2024-03-09T14:14:51.012 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-09T14:14:51.012 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484 --description rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} --owner scheduled_cbodley@teuthology --name cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi --verbose -- /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484/orig.config.yaml 2024-03-09T14:14:51.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T14:14:51.143 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484 branch: wip-rgw-account-v3 description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7588484' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rgw-account-v3 ceph: conf: client: debug rgw: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: true frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 force-branch: wip-iam-user-apis git_remote: https://github.com/cbodley/ slow_backend: true storage classes: LUKEWARM, FROZEN selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-account-v3 sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 owner: scheduled_cbodley@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 3347 sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-account-v3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLdtrRT99sDurN4PmqBejSe8+hw5Kx40rgqwoN57B61MTNS+gxPUGjelnDy0ix9LAM9V6Hy+V216d7iKXZ+p8f8= smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ7LiqayEOgfVyz0QeLjdO0Z/3ilRQWwBCs/yi1K4gMIDHnub5mWKmMowyZxsw1WoaTZc6Y46AvcIdZP2bJLO4o= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-09_13:26:09 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-09T14:14:51.143 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa; will attempt to use it 2024-03-09T14:14:51.144 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks 2024-03-09T14:14:51.144 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-09T14:14:51.145 INFO:teuthology.task.internal:Checking packages... 2024-03-09T14:14:51.169 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c00d9c609fb42a2a25f1c196bed064ca8bb02413' 2024-03-09T14:14:51.169 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-09T14:14:51.169 INFO:teuthology.packaging:ref: None 2024-03-09T14:14:51.169 INFO:teuthology.packaging:tag: None 2024-03-09T14:14:51.169 INFO:teuthology.packaging:branch: wip-rgw-account-v3 2024-03-09T14:14:51.169 INFO:teuthology.packaging:sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:14:51.170 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rgw-account-v3 2024-03-09T14:14:51.416 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2079.gc00d9c60 2024-03-09T14:14:51.418 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-09T14:14:51.424 INFO:teuthology.task.internal:no buildpackages task found 2024-03-09T14:14:51.424 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-09T14:14:51.572 INFO:teuthology.task.internal:Saving configuration 2024-03-09T14:14:51.589 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-09T14:14:51.595 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-09T14:14:51.620 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-09 14:09:18.450602', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLdtrRT99sDurN4PmqBejSe8+hw5Kx40rgqwoN57B61MTNS+gxPUGjelnDy0ix9LAM9V6Hy+V216d7iKXZ+p8f8='} 2024-03-09T14:14:51.645 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-09 14:09:18.451697', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ7LiqayEOgfVyz0QeLjdO0Z/3ilRQWwBCs/yi1K4gMIDHnub5mWKmMowyZxsw1WoaTZc6Y46AvcIdZP2bJLO4o='} 2024-03-09T14:14:51.645 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-09T14:14:51.651 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-03-09T14:14:51.652 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-03-09T14:14:51.652 INFO:teuthology.run_tasks:Running task console_log... 2024-03-09T14:14:51.722 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f14b29450d0>, signals=[15]) 2024-03-09T14:14:51.722 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-09T14:14:51.728 INFO:teuthology.task.internal:Opening connections... 2024-03-09T14:14:51.728 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2024-03-09T14:14:51.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:14:51.820 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2024-03-09T14:14:51.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:14:51.914 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-09T14:14:51.922 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-03-09T14:14:51.940 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-03-09T14:14:51.940 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-03-09T14:14:51.997 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-03-09T14:14:51.997 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-03-09T14:14:51.997 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-03-09T14:14:51.997 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-03-09T14:14:51.997 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-03-09T14:14:51.997 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-03-09T14:14:51.997 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-09T14:14:51.997 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-03-09T14:14:51.998 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-03-09T14:14:51.998 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-09T14:14:51.998 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-03-09T14:14:51.998 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-09T14:14:51.998 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-09T14:14:51.998 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-09T14:14:51.999 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-03-09T14:14:52.024 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-03-09T14:14:52.041 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-03-09T14:14:52.042 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-03-09T14:14:52.098 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2024-03-09T14:14:52.098 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2024-03-09T14:14:52.099 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2024-03-09T14:14:52.099 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2024-03-09T14:14:52.099 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2024-03-09T14:14:52.099 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2024-03-09T14:14:52.099 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-09T14:14:52.099 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-03-09T14:14:52.099 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2024-03-09T14:14:52.099 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-09T14:14:52.099 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2024-03-09T14:14:52.099 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-09T14:14:52.099 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-09T14:14:52.099 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-09T14:14:52.100 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-03-09T14:14:52.166 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-09T14:14:52.175 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-09T14:14:52.181 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-09T14:14:52.181 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2024-03-09T14:14:52.184 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2024-03-09T14:14:52.199 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-09T14:14:52.205 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-09T14:14:52.205 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2024-03-09T14:14:52.242 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2024-03-09T14:14:52.336 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-09T14:14:52.390 INFO:teuthology.run_tasks:Running task kernel... 2024-03-09T14:14:52.405 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-09T14:14:52.405 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-09T14:14:52.405 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-09T14:14:52.406 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-09T14:14:52.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:14:52.423 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2024-03-09T14:14:52.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:14:52.424 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-03-09T14:14:52.480 INFO:teuthology.orchestra.run.smithi132.stdout:5.14.0-361.el9.x86_64 2024-03-09T14:14:52.480 INFO:teuthology.task.kernel:Running kernel on smithi132: 5.14.0-361.el9.x86_64 2024-03-09T14:14:52.480 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum install -y kernel 2024-03-09T14:14:52.481 INFO:teuthology.orchestra.run.smithi088.stdout:5.14.0-361.el9.x86_64 2024-03-09T14:14:52.481 INFO:teuthology.task.kernel:Running kernel on smithi088: 5.14.0-361.el9.x86_64 2024-03-09T14:14:52.481 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum install -y kernel 2024-03-09T14:14:54.547 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-09T14:14:54.635 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-09T14:14:56.014 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.0 MB 00:00 2024-03-09T14:14:56.068 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - BaseOS 6.8 MB/s | 2.0 MB 00:00 2024-03-09T14:14:57.317 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.0 MB 00:00 2024-03-09T14:14:58.113 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.0 MB 00:01 2024-03-09T14:15:20.475 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 873 kB/s | 19 MB 00:22 2024-03-09T14:15:21.334 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 870 kB/s | 19 MB 00:22 2024-03-09T14:15:25.241 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.1 MB 00:01 2024-03-09T14:15:25.826 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 6.1 MB 00:01 2024-03-09T14:15:27.450 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 15 kB 00:01 2024-03-09T14:15:27.610 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 15 kB 00:00 2024-03-09T14:15:28.954 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-03-09T14:15:30.037 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 21 MB 00:02 2024-03-09T14:15:34.035 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-03-09T14:15:34.919 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-03-09T14:15:36.217 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-09T14:15:36.217 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-09T14:15:36.306 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-03-09T14:15:36.312 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-03-09T14:15:36.312 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2024-03-09T14:15:36.312 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-03-09T14:15:36.312 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-03-09T14:15:36.312 INFO:teuthology.orchestra.run.smithi132.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-09T14:15:36.313 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-03-09T14:15:36.313 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-09T14:15:36.313 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-09T14:15:36.313 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-09T14:15:36.313 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:15:36.313 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-03-09T14:15:36.313 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-03-09T14:15:36.313 INFO:teuthology.orchestra.run.smithi132.stdout:Install 4 Packages 2024-03-09T14:15:36.313 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:15:36.314 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 100 M 2024-03-09T14:15:36.314 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 123 M 2024-03-09T14:15:36.314 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-03-09T14:15:37.076 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-09T14:15:37.076 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-09T14:15:37.159 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-03-09T14:15:37.169 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-03-09T14:15:37.169 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-03-09T14:15:37.169 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-03-09T14:15:37.169 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-03-09T14:15:37.169 INFO:teuthology.orchestra.run.smithi088.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-09T14:15:37.169 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-03-09T14:15:37.169 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-09T14:15:37.169 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-09T14:15:37.169 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-09T14:15:37.169 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:15:37.169 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-03-09T14:15:37.169 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-03-09T14:15:37.170 INFO:teuthology.orchestra.run.smithi088.stdout:Install 4 Packages 2024-03-09T14:15:37.170 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:15:37.170 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 100 M 2024-03-09T14:15:37.170 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 123 M 2024-03-09T14:15:37.170 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-03-09T14:15:37.337 INFO:teuthology.orchestra.run.smithi132.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 7.9 MB/s | 6.0 MB 00:00 2024-03-09T14:15:37.487 INFO:teuthology.orchestra.run.smithi088.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 22 MB/s | 6.0 MB 00:00 2024-03-09T14:15:37.812 INFO:teuthology.orchestra.run.smithi088.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 35 MB/s | 21 MB 00:00 2024-03-09T14:15:38.362 INFO:teuthology.orchestra.run.smithi088.stdout:(3/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 34 MB/s | 39 MB 00:01 2024-03-09T14:15:38.679 INFO:teuthology.orchestra.run.smithi088.stdout:(4/4): kernel-modules-core-5.14.0-427.el9.x86_6 28 MB/s | 33 MB 00:01 2024-03-09T14:15:38.679 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-03-09T14:15:38.680 INFO:teuthology.orchestra.run.smithi088.stdout:Total 66 MB/s | 100 MB 00:01 2024-03-09T14:15:38.912 INFO:teuthology.orchestra.run.smithi132.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 8.9 MB/s | 21 MB 00:02 2024-03-09T14:15:39.562 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-03-09T14:15:39.939 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-03-09T14:15:39.939 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-03-09T14:15:40.495 INFO:teuthology.orchestra.run.smithi132.stdout:(3/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 10 MB/s | 39 MB 00:03 2024-03-09T14:15:40.812 INFO:teuthology.orchestra.run.smithi132.stdout:(4/4): kernel-modules-core-5.14.0-427.el9.x86_6 9.6 MB/s | 33 MB 00:03 2024-03-09T14:15:40.813 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-03-09T14:15:40.813 INFO:teuthology.orchestra.run.smithi132.stdout:Total 22 MB/s | 100 MB 00:04 2024-03-09T14:15:41.302 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-03-09T14:15:41.302 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-03-09T14:15:41.700 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-03-09T14:15:42.072 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-03-09T14:15:42.072 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-03-09T14:15:43.739 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-03-09T14:15:43.739 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-03-09T14:15:44.011 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-03-09T14:15:44.667 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-09T14:15:44.804 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-09T14:15:46.672 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-03-09T14:15:47.328 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-09T14:15:47.457 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-09T14:15:47.573 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-09T14:15:47.757 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-09T14:15:50.242 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-09T14:15:50.419 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-09T14:15:52.476 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-09T14:15:52.608 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:15:55.172 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-09T14:15:55.320 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:15:57.360 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:16:00.115 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:16:26.657 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:16:26.658 INFO:teuthology.orchestra.run.smithi088.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-09T14:16:26.658 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:16:26.742 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:16:27.212 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:16:27.212 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-09T14:16:27.212 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-09T14:16:27.212 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-09T14:16:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:16:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:16:27.639 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-03-09T14:16:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-09T14:16:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-09T14:16:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-09T14:16:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-09T14:16:27.639 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:16:27.639 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-03-09T14:16:28.184 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2024-03-09T14:16:28.336 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-09T14:16:28.336 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-09T14:16:28.336 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-09T14:16:28.336 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-09T14:16:28.336 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-09T14:16:28.336 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-09T14:16:28.337 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=None, version=distro) 2024-03-09T14:16:28.337 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2024-03-09T14:16:28.457 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-09T14:16:28.457 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-09T14:16:28.458 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2024-03-09T14:16:28.491 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2024-03-09T14:16:28.491 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2024-03-09T14:16:28.492 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.06 2024-03-09T14:16:28.492 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 68.el9 2024-03-09T14:16:28.492 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2024-03-09T14:16:28.492 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-09T14:16:28.492 INFO:teuthology.orchestra.run.smithi088.stdout:Group : Unspecified 2024-03-09T14:16:28.492 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 8264254 2024-03-09T14:16:28.492 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2024-03-09T14:16:28.492 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-09T14:16:28.492 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-09T14:16:28.492 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-09T14:16:28.492 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-09T14:16:28.492 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : builder@centos.org 2024-03-09T14:16:28.492 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : CentOS 2024-03-09T14:16:28.492 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-09T14:16:28.493 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2024-03-09T14:16:28.493 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2024-03-09T14:16:28.493 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:16:28.493 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-09T14:16:28.493 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-09T14:16:28.493 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-09T14:16:28.493 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2024-03-09T14:16:28.493 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:16:28.493 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2024-03-09T14:16:28.494 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-09T14:16:28.494 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 5.14.0-427.el9.x86_64 2024-03-09T14:16:28.494 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-09T14:16:29.142 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2024-03-09T14:16:29.178 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:16:29.179 INFO:teuthology.orchestra.run.smithi132.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-09T14:16:29.179 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:16:29.263 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:16:29.666 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:16:29.666 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-09T14:16:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-09T14:16:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-09T14:16:30.070 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:16:30.071 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:16:30.071 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-03-09T14:16:30.071 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-09T14:16:30.071 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-09T14:16:30.071 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-09T14:16:30.071 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-09T14:16:30.071 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:16:30.072 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-03-09T14:16:30.505 INFO:teuthology.orchestra.run.smithi088.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-09T14:16:30.550 INFO:teuthology.orchestra.run.smithi088.stderr:done 2024-03-09T14:16:30.553 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-03-09T14:16:30.569 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.wPABAU14Xs 2024-03-09T14:16:30.569 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wPABAU14Xs 2024-03-09T14:16:30.618 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q kernel | sort -rV | head -n 1 2024-03-09T14:16:30.639 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.wPABAU14Xs 2024-03-09T14:16:30.774 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.wPABAU14Xs is 6KB 2024-03-09T14:16:30.803 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-09T14:16:30.804 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-09T14:16:30.804 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-09T14:16:30.804 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-09T14:16:30.804 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-09T14:16:30.805 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-09T14:16:30.805 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi132.front.sepia.ceph.com, path=None, version=distro) 2024-03-09T14:16:30.805 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q kernel | sort -rV | head -n 1 2024-03-09T14:16:30.822 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.wPABAU14Xs 2024-03-09T14:16:30.836 DEBUG:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2024-03-09T14:16:30.907 INFO:teuthology.orchestra.run.smithi088.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-09T14:16:30.907 INFO:teuthology.orchestra.run.smithi088.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-09T14:16:30.907 INFO:teuthology.orchestra.run.smithi088.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-09T14:16:30.907 INFO:teuthology.orchestra.run.smithi088.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-09T14:16:30.908 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-09T14:16:30.927 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-09T14:16:30.927 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-09T14:16:30.928 DEBUG:teuthology.orchestra.run.smithi132:> sudo rpm -qi grub2-tools 2024-03-09T14:16:30.971 INFO:teuthology.orchestra.run.smithi132.stdout:Name : grub2-tools 2024-03-09T14:16:30.971 INFO:teuthology.orchestra.run.smithi132.stdout:Epoch : 1 2024-03-09T14:16:30.971 INFO:teuthology.orchestra.run.smithi132.stdout:Version : 2.06 2024-03-09T14:16:30.971 INFO:teuthology.orchestra.run.smithi132.stdout:Release : 68.el9 2024-03-09T14:16:30.971 INFO:teuthology.orchestra.run.smithi132.stdout:Architecture: x86_64 2024-03-09T14:16:30.972 INFO:teuthology.orchestra.run.smithi132.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-09T14:16:30.972 INFO:teuthology.orchestra.run.smithi132.stdout:Group : Unspecified 2024-03-09T14:16:30.972 INFO:teuthology.orchestra.run.smithi132.stdout:Size : 8264254 2024-03-09T14:16:30.972 INFO:teuthology.orchestra.run.smithi132.stdout:License : GPLv3+ 2024-03-09T14:16:30.972 INFO:teuthology.orchestra.run.smithi132.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-09T14:16:30.972 INFO:teuthology.orchestra.run.smithi132.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-09T14:16:30.972 INFO:teuthology.orchestra.run.smithi132.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-09T14:16:30.972 INFO:teuthology.orchestra.run.smithi132.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-09T14:16:30.972 INFO:teuthology.orchestra.run.smithi132.stdout:Packager : builder@centos.org 2024-03-09T14:16:30.972 INFO:teuthology.orchestra.run.smithi132.stdout:Vendor : CentOS 2024-03-09T14:16:30.972 INFO:teuthology.orchestra.run.smithi132.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-09T14:16:30.972 INFO:teuthology.orchestra.run.smithi132.stdout:Summary : Support tools for GRUB. 2024-03-09T14:16:30.972 INFO:teuthology.orchestra.run.smithi132.stdout:Description : 2024-03-09T14:16:30.972 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:16:30.973 INFO:teuthology.orchestra.run.smithi132.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-09T14:16:30.973 INFO:teuthology.orchestra.run.smithi132.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-09T14:16:30.973 INFO:teuthology.orchestra.run.smithi132.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-09T14:16:30.973 INFO:teuthology.orchestra.run.smithi132.stdout:hardware devices. 2024-03-09T14:16:30.973 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:16:30.973 INFO:teuthology.orchestra.run.smithi132.stdout:This subpackage provides tools for support of all platforms. 2024-03-09T14:16:30.974 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-09T14:16:30.974 INFO:teuthology.task.kernel:Updating grub on smithi132 to boot 5.14.0-427.el9.x86_64 2024-03-09T14:16:30.974 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-09T14:16:31.067 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2024-03-09T14:16:31.507 INFO:teuthology.orchestra.run.smithi132.stderr:Generating grub configuration file ... 2024-03-09T14:16:32.881 INFO:teuthology.orchestra.run.smithi132.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-09T14:16:32.918 INFO:teuthology.orchestra.run.smithi132.stderr:done 2024-03-09T14:16:32.920 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2024-03-09T14:16:32.935 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.WnKm9zYs87 2024-03-09T14:16:32.935 DEBUG:teuthology.orchestra.run.smithi132:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.WnKm9zYs87 2024-03-09T14:16:33.005 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.WnKm9zYs87 2024-03-09T14:16:33.148 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.WnKm9zYs87 is 6KB 2024-03-09T14:16:33.197 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.WnKm9zYs87 2024-03-09T14:16:33.211 DEBUG:teuthology.orchestra.run.smithi132:> sudo /bin/ls /boot/loader/entries || true 2024-03-09T14:16:33.276 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-09T14:16:33.277 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-09T14:16:33.277 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-09T14:16:33.277 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-09T14:16:33.278 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-09T14:16:33.452 DEBUG:teuthology.orchestra.run.smithi132:> sudo shutdown -r now 2024-03-09T14:17:01.098 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-09T14:17:01.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-03-09T14:17:01.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:17:03.457 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-09T14:17:03.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-03-09T14:17:03.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:17:19.646 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-03-09T14:17:21.950 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-03-09T14:17:28.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-03-09T14:17:28.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:17:30.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-03-09T14:17:30.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:17:31.710 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-03-09T14:17:43.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-03-09T14:17:43.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:17:46.782 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-03-09T14:18:01.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-03-09T14:18:01.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:18:30.986 DEBUG:teuthology.orchestra.remote:timed out 2024-03-09T14:18:33.705 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-03-09T14:18:34.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-03-09T14:18:34.189 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-427.el9.x86_64"... 2024-03-09T14:18:34.190 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-03-09T14:18:34.203 INFO:teuthology.orchestra.run.smithi088.stdout:5.14.0-427.el9.x86_64 2024-03-09T14:18:34.204 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-09T14:18:34.204 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-09T14:18:34.204 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-09T14:18:35.204 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-09T14:18:35.205 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-09T14:18:35.264 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2024-03-09T14:18:35.300 DEBUG:teuthology.parallel:result is None 2024-03-09T14:18:42.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-03-09T14:18:42.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:18:43.375 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-03-09T14:18:43.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-03-09T14:18:43.794 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-427.el9.x86_64"... 2024-03-09T14:18:43.794 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2024-03-09T14:18:43.810 INFO:teuthology.orchestra.run.smithi132.stdout:5.14.0-427.el9.x86_64 2024-03-09T14:18:43.810 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-09T14:18:43.810 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-09T14:18:43.810 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-09T14:18:44.811 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-09T14:18:44.812 DEBUG:teuthology.orchestra.run.smithi132:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-09T14:18:44.878 INFO:teuthology.orchestra.run.smithi132.stdout:ttyS1 2024-03-09T14:18:44.912 DEBUG:teuthology.parallel:result is None 2024-03-09T14:18:44.912 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-09T14:18:44.923 INFO:teuthology.task.internal:Creating test directory... 2024-03-09T14:18:44.924 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-09T14:18:44.926 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-09T14:18:44.944 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-09T14:18:44.951 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-09T14:18:44.959 INFO:teuthology.task.internal:Creating archive directory... 2024-03-09T14:18:44.959 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-09T14:18:44.985 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-09T14:18:45.125 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-09T14:18:45.131 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-09T14:18:45.132 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-09T14:18:45.134 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-09T14:18:45.172 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-09T14:18:45.175 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-09T14:18:45.186 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-09T14:18:45.189 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-09T14:18:45.191 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-09T14:18:45.199 INFO:teuthology.task.internal:Configuring sudo... 2024-03-09T14:18:45.199 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-09T14:18:45.230 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-09T14:18:45.263 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-09T14:18:45.271 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-09T14:18:45.272 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-09T14:18:45.301 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-09T14:18:45.319 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-09T14:18:45.401 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-09T14:18:45.455 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-09T14:18:45.539 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-09T14:18:45.584 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:18:45.584 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-09T14:18:45.654 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-09T14:18:45.699 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-09T14:18:45.749 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-09T14:18:45.832 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-09T14:18:45.876 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:18:45.876 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-09T14:18:45.945 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2024-03-09T14:18:45.947 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2024-03-09T14:18:45.992 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-09T14:18:46.041 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-09T14:18:46.304 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-09T14:18:46.313 INFO:teuthology.task.internal:Starting timer... 2024-03-09T14:18:46.313 INFO:teuthology.run_tasks:Running task pcp... 2024-03-09T14:18:46.333 INFO:teuthology.run_tasks:Running task selinux... 2024-03-09T14:18:46.341 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-09T14:18:46.342 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2024-03-09T14:18:46.401 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2024-03-09T14:18:46.403 DEBUG:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2024-03-09T14:18:46.460 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: 2024-03-09T14:18:46.463 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-09T14:18:46.463 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2024-03-09T14:18:46.491 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2024-03-09T14:18:46.491 DEBUG:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2024-03-09T14:18:46.514 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2024-03-09T14:18:46.515 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi132.front.sepia.ceph.com': 'permissive'} 2024-03-09T14:18:46.515 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-09T14:18:46.561 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:18:46.562 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-09T14:18:46.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:18:46.589 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-09T14:18:46.589 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2024-03-09T14:18:46.642 DEBUG:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2024-03-09T14:18:46.675 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-09T14:18:46.684 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-09T14:18:46.689 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-09T14:18:46.804 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-09T14:18:46.821 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-09T14:18:46.822 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi132.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-09T14:22:59.907 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi132.front.sepia.ceph.com')] 2024-03-09T14:22:59.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-03-09T14:22:59.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:22:59.997 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-03-09T14:23:00.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-03-09T14:23:00.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-03-09T14:23:00.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:23:00.167 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-03-09T14:23:00.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-03-09T14:23:00.246 INFO:teuthology.run_tasks:Running task clock... 2024-03-09T14:23:00.256 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-09T14:23:00.256 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-09T14:23:00.257 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-09T14:23:00.259 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-09T14:23:00.259 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-09T14:23:00.287 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-09T14:23:00.304 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-09T14:23:00.318 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-09T14:23:00.332 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2024-03-09T14:23:00.335 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-09T14:23:00.346 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2024-03-09T14:23:00.362 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-09T14:23:00.365 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: ntpd: command not found 2024-03-09T14:23:00.378 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-09T14:23:00.379 INFO:teuthology.orchestra.run.smithi132.stdout:506 Cannot talk to daemon 2024-03-09T14:23:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-09T14:23:00.412 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-09T14:23:00.433 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-03-09T14:23:00.437 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-09T14:23:00.437 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-03-09T14:23:00.437 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:23:00.437 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:23:00.437 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:23:00.437 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:23:00.463 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2024-03-09T14:23:00.467 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-09T14:23:00.467 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-03-09T14:23:00.467 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:23:00.467 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:23:00.467 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:23:00.467 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:23:00.467 INFO:teuthology.run_tasks:Running task install... 2024-03-09T14:23:00.476 DEBUG:teuthology.task.install:project ceph 2024-03-09T14:23:00.476 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'}} 2024-03-09T14:23:00.476 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'} 2024-03-09T14:23:00.476 INFO:teuthology.task.install:Using flavor: default 2024-03-09T14:23:00.481 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-09T14:23:00.481 INFO:teuthology.task.install:extra packages: [] 2024-03-09T14:23:00.482 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413', 'tag': None, 'wait_for_package': False} 2024-03-09T14:23:00.482 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:23:00.484 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413', 'tag': None, 'wait_for_package': False} 2024-03-09T14:23:00.485 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:23:00.700 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/ 2024-03-09T14:23:00.701 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2079.gc00d9c60 2024-03-09T14:23:00.719 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/ 2024-03-09T14:23:00.720 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2079.gc00d9c60 2024-03-09T14:23:00.872 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-09T14:23:00.872 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:23:00.872 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-09T14:23:00.892 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-09T14:23:00.892 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:23:00.892 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-09T14:23:00.901 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-03-09T14:23:00.901 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c00d9c609fb42a2a25f1c196bed064ca8bb02413/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-09T14:23:00.921 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-03-09T14:23:00.921 DEBUG:teuthology.orchestra.run.smithi132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c00d9c609fb42a2a25f1c196bed064ca8bb02413/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-09T14:23:00.970 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-09T14:23:00.988 DEBUG:teuthology.orchestra.run.smithi132:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-09T14:23:01.051 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-09T14:23:01.068 DEBUG:teuthology.orchestra.run.smithi132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-09T14:23:01.118 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2024-03-09T14:23:01.119 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2024-03-09T14:23:01.135 INFO:teuthology.orchestra.run.smithi132.stdout:check_obsoletes = 1 2024-03-09T14:23:01.136 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum clean all 2024-03-09T14:23:01.354 INFO:teuthology.orchestra.run.smithi088.stdout:74 files removed 2024-03-09T14:23:01.383 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-03-09T14:23:01.384 INFO:teuthology.orchestra.run.smithi132.stdout:74 files removed 2024-03-09T14:23:01.410 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-03-09T14:23:02.024 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 251 kB/s | 82 kB 00:00 2024-03-09T14:23:02.130 INFO:teuthology.orchestra.run.smithi132.stdout:ceph packages for x86_64 206 kB/s | 82 kB 00:00 2024-03-09T14:23:02.449 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 27 kB/s | 10 kB 00:00 2024-03-09T14:23:02.556 INFO:teuthology.orchestra.run.smithi132.stdout:ceph noarch packages 27 kB/s | 10 kB 00:00 2024-03-09T14:23:02.825 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-03-09T14:23:02.973 INFO:teuthology.orchestra.run.smithi132.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-03-09T14:23:03.384 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - AppStream 18 MB/s | 6.7 MB 00:00 2024-03-09T14:23:03.461 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-03-09T14:23:04.844 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-9 - BaseOS 7.3 MB/s | 2.0 MB 00:00 2024-03-09T14:23:05.067 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - BaseOS 3.5 MB/s | 2.0 MB 00:00 2024-03-09T14:23:06.150 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-03-09T14:23:08.245 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-03-09T14:23:09.101 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 2.0 MB/s | 8.0 MB 00:03 2024-03-09T14:23:12.185 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.1 MB 00:00 2024-03-09T14:23:13.778 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 15 kB 00:00 2024-03-09T14:23:15.207 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-03-09T14:23:18.942 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 2.1 MB/s | 19 MB 00:08 2024-03-09T14:23:20.087 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-03-09T14:23:22.592 INFO:teuthology.orchestra.run.smithi132.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-09T14:23:22.593 INFO:teuthology.orchestra.run.smithi132.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-09T14:23:22.702 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-03-09T14:23:22.720 INFO:teuthology.orchestra.run.smithi132.stdout:=========================================================================================================== 2024-03-09T14:23:22.720 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-03-09T14:23:22.720 INFO:teuthology.orchestra.run.smithi132.stdout:=========================================================================================================== 2024-03-09T14:23:22.720 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-03-09T14:23:22.720 INFO:teuthology.orchestra.run.smithi132.stdout: ceph x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 6.6 k 2024-03-09T14:23:22.720 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 5.4 M 2024-03-09T14:23:22.720 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 888 k 2024-03-09T14:23:22.720 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 145 k 2024-03-09T14:23:22.721 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 1.5 M 2024-03-09T14:23:22.721 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 139 k 2024-03-09T14:23:22.721 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 1.8 M 2024-03-09T14:23:22.721 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 7.4 M 2024-03-09T14:23:22.721 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 49 k 2024-03-09T14:23:22.721 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 10 M 2024-03-09T14:23:22.721 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 48 M 2024-03-09T14:23:22.721 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 264 k 2024-03-09T14:23:22.721 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 749 k 2024-03-09T14:23:22.721 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 31 k 2024-03-09T14:23:22.721 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 745 k 2024-03-09T14:23:22.721 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 127 k 2024-03-09T14:23:22.721 INFO:teuthology.orchestra.run.smithi132.stdout: maven noarch 1:3.6.3-15.el9 CentOS-AppStream 17 k 2024-03-09T14:23:22.721 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 162 k 2024-03-09T14:23:22.722 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 321 k 2024-03-09T14:23:22.722 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 299 k 2024-03-09T14:23:22.722 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 99 k 2024-03-09T14:23:22.722 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 85 k 2024-03-09T14:23:22.722 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 3.1 M 2024-03-09T14:23:22.722 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 170 k 2024-03-09T14:23:22.722 INFO:teuthology.orchestra.run.smithi132.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-03-09T14:23:22.722 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2024-03-09T14:23:22.722 INFO:teuthology.orchestra.run.smithi132.stdout: librados2 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 3.4 M 2024-03-09T14:23:22.722 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 3.1 M 2024-03-09T14:23:22.722 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-03-09T14:23:22.722 INFO:teuthology.orchestra.run.smithi132.stdout: ModemManager-glib x86_64 1.20.2-1.el9 CentOS-BaseOS 334 k 2024-03-09T14:23:22.723 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-09T14:23:22.723 INFO:teuthology.orchestra.run.smithi132.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 CentOS-AppStream 625 k 2024-03-09T14:23:22.723 INFO:teuthology.orchestra.run.smithi132.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 CentOS-AppStream 11 M 2024-03-09T14:23:22.723 INFO:teuthology.orchestra.run.smithi132.stdout: alsa-lib x86_64 1.2.10-2.el9 appstream 523 k 2024-03-09T14:23:22.723 INFO:teuthology.orchestra.run.smithi132.stdout: apache-commons-cli noarch 1.4-17.el9 CentOS-AppStream 70 k 2024-03-09T14:23:22.723 INFO:teuthology.orchestra.run.smithi132.stdout: apache-commons-codec noarch 1.15-7.el9 CentOS-AppStream 301 k 2024-03-09T14:23:22.723 INFO:teuthology.orchestra.run.smithi132.stdout: apache-commons-io noarch 1:2.8.0-8.el9 CentOS-AppStream 282 k 2024-03-09T14:23:22.723 INFO:teuthology.orchestra.run.smithi132.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 CentOS-AppStream 558 k 2024-03-09T14:23:22.723 INFO:teuthology.orchestra.run.smithi132.stdout: at-spi2-atk x86_64 2.38.0-4.el9 CentOS-AppStream 86 k 2024-03-09T14:23:22.723 INFO:teuthology.orchestra.run.smithi132.stdout: at-spi2-core x86_64 2.40.3-1.el9 CentOS-AppStream 176 k 2024-03-09T14:23:22.723 INFO:teuthology.orchestra.run.smithi132.stdout: atinject noarch 1.0.3-6.el9 CentOS-AppStream 22 k 2024-03-09T14:23:22.723 INFO:teuthology.orchestra.run.smithi132.stdout: atk x86_64 2.36.0-5.el9 CentOS-AppStream 270 k 2024-03-09T14:23:22.723 INFO:teuthology.orchestra.run.smithi132.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2024-03-09T14:23:22.723 INFO:teuthology.orchestra.run.smithi132.stdout: bluez-libs x86_64 5.64-1.el9 CentOS-BaseOS 83 k 2024-03-09T14:23:22.724 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-09T14:23:22.724 INFO:teuthology.orchestra.run.smithi132.stdout: bubblewrap x86_64 0.4.1-6.el9 CentOS-BaseOS 49 k 2024-03-09T14:23:22.724 INFO:teuthology.orchestra.run.smithi132.stdout: cdi-api noarch 2.0.2-6.el9 CentOS-AppStream 52 k 2024-03-09T14:23:22.724 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 20 M 2024-03-09T14:23:22.724 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 34 k 2024-03-09T14:23:22.724 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 2.1 M 2024-03-09T14:23:22.724 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 248 k 2024-03-09T14:23:22.724 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 4.7 M 2024-03-09T14:23:22.724 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 17 M 2024-03-09T14:23:22.724 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 16 k 2024-03-09T14:23:22.724 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 25 k 2024-03-09T14:23:22.724 INFO:teuthology.orchestra.run.smithi132.stdout: colord-libs x86_64 1.4.5-4.el9 CentOS-AppStream 228 k 2024-03-09T14:23:22.724 INFO:teuthology.orchestra.run.smithi132.stdout: copy-jdk-configs noarch 4.0-3.el9 CentOS-AppStream 27 k 2024-03-09T14:23:22.725 INFO:teuthology.orchestra.run.smithi132.stdout: cups-libs x86_64 1:2.3.3op2-24.el9 baseos 262 k 2024-03-09T14:23:22.725 INFO:teuthology.orchestra.run.smithi132.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 CentOS-AppStream 524 k 2024-03-09T14:23:22.725 INFO:teuthology.orchestra.run.smithi132.stdout: exiv2-libs x86_64 0.27.5-2.el9 CentOS-AppStream 780 k 2024-03-09T14:23:22.725 INFO:teuthology.orchestra.run.smithi132.stdout: fdk-aac-free x86_64 2.0.0-8.el9 CentOS-AppStream 324 k 2024-03-09T14:23:22.725 INFO:teuthology.orchestra.run.smithi132.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-03-09T14:23:22.725 INFO:teuthology.orchestra.run.smithi132.stdout: flatpak-selinux noarch 1.12.8-1.el9 CentOS-AppStream 20 k 2024-03-09T14:23:22.725 INFO:teuthology.orchestra.run.smithi132.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 CentOS-AppStream 73 k 2024-03-09T14:23:22.725 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-09T14:23:22.725 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-09T14:23:22.725 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-09T14:23:22.725 INFO:teuthology.orchestra.run.smithi132.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-09T14:23:22.725 INFO:teuthology.orchestra.run.smithi132.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 CentOS-AppStream 84 k 2024-03-09T14:23:22.725 INFO:teuthology.orchestra.run.smithi132.stdout: geoclue2 x86_64 2.6.0-7.el9 CentOS-AppStream 122 k 2024-03-09T14:23:22.725 INFO:teuthology.orchestra.run.smithi132.stdout: giflib x86_64 5.2.1-9.el9 CentOS-AppStream 47 k 2024-03-09T14:23:22.726 INFO:teuthology.orchestra.run.smithi132.stdout: google-guice noarch 4.2.3-9.el9 CentOS-AppStream 472 k 2024-03-09T14:23:22.726 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-09T14:23:22.726 INFO:teuthology.orchestra.run.smithi132.stdout: graphene x86_64 1.10.6-2.el9 CentOS-AppStream 63 k 2024-03-09T14:23:22.726 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-09T14:23:22.726 INFO:teuthology.orchestra.run.smithi132.stdout: gsm x86_64 1.0.19-6.el9 CentOS-AppStream 33 k 2024-03-09T14:23:22.726 INFO:teuthology.orchestra.run.smithi132.stdout: gstreamer1 x86_64 1.22.1-2.el9 CentOS-AppStream 1.4 M 2024-03-09T14:23:22.726 INFO:teuthology.orchestra.run.smithi132.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-03-09T14:23:22.726 INFO:teuthology.orchestra.run.smithi132.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 CentOS-AppStream 34 k 2024-03-09T14:23:22.726 INFO:teuthology.orchestra.run.smithi132.stdout: guava noarch 30.1-6.el9 CentOS-AppStream 2.3 M 2024-03-09T14:23:22.726 INFO:teuthology.orchestra.run.smithi132.stdout: hicolor-icon-theme noarch 0.17-13.el9 CentOS-AppStream 65 k 2024-03-09T14:23:22.726 INFO:teuthology.orchestra.run.smithi132.stdout: httpcomponents-client noarch 4.5.13-3.el9 CentOS-AppStream 656 k 2024-03-09T14:23:22.726 INFO:teuthology.orchestra.run.smithi132.stdout: httpcomponents-core noarch 4.4.13-7.el9 CentOS-AppStream 630 k 2024-03-09T14:23:22.726 INFO:teuthology.orchestra.run.smithi132.stdout: iso-codes noarch 4.6.0-3.el9 CentOS-AppStream 3.3 M 2024-03-09T14:23:22.727 INFO:teuthology.orchestra.run.smithi132.stdout: jakarta-annotations noarch 1.3.5-13.el9 CentOS-AppStream 44 k 2024-03-09T14:23:22.727 INFO:teuthology.orchestra.run.smithi132.stdout: jansi x86_64 2.3.3-6.el9 CentOS-AppStream 108 k 2024-03-09T14:23:22.727 INFO:teuthology.orchestra.run.smithi132.stdout: java-11-openjdk x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 439 k 2024-03-09T14:23:22.727 INFO:teuthology.orchestra.run.smithi132.stdout: java-11-openjdk-headless x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 40 M 2024-03-09T14:23:22.727 INFO:teuthology.orchestra.run.smithi132.stdout: javapackages-filesystem noarch 6.0.0-4.el9 CentOS-AppStream 10 k 2024-03-09T14:23:22.727 INFO:teuthology.orchestra.run.smithi132.stdout: jbigkit-libs x86_64 2.1-23.el9 CentOS-AppStream 52 k 2024-03-09T14:23:22.727 INFO:teuthology.orchestra.run.smithi132.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 CentOS-AppStream 23 k 2024-03-09T14:23:22.727 INFO:teuthology.orchestra.run.smithi132.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-09T14:23:22.727 INFO:teuthology.orchestra.run.smithi132.stdout: jsoup noarch 1.13.1-10.el9 CentOS-AppStream 376 k 2024-03-09T14:23:22.727 INFO:teuthology.orchestra.run.smithi132.stdout: jsr-305 noarch 3.0.2-6.el9 CentOS-AppStream 31 k 2024-03-09T14:23:22.727 INFO:teuthology.orchestra.run.smithi132.stdout: lcms2 x86_64 2.12-3.el9 CentOS-AppStream 166 k 2024-03-09T14:23:22.727 INFO:teuthology.orchestra.run.smithi132.stdout: libX11-xcb x86_64 1.7.0-8.el9 CentOS-AppStream 9.8 k 2024-03-09T14:23:22.727 INFO:teuthology.orchestra.run.smithi132.stdout: libXcomposite x86_64 0.4.5-7.el9 CentOS-AppStream 23 k 2024-03-09T14:23:22.727 INFO:teuthology.orchestra.run.smithi132.stdout: libXcursor x86_64 1.2.0-7.el9 CentOS-AppStream 30 k 2024-03-09T14:23:22.728 INFO:teuthology.orchestra.run.smithi132.stdout: libXdamage x86_64 1.1.5-7.el9 CentOS-AppStream 22 k 2024-03-09T14:23:22.728 INFO:teuthology.orchestra.run.smithi132.stdout: libXfixes x86_64 5.0.3-16.el9 CentOS-AppStream 19 k 2024-03-09T14:23:22.728 INFO:teuthology.orchestra.run.smithi132.stdout: libXi x86_64 1.7.10-8.el9 CentOS-AppStream 38 k 2024-03-09T14:23:22.728 INFO:teuthology.orchestra.run.smithi132.stdout: libXinerama x86_64 1.1.4-10.el9 CentOS-AppStream 14 k 2024-03-09T14:23:22.728 INFO:teuthology.orchestra.run.smithi132.stdout: libXrandr x86_64 1.5.2-8.el9 CentOS-AppStream 27 k 2024-03-09T14:23:22.728 INFO:teuthology.orchestra.run.smithi132.stdout: libXtst x86_64 1.2.3-16.el9 CentOS-AppStream 20 k 2024-03-09T14:23:22.728 INFO:teuthology.orchestra.run.smithi132.stdout: libXv x86_64 1.0.11-16.el9 CentOS-AppStream 18 k 2024-03-09T14:23:22.728 INFO:teuthology.orchestra.run.smithi132.stdout: libXxf86vm x86_64 1.1.4-18.el9 CentOS-AppStream 18 k 2024-03-09T14:23:22.728 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-09T14:23:22.728 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-09T14:23:22.728 INFO:teuthology.orchestra.run.smithi132.stdout: libasyncns x86_64 0.8-22.el9 CentOS-AppStream 29 k 2024-03-09T14:23:22.728 INFO:teuthology.orchestra.run.smithi132.stdout: libcanberra x86_64 0.30-27.el9 CentOS-AppStream 85 k 2024-03-09T14:23:22.728 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 163 k 2024-03-09T14:23:22.728 INFO:teuthology.orchestra.run.smithi132.stdout: libdrm x86_64 2.4.117-1.el9 appstream 161 k 2024-03-09T14:23:22.729 INFO:teuthology.orchestra.run.smithi132.stdout: libepoxy x86_64 1.5.5-4.el9 CentOS-AppStream 240 k 2024-03-09T14:23:22.729 INFO:teuthology.orchestra.run.smithi132.stdout: libexif x86_64 0.6.22-6.el9 CentOS-AppStream 431 k 2024-03-09T14:23:22.729 INFO:teuthology.orchestra.run.smithi132.stdout: libfontenc x86_64 1.1.3-17.el9 CentOS-AppStream 30 k 2024-03-09T14:23:22.729 INFO:teuthology.orchestra.run.smithi132.stdout: libgexiv2 x86_64 0.12.3-1.el9 CentOS-AppStream 82 k 2024-03-09T14:23:22.729 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-09T14:23:22.729 INFO:teuthology.orchestra.run.smithi132.stdout: libglvnd x86_64 1:1.3.4-1.el9 CentOS-AppStream 134 k 2024-03-09T14:23:22.729 INFO:teuthology.orchestra.run.smithi132.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 CentOS-AppStream 36 k 2024-03-09T14:23:22.729 INFO:teuthology.orchestra.run.smithi132.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 CentOS-AppStream 141 k 2024-03-09T14:23:22.729 INFO:teuthology.orchestra.run.smithi132.stdout: libgsf x86_64 1.14.47-5.el9 CentOS-AppStream 245 k 2024-03-09T14:23:22.729 INFO:teuthology.orchestra.run.smithi132.stdout: libgxps x86_64 0.3.2-3.el9 CentOS-AppStream 78 k 2024-03-09T14:23:22.729 INFO:teuthology.orchestra.run.smithi132.stdout: libiptcdata x86_64 1.0.5-9.el9 CentOS-AppStream 61 k 2024-03-09T14:23:22.729 INFO:teuthology.orchestra.run.smithi132.stdout: libldac x86_64 2.0.2.3-10.el9 CentOS-AppStream 40 k 2024-03-09T14:23:22.729 INFO:teuthology.orchestra.run.smithi132.stdout: libnotify x86_64 0.7.9-8.el9 CentOS-AppStream 43 k 2024-03-09T14:23:22.729 INFO:teuthology.orchestra.run.smithi132.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-09T14:23:22.729 INFO:teuthology.orchestra.run.smithi132.stdout: libogg x86_64 2:1.3.4-6.el9 CentOS-AppStream 32 k 2024-03-09T14:23:22.730 INFO:teuthology.orchestra.run.smithi132.stdout: libosinfo x86_64 1.10.0-1.el9 CentOS-AppStream 312 k 2024-03-09T14:23:22.730 INFO:teuthology.orchestra.run.smithi132.stdout: libpciaccess x86_64 0.16-6.el9 CentOS-BaseOS 27 k 2024-03-09T14:23:22.730 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-09T14:23:22.730 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-09T14:23:22.730 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-09T14:23:22.730 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 501 k 2024-03-09T14:23:22.730 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-09T14:23:22.730 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 5.3 M 2024-03-09T14:23:22.730 INFO:teuthology.orchestra.run.smithi132.stdout: libsbc x86_64 1.4-9.el9 CentOS-AppStream 44 k 2024-03-09T14:23:22.730 INFO:teuthology.orchestra.run.smithi132.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-03-09T14:23:22.730 INFO:teuthology.orchestra.run.smithi132.stdout: libtheora x86_64 1:1.1.1-31.el9 CentOS-AppStream 163 k 2024-03-09T14:23:22.730 INFO:teuthology.orchestra.run.smithi132.stdout: libtiff x86_64 4.4.0-12.el9 appstream 198 k 2024-03-09T14:23:22.730 INFO:teuthology.orchestra.run.smithi132.stdout: libtool-ltdl x86_64 2.4.6-45.el9 CentOS-AppStream 36 k 2024-03-09T14:23:22.730 INFO:teuthology.orchestra.run.smithi132.stdout: libtracker-sparql x86_64 3.1.2-3.el9 CentOS-AppStream 316 k 2024-03-09T14:23:22.731 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-09T14:23:22.731 INFO:teuthology.orchestra.run.smithi132.stdout: libvisual x86_64 1:0.4.0-34.el9 CentOS-AppStream 143 k 2024-03-09T14:23:22.731 INFO:teuthology.orchestra.run.smithi132.stdout: libvorbis x86_64 1:1.3.7-5.el9 CentOS-AppStream 192 k 2024-03-09T14:23:22.731 INFO:teuthology.orchestra.run.smithi132.stdout: libwayland-client x86_64 1.21.0-1.el9 CentOS-AppStream 32 k 2024-03-09T14:23:22.731 INFO:teuthology.orchestra.run.smithi132.stdout: libwayland-cursor x86_64 1.21.0-1.el9 CentOS-AppStream 18 k 2024-03-09T14:23:22.731 INFO:teuthology.orchestra.run.smithi132.stdout: libwayland-egl x86_64 1.21.0-1.el9 CentOS-AppStream 12 k 2024-03-09T14:23:22.731 INFO:teuthology.orchestra.run.smithi132.stdout: libwayland-server x86_64 1.21.0-1.el9 CentOS-AppStream 41 k 2024-03-09T14:23:22.731 INFO:teuthology.orchestra.run.smithi132.stdout: libwebp x86_64 1.2.0-8.el9 CentOS-AppStream 276 k 2024-03-09T14:23:22.731 INFO:teuthology.orchestra.run.smithi132.stdout: libxkbcommon x86_64 1.0.3-4.el9 CentOS-AppStream 132 k 2024-03-09T14:23:22.731 INFO:teuthology.orchestra.run.smithi132.stdout: libxshmfence x86_64 1.3-10.el9 CentOS-AppStream 12 k 2024-03-09T14:23:22.731 INFO:teuthology.orchestra.run.smithi132.stdout: lksctp-tools x86_64 1.0.19-2.el9 CentOS-BaseOS 90 k 2024-03-09T14:23:22.731 INFO:teuthology.orchestra.run.smithi132.stdout: low-memory-monitor x86_64 2.1-4.el9 CentOS-AppStream 35 k 2024-03-09T14:23:22.731 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-09T14:23:22.731 INFO:teuthology.orchestra.run.smithi132.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-09T14:23:22.732 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-09T14:23:22.732 INFO:teuthology.orchestra.run.smithi132.stdout: lua-posix x86_64 35.0-8.el9 CentOS-AppStream 131 k 2024-03-09T14:23:22.732 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-09T14:23:22.732 INFO:teuthology.orchestra.run.smithi132.stdout: maven-lib noarch 1:3.6.3-15.el9 CentOS-AppStream 1.5 M 2024-03-09T14:23:22.732 INFO:teuthology.orchestra.run.smithi132.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 CentOS-AppStream 7.9 k 2024-03-09T14:23:22.732 INFO:teuthology.orchestra.run.smithi132.stdout: maven-resolver noarch 1:1.6.1-10.el9 CentOS-AppStream 512 k 2024-03-09T14:23:22.732 INFO:teuthology.orchestra.run.smithi132.stdout: maven-shared-utils noarch 3.3.4-3.el9 CentOS-AppStream 150 k 2024-03-09T14:23:22.732 INFO:teuthology.orchestra.run.smithi132.stdout: maven-wagon noarch 3.4.2-7.el9 CentOS-AppStream 111 k 2024-03-09T14:23:22.732 INFO:teuthology.orchestra.run.smithi132.stdout: mesa-libEGL x86_64 23.3.3-1.el9 appstream 127 k 2024-03-09T14:23:22.732 INFO:teuthology.orchestra.run.smithi132.stdout: mesa-libGL x86_64 23.3.3-1.el9 appstream 168 k 2024-03-09T14:23:22.732 INFO:teuthology.orchestra.run.smithi132.stdout: mesa-libgbm x86_64 23.3.3-1.el9 appstream 38 k 2024-03-09T14:23:22.732 INFO:teuthology.orchestra.run.smithi132.stdout: mesa-libglapi x86_64 23.3.3-1.el9 appstream 44 k 2024-03-09T14:23:22.732 INFO:teuthology.orchestra.run.smithi132.stdout: mkfontscale x86_64 1.2.1-3.el9 CentOS-AppStream 31 k 2024-03-09T14:23:22.732 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-09T14:23:22.733 INFO:teuthology.orchestra.run.smithi132.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-09T14:23:22.733 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-09T14:23:22.733 INFO:teuthology.orchestra.run.smithi132.stdout: openjpeg2 x86_64 2.4.0-7.el9 CentOS-AppStream 162 k 2024-03-09T14:23:22.733 INFO:teuthology.orchestra.run.smithi132.stdout: opus x86_64 1.3.1-10.el9 CentOS-AppStream 199 k 2024-03-09T14:23:22.733 INFO:teuthology.orchestra.run.smithi132.stdout: orc x86_64 0.4.31-6.el9 CentOS-AppStream 183 k 2024-03-09T14:23:22.733 INFO:teuthology.orchestra.run.smithi132.stdout: osinfo-db noarch 20231215-1.el9 appstream 521 k 2024-03-09T14:23:22.733 INFO:teuthology.orchestra.run.smithi132.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 CentOS-AppStream 68 k 2024-03-09T14:23:22.733 INFO:teuthology.orchestra.run.smithi132.stdout: ostree-libs x86_64 2024.4-3.el9 appstream 487 k 2024-03-09T14:23:22.733 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-09T14:23:22.733 INFO:teuthology.orchestra.run.smithi132.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-03-09T14:23:22.733 INFO:teuthology.orchestra.run.smithi132.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-03-09T14:23:22.733 INFO:teuthology.orchestra.run.smithi132.stdout: plexus-cipher noarch 1.7-27.el9 CentOS-AppStream 25 k 2024-03-09T14:23:22.733 INFO:teuthology.orchestra.run.smithi132.stdout: plexus-classworlds noarch 2.6.0-11.el9 CentOS-AppStream 59 k 2024-03-09T14:23:22.733 INFO:teuthology.orchestra.run.smithi132.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 CentOS-AppStream 17 k 2024-03-09T14:23:22.734 INFO:teuthology.orchestra.run.smithi132.stdout: plexus-interpolation noarch 1.26-11.el9 CentOS-AppStream 79 k 2024-03-09T14:23:22.734 INFO:teuthology.orchestra.run.smithi132.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 CentOS-AppStream 33 k 2024-03-09T14:23:22.734 INFO:teuthology.orchestra.run.smithi132.stdout: plexus-utils noarch 3.3.0-10.el9 CentOS-AppStream 253 k 2024-03-09T14:23:22.734 INFO:teuthology.orchestra.run.smithi132.stdout: poppler x86_64 21.01.0-19.el9 appstream 1.1 M 2024-03-09T14:23:22.734 INFO:teuthology.orchestra.run.smithi132.stdout: poppler-data noarch 0.4.9-9.el9 CentOS-AppStream 1.8 M 2024-03-09T14:23:22.734 INFO:teuthology.orchestra.run.smithi132.stdout: poppler-glib x86_64 21.01.0-19.el9 appstream 152 k 2024-03-09T14:23:22.734 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-09T14:23:22.734 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-09T14:23:22.734 INFO:teuthology.orchestra.run.smithi132.stdout: publicsuffix-list noarch 20210518-3.el9 CentOS-AppStream 82 k 2024-03-09T14:23:22.734 INFO:teuthology.orchestra.run.smithi132.stdout: pulseaudio-libs x86_64 15.0-2.el9 CentOS-AppStream 666 k 2024-03-09T14:23:22.734 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-09T14:23:22.734 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-09T14:23:22.734 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-09T14:23:22.734 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-09T14:23:22.735 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 45 k 2024-03-09T14:23:22.735 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 131 k 2024-03-09T14:23:22.735 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-09T14:23:22.735 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-09T14:23:22.735 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-09T14:23:22.735 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-09T14:23:22.735 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-09T14:23:22.735 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-09T14:23:22.735 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-09T14:23:22.735 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-09T14:23:22.735 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-09T14:23:22.735 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-09T14:23:22.735 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-09T14:23:22.735 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-09T14:23:22.736 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-09T14:23:22.736 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-09T14:23:22.736 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-09T14:23:22.736 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-09T14:23:22.736 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-09T14:23:22.736 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-09T14:23:22.736 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-09T14:23:22.736 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-09T14:23:22.736 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-09T14:23:22.736 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-09T14:23:22.736 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-09T14:23:22.736 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-09T14:23:22.736 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-09T14:23:22.736 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-09T14:23:22.736 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-09T14:23:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-09T14:23:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-09T14:23:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-09T14:23:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-09T14:23:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-09T14:23:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-09T14:23:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-09T14:23:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-09T14:23:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-09T14:23:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-09T14:23:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-09T14:23:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-09T14:23:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-09T14:23:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-09T14:23:22.738 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-09T14:23:22.738 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-09T14:23:22.738 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-09T14:23:22.738 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-09T14:23:22.738 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-09T14:23:22.738 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-09T14:23:22.738 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-09T14:23:22.738 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-09T14:23:22.738 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-09T14:23:22.738 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-09T14:23:22.738 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-09T14:23:22.738 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-09T14:23:22.738 INFO:teuthology.orchestra.run.smithi132.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-09T14:23:22.738 INFO:teuthology.orchestra.run.smithi132.stdout: rtkit x86_64 0.11-28.el9 CentOS-AppStream 55 k 2024-03-09T14:23:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: sisu noarch 1:0.3.4-10.el9 CentOS-AppStream 509 k 2024-03-09T14:23:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: slf4j noarch 1.7.30-13.el9 CentOS-AppStream 68 k 2024-03-09T14:23:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-09T14:23:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: sound-theme-freedesktop noarch 0.8-17.el9 CentOS-AppStream 377 k 2024-03-09T14:23:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-09T14:23:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: totem-pl-parser x86_64 3.26.6-2.el9 CentOS-AppStream 130 k 2024-03-09T14:23:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: ttmkfdir x86_64 3.0.9-65.el9 CentOS-AppStream 52 k 2024-03-09T14:23:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: tzdata-java noarch 2024a-1.el9 appstream 230 k 2024-03-09T14:23:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: upower x86_64 0.99.11-11.el9 CentOS-AppStream 168 k 2024-03-09T14:23:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 CentOS-AppStream 305 k 2024-03-09T14:23:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: wireplumber x86_64 0.4.14-1.el9 CentOS-AppStream 83 k 2024-03-09T14:23:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: wireplumber-libs x86_64 0.4.14-1.el9 CentOS-AppStream 337 k 2024-03-09T14:23:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 CentOS-AppStream 41 k 2024-03-09T14:23:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-03-09T14:23:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: xkeyboard-config noarch 2.33-2.el9 CentOS-AppStream 780 k 2024-03-09T14:23:22.740 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-09T14:23:22.740 INFO:teuthology.orchestra.run.smithi132.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 CentOS-AppStream 499 k 2024-03-09T14:23:22.740 INFO:teuthology.orchestra.run.smithi132.stdout:Installing weak dependencies: 2024-03-09T14:23:22.740 INFO:teuthology.orchestra.run.smithi132.stdout: dconf x86_64 0.40.0-6.el9 CentOS-AppStream 108 k 2024-03-09T14:23:22.740 INFO:teuthology.orchestra.run.smithi132.stdout: exiv2 x86_64 0.27.5-2.el9 CentOS-AppStream 978 k 2024-03-09T14:23:22.740 INFO:teuthology.orchestra.run.smithi132.stdout: flatpak x86_64 1.12.8-1.el9 CentOS-AppStream 1.7 M 2024-03-09T14:23:22.740 INFO:teuthology.orchestra.run.smithi132.stdout: gtk3 x86_64 3.24.31-2.el9 CentOS-AppStream 4.8 M 2024-03-09T14:23:22.740 INFO:teuthology.orchestra.run.smithi132.stdout: java-11-openjdk-devel x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 3.3 M 2024-03-09T14:23:22.740 INFO:teuthology.orchestra.run.smithi132.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 CentOS-AppStream 31 k 2024-03-09T14:23:22.740 INFO:teuthology.orchestra.run.smithi132.stdout: p11-kit-server x86_64 0.24.1-2.el9 CentOS-AppStream 198 k 2024-03-09T14:23:22.740 INFO:teuthology.orchestra.run.smithi132.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-03-09T14:23:22.740 INFO:teuthology.orchestra.run.smithi132.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-03-09T14:23:22.740 INFO:teuthology.orchestra.run.smithi132.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-03-09T14:23:22.740 INFO:teuthology.orchestra.run.smithi132.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-03-09T14:23:22.740 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-09T14:23:22.741 INFO:teuthology.orchestra.run.smithi132.stdout: tracker x86_64 3.1.2-3.el9 CentOS-AppStream 537 k 2024-03-09T14:23:22.741 INFO:teuthology.orchestra.run.smithi132.stdout: tracker-miners x86_64 3.1.2-4.el9 CentOS-AppStream 893 k 2024-03-09T14:23:22.741 INFO:teuthology.orchestra.run.smithi132.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 CentOS-AppStream 130 k 2024-03-09T14:23:22.741 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:23:22.741 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-03-09T14:23:22.741 INFO:teuthology.orchestra.run.smithi132.stdout:=========================================================================================================== 2024-03-09T14:23:22.741 INFO:teuthology.orchestra.run.smithi132.stdout:Install 282 Packages 2024-03-09T14:23:22.741 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 2 Packages 2024-03-09T14:23:22.741 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:23:22.742 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 297 M 2024-03-09T14:23:22.742 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-03-09T14:23:23.335 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 6.1 MB 00:00 2024-03-09T14:23:23.505 INFO:teuthology.orchestra.run.smithi132.stdout:(1/284): ceph-19.0.0-2079.gc00d9c60.el9.x86_64. 40 kB/s | 6.6 kB 00:00 2024-03-09T14:23:23.697 INFO:teuthology.orchestra.run.smithi132.stdout:(2/284): ceph-fuse-19.0.0-2079.gc00d9c60.el9.x8 4.5 MB/s | 888 kB 00:00 2024-03-09T14:23:23.739 INFO:teuthology.orchestra.run.smithi132.stdout:(3/284): ceph-immutable-object-cache-19.0.0-207 3.4 MB/s | 145 kB 00:00 2024-03-09T14:23:23.989 INFO:teuthology.orchestra.run.smithi132.stdout:(4/284): ceph-mds-19.0.0-2079.gc00d9c60.el9.x86 8.5 MB/s | 2.1 MB 00:00 2024-03-09T14:23:24.134 INFO:teuthology.orchestra.run.smithi132.stdout:(5/284): ceph-base-19.0.0-2079.gc00d9c60.el9.x8 6.7 MB/s | 5.4 MB 00:00 2024-03-09T14:23:24.214 INFO:teuthology.orchestra.run.smithi132.stdout:(6/284): ceph-mgr-19.0.0-2079.gc00d9c60.el9.x86 6.6 MB/s | 1.5 MB 00:00 2024-03-09T14:23:24.565 INFO:teuthology.orchestra.run.smithi132.stdout:(7/284): ceph-mon-19.0.0-2079.gc00d9c60.el9.x86 11 MB/s | 4.7 MB 00:00 2024-03-09T14:23:24.760 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 15 kB 00:00 2024-03-09T14:23:25.548 INFO:teuthology.orchestra.run.smithi132.stdout:(8/284): ceph-radosgw-19.0.0-2079.gc00d9c60.el9 10 MB/s | 10 MB 00:00 2024-03-09T14:23:25.624 INFO:teuthology.orchestra.run.smithi132.stdout:(9/284): ceph-selinux-19.0.0-2079.gc00d9c60.el9 335 kB/s | 25 kB 00:00 2024-03-09T14:23:26.007 INFO:teuthology.orchestra.run.smithi132.stdout:(10/284): ceph-osd-19.0.0-2079.gc00d9c60.el9.x8 9.4 MB/s | 17 MB 00:01 2024-03-09T14:23:26.057 INFO:teuthology.orchestra.run.smithi132.stdout:(11/284): libcephfs-devel-19.0.0-2079.gc00d9c60 627 kB/s | 31 kB 00:00 2024-03-09T14:23:26.166 INFO:teuthology.orchestra.run.smithi132.stdout:(12/284): libcephfs2-19.0.0-2079.gc00d9c60.el9. 6.7 MB/s | 745 kB 00:00 2024-03-09T14:23:26.233 INFO:teuthology.orchestra.run.smithi132.stdout:(13/284): libcephsqlite-19.0.0-2079.gc00d9c60.e 2.4 MB/s | 163 kB 00:00 2024-03-09T14:23:26.300 INFO:teuthology.orchestra.run.smithi132.stdout:(14/284): librados-devel-19.0.0-2079.gc00d9c60. 1.9 MB/s | 127 kB 00:00 2024-03-09T14:23:26.408 INFO:teuthology.orchestra.run.smithi132.stdout:(15/284): libradosstriper1-19.0.0-2079.gc00d9c6 4.5 MB/s | 501 kB 00:00 2024-03-09T14:23:26.420 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-03-09T14:23:27.117 INFO:teuthology.orchestra.run.smithi132.stdout:(16/284): ceph-common-19.0.0-2079.gc00d9c60.el9 5.4 MB/s | 20 MB 00:03 2024-03-09T14:23:27.184 INFO:teuthology.orchestra.run.smithi132.stdout:(17/284): librgw2-19.0.0-2079.gc00d9c60.el9.x86 6.8 MB/s | 5.3 MB 00:00 2024-03-09T14:23:27.200 INFO:teuthology.orchestra.run.smithi132.stdout:(18/284): python3-ceph-argparse-19.0.0-2079.gc0 541 kB/s | 45 kB 00:00 2024-03-09T14:23:27.234 INFO:teuthology.orchestra.run.smithi132.stdout:(19/284): python3-ceph-common-19.0.0-2079.gc00d 2.6 MB/s | 131 kB 00:00 2024-03-09T14:23:27.268 INFO:teuthology.orchestra.run.smithi132.stdout:(20/284): python3-cephfs-19.0.0-2079.gc00d9c60. 2.4 MB/s | 162 kB 00:00 2024-03-09T14:23:27.318 INFO:teuthology.orchestra.run.smithi132.stdout:(21/284): python3-rados-19.0.0-2079.gc00d9c60.e 3.8 MB/s | 321 kB 00:00 2024-03-09T14:23:27.352 INFO:teuthology.orchestra.run.smithi132.stdout:(22/284): python3-rbd-19.0.0-2079.gc00d9c60.el9 3.5 MB/s | 299 kB 00:00 2024-03-09T14:23:27.377 INFO:teuthology.orchestra.run.smithi132.stdout:(23/284): python3-rgw-19.0.0-2079.gc00d9c60.el9 1.7 MB/s | 99 kB 00:00 2024-03-09T14:23:27.428 INFO:teuthology.orchestra.run.smithi132.stdout:(24/284): rbd-fuse-19.0.0-2079.gc00d9c60.el9.x8 1.1 MB/s | 85 kB 00:00 2024-03-09T14:23:27.511 INFO:teuthology.orchestra.run.smithi132.stdout:(25/284): rbd-nbd-19.0.0-2079.gc00d9c60.el9.x86 2.0 MB/s | 170 kB 00:00 2024-03-09T14:23:27.579 INFO:teuthology.orchestra.run.smithi132.stdout:(26/284): ceph-grafana-dashboards-19.0.0-2079.g 509 kB/s | 34 kB 00:00 2024-03-09T14:23:27.662 INFO:teuthology.orchestra.run.smithi132.stdout:(27/284): ceph-mgr-cephadm-19.0.0-2079.gc00d9c6 1.6 MB/s | 139 kB 00:00 2024-03-09T14:23:27.712 INFO:teuthology.orchestra.run.smithi132.stdout:(28/284): rbd-mirror-19.0.0-2079.gc00d9c60.el9. 9.2 MB/s | 3.1 MB 00:00 2024-03-09T14:23:28.004 INFO:teuthology.orchestra.run.smithi132.stdout:(29/284): ceph-mgr-dashboard-19.0.0-2079.gc00d9 5.2 MB/s | 1.8 MB 00:00 2024-03-09T14:23:28.096 INFO:teuthology.orchestra.run.smithi132.stdout:(30/284): ceph-mgr-modules-core-19.0.0-2079.gc0 2.6 MB/s | 248 kB 00:00 2024-03-09T14:23:28.180 INFO:teuthology.orchestra.run.smithi132.stdout:(31/284): ceph-mgr-rook-19.0.0-2079.gc00d9c60.e 592 kB/s | 49 kB 00:00 2024-03-09T14:23:28.255 INFO:teuthology.orchestra.run.smithi132.stdout:(32/284): ceph-prometheus-alerts-19.0.0-2079.gc 219 kB/s | 16 kB 00:00 2024-03-09T14:23:28.347 INFO:teuthology.orchestra.run.smithi132.stdout:(33/284): ceph-volume-19.0.0-2079.gc00d9c60.el9 2.8 MB/s | 264 kB 00:00 2024-03-09T14:23:28.447 INFO:teuthology.orchestra.run.smithi132.stdout:(34/284): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2024-03-09T14:23:28.522 INFO:teuthology.orchestra.run.smithi132.stdout:(35/284): cephadm-19.0.0-2079.gc00d9c60.el9.noa 4.2 MB/s | 749 kB 00:00 2024-03-09T14:23:28.631 INFO:teuthology.orchestra.run.smithi132.stdout:(36/284): adwaita-cursor-theme-40.1.1-3.el9.noa 3.3 MB/s | 625 kB 00:00 2024-03-09T14:23:28.815 INFO:teuthology.orchestra.run.smithi132.stdout:(37/284): adwaita-icon-theme-40.1.1-3.el9.noarc 37 MB/s | 11 MB 00:00 2024-03-09T14:23:28.840 INFO:teuthology.orchestra.run.smithi132.stdout:(38/284): apache-commons-cli-1.4-17.el9.noarch. 335 kB/s | 70 kB 00:00 2024-03-09T14:23:28.865 INFO:teuthology.orchestra.run.smithi132.stdout:(39/284): apache-commons-codec-1.15-7.el9.noarc 5.9 MB/s | 301 kB 00:00 2024-03-09T14:23:28.890 INFO:teuthology.orchestra.run.smithi132.stdout:(40/284): apache-commons-io-2.8.0-8.el9.noarch. 5.5 MB/s | 282 kB 00:00 2024-03-09T14:23:28.915 INFO:teuthology.orchestra.run.smithi132.stdout:(41/284): apache-commons-lang3-3.12.0-6.el9.noa 11 MB/s | 558 kB 00:00 2024-03-09T14:23:28.941 INFO:teuthology.orchestra.run.smithi132.stdout:(42/284): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-03-09T14:23:28.966 INFO:teuthology.orchestra.run.smithi132.stdout:(43/284): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.4 MB/s | 176 kB 00:00 2024-03-09T14:23:28.983 INFO:teuthology.orchestra.run.smithi132.stdout:(44/284): atinject-1.0.3-6.el9.noarch.rpm 533 kB/s | 22 kB 00:00 2024-03-09T14:23:29.008 INFO:teuthology.orchestra.run.smithi132.stdout:(45/284): atk-2.36.0-5.el9.x86_64.rpm 6.3 MB/s | 270 kB 00:00 2024-03-09T14:23:29.034 INFO:teuthology.orchestra.run.smithi132.stdout:(46/284): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 106 kB 00:00 2024-03-09T14:23:29.051 INFO:teuthology.orchestra.run.smithi132.stdout:(47/284): cdi-api-2.0.2-6.el9.noarch.rpm 1.2 MB/s | 52 kB 00:00 2024-03-09T14:23:29.076 INFO:teuthology.orchestra.run.smithi132.stdout:(48/284): colord-libs-1.4.5-4.el9.x86_64.rpm 5.3 MB/s | 228 kB 00:00 2024-03-09T14:23:29.093 INFO:teuthology.orchestra.run.smithi132.stdout:(49/284): copy-jdk-configs-4.0-3.el9.noarch.rpm 653 kB/s | 27 kB 00:00 2024-03-09T14:23:29.143 INFO:teuthology.orchestra.run.smithi132.stdout:(50/284): dconf-0.40.0-6.el9.x86_64.rpm 1.6 MB/s | 108 kB 00:00 2024-03-09T14:23:29.169 INFO:teuthology.orchestra.run.smithi132.stdout:(51/284): exempi-2.6.0-0.2.20211007gite23c213.e 6.8 MB/s | 524 kB 00:00 2024-03-09T14:23:29.202 INFO:teuthology.orchestra.run.smithi132.stdout:(52/284): exiv2-0.27.5-2.el9.x86_64.rpm 16 MB/s | 978 kB 00:00 2024-03-09T14:23:29.245 INFO:teuthology.orchestra.run.smithi132.stdout:(53/284): exiv2-libs-0.27.5-2.el9.x86_64.rpm 10 MB/s | 780 kB 00:00 2024-03-09T14:23:29.270 INFO:teuthology.orchestra.run.smithi132.stdout:(54/284): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 4.8 MB/s | 324 kB 00:00 2024-03-09T14:23:29.312 INFO:teuthology.orchestra.run.smithi132.stdout:(55/284): flatpak-1.12.8-1.el9.x86_64.rpm 26 MB/s | 1.7 MB 00:00 2024-03-09T14:23:29.337 INFO:teuthology.orchestra.run.smithi132.stdout:(56/284): flatpak-selinux-1.12.8-1.el9.noarch.r 313 kB/s | 20 kB 00:00 2024-03-09T14:23:29.854 INFO:teuthology.orchestra.run.smithi132.stdout:(57/284): ceph-test-19.0.0-2079.gc00d9c60.el9.x 11 MB/s | 48 MB 00:04 2024-03-09T14:23:29.879 INFO:teuthology.orchestra.run.smithi132.stdout:(58/284): flatpak-session-helper-1.12.8-1.el9.x 128 kB/s | 73 kB 00:00 2024-03-09T14:23:29.896 INFO:teuthology.orchestra.run.smithi132.stdout:(59/284): flexiblas-3.0.4-8.el9.x86_64.rpm 57 kB/s | 32 kB 00:00 2024-03-09T14:23:30.288 INFO:teuthology.orchestra.run.smithi132.stdout:(60/284): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.9 MB/s | 3.0 MB 00:00 2024-03-09T14:23:30.305 INFO:teuthology.orchestra.run.smithi132.stdout:(61/284): flexiblas-openblas-openmp-3.0.4-8.el9 42 kB/s | 17 kB 00:00 2024-03-09T14:23:30.330 INFO:teuthology.orchestra.run.smithi132.stdout:(62/284): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 194 kB/s | 84 kB 00:00 2024-03-09T14:23:30.355 INFO:teuthology.orchestra.run.smithi132.stdout:(63/284): geoclue2-2.6.0-7.el9.x86_64.rpm 1.8 MB/s | 122 kB 00:00 2024-03-09T14:23:30.380 INFO:teuthology.orchestra.run.smithi132.stdout:(64/284): giflib-5.2.1-9.el9.x86_64.rpm 954 kB/s | 47 kB 00:00 2024-03-09T14:23:30.406 INFO:teuthology.orchestra.run.smithi132.stdout:(65/284): google-guice-4.2.3-9.el9.noarch.rpm 6.2 MB/s | 472 kB 00:00 2024-03-09T14:23:30.431 INFO:teuthology.orchestra.run.smithi132.stdout:(66/284): graphene-1.10.6-2.el9.x86_64.rpm 853 kB/s | 63 kB 00:00 2024-03-09T14:23:30.456 INFO:teuthology.orchestra.run.smithi132.stdout:(67/284): gsm-1.0.19-6.el9.x86_64.rpm 660 kB/s | 33 kB 00:00 2024-03-09T14:23:30.499 INFO:teuthology.orchestra.run.smithi132.stdout:(68/284): gstreamer1-1.22.1-2.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-03-09T14:23:30.523 INFO:teuthology.orchestra.run.smithi132.stdout:(69/284): gtk-update-icon-cache-3.24.31-2.el9.x 377 kB/s | 34 kB 00:00 2024-03-09T14:23:30.665 INFO:teuthology.orchestra.run.smithi132.stdout:(70/284): gtk3-3.24.31-2.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2024-03-09T14:23:30.690 INFO:teuthology.orchestra.run.smithi132.stdout:(71/284): hicolor-icon-theme-0.17-13.el9.noarch 398 kB/s | 65 kB 00:00 2024-03-09T14:23:30.741 INFO:teuthology.orchestra.run.smithi132.stdout:(72/284): guava-30.1-6.el9.noarch.rpm 11 MB/s | 2.3 MB 00:00 2024-03-09T14:23:30.766 INFO:teuthology.orchestra.run.smithi132.stdout:(73/284): httpcomponents-client-4.5.13-3.el9.no 6.5 MB/s | 656 kB 00:00 2024-03-09T14:23:30.791 INFO:teuthology.orchestra.run.smithi132.stdout:(74/284): httpcomponents-core-4.4.13-7.el9.noar 6.3 MB/s | 630 kB 00:00 2024-03-09T14:23:30.816 INFO:teuthology.orchestra.run.smithi132.stdout:(75/284): jakarta-annotations-1.3.5-13.el9.noar 901 kB/s | 44 kB 00:00 2024-03-09T14:23:30.892 INFO:teuthology.orchestra.run.smithi132.stdout:(76/284): iso-codes-4.6.0-3.el9.noarch.rpm 27 MB/s | 3.3 MB 00:00 2024-03-09T14:23:30.917 INFO:teuthology.orchestra.run.smithi132.stdout:(77/284): jansi-2.3.3-6.el9.x86_64.rpm 869 kB/s | 108 kB 00:00 2024-03-09T14:23:30.950 INFO:teuthology.orchestra.run.smithi132.stdout:(78/284): java-11-openjdk-11.0.18.0.10-3.el9.x8 3.3 MB/s | 439 kB 00:00 2024-03-09T14:23:31.017 INFO:teuthology.orchestra.run.smithi132.stdout:(79/284): java-11-openjdk-devel-11.0.18.0.10-3. 27 MB/s | 3.3 MB 00:00 2024-03-09T14:23:31.034 INFO:teuthology.orchestra.run.smithi132.stdout:(80/284): javapackages-filesystem-6.0.0-4.el9.n 130 kB/s | 10 kB 00:00 2024-03-09T14:23:31.201 INFO:teuthology.orchestra.run.smithi132.stdout:(81/284): jbigkit-libs-2.1-23.el9.x86_64.rpm 284 kB/s | 52 kB 00:00 2024-03-09T14:23:31.218 INFO:teuthology.orchestra.run.smithi132.stdout:(82/284): jcl-over-slf4j-1.7.30-13.el9.noarch.r 127 kB/s | 23 kB 00:00 2024-03-09T14:23:31.343 INFO:teuthology.orchestra.run.smithi132.stdout:(83/284): jsr-305-3.0.2-6.el9.noarch.rpm 248 kB/s | 31 kB 00:00 2024-03-09T14:23:31.386 INFO:teuthology.orchestra.run.smithi132.stdout:(84/284): jsoup-1.13.1-10.el9.noarch.rpm 2.0 MB/s | 376 kB 00:00 2024-03-09T14:23:31.419 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 7.3 kB/s | 1.7 kB 00:00 2024-03-09T14:23:31.778 INFO:teuthology.orchestra.run.smithi132.stdout:(85/284): java-11-openjdk-headless-11.0.18.0.10 48 MB/s | 40 MB 00:00 2024-03-09T14:23:31.811 INFO:teuthology.orchestra.run.smithi132.stdout:(86/284): lcms2-2.12-3.el9.x86_64.rpm 357 kB/s | 166 kB 00:00 2024-03-09T14:23:31.828 INFO:teuthology.orchestra.run.smithi132.stdout:(87/284): libX11-xcb-1.7.0-8.el9.x86_64.rpm 22 kB/s | 9.8 kB 00:00 2024-03-09T14:23:31.845 INFO:teuthology.orchestra.run.smithi132.stdout:(88/284): libXcomposite-0.4.5-7.el9.x86_64.rpm 347 kB/s | 23 kB 00:00 2024-03-09T14:23:31.862 INFO:teuthology.orchestra.run.smithi132.stdout:(89/284): libXcursor-1.2.0-7.el9.x86_64.rpm 891 kB/s | 30 kB 00:00 2024-03-09T14:23:31.878 INFO:teuthology.orchestra.run.smithi132.stdout:(90/284): libXdamage-1.1.5-7.el9.x86_64.rpm 435 kB/s | 22 kB 00:00 2024-03-09T14:23:31.895 INFO:teuthology.orchestra.run.smithi132.stdout:(91/284): libXfixes-5.0.3-16.el9.x86_64.rpm 374 kB/s | 19 kB 00:00 2024-03-09T14:23:31.912 INFO:teuthology.orchestra.run.smithi132.stdout:(92/284): libXinerama-1.1.4-10.el9.x86_64.rpm 420 kB/s | 14 kB 00:00 2024-03-09T14:23:31.929 INFO:teuthology.orchestra.run.smithi132.stdout:(93/284): libXi-1.7.10-8.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-03-09T14:23:31.946 INFO:teuthology.orchestra.run.smithi132.stdout:(94/284): libXrandr-1.5.2-8.el9.x86_64.rpm 543 kB/s | 27 kB 00:00 2024-03-09T14:23:31.963 INFO:teuthology.orchestra.run.smithi132.stdout:(95/284): libXtst-1.2.3-16.el9.x86_64.rpm 407 kB/s | 20 kB 00:00 2024-03-09T14:23:31.980 INFO:teuthology.orchestra.run.smithi132.stdout:(96/284): libXxf86vm-1.1.4-18.el9.x86_64.rpm 531 kB/s | 18 kB 00:00 2024-03-09T14:23:31.997 INFO:teuthology.orchestra.run.smithi132.stdout:(97/284): libXv-1.0.11-16.el9.x86_64.rpm 358 kB/s | 18 kB 00:00 2024-03-09T14:23:32.014 INFO:teuthology.orchestra.run.smithi132.stdout:(98/284): libasyncns-0.8-22.el9.x86_64.rpm 584 kB/s | 29 kB 00:00 2024-03-09T14:23:32.039 INFO:teuthology.orchestra.run.smithi132.stdout:(99/284): libcanberra-0.30-27.el9.x86_64.rpm 1.4 MB/s | 85 kB 00:00 2024-03-09T14:23:32.056 INFO:teuthology.orchestra.run.smithi132.stdout:(100/284): libcanberra-gtk3-0.30-27.el9.x86_64. 739 kB/s | 31 kB 00:00 2024-03-09T14:23:32.081 INFO:teuthology.orchestra.run.smithi132.stdout:(101/284): libepoxy-1.5.5-4.el9.x86_64.rpm 3.5 MB/s | 240 kB 00:00 2024-03-09T14:23:32.106 INFO:teuthology.orchestra.run.smithi132.stdout:(102/284): libexif-0.6.22-6.el9.x86_64.rpm 6.3 MB/s | 431 kB 00:00 2024-03-09T14:23:32.124 INFO:teuthology.orchestra.run.smithi132.stdout:(103/284): libfontenc-1.1.3-17.el9.x86_64.rpm 730 kB/s | 30 kB 00:00 2024-03-09T14:23:32.149 INFO:teuthology.orchestra.run.smithi132.stdout:(104/284): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.2 MB/s | 82 kB 00:00 2024-03-09T14:23:32.174 INFO:teuthology.orchestra.run.smithi132.stdout:(105/284): libglvnd-1.3.4-1.el9.x86_64.rpm 2.0 MB/s | 134 kB 00:00 2024-03-09T14:23:32.191 INFO:teuthology.orchestra.run.smithi132.stdout:(106/284): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 861 kB/s | 36 kB 00:00 2024-03-09T14:23:32.216 INFO:teuthology.orchestra.run.smithi132.stdout:(107/284): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.1 MB/s | 141 kB 00:00 2024-03-09T14:23:32.241 INFO:teuthology.orchestra.run.smithi132.stdout:(108/284): libgsf-1.14.47-5.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-03-09T14:23:32.258 INFO:teuthology.orchestra.run.smithi132.stdout:(109/284): libiptcdata-1.0.5-9.el9.x86_64.rpm 1.4 MB/s | 61 kB 00:00 2024-03-09T14:23:32.283 INFO:teuthology.orchestra.run.smithi132.stdout:(110/284): libgxps-0.3.2-3.el9.x86_64.rpm 1.1 MB/s | 78 kB 00:00 2024-03-09T14:23:32.300 INFO:teuthology.orchestra.run.smithi132.stdout:(111/284): libldac-2.0.2.3-10.el9.x86_64.rpm 687 kB/s | 40 kB 00:00 2024-03-09T14:23:32.317 INFO:teuthology.orchestra.run.smithi132.stdout:(112/284): libnotify-0.7.9-8.el9.x86_64.rpm 727 kB/s | 43 kB 00:00 2024-03-09T14:23:32.342 INFO:teuthology.orchestra.run.smithi132.stdout:(113/284): libogg-1.3.4-6.el9.x86_64.rpm 782 kB/s | 32 kB 00:00 2024-03-09T14:23:32.368 INFO:teuthology.orchestra.run.smithi132.stdout:(114/284): libosinfo-1.10.0-1.el9.x86_64.rpm 4.6 MB/s | 312 kB 00:00 2024-03-09T14:23:32.393 INFO:teuthology.orchestra.run.smithi132.stdout:(115/284): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2024-03-09T14:23:32.418 INFO:teuthology.orchestra.run.smithi132.stdout:(116/284): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-03-09T14:23:32.443 INFO:teuthology.orchestra.run.smithi132.stdout:(117/284): librabbitmq-0.11.0-7.el9.x86_64.rpm 589 kB/s | 44 kB 00:00 2024-03-09T14:23:32.469 INFO:teuthology.orchestra.run.smithi132.stdout:(118/284): libsbc-1.4-9.el9.x86_64.rpm 589 kB/s | 44 kB 00:00 2024-03-09T14:23:32.494 INFO:teuthology.orchestra.run.smithi132.stdout:(119/284): libtheora-1.1.1-31.el9.x86_64.rpm 2.1 MB/s | 163 kB 00:00 2024-03-09T14:23:32.519 INFO:teuthology.orchestra.run.smithi132.stdout:(120/284): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 723 kB/s | 36 kB 00:00 2024-03-09T14:23:32.544 INFO:teuthology.orchestra.run.smithi132.stdout:(121/284): libtracker-sparql-3.1.2-3.el9.x86_64 4.1 MB/s | 316 kB 00:00 2024-03-09T14:23:32.570 INFO:teuthology.orchestra.run.smithi132.stdout:(122/284): libvisual-0.4.0-34.el9.x86_64.rpm 1.9 MB/s | 143 kB 00:00 2024-03-09T14:23:32.595 INFO:teuthology.orchestra.run.smithi132.stdout:(123/284): libvorbis-1.3.7-5.el9.x86_64.rpm 3.8 MB/s | 192 kB 00:00 2024-03-09T14:23:32.620 INFO:teuthology.orchestra.run.smithi132.stdout:(124/284): libwayland-client-1.21.0-1.el9.x86_6 432 kB/s | 32 kB 00:00 2024-03-09T14:23:32.646 INFO:teuthology.orchestra.run.smithi132.stdout:(125/284): libwayland-cursor-1.21.0-1.el9.x86_6 244 kB/s | 18 kB 00:00 2024-03-09T14:23:32.671 INFO:teuthology.orchestra.run.smithi132.stdout:(126/284): libwayland-egl-1.21.0-1.el9.x86_64.r 235 kB/s | 12 kB 00:00 2024-03-09T14:23:32.696 INFO:teuthology.orchestra.run.smithi132.stdout:(127/284): libwayland-server-1.21.0-1.el9.x86_6 542 kB/s | 41 kB 00:00 2024-03-09T14:23:32.721 INFO:teuthology.orchestra.run.smithi132.stdout:(128/284): libwebp-1.2.0-8.el9.x86_64.rpm 3.6 MB/s | 276 kB 00:00 2024-03-09T14:23:32.746 INFO:teuthology.orchestra.run.smithi132.stdout:(129/284): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.6 MB/s | 132 kB 00:00 2024-03-09T14:23:32.772 INFO:teuthology.orchestra.run.smithi132.stdout:(130/284): libxshmfence-1.3-10.el9.x86_64.rpm 154 kB/s | 12 kB 00:00 2024-03-09T14:23:32.797 INFO:teuthology.orchestra.run.smithi132.stdout:(131/284): low-memory-monitor-2.1-4.el9.x86_64. 464 kB/s | 35 kB 00:00 2024-03-09T14:23:32.822 INFO:teuthology.orchestra.run.smithi132.stdout:(132/284): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-09T14:23:32.847 INFO:teuthology.orchestra.run.smithi132.stdout:(133/284): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2024-03-09T14:23:32.872 INFO:teuthology.orchestra.run.smithi132.stdout:(134/284): lua-posix-35.0-8.el9.x86_64.rpm 1.7 MB/s | 131 kB 00:00 2024-03-09T14:23:32.889 INFO:teuthology.orchestra.run.smithi132.stdout:(135/284): maven-3.6.3-15.el9.noarch.rpm 401 kB/s | 17 kB 00:00 2024-03-09T14:23:32.931 INFO:teuthology.orchestra.run.smithi132.stdout:(136/284): maven-lib-3.6.3-15.el9.noarch.rpm 18 MB/s | 1.5 MB 00:00 2024-03-09T14:23:32.948 INFO:teuthology.orchestra.run.smithi132.stdout:(137/284): maven-openjdk11-3.6.3-15.el9.noarch. 109 kB/s | 7.9 kB 00:00 2024-03-09T14:23:32.974 INFO:teuthology.orchestra.run.smithi132.stdout:(138/284): maven-resolver-1.6.1-10.el9.noarch.r 12 MB/s | 512 kB 00:00 2024-03-09T14:23:32.999 INFO:teuthology.orchestra.run.smithi132.stdout:(139/284): maven-shared-utils-3.3.4-3.el9.noarc 2.2 MB/s | 150 kB 00:00 2024-03-09T14:23:33.024 INFO:teuthology.orchestra.run.smithi132.stdout:(140/284): maven-wagon-3.4.2-7.el9.noarch.rpm 1.5 MB/s | 111 kB 00:00 2024-03-09T14:23:33.041 INFO:teuthology.orchestra.run.smithi132.stdout:(141/284): mkfontscale-1.2.1-3.el9.x86_64.rpm 750 kB/s | 31 kB 00:00 2024-03-09T14:23:33.058 INFO:teuthology.orchestra.run.smithi132.stdout:(142/284): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-03-09T14:23:33.075 INFO:teuthology.orchestra.run.smithi132.stdout:(143/284): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2024-03-09T14:23:33.158 INFO:teuthology.orchestra.run.smithi132.stdout:(144/284): openblas-openmp-0.3.21-2.el9.x86_64. 41 MB/s | 4.7 MB 00:00 2024-03-09T14:23:33.184 INFO:teuthology.orchestra.run.smithi132.stdout:(145/284): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.3 MB/s | 162 kB 00:00 2024-03-09T14:23:33.209 INFO:teuthology.orchestra.run.smithi132.stdout:(146/284): opus-1.3.1-10.el9.x86_64.rpm 1.5 MB/s | 199 kB 00:00 2024-03-09T14:23:33.234 INFO:teuthology.orchestra.run.smithi132.stdout:(147/284): orc-0.4.31-6.el9.x86_64.rpm 2.4 MB/s | 183 kB 00:00 2024-03-09T14:23:33.259 INFO:teuthology.orchestra.run.smithi132.stdout:(148/284): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.3 MB/s | 68 kB 00:00 2024-03-09T14:23:33.285 INFO:teuthology.orchestra.run.smithi132.stdout:(149/284): p11-kit-server-0.24.1-2.el9.x86_64.r 2.6 MB/s | 198 kB 00:00 2024-03-09T14:23:33.302 INFO:teuthology.orchestra.run.smithi132.stdout:(150/284): plexus-cipher-1.7-27.el9.noarch.rpm 373 kB/s | 25 kB 00:00 2024-03-09T14:23:33.318 INFO:teuthology.orchestra.run.smithi132.stdout:(151/284): plexus-classworlds-2.6.0-11.el9.noar 1.7 MB/s | 59 kB 00:00 2024-03-09T14:23:33.335 INFO:teuthology.orchestra.run.smithi132.stdout:(152/284): plexus-containers-component-annotati 346 kB/s | 17 kB 00:00 2024-03-09T14:23:33.369 INFO:teuthology.orchestra.run.smithi132.stdout:(153/284): plexus-interpolation-1.26-11.el9.noa 1.1 MB/s | 79 kB 00:00 2024-03-09T14:23:33.394 INFO:teuthology.orchestra.run.smithi132.stdout:(154/284): plexus-sec-dispatcher-1.4-37.el9.noa 557 kB/s | 33 kB 00:00 2024-03-09T14:23:33.420 INFO:teuthology.orchestra.run.smithi132.stdout:(155/284): plexus-utils-3.3.0-10.el9.noarch.rpm 3.0 MB/s | 253 kB 00:00 2024-03-09T14:23:33.461 INFO:teuthology.orchestra.run.smithi132.stdout:(156/284): poppler-data-0.4.9-9.el9.noarch.rpm 20 MB/s | 1.8 MB 00:00 2024-03-09T14:23:33.495 INFO:teuthology.orchestra.run.smithi132.stdout:(157/284): protobuf-3.14.0-13.el9.x86_64.rpm 14 MB/s | 1.0 MB 00:00 2024-03-09T14:23:33.520 INFO:teuthology.orchestra.run.smithi132.stdout:(158/284): publicsuffix-list-20210518-3.el9.noa 837 kB/s | 82 kB 00:00 2024-03-09T14:23:33.546 INFO:teuthology.orchestra.run.smithi132.stdout:(159/284): pulseaudio-libs-15.0-2.el9.x86_64.rp 8.0 MB/s | 666 kB 00:00 2024-03-09T14:23:33.571 INFO:teuthology.orchestra.run.smithi132.stdout:(160/284): python3-jsonpatch-1.21-16.el9.noarch 500 kB/s | 24 kB 00:00 2024-03-09T14:23:33.671 INFO:teuthology.orchestra.run.smithi132.stdout:(161/284): python3-babel-2.9.1-2.el9.noarch.rpm 39 MB/s | 5.8 MB 00:00 2024-03-09T14:23:33.696 INFO:teuthology.orchestra.run.smithi132.stdout:(162/284): python3-jsonpointer-2.0-4.el9.noarch 120 kB/s | 18 kB 00:00 2024-03-09T14:23:33.721 INFO:teuthology.orchestra.run.smithi132.stdout:(163/284): python3-mako-1.1.4-6.el9.noarch.rpm 977 kB/s | 144 kB 00:00 2024-03-09T14:23:33.747 INFO:teuthology.orchestra.run.smithi132.stdout:(164/284): python3-markupsafe-1.1.1-12.el9.x86_ 422 kB/s | 32 kB 00:00 2024-03-09T14:23:33.780 INFO:teuthology.orchestra.run.smithi132.stdout:(165/284): python3-numpy-f2py-1.20.1-5.el9.x86_ 3.6 MB/s | 217 kB 00:00 2024-03-09T14:23:33.847 INFO:teuthology.orchestra.run.smithi132.stdout:(166/284): python3-numpy-1.20.1-5.el9.x86_64.rp 38 MB/s | 4.8 MB 00:00 2024-03-09T14:23:33.873 INFO:teuthology.orchestra.run.smithi132.stdout:(167/284): python3-oauthlib-3.1.1-5.el9.noarch. 1.4 MB/s | 174 kB 00:00 2024-03-09T14:23:33.898 INFO:teuthology.orchestra.run.smithi132.stdout:(168/284): python3-packaging-20.9-5.el9.noarch. 600 kB/s | 69 kB 00:00 2024-03-09T14:23:33.923 INFO:teuthology.orchestra.run.smithi132.stdout:(169/284): python3-prettytable-0.7.2-27.el9.noa 827 kB/s | 41 kB 00:00 2024-03-09T14:23:33.947 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-09T14:23:33.948 INFO:teuthology.orchestra.run.smithi132.stdout:(170/284): python3-protobuf-3.14.0-13.el9.noarc 3.1 MB/s | 238 kB 00:00 2024-03-09T14:23:33.948 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-09T14:23:33.973 INFO:teuthology.orchestra.run.smithi132.stdout:(171/284): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.7 MB/s | 132 kB 00:00 2024-03-09T14:23:33.998 INFO:teuthology.orchestra.run.smithi132.stdout:(172/284): python3-pyasn1-modules-0.4.8-6.el9.n 4.1 MB/s | 211 kB 00:00 2024-03-09T14:23:34.024 INFO:teuthology.orchestra.run.smithi132.stdout:(173/284): python3-pytz-2021.1-5.el9.noarch.rpm 631 kB/s | 47 kB 00:00 2024-03-09T14:23:34.049 INFO:teuthology.orchestra.run.smithi132.stdout:(174/284): python3-requests-oauthlib-1.3.0-12.e 572 kB/s | 43 kB 00:00 2024-03-09T14:23:34.055 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-03-09T14:23:34.074 INFO:teuthology.orchestra.run.smithi132.stdout:(175/284): python3-toml-0.10.2-6.el9.noarch.rpm 775 kB/s | 39 kB 00:00 2024-03-09T14:23:34.076 INFO:teuthology.orchestra.run.smithi088.stdout:=========================================================================================================== 2024-03-09T14:23:34.077 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-03-09T14:23:34.077 INFO:teuthology.orchestra.run.smithi088.stdout:=========================================================================================================== 2024-03-09T14:23:34.077 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-03-09T14:23:34.077 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 6.6 k 2024-03-09T14:23:34.077 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 5.4 M 2024-03-09T14:23:34.077 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 888 k 2024-03-09T14:23:34.077 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 145 k 2024-03-09T14:23:34.077 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 1.5 M 2024-03-09T14:23:34.077 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 139 k 2024-03-09T14:23:34.077 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 1.8 M 2024-03-09T14:23:34.077 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 7.4 M 2024-03-09T14:23:34.077 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 49 k 2024-03-09T14:23:34.077 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 10 M 2024-03-09T14:23:34.078 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 48 M 2024-03-09T14:23:34.078 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 264 k 2024-03-09T14:23:34.078 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 749 k 2024-03-09T14:23:34.078 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 31 k 2024-03-09T14:23:34.078 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 745 k 2024-03-09T14:23:34.078 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 127 k 2024-03-09T14:23:34.078 INFO:teuthology.orchestra.run.smithi088.stdout: maven noarch 1:3.6.3-15.el9 CentOS-AppStream 17 k 2024-03-09T14:23:34.078 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 162 k 2024-03-09T14:23:34.078 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 321 k 2024-03-09T14:23:34.078 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 299 k 2024-03-09T14:23:34.078 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 99 k 2024-03-09T14:23:34.078 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 85 k 2024-03-09T14:23:34.078 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 3.1 M 2024-03-09T14:23:34.079 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 170 k 2024-03-09T14:23:34.079 INFO:teuthology.orchestra.run.smithi088.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-03-09T14:23:34.079 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2024-03-09T14:23:34.079 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 3.4 M 2024-03-09T14:23:34.079 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 3.1 M 2024-03-09T14:23:34.079 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-03-09T14:23:34.079 INFO:teuthology.orchestra.run.smithi088.stdout: ModemManager-glib x86_64 1.20.2-1.el9 CentOS-BaseOS 334 k 2024-03-09T14:23:34.079 INFO:teuthology.orchestra.run.smithi088.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-09T14:23:34.079 INFO:teuthology.orchestra.run.smithi088.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 CentOS-AppStream 625 k 2024-03-09T14:23:34.079 INFO:teuthology.orchestra.run.smithi088.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 CentOS-AppStream 11 M 2024-03-09T14:23:34.079 INFO:teuthology.orchestra.run.smithi088.stdout: alsa-lib x86_64 1.2.10-2.el9 appstream 523 k 2024-03-09T14:23:34.079 INFO:teuthology.orchestra.run.smithi088.stdout: apache-commons-cli noarch 1.4-17.el9 CentOS-AppStream 70 k 2024-03-09T14:23:34.079 INFO:teuthology.orchestra.run.smithi088.stdout: apache-commons-codec noarch 1.15-7.el9 CentOS-AppStream 301 k 2024-03-09T14:23:34.080 INFO:teuthology.orchestra.run.smithi088.stdout: apache-commons-io noarch 1:2.8.0-8.el9 CentOS-AppStream 282 k 2024-03-09T14:23:34.080 INFO:teuthology.orchestra.run.smithi088.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 CentOS-AppStream 558 k 2024-03-09T14:23:34.080 INFO:teuthology.orchestra.run.smithi088.stdout: at-spi2-atk x86_64 2.38.0-4.el9 CentOS-AppStream 86 k 2024-03-09T14:23:34.080 INFO:teuthology.orchestra.run.smithi088.stdout: at-spi2-core x86_64 2.40.3-1.el9 CentOS-AppStream 176 k 2024-03-09T14:23:34.080 INFO:teuthology.orchestra.run.smithi088.stdout: atinject noarch 1.0.3-6.el9 CentOS-AppStream 22 k 2024-03-09T14:23:34.080 INFO:teuthology.orchestra.run.smithi088.stdout: atk x86_64 2.36.0-5.el9 CentOS-AppStream 270 k 2024-03-09T14:23:34.080 INFO:teuthology.orchestra.run.smithi088.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2024-03-09T14:23:34.080 INFO:teuthology.orchestra.run.smithi088.stdout: bluez-libs x86_64 5.64-1.el9 CentOS-BaseOS 83 k 2024-03-09T14:23:34.080 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-09T14:23:34.080 INFO:teuthology.orchestra.run.smithi088.stdout: bubblewrap x86_64 0.4.1-6.el9 CentOS-BaseOS 49 k 2024-03-09T14:23:34.080 INFO:teuthology.orchestra.run.smithi088.stdout: cdi-api noarch 2.0.2-6.el9 CentOS-AppStream 52 k 2024-03-09T14:23:34.080 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 20 M 2024-03-09T14:23:34.080 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 34 k 2024-03-09T14:23:34.081 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 2.1 M 2024-03-09T14:23:34.081 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 248 k 2024-03-09T14:23:34.081 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 4.7 M 2024-03-09T14:23:34.081 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 17 M 2024-03-09T14:23:34.081 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 16 k 2024-03-09T14:23:34.081 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 25 k 2024-03-09T14:23:34.081 INFO:teuthology.orchestra.run.smithi088.stdout: colord-libs x86_64 1.4.5-4.el9 CentOS-AppStream 228 k 2024-03-09T14:23:34.081 INFO:teuthology.orchestra.run.smithi088.stdout: copy-jdk-configs noarch 4.0-3.el9 CentOS-AppStream 27 k 2024-03-09T14:23:34.081 INFO:teuthology.orchestra.run.smithi088.stdout: cups-libs x86_64 1:2.3.3op2-24.el9 baseos 262 k 2024-03-09T14:23:34.081 INFO:teuthology.orchestra.run.smithi088.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 CentOS-AppStream 524 k 2024-03-09T14:23:34.081 INFO:teuthology.orchestra.run.smithi088.stdout: exiv2-libs x86_64 0.27.5-2.el9 CentOS-AppStream 780 k 2024-03-09T14:23:34.081 INFO:teuthology.orchestra.run.smithi088.stdout: fdk-aac-free x86_64 2.0.0-8.el9 CentOS-AppStream 324 k 2024-03-09T14:23:34.081 INFO:teuthology.orchestra.run.smithi088.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-03-09T14:23:34.081 INFO:teuthology.orchestra.run.smithi088.stdout: flatpak-selinux noarch 1.12.8-1.el9 CentOS-AppStream 20 k 2024-03-09T14:23:34.082 INFO:teuthology.orchestra.run.smithi088.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 CentOS-AppStream 73 k 2024-03-09T14:23:34.082 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-09T14:23:34.082 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-09T14:23:34.082 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-09T14:23:34.082 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-09T14:23:34.082 INFO:teuthology.orchestra.run.smithi088.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 CentOS-AppStream 84 k 2024-03-09T14:23:34.082 INFO:teuthology.orchestra.run.smithi088.stdout: geoclue2 x86_64 2.6.0-7.el9 CentOS-AppStream 122 k 2024-03-09T14:23:34.082 INFO:teuthology.orchestra.run.smithi088.stdout: giflib x86_64 5.2.1-9.el9 CentOS-AppStream 47 k 2024-03-09T14:23:34.082 INFO:teuthology.orchestra.run.smithi088.stdout: google-guice noarch 4.2.3-9.el9 CentOS-AppStream 472 k 2024-03-09T14:23:34.082 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-09T14:23:34.082 INFO:teuthology.orchestra.run.smithi088.stdout: graphene x86_64 1.10.6-2.el9 CentOS-AppStream 63 k 2024-03-09T14:23:34.082 INFO:teuthology.orchestra.run.smithi088.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-09T14:23:34.083 INFO:teuthology.orchestra.run.smithi088.stdout: gsm x86_64 1.0.19-6.el9 CentOS-AppStream 33 k 2024-03-09T14:23:34.083 INFO:teuthology.orchestra.run.smithi088.stdout: gstreamer1 x86_64 1.22.1-2.el9 CentOS-AppStream 1.4 M 2024-03-09T14:23:34.083 INFO:teuthology.orchestra.run.smithi088.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-03-09T14:23:34.083 INFO:teuthology.orchestra.run.smithi088.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 CentOS-AppStream 34 k 2024-03-09T14:23:34.083 INFO:teuthology.orchestra.run.smithi088.stdout: guava noarch 30.1-6.el9 CentOS-AppStream 2.3 M 2024-03-09T14:23:34.083 INFO:teuthology.orchestra.run.smithi088.stdout: hicolor-icon-theme noarch 0.17-13.el9 CentOS-AppStream 65 k 2024-03-09T14:23:34.083 INFO:teuthology.orchestra.run.smithi088.stdout: httpcomponents-client noarch 4.5.13-3.el9 CentOS-AppStream 656 k 2024-03-09T14:23:34.083 INFO:teuthology.orchestra.run.smithi088.stdout: httpcomponents-core noarch 4.4.13-7.el9 CentOS-AppStream 630 k 2024-03-09T14:23:34.083 INFO:teuthology.orchestra.run.smithi088.stdout: iso-codes noarch 4.6.0-3.el9 CentOS-AppStream 3.3 M 2024-03-09T14:23:34.083 INFO:teuthology.orchestra.run.smithi088.stdout: jakarta-annotations noarch 1.3.5-13.el9 CentOS-AppStream 44 k 2024-03-09T14:23:34.083 INFO:teuthology.orchestra.run.smithi088.stdout: jansi x86_64 2.3.3-6.el9 CentOS-AppStream 108 k 2024-03-09T14:23:34.083 INFO:teuthology.orchestra.run.smithi088.stdout: java-11-openjdk x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 439 k 2024-03-09T14:23:34.083 INFO:teuthology.orchestra.run.smithi088.stdout: java-11-openjdk-headless x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 40 M 2024-03-09T14:23:34.083 INFO:teuthology.orchestra.run.smithi088.stdout: javapackages-filesystem noarch 6.0.0-4.el9 CentOS-AppStream 10 k 2024-03-09T14:23:34.083 INFO:teuthology.orchestra.run.smithi088.stdout: jbigkit-libs x86_64 2.1-23.el9 CentOS-AppStream 52 k 2024-03-09T14:23:34.084 INFO:teuthology.orchestra.run.smithi088.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 CentOS-AppStream 23 k 2024-03-09T14:23:34.084 INFO:teuthology.orchestra.run.smithi088.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-09T14:23:34.084 INFO:teuthology.orchestra.run.smithi088.stdout: jsoup noarch 1.13.1-10.el9 CentOS-AppStream 376 k 2024-03-09T14:23:34.084 INFO:teuthology.orchestra.run.smithi088.stdout: jsr-305 noarch 3.0.2-6.el9 CentOS-AppStream 31 k 2024-03-09T14:23:34.084 INFO:teuthology.orchestra.run.smithi088.stdout: lcms2 x86_64 2.12-3.el9 CentOS-AppStream 166 k 2024-03-09T14:23:34.084 INFO:teuthology.orchestra.run.smithi088.stdout: libX11-xcb x86_64 1.7.0-8.el9 CentOS-AppStream 9.8 k 2024-03-09T14:23:34.084 INFO:teuthology.orchestra.run.smithi088.stdout: libXcomposite x86_64 0.4.5-7.el9 CentOS-AppStream 23 k 2024-03-09T14:23:34.084 INFO:teuthology.orchestra.run.smithi088.stdout: libXcursor x86_64 1.2.0-7.el9 CentOS-AppStream 30 k 2024-03-09T14:23:34.084 INFO:teuthology.orchestra.run.smithi088.stdout: libXdamage x86_64 1.1.5-7.el9 CentOS-AppStream 22 k 2024-03-09T14:23:34.084 INFO:teuthology.orchestra.run.smithi088.stdout: libXfixes x86_64 5.0.3-16.el9 CentOS-AppStream 19 k 2024-03-09T14:23:34.084 INFO:teuthology.orchestra.run.smithi088.stdout: libXi x86_64 1.7.10-8.el9 CentOS-AppStream 38 k 2024-03-09T14:23:34.084 INFO:teuthology.orchestra.run.smithi088.stdout: libXinerama x86_64 1.1.4-10.el9 CentOS-AppStream 14 k 2024-03-09T14:23:34.084 INFO:teuthology.orchestra.run.smithi088.stdout: libXrandr x86_64 1.5.2-8.el9 CentOS-AppStream 27 k 2024-03-09T14:23:34.084 INFO:teuthology.orchestra.run.smithi088.stdout: libXtst x86_64 1.2.3-16.el9 CentOS-AppStream 20 k 2024-03-09T14:23:34.084 INFO:teuthology.orchestra.run.smithi088.stdout: libXv x86_64 1.0.11-16.el9 CentOS-AppStream 18 k 2024-03-09T14:23:34.085 INFO:teuthology.orchestra.run.smithi088.stdout: libXxf86vm x86_64 1.1.4-18.el9 CentOS-AppStream 18 k 2024-03-09T14:23:34.085 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-09T14:23:34.085 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-09T14:23:34.085 INFO:teuthology.orchestra.run.smithi088.stdout: libasyncns x86_64 0.8-22.el9 CentOS-AppStream 29 k 2024-03-09T14:23:34.085 INFO:teuthology.orchestra.run.smithi088.stdout: libcanberra x86_64 0.30-27.el9 CentOS-AppStream 85 k 2024-03-09T14:23:34.085 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 163 k 2024-03-09T14:23:34.085 INFO:teuthology.orchestra.run.smithi088.stdout: libdrm x86_64 2.4.117-1.el9 appstream 161 k 2024-03-09T14:23:34.085 INFO:teuthology.orchestra.run.smithi088.stdout: libepoxy x86_64 1.5.5-4.el9 CentOS-AppStream 240 k 2024-03-09T14:23:34.085 INFO:teuthology.orchestra.run.smithi088.stdout: libexif x86_64 0.6.22-6.el9 CentOS-AppStream 431 k 2024-03-09T14:23:34.085 INFO:teuthology.orchestra.run.smithi088.stdout: libfontenc x86_64 1.1.3-17.el9 CentOS-AppStream 30 k 2024-03-09T14:23:34.085 INFO:teuthology.orchestra.run.smithi088.stdout: libgexiv2 x86_64 0.12.3-1.el9 CentOS-AppStream 82 k 2024-03-09T14:23:34.085 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-09T14:23:34.085 INFO:teuthology.orchestra.run.smithi088.stdout: libglvnd x86_64 1:1.3.4-1.el9 CentOS-AppStream 134 k 2024-03-09T14:23:34.085 INFO:teuthology.orchestra.run.smithi088.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 CentOS-AppStream 36 k 2024-03-09T14:23:34.086 INFO:teuthology.orchestra.run.smithi088.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 CentOS-AppStream 141 k 2024-03-09T14:23:34.086 INFO:teuthology.orchestra.run.smithi088.stdout: libgsf x86_64 1.14.47-5.el9 CentOS-AppStream 245 k 2024-03-09T14:23:34.086 INFO:teuthology.orchestra.run.smithi088.stdout: libgxps x86_64 0.3.2-3.el9 CentOS-AppStream 78 k 2024-03-09T14:23:34.086 INFO:teuthology.orchestra.run.smithi088.stdout: libiptcdata x86_64 1.0.5-9.el9 CentOS-AppStream 61 k 2024-03-09T14:23:34.086 INFO:teuthology.orchestra.run.smithi088.stdout: libldac x86_64 2.0.2.3-10.el9 CentOS-AppStream 40 k 2024-03-09T14:23:34.086 INFO:teuthology.orchestra.run.smithi088.stdout: libnotify x86_64 0.7.9-8.el9 CentOS-AppStream 43 k 2024-03-09T14:23:34.086 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-09T14:23:34.086 INFO:teuthology.orchestra.run.smithi088.stdout: libogg x86_64 2:1.3.4-6.el9 CentOS-AppStream 32 k 2024-03-09T14:23:34.086 INFO:teuthology.orchestra.run.smithi088.stdout: libosinfo x86_64 1.10.0-1.el9 CentOS-AppStream 312 k 2024-03-09T14:23:34.086 INFO:teuthology.orchestra.run.smithi088.stdout: libpciaccess x86_64 0.16-6.el9 CentOS-BaseOS 27 k 2024-03-09T14:23:34.086 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-09T14:23:34.086 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-09T14:23:34.086 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-09T14:23:34.087 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 501 k 2024-03-09T14:23:34.087 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-09T14:23:34.087 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 5.3 M 2024-03-09T14:23:34.087 INFO:teuthology.orchestra.run.smithi088.stdout: libsbc x86_64 1.4-9.el9 CentOS-AppStream 44 k 2024-03-09T14:23:34.087 INFO:teuthology.orchestra.run.smithi088.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-03-09T14:23:34.087 INFO:teuthology.orchestra.run.smithi088.stdout: libtheora x86_64 1:1.1.1-31.el9 CentOS-AppStream 163 k 2024-03-09T14:23:34.087 INFO:teuthology.orchestra.run.smithi088.stdout: libtiff x86_64 4.4.0-12.el9 appstream 198 k 2024-03-09T14:23:34.087 INFO:teuthology.orchestra.run.smithi088.stdout: libtool-ltdl x86_64 2.4.6-45.el9 CentOS-AppStream 36 k 2024-03-09T14:23:34.087 INFO:teuthology.orchestra.run.smithi088.stdout: libtracker-sparql x86_64 3.1.2-3.el9 CentOS-AppStream 316 k 2024-03-09T14:23:34.087 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-09T14:23:34.087 INFO:teuthology.orchestra.run.smithi088.stdout: libvisual x86_64 1:0.4.0-34.el9 CentOS-AppStream 143 k 2024-03-09T14:23:34.087 INFO:teuthology.orchestra.run.smithi088.stdout: libvorbis x86_64 1:1.3.7-5.el9 CentOS-AppStream 192 k 2024-03-09T14:23:34.087 INFO:teuthology.orchestra.run.smithi088.stdout: libwayland-client x86_64 1.21.0-1.el9 CentOS-AppStream 32 k 2024-03-09T14:23:34.087 INFO:teuthology.orchestra.run.smithi088.stdout: libwayland-cursor x86_64 1.21.0-1.el9 CentOS-AppStream 18 k 2024-03-09T14:23:34.088 INFO:teuthology.orchestra.run.smithi088.stdout: libwayland-egl x86_64 1.21.0-1.el9 CentOS-AppStream 12 k 2024-03-09T14:23:34.088 INFO:teuthology.orchestra.run.smithi088.stdout: libwayland-server x86_64 1.21.0-1.el9 CentOS-AppStream 41 k 2024-03-09T14:23:34.088 INFO:teuthology.orchestra.run.smithi088.stdout: libwebp x86_64 1.2.0-8.el9 CentOS-AppStream 276 k 2024-03-09T14:23:34.088 INFO:teuthology.orchestra.run.smithi088.stdout: libxkbcommon x86_64 1.0.3-4.el9 CentOS-AppStream 132 k 2024-03-09T14:23:34.088 INFO:teuthology.orchestra.run.smithi088.stdout: libxshmfence x86_64 1.3-10.el9 CentOS-AppStream 12 k 2024-03-09T14:23:34.088 INFO:teuthology.orchestra.run.smithi088.stdout: lksctp-tools x86_64 1.0.19-2.el9 CentOS-BaseOS 90 k 2024-03-09T14:23:34.088 INFO:teuthology.orchestra.run.smithi088.stdout: low-memory-monitor x86_64 2.1-4.el9 CentOS-AppStream 35 k 2024-03-09T14:23:34.088 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-09T14:23:34.088 INFO:teuthology.orchestra.run.smithi088.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-09T14:23:34.088 INFO:teuthology.orchestra.run.smithi088.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-09T14:23:34.088 INFO:teuthology.orchestra.run.smithi088.stdout: lua-posix x86_64 35.0-8.el9 CentOS-AppStream 131 k 2024-03-09T14:23:34.088 INFO:teuthology.orchestra.run.smithi088.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-09T14:23:34.088 INFO:teuthology.orchestra.run.smithi088.stdout: maven-lib noarch 1:3.6.3-15.el9 CentOS-AppStream 1.5 M 2024-03-09T14:23:34.089 INFO:teuthology.orchestra.run.smithi088.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 CentOS-AppStream 7.9 k 2024-03-09T14:23:34.089 INFO:teuthology.orchestra.run.smithi088.stdout: maven-resolver noarch 1:1.6.1-10.el9 CentOS-AppStream 512 k 2024-03-09T14:23:34.089 INFO:teuthology.orchestra.run.smithi088.stdout: maven-shared-utils noarch 3.3.4-3.el9 CentOS-AppStream 150 k 2024-03-09T14:23:34.089 INFO:teuthology.orchestra.run.smithi088.stdout: maven-wagon noarch 3.4.2-7.el9 CentOS-AppStream 111 k 2024-03-09T14:23:34.089 INFO:teuthology.orchestra.run.smithi088.stdout: mesa-libEGL x86_64 23.3.3-1.el9 appstream 127 k 2024-03-09T14:23:34.089 INFO:teuthology.orchestra.run.smithi088.stdout: mesa-libGL x86_64 23.3.3-1.el9 appstream 168 k 2024-03-09T14:23:34.089 INFO:teuthology.orchestra.run.smithi088.stdout: mesa-libgbm x86_64 23.3.3-1.el9 appstream 38 k 2024-03-09T14:23:34.089 INFO:teuthology.orchestra.run.smithi088.stdout: mesa-libglapi x86_64 23.3.3-1.el9 appstream 44 k 2024-03-09T14:23:34.089 INFO:teuthology.orchestra.run.smithi088.stdout: mkfontscale x86_64 1.2.1-3.el9 CentOS-AppStream 31 k 2024-03-09T14:23:34.089 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-09T14:23:34.090 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-09T14:23:34.090 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-09T14:23:34.090 INFO:teuthology.orchestra.run.smithi088.stdout: openjpeg2 x86_64 2.4.0-7.el9 CentOS-AppStream 162 k 2024-03-09T14:23:34.090 INFO:teuthology.orchestra.run.smithi088.stdout: opus x86_64 1.3.1-10.el9 CentOS-AppStream 199 k 2024-03-09T14:23:34.090 INFO:teuthology.orchestra.run.smithi088.stdout: orc x86_64 0.4.31-6.el9 CentOS-AppStream 183 k 2024-03-09T14:23:34.090 INFO:teuthology.orchestra.run.smithi088.stdout: osinfo-db noarch 20231215-1.el9 appstream 521 k 2024-03-09T14:23:34.090 INFO:teuthology.orchestra.run.smithi088.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 CentOS-AppStream 68 k 2024-03-09T14:23:34.090 INFO:teuthology.orchestra.run.smithi088.stdout: ostree-libs x86_64 2024.4-3.el9 appstream 487 k 2024-03-09T14:23:34.090 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-09T14:23:34.090 INFO:teuthology.orchestra.run.smithi088.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-03-09T14:23:34.090 INFO:teuthology.orchestra.run.smithi088.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-03-09T14:23:34.090 INFO:teuthology.orchestra.run.smithi088.stdout: plexus-cipher noarch 1.7-27.el9 CentOS-AppStream 25 k 2024-03-09T14:23:34.090 INFO:teuthology.orchestra.run.smithi088.stdout: plexus-classworlds noarch 2.6.0-11.el9 CentOS-AppStream 59 k 2024-03-09T14:23:34.090 INFO:teuthology.orchestra.run.smithi088.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 CentOS-AppStream 17 k 2024-03-09T14:23:34.091 INFO:teuthology.orchestra.run.smithi088.stdout: plexus-interpolation noarch 1.26-11.el9 CentOS-AppStream 79 k 2024-03-09T14:23:34.091 INFO:teuthology.orchestra.run.smithi088.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 CentOS-AppStream 33 k 2024-03-09T14:23:34.091 INFO:teuthology.orchestra.run.smithi088.stdout: plexus-utils noarch 3.3.0-10.el9 CentOS-AppStream 253 k 2024-03-09T14:23:34.091 INFO:teuthology.orchestra.run.smithi088.stdout: poppler x86_64 21.01.0-19.el9 appstream 1.1 M 2024-03-09T14:23:34.091 INFO:teuthology.orchestra.run.smithi088.stdout: poppler-data noarch 0.4.9-9.el9 CentOS-AppStream 1.8 M 2024-03-09T14:23:34.091 INFO:teuthology.orchestra.run.smithi088.stdout: poppler-glib x86_64 21.01.0-19.el9 appstream 152 k 2024-03-09T14:23:34.091 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-09T14:23:34.091 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-09T14:23:34.091 INFO:teuthology.orchestra.run.smithi088.stdout: publicsuffix-list noarch 20210518-3.el9 CentOS-AppStream 82 k 2024-03-09T14:23:34.091 INFO:teuthology.orchestra.run.smithi088.stdout: pulseaudio-libs x86_64 15.0-2.el9 CentOS-AppStream 666 k 2024-03-09T14:23:34.091 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-09T14:23:34.091 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-09T14:23:34.091 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-09T14:23:34.092 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-09T14:23:34.092 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 45 k 2024-03-09T14:23:34.092 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 131 k 2024-03-09T14:23:34.092 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-09T14:23:34.092 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-09T14:23:34.092 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-09T14:23:34.092 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-09T14:23:34.092 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-09T14:23:34.092 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-09T14:23:34.093 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-09T14:23:34.093 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-09T14:23:34.093 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-09T14:23:34.093 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-09T14:23:34.093 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-09T14:23:34.093 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-09T14:23:34.093 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-09T14:23:34.093 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-09T14:23:34.093 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-09T14:23:34.093 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-09T14:23:34.093 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-09T14:23:34.093 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-09T14:23:34.093 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-09T14:23:34.093 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-09T14:23:34.094 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-09T14:23:34.094 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-09T14:23:34.094 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-09T14:23:34.094 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-09T14:23:34.094 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-09T14:23:34.094 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-09T14:23:34.094 INFO:teuthology.orchestra.run.smithi088.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-09T14:23:34.094 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-09T14:23:34.094 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-09T14:23:34.094 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-09T14:23:34.094 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-09T14:23:34.094 INFO:teuthology.orchestra.run.smithi088.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-09T14:23:34.095 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-09T14:23:34.095 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-09T14:23:34.095 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-09T14:23:34.095 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-09T14:23:34.095 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-09T14:23:34.095 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-09T14:23:34.095 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-09T14:23:34.095 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-09T14:23:34.095 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-09T14:23:34.095 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-09T14:23:34.095 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-09T14:23:34.095 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-09T14:23:34.095 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-09T14:23:34.096 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-09T14:23:34.096 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-09T14:23:34.096 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-09T14:23:34.096 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-09T14:23:34.096 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-09T14:23:34.096 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-09T14:23:34.096 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-09T14:23:34.096 INFO:teuthology.orchestra.run.smithi088.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-09T14:23:34.096 INFO:teuthology.orchestra.run.smithi088.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-09T14:23:34.096 INFO:teuthology.orchestra.run.smithi088.stdout: rtkit x86_64 0.11-28.el9 CentOS-AppStream 55 k 2024-03-09T14:23:34.096 INFO:teuthology.orchestra.run.smithi088.stdout: sisu noarch 1:0.3.4-10.el9 CentOS-AppStream 509 k 2024-03-09T14:23:34.096 INFO:teuthology.orchestra.run.smithi088.stdout: slf4j noarch 1.7.30-13.el9 CentOS-AppStream 68 k 2024-03-09T14:23:34.096 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-09T14:23:34.096 INFO:teuthology.orchestra.run.smithi088.stdout: sound-theme-freedesktop noarch 0.8-17.el9 CentOS-AppStream 377 k 2024-03-09T14:23:34.097 INFO:teuthology.orchestra.run.smithi088.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-09T14:23:34.097 INFO:teuthology.orchestra.run.smithi088.stdout: totem-pl-parser x86_64 3.26.6-2.el9 CentOS-AppStream 130 k 2024-03-09T14:23:34.097 INFO:teuthology.orchestra.run.smithi088.stdout: ttmkfdir x86_64 3.0.9-65.el9 CentOS-AppStream 52 k 2024-03-09T14:23:34.097 INFO:teuthology.orchestra.run.smithi088.stdout: tzdata-java noarch 2024a-1.el9 appstream 230 k 2024-03-09T14:23:34.097 INFO:teuthology.orchestra.run.smithi088.stdout: upower x86_64 0.99.11-11.el9 CentOS-AppStream 168 k 2024-03-09T14:23:34.097 INFO:teuthology.orchestra.run.smithi088.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 CentOS-AppStream 305 k 2024-03-09T14:23:34.097 INFO:teuthology.orchestra.run.smithi088.stdout: wireplumber x86_64 0.4.14-1.el9 CentOS-AppStream 83 k 2024-03-09T14:23:34.097 INFO:teuthology.orchestra.run.smithi088.stdout: wireplumber-libs x86_64 0.4.14-1.el9 CentOS-AppStream 337 k 2024-03-09T14:23:34.097 INFO:teuthology.orchestra.run.smithi088.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 CentOS-AppStream 41 k 2024-03-09T14:23:34.097 INFO:teuthology.orchestra.run.smithi088.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-03-09T14:23:34.097 INFO:teuthology.orchestra.run.smithi088.stdout: xkeyboard-config noarch 2.33-2.el9 CentOS-AppStream 780 k 2024-03-09T14:23:34.097 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-09T14:23:34.097 INFO:teuthology.orchestra.run.smithi088.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 CentOS-AppStream 499 k 2024-03-09T14:23:34.098 INFO:teuthology.orchestra.run.smithi088.stdout:Installing weak dependencies: 2024-03-09T14:23:34.098 INFO:teuthology.orchestra.run.smithi088.stdout: dconf x86_64 0.40.0-6.el9 CentOS-AppStream 108 k 2024-03-09T14:23:34.098 INFO:teuthology.orchestra.run.smithi088.stdout: exiv2 x86_64 0.27.5-2.el9 CentOS-AppStream 978 k 2024-03-09T14:23:34.098 INFO:teuthology.orchestra.run.smithi088.stdout: flatpak x86_64 1.12.8-1.el9 CentOS-AppStream 1.7 M 2024-03-09T14:23:34.098 INFO:teuthology.orchestra.run.smithi088.stdout: gtk3 x86_64 3.24.31-2.el9 CentOS-AppStream 4.8 M 2024-03-09T14:23:34.098 INFO:teuthology.orchestra.run.smithi088.stdout: java-11-openjdk-devel x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 3.3 M 2024-03-09T14:23:34.098 INFO:teuthology.orchestra.run.smithi088.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 CentOS-AppStream 31 k 2024-03-09T14:23:34.098 INFO:teuthology.orchestra.run.smithi088.stdout: p11-kit-server x86_64 0.24.1-2.el9 CentOS-AppStream 198 k 2024-03-09T14:23:34.098 INFO:teuthology.orchestra.run.smithi088.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-03-09T14:23:34.098 INFO:teuthology.orchestra.run.smithi088.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-03-09T14:23:34.098 INFO:teuthology.orchestra.run.smithi088.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-03-09T14:23:34.098 INFO:teuthology.orchestra.run.smithi088.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-03-09T14:23:34.099 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-09T14:23:34.099 INFO:teuthology.orchestra.run.smithi088.stdout: tracker x86_64 3.1.2-3.el9 CentOS-AppStream 537 k 2024-03-09T14:23:34.099 INFO:teuthology.orchestra.run.smithi088.stdout: tracker-miners x86_64 3.1.2-4.el9 CentOS-AppStream 893 k 2024-03-09T14:23:34.099 INFO:teuthology.orchestra.run.smithi088.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 CentOS-AppStream 130 k 2024-03-09T14:23:34.099 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:23:34.099 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-03-09T14:23:34.099 INFO:teuthology.orchestra.run.smithi088.stdout:=========================================================================================================== 2024-03-09T14:23:34.099 INFO:teuthology.orchestra.run.smithi088.stdout:Install 282 Packages 2024-03-09T14:23:34.099 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 2 Packages 2024-03-09T14:23:34.099 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:23:34.100 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 297 M 2024-03-09T14:23:34.100 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-03-09T14:23:34.191 INFO:teuthology.orchestra.run.smithi132.stdout:(176/284): rtkit-0.11-28.el9.x86_64.rpm 395 kB/s | 55 kB 00:00 2024-03-09T14:23:34.342 INFO:teuthology.orchestra.run.smithi132.stdout:(177/284): python3-scipy-1.6.2-8.el9.x86_64.rpm 49 MB/s | 16 MB 00:00 2024-03-09T14:23:34.383 INFO:teuthology.orchestra.run.smithi132.stdout:(178/284): sisu-0.3.4-10.el9.noarch.rpm 1.6 MB/s | 509 kB 00:00 2024-03-09T14:23:34.409 INFO:teuthology.orchestra.run.smithi132.stdout:(179/284): slf4j-1.7.30-13.el9.noarch.rpm 316 kB/s | 68 kB 00:00 2024-03-09T14:23:34.442 INFO:teuthology.orchestra.run.smithi132.stdout:(180/284): socat-1.7.4.1-5.el9.x86_64.rpm 5.0 MB/s | 300 kB 00:00 2024-03-09T14:23:34.468 INFO:teuthology.orchestra.run.smithi132.stdout:(181/284): sound-theme-freedesktop-0.8-17.el9.n 4.4 MB/s | 377 kB 00:00 2024-03-09T14:23:34.493 INFO:teuthology.orchestra.run.smithi132.stdout:(182/284): totem-pl-parser-3.26.6-2.el9.x86_64. 1.5 MB/s | 130 kB 00:00 2024-03-09T14:23:34.518 INFO:teuthology.orchestra.run.smithi132.stdout:(183/284): tracker-3.1.2-3.el9.x86_64.rpm 11 MB/s | 537 kB 00:00 2024-03-09T14:23:34.552 INFO:teuthology.orchestra.run.smithi132.stdout:(184/284): tracker-miners-3.1.2-4.el9.x86_64.rp 10 MB/s | 893 kB 00:00 2024-03-09T14:23:34.577 INFO:teuthology.orchestra.run.smithi132.stdout:(185/284): ttmkfdir-3.0.9-65.el9.x86_64.rpm 635 kB/s | 52 kB 00:00 2024-03-09T14:23:34.602 INFO:teuthology.orchestra.run.smithi132.stdout:(186/284): upower-0.99.11-11.el9.x86_64.rpm 3.3 MB/s | 168 kB 00:00 2024-03-09T14:23:34.644 INFO:teuthology.orchestra.run.smithi132.stdout:(187/284): webrtc-audio-processing-0.3.1-8.el9. 3.2 MB/s | 305 kB 00:00 2024-03-09T14:23:34.669 INFO:teuthology.orchestra.run.smithi132.stdout:(188/284): wireplumber-0.4.14-1.el9.x86_64.rpm 906 kB/s | 83 kB 00:00 2024-03-09T14:23:34.695 INFO:teuthology.orchestra.run.smithi132.stdout:(189/284): wireplumber-libs-0.4.14-1.el9.x86_64 6.6 MB/s | 337 kB 00:00 2024-03-09T14:23:34.720 INFO:teuthology.orchestra.run.smithi132.stdout:(190/284): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 552 kB/s | 41 kB 00:00 2024-03-09T14:23:34.753 INFO:teuthology.orchestra.run.smithi132.stdout:(191/284): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.5 MB/s | 130 kB 00:00 2024-03-09T14:23:34.779 INFO:teuthology.orchestra.run.smithi132.stdout:(192/284): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 63 kB 00:00 2024-03-09T14:23:34.812 INFO:teuthology.orchestra.run.smithi132.stdout:(193/284): xkeyboard-config-2.33-2.el9.noarch.r 8.3 MB/s | 780 kB 00:00 2024-03-09T14:23:34.838 INFO:teuthology.orchestra.run.smithi132.stdout:(194/284): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.8 MB/s | 499 kB 00:00 2024-03-09T14:23:34.863 INFO:teuthology.orchestra.run.smithi132.stdout:(195/284): ModemManager-glib-1.20.2-1.el9.x86_6 4.0 MB/s | 334 kB 00:00 2024-03-09T14:23:34.888 INFO:teuthology.orchestra.run.smithi132.stdout:(196/284): bluez-libs-5.64-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-03-09T14:23:34.913 INFO:teuthology.orchestra.run.smithi132.stdout:(197/284): bubblewrap-0.4.1-6.el9.x86_64.rpm 660 kB/s | 49 kB 00:00 2024-03-09T14:23:34.939 INFO:teuthology.orchestra.run.smithi132.stdout:(198/284): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-09T14:23:34.963 INFO:teuthology.orchestra.run.smithi132.stdout:(199/284): libpciaccess-0.16-6.el9.x86_64.rpm 533 kB/s | 27 kB 00:00 2024-03-09T14:23:34.989 INFO:teuthology.orchestra.run.smithi132.stdout:(200/284): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.2 MB/s | 90 kB 00:00 2024-03-09T14:23:35.014 INFO:teuthology.orchestra.run.smithi132.stdout:(201/284): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-03-09T14:23:35.048 INFO:teuthology.orchestra.run.smithi132.stdout:(202/284): python3-cryptography-36.0.1-4.el9.x8 20 MB/s | 1.1 MB 00:00 2024-03-09T14:23:35.073 INFO:teuthology.orchestra.run.smithi132.stdout:(203/284): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-09T14:23:35.107 INFO:teuthology.orchestra.run.smithi132.stdout:(204/284): python3-pycparser-2.20-6.el9.noarch. 1.3 MB/s | 124 kB 00:00 2024-03-09T14:23:35.132 INFO:teuthology.orchestra.run.smithi132.stdout:(205/284): python3-urllib3-1.26.5-5.el9.noarch. 3.1 MB/s | 187 kB 00:00 2024-03-09T14:23:35.366 INFO:teuthology.orchestra.run.smithi132.stdout:(206/284): cups-libs-2.3.3op2-24.el9.x86_64.rpm 897 kB/s | 262 kB 00:00 2024-03-09T14:23:35.399 INFO:teuthology.orchestra.run.smithi132.stdout:(207/284): jq-1.6-16.el9.x86_64.rpm 641 kB/s | 187 kB 00:00 2024-03-09T14:23:35.412 INFO:teuthology.orchestra.run.smithi088.stdout:(1/284): ceph-19.0.0-2079.gc00d9c60.el9.x86_64. 15 kB/s | 6.6 kB 00:00 2024-03-09T14:23:35.441 INFO:teuthology.orchestra.run.smithi132.stdout:(208/284): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-03-09T14:23:35.466 INFO:teuthology.orchestra.run.smithi132.stdout:(209/284): python3-requests-2.25.1-8.el9.noarch 1.8 MB/s | 125 kB 00:00 2024-03-09T14:23:35.508 INFO:teuthology.orchestra.run.smithi132.stdout:(210/284): libgfortran-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 803 kB 00:00 2024-03-09T14:23:35.700 INFO:teuthology.orchestra.run.smithi132.stdout:(211/284): avahi-glib-0.8-12.el9.x86_64.rpm 63 kB/s | 15 kB 00:00 2024-03-09T14:23:35.750 INFO:teuthology.orchestra.run.smithi132.stdout:(212/284): flac-libs-1.3.3-12.el9.x86_64.rpm 901 kB/s | 218 kB 00:00 2024-03-09T14:23:35.775 INFO:teuthology.orchestra.run.smithi132.stdout:(213/284): alsa-lib-1.2.10-2.el9.x86_64.rpm 1.5 MB/s | 523 kB 00:00 2024-03-09T14:23:35.867 INFO:teuthology.orchestra.run.smithi132.stdout:(214/284): libsndfile-1.0.31-8.el9.x86_64.rpm 2.2 MB/s | 206 kB 00:00 2024-03-09T14:23:35.901 INFO:teuthology.orchestra.run.smithi132.stdout:(215/284): libdrm-2.4.117-1.el9.x86_64.rpm 1.0 MB/s | 161 kB 00:00 2024-03-09T14:23:35.960 INFO:teuthology.orchestra.run.smithi132.stdout:(216/284): gstreamer1-plugins-base-1.22.1-2.el9 8.7 MB/s | 2.2 MB 00:00 2024-03-09T14:23:36.001 INFO:teuthology.orchestra.run.smithi132.stdout:(217/284): libtiff-4.4.0-12.el9.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2024-03-09T14:23:36.027 INFO:teuthology.orchestra.run.smithi132.stdout:(218/284): mesa-libEGL-23.3.3-1.el9.x86_64.rpm 1.0 MB/s | 127 kB 00:00 2024-03-09T14:23:36.069 INFO:teuthology.orchestra.run.smithi132.stdout:(219/284): mesa-libGL-23.3.3-1.el9.x86_64.rpm 1.5 MB/s | 168 kB 00:00 2024-03-09T14:23:36.105 INFO:teuthology.orchestra.run.smithi132.stdout:(220/284): mesa-libgbm-23.3.3-1.el9.x86_64.rpm 373 kB/s | 38 kB 00:00 2024-03-09T14:23:36.120 INFO:teuthology.orchestra.run.smithi132.stdout:(221/284): mesa-libglapi-23.3.3-1.el9.x86_64.rp 479 kB/s | 44 kB 00:00 2024-03-09T14:23:36.171 INFO:teuthology.orchestra.run.smithi088.stdout:(2/284): ceph-fuse-19.0.0-2079.gc00d9c60.el9.x8 1.1 MB/s | 888 kB 00:00 2024-03-09T14:23:36.211 INFO:teuthology.orchestra.run.smithi132.stdout:(222/284): ostree-libs-2024.4-3.el9.x86_64.rpm 4.4 MB/s | 487 kB 00:00 2024-03-09T14:23:36.237 INFO:teuthology.orchestra.run.smithi132.stdout:(223/284): pipewire-1.0.1-1.el9.x86_64.rpm 912 kB/s | 107 kB 00:00 2024-03-09T14:23:36.254 INFO:teuthology.orchestra.run.smithi088.stdout:(3/284): ceph-base-19.0.0-2079.gc00d9c60.el9.x8 4.1 MB/s | 5.4 MB 00:01 2024-03-09T14:23:36.279 INFO:teuthology.orchestra.run.smithi132.stdout:(224/284): osinfo-db-20231215-1.el9.noarch.rpm 2.4 MB/s | 521 kB 00:00 2024-03-09T14:23:36.305 INFO:teuthology.orchestra.run.smithi088.stdout:(4/284): ceph-immutable-object-cache-19.0.0-207 1.1 MB/s | 145 kB 00:00 2024-03-09T14:23:36.321 INFO:teuthology.orchestra.run.smithi132.stdout:(225/284): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 526 kB/s | 57 kB 00:00 2024-03-09T14:23:36.368 INFO:teuthology.orchestra.run.smithi132.stdout:(226/284): pipewire-jack-audio-connection-kit-1 70 kB/s | 9.1 kB 00:00 2024-03-09T14:23:36.410 INFO:teuthology.orchestra.run.smithi132.stdout:(227/284): pipewire-jack-audio-connection-kit-l 1.0 MB/s | 135 kB 00:00 2024-03-09T14:23:36.463 INFO:teuthology.orchestra.run.smithi088.stdout:(5/284): ceph-mds-19.0.0-2079.gc00d9c60.el9.x86 10 MB/s | 2.1 MB 00:00 2024-03-09T14:23:36.468 INFO:teuthology.orchestra.run.smithi132.stdout:(228/284): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.9 MB/s | 192 kB 00:00 2024-03-09T14:23:36.561 INFO:teuthology.orchestra.run.smithi132.stdout:(229/284): pipewire-libs-1.0.1-1.el9.x86_64.rpm 8.0 MB/s | 1.9 MB 00:00 2024-03-09T14:23:36.594 INFO:teuthology.orchestra.run.smithi132.stdout:(230/284): poppler-21.01.0-19.el9.x86_64.rpm 5.8 MB/s | 1.1 MB 00:00 2024-03-09T14:23:36.620 INFO:teuthology.orchestra.run.smithi132.stdout:(231/284): poppler-glib-21.01.0-19.el9.x86_64.r 1.0 MB/s | 152 kB 00:00 2024-03-09T14:23:36.687 INFO:teuthology.orchestra.run.smithi132.stdout:(232/284): python3-devel-3.9.17-2.el9.x86_64.rp 1.9 MB/s | 245 kB 00:00 2024-03-09T14:23:36.722 INFO:teuthology.orchestra.run.smithi132.stdout:(233/284): python3-jinja2-2.11.3-5.el9.noarch.r 1.9 MB/s | 248 kB 00:00 2024-03-09T14:23:36.755 INFO:teuthology.orchestra.run.smithi088.stdout:(6/284): ceph-mon-19.0.0-2079.gc00d9c60.el9.x86 16 MB/s | 4.7 MB 00:00 2024-03-09T14:23:36.762 INFO:teuthology.orchestra.run.smithi132.stdout:(234/284): qatlib-23.11.0-1.el9.x86_64.rpm 1.5 MB/s | 216 kB 00:00 2024-03-09T14:23:36.796 INFO:teuthology.orchestra.run.smithi132.stdout:(235/284): qatlib-service-23.11.0-1.el9.x86_64. 320 kB/s | 35 kB 00:00 2024-03-09T14:23:36.821 INFO:teuthology.orchestra.run.smithi132.stdout:(236/284): qatzip-libs-1.1.2-2.el9.x86_64.rpm 443 kB/s | 44 kB 00:00 2024-03-09T14:23:36.947 INFO:teuthology.orchestra.run.smithi088.stdout:(7/284): ceph-mgr-19.0.0-2079.gc00d9c60.el9.x86 2.3 MB/s | 1.5 MB 00:00 2024-03-09T14:23:36.996 INFO:teuthology.orchestra.run.smithi132.stdout:(237/284): tzdata-java-2024a-1.el9.noarch.rpm 982 kB/s | 230 kB 00:00 2024-03-09T14:23:37.072 INFO:teuthology.orchestra.run.smithi132.stdout:(238/284): xdg-desktop-portal-1.12.6-1.el9.x86_ 1.4 MB/s | 385 kB 00:00 2024-03-09T14:23:37.189 INFO:teuthology.orchestra.run.smithi132.stdout:(239/284): lua-devel-5.4.4-4.el9.x86_64.rpm 61 kB/s | 22 kB 00:00 2024-03-09T14:23:37.264 INFO:teuthology.orchestra.run.smithi132.stdout:(240/284): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-03-09T14:23:37.540 INFO:teuthology.orchestra.run.smithi132.stdout:(241/284): grpc-data-1.46.7-10.el9.noarch.rpm 78 kB/s | 19 kB 00:00 2024-03-09T14:23:37.564 INFO:teuthology.orchestra.run.smithi132.stdout:(242/284): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-03-09T14:23:37.640 INFO:teuthology.orchestra.run.smithi132.stdout:(243/284): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-03-09T14:23:37.665 INFO:teuthology.orchestra.run.smithi132.stdout:(244/284): gperftools-libs-2.9.1-2.el9.x86_64.r 649 kB/s | 309 kB 00:00 2024-03-09T14:23:37.706 INFO:teuthology.orchestra.run.smithi088.stdout:(8/284): ceph-osd-19.0.0-2079.gc00d9c60.el9.x86 18 MB/s | 17 MB 00:00 2024-03-09T14:23:37.715 INFO:teuthology.orchestra.run.smithi132.stdout:(245/284): liboath-2.6.7-2.el9.x86_64.rpm 646 kB/s | 49 kB 00:00 2024-03-09T14:23:37.749 INFO:teuthology.orchestra.run.smithi132.stdout:(246/284): libunwind-1.6.2-1.el9.x86_64.rpm 808 kB/s | 67 kB 00:00 2024-03-09T14:23:37.756 INFO:teuthology.orchestra.run.smithi088.stdout:(9/284): ceph-selinux-19.0.0-2079.gc00d9c60.el9 506 kB/s | 25 kB 00:00 2024-03-09T14:23:37.800 INFO:teuthology.orchestra.run.smithi132.stdout:(247/284): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-03-09T14:23:37.908 INFO:teuthology.orchestra.run.smithi132.stdout:(248/284): python3-asyncssh-2.13.2-4.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-03-09T14:23:37.941 INFO:teuthology.orchestra.run.smithi132.stdout:(249/284): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.3 MB/s | 838 kB 00:00 2024-03-09T14:23:37.983 INFO:teuthology.orchestra.run.smithi132.stdout:(250/284): python3-bcrypt-3.2.2-1.el9.x86_64.rp 579 kB/s | 43 kB 00:00 2024-03-09T14:23:38.051 INFO:teuthology.orchestra.run.smithi132.stdout:(251/284): libarrow-9.0.0-10.el9.x86_64.rpm 8.7 MB/s | 4.4 MB 00:00 2024-03-09T14:23:38.076 INFO:teuthology.orchestra.run.smithi132.stdout:(252/284): python3-certifi-2021.10.8-2.el9.noar 163 kB/s | 15 kB 00:00 2024-03-09T14:23:38.101 INFO:teuthology.orchestra.run.smithi132.stdout:(253/284): python3-cachetools-4.2.4-1.el9.noarc 202 kB/s | 32 kB 00:00 2024-03-09T14:23:38.135 INFO:teuthology.orchestra.run.smithi132.stdout:(254/284): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-03-09T14:23:38.160 INFO:teuthology.orchestra.run.smithi132.stdout:(255/284): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-03-09T14:23:38.185 INFO:teuthology.orchestra.run.smithi132.stdout:(256/284): python3-google-auth-2.28.0-1.el9.noa 2.4 MB/s | 203 kB 00:00 2024-03-09T14:23:38.235 INFO:teuthology.orchestra.run.smithi132.stdout:(257/284): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-03-09T14:23:38.260 INFO:teuthology.orchestra.run.smithi132.stdout:(258/284): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-03-09T14:23:38.327 INFO:teuthology.orchestra.run.smithi132.stdout:(259/284): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-03-09T14:23:38.354 INFO:teuthology.orchestra.run.smithi132.stdout:(260/284): python3-jaraco-classes-3.2.1-5.el9.n 151 kB/s | 18 kB 00:00 2024-03-09T14:23:38.378 INFO:teuthology.orchestra.run.smithi132.stdout:(261/284): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2024-03-09T14:23:38.403 INFO:teuthology.orchestra.run.smithi132.stdout:(262/284): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-03-09T14:23:38.445 INFO:teuthology.orchestra.run.smithi132.stdout:(263/284): python3-jaraco-text-3.2.0-6.el9.noar 295 kB/s | 20 kB 00:00 2024-03-09T14:23:38.479 INFO:teuthology.orchestra.run.smithi132.stdout:(264/284): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-03-09T14:23:38.504 INFO:teuthology.orchestra.run.smithi132.stdout:(265/284): python3-logutils-0.3.5-21.el9.noarch 461 kB/s | 46 kB 00:00 2024-03-09T14:23:38.529 INFO:teuthology.orchestra.run.smithi132.stdout:(266/284): python3-more-itertools-8.12.0-2.el9. 942 kB/s | 79 kB 00:00 2024-03-09T14:23:38.554 INFO:teuthology.orchestra.run.smithi132.stdout:(267/284): python3-natsort-7.1.1-5.el9.noarch.r 767 kB/s | 58 kB 00:00 2024-03-09T14:23:38.580 INFO:teuthology.orchestra.run.smithi132.stdout:(268/284): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-03-09T14:23:38.597 INFO:teuthology.orchestra.run.smithi132.stdout:(269/284): python3-portend-3.1.0-2.el9.noarch.r 244 kB/s | 16 kB 00:00 2024-03-09T14:23:38.630 INFO:teuthology.orchestra.run.smithi132.stdout:(270/284): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-03-09T14:23:38.647 INFO:teuthology.orchestra.run.smithi132.stdout:(271/284): python3-repoze-lru-0.7-16.el9.noarch 457 kB/s | 31 kB 00:00 2024-03-09T14:23:38.681 INFO:teuthology.orchestra.run.smithi132.stdout:(272/284): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-03-09T14:23:38.706 INFO:teuthology.orchestra.run.smithi132.stdout:(273/284): python3-rsa-4.9-2.el9.noarch.rpm 779 kB/s | 59 kB 00:00 2024-03-09T14:23:38.732 INFO:teuthology.orchestra.run.smithi132.stdout:(274/284): python3-tempora-5.0.0-2.el9.noarch.r 425 kB/s | 36 kB 00:00 2024-03-09T14:23:38.757 INFO:teuthology.orchestra.run.smithi132.stdout:(275/284): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-03-09T14:23:38.782 INFO:teuthology.orchestra.run.smithi132.stdout:(276/284): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-09T14:23:38.807 INFO:teuthology.orchestra.run.smithi132.stdout:(277/284): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-03-09T14:23:38.858 INFO:teuthology.orchestra.run.smithi132.stdout:(278/284): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-03-09T14:23:38.883 INFO:teuthology.orchestra.run.smithi132.stdout:(279/284): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-03-09T14:23:38.910 INFO:teuthology.orchestra.run.smithi132.stdout:(280/284): re2-20211101-3.el9.x86_64.rpm 1.8 MB/s | 192 kB 00:00 2024-03-09T14:23:38.935 INFO:teuthology.orchestra.run.smithi132.stdout:(281/284): s3cmd-2.4.0-1.el9.noarch.rpm 2.6 MB/s | 206 kB 00:00 2024-03-09T14:23:38.985 INFO:teuthology.orchestra.run.smithi132.stdout:(282/284): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-03-09T14:23:39.598 INFO:teuthology.orchestra.run.smithi088.stdout:(10/284): ceph-radosgw-19.0.0-2079.gc00d9c60.el 3.8 MB/s | 10 MB 00:02 2024-03-09T14:23:39.794 INFO:teuthology.orchestra.run.smithi132.stdout:(283/284): librados2-19.0.0-2079.gc00d9c60.el9. 3.8 MB/s | 3.4 MB 00:00 2024-03-09T14:23:39.806 INFO:teuthology.orchestra.run.smithi088.stdout:(11/284): ceph-common-19.0.0-2079.gc00d9c60.el9 4.2 MB/s | 20 MB 00:04 2024-03-09T14:23:39.857 INFO:teuthology.orchestra.run.smithi088.stdout:(12/284): libcephfs-devel-19.0.0-2079.gc00d9c60 120 kB/s | 31 kB 00:00 2024-03-09T14:23:39.923 INFO:teuthology.orchestra.run.smithi088.stdout:(13/284): libcephfs2-19.0.0-2079.gc00d9c60.el9. 6.3 MB/s | 745 kB 00:00 2024-03-09T14:23:39.949 INFO:teuthology.orchestra.run.smithi088.stdout:(14/284): libcephsqlite-19.0.0-2079.gc00d9c60.e 1.7 MB/s | 163 kB 00:00 2024-03-09T14:23:39.999 INFO:teuthology.orchestra.run.smithi088.stdout:(15/284): librados-devel-19.0.0-2079.gc00d9c60. 1.7 MB/s | 127 kB 00:00 2024-03-09T14:23:40.175 INFO:teuthology.orchestra.run.smithi088.stdout:(16/284): libradosstriper1-19.0.0-2079.gc00d9c6 2.2 MB/s | 501 kB 00:00 2024-03-09T14:23:40.244 INFO:teuthology.orchestra.run.smithi132.stdout:(284/284): librbd1-19.0.0-2079.gc00d9c60.el9.x8 2.4 MB/s | 3.1 MB 00:01 2024-03-09T14:23:40.253 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-03-09T14:23:40.253 INFO:teuthology.orchestra.run.smithi132.stdout:Total 17 MB/s | 297 MB 00:17 2024-03-09T14:23:40.266 INFO:teuthology.orchestra.run.smithi088.stdout:(17/284): python3-ceph-argparse-19.0.0-2079.gc0 491 kB/s | 45 kB 00:00 2024-03-09T14:23:40.358 INFO:teuthology.orchestra.run.smithi088.stdout:(18/284): python3-ceph-common-19.0.0-2079.gc00d 1.4 MB/s | 131 kB 00:00 2024-03-09T14:23:40.467 INFO:teuthology.orchestra.run.smithi088.stdout:(19/284): python3-cephfs-19.0.0-2079.gc00d9c60. 1.5 MB/s | 162 kB 00:00 2024-03-09T14:23:40.576 INFO:teuthology.orchestra.run.smithi088.stdout:(20/284): python3-rados-19.0.0-2079.gc00d9c60.e 2.9 MB/s | 321 kB 00:00 2024-03-09T14:23:40.657 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-03-09T14:23:40.717 INFO:teuthology.orchestra.run.smithi088.stdout:(21/284): librgw2-19.0.0-2079.gc00d9c60.el9.x86 7.3 MB/s | 5.3 MB 00:00 2024-03-09T14:23:40.743 INFO:teuthology.orchestra.run.smithi088.stdout:(22/284): python3-rbd-19.0.0-2079.gc00d9c60.el9 1.7 MB/s | 299 kB 00:00 2024-03-09T14:23:40.821 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-03-09T14:23:40.821 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-03-09T14:23:41.160 INFO:teuthology.orchestra.run.smithi088.stdout:(23/284): ceph-test-19.0.0-2079.gc00d9c60.el9.x 14 MB/s | 48 MB 00:03 2024-03-09T14:23:41.185 INFO:teuthology.orchestra.run.smithi088.stdout:(24/284): rbd-fuse-19.0.0-2079.gc00d9c60.el9.x8 193 kB/s | 85 kB 00:00 2024-03-09T14:23:41.210 INFO:teuthology.orchestra.run.smithi088.stdout:(25/284): python3-rgw-19.0.0-2079.gc00d9c60.el9 202 kB/s | 99 kB 00:00 2024-03-09T14:23:41.277 INFO:teuthology.orchestra.run.smithi088.stdout:(26/284): rbd-nbd-19.0.0-2079.gc00d9c60.el9.x86 1.8 MB/s | 170 kB 00:00 2024-03-09T14:23:41.294 INFO:teuthology.orchestra.run.smithi088.stdout:(27/284): ceph-grafana-dashboards-19.0.0-2079.g 406 kB/s | 34 kB 00:00 2024-03-09T14:23:41.411 INFO:teuthology.orchestra.run.smithi088.stdout:(28/284): rbd-mirror-19.0.0-2079.gc00d9c60.el9. 12 MB/s | 3.1 MB 00:00 2024-03-09T14:23:41.445 INFO:teuthology.orchestra.run.smithi088.stdout:(29/284): ceph-mgr-cephadm-19.0.0-2079.gc00d9c6 831 kB/s | 139 kB 00:00 2024-03-09T14:23:41.537 INFO:teuthology.orchestra.run.smithi088.stdout:(30/284): ceph-mgr-modules-core-19.0.0-2079.gc0 2.6 MB/s | 248 kB 00:00 2024-03-09T14:23:41.629 INFO:teuthology.orchestra.run.smithi088.stdout:(31/284): ceph-mgr-rook-19.0.0-2079.gc00d9c60.e 539 kB/s | 49 kB 00:00 2024-03-09T14:23:41.704 INFO:teuthology.orchestra.run.smithi088.stdout:(32/284): ceph-mgr-dashboard-19.0.0-2079.gc00d9 4.4 MB/s | 1.8 MB 00:00 2024-03-09T14:23:41.730 INFO:teuthology.orchestra.run.smithi088.stdout:(33/284): ceph-prometheus-alerts-19.0.0-2079.gc 164 kB/s | 16 kB 00:00 2024-03-09T14:23:41.855 INFO:teuthology.orchestra.run.smithi088.stdout:(34/284): ceph-volume-19.0.0-2079.gc00d9c60.el9 1.7 MB/s | 264 kB 00:00 2024-03-09T14:23:41.930 INFO:teuthology.orchestra.run.smithi088.stdout:(35/284): cephadm-19.0.0-2079.gc00d9c60.el9.noa 3.7 MB/s | 749 kB 00:00 2024-03-09T14:23:42.072 INFO:teuthology.orchestra.run.smithi088.stdout:(36/284): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-03-09T14:23:42.097 INFO:teuthology.orchestra.run.smithi088.stdout:(37/284): adwaita-cursor-theme-40.1.1-3.el9.noa 2.5 MB/s | 625 kB 00:00 2024-03-09T14:23:42.198 INFO:teuthology.orchestra.run.smithi088.stdout:(38/284): apache-commons-cli-1.4-17.el9.noarch. 564 kB/s | 70 kB 00:00 2024-03-09T14:23:42.231 INFO:teuthology.orchestra.run.smithi088.stdout:(39/284): apache-commons-codec-1.15-7.el9.noarc 2.2 MB/s | 301 kB 00:00 2024-03-09T14:23:42.348 INFO:teuthology.orchestra.run.smithi088.stdout:(40/284): adwaita-icon-theme-40.1.1-3.el9.noarc 25 MB/s | 11 MB 00:00 2024-03-09T14:23:42.382 INFO:teuthology.orchestra.run.smithi088.stdout:(41/284): apache-commons-io-2.8.0-8.el9.noarch. 1.5 MB/s | 282 kB 00:00 2024-03-09T14:23:42.416 INFO:teuthology.orchestra.run.smithi088.stdout:(42/284): apache-commons-lang3-3.12.0-6.el9.noa 3.0 MB/s | 558 kB 00:00 2024-03-09T14:23:42.441 INFO:teuthology.orchestra.run.smithi088.stdout:(43/284): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.5 MB/s | 86 kB 00:00 2024-03-09T14:23:42.466 INFO:teuthology.orchestra.run.smithi088.stdout:(44/284): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.1 MB/s | 176 kB 00:00 2024-03-09T14:23:42.491 INFO:teuthology.orchestra.run.smithi088.stdout:(45/284): atinject-1.0.3-6.el9.noarch.rpm 297 kB/s | 22 kB 00:00 2024-03-09T14:23:42.517 INFO:teuthology.orchestra.run.smithi088.stdout:(46/284): atk-2.36.0-5.el9.x86_64.rpm 5.3 MB/s | 270 kB 00:00 2024-03-09T14:23:42.550 INFO:teuthology.orchestra.run.smithi088.stdout:(47/284): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 106 kB 00:00 2024-03-09T14:23:42.567 INFO:teuthology.orchestra.run.smithi088.stdout:(48/284): cdi-api-2.0.2-6.el9.noarch.rpm 698 kB/s | 52 kB 00:00 2024-03-09T14:23:42.601 INFO:teuthology.orchestra.run.smithi088.stdout:(49/284): colord-libs-1.4.5-4.el9.x86_64.rpm 4.5 MB/s | 228 kB 00:00 2024-03-09T14:23:42.617 INFO:teuthology.orchestra.run.smithi088.stdout:(50/284): copy-jdk-configs-4.0-3.el9.noarch.rpm 406 kB/s | 27 kB 00:00 2024-03-09T14:23:42.643 INFO:teuthology.orchestra.run.smithi088.stdout:(51/284): dconf-0.40.0-6.el9.x86_64.rpm 1.4 MB/s | 108 kB 00:00 2024-03-09T14:23:42.685 INFO:teuthology.orchestra.run.smithi088.stdout:(52/284): exempi-2.6.0-0.2.20211007gite23c213.e 7.7 MB/s | 524 kB 00:00 2024-03-09T14:23:42.718 INFO:teuthology.orchestra.run.smithi088.stdout:(53/284): exiv2-0.27.5-2.el9.x86_64.rpm 9.5 MB/s | 978 kB 00:00 2024-03-09T14:23:42.768 INFO:teuthology.orchestra.run.smithi088.stdout:(54/284): exiv2-libs-0.27.5-2.el9.x86_64.rpm 6.1 MB/s | 780 kB 00:00 2024-03-09T14:23:42.794 INFO:teuthology.orchestra.run.smithi088.stdout:(55/284): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.0 MB/s | 324 kB 00:00 2024-03-09T14:23:42.827 INFO:teuthology.orchestra.run.smithi088.stdout:(56/284): flatpak-selinux-1.12.8-1.el9.noarch.r 351 kB/s | 20 kB 00:00 2024-03-09T14:23:42.869 INFO:teuthology.orchestra.run.smithi088.stdout:(57/284): flatpak-1.12.8-1.el9.x86_64.rpm 17 MB/s | 1.7 MB 00:00 2024-03-09T14:23:42.903 INFO:teuthology.orchestra.run.smithi088.stdout:(58/284): flatpak-session-helper-1.12.8-1.el9.x 673 kB/s | 73 kB 00:00 2024-03-09T14:23:42.928 INFO:teuthology.orchestra.run.smithi088.stdout:(59/284): flexiblas-3.0.4-8.el9.x86_64.rpm 321 kB/s | 32 kB 00:00 2024-03-09T14:23:43.012 INFO:teuthology.orchestra.run.smithi088.stdout:(60/284): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-03-09T14:23:43.037 INFO:teuthology.orchestra.run.smithi088.stdout:(61/284): flexiblas-openblas-openmp-3.0.4-8.el9 163 kB/s | 17 kB 00:00 2024-03-09T14:23:43.062 INFO:teuthology.orchestra.run.smithi088.stdout:(62/284): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 644 kB/s | 84 kB 00:00 2024-03-09T14:23:43.105 INFO:teuthology.orchestra.run.smithi088.stdout:(63/284): geoclue2-2.6.0-7.el9.x86_64.rpm 1.3 MB/s | 122 kB 00:00 2024-03-09T14:23:43.130 INFO:teuthology.orchestra.run.smithi088.stdout:(64/284): giflib-5.2.1-9.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-03-09T14:23:43.155 INFO:teuthology.orchestra.run.smithi088.stdout:(65/284): google-guice-4.2.3-9.el9.noarch.rpm 5.0 MB/s | 472 kB 00:00 2024-03-09T14:23:43.180 INFO:teuthology.orchestra.run.smithi088.stdout:(66/284): graphene-1.10.6-2.el9.x86_64.rpm 854 kB/s | 63 kB 00:00 2024-03-09T14:23:43.205 INFO:teuthology.orchestra.run.smithi088.stdout:(67/284): gsm-1.0.19-6.el9.x86_64.rpm 661 kB/s | 33 kB 00:00 2024-03-09T14:23:43.248 INFO:teuthology.orchestra.run.smithi088.stdout:(68/284): gstreamer1-1.22.1-2.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-03-09T14:23:43.272 INFO:teuthology.orchestra.run.smithi088.stdout:(69/284): gtk-update-icon-cache-3.24.31-2.el9.x 378 kB/s | 34 kB 00:00 2024-03-09T14:23:43.406 INFO:teuthology.orchestra.run.smithi088.stdout:(70/284): gtk3-3.24.31-2.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2024-03-09T14:23:43.412 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-03-09T14:23:43.412 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-03-09T14:23:43.432 INFO:teuthology.orchestra.run.smithi088.stdout:(71/284): hicolor-icon-theme-0.17-13.el9.noarch 421 kB/s | 65 kB 00:00 2024-03-09T14:23:43.473 INFO:teuthology.orchestra.run.smithi088.stdout:(72/284): guava-30.1-6.el9.noarch.rpm 12 MB/s | 2.3 MB 00:00 2024-03-09T14:23:43.499 INFO:teuthology.orchestra.run.smithi088.stdout:(73/284): httpcomponents-client-4.5.13-3.el9.no 7.1 MB/s | 656 kB 00:00 2024-03-09T14:23:43.532 INFO:teuthology.orchestra.run.smithi088.stdout:(74/284): httpcomponents-core-4.4.13-7.el9.noar 6.3 MB/s | 630 kB 00:00 2024-03-09T14:23:43.558 INFO:teuthology.orchestra.run.smithi088.stdout:(75/284): jakarta-annotations-1.3.5-13.el9.noar 768 kB/s | 44 kB 00:00 2024-03-09T14:23:43.608 INFO:teuthology.orchestra.run.smithi088.stdout:(76/284): iso-codes-4.6.0-3.el9.noarch.rpm 31 MB/s | 3.3 MB 00:00 2024-03-09T14:23:43.641 INFO:teuthology.orchestra.run.smithi088.stdout:(77/284): jansi-2.3.3-6.el9.x86_64.rpm 1.0 MB/s | 108 kB 00:00 2024-03-09T14:23:43.675 INFO:teuthology.orchestra.run.smithi088.stdout:(78/284): java-11-openjdk-11.0.18.0.10-3.el9.x8 3.7 MB/s | 439 kB 00:00 2024-03-09T14:23:43.817 INFO:teuthology.orchestra.run.smithi088.stdout:(79/284): java-11-openjdk-devel-11.0.18.0.10-3. 19 MB/s | 3.3 MB 00:00 2024-03-09T14:23:43.867 INFO:teuthology.orchestra.run.smithi088.stdout:(80/284): javapackages-filesystem-6.0.0-4.el9.n 55 kB/s | 10 kB 00:00 2024-03-09T14:23:44.034 INFO:teuthology.orchestra.run.smithi088.stdout:(81/284): jbigkit-libs-2.1-23.el9.x86_64.rpm 240 kB/s | 52 kB 00:00 2024-03-09T14:23:44.059 INFO:teuthology.orchestra.run.smithi088.stdout:(82/284): jcl-over-slf4j-1.7.30-13.el9.noarch.r 121 kB/s | 23 kB 00:00 2024-03-09T14:23:44.201 INFO:teuthology.orchestra.run.smithi088.stdout:(83/284): jsoup-1.13.1-10.el9.noarch.rpm 2.2 MB/s | 376 kB 00:00 2024-03-09T14:23:44.577 INFO:teuthology.orchestra.run.smithi088.stdout:(84/284): java-11-openjdk-headless-11.0.18.0.10 42 MB/s | 40 MB 00:00 2024-03-09T14:23:44.602 INFO:teuthology.orchestra.run.smithi088.stdout:(85/284): jsr-305-3.0.2-6.el9.noarch.rpm 57 kB/s | 31 kB 00:00 2024-03-09T14:23:44.627 INFO:teuthology.orchestra.run.smithi088.stdout:(86/284): lcms2-2.12-3.el9.x86_64.rpm 393 kB/s | 166 kB 00:00 2024-03-09T14:23:44.644 INFO:teuthology.orchestra.run.smithi088.stdout:(87/284): libX11-xcb-1.7.0-8.el9.x86_64.rpm 148 kB/s | 9.8 kB 00:00 2024-03-09T14:23:44.661 INFO:teuthology.orchestra.run.smithi088.stdout:(88/284): libXcomposite-0.4.5-7.el9.x86_64.rpm 693 kB/s | 23 kB 00:00 2024-03-09T14:23:44.678 INFO:teuthology.orchestra.run.smithi088.stdout:(89/284): libXcursor-1.2.0-7.el9.x86_64.rpm 593 kB/s | 30 kB 00:00 2024-03-09T14:23:44.694 INFO:teuthology.orchestra.run.smithi088.stdout:(90/284): libXdamage-1.1.5-7.el9.x86_64.rpm 435 kB/s | 22 kB 00:00 2024-03-09T14:23:44.712 INFO:teuthology.orchestra.run.smithi088.stdout:(91/284): libXfixes-5.0.3-16.el9.x86_64.rpm 563 kB/s | 19 kB 00:00 2024-03-09T14:23:44.729 INFO:teuthology.orchestra.run.smithi088.stdout:(92/284): libXi-1.7.10-8.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-03-09T14:23:44.745 INFO:teuthology.orchestra.run.smithi088.stdout:(93/284): libXinerama-1.1.4-10.el9.x86_64.rpm 279 kB/s | 14 kB 00:00 2024-03-09T14:23:44.771 INFO:teuthology.orchestra.run.smithi088.stdout:(94/284): libXrandr-1.5.2-8.el9.x86_64.rpm 654 kB/s | 27 kB 00:00 2024-03-09T14:23:44.796 INFO:teuthology.orchestra.run.smithi088.stdout:(95/284): libXtst-1.2.3-16.el9.x86_64.rpm 305 kB/s | 20 kB 00:00 2024-03-09T14:23:44.821 INFO:teuthology.orchestra.run.smithi088.stdout:(96/284): libXv-1.0.11-16.el9.x86_64.rpm 238 kB/s | 18 kB 00:00 2024-03-09T14:23:44.847 INFO:teuthology.orchestra.run.smithi088.stdout:(97/284): libXxf86vm-1.1.4-18.el9.x86_64.rpm 354 kB/s | 18 kB 00:00 2024-03-09T14:23:44.872 INFO:teuthology.orchestra.run.smithi088.stdout:(98/284): libasyncns-0.8-22.el9.x86_64.rpm 390 kB/s | 29 kB 00:00 2024-03-09T14:23:44.897 INFO:teuthology.orchestra.run.smithi088.stdout:(99/284): libcanberra-0.30-27.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2024-03-09T14:23:44.923 INFO:teuthology.orchestra.run.smithi088.stdout:(100/284): libcanberra-gtk3-0.30-27.el9.x86_64. 617 kB/s | 31 kB 00:00 2024-03-09T14:23:44.956 INFO:teuthology.orchestra.run.smithi088.stdout:(101/284): libepoxy-1.5.5-4.el9.x86_64.rpm 2.8 MB/s | 240 kB 00:00 2024-03-09T14:23:44.981 INFO:teuthology.orchestra.run.smithi088.stdout:(102/284): libexif-0.6.22-6.el9.x86_64.rpm 5.1 MB/s | 431 kB 00:00 2024-03-09T14:23:45.006 INFO:teuthology.orchestra.run.smithi088.stdout:(103/284): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 82 kB 00:00 2024-03-09T14:23:45.032 INFO:teuthology.orchestra.run.smithi088.stdout:(104/284): libfontenc-1.1.3-17.el9.x86_64.rpm 400 kB/s | 30 kB 00:00 2024-03-09T14:23:45.057 INFO:teuthology.orchestra.run.smithi088.stdout:(105/284): libglvnd-1.3.4-1.el9.x86_64.rpm 1.7 MB/s | 134 kB 00:00 2024-03-09T14:23:45.082 INFO:teuthology.orchestra.run.smithi088.stdout:(106/284): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 474 kB/s | 36 kB 00:00 2024-03-09T14:23:45.107 INFO:teuthology.orchestra.run.smithi088.stdout:(107/284): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.8 MB/s | 141 kB 00:00 2024-03-09T14:23:45.133 INFO:teuthology.orchestra.run.smithi088.stdout:(108/284): libgsf-1.14.47-5.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-03-09T14:23:45.158 INFO:teuthology.orchestra.run.smithi088.stdout:(109/284): libgxps-0.3.2-3.el9.x86_64.rpm 1.0 MB/s | 78 kB 00:00 2024-03-09T14:23:45.184 INFO:teuthology.orchestra.run.smithi088.stdout:(110/284): libiptcdata-1.0.5-9.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-03-09T14:23:45.225 INFO:teuthology.orchestra.run.smithi088.stdout:(111/284): libldac-2.0.2.3-10.el9.x86_64.rpm 438 kB/s | 40 kB 00:00 2024-03-09T14:23:45.251 INFO:teuthology.orchestra.run.smithi088.stdout:(112/284): libnotify-0.7.9-8.el9.x86_64.rpm 463 kB/s | 43 kB 00:00 2024-03-09T14:23:45.276 INFO:teuthology.orchestra.run.smithi088.stdout:(113/284): libogg-1.3.4-6.el9.x86_64.rpm 649 kB/s | 32 kB 00:00 2024-03-09T14:23:45.309 INFO:teuthology.orchestra.run.smithi088.stdout:(114/284): libosinfo-1.10.0-1.el9.x86_64.rpm 3.7 MB/s | 312 kB 00:00 2024-03-09T14:23:45.335 INFO:teuthology.orchestra.run.smithi088.stdout:(115/284): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 159 kB 00:00 2024-03-09T14:23:45.360 INFO:teuthology.orchestra.run.smithi088.stdout:(116/284): librabbitmq-0.11.0-7.el9.x86_64.rpm 887 kB/s | 44 kB 00:00 2024-03-09T14:23:45.385 INFO:teuthology.orchestra.run.smithi088.stdout:(117/284): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-03-09T14:23:45.410 INFO:teuthology.orchestra.run.smithi088.stdout:(118/284): libsbc-1.4-9.el9.x86_64.rpm 590 kB/s | 44 kB 00:00 2024-03-09T14:23:45.436 INFO:teuthology.orchestra.run.smithi088.stdout:(119/284): libtheora-1.1.1-31.el9.x86_64.rpm 3.2 MB/s | 163 kB 00:00 2024-03-09T14:23:45.461 INFO:teuthology.orchestra.run.smithi088.stdout:(120/284): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 479 kB/s | 36 kB 00:00 2024-03-09T14:23:45.494 INFO:teuthology.orchestra.run.smithi088.stdout:(121/284): libtracker-sparql-3.1.2-3.el9.x86_64 3.7 MB/s | 316 kB 00:00 2024-03-09T14:23:45.528 INFO:teuthology.orchestra.run.smithi088.stdout:(122/284): libvisual-0.4.0-34.el9.x86_64.rpm 2.1 MB/s | 143 kB 00:00 2024-03-09T14:23:45.553 INFO:teuthology.orchestra.run.smithi088.stdout:(123/284): libvorbis-1.3.7-5.el9.x86_64.rpm 2.1 MB/s | 192 kB 00:00 2024-03-09T14:23:45.579 INFO:teuthology.orchestra.run.smithi088.stdout:(124/284): libwayland-client-1.21.0-1.el9.x86_6 388 kB/s | 32 kB 00:00 2024-03-09T14:23:45.604 INFO:teuthology.orchestra.run.smithi088.stdout:(125/284): libwayland-cursor-1.21.0-1.el9.x86_6 366 kB/s | 18 kB 00:00 2024-03-09T14:23:45.629 INFO:teuthology.orchestra.run.smithi088.stdout:(126/284): libwayland-egl-1.21.0-1.el9.x86_64.r 157 kB/s | 12 kB 00:00 2024-03-09T14:23:45.663 INFO:teuthology.orchestra.run.smithi088.stdout:(127/284): libwayland-server-1.21.0-1.el9.x86_6 486 kB/s | 41 kB 00:00 2024-03-09T14:23:45.688 INFO:teuthology.orchestra.run.smithi088.stdout:(128/284): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.2 MB/s | 132 kB 00:00 2024-03-09T14:23:45.713 INFO:teuthology.orchestra.run.smithi088.stdout:(129/284): libwebp-1.2.0-8.el9.x86_64.rpm 3.2 MB/s | 276 kB 00:00 2024-03-09T14:23:45.739 INFO:teuthology.orchestra.run.smithi088.stdout:(130/284): libxshmfence-1.3-10.el9.x86_64.rpm 153 kB/s | 12 kB 00:00 2024-03-09T14:23:45.764 INFO:teuthology.orchestra.run.smithi088.stdout:(131/284): low-memory-monitor-2.1-4.el9.x86_64. 464 kB/s | 35 kB 00:00 2024-03-09T14:23:45.789 INFO:teuthology.orchestra.run.smithi088.stdout:(132/284): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-09T14:23:45.814 INFO:teuthology.orchestra.run.smithi088.stdout:(133/284): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-03-09T14:23:45.840 INFO:teuthology.orchestra.run.smithi088.stdout:(134/284): lua-posix-35.0-8.el9.x86_64.rpm 1.7 MB/s | 131 kB 00:00 2024-03-09T14:23:45.865 INFO:teuthology.orchestra.run.smithi088.stdout:(135/284): maven-3.6.3-15.el9.noarch.rpm 223 kB/s | 17 kB 00:00 2024-03-09T14:23:45.882 INFO:teuthology.orchestra.run.smithi088.stdout:(136/284): maven-openjdk11-3.6.3-15.el9.noarch. 191 kB/s | 7.9 kB 00:00 2024-03-09T14:23:45.924 INFO:teuthology.orchestra.run.smithi088.stdout:(137/284): maven-lib-3.6.3-15.el9.noarch.rpm 17 MB/s | 1.5 MB 00:00 2024-03-09T14:23:45.949 INFO:teuthology.orchestra.run.smithi088.stdout:(138/284): maven-resolver-1.6.1-10.el9.noarch.r 6.0 MB/s | 512 kB 00:00 2024-03-09T14:23:45.974 INFO:teuthology.orchestra.run.smithi088.stdout:(139/284): maven-shared-utils-3.3.4-3.el9.noarc 1.6 MB/s | 150 kB 00:00 2024-03-09T14:23:46.000 INFO:teuthology.orchestra.run.smithi088.stdout:(140/284): maven-wagon-3.4.2-7.el9.noarch.rpm 2.2 MB/s | 111 kB 00:00 2024-03-09T14:23:46.025 INFO:teuthology.orchestra.run.smithi088.stdout:(141/284): mkfontscale-1.2.1-3.el9.x86_64.rpm 416 kB/s | 31 kB 00:00 2024-03-09T14:23:46.059 INFO:teuthology.orchestra.run.smithi088.stdout:(142/284): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.5 MB/s | 217 kB 00:00 2024-03-09T14:23:46.084 INFO:teuthology.orchestra.run.smithi088.stdout:(143/284): openblas-0.3.21-2.el9.x86_64.rpm 589 kB/s | 34 kB 00:00 2024-03-09T14:23:46.151 INFO:teuthology.orchestra.run.smithi088.stdout:(144/284): openblas-openmp-0.3.21-2.el9.x86_64. 38 MB/s | 4.7 MB 00:00 2024-03-09T14:23:46.176 INFO:teuthology.orchestra.run.smithi088.stdout:(145/284): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.4 MB/s | 162 kB 00:00 2024-03-09T14:23:46.201 INFO:teuthology.orchestra.run.smithi088.stdout:(146/284): opus-1.3.1-10.el9.x86_64.rpm 1.7 MB/s | 199 kB 00:00 2024-03-09T14:23:46.226 INFO:teuthology.orchestra.run.smithi088.stdout:(147/284): orc-0.4.31-6.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-03-09T14:23:46.252 INFO:teuthology.orchestra.run.smithi088.stdout:(148/284): osinfo-db-tools-1.10.0-1.el9.x86_64. 915 kB/s | 68 kB 00:00 2024-03-09T14:23:46.277 INFO:teuthology.orchestra.run.smithi088.stdout:(149/284): p11-kit-server-0.24.1-2.el9.x86_64.r 2.6 MB/s | 198 kB 00:00 2024-03-09T14:23:46.303 INFO:teuthology.orchestra.run.smithi088.stdout:(150/284): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 59 kB 00:00 2024-03-09T14:23:46.327 INFO:teuthology.orchestra.run.smithi088.stdout:(151/284): plexus-cipher-1.7-27.el9.noarch.rpm 330 kB/s | 25 kB 00:00 2024-03-09T14:23:46.373 INFO:teuthology.orchestra.run.smithi088.stdout:(152/284): plexus-containers-component-annotati 181 kB/s | 17 kB 00:00 2024-03-09T14:23:46.403 INFO:teuthology.orchestra.run.smithi088.stdout:(153/284): plexus-interpolation-1.26-11.el9.noa 785 kB/s | 79 kB 00:00 2024-03-09T14:23:46.428 INFO:teuthology.orchestra.run.smithi088.stdout:(154/284): plexus-sec-dispatcher-1.4-37.el9.noa 596 kB/s | 33 kB 00:00 2024-03-09T14:23:46.453 INFO:teuthology.orchestra.run.smithi088.stdout:(155/284): plexus-utils-3.3.0-10.el9.noarch.rpm 3.1 MB/s | 253 kB 00:00 2024-03-09T14:23:46.504 INFO:teuthology.orchestra.run.smithi088.stdout:(156/284): poppler-data-0.4.9-9.el9.noarch.rpm 18 MB/s | 1.8 MB 00:00 2024-03-09T14:23:46.529 INFO:teuthology.orchestra.run.smithi088.stdout:(157/284): publicsuffix-list-20210518-3.el9.noa 1.1 MB/s | 82 kB 00:00 2024-03-09T14:23:46.571 INFO:teuthology.orchestra.run.smithi088.stdout:(158/284): protobuf-3.14.0-13.el9.x86_64.rpm 8.8 MB/s | 1.0 MB 00:00 2024-03-09T14:23:46.596 INFO:teuthology.orchestra.run.smithi088.stdout:(159/284): pulseaudio-libs-15.0-2.el9.x86_64.rp 7.1 MB/s | 666 kB 00:00 2024-03-09T14:23:46.705 INFO:teuthology.orchestra.run.smithi088.stdout:(160/284): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 5.8 MB 00:00 2024-03-09T14:23:46.731 INFO:teuthology.orchestra.run.smithi088.stdout:(161/284): python3-jsonpatch-1.21-16.el9.noarch 186 kB/s | 24 kB 00:00 2024-03-09T14:23:46.755 INFO:teuthology.orchestra.run.smithi088.stdout:(162/284): python3-jsonpointer-2.0-4.el9.noarch 116 kB/s | 18 kB 00:00 2024-03-09T14:23:46.781 INFO:teuthology.orchestra.run.smithi088.stdout:(163/284): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-03-09T14:23:46.806 INFO:teuthology.orchestra.run.smithi088.stdout:(164/284): python3-markupsafe-1.1.1-12.el9.x86_ 635 kB/s | 32 kB 00:00 2024-03-09T14:23:46.898 INFO:teuthology.orchestra.run.smithi088.stdout:(165/284): python3-numpy-1.20.1-5.el9.x86_64.rp 34 MB/s | 4.8 MB 00:00 2024-03-09T14:23:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:(166/284): python3-numpy-f2py-1.20.1-5.el9.x86_ 1.5 MB/s | 217 kB 00:00 2024-03-09T14:23:46.949 INFO:teuthology.orchestra.run.smithi088.stdout:(167/284): python3-oauthlib-3.1.1-5.el9.noarch. 1.2 MB/s | 174 kB 00:00 2024-03-09T14:23:46.982 INFO:teuthology.orchestra.run.smithi088.stdout:(168/284): python3-packaging-20.9-5.el9.noarch. 827 kB/s | 69 kB 00:00 2024-03-09T14:23:47.007 INFO:teuthology.orchestra.run.smithi088.stdout:(169/284): python3-prettytable-0.7.2-27.el9.noa 703 kB/s | 41 kB 00:00 2024-03-09T14:23:47.033 INFO:teuthology.orchestra.run.smithi088.stdout:(170/284): python3-protobuf-3.14.0-13.el9.noarc 2.8 MB/s | 238 kB 00:00 2024-03-09T14:23:47.058 INFO:teuthology.orchestra.run.smithi088.stdout:(171/284): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.7 MB/s | 132 kB 00:00 2024-03-09T14:23:47.075 INFO:teuthology.orchestra.run.smithi088.stdout:(172/284): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-03-09T14:23:47.100 INFO:teuthology.orchestra.run.smithi088.stdout:(173/284): python3-pyasn1-modules-0.4.8-6.el9.n 3.1 MB/s | 211 kB 00:00 2024-03-09T14:23:47.125 INFO:teuthology.orchestra.run.smithi088.stdout:(174/284): python3-requests-oauthlib-1.3.0-12.e 641 kB/s | 43 kB 00:00 2024-03-09T14:23:47.401 INFO:teuthology.orchestra.run.smithi088.stdout:(175/284): python3-scipy-1.6.2-8.el9.x86_64.rpm 48 MB/s | 16 MB 00:00 2024-03-09T14:23:47.417 INFO:teuthology.orchestra.run.smithi088.stdout:(176/284): python3-toml-0.10.2-6.el9.noarch.rpm 133 kB/s | 39 kB 00:00 2024-03-09T14:23:47.434 INFO:teuthology.orchestra.run.smithi088.stdout:(177/284): rtkit-0.11-28.el9.x86_64.rpm 179 kB/s | 55 kB 00:00 2024-03-09T14:23:47.468 INFO:teuthology.orchestra.run.smithi088.stdout:(178/284): sisu-0.3.4-10.el9.noarch.rpm 7.5 MB/s | 509 kB 00:00 2024-03-09T14:23:47.494 INFO:teuthology.orchestra.run.smithi088.stdout:(179/284): slf4j-1.7.30-13.el9.noarch.rpm 1.1 MB/s | 68 kB 00:00 2024-03-09T14:23:47.518 INFO:teuthology.orchestra.run.smithi088.stdout:(180/284): socat-1.7.4.1-5.el9.x86_64.rpm 3.5 MB/s | 300 kB 00:00 2024-03-09T14:23:47.552 INFO:teuthology.orchestra.run.smithi088.stdout:(181/284): sound-theme-freedesktop-0.8-17.el9.n 4.4 MB/s | 377 kB 00:00 2024-03-09T14:23:47.577 INFO:teuthology.orchestra.run.smithi088.stdout:(182/284): totem-pl-parser-3.26.6-2.el9.x86_64. 2.2 MB/s | 130 kB 00:00 2024-03-09T14:23:47.602 INFO:teuthology.orchestra.run.smithi088.stdout:(183/284): tracker-3.1.2-3.el9.x86_64.rpm 6.3 MB/s | 537 kB 00:00 2024-03-09T14:23:47.644 INFO:teuthology.orchestra.run.smithi088.stdout:(184/284): tracker-miners-3.1.2-4.el9.x86_64.rp 9.5 MB/s | 893 kB 00:00 2024-03-09T14:23:47.670 INFO:teuthology.orchestra.run.smithi088.stdout:(185/284): ttmkfdir-3.0.9-65.el9.x86_64.rpm 792 kB/s | 52 kB 00:00 2024-03-09T14:23:47.695 INFO:teuthology.orchestra.run.smithi088.stdout:(186/284): upower-0.99.11-11.el9.x86_64.rpm 1.8 MB/s | 168 kB 00:00 2024-03-09T14:23:47.729 INFO:teuthology.orchestra.run.smithi088.stdout:(187/284): webrtc-audio-processing-0.3.1-8.el9. 3.6 MB/s | 305 kB 00:00 2024-03-09T14:23:47.754 INFO:teuthology.orchestra.run.smithi088.stdout:(188/284): wireplumber-0.4.14-1.el9.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2024-03-09T14:23:47.788 INFO:teuthology.orchestra.run.smithi088.stdout:(189/284): wireplumber-libs-0.4.14-1.el9.x86_64 3.6 MB/s | 337 kB 00:00 2024-03-09T14:23:47.813 INFO:teuthology.orchestra.run.smithi088.stdout:(190/284): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 495 kB/s | 41 kB 00:00 2024-03-09T14:23:47.838 INFO:teuthology.orchestra.run.smithi088.stdout:(191/284): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.5 MB/s | 130 kB 00:00 2024-03-09T14:23:47.864 INFO:teuthology.orchestra.run.smithi088.stdout:(192/284): xkeyboard-config-2.33-2.el9.noarch.r 10 MB/s | 780 kB 00:00 2024-03-09T14:23:47.889 INFO:teuthology.orchestra.run.smithi088.stdout:(193/284): xmlstarlet-1.6.1-20.el9.x86_64.rpm 845 kB/s | 63 kB 00:00 2024-03-09T14:23:47.923 INFO:teuthology.orchestra.run.smithi088.stdout:(194/284): xorg-x11-fonts-Type1-7.5-33.el9.noar 8.4 MB/s | 499 kB 00:00 2024-03-09T14:23:47.948 INFO:teuthology.orchestra.run.smithi088.stdout:(195/284): ModemManager-glib-1.20.2-1.el9.x86_6 3.9 MB/s | 334 kB 00:00 2024-03-09T14:23:47.973 INFO:teuthology.orchestra.run.smithi088.stdout:(196/284): bluez-libs-5.64-1.el9.x86_64.rpm 1.0 MB/s | 83 kB 00:00 2024-03-09T14:23:47.999 INFO:teuthology.orchestra.run.smithi088.stdout:(197/284): bubblewrap-0.4.1-6.el9.x86_64.rpm 982 kB/s | 49 kB 00:00 2024-03-09T14:23:48.023 INFO:teuthology.orchestra.run.smithi088.stdout:(198/284): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-09T14:23:48.049 INFO:teuthology.orchestra.run.smithi088.stdout:(199/284): libpciaccess-0.16-6.el9.x86_64.rpm 355 kB/s | 27 kB 00:00 2024-03-09T14:23:48.074 INFO:teuthology.orchestra.run.smithi088.stdout:(200/284): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.8 MB/s | 90 kB 00:00 2024-03-09T14:23:48.099 INFO:teuthology.orchestra.run.smithi088.stdout:(201/284): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-03-09T14:23:48.141 INFO:teuthology.orchestra.run.smithi088.stdout:(202/284): python3-cryptography-36.0.1-4.el9.x8 12 MB/s | 1.1 MB 00:00 2024-03-09T14:23:48.167 INFO:teuthology.orchestra.run.smithi088.stdout:(203/284): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2024-03-09T14:23:48.192 INFO:teuthology.orchestra.run.smithi088.stdout:(204/284): python3-pycparser-2.20-6.el9.noarch. 1.3 MB/s | 124 kB 00:00 2024-03-09T14:23:48.217 INFO:teuthology.orchestra.run.smithi088.stdout:(205/284): python3-urllib3-1.26.5-5.el9.noarch. 2.4 MB/s | 187 kB 00:00 2024-03-09T14:23:48.353 INFO:teuthology.orchestra.run.smithi088.stdout:(206/284): jq-1.6-16.el9.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2024-03-09T14:23:48.386 INFO:teuthology.orchestra.run.smithi088.stdout:(207/284): cups-libs-2.3.3op2-24.el9.x86_64.rpm 1.3 MB/s | 262 kB 00:00 2024-03-09T14:23:48.411 INFO:teuthology.orchestra.run.smithi088.stdout:(208/284): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-03-09T14:23:48.437 INFO:teuthology.orchestra.run.smithi088.stdout:(209/284): python3-requests-2.25.1-8.el9.noarch 2.4 MB/s | 125 kB 00:00 2024-03-09T14:23:48.471 INFO:teuthology.orchestra.run.smithi088.stdout:(210/284): libgfortran-11.4.1-3.el9.x86_64.rpm 3.1 MB/s | 803 kB 00:00 2024-03-09T14:23:48.529 INFO:teuthology.orchestra.run.smithi088.stdout:(211/284): avahi-glib-0.8-12.el9.x86_64.rpm 160 kB/s | 15 kB 00:00 2024-03-09T14:23:48.597 INFO:teuthology.orchestra.run.smithi088.stdout:(212/284): alsa-lib-1.2.10-2.el9.x86_64.rpm 2.8 MB/s | 523 kB 00:00 2024-03-09T14:23:48.630 INFO:teuthology.orchestra.run.smithi088.stdout:(213/284): flac-libs-1.3.3-12.el9.x86_64.rpm 1.3 MB/s | 218 kB 00:00 2024-03-09T14:23:48.655 INFO:teuthology.orchestra.run.smithi088.stdout:(214/284): libdrm-2.4.117-1.el9.x86_64.rpm 2.7 MB/s | 161 kB 00:00 2024-03-09T14:23:48.681 INFO:teuthology.orchestra.run.smithi088.stdout:(215/284): libsndfile-1.0.31-8.el9.x86_64.rpm 4.0 MB/s | 206 kB 00:00 2024-03-09T14:23:48.706 INFO:teuthology.orchestra.run.smithi088.stdout:(216/284): libtiff-4.4.0-12.el9.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2024-03-09T14:23:48.731 INFO:teuthology.orchestra.run.smithi088.stdout:(217/284): mesa-libEGL-23.3.3-1.el9.x86_64.rpm 2.5 MB/s | 127 kB 00:00 2024-03-09T14:23:48.765 INFO:teuthology.orchestra.run.smithi088.stdout:(218/284): mesa-libGL-23.3.3-1.el9.x86_64.rpm 2.8 MB/s | 168 kB 00:00 2024-03-09T14:23:48.790 INFO:teuthology.orchestra.run.smithi088.stdout:(219/284): mesa-libgbm-23.3.3-1.el9.x86_64.rpm 642 kB/s | 38 kB 00:00 2024-03-09T14:23:48.815 INFO:teuthology.orchestra.run.smithi088.stdout:(220/284): mesa-libglapi-23.3.3-1.el9.x86_64.rp 884 kB/s | 44 kB 00:00 2024-03-09T14:23:48.866 INFO:teuthology.orchestra.run.smithi088.stdout:(221/284): gstreamer1-plugins-base-1.22.1-2.el9 6.7 MB/s | 2.2 MB 00:00 2024-03-09T14:23:48.900 INFO:teuthology.orchestra.run.smithi088.stdout:(222/284): osinfo-db-20231215-1.el9.noarch.rpm 4.7 MB/s | 521 kB 00:00 2024-03-09T14:23:48.925 INFO:teuthology.orchestra.run.smithi088.stdout:(223/284): pipewire-1.0.1-1.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-03-09T14:23:48.950 INFO:teuthology.orchestra.run.smithi088.stdout:(224/284): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 57 kB 00:00 2024-03-09T14:23:48.975 INFO:teuthology.orchestra.run.smithi088.stdout:(225/284): pipewire-jack-audio-connection-kit-1 182 kB/s | 9.1 kB 00:00 2024-03-09T14:23:49.001 INFO:teuthology.orchestra.run.smithi088.stdout:(226/284): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 135 kB 00:00 2024-03-09T14:23:49.026 INFO:teuthology.orchestra.run.smithi088.stdout:(227/284): ostree-libs-2024.4-3.el9.x86_64.rpm 2.3 MB/s | 487 kB 00:00 2024-03-09T14:23:49.060 INFO:teuthology.orchestra.run.smithi088.stdout:(228/284): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.2 MB/s | 192 kB 00:00 2024-03-09T14:23:49.110 INFO:teuthology.orchestra.run.smithi088.stdout:(229/284): pipewire-libs-1.0.1-1.el9.x86_64.rpm 14 MB/s | 1.9 MB 00:00 2024-03-09T14:23:49.144 INFO:teuthology.orchestra.run.smithi088.stdout:(230/284): poppler-21.01.0-19.el9.x86_64.rpm 9.1 MB/s | 1.1 MB 00:00 2024-03-09T14:23:49.169 INFO:teuthology.orchestra.run.smithi088.stdout:(231/284): poppler-glib-21.01.0-19.el9.x86_64.r 1.4 MB/s | 152 kB 00:00 2024-03-09T14:23:49.194 INFO:teuthology.orchestra.run.smithi088.stdout:(232/284): python3-devel-3.9.17-2.el9.x86_64.rp 2.9 MB/s | 245 kB 00:00 2024-03-09T14:23:49.220 INFO:teuthology.orchestra.run.smithi088.stdout:(233/284): python3-jinja2-2.11.3-5.el9.noarch.r 3.2 MB/s | 248 kB 00:00 2024-03-09T14:23:49.245 INFO:teuthology.orchestra.run.smithi088.stdout:(234/284): qatlib-service-23.11.0-1.el9.x86_64. 694 kB/s | 35 kB 00:00 2024-03-09T14:23:49.262 INFO:teuthology.orchestra.run.smithi088.stdout:(235/284): qatzip-libs-1.1.2-2.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-09T14:23:49.287 INFO:teuthology.orchestra.run.smithi088.stdout:(236/284): qatlib-23.11.0-1.el9.x86_64.rpm 1.8 MB/s | 216 kB 00:00 2024-03-09T14:23:49.312 INFO:teuthology.orchestra.run.smithi088.stdout:(237/284): tzdata-java-2024a-1.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-03-09T14:23:49.337 INFO:teuthology.orchestra.run.smithi088.stdout:(238/284): lua-devel-5.4.4-4.el9.x86_64.rpm 443 kB/s | 22 kB 00:00 2024-03-09T14:23:49.371 INFO:teuthology.orchestra.run.smithi088.stdout:(239/284): xdg-desktop-portal-1.12.6-1.el9.x86_ 3.5 MB/s | 385 kB 00:00 2024-03-09T14:23:49.430 INFO:teuthology.orchestra.run.smithi088.stdout:(240/284): protobuf-compiler-3.14.0-13.el9.x86_ 7.2 MB/s | 863 kB 00:00 2024-03-09T14:23:49.647 INFO:teuthology.orchestra.run.smithi088.stdout:(241/284): grpc-data-1.46.7-10.el9.noarch.rpm 101 kB/s | 19 kB 00:00 2024-03-09T14:23:49.714 INFO:teuthology.orchestra.run.smithi088.stdout:(242/284): abseil-cpp-20211102.0-3.el9.x86_64.r 1.4 MB/s | 548 kB 00:00 2024-03-09T14:23:49.739 INFO:teuthology.orchestra.run.smithi088.stdout:(243/284): gperftools-libs-2.9.1-2.el9.x86_64.r 905 kB/s | 309 kB 00:00 2024-03-09T14:23:49.773 INFO:teuthology.orchestra.run.smithi088.stdout:(244/284): libarrow-doc-9.0.0-10.el9.noarch.rpm 445 kB/s | 26 kB 00:00 2024-03-09T14:23:49.798 INFO:teuthology.orchestra.run.smithi088.stdout:(245/284): liboath-2.6.7-2.el9.x86_64.rpm 829 kB/s | 49 kB 00:00 2024-03-09T14:23:49.832 INFO:teuthology.orchestra.run.smithi088.stdout:(246/284): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-03-09T14:23:49.873 INFO:teuthology.orchestra.run.smithi088.stdout:(247/284): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-03-09T14:23:49.940 INFO:teuthology.orchestra.run.smithi088.stdout:(248/284): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.6 MB/s | 838 kB 00:00 2024-03-09T14:23:49.999 INFO:teuthology.orchestra.run.smithi088.stdout:(249/284): python3-asyncssh-2.13.2-4.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-03-09T14:23:50.024 INFO:teuthology.orchestra.run.smithi088.stdout:(250/284): python3-bcrypt-3.2.2-1.el9.x86_64.rp 520 kB/s | 43 kB 00:00 2024-03-09T14:23:50.100 INFO:teuthology.orchestra.run.smithi088.stdout:(251/284): libarrow-9.0.0-10.el9.x86_64.rpm 9.8 MB/s | 4.4 MB 00:00 2024-03-09T14:23:50.125 INFO:teuthology.orchestra.run.smithi088.stdout:(252/284): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-03-09T14:23:50.150 INFO:teuthology.orchestra.run.smithi088.stdout:(253/284): python3-cachetools-4.2.4-1.el9.noarc 213 kB/s | 32 kB 00:00 2024-03-09T14:23:50.176 INFO:teuthology.orchestra.run.smithi088.stdout:(254/284): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-03-09T14:23:50.201 INFO:teuthology.orchestra.run.smithi088.stdout:(255/284): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-03-09T14:23:50.234 INFO:teuthology.orchestra.run.smithi088.stdout:(256/284): python3-google-auth-2.28.0-1.el9.noa 2.4 MB/s | 203 kB 00:00 2024-03-09T14:23:50.260 INFO:teuthology.orchestra.run.smithi088.stdout:(257/284): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-03-09T14:23:50.290 INFO:teuthology.orchestra.run.smithi088.stdout:(258/284): python3-jaraco-8.2.1-3.el9.noarch.rp 194 kB/s | 11 kB 00:00 2024-03-09T14:23:50.407 INFO:teuthology.orchestra.run.smithi088.stdout:(259/284): python3-grpcio-1.46.7-10.el9.x86_64. 8.8 MB/s | 2.0 MB 00:00 2024-03-09T14:23:50.433 INFO:teuthology.orchestra.run.smithi088.stdout:(260/284): python3-jaraco-classes-3.2.1-5.el9.n 103 kB/s | 18 kB 00:00 2024-03-09T14:23:50.458 INFO:teuthology.orchestra.run.smithi088.stdout:(261/284): python3-jaraco-collections-3.0.0-8.e 138 kB/s | 23 kB 00:00 2024-03-09T14:23:50.483 INFO:teuthology.orchestra.run.smithi088.stdout:(262/284): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-03-09T14:23:50.516 INFO:teuthology.orchestra.run.smithi088.stdout:(263/284): python3-jaraco-text-3.2.0-6.el9.noar 338 kB/s | 20 kB 00:00 2024-03-09T14:23:50.542 INFO:teuthology.orchestra.run.smithi088.stdout:(264/284): python3-logutils-0.3.5-21.el9.noarch 790 kB/s | 46 kB 00:00 2024-03-09T14:23:50.576 INFO:teuthology.orchestra.run.smithi088.stdout:(265/284): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-03-09T14:23:50.601 INFO:teuthology.orchestra.run.smithi088.stdout:(266/284): python3-more-itertools-8.12.0-2.el9. 942 kB/s | 79 kB 00:00 2024-03-09T14:23:50.626 INFO:teuthology.orchestra.run.smithi088.stdout:(267/284): python3-natsort-7.1.1-5.el9.noarch.r 688 kB/s | 58 kB 00:00 2024-03-09T14:23:50.651 INFO:teuthology.orchestra.run.smithi088.stdout:(268/284): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-03-09T14:23:50.676 INFO:teuthology.orchestra.run.smithi088.stdout:(269/284): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-03-09T14:23:50.702 INFO:teuthology.orchestra.run.smithi088.stdout:(270/284): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-03-09T14:23:50.727 INFO:teuthology.orchestra.run.smithi088.stdout:(271/284): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-03-09T14:23:50.761 INFO:teuthology.orchestra.run.smithi088.stdout:(272/284): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-03-09T14:23:50.786 INFO:teuthology.orchestra.run.smithi088.stdout:(273/284): python3-tempora-5.0.0-2.el9.noarch.r 612 kB/s | 36 kB 00:00 2024-03-09T14:23:50.811 INFO:teuthology.orchestra.run.smithi088.stdout:(274/284): python3-rsa-4.9-2.el9.noarch.rpm 542 kB/s | 59 kB 00:00 2024-03-09T14:23:50.837 INFO:teuthology.orchestra.run.smithi088.stdout:(275/284): python3-typing-extensions-4.4.0-2.el 674 kB/s | 51 kB 00:00 2024-03-09T14:23:50.862 INFO:teuthology.orchestra.run.smithi088.stdout:(276/284): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-09T14:23:50.887 INFO:teuthology.orchestra.run.smithi088.stdout:(277/284): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-03-09T14:23:50.929 INFO:teuthology.orchestra.run.smithi088.stdout:(278/284): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-03-09T14:23:50.954 INFO:teuthology.orchestra.run.smithi088.stdout:(279/284): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-03-09T14:23:50.980 INFO:teuthology.orchestra.run.smithi088.stdout:(280/284): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-03-09T14:23:51.022 INFO:teuthology.orchestra.run.smithi088.stdout:(281/284): s3cmd-2.4.0-1.el9.noarch.rpm 2.2 MB/s | 206 kB 00:00 2024-03-09T14:23:51.063 INFO:teuthology.orchestra.run.smithi088.stdout:(282/284): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-03-09T14:23:51.322 INFO:teuthology.orchestra.run.smithi088.stdout:(283/284): librbd1-19.0.0-2079.gc00d9c60.el9.x8 10 MB/s | 3.1 MB 00:00 2024-03-09T14:23:51.531 INFO:teuthology.orchestra.run.smithi088.stdout:(284/284): librados2-19.0.0-2079.gc00d9c60.el9. 6.1 MB/s | 3.4 MB 00:00 2024-03-09T14:23:51.537 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-03-09T14:23:51.537 INFO:teuthology.orchestra.run.smithi088.stdout:Total 17 MB/s | 297 MB 00:17 2024-03-09T14:23:51.926 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-03-09T14:23:52.090 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-03-09T14:23:52.091 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-03-09T14:23:53.074 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-03-09T14:23:53.224 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 1/1 2024-03-09T14:23:53.385 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-03-09T14:23:53.497 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/286 2024-03-09T14:23:53.541 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : alsa-lib-1.2.10-2.el9.x86_64 2/286 2024-03-09T14:23:53.573 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 3/286 2024-03-09T14:23:53.605 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libXi-1.7.10-8.el9.x86_64 4/286 2024-03-09T14:23:53.660 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/286 2024-03-09T14:23:53.693 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/286 2024-03-09T14:23:53.719 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/286 2024-03-09T14:23:53.767 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/286 2024-03-09T14:23:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/286 2024-03-09T14:23:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 10/286 2024-03-09T14:23:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 10/286 2024-03-09T14:23:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 11/286 2024-03-09T14:23:54.418 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 11/286 2024-03-09T14:23:54.450 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rados-2:19.0.0-2079.gc00d9c60.el9.x86_64 12/286 2024-03-09T14:23:54.492 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/286 2024-03-09T14:23:54.535 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/286 2024-03-09T14:23:54.560 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/286 2024-03-09T14:23:54.587 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/286 2024-03-09T14:23:54.602 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-03-09T14:23:54.603 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-03-09T14:23:54.619 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/286 2024-03-09T14:23:54.644 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/286 2024-03-09T14:23:54.690 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 19/286 2024-03-09T14:23:54.855 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/286 2024-03-09T14:23:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/286 2024-03-09T14:23:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/286 2024-03-09T14:23:55.066 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/286 2024-03-09T14:23:55.093 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 24/286 2024-03-09T14:23:55.198 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 24/286 2024-03-09T14:23:55.227 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86 25/286 2024-03-09T14:23:55.290 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86 25/286 2024-03-09T14:23:55.317 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/286 2024-03-09T14:23:55.345 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-09T14:23:55.361 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-09T14:23:55.554 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-09T14:23:55.592 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-09T14:23:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : re2-1:20211101-3.el9.x86_64 29/286 2024-03-09T14:23:55.790 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 30/286 2024-03-09T14:23:55.836 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 31/286 2024-03-09T14:23:55.871 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/286 2024-03-09T14:23:55.906 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : mesa-libglapi-23.3.3-1.el9.x86_64 33/286 2024-03-09T14:23:55.949 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 34/286 2024-03-09T14:23:55.984 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 35/286 2024-03-09T14:23:56.059 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cups-libs-1:2.3.3op2-24.el9.x86_64 36/286 2024-03-09T14:23:56.111 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 37/286 2024-03-09T14:23:56.145 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 38/286 2024-03-09T14:23:56.184 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fuse-2.9.9-15.el9.x86_64 39/286 2024-03-09T14:23:56.249 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 40/286 2024-03-09T14:23:56.283 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 41/286 2024-03-09T14:23:56.326 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 42/286 2024-03-09T14:23:56.351 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 43/286 2024-03-09T14:23:56.378 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 44/286 2024-03-09T14:23:56.409 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 45/286 2024-03-09T14:23:56.437 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 46/286 2024-03-09T14:23:56.465 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 47/286 2024-03-09T14:23:56.498 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 48/286 2024-03-09T14:23:56.522 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 49/286 2024-03-09T14:23:56.562 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 50/286 2024-03-09T14:23:56.587 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : dconf-0.40.0-6.el9.x86_64 51/286 2024-03-09T14:23:56.666 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 51/286 2024-03-09T14:23:56.695 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-common-2:19.0.0-2079.gc00d9c60.el9. 52/286 2024-03-09T14:23:56.730 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-argparse-2:19.0.0-2079.gc00d9c60.el 53/286 2024-03-09T14:23:56.772 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cephfs-2:19.0.0-2079.gc00d9c60.el9.x86_6 54/286 2024-03-09T14:23:56.847 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/286 2024-03-09T14:23:56.985 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/286 2024-03-09T14:23:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/286 2024-03-09T14:23:57.599 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/286 2024-03-09T14:23:57.680 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/286 2024-03-09T14:23:57.715 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 60/286 2024-03-09T14:23:57.776 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 61/286 2024-03-09T14:23:57.812 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/286 2024-03-09T14:23:57.849 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/286 2024-03-09T14:23:57.879 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/286 2024-03-09T14:23:57.942 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/286 2024-03-09T14:23:57.980 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : luarocks-3.9.2-1.el9.noarch 66/286 2024-03-09T14:23:58.006 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/286 2024-03-09T14:23:58.041 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/286 2024-03-09T14:23:58.079 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librados-devel-2:19.0.0-2079.gc00d9c60.el9.x86_6 69/286 2024-03-09T14:23:58.110 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/286 2024-03-09T14:23:58.146 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/286 2024-03-09T14:23:58.186 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 72/286 2024-03-09T14:23:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/286 2024-03-09T14:23:58.279 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/286 2024-03-09T14:23:58.307 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/286 2024-03-09T14:23:58.364 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/286 2024-03-09T14:23:58.437 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/286 2024-03-09T14:23:58.467 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 78/286 2024-03-09T14:23:58.503 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 79/286 2024-03-09T14:23:58.550 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/286 2024-03-09T14:23:58.596 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/286 2024-03-09T14:23:58.638 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/286 2024-03-09T14:23:58.776 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/286 2024-03-09T14:23:58.823 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/286 2024-03-09T14:23:58.865 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 85/286 2024-03-09T14:23:58.962 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/286 2024-03-09T14:23:59.032 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 87/286 2024-03-09T14:23:59.072 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/286 2024-03-09T14:23:59.105 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/286 2024-03-09T14:23:59.129 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 90/286 2024-03-09T14:23:59.213 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/286 2024-03-09T14:23:59.341 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/286 2024-03-09T14:23:59.527 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/286 2024-03-09T14:23:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : tzdata-java-2024a-1.el9.noarch 94/286 2024-03-09T14:23:59.686 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 95/286 2024-03-09T14:24:00.175 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ostree-libs-2024.4-3.el9.x86_64 96/286 2024-03-09T14:24:00.212 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : osinfo-db-20231215-1.el9.noarch 97/286 2024-03-09T14:24:00.247 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 98/286 2024-03-09T14:24:00.297 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ply-3.11-14.el9.noarch 99/286 2024-03-09T14:24:00.353 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 100/286 2024-03-09T14:24:00.552 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 101/286 2024-03-09T14:24:00.610 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 102/286 2024-03-09T14:24:00.759 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 103/286 2024-03-09T14:24:00.800 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 104/286 2024-03-09T14:24:00.838 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 105/286 2024-03-09T14:24:00.870 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 106/286 2024-03-09T14:24:00.907 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 107/286 2024-03-09T14:24:00.937 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libdrm-2.4.117-1.el9.x86_64 108/286 2024-03-09T14:24:00.964 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : mesa-libgbm-23.3.3-1.el9.x86_64 109/286 2024-03-09T14:24:00.990 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 110/286 2024-03-09T14:24:01.016 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : mesa-libEGL-23.3.3-1.el9.x86_64 111/286 2024-03-09T14:24:01.041 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 112/286 2024-03-09T14:24:01.073 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : bluez-libs-5.64-1.el9.x86_64 113/286 2024-03-09T14:24:01.104 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 114/286 2024-03-09T14:24:01.316 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 115/286 2024-03-09T14:24:01.355 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 116/286 2024-03-09T14:24:01.378 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 117/286 2024-03-09T14:24:01.416 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 118/286 2024-03-09T14:24:01.458 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 119/286 2024-03-09T14:24:01.487 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : upower-0.99.11-11.el9.x86_64 120/286 2024-03-09T14:24:01.499 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 120/286 2024-03-09T14:24:01.499 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-03-09T14:24:01.499 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:01.578 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 121/286 2024-03-09T14:24:01.626 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 122/286 2024-03-09T14:24:01.651 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 123/286 2024-03-09T14:24:01.675 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 123/286 2024-03-09T14:24:01.702 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 124/286 2024-03-09T14:24:02.047 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 125/286 2024-03-09T14:24:02.081 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rtkit-0.11-28.el9.x86_64 125/286 2024-03-09T14:24:02.094 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 125/286 2024-03-09T14:24:02.094 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-03-09T14:24:02.094 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:02.137 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 126/286 2024-03-09T14:24:02.213 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 127/286 2024-03-09T14:24:02.247 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 128/286 2024-03-09T14:24:02.272 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 129/286 2024-03-09T14:24:02.306 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 130/286 2024-03-09T14:24:02.340 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 131/286 2024-03-09T14:24:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 132/286 2024-03-09T14:24:02.529 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 133/286 2024-03-09T14:24:02.580 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 134/286 2024-03-09T14:24:02.611 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 135/286 2024-03-09T14:24:02.659 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 136/286 2024-03-09T14:24:02.757 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-packaging-20.9-5.el9.noarch 137/286 2024-03-09T14:24:02.813 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 138/286 2024-03-09T14:24:03.558 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 139/286 2024-03-09T14:24:03.601 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 140/286 2024-03-09T14:24:03.635 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 141/286 2024-03-09T14:24:03.670 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 142/286 2024-03-09T14:24:03.861 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 143/286 2024-03-09T14:24:03.897 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 144/286 2024-03-09T14:24:03.937 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 145/286 2024-03-09T14:24:03.995 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 146/286 2024-03-09T14:24:04.032 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 147/286 2024-03-09T14:24:04.066 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : orc-0.4.31-6.el9.x86_64 148/286 2024-03-09T14:24:04.099 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 149/286 2024-03-09T14:24:04.173 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-03-09T14:24:04.275 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-0.3.21-2.el9.x86_64 150/286 2024-03-09T14:24:04.314 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 151/286 2024-03-09T14:24:04.326 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 1/1 2024-03-09T14:24:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 152/286 2024-03-09T14:24:04.488 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-03-09T14:24:04.603 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/286 2024-03-09T14:24:04.635 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : alsa-lib-1.2.10-2.el9.x86_64 2/286 2024-03-09T14:24:04.714 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 3/286 2024-03-09T14:24:04.911 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libXi-1.7.10-8.el9.x86_64 4/286 2024-03-09T14:24:05.002 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/286 2024-03-09T14:24:05.045 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/286 2024-03-09T14:24:05.058 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 153/286 2024-03-09T14:24:05.078 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/286 2024-03-09T14:24:05.128 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/286 2024-03-09T14:24:05.205 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 154/286 2024-03-09T14:24:05.467 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/286 2024-03-09T14:24:05.520 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 10/286 2024-03-09T14:24:05.625 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 10/286 2024-03-09T14:24:05.655 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 11/286 2024-03-09T14:24:05.731 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 11/286 2024-03-09T14:24:05.758 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:19.0.0-2079.gc00d9c60.el9.x86_64 12/286 2024-03-09T14:24:05.797 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/286 2024-03-09T14:24:05.826 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/286 2024-03-09T14:24:05.860 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/286 2024-03-09T14:24:05.886 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/286 2024-03-09T14:24:05.918 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/286 2024-03-09T14:24:05.960 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/286 2024-03-09T14:24:05.991 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 19/286 2024-03-09T14:24:06.131 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/286 2024-03-09T14:24:06.269 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/286 2024-03-09T14:24:06.302 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/286 2024-03-09T14:24:06.339 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/286 2024-03-09T14:24:06.368 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 24/286 2024-03-09T14:24:06.456 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 24/286 2024-03-09T14:24:06.470 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 155/286 2024-03-09T14:24:06.485 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86 25/286 2024-03-09T14:24:06.548 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86 25/286 2024-03-09T14:24:06.557 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 156/286 2024-03-09T14:24:06.577 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/286 2024-03-09T14:24:06.588 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 157/286 2024-03-09T14:24:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-09T14:24:06.619 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-09T14:24:06.652 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jq-1.6-16.el9.x86_64 158/286 2024-03-09T14:24:06.686 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-posix-35.0-8.el9.x86_64 159/286 2024-03-09T14:24:06.804 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-09T14:24:06.837 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-09T14:24:06.943 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : re2-1:20211101-3.el9.x86_64 29/286 2024-03-09T14:24:07.031 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 30/286 2024-03-09T14:24:07.060 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 31/286 2024-03-09T14:24:07.086 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/286 2024-03-09T14:24:07.113 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : mesa-libglapi-23.3.3-1.el9.x86_64 33/286 2024-03-09T14:24:07.156 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 34/286 2024-03-09T14:24:07.200 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 35/286 2024-03-09T14:24:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cups-libs-1:2.3.3op2-24.el9.x86_64 36/286 2024-03-09T14:24:07.327 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 37/286 2024-03-09T14:24:07.361 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 38/286 2024-03-09T14:24:07.399 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.9-15.el9.x86_64 39/286 2024-03-09T14:24:07.480 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 40/286 2024-03-09T14:24:07.515 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 41/286 2024-03-09T14:24:07.558 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 42/286 2024-03-09T14:24:07.573 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 160/286 2024-03-09T14:24:07.583 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 43/286 2024-03-09T14:24:07.612 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 44/286 2024-03-09T14:24:07.615 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-09T14:24:07.638 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 45/286 2024-03-09T14:24:07.669 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 46/286 2024-03-09T14:24:07.697 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 47/286 2024-03-09T14:24:07.730 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 48/286 2024-03-09T14:24:07.754 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 49/286 2024-03-09T14:24:07.806 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 50/286 2024-03-09T14:24:07.836 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : dconf-0.40.0-6.el9.x86_64 51/286 2024-03-09T14:24:07.910 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 51/286 2024-03-09T14:24:07.944 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:19.0.0-2079.gc00d9c60.el9. 52/286 2024-03-09T14:24:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-09T14:24:07.988 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:19.0.0-2079.gc00d9c60.el 53/286 2024-03-09T14:24:08.022 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 162/286 2024-03-09T14:24:08.028 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:19.0.0-2079.gc00d9c60.el9.x86_6 54/286 2024-03-09T14:24:08.053 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : slf4j-1.7.30-13.el9.noarch 163/286 2024-03-09T14:24:08.072 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : atinject-1.0.3-6.el9.noarch 164/286 2024-03-09T14:24:08.103 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/286 2024-03-09T14:24:08.115 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 165/286 2024-03-09T14:24:08.152 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 166/286 2024-03-09T14:24:08.180 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 167/286 2024-03-09T14:24:08.206 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 168/286 2024-03-09T14:24:08.231 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 169/286 2024-03-09T14:24:08.238 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/286 2024-03-09T14:24:08.256 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 170/286 2024-03-09T14:24:08.282 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 171/286 2024-03-09T14:24:08.298 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/286 2024-03-09T14:24:08.308 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 172/286 2024-03-09T14:24:08.335 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 173/286 2024-03-09T14:24:08.365 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 174/286 2024-03-09T14:24:08.393 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 175/286 2024-03-09T14:24:08.420 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 176/286 2024-03-09T14:24:08.455 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 177/286 2024-03-09T14:24:08.478 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 178/286 2024-03-09T14:24:08.513 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 179/286 2024-03-09T14:24:08.546 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jansi-2.3.3-6.el9.x86_64 180/286 2024-03-09T14:24:08.583 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jsoup-1.13.1-10.el9.noarch 181/286 2024-03-09T14:24:08.621 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 182/286 2024-03-09T14:24:08.663 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 183/286 2024-03-09T14:24:08.708 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 184/286 2024-03-09T14:24:08.740 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : guava-30.1-6.el9.noarch 185/286 2024-03-09T14:24:08.763 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : google-guice-4.2.3-9.el9.noarch 186/286 2024-03-09T14:24:08.816 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 187/286 2024-03-09T14:24:08.821 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/286 2024-03-09T14:24:08.850 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 188/286 2024-03-09T14:24:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-09T14:24:08.890 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-09T14:24:08.891 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-03-09T14:24:08.891 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:08.910 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/286 2024-03-09T14:24:08.938 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 60/286 2024-03-09T14:24:08.946 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 190/286 2024-03-09T14:24:08.975 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 191/286 2024-03-09T14:24:08.997 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 61/286 2024-03-09T14:24:09.003 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libsbc-1.4-9.el9.x86_64 192/286 2024-03-09T14:24:09.036 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/286 2024-03-09T14:24:09.072 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/286 2024-03-09T14:24:09.102 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/286 2024-03-09T14:24:09.171 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/286 2024-03-09T14:24:09.233 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : luarocks-3.9.2-1.el9.noarch 66/286 2024-03-09T14:24:09.254 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/286 2024-03-09T14:24:09.290 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/286 2024-03-09T14:24:09.317 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 193/286 2024-03-09T14:24:09.327 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:19.0.0-2079.gc00d9c60.el9.x86_6 69/286 2024-03-09T14:24:09.350 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 194/286 2024-03-09T14:24:09.358 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/286 2024-03-09T14:24:09.394 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/286 2024-03-09T14:24:09.438 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 72/286 2024-03-09T14:24:09.440 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 194/286 2024-03-09T14:24:09.474 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 195/286 2024-03-09T14:24:09.491 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/286 2024-03-09T14:24:09.502 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 196/286 2024-03-09T14:24:09.527 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/286 2024-03-09T14:24:09.564 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/286 2024-03-09T14:24:09.619 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/286 2024-03-09T14:24:09.692 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/286 2024-03-09T14:24:09.723 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 78/286 2024-03-09T14:24:09.759 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 79/286 2024-03-09T14:24:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/286 2024-03-09T14:24:09.851 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/286 2024-03-09T14:24:09.894 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/286 2024-03-09T14:24:09.901 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-09T14:24:09.932 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-09T14:24:09.949 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-09T14:24:09.981 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 198/286 2024-03-09T14:24:10.027 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/286 2024-03-09T14:24:10.038 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 199/286 2024-03-09T14:24:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 200/286 2024-03-09T14:24:10.078 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/286 2024-03-09T14:24:10.098 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 201/286 2024-03-09T14:24:10.119 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 85/286 2024-03-09T14:24:10.141 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 202/286 2024-03-09T14:24:10.171 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-09T14:24:10.209 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/286 2024-03-09T14:24:10.246 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 87/286 2024-03-09T14:24:10.285 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/286 2024-03-09T14:24:10.310 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/286 2024-03-09T14:24:10.335 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 90/286 2024-03-09T14:24:10.415 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/286 2024-03-09T14:24:10.449 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-09T14:24:10.523 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libexif-0.6.22-6.el9.x86_64 204/286 2024-03-09T14:24:10.545 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/286 2024-03-09T14:24:10.551 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 205/286 2024-03-09T14:24:10.576 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libasyncns-0.8-22.el9.x86_64 206/286 2024-03-09T14:24:10.604 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 207/286 2024-03-09T14:24:10.637 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 208/286 2024-03-09T14:24:10.661 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : mesa-libGL-23.3.3-1.el9.x86_64 209/286 2024-03-09T14:24:10.687 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libXv-1.0.11-16.el9.x86_64 210/286 2024-03-09T14:24:10.712 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 211/286 2024-03-09T14:24:10.735 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/286 2024-03-09T14:24:10.740 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 212/286 2024-03-09T14:24:10.768 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 213/286 2024-03-09T14:24:10.813 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libtiff-4.4.0-12.el9.x86_64 214/286 2024-03-09T14:24:10.838 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : tzdata-java-2024a-1.el9.noarch 94/286 2024-03-09T14:24:10.845 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 215/286 2024-03-09T14:24:10.874 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 95/286 2024-03-09T14:24:10.894 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 216/286 2024-03-09T14:24:10.921 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : poppler-21.01.0-19.el9.x86_64 217/286 2024-03-09T14:24:11.350 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ostree-libs-2024.4-3.el9.x86_64 96/286 2024-03-09T14:24:11.373 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : poppler-glib-21.01.0-19.el9.x86_64 218/286 2024-03-09T14:24:11.389 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : osinfo-db-20231215-1.el9.noarch 97/286 2024-03-09T14:24:11.424 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 98/286 2024-03-09T14:24:11.473 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ply-3.11-14.el9.noarch 99/286 2024-03-09T14:24:11.510 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 219/286 2024-03-09T14:24:11.529 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 100/286 2024-03-09T14:24:11.577 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 220/286 2024-03-09T14:24:11.603 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 221/286 2024-03-09T14:24:11.631 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gsm-1.0.19-6.el9.x86_64 222/286 2024-03-09T14:24:11.707 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 223/286 2024-03-09T14:24:11.737 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 101/286 2024-03-09T14:24:11.746 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 224/286 2024-03-09T14:24:11.779 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcanberra-0.30-27.el9.x86_64 225/286 2024-03-09T14:24:11.786 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 102/286 2024-03-09T14:24:11.797 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 225/286 2024-03-09T14:24:11.910 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : graphene-1.10.6-2.el9.x86_64 226/286 2024-03-09T14:24:11.920 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 103/286 2024-03-09T14:24:11.946 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 227/286 2024-03-09T14:24:11.968 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 104/286 2024-03-09T14:24:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : giflib-5.2.1-9.el9.x86_64 228/286 2024-03-09T14:24:12.002 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 105/286 2024-03-09T14:24:12.011 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 229/286 2024-03-09T14:24:12.031 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 106/286 2024-03-09T14:24:12.035 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-09T14:24:12.077 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 107/286 2024-03-09T14:24:12.105 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libdrm-2.4.117-1.el9.x86_64 108/286 2024-03-09T14:24:12.132 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : mesa-libgbm-23.3.3-1.el9.x86_64 109/286 2024-03-09T14:24:12.158 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 110/286 2024-03-09T14:24:12.184 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : mesa-libEGL-23.3.3-1.el9.x86_64 111/286 2024-03-09T14:24:12.209 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 112/286 2024-03-09T14:24:12.232 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : bluez-libs-5.64-1.el9.x86_64 113/286 2024-03-09T14:24:12.263 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 114/286 2024-03-09T14:24:12.467 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 115/286 2024-03-09T14:24:12.531 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 116/286 2024-03-09T14:24:12.563 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 117/286 2024-03-09T14:24:12.592 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 118/286 2024-03-09T14:24:12.634 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 119/286 2024-03-09T14:24:12.663 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : upower-0.99.11-11.el9.x86_64 120/286 2024-03-09T14:24:12.675 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 120/286 2024-03-09T14:24:12.675 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-03-09T14:24:12.676 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:24:12.751 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 121/286 2024-03-09T14:24:12.801 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 122/286 2024-03-09T14:24:12.818 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 123/286 2024-03-09T14:24:12.841 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 123/286 2024-03-09T14:24:12.869 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 124/286 2024-03-09T14:24:13.220 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 125/286 2024-03-09T14:24:13.248 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rtkit-0.11-28.el9.x86_64 125/286 2024-03-09T14:24:13.260 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 125/286 2024-03-09T14:24:13.260 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-03-09T14:24:13.260 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:24:13.304 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 126/286 2024-03-09T14:24:13.372 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 127/286 2024-03-09T14:24:13.406 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 128/286 2024-03-09T14:24:13.439 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 129/286 2024-03-09T14:24:13.481 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 130/286 2024-03-09T14:24:13.515 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 131/286 2024-03-09T14:24:13.605 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 132/286 2024-03-09T14:24:13.695 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 133/286 2024-03-09T14:24:13.746 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 134/286 2024-03-09T14:24:13.778 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 135/286 2024-03-09T14:24:13.817 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 136/286 2024-03-09T14:24:13.914 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-packaging-20.9-5.el9.noarch 137/286 2024-03-09T14:24:13.962 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 138/286 2024-03-09T14:24:14.701 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 139/286 2024-03-09T14:24:14.786 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 140/286 2024-03-09T14:24:14.809 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 141/286 2024-03-09T14:24:14.845 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 142/286 2024-03-09T14:24:15.031 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 143/286 2024-03-09T14:24:15.090 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 144/286 2024-03-09T14:24:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 145/286 2024-03-09T14:24:15.185 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 146/286 2024-03-09T14:24:15.223 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 147/286 2024-03-09T14:24:15.257 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : orc-0.4.31-6.el9.x86_64 148/286 2024-03-09T14:24:15.290 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 149/286 2024-03-09T14:24:15.458 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.21-2.el9.x86_64 150/286 2024-03-09T14:24:15.488 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 151/286 2024-03-09T14:24:15.569 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 152/286 2024-03-09T14:24:16.240 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 153/286 2024-03-09T14:24:16.361 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 154/286 2024-03-09T14:24:17.620 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 155/286 2024-03-09T14:24:17.696 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 156/286 2024-03-09T14:24:17.727 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 157/286 2024-03-09T14:24:17.781 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jq-1.6-16.el9.x86_64 158/286 2024-03-09T14:24:17.809 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lua-posix-35.0-8.el9.x86_64 159/286 2024-03-09T14:24:18.694 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 160/286 2024-03-09T14:24:18.738 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-09T14:24:19.096 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-09T14:24:19.136 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 162/286 2024-03-09T14:24:19.159 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : slf4j-1.7.30-13.el9.noarch 163/286 2024-03-09T14:24:19.178 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : atinject-1.0.3-6.el9.noarch 164/286 2024-03-09T14:24:19.205 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 165/286 2024-03-09T14:24:19.233 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 166/286 2024-03-09T14:24:19.261 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 167/286 2024-03-09T14:24:19.286 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 168/286 2024-03-09T14:24:19.312 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 169/286 2024-03-09T14:24:19.336 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 170/286 2024-03-09T14:24:19.363 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 171/286 2024-03-09T14:24:19.388 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 172/286 2024-03-09T14:24:19.415 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 173/286 2024-03-09T14:24:19.446 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 174/286 2024-03-09T14:24:19.473 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 175/286 2024-03-09T14:24:19.500 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 176/286 2024-03-09T14:24:19.527 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 177/286 2024-03-09T14:24:19.550 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 178/286 2024-03-09T14:24:19.568 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 179/286 2024-03-09T14:24:19.602 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jansi-2.3.3-6.el9.x86_64 180/286 2024-03-09T14:24:19.638 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jsoup-1.13.1-10.el9.noarch 181/286 2024-03-09T14:24:19.677 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 182/286 2024-03-09T14:24:19.711 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 183/286 2024-03-09T14:24:19.755 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 184/286 2024-03-09T14:24:19.787 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : guava-30.1-6.el9.noarch 185/286 2024-03-09T14:24:19.810 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : google-guice-4.2.3-9.el9.noarch 186/286 2024-03-09T14:24:19.862 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 187/286 2024-03-09T14:24:19.897 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 188/286 2024-03-09T14:24:19.927 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-09T14:24:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-09T14:24:19.937 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-03-09T14:24:19.937 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:24:19.981 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 190/286 2024-03-09T14:24:20.034 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 191/286 2024-03-09T14:24:20.159 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libsbc-1.4-9.el9.x86_64 192/286 2024-03-09T14:24:20.472 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 193/286 2024-03-09T14:24:20.497 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 194/286 2024-03-09T14:24:20.588 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 194/286 2024-03-09T14:24:20.621 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 195/286 2024-03-09T14:24:20.650 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 196/286 2024-03-09T14:24:21.048 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-09T14:24:21.079 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-09T14:24:21.097 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-09T14:24:21.137 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 198/286 2024-03-09T14:24:21.197 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 199/286 2024-03-09T14:24:21.227 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 200/286 2024-03-09T14:24:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 201/286 2024-03-09T14:24:21.290 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 202/286 2024-03-09T14:24:21.309 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-09T14:24:21.583 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-09T14:24:21.610 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libexif-0.6.22-6.el9.x86_64 204/286 2024-03-09T14:24:21.639 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 205/286 2024-03-09T14:24:21.658 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libasyncns-0.8-22.el9.x86_64 206/286 2024-03-09T14:24:21.678 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 207/286 2024-03-09T14:24:21.710 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 208/286 2024-03-09T14:24:21.734 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : mesa-libGL-23.3.3-1.el9.x86_64 209/286 2024-03-09T14:24:21.760 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libXv-1.0.11-16.el9.x86_64 210/286 2024-03-09T14:24:21.785 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 211/286 2024-03-09T14:24:21.812 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 212/286 2024-03-09T14:24:21.842 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 213/286 2024-03-09T14:24:21.884 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libtiff-4.4.0-12.el9.x86_64 214/286 2024-03-09T14:24:21.916 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 215/286 2024-03-09T14:24:21.964 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 216/286 2024-03-09T14:24:21.991 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : poppler-21.01.0-19.el9.x86_64 217/286 2024-03-09T14:24:22.461 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : poppler-glib-21.01.0-19.el9.x86_64 218/286 2024-03-09T14:24:22.587 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 219/286 2024-03-09T14:24:22.646 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 220/286 2024-03-09T14:24:22.672 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 221/286 2024-03-09T14:24:22.700 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gsm-1.0.19-6.el9.x86_64 222/286 2024-03-09T14:24:22.776 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 223/286 2024-03-09T14:24:22.815 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 224/286 2024-03-09T14:24:22.840 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcanberra-0.30-27.el9.x86_64 225/286 2024-03-09T14:24:22.859 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 225/286 2024-03-09T14:24:22.966 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : graphene-1.10.6-2.el9.x86_64 226/286 2024-03-09T14:24:23.015 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 227/286 2024-03-09T14:24:23.032 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : giflib-5.2.1-9.el9.x86_64 228/286 2024-03-09T14:24:23.052 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 229/286 2024-03-09T14:24:23.071 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-09T14:24:24.604 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-09T14:24:24.666 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 231/286 2024-03-09T14:24:24.734 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 232/286 2024-03-09T14:24:24.767 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 233/286 2024-03-09T14:24:25.175 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 234/286 2024-03-09T14:24:25.206 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 234/286 2024-03-09T14:24:25.221 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 234/286 2024-03-09T14:24:25.222 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-03-09T14:24:25.222 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:25.517 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 235/286 2024-03-09T14:24:25.569 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/286 2024-03-09T14:24:25.590 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 236/286 2024-03-09T14:24:26.050 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 237/286 2024-03-09T14:24:26.097 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 237/286 2024-03-09T14:24:26.133 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 238/286 2024-03-09T14:24:26.171 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 239/286 2024-03-09T14:24:26.248 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 240/286 2024-03-09T14:24:26.278 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : tracker-3.1.2-3.el9.x86_64 241/286 2024-03-09T14:24:26.388 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 241/286 2024-03-09T14:24:26.450 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-09T14:24:26.465 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-09T14:24:26.516 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 243/286 2024-03-09T14:24:26.982 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 244/286 2024-03-09T14:24:27.010 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 245/286 2024-03-09T14:24:27.066 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 245/286 2024-03-09T14:24:27.087 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 246/286 2024-03-09T14:24:29.276 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 247/286 2024-03-09T14:24:29.309 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 247/286 2024-03-09T14:24:29.843 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 247/286 2024-03-09T14:24:29.879 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 248/286 2024-03-09T14:24:29.957 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 248/286 2024-03-09T14:24:29.957 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-09T14:24:29.958 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-09T14:24:29.958 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:29.988 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 249/286 2024-03-09T14:24:35.697 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-09T14:24:35.762 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 231/286 2024-03-09T14:24:35.823 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 232/286 2024-03-09T14:24:35.858 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 233/286 2024-03-09T14:24:36.336 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 234/286 2024-03-09T14:24:36.363 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 234/286 2024-03-09T14:24:36.379 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 234/286 2024-03-09T14:24:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-03-09T14:24:36.380 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:24:36.678 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 235/286 2024-03-09T14:24:36.713 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/286 2024-03-09T14:24:36.734 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 236/286 2024-03-09T14:24:37.195 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 237/286 2024-03-09T14:24:37.237 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 237/286 2024-03-09T14:24:37.274 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 238/286 2024-03-09T14:24:37.320 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 239/286 2024-03-09T14:24:37.387 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 240/286 2024-03-09T14:24:37.418 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : tracker-3.1.2-3.el9.x86_64 241/286 2024-03-09T14:24:37.521 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 241/286 2024-03-09T14:24:37.565 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-09T14:24:37.579 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-09T14:24:37.626 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 243/286 2024-03-09T14:24:38.099 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 244/286 2024-03-09T14:24:38.125 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 245/286 2024-03-09T14:24:38.188 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 245/286 2024-03-09T14:24:38.210 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 246/286 2024-03-09T14:24:39.384 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 249/286 2024-03-09T14:24:39.384 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /sys 2024-03-09T14:24:39.384 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /proc 2024-03-09T14:24:39.384 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /mnt 2024-03-09T14:24:39.384 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /var/tmp 2024-03-09T14:24:39.384 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /home 2024-03-09T14:24:39.385 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /root 2024-03-09T14:24:39.385 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /tmp 2024-03-09T14:24:39.385 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:39.550 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 250/286 2024-03-09T14:24:39.562 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 250/286 2024-03-09T14:24:39.563 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:39.563 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-09T14:24:39.563 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:40.358 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 247/286 2024-03-09T14:24:40.390 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 247/286 2024-03-09T14:24:40.928 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 247/286 2024-03-09T14:24:40.968 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 248/286 2024-03-09T14:24:40.998 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 251/286 2024-03-09T14:24:41.024 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 251/286 2024-03-09T14:24:41.024 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:41.024 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-09T14:24:41.024 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-09T14:24:41.024 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-09T14:24:41.024 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:41.098 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 248/286 2024-03-09T14:24:41.098 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-09T14:24:41.098 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-09T14:24:41.099 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:24:41.128 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 249/286 2024-03-09T14:24:41.223 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 252/286 2024-03-09T14:24:41.246 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 252/286 2024-03-09T14:24:41.246 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:41.246 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-09T14:24:41.247 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-09T14:24:41.247 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-09T14:24:41.247 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:41.682 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 253/286 2024-03-09T14:24:41.705 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 253/286 2024-03-09T14:24:41.705 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:41.705 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-09T14:24:41.705 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-09T14:24:41.705 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-09T14:24:41.706 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:44.599 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 254/286 2024-03-09T14:24:44.693 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 255/286 2024-03-09T14:24:44.736 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 256/286 2024-03-09T14:24:44.764 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-09T14:24:44.939 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-09T14:24:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 258/286 2024-03-09T14:24:45.021 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-09T14:24:45.084 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-09T14:24:45.115 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-09T14:24:45.126 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-09T14:24:45.157 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : maven-1:3.6.3-15.el9.noarch 261/286 2024-03-09T14:24:45.177 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 261/286 2024-03-09T14:24:45.200 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 262/286 2024-03-09T14:24:45.566 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 263/286 2024-03-09T14:24:45.597 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 263/286 2024-03-09T14:24:45.631 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2079.gc00d9c60.e 264/286 2024-03-09T14:24:45.691 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2079.gc00d9c60. 265/286 2024-03-09T14:24:45.721 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noa 266/286 2024-03-09T14:24:45.954 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noa 266/286 2024-03-09T14:24:45.981 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.n 267/286 2024-03-09T14:24:46.939 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.n 267/286 2024-03-09T14:24:46.965 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00 268/286 2024-03-09T14:24:47.065 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00 268/286 2024-03-09T14:24:47.234 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2079.gc00d9c60.el 269/286 2024-03-09T14:24:47.267 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 270/286 2024-03-09T14:24:47.289 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 270/286 2024-03-09T14:24:47.290 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:47.290 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-09T14:24:47.290 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-09T14:24:47.290 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-09T14:24:47.290 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:47.334 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 271/286 2024-03-09T14:24:47.345 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 271/286 2024-03-09T14:24:48.229 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-2:19.0.0-2079.gc00d9c60.el9.x86_64 272/286 2024-03-09T14:24:48.260 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 273/286 2024-03-09T14:24:48.283 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 273/286 2024-03-09T14:24:48.283 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:48.283 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-09T14:24:48.283 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-09T14:24:48.283 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-09T14:24:48.283 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:48.328 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2079.gc00d9 274/286 2024-03-09T14:24:48.350 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2079.gc00d9 274/286 2024-03-09T14:24:48.350 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:48.350 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-09T14:24:48.350 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:48.645 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 275/286 2024-03-09T14:24:48.667 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 275/286 2024-03-09T14:24:48.667 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:48.667 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-09T14:24:48.667 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-09T14:24:48.668 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-09T14:24:48.668 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:50.541 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 249/286 2024-03-09T14:24:50.542 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2024-03-09T14:24:50.542 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2024-03-09T14:24:50.542 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2024-03-09T14:24:50.542 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2024-03-09T14:24:50.542 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2024-03-09T14:24:50.542 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /root 2024-03-09T14:24:50.542 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2024-03-09T14:24:50.542 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:24:50.702 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 250/286 2024-03-09T14:24:50.716 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 250/286 2024-03-09T14:24:50.717 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:50.717 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-09T14:24:50.717 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:24:52.153 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 251/286 2024-03-09T14:24:52.179 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 251/286 2024-03-09T14:24:52.179 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:52.179 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-09T14:24:52.180 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-09T14:24:52.180 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-09T14:24:52.180 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:24:52.386 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 252/286 2024-03-09T14:24:52.408 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 252/286 2024-03-09T14:24:52.408 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:52.408 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-09T14:24:52.409 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-09T14:24:52.409 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-09T14:24:52.409 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:24:52.862 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 253/286 2024-03-09T14:24:52.884 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 253/286 2024-03-09T14:24:52.884 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:52.885 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-09T14:24:52.885 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-09T14:24:52.885 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-09T14:24:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:24:53.158 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-test-2:19.0.0-2079.gc00d9c60.el9.x86_64 276/286 2024-03-09T14:24:53.187 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 277/286 2024-03-09T14:24:53.235 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 278/286 2024-03-09T14:24:53.259 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-09T14:24:53.273 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-09T14:24:53.274 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-03-09T14:24:53.274 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:53.333 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 280/286 2024-03-09T14:24:53.365 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-nbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 281/286 2024-03-09T14:24:53.459 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs-devel-2:19.0.0-2079.gc00d9c60.el9.x86_ 282/286 2024-03-09T14:24:53.517 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 283/286 2024-03-09T14:24:53.548 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 284/286 2024-03-09T14:24:53.548 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-09T14:24:53.640 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-09T14:24:53.640 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:24:53.731 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:24:53.754 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 286/286 2024-03-09T14:24:53.759 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 286/286 2024-03-09T14:24:53.767 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 286/286 2024-03-09T14:24:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 286/286 2024-03-09T14:24:53.776 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-09T14:24:53.777 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-09T14:24:53.777 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:24:53.852 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 286/286 2024-03-09T14:24:53.920 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 286/286 2024-03-09T14:24:55.770 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 254/286 2024-03-09T14:24:55.889 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 255/286 2024-03-09T14:24:55.932 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 256/286 2024-03-09T14:24:55.959 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-09T14:24:56.150 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-09T14:24:56.200 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 258/286 2024-03-09T14:24:56.224 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-09T14:24:56.285 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-09T14:24:56.318 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-09T14:24:56.328 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-09T14:24:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : maven-1:3.6.3-15.el9.noarch 261/286 2024-03-09T14:24:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 261/286 2024-03-09T14:24:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 262/286 2024-03-09T14:24:56.871 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 263/286 2024-03-09T14:24:56.901 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 263/286 2024-03-09T14:24:56.934 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2079.gc00d9c60.e 264/286 2024-03-09T14:24:56.994 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2079.gc00d9c60. 265/286 2024-03-09T14:24:57.016 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noa 266/286 2024-03-09T14:24:57.252 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noa 266/286 2024-03-09T14:24:57.292 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.n 267/286 2024-03-09T14:24:58.253 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.n 267/286 2024-03-09T14:24:58.284 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00 268/286 2024-03-09T14:24:58.384 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00 268/286 2024-03-09T14:24:58.546 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2079.gc00d9c60.el 269/286 2024-03-09T14:24:58.578 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 270/286 2024-03-09T14:24:58.600 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 270/286 2024-03-09T14:24:58.600 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:58.600 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-09T14:24:58.600 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-09T14:24:58.600 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-09T14:24:58.600 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:24:58.645 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 271/286 2024-03-09T14:24:58.656 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 271/286 2024-03-09T14:24:59.534 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:19.0.0-2079.gc00d9c60.el9.x86_64 272/286 2024-03-09T14:24:59.563 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 273/286 2024-03-09T14:24:59.585 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 273/286 2024-03-09T14:24:59.586 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:59.586 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-09T14:24:59.586 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-09T14:24:59.586 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-09T14:24:59.586 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:24:59.630 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2079.gc00d9 274/286 2024-03-09T14:24:59.652 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2079.gc00d9 274/286 2024-03-09T14:24:59.652 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:59.652 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-09T14:24:59.652 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:24:59.964 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 275/286 2024-03-09T14:24:59.986 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 275/286 2024-03-09T14:24:59.986 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:24:59.986 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-09T14:24:59.986 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-09T14:24:59.986 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-09T14:24:59.986 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:00.519 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:25:00.519 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-2:19.0.0-2079.gc00d9c60.el9.x86_64 1/286 2024-03-09T14:25:00.519 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 2/286 2024-03-09T14:25:00.519 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 3/286 2024-03-09T14:25:00.519 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 4/286 2024-03-09T14:25:00.519 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2079.gc00d9 5/286 2024-03-09T14:25:00.519 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 6/286 2024-03-09T14:25:00.520 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 7/286 2024-03-09T14:25:00.520 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 8/286 2024-03-09T14:25:00.520 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 9/286 2024-03-09T14:25:00.520 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 10/286 2024-03-09T14:25:00.520 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 11/286 2024-03-09T14:25:00.520 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-test-2:19.0.0-2079.gc00d9c60.el9.x86_64 12/286 2024-03-09T14:25:00.520 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs-devel-2:19.0.0-2079.gc00d9c60.el9.x86_ 13/286 2024-03-09T14:25:00.520 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 14/286 2024-03-09T14:25:00.520 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 15/286 2024-03-09T14:25:00.520 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados-devel-2:19.0.0-2079.gc00d9c60.el9.x86_6 16/286 2024-03-09T14:25:00.520 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86 17/286 2024-03-09T14:25:00.520 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 18/286 2024-03-09T14:25:00.521 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2079.gc00d9c60.el 19/286 2024-03-09T14:25:00.521 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-common-2:19.0.0-2079.gc00d9c60.el9. 20/286 2024-03-09T14:25:00.521 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cephfs-2:19.0.0-2079.gc00d9c60.el9.x86_6 21/286 2024-03-09T14:25:00.521 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rados-2:19.0.0-2079.gc00d9c60.el9.x86_64 22/286 2024-03-09T14:25:00.521 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 23/286 2024-03-09T14:25:00.521 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 24/286 2024-03-09T14:25:00.521 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 25/286 2024-03-09T14:25:00.521 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 26/286 2024-03-09T14:25:00.521 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-nbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 27/286 2024-03-09T14:25:00.521 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2079.gc00d9c60. 28/286 2024-03-09T14:25:00.521 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noa 29/286 2024-03-09T14:25:00.521 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.n 30/286 2024-03-09T14:25:00.522 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00 31/286 2024-03-09T14:25:00.522 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2079.gc00d9c60.el 32/286 2024-03-09T14:25:00.522 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 33/286 2024-03-09T14:25:00.522 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2079.gc00d9c60.e 34/286 2024-03-09T14:25:00.522 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 35/286 2024-03-09T14:25:00.522 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 36/286 2024-03-09T14:25:00.522 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 37/286 2024-03-09T14:25:00.522 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 38/286 2024-03-09T14:25:00.522 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 39/286 2024-03-09T14:25:00.522 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 40/286 2024-03-09T14:25:00.522 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 41/286 2024-03-09T14:25:00.523 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 42/286 2024-03-09T14:25:00.523 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 43/286 2024-03-09T14:25:00.523 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 44/286 2024-03-09T14:25:00.523 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : atinject-1.0.3-6.el9.noarch 45/286 2024-03-09T14:25:00.523 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : atk-2.36.0-5.el9.x86_64 46/286 2024-03-09T14:25:00.523 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 47/286 2024-03-09T14:25:00.523 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 48/286 2024-03-09T14:25:00.523 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 49/286 2024-03-09T14:25:00.523 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 50/286 2024-03-09T14:25:00.523 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 51/286 2024-03-09T14:25:00.523 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 52/286 2024-03-09T14:25:00.523 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 53/286 2024-03-09T14:25:00.524 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 54/286 2024-03-09T14:25:00.524 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 55/286 2024-03-09T14:25:00.524 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 56/286 2024-03-09T14:25:00.524 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 57/286 2024-03-09T14:25:00.524 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 58/286 2024-03-09T14:25:00.524 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 59/286 2024-03-09T14:25:00.524 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 60/286 2024-03-09T14:25:00.524 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 61/286 2024-03-09T14:25:00.524 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 62/286 2024-03-09T14:25:00.524 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 63/286 2024-03-09T14:25:00.524 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 64/286 2024-03-09T14:25:00.524 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 65/286 2024-03-09T14:25:00.525 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 66/286 2024-03-09T14:25:00.525 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 67/286 2024-03-09T14:25:00.525 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 68/286 2024-03-09T14:25:00.525 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 69/286 2024-03-09T14:25:00.525 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 70/286 2024-03-09T14:25:00.525 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : guava-30.1-6.el9.noarch 71/286 2024-03-09T14:25:00.525 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 72/286 2024-03-09T14:25:00.525 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 73/286 2024-03-09T14:25:00.525 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 74/286 2024-03-09T14:25:00.525 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 75/286 2024-03-09T14:25:00.525 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 76/286 2024-03-09T14:25:00.526 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 77/286 2024-03-09T14:25:00.526 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 78/286 2024-03-09T14:25:00.526 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 79/286 2024-03-09T14:25:00.526 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 80/286 2024-03-09T14:25:00.526 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 81/286 2024-03-09T14:25:00.526 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 82/286 2024-03-09T14:25:00.526 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 83/286 2024-03-09T14:25:00.526 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 84/286 2024-03-09T14:25:00.526 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 85/286 2024-03-09T14:25:00.526 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lcms2-2.12-3.el9.x86_64 86/286 2024-03-09T14:25:00.526 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 87/286 2024-03-09T14:25:00.526 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 88/286 2024-03-09T14:25:00.527 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 89/286 2024-03-09T14:25:00.527 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 90/286 2024-03-09T14:25:00.527 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 91/286 2024-03-09T14:25:00.527 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 92/286 2024-03-09T14:25:00.527 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 93/286 2024-03-09T14:25:00.527 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 94/286 2024-03-09T14:25:00.527 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 95/286 2024-03-09T14:25:00.527 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 96/286 2024-03-09T14:25:00.527 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 97/286 2024-03-09T14:25:00.527 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 98/286 2024-03-09T14:25:00.527 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 99/286 2024-03-09T14:25:00.528 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 100/286 2024-03-09T14:25:00.528 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 101/286 2024-03-09T14:25:00.528 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 102/286 2024-03-09T14:25:00.528 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 103/286 2024-03-09T14:25:00.528 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 104/286 2024-03-09T14:25:00.528 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 105/286 2024-03-09T14:25:00.528 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 106/286 2024-03-09T14:25:00.528 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 107/286 2024-03-09T14:25:00.528 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 108/286 2024-03-09T14:25:00.528 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 109/286 2024-03-09T14:25:00.528 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 110/286 2024-03-09T14:25:00.528 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 111/286 2024-03-09T14:25:00.529 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 112/286 2024-03-09T14:25:00.529 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 113/286 2024-03-09T14:25:00.529 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 114/286 2024-03-09T14:25:00.529 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 115/286 2024-03-09T14:25:00.529 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 116/286 2024-03-09T14:25:00.529 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 117/286 2024-03-09T14:25:00.529 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libsbc-1.4-9.el9.x86_64 118/286 2024-03-09T14:25:00.529 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 119/286 2024-03-09T14:25:00.529 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 120/286 2024-03-09T14:25:00.529 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 121/286 2024-03-09T14:25:00.529 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 122/286 2024-03-09T14:25:00.529 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 123/286 2024-03-09T14:25:00.530 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 124/286 2024-03-09T14:25:00.530 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 125/286 2024-03-09T14:25:00.530 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 126/286 2024-03-09T14:25:00.530 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 127/286 2024-03-09T14:25:00.530 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 128/286 2024-03-09T14:25:00.530 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 129/286 2024-03-09T14:25:00.530 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 130/286 2024-03-09T14:25:00.530 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 131/286 2024-03-09T14:25:00.530 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 132/286 2024-03-09T14:25:00.530 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-5.4.4-4.el9.x86_64 133/286 2024-03-09T14:25:00.530 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 134/286 2024-03-09T14:25:00.530 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 135/286 2024-03-09T14:25:00.531 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 136/286 2024-03-09T14:25:00.531 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 137/286 2024-03-09T14:25:00.531 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 138/286 2024-03-09T14:25:00.531 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 139/286 2024-03-09T14:25:00.531 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 140/286 2024-03-09T14:25:00.531 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 141/286 2024-03-09T14:25:00.531 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 142/286 2024-03-09T14:25:00.531 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 143/286 2024-03-09T14:25:00.531 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 144/286 2024-03-09T14:25:00.531 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 145/286 2024-03-09T14:25:00.531 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : opus-1.3.1-10.el9.x86_64 146/286 2024-03-09T14:25:00.531 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : orc-0.4.31-6.el9.x86_64 147/286 2024-03-09T14:25:00.532 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 148/286 2024-03-09T14:25:00.532 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 149/286 2024-03-09T14:25:00.532 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 150/286 2024-03-09T14:25:00.532 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 151/286 2024-03-09T14:25:00.532 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 152/286 2024-03-09T14:25:00.532 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 153/286 2024-03-09T14:25:00.532 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 154/286 2024-03-09T14:25:00.532 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 155/286 2024-03-09T14:25:00.532 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 156/286 2024-03-09T14:25:00.532 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 157/286 2024-03-09T14:25:00.532 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 158/286 2024-03-09T14:25:00.533 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 159/286 2024-03-09T14:25:00.533 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 160/286 2024-03-09T14:25:00.533 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 161/286 2024-03-09T14:25:00.533 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 162/286 2024-03-09T14:25:00.533 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 163/286 2024-03-09T14:25:00.533 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 164/286 2024-03-09T14:25:00.533 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 165/286 2024-03-09T14:25:00.533 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 166/286 2024-03-09T14:25:00.533 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 167/286 2024-03-09T14:25:00.533 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 168/286 2024-03-09T14:25:00.533 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 169/286 2024-03-09T14:25:00.534 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 170/286 2024-03-09T14:25:00.534 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 171/286 2024-03-09T14:25:00.534 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 172/286 2024-03-09T14:25:00.534 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 173/286 2024-03-09T14:25:00.534 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 174/286 2024-03-09T14:25:00.534 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 175/286 2024-03-09T14:25:00.534 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 176/286 2024-03-09T14:25:00.534 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rtkit-0.11-28.el9.x86_64 177/286 2024-03-09T14:25:00.534 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 178/286 2024-03-09T14:25:00.534 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 179/286 2024-03-09T14:25:00.534 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 180/286 2024-03-09T14:25:00.534 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 181/286 2024-03-09T14:25:00.535 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 182/286 2024-03-09T14:25:00.535 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 183/286 2024-03-09T14:25:00.535 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 184/286 2024-03-09T14:25:00.535 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 185/286 2024-03-09T14:25:00.535 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : upower-0.99.11-11.el9.x86_64 186/286 2024-03-09T14:25:00.535 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 187/286 2024-03-09T14:25:00.535 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 188/286 2024-03-09T14:25:00.535 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 189/286 2024-03-09T14:25:00.535 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 190/286 2024-03-09T14:25:00.535 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 191/286 2024-03-09T14:25:00.536 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 192/286 2024-03-09T14:25:00.536 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 193/286 2024-03-09T14:25:00.536 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 194/286 2024-03-09T14:25:00.536 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 195/286 2024-03-09T14:25:00.536 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : bluez-libs-5.64-1.el9.x86_64 196/286 2024-03-09T14:25:00.536 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 197/286 2024-03-09T14:25:00.536 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 198/286 2024-03-09T14:25:00.536 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 199/286 2024-03-09T14:25:00.536 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 200/286 2024-03-09T14:25:00.536 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 201/286 2024-03-09T14:25:00.536 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 202/286 2024-03-09T14:25:00.536 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ply-3.11-14.el9.noarch 203/286 2024-03-09T14:25:00.537 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 204/286 2024-03-09T14:25:00.537 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 205/286 2024-03-09T14:25:00.537 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cups-libs-1:2.3.3op2-24.el9.x86_64 206/286 2024-03-09T14:25:00.537 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jq-1.6-16.el9.x86_64 207/286 2024-03-09T14:25:00.537 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 208/286 2024-03-09T14:25:00.537 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 209/286 2024-03-09T14:25:00.537 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 210/286 2024-03-09T14:25:00.537 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : alsa-lib-1.2.10-2.el9.x86_64 211/286 2024-03-09T14:25:00.537 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 212/286 2024-03-09T14:25:00.537 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 213/286 2024-03-09T14:25:00.537 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 214/286 2024-03-09T14:25:00.538 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libdrm-2.4.117-1.el9.x86_64 215/286 2024-03-09T14:25:00.538 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 216/286 2024-03-09T14:25:00.538 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libtiff-4.4.0-12.el9.x86_64 217/286 2024-03-09T14:25:00.538 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : mesa-libEGL-23.3.3-1.el9.x86_64 218/286 2024-03-09T14:25:00.538 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : mesa-libGL-23.3.3-1.el9.x86_64 219/286 2024-03-09T14:25:00.538 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : mesa-libgbm-23.3.3-1.el9.x86_64 220/286 2024-03-09T14:25:00.538 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : mesa-libglapi-23.3.3-1.el9.x86_64 221/286 2024-03-09T14:25:00.538 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : osinfo-db-20231215-1.el9.noarch 222/286 2024-03-09T14:25:00.538 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ostree-libs-2024.4-3.el9.x86_64 223/286 2024-03-09T14:25:00.538 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 224/286 2024-03-09T14:25:00.538 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 225/286 2024-03-09T14:25:00.539 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 226/286 2024-03-09T14:25:00.539 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 227/286 2024-03-09T14:25:00.539 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 228/286 2024-03-09T14:25:00.539 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 229/286 2024-03-09T14:25:00.539 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : poppler-21.01.0-19.el9.x86_64 230/286 2024-03-09T14:25:00.539 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : poppler-glib-21.01.0-19.el9.x86_64 231/286 2024-03-09T14:25:00.539 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 232/286 2024-03-09T14:25:00.539 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 233/286 2024-03-09T14:25:00.539 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 234/286 2024-03-09T14:25:00.539 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 235/286 2024-03-09T14:25:00.539 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 236/286 2024-03-09T14:25:00.539 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : tzdata-java-2024a-1.el9.noarch 237/286 2024-03-09T14:25:00.540 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 238/286 2024-03-09T14:25:00.540 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 239/286 2024-03-09T14:25:00.540 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 240/286 2024-03-09T14:25:00.540 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 241/286 2024-03-09T14:25:00.540 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 242/286 2024-03-09T14:25:00.540 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 243/286 2024-03-09T14:25:00.540 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 244/286 2024-03-09T14:25:00.540 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 245/286 2024-03-09T14:25:00.540 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 246/286 2024-03-09T14:25:00.540 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 247/286 2024-03-09T14:25:00.540 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 248/286 2024-03-09T14:25:00.540 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 249/286 2024-03-09T14:25:00.541 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 250/286 2024-03-09T14:25:00.541 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 251/286 2024-03-09T14:25:00.541 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 252/286 2024-03-09T14:25:00.541 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 253/286 2024-03-09T14:25:00.541 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 254/286 2024-03-09T14:25:00.541 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 255/286 2024-03-09T14:25:00.541 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 256/286 2024-03-09T14:25:00.541 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 257/286 2024-03-09T14:25:00.541 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 258/286 2024-03-09T14:25:00.541 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 259/286 2024-03-09T14:25:00.541 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 260/286 2024-03-09T14:25:00.541 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 261/286 2024-03-09T14:25:00.542 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 262/286 2024-03-09T14:25:00.542 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 263/286 2024-03-09T14:25:00.542 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 264/286 2024-03-09T14:25:00.542 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 265/286 2024-03-09T14:25:00.542 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 266/286 2024-03-09T14:25:00.542 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 267/286 2024-03-09T14:25:00.542 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 268/286 2024-03-09T14:25:00.542 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 269/286 2024-03-09T14:25:00.542 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 270/286 2024-03-09T14:25:00.542 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 271/286 2024-03-09T14:25:00.542 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 272/286 2024-03-09T14:25:00.542 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 273/286 2024-03-09T14:25:00.543 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 274/286 2024-03-09T14:25:00.543 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 275/286 2024-03-09T14:25:00.543 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 276/286 2024-03-09T14:25:00.543 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 277/286 2024-03-09T14:25:00.543 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 278/286 2024-03-09T14:25:00.543 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 279/286 2024-03-09T14:25:00.543 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : re2-1:20211101-3.el9.x86_64 280/286 2024-03-09T14:25:00.543 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 281/286 2024-03-09T14:25:00.543 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 282/286 2024-03-09T14:25:00.543 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 283/286 2024-03-09T14:25:00.543 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 284/286 2024-03-09T14:25:00.543 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 285/286 2024-03-09T14:25:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:25:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:04.331 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2024-03-09T14:25:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.332 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-03-09T14:25:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-03-09T14:25:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-09T14:25:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-03-09T14:25:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-03-09T14:25:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: alsa-lib-1.2.10-2.el9.x86_64 2024-03-09T14:25:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-03-09T14:25:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-03-09T14:25:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-03-09T14:25:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-03-09T14:25:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-03-09T14:25:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-03-09T14:25:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: atinject-1.0.3-6.el9.noarch 2024-03-09T14:25:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: atk-2.36.0-5.el9.x86_64 2024-03-09T14:25:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: avahi-glib-0.8-12.el9.x86_64 2024-03-09T14:25:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: bluez-libs-5.64-1.el9.x86_64 2024-03-09T14:25:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-09T14:25:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: bubblewrap-0.4.1-6.el9.x86_64 2024-03-09T14:25:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: cdi-api-2.0.2-6.el9.noarch 2024-03-09T14:25:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-03-09T14:25:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-03-09T14:25:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: cups-libs-1:2.3.3op2-24.el9.x86_64 2024-03-09T14:25:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: dconf-0.40.0-6.el9.x86_64 2024-03-09T14:25:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-03-09T14:25:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: exiv2-0.27.5-2.el9.x86_64 2024-03-09T14:25:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-03-09T14:25:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-03-09T14:25:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-03-09T14:25:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: flatpak-1.12.8-1.el9.x86_64 2024-03-09T14:25:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2024-03-09T14:25:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2024-03-09T14:25:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-09T14:25:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-09T14:25:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-09T14:25:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-09T14:25:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2024-03-09T14:25:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-03-09T14:25:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: giflib-5.2.1-9.el9.x86_64 2024-03-09T14:25:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: google-guice-4.2.3-9.el9.noarch 2024-03-09T14:25:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-09T14:25:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: graphene-1.10.6-2.el9.x86_64 2024-03-09T14:25:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-09T14:25:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: gsm-1.0.19-6.el9.x86_64 2024-03-09T14:25:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-03-09T14:25:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-03-09T14:25:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2024-03-09T14:25:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: gtk3-3.24.31-2.el9.x86_64 2024-03-09T14:25:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: guava-30.1-6.el9.noarch 2024-03-09T14:25:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-03-09T14:25:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-03-09T14:25:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-03-09T14:25:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: iso-codes-4.6.0-3.el9.noarch 2024-03-09T14:25:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-03-09T14:25:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: jansi-2.3.3-6.el9.x86_64 2024-03-09T14:25:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 2024-03-09T14:25:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_64 2024-03-09T14:25:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 2024-03-09T14:25:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-03-09T14:25:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-03-09T14:25:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-03-09T14:25:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: jq-1.6-16.el9.x86_64 2024-03-09T14:25:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: jsoup-1.13.1-10.el9.noarch 2024-03-09T14:25:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: jsr-305-3.0.2-6.el9.noarch 2024-03-09T14:25:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: lcms2-2.12-3.el9.x86_64 2024-03-09T14:25:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2024-03-09T14:25:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-03-09T14:25:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-03-09T14:25:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-03-09T14:25:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-03-09T14:25:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: libXi-1.7.10-8.el9.x86_64 2024-03-09T14:25:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-03-09T14:25:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-03-09T14:25:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: libXtst-1.2.3-16.el9.x86_64 2024-03-09T14:25:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: libXv-1.0.11-16.el9.x86_64 2024-03-09T14:25:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-03-09T14:25:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-09T14:25:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-09T14:25:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: libasyncns-0.8-22.el9.x86_64 2024-03-09T14:25:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: libcanberra-0.30-27.el9.x86_64 2024-03-09T14:25:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-03-09T14:25:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: libdrm-2.4.117-1.el9.x86_64 2024-03-09T14:25:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-03-09T14:25:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: libexif-0.6.22-6.el9.x86_64 2024-03-09T14:25:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-03-09T14:25:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-03-09T14:25:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-09T14:25:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-03-09T14:25:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-03-09T14:25:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-03-09T14:25:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: libgsf-1.14.47-5.el9.x86_64 2024-03-09T14:25:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: libgxps-0.3.2-3.el9.x86_64 2024-03-09T14:25:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: libiptcdata-1.0.5-9.el9.x86_64 2024-03-09T14:25:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-03-09T14:25:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: libnotify-0.7.9-8.el9.x86_64 2024-03-09T14:25:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-09T14:25:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-03-09T14:25:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-03-09T14:25:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: libpciaccess-0.16-6.el9.x86_64 2024-03-09T14:25:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-09T14:25:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-09T14:25:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-09T14:25:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-09T14:25:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: libsbc-1.4-9.el9.x86_64 2024-03-09T14:25:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-03-09T14:25:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-03-09T14:25:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: libtiff-4.4.0-12.el9.x86_64 2024-03-09T14:25:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2024-03-09T14:25:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-03-09T14:25:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-09T14:25:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-03-09T14:25:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-03-09T14:25:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-03-09T14:25:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-03-09T14:25:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-03-09T14:25:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-03-09T14:25:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: libwebp-1.2.0-8.el9.x86_64 2024-03-09T14:25:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-03-09T14:25:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: libxshmfence-1.3-10.el9.x86_64 2024-03-09T14:25:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-03-09T14:25:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-03-09T14:25:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-09T14:25:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: lua-5.4.4-4.el9.x86_64 2024-03-09T14:25:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-09T14:25:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: lua-posix-35.0-8.el9.x86_64 2024-03-09T14:25:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-09T14:25:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: maven-1:3.6.3-15.el9.noarch 2024-03-09T14:25:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-03-09T14:25:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-03-09T14:25:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-03-09T14:25:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-03-09T14:25:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-03-09T14:25:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: mesa-libEGL-23.3.3-1.el9.x86_64 2024-03-09T14:25:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: mesa-libGL-23.3.3-1.el9.x86_64 2024-03-09T14:25:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: mesa-libgbm-23.3.3-1.el9.x86_64 2024-03-09T14:25:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: mesa-libglapi-23.3.3-1.el9.x86_64 2024-03-09T14:25:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-03-09T14:25:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-09T14:25:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-09T14:25:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-09T14:25:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-03-09T14:25:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: opus-1.3.1-10.el9.x86_64 2024-03-09T14:25:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: orc-0.4.31-6.el9.x86_64 2024-03-09T14:25:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: osinfo-db-20231215-1.el9.noarch 2024-03-09T14:25:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-03-09T14:25:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: ostree-libs-2024.4-3.el9.x86_64 2024-03-09T14:25:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2024-03-09T14:25:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-09T14:25:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: pipewire-1.0.1-1.el9.x86_64 2024-03-09T14:25:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-03-09T14:25:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-03-09T14:25:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-03-09T14:25:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-03-09T14:25:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-03-09T14:25:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: plexus-cipher-1.7-27.el9.noarch 2024-03-09T14:25:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-03-09T14:25:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-03-09T14:25:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-03-09T14:25:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-03-09T14:25:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-03-09T14:25:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: poppler-21.01.0-19.el9.x86_64 2024-03-09T14:25:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: poppler-data-0.4.9-9.el9.noarch 2024-03-09T14:25:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: poppler-glib-21.01.0-19.el9.x86_64 2024-03-09T14:25:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-09T14:25:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-09T14:25:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-03-09T14:25:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-03-09T14:25:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-09T14:25:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-09T14:25:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-09T14:25:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-09T14:25:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-09T14:25:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-09T14:25:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-09T14:25:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-09T14:25:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-09T14:25:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-09T14:25:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-09T14:25:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-09T14:25:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-09T14:25:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-09T14:25:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-09T14:25:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-09T14:25:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-09T14:25:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-09T14:25:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-09T14:25:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-09T14:25:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-09T14:25:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-09T14:25:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-09T14:25:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-09T14:25:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-09T14:25:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-09T14:25:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-09T14:25:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-09T14:25:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-09T14:25:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-09T14:25:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-09T14:25:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-09T14:25:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply-3.11-14.el9.noarch 2024-03-09T14:25:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-09T14:25:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-09T14:25:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-09T14:25:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-09T14:25:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-09T14:25:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-09T14:25:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-09T14:25:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-09T14:25:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-09T14:25:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-09T14:25:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-09T14:25:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-09T14:25:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-09T14:25:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-09T14:25:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-09T14:25:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-09T14:25:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-09T14:25:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-09T14:25:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-09T14:25:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-09T14:25:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-09T14:25:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-09T14:25:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-09T14:25:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-09T14:25:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-09T14:25:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: re2-1:20211101-3.el9.x86_64 2024-03-09T14:25:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: rtkit-0.11-28.el9.x86_64 2024-03-09T14:25:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: s3cmd-2.4.0-1.el9.noarch 2024-03-09T14:25:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: sisu-1:0.3.4-10.el9.noarch 2024-03-09T14:25:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: slf4j-1.7.30-13.el9.noarch 2024-03-09T14:25:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-09T14:25:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-03-09T14:25:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-09T14:25:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-03-09T14:25:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: tracker-3.1.2-3.el9.x86_64 2024-03-09T14:25:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-03-09T14:25:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-03-09T14:25:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: tzdata-java-2024a-1.el9.noarch 2024-03-09T14:25:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: upower-0.99.11-11.el9.x86_64 2024-03-09T14:25:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-03-09T14:25:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-03-09T14:25:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-03-09T14:25:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-03-09T14:25:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-03-09T14:25:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-03-09T14:25:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-03-09T14:25:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-09T14:25:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-03-09T14:25:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:04.352 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-03-09T14:25:04.485 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:19.0.0-2079.gc00d9c60.el9.x86_64 276/286 2024-03-09T14:25:04.514 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 277/286 2024-03-09T14:25:04.563 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 278/286 2024-03-09T14:25:04.595 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-09T14:25:04.609 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-09T14:25:04.609 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-03-09T14:25:04.609 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:04.660 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 280/286 2024-03-09T14:25:04.692 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 281/286 2024-03-09T14:25:04.713 DEBUG:teuthology.parallel:result is None 2024-03-09T14:25:04.787 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:19.0.0-2079.gc00d9c60.el9.x86_ 282/286 2024-03-09T14:25:04.843 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 283/286 2024-03-09T14:25:04.875 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 284/286 2024-03-09T14:25:04.875 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-09T14:25:04.967 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-09T14:25:04.967 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:25:05.049 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:25:05.067 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 286/286 2024-03-09T14:25:05.072 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 286/286 2024-03-09T14:25:05.080 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 286/286 2024-03-09T14:25:05.090 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 286/286 2024-03-09T14:25:05.090 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-09T14:25:05.090 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-09T14:25:05.090 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:05.162 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 286/286 2024-03-09T14:25:05.231 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 286/286 2024-03-09T14:25:11.553 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:25:11.553 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:19.0.0-2079.gc00d9c60.el9.x86_64 1/286 2024-03-09T14:25:11.553 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 2/286 2024-03-09T14:25:11.553 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 3/286 2024-03-09T14:25:11.554 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 4/286 2024-03-09T14:25:11.554 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2079.gc00d9 5/286 2024-03-09T14:25:11.554 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 6/286 2024-03-09T14:25:11.554 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 7/286 2024-03-09T14:25:11.554 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 8/286 2024-03-09T14:25:11.554 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 9/286 2024-03-09T14:25:11.554 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 10/286 2024-03-09T14:25:11.554 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 11/286 2024-03-09T14:25:11.554 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:19.0.0-2079.gc00d9c60.el9.x86_64 12/286 2024-03-09T14:25:11.554 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:19.0.0-2079.gc00d9c60.el9.x86_ 13/286 2024-03-09T14:25:11.554 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 14/286 2024-03-09T14:25:11.554 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 15/286 2024-03-09T14:25:11.555 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:19.0.0-2079.gc00d9c60.el9.x86_6 16/286 2024-03-09T14:25:11.555 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86 17/286 2024-03-09T14:25:11.555 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 18/286 2024-03-09T14:25:11.555 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2079.gc00d9c60.el 19/286 2024-03-09T14:25:11.555 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:19.0.0-2079.gc00d9c60.el9. 20/286 2024-03-09T14:25:11.555 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:19.0.0-2079.gc00d9c60.el9.x86_6 21/286 2024-03-09T14:25:11.555 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:19.0.0-2079.gc00d9c60.el9.x86_64 22/286 2024-03-09T14:25:11.555 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 23/286 2024-03-09T14:25:11.555 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 24/286 2024-03-09T14:25:11.555 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 25/286 2024-03-09T14:25:11.555 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 26/286 2024-03-09T14:25:11.555 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 27/286 2024-03-09T14:25:11.556 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2079.gc00d9c60. 28/286 2024-03-09T14:25:11.556 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noa 29/286 2024-03-09T14:25:11.556 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.n 30/286 2024-03-09T14:25:11.578 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00 31/286 2024-03-09T14:25:11.578 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2079.gc00d9c60.el 32/286 2024-03-09T14:25:11.578 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 33/286 2024-03-09T14:25:11.578 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2079.gc00d9c60.e 34/286 2024-03-09T14:25:11.578 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 35/286 2024-03-09T14:25:11.578 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 36/286 2024-03-09T14:25:11.578 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 37/286 2024-03-09T14:25:11.578 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 38/286 2024-03-09T14:25:11.579 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 39/286 2024-03-09T14:25:11.579 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 40/286 2024-03-09T14:25:11.579 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 41/286 2024-03-09T14:25:11.579 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 42/286 2024-03-09T14:25:11.579 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 43/286 2024-03-09T14:25:11.579 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 44/286 2024-03-09T14:25:11.579 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : atinject-1.0.3-6.el9.noarch 45/286 2024-03-09T14:25:11.579 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : atk-2.36.0-5.el9.x86_64 46/286 2024-03-09T14:25:11.579 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 47/286 2024-03-09T14:25:11.579 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 48/286 2024-03-09T14:25:11.579 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 49/286 2024-03-09T14:25:11.579 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 50/286 2024-03-09T14:25:11.579 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 51/286 2024-03-09T14:25:11.579 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 52/286 2024-03-09T14:25:11.580 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 53/286 2024-03-09T14:25:11.580 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 54/286 2024-03-09T14:25:11.580 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 55/286 2024-03-09T14:25:11.580 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 56/286 2024-03-09T14:25:11.580 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 57/286 2024-03-09T14:25:11.580 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 58/286 2024-03-09T14:25:11.580 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 59/286 2024-03-09T14:25:11.580 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 60/286 2024-03-09T14:25:11.580 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 61/286 2024-03-09T14:25:11.580 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 62/286 2024-03-09T14:25:11.580 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 63/286 2024-03-09T14:25:11.580 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 64/286 2024-03-09T14:25:11.580 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 65/286 2024-03-09T14:25:11.580 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 66/286 2024-03-09T14:25:11.580 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 67/286 2024-03-09T14:25:11.581 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 68/286 2024-03-09T14:25:11.581 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 69/286 2024-03-09T14:25:11.581 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 70/286 2024-03-09T14:25:11.581 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : guava-30.1-6.el9.noarch 71/286 2024-03-09T14:25:11.581 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 72/286 2024-03-09T14:25:11.581 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 73/286 2024-03-09T14:25:11.581 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 74/286 2024-03-09T14:25:11.581 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 75/286 2024-03-09T14:25:11.581 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 76/286 2024-03-09T14:25:11.581 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 77/286 2024-03-09T14:25:11.581 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 78/286 2024-03-09T14:25:11.581 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 79/286 2024-03-09T14:25:11.581 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 80/286 2024-03-09T14:25:11.581 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 81/286 2024-03-09T14:25:11.582 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 82/286 2024-03-09T14:25:11.582 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 83/286 2024-03-09T14:25:11.582 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 84/286 2024-03-09T14:25:11.582 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 85/286 2024-03-09T14:25:11.582 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lcms2-2.12-3.el9.x86_64 86/286 2024-03-09T14:25:11.582 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 87/286 2024-03-09T14:25:11.582 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 88/286 2024-03-09T14:25:11.582 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 89/286 2024-03-09T14:25:11.582 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 90/286 2024-03-09T14:25:11.582 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 91/286 2024-03-09T14:25:11.582 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 92/286 2024-03-09T14:25:11.582 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 93/286 2024-03-09T14:25:11.582 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 94/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 95/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 96/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 97/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 98/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 99/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 100/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 101/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 102/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 103/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 104/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 105/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 106/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 107/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 108/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 109/286 2024-03-09T14:25:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 110/286 2024-03-09T14:25:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 111/286 2024-03-09T14:25:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 112/286 2024-03-09T14:25:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 113/286 2024-03-09T14:25:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 114/286 2024-03-09T14:25:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 115/286 2024-03-09T14:25:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 116/286 2024-03-09T14:25:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 117/286 2024-03-09T14:25:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libsbc-1.4-9.el9.x86_64 118/286 2024-03-09T14:25:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 119/286 2024-03-09T14:25:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 120/286 2024-03-09T14:25:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 121/286 2024-03-09T14:25:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 122/286 2024-03-09T14:25:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 123/286 2024-03-09T14:25:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 124/286 2024-03-09T14:25:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 125/286 2024-03-09T14:25:11.585 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 126/286 2024-03-09T14:25:11.585 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 127/286 2024-03-09T14:25:11.585 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 128/286 2024-03-09T14:25:11.585 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 129/286 2024-03-09T14:25:11.585 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 130/286 2024-03-09T14:25:11.585 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 131/286 2024-03-09T14:25:11.585 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 132/286 2024-03-09T14:25:11.585 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lua-5.4.4-4.el9.x86_64 133/286 2024-03-09T14:25:11.585 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 134/286 2024-03-09T14:25:11.585 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 135/286 2024-03-09T14:25:11.585 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 136/286 2024-03-09T14:25:11.585 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 137/286 2024-03-09T14:25:11.585 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 138/286 2024-03-09T14:25:11.585 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 139/286 2024-03-09T14:25:11.585 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 140/286 2024-03-09T14:25:11.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 141/286 2024-03-09T14:25:11.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 142/286 2024-03-09T14:25:11.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 143/286 2024-03-09T14:25:11.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 144/286 2024-03-09T14:25:11.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 145/286 2024-03-09T14:25:11.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : opus-1.3.1-10.el9.x86_64 146/286 2024-03-09T14:25:11.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : orc-0.4.31-6.el9.x86_64 147/286 2024-03-09T14:25:11.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 148/286 2024-03-09T14:25:11.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 149/286 2024-03-09T14:25:11.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 150/286 2024-03-09T14:25:11.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 151/286 2024-03-09T14:25:11.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 152/286 2024-03-09T14:25:11.586 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 153/286 2024-03-09T14:25:11.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 154/286 2024-03-09T14:25:11.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 155/286 2024-03-09T14:25:11.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 156/286 2024-03-09T14:25:11.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 157/286 2024-03-09T14:25:11.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 158/286 2024-03-09T14:25:11.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 159/286 2024-03-09T14:25:11.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 160/286 2024-03-09T14:25:11.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 161/286 2024-03-09T14:25:11.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 162/286 2024-03-09T14:25:11.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 163/286 2024-03-09T14:25:11.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 164/286 2024-03-09T14:25:11.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 165/286 2024-03-09T14:25:11.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 166/286 2024-03-09T14:25:11.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 167/286 2024-03-09T14:25:11.587 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 168/286 2024-03-09T14:25:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 169/286 2024-03-09T14:25:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 170/286 2024-03-09T14:25:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 171/286 2024-03-09T14:25:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 172/286 2024-03-09T14:25:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 173/286 2024-03-09T14:25:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 174/286 2024-03-09T14:25:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 175/286 2024-03-09T14:25:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 176/286 2024-03-09T14:25:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rtkit-0.11-28.el9.x86_64 177/286 2024-03-09T14:25:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 178/286 2024-03-09T14:25:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 179/286 2024-03-09T14:25:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 180/286 2024-03-09T14:25:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 181/286 2024-03-09T14:25:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 182/286 2024-03-09T14:25:11.588 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 183/286 2024-03-09T14:25:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 184/286 2024-03-09T14:25:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 185/286 2024-03-09T14:25:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : upower-0.99.11-11.el9.x86_64 186/286 2024-03-09T14:25:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 187/286 2024-03-09T14:25:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 188/286 2024-03-09T14:25:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 189/286 2024-03-09T14:25:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 190/286 2024-03-09T14:25:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 191/286 2024-03-09T14:25:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 192/286 2024-03-09T14:25:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 193/286 2024-03-09T14:25:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 194/286 2024-03-09T14:25:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 195/286 2024-03-09T14:25:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : bluez-libs-5.64-1.el9.x86_64 196/286 2024-03-09T14:25:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 197/286 2024-03-09T14:25:11.589 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 198/286 2024-03-09T14:25:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 199/286 2024-03-09T14:25:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 200/286 2024-03-09T14:25:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 201/286 2024-03-09T14:25:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 202/286 2024-03-09T14:25:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ply-3.11-14.el9.noarch 203/286 2024-03-09T14:25:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 204/286 2024-03-09T14:25:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 205/286 2024-03-09T14:25:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cups-libs-1:2.3.3op2-24.el9.x86_64 206/286 2024-03-09T14:25:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jq-1.6-16.el9.x86_64 207/286 2024-03-09T14:25:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 208/286 2024-03-09T14:25:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 209/286 2024-03-09T14:25:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 210/286 2024-03-09T14:25:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : alsa-lib-1.2.10-2.el9.x86_64 211/286 2024-03-09T14:25:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 212/286 2024-03-09T14:25:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 213/286 2024-03-09T14:25:11.591 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 214/286 2024-03-09T14:25:11.591 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libdrm-2.4.117-1.el9.x86_64 215/286 2024-03-09T14:25:11.591 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 216/286 2024-03-09T14:25:11.591 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libtiff-4.4.0-12.el9.x86_64 217/286 2024-03-09T14:25:11.591 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : mesa-libEGL-23.3.3-1.el9.x86_64 218/286 2024-03-09T14:25:11.591 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : mesa-libGL-23.3.3-1.el9.x86_64 219/286 2024-03-09T14:25:11.591 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : mesa-libgbm-23.3.3-1.el9.x86_64 220/286 2024-03-09T14:25:11.591 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : mesa-libglapi-23.3.3-1.el9.x86_64 221/286 2024-03-09T14:25:11.591 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : osinfo-db-20231215-1.el9.noarch 222/286 2024-03-09T14:25:11.591 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ostree-libs-2024.4-3.el9.x86_64 223/286 2024-03-09T14:25:11.591 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 224/286 2024-03-09T14:25:11.591 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 225/286 2024-03-09T14:25:11.591 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 226/286 2024-03-09T14:25:11.591 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 227/286 2024-03-09T14:25:11.592 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 228/286 2024-03-09T14:25:11.592 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 229/286 2024-03-09T14:25:11.592 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : poppler-21.01.0-19.el9.x86_64 230/286 2024-03-09T14:25:11.592 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : poppler-glib-21.01.0-19.el9.x86_64 231/286 2024-03-09T14:25:11.592 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 232/286 2024-03-09T14:25:11.592 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 233/286 2024-03-09T14:25:11.592 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 234/286 2024-03-09T14:25:11.592 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 235/286 2024-03-09T14:25:11.592 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 236/286 2024-03-09T14:25:11.592 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : tzdata-java-2024a-1.el9.noarch 237/286 2024-03-09T14:25:11.592 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 238/286 2024-03-09T14:25:11.592 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 239/286 2024-03-09T14:25:11.592 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 240/286 2024-03-09T14:25:11.592 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 241/286 2024-03-09T14:25:11.592 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 242/286 2024-03-09T14:25:11.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 243/286 2024-03-09T14:25:11.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 244/286 2024-03-09T14:25:11.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 245/286 2024-03-09T14:25:11.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 246/286 2024-03-09T14:25:11.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 247/286 2024-03-09T14:25:11.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 248/286 2024-03-09T14:25:11.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 249/286 2024-03-09T14:25:11.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 250/286 2024-03-09T14:25:11.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 251/286 2024-03-09T14:25:11.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 252/286 2024-03-09T14:25:11.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 253/286 2024-03-09T14:25:11.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 254/286 2024-03-09T14:25:11.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 255/286 2024-03-09T14:25:11.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 256/286 2024-03-09T14:25:11.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 257/286 2024-03-09T14:25:11.594 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 258/286 2024-03-09T14:25:11.594 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 259/286 2024-03-09T14:25:11.594 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 260/286 2024-03-09T14:25:11.594 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 261/286 2024-03-09T14:25:11.594 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 262/286 2024-03-09T14:25:11.594 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 263/286 2024-03-09T14:25:11.594 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 264/286 2024-03-09T14:25:11.594 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 265/286 2024-03-09T14:25:11.594 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 266/286 2024-03-09T14:25:11.594 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 267/286 2024-03-09T14:25:11.594 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 268/286 2024-03-09T14:25:11.594 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 269/286 2024-03-09T14:25:11.594 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 270/286 2024-03-09T14:25:11.594 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 271/286 2024-03-09T14:25:11.594 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 272/286 2024-03-09T14:25:11.595 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 273/286 2024-03-09T14:25:11.595 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 274/286 2024-03-09T14:25:11.595 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 275/286 2024-03-09T14:25:11.595 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 276/286 2024-03-09T14:25:11.595 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 277/286 2024-03-09T14:25:11.595 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 278/286 2024-03-09T14:25:11.595 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 279/286 2024-03-09T14:25:11.595 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : re2-1:20211101-3.el9.x86_64 280/286 2024-03-09T14:25:11.595 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 281/286 2024-03-09T14:25:11.595 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 282/286 2024-03-09T14:25:11.595 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 283/286 2024-03-09T14:25:11.595 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 284/286 2024-03-09T14:25:11.595 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 285/286 2024-03-09T14:25:15.142 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:25:15.142 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:15.142 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2024-03-09T14:25:15.142 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.143 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.143 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-03-09T14:25:15.143 INFO:teuthology.orchestra.run.smithi088.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-03-09T14:25:15.143 INFO:teuthology.orchestra.run.smithi088.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-09T14:25:15.143 INFO:teuthology.orchestra.run.smithi088.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-03-09T14:25:15.143 INFO:teuthology.orchestra.run.smithi088.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-03-09T14:25:15.143 INFO:teuthology.orchestra.run.smithi088.stdout: alsa-lib-1.2.10-2.el9.x86_64 2024-03-09T14:25:15.143 INFO:teuthology.orchestra.run.smithi088.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-03-09T14:25:15.143 INFO:teuthology.orchestra.run.smithi088.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-03-09T14:25:15.143 INFO:teuthology.orchestra.run.smithi088.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-03-09T14:25:15.143 INFO:teuthology.orchestra.run.smithi088.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-03-09T14:25:15.143 INFO:teuthology.orchestra.run.smithi088.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-03-09T14:25:15.143 INFO:teuthology.orchestra.run.smithi088.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-03-09T14:25:15.143 INFO:teuthology.orchestra.run.smithi088.stdout: atinject-1.0.3-6.el9.noarch 2024-03-09T14:25:15.144 INFO:teuthology.orchestra.run.smithi088.stdout: atk-2.36.0-5.el9.x86_64 2024-03-09T14:25:15.144 INFO:teuthology.orchestra.run.smithi088.stdout: avahi-glib-0.8-12.el9.x86_64 2024-03-09T14:25:15.144 INFO:teuthology.orchestra.run.smithi088.stdout: bluez-libs-5.64-1.el9.x86_64 2024-03-09T14:25:15.144 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-09T14:25:15.144 INFO:teuthology.orchestra.run.smithi088.stdout: bubblewrap-0.4.1-6.el9.x86_64 2024-03-09T14:25:15.144 INFO:teuthology.orchestra.run.smithi088.stdout: cdi-api-2.0.2-6.el9.noarch 2024-03-09T14:25:15.144 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.144 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.144 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.144 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.144 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:15.144 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.144 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.145 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.145 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:15.145 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:15.145 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:15.145 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:15.145 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:15.145 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.145 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.145 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:15.145 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.145 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.145 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.145 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:15.145 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:25:15.145 INFO:teuthology.orchestra.run.smithi088.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-03-09T14:25:15.146 INFO:teuthology.orchestra.run.smithi088.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-03-09T14:25:15.146 INFO:teuthology.orchestra.run.smithi088.stdout: cups-libs-1:2.3.3op2-24.el9.x86_64 2024-03-09T14:25:15.146 INFO:teuthology.orchestra.run.smithi088.stdout: dconf-0.40.0-6.el9.x86_64 2024-03-09T14:25:15.146 INFO:teuthology.orchestra.run.smithi088.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-03-09T14:25:15.146 INFO:teuthology.orchestra.run.smithi088.stdout: exiv2-0.27.5-2.el9.x86_64 2024-03-09T14:25:15.146 INFO:teuthology.orchestra.run.smithi088.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-03-09T14:25:15.146 INFO:teuthology.orchestra.run.smithi088.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-03-09T14:25:15.146 INFO:teuthology.orchestra.run.smithi088.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-03-09T14:25:15.146 INFO:teuthology.orchestra.run.smithi088.stdout: flatpak-1.12.8-1.el9.x86_64 2024-03-09T14:25:15.146 INFO:teuthology.orchestra.run.smithi088.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2024-03-09T14:25:15.146 INFO:teuthology.orchestra.run.smithi088.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2024-03-09T14:25:15.146 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-09T14:25:15.146 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-09T14:25:15.147 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-09T14:25:15.147 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-09T14:25:15.147 INFO:teuthology.orchestra.run.smithi088.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2024-03-09T14:25:15.147 INFO:teuthology.orchestra.run.smithi088.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-03-09T14:25:15.147 INFO:teuthology.orchestra.run.smithi088.stdout: giflib-5.2.1-9.el9.x86_64 2024-03-09T14:25:15.147 INFO:teuthology.orchestra.run.smithi088.stdout: google-guice-4.2.3-9.el9.noarch 2024-03-09T14:25:15.147 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-09T14:25:15.147 INFO:teuthology.orchestra.run.smithi088.stdout: graphene-1.10.6-2.el9.x86_64 2024-03-09T14:25:15.147 INFO:teuthology.orchestra.run.smithi088.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-09T14:25:15.147 INFO:teuthology.orchestra.run.smithi088.stdout: gsm-1.0.19-6.el9.x86_64 2024-03-09T14:25:15.147 INFO:teuthology.orchestra.run.smithi088.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-03-09T14:25:15.147 INFO:teuthology.orchestra.run.smithi088.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-03-09T14:25:15.147 INFO:teuthology.orchestra.run.smithi088.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2024-03-09T14:25:15.147 INFO:teuthology.orchestra.run.smithi088.stdout: gtk3-3.24.31-2.el9.x86_64 2024-03-09T14:25:15.148 INFO:teuthology.orchestra.run.smithi088.stdout: guava-30.1-6.el9.noarch 2024-03-09T14:25:15.148 INFO:teuthology.orchestra.run.smithi088.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-03-09T14:25:15.148 INFO:teuthology.orchestra.run.smithi088.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-03-09T14:25:15.148 INFO:teuthology.orchestra.run.smithi088.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-03-09T14:25:15.148 INFO:teuthology.orchestra.run.smithi088.stdout: iso-codes-4.6.0-3.el9.noarch 2024-03-09T14:25:15.148 INFO:teuthology.orchestra.run.smithi088.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-03-09T14:25:15.148 INFO:teuthology.orchestra.run.smithi088.stdout: jansi-2.3.3-6.el9.x86_64 2024-03-09T14:25:15.148 INFO:teuthology.orchestra.run.smithi088.stdout: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 2024-03-09T14:25:15.148 INFO:teuthology.orchestra.run.smithi088.stdout: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_64 2024-03-09T14:25:15.148 INFO:teuthology.orchestra.run.smithi088.stdout: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 2024-03-09T14:25:15.148 INFO:teuthology.orchestra.run.smithi088.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-03-09T14:25:15.148 INFO:teuthology.orchestra.run.smithi088.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-03-09T14:25:15.148 INFO:teuthology.orchestra.run.smithi088.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-03-09T14:25:15.148 INFO:teuthology.orchestra.run.smithi088.stdout: jq-1.6-16.el9.x86_64 2024-03-09T14:25:15.149 INFO:teuthology.orchestra.run.smithi088.stdout: jsoup-1.13.1-10.el9.noarch 2024-03-09T14:25:15.149 INFO:teuthology.orchestra.run.smithi088.stdout: jsr-305-3.0.2-6.el9.noarch 2024-03-09T14:25:15.149 INFO:teuthology.orchestra.run.smithi088.stdout: lcms2-2.12-3.el9.x86_64 2024-03-09T14:25:15.149 INFO:teuthology.orchestra.run.smithi088.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2024-03-09T14:25:15.149 INFO:teuthology.orchestra.run.smithi088.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-03-09T14:25:15.149 INFO:teuthology.orchestra.run.smithi088.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-03-09T14:25:15.149 INFO:teuthology.orchestra.run.smithi088.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-03-09T14:25:15.149 INFO:teuthology.orchestra.run.smithi088.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-03-09T14:25:15.149 INFO:teuthology.orchestra.run.smithi088.stdout: libXi-1.7.10-8.el9.x86_64 2024-03-09T14:25:15.149 INFO:teuthology.orchestra.run.smithi088.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-03-09T14:25:15.149 INFO:teuthology.orchestra.run.smithi088.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-03-09T14:25:15.149 INFO:teuthology.orchestra.run.smithi088.stdout: libXtst-1.2.3-16.el9.x86_64 2024-03-09T14:25:15.150 INFO:teuthology.orchestra.run.smithi088.stdout: libXv-1.0.11-16.el9.x86_64 2024-03-09T14:25:15.150 INFO:teuthology.orchestra.run.smithi088.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-03-09T14:25:15.150 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-09T14:25:15.150 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-09T14:25:15.150 INFO:teuthology.orchestra.run.smithi088.stdout: libasyncns-0.8-22.el9.x86_64 2024-03-09T14:25:15.150 INFO:teuthology.orchestra.run.smithi088.stdout: libcanberra-0.30-27.el9.x86_64 2024-03-09T14:25:15.150 INFO:teuthology.orchestra.run.smithi088.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-03-09T14:25:15.150 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.150 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.150 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.150 INFO:teuthology.orchestra.run.smithi088.stdout: libdrm-2.4.117-1.el9.x86_64 2024-03-09T14:25:15.150 INFO:teuthology.orchestra.run.smithi088.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-03-09T14:25:15.150 INFO:teuthology.orchestra.run.smithi088.stdout: libexif-0.6.22-6.el9.x86_64 2024-03-09T14:25:15.151 INFO:teuthology.orchestra.run.smithi088.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-03-09T14:25:15.151 INFO:teuthology.orchestra.run.smithi088.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-03-09T14:25:15.151 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-09T14:25:15.151 INFO:teuthology.orchestra.run.smithi088.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-03-09T14:25:15.151 INFO:teuthology.orchestra.run.smithi088.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-03-09T14:25:15.151 INFO:teuthology.orchestra.run.smithi088.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-03-09T14:25:15.151 INFO:teuthology.orchestra.run.smithi088.stdout: libgsf-1.14.47-5.el9.x86_64 2024-03-09T14:25:15.151 INFO:teuthology.orchestra.run.smithi088.stdout: libgxps-0.3.2-3.el9.x86_64 2024-03-09T14:25:15.151 INFO:teuthology.orchestra.run.smithi088.stdout: libiptcdata-1.0.5-9.el9.x86_64 2024-03-09T14:25:15.151 INFO:teuthology.orchestra.run.smithi088.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-03-09T14:25:15.151 INFO:teuthology.orchestra.run.smithi088.stdout: libnotify-0.7.9-8.el9.x86_64 2024-03-09T14:25:15.151 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-09T14:25:15.152 INFO:teuthology.orchestra.run.smithi088.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-03-09T14:25:15.152 INFO:teuthology.orchestra.run.smithi088.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-03-09T14:25:15.152 INFO:teuthology.orchestra.run.smithi088.stdout: libpciaccess-0.16-6.el9.x86_64 2024-03-09T14:25:15.152 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-09T14:25:15.152 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-09T14:25:15.152 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-09T14:25:15.152 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.152 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.152 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-09T14:25:15.152 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.152 INFO:teuthology.orchestra.run.smithi088.stdout: libsbc-1.4-9.el9.x86_64 2024-03-09T14:25:15.152 INFO:teuthology.orchestra.run.smithi088.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-03-09T14:25:15.152 INFO:teuthology.orchestra.run.smithi088.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-03-09T14:25:15.152 INFO:teuthology.orchestra.run.smithi088.stdout: libtiff-4.4.0-12.el9.x86_64 2024-03-09T14:25:15.153 INFO:teuthology.orchestra.run.smithi088.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2024-03-09T14:25:15.153 INFO:teuthology.orchestra.run.smithi088.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-03-09T14:25:15.153 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-09T14:25:15.153 INFO:teuthology.orchestra.run.smithi088.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-03-09T14:25:15.153 INFO:teuthology.orchestra.run.smithi088.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-03-09T14:25:15.153 INFO:teuthology.orchestra.run.smithi088.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-03-09T14:25:15.153 INFO:teuthology.orchestra.run.smithi088.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-03-09T14:25:15.153 INFO:teuthology.orchestra.run.smithi088.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-03-09T14:25:15.153 INFO:teuthology.orchestra.run.smithi088.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-03-09T14:25:15.153 INFO:teuthology.orchestra.run.smithi088.stdout: libwebp-1.2.0-8.el9.x86_64 2024-03-09T14:25:15.153 INFO:teuthology.orchestra.run.smithi088.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-03-09T14:25:15.153 INFO:teuthology.orchestra.run.smithi088.stdout: libxshmfence-1.3-10.el9.x86_64 2024-03-09T14:25:15.153 INFO:teuthology.orchestra.run.smithi088.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-03-09T14:25:15.153 INFO:teuthology.orchestra.run.smithi088.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-03-09T14:25:15.153 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-09T14:25:15.154 INFO:teuthology.orchestra.run.smithi088.stdout: lua-5.4.4-4.el9.x86_64 2024-03-09T14:25:15.154 INFO:teuthology.orchestra.run.smithi088.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-09T14:25:15.154 INFO:teuthology.orchestra.run.smithi088.stdout: lua-posix-35.0-8.el9.x86_64 2024-03-09T14:25:15.154 INFO:teuthology.orchestra.run.smithi088.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-09T14:25:15.154 INFO:teuthology.orchestra.run.smithi088.stdout: maven-1:3.6.3-15.el9.noarch 2024-03-09T14:25:15.154 INFO:teuthology.orchestra.run.smithi088.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-03-09T14:25:15.154 INFO:teuthology.orchestra.run.smithi088.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-03-09T14:25:15.154 INFO:teuthology.orchestra.run.smithi088.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-03-09T14:25:15.154 INFO:teuthology.orchestra.run.smithi088.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-03-09T14:25:15.154 INFO:teuthology.orchestra.run.smithi088.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-03-09T14:25:15.154 INFO:teuthology.orchestra.run.smithi088.stdout: mesa-libEGL-23.3.3-1.el9.x86_64 2024-03-09T14:25:15.154 INFO:teuthology.orchestra.run.smithi088.stdout: mesa-libGL-23.3.3-1.el9.x86_64 2024-03-09T14:25:15.154 INFO:teuthology.orchestra.run.smithi088.stdout: mesa-libgbm-23.3.3-1.el9.x86_64 2024-03-09T14:25:15.154 INFO:teuthology.orchestra.run.smithi088.stdout: mesa-libglapi-23.3.3-1.el9.x86_64 2024-03-09T14:25:15.154 INFO:teuthology.orchestra.run.smithi088.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-03-09T14:25:15.155 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-09T14:25:15.155 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-09T14:25:15.155 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-09T14:25:15.155 INFO:teuthology.orchestra.run.smithi088.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-03-09T14:25:15.155 INFO:teuthology.orchestra.run.smithi088.stdout: opus-1.3.1-10.el9.x86_64 2024-03-09T14:25:15.155 INFO:teuthology.orchestra.run.smithi088.stdout: orc-0.4.31-6.el9.x86_64 2024-03-09T14:25:15.155 INFO:teuthology.orchestra.run.smithi088.stdout: osinfo-db-20231215-1.el9.noarch 2024-03-09T14:25:15.155 INFO:teuthology.orchestra.run.smithi088.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-03-09T14:25:15.155 INFO:teuthology.orchestra.run.smithi088.stdout: ostree-libs-2024.4-3.el9.x86_64 2024-03-09T14:25:15.155 INFO:teuthology.orchestra.run.smithi088.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2024-03-09T14:25:15.155 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-09T14:25:15.155 INFO:teuthology.orchestra.run.smithi088.stdout: pipewire-1.0.1-1.el9.x86_64 2024-03-09T14:25:15.155 INFO:teuthology.orchestra.run.smithi088.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-03-09T14:25:15.155 INFO:teuthology.orchestra.run.smithi088.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: plexus-cipher-1.7-27.el9.noarch 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: poppler-21.01.0-19.el9.x86_64 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: poppler-data-0.4.9-9.el9.noarch 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: poppler-glib-21.01.0-19.el9.x86_64 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-03-09T14:25:15.156 INFO:teuthology.orchestra.run.smithi088.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-03-09T14:25:15.157 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-09T14:25:15.157 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-09T14:25:15.157 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-09T14:25:15.157 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-09T14:25:15.157 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.157 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.157 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.157 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-09T14:25:15.157 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-09T14:25:15.157 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-09T14:25:15.157 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-09T14:25:15.157 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-09T14:25:15.157 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-09T14:25:15.157 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-09T14:25:15.158 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-09T14:25:15.158 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-09T14:25:15.158 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-09T14:25:15.158 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-09T14:25:15.158 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-09T14:25:15.158 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-09T14:25:15.158 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-09T14:25:15.158 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-09T14:25:15.158 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-09T14:25:15.158 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-09T14:25:15.158 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-09T14:25:15.158 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-09T14:25:15.158 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-09T14:25:15.158 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-09T14:25:15.159 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-09T14:25:15.159 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-09T14:25:15.159 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-09T14:25:15.159 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-09T14:25:15.159 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-09T14:25:15.159 INFO:teuthology.orchestra.run.smithi088.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-09T14:25:15.159 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-09T14:25:15.159 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply-3.11-14.el9.noarch 2024-03-09T14:25:15.159 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-09T14:25:15.159 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-09T14:25:15.159 INFO:teuthology.orchestra.run.smithi088.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-09T14:25:15.159 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-09T14:25:15.159 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-09T14:25:15.159 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-09T14:25:15.160 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-09T14:25:15.160 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-09T14:25:15.160 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.160 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.160 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-09T14:25:15.160 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-09T14:25:15.160 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-09T14:25:15.160 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.160 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-09T14:25:15.160 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-09T14:25:15.160 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-09T14:25:15.160 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-09T14:25:15.160 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-09T14:25:15.160 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-09T14:25:15.161 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-09T14:25:15.161 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-09T14:25:15.161 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-09T14:25:15.161 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-09T14:25:15.161 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-09T14:25:15.161 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-09T14:25:15.161 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-09T14:25:15.161 INFO:teuthology.orchestra.run.smithi088.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-09T14:25:15.161 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.161 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.161 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:25:15.161 INFO:teuthology.orchestra.run.smithi088.stdout: re2-1:20211101-3.el9.x86_64 2024-03-09T14:25:15.161 INFO:teuthology.orchestra.run.smithi088.stdout: rtkit-0.11-28.el9.x86_64 2024-03-09T14:25:15.161 INFO:teuthology.orchestra.run.smithi088.stdout: s3cmd-2.4.0-1.el9.noarch 2024-03-09T14:25:15.162 INFO:teuthology.orchestra.run.smithi088.stdout: sisu-1:0.3.4-10.el9.noarch 2024-03-09T14:25:15.162 INFO:teuthology.orchestra.run.smithi088.stdout: slf4j-1.7.30-13.el9.noarch 2024-03-09T14:25:15.162 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-09T14:25:15.162 INFO:teuthology.orchestra.run.smithi088.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-03-09T14:25:15.162 INFO:teuthology.orchestra.run.smithi088.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-09T14:25:15.162 INFO:teuthology.orchestra.run.smithi088.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-03-09T14:25:15.162 INFO:teuthology.orchestra.run.smithi088.stdout: tracker-3.1.2-3.el9.x86_64 2024-03-09T14:25:15.162 INFO:teuthology.orchestra.run.smithi088.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-03-09T14:25:15.162 INFO:teuthology.orchestra.run.smithi088.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-03-09T14:25:15.162 INFO:teuthology.orchestra.run.smithi088.stdout: tzdata-java-2024a-1.el9.noarch 2024-03-09T14:25:15.162 INFO:teuthology.orchestra.run.smithi088.stdout: upower-0.99.11-11.el9.x86_64 2024-03-09T14:25:15.162 INFO:teuthology.orchestra.run.smithi088.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-03-09T14:25:15.162 INFO:teuthology.orchestra.run.smithi088.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-03-09T14:25:15.163 INFO:teuthology.orchestra.run.smithi088.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-03-09T14:25:15.163 INFO:teuthology.orchestra.run.smithi088.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-03-09T14:25:15.163 INFO:teuthology.orchestra.run.smithi088.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-03-09T14:25:15.163 INFO:teuthology.orchestra.run.smithi088.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-03-09T14:25:15.163 INFO:teuthology.orchestra.run.smithi088.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-03-09T14:25:15.163 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-09T14:25:15.163 INFO:teuthology.orchestra.run.smithi088.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-03-09T14:25:15.163 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:15.163 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-03-09T14:25:15.546 DEBUG:teuthology.parallel:result is None 2024-03-09T14:25:15.547 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:25:15.768 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-09T14:25:15.877 INFO:teuthology.orchestra.run.smithi088.stdout:19.0.0-2079.gc00d9c60.el9 2024-03-09T14:25:15.878 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2079.gc00d9c60.el9 2024-03-09T14:25:15.878 INFO:teuthology.task.install:The correct ceph version 19.0.0-2079.gc00d9c60 is installed. 2024-03-09T14:25:15.880 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:25:16.020 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-09T14:25:16.144 INFO:teuthology.orchestra.run.smithi132.stdout:19.0.0-2079.gc00d9c60.el9 2024-03-09T14:25:16.144 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2079.gc00d9c60.el9 2024-03-09T14:25:16.145 INFO:teuthology.task.install:The correct ceph version 19.0.0-2079.gc00d9c60 is installed. 2024-03-09T14:25:16.147 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-09T14:25:16.147 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:16.147 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-09T14:25:16.191 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:16.192 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-09T14:25:16.239 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-09T14:25:16.240 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:16.240 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2024-03-09T14:25:16.280 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-09T14:25:16.358 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:16.359 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2024-03-09T14:25:16.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-09T14:25:16.483 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-09T14:25:16.483 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:16.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-09T14:25:16.523 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-09T14:25:16.601 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:16.601 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-09T14:25:16.643 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-09T14:25:16.724 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-09T14:25:16.724 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:16.724 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2024-03-09T14:25:16.764 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-09T14:25:16.844 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:16.844 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/stdin-killer 2024-03-09T14:25:16.884 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-09T14:25:16.964 INFO:teuthology.run_tasks:Running task ceph... 2024-03-09T14:25:17.050 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-09T14:25:17.050 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2024-03-09T14:25:17.052 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2024-03-09T14:25:17.091 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-09T14:25:17.091 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-09T14:25:17.132 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-09T14:25:17.171 INFO:tasks.ceph:Creating extra log directories... 2024-03-09T14:25:17.171 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-09T14:25:17.212 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-09T14:25:17.263 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-09T14:25:17.263 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-09T14:25:17.263 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484', 'branch': 'wip-rgw-account-v3', 'description': 'rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7588484', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rgw-account-v3'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': True, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'wip-iam-user-apis', 'git_remote': 'https://github.com/cbodley/', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-account-v3', 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 3347, 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-account-v3', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413', 'targets': {'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLdtrRT99sDurN4PmqBejSe8+hw5Kx40rgqwoN57B61MTNS+gxPUGjelnDy0ix9LAM9V6Hy+V216d7iKXZ+p8f8=', 'smithi132.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ7LiqayEOgfVyz0QeLjdO0Z/3ilRQWwBCs/yi1K4gMIDHnub5mWKmMowyZxsw1WoaTZc6Y46AvcIdZP2bJLO4o='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-09_13:26:09', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-09T14:25:17.264 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-09T14:25:17.292 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-09T14:25:17.319 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2024-03-09T14:25:17.360 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2024-03-09T14:25:17.399 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:17.399 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2024-03-09T14:25:17.466 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-09T14:25:17.466 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2024-03-09T14:25:17.533 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-09T14:25:17.533 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:25:17.533 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-03-09T14:25:17.533 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:25:17.533 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:25:17.533 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-03-09 14:25:06.088104620 +0000 2024-03-09T14:25:17.533 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-03-09 14:22:37.339296298 +0000 2024-03-09T14:25:17.533 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-03-09 14:22:37.339296298 +0000 2024-03-09T14:25:17.533 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-03-09 14:22:37.339296298 +0000 2024-03-09T14:25:17.534 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-09T14:25:17.611 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-03-09T14:25:17.667 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-03-09T14:25:17.667 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000204765 s, 2.5 MB/s 2024-03-09T14:25:17.668 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-09T14:25:17.737 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2024-03-09T14:25:17.806 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-09T14:25:17.806 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:25:17.806 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-03-09T14:25:17.806 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:25:17.806 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:25:17.806 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-03-09 14:25:06.089104600 +0000 2024-03-09T14:25:17.806 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-03-09 14:22:37.696288982 +0000 2024-03-09T14:25:17.806 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-03-09 14:22:37.696288982 +0000 2024-03-09T14:25:17.807 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-03-09 14:22:37.696288982 +0000 2024-03-09T14:25:17.807 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-09T14:25:17.885 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-03-09T14:25:17.885 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-03-09T14:25:17.885 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000227178 s, 2.3 MB/s 2024-03-09T14:25:17.886 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-09T14:25:17.954 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2024-03-09T14:25:18.023 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-09T14:25:18.023 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:25:18.023 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-03-09T14:25:18.023 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:25:18.024 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:25:18.024 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-03-09 14:25:06.089104600 +0000 2024-03-09T14:25:18.024 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-03-09 14:22:38.044281850 +0000 2024-03-09T14:25:18.024 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-03-09 14:22:38.044281850 +0000 2024-03-09T14:25:18.024 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-03-09 14:22:38.044281850 +0000 2024-03-09T14:25:18.025 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-09T14:25:18.102 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-03-09T14:25:18.102 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-03-09T14:25:18.102 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000189747 s, 2.7 MB/s 2024-03-09T14:25:18.103 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-09T14:25:18.172 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2024-03-09T14:25:18.239 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-09T14:25:18.239 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:25:18.239 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-03-09T14:25:18.239 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:25:18.239 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:25:18.240 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-03-09 14:25:06.089104600 +0000 2024-03-09T14:25:18.240 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-03-09 14:22:38.383274903 +0000 2024-03-09T14:25:18.240 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-03-09 14:22:38.383274903 +0000 2024-03-09T14:25:18.240 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-03-09 14:22:38.383274903 +0000 2024-03-09T14:25:18.240 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-09T14:25:18.318 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-03-09T14:25:18.318 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-03-09T14:25:18.318 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000202028 s, 2.5 MB/s 2024-03-09T14:25:18.319 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-09T14:25:18.387 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-09T14:25:18.387 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:18.387 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2024-03-09T14:25:18.419 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-09T14:25:18.420 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2024-03-09T14:25:18.491 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-09T14:25:18.492 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:25:18.492 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-03-09T14:25:18.492 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:25:18.492 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:25:18.492 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-03-09 14:24:54.782950413 +0000 2024-03-09T14:25:18.492 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-03-09 14:22:37.326788216 +0000 2024-03-09T14:25:18.492 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-03-09 14:22:37.326788216 +0000 2024-03-09T14:25:18.492 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-03-09 14:22:37.326788216 +0000 2024-03-09T14:25:18.492 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-09T14:25:18.574 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-03-09T14:25:18.574 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-03-09T14:25:18.574 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000219278 s, 2.3 MB/s 2024-03-09T14:25:18.575 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-09T14:25:18.645 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2024-03-09T14:25:18.714 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-09T14:25:18.714 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:25:18.714 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-03-09T14:25:18.714 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:25:18.714 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:25:18.714 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-03-09 14:24:54.783950387 +0000 2024-03-09T14:25:18.714 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-03-09 14:22:37.678779167 +0000 2024-03-09T14:25:18.714 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-03-09 14:22:37.678779167 +0000 2024-03-09T14:25:18.714 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-03-09 14:22:37.678779167 +0000 2024-03-09T14:25:18.715 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-09T14:25:18.794 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-03-09T14:25:18.794 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-03-09T14:25:18.794 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000193062 s, 2.7 MB/s 2024-03-09T14:25:18.795 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-09T14:25:18.865 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2024-03-09T14:25:18.932 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-09T14:25:18.933 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:25:18.933 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-03-09T14:25:18.933 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:25:18.933 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:25:18.933 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-03-09 14:24:54.783950387 +0000 2024-03-09T14:25:18.933 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-03-09 14:22:38.001770864 +0000 2024-03-09T14:25:18.933 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-03-09 14:22:38.001770864 +0000 2024-03-09T14:25:18.933 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-03-09 14:22:38.001770864 +0000 2024-03-09T14:25:18.933 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-09T14:25:19.010 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-03-09T14:25:19.010 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-03-09T14:25:19.010 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000187845 s, 2.7 MB/s 2024-03-09T14:25:19.011 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-09T14:25:19.080 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2024-03-09T14:25:19.146 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-09T14:25:19.146 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:25:19.146 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-03-09T14:25:19.147 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:25:19.147 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:25:19.147 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-03-09 14:24:54.784950361 +0000 2024-03-09T14:25:19.147 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-03-09 14:22:38.396760710 +0000 2024-03-09T14:25:19.147 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-03-09 14:22:38.396760710 +0000 2024-03-09T14:25:19.147 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-03-09 14:22:38.396760710 +0000 2024-03-09T14:25:19.147 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-09T14:25:19.224 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-03-09T14:25:19.224 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-03-09T14:25:19.224 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000211585 s, 2.4 MB/s 2024-03-09T14:25:19.225 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-09T14:25:19.293 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-09T14:25:19.293 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-09T14:25:19.293 INFO:tasks.ceph:Generating config... 2024-03-09T14:25:19.295 INFO:tasks.ceph:[client] debug rgw = 20 2024-03-09T14:25:19.295 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-03-09T14:25:19.295 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-03-09T14:25:19.295 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-03-09T14:25:19.295 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-03-09T14:25:19.295 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-03-09T14:25:19.295 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-03-09T14:25:19.295 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-03-09T14:25:19.295 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-03-09T14:25:19.295 INFO:tasks.ceph:[client] setgroup = ceph 2024-03-09T14:25:19.295 INFO:tasks.ceph:[client] setuser = ceph 2024-03-09T14:25:19.295 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-03-09T14:25:19.295 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-03-09T14:25:19.296 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-03-09T14:25:19.296 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-03-09T14:25:19.296 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-03-09T14:25:19.296 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-09T14:25:19.296 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-09T14:25:19.296 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-09T14:25:19.296 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-09T14:25:19.296 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-09T14:25:19.296 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-03-09T14:25:19.296 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-09T14:25:19.296 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-09T14:25:19.296 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-09T14:25:19.296 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-09T14:25:19.296 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-09T14:25:19.296 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-09T14:25:19.296 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-09T14:25:19.297 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-09T14:25:19.297 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-09T14:25:19.297 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-09T14:25:19.297 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-09T14:25:19.297 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-09T14:25:19.297 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-09T14:25:19.297 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-09T14:25:19.297 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-03-09T14:25:19.297 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-09T14:25:19.297 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-03-09T14:25:19.297 INFO:tasks.ceph:Setting up mon.a... 2024-03-09T14:25:19.297 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-09T14:25:19.357 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.keyring 2024-03-09T14:25:19.360 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-09T14:25:19.417 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-09T14:25:19.455 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.88'), ('mon.c', '[v2:172.21.15.88:3301,v1:172.21.15.88:6790]'), ('mon.b', '172.21.15.132')] 2024-03-09T14:25:19.456 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790],172.21.15.132', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-03-09T14:25:19.457 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:19.457 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-09T14:25:19.523 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.88 --addv c '[v2:172.21.15.88:3301,v1:172.21.15.88:6790]' --add b 172.21.15.132 --print /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:25:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:25:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:25:19.623 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:25:19.623 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: generated fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:25:19.624 INFO:teuthology.orchestra.run.smithi088.stdout:setting min_mon_release = quincy 2024-03-09T14:25:19.624 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 0 2024-03-09T14:25:19.624 INFO:teuthology.orchestra.run.smithi088.stdout:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:25:19.624 INFO:teuthology.orchestra.run.smithi088.stdout:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:25:19.624 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:25:19.624 INFO:teuthology.orchestra.run.smithi088.stdout:min_mon_release 17 (quincy) 2024-03-09T14:25:19.624 INFO:teuthology.orchestra.run.smithi088.stdout:election_strategy: 1 2024-03-09T14:25:19.624 INFO:teuthology.orchestra.run.smithi088.stdout:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:25:19.624 INFO:teuthology.orchestra.run.smithi088.stdout:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:25:19.624 INFO:teuthology.orchestra.run.smithi088.stdout:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:25:19.624 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-09T14:25:19.625 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-09T14:25:19.652 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 03df7284-17fe-4d16-b21b-e9f66257a07a... 2024-03-09T14:25:19.653 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-09T14:25:19.695 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-09T14:25:19.756 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2024-03-09T14:25:19.756 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2024-03-09T14:25:19.756 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-09T14:25:19.756 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2024-03-09T14:25:19.756 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.757 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2024-03-09T14:25:19.757 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.757 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2024-03-09T14:25:19.757 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.757 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2024-03-09T14:25:19.757 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2024-03-09T14:25:19.757 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.757 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2024-03-09T14:25:19.757 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2024-03-09T14:25:19.757 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.757 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-09T14:25:19.757 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2024-03-09T14:25:19.757 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.757 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2024-03-09T14:25:19.758 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-09T14:25:19.758 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.758 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2024-03-09T14:25:19.758 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.758 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2024-03-09T14:25:19.758 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2024-03-09T14:25:19.758 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2024-03-09T14:25:19.758 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2024-03-09T14:25:19.758 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2024-03-09T14:25:19.758 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2024-03-09T14:25:19.758 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2024-03-09T14:25:19.758 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-09T14:25:19.758 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-09T14:25:19.759 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2024-03-09T14:25:19.759 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.759 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-09T14:25:19.759 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.759 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2024-03-09T14:25:19.759 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.759 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2024-03-09T14:25:19.759 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.759 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2024-03-09T14:25:19.759 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2024-03-09T14:25:19.759 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2024-03-09T14:25:19.759 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790],172.21.15.132" 2024-03-09T14:25:19.759 INFO:teuthology.orchestra.run.smithi088.stdout: mon client directed command retry = 5 2024-03-09T14:25:19.759 INFO:teuthology.orchestra.run.smithi088.stdout: ms inject socket failures = 5000 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi088.stdout: osd heartbeat grace = 40 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi088.stdout: osd_max_pg_log_entries = 10 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi088.stdout: osd_min_pg_log_entries = 10 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi088.stdout: osd mclock profile = high_recovery_ops 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.761 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2024-03-09T14:25:19.761 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2024-03-09T14:25:19.761 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2024-03-09T14:25:19.761 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug trim objects = true 2024-03-09T14:25:19.761 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.761 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2024-03-09T14:25:19.761 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2024-03-09T14:25:19.761 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.761 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2024-03-09T14:25:19.761 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.761 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2024-03-09T14:25:19.761 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.761 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2024-03-09T14:25:19.761 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: bdev async discard = True 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: bdev enable discard = True 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore allocator = bitmap 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 1/20 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 1/20 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 4/10 2024-03-09T14:25:19.762 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2024-03-09T14:25:19.763 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2024-03-09T14:25:19.763 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2024-03-09T14:25:19.763 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2024-03-09T14:25:19.763 INFO:teuthology.orchestra.run.smithi088.stdout: osd fast shutdown = False 2024-03-09T14:25:19.763 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2024-03-09T14:25:19.763 INFO:teuthology.orchestra.run.smithi088.stdout: osd shutdown pgref assert = True 2024-03-09T14:25:19.763 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.763 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2024-03-09T14:25:19.763 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-03-09T14:25:19.763 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2024-03-09T14:25:19.763 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-03-09T14:25:19.763 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-03-09T14:25:19.763 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-03-09T14:25:19.763 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-03-09T14:25:19.764 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2024-03-09T14:25:19.764 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.764 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2024-03-09T14:25:19.764 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-03-09T14:25:19.764 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-03-09T14:25:19.764 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2024-03-09T14:25:19.764 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-03-09T14:25:19.764 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2024-03-09T14:25:19.764 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2024-03-09T14:25:19.764 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-03-09T14:25:19.764 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2024-03-09T14:25:19.764 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2024-03-09T14:25:19.764 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-03-09T14:25:19.764 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.764 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-09T14:25:19.765 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2024-03-09T14:25:19.765 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2024-03-09T14:25:19.765 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.765 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2024-03-09T14:25:19.765 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-09T14:25:19.765 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-09T14:25:19.765 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.765 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2024-03-09T14:25:19.765 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2024-03-09T14:25:19.765 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.765 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2024-03-09T14:25:19.765 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd crush smoke test = False 2024-03-09T14:25:19.765 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:25:19.765 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2024-03-09T14:25:19.766 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2024-03-09T14:25:19.766 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2024-03-09T14:25:19.766 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2024-03-09T14:25:19.766 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-09T14:25:19.766 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-09T14:25:19.766 INFO:teuthology.orchestra.run.smithi088.stdout: debug rgw = 20 2024-03-09T14:25:19.766 INFO:teuthology.orchestra.run.smithi088.stdout: rgw bucket counters cache = True 2024-03-09T14:25:19.766 INFO:teuthology.orchestra.run.smithi088.stdout: rgw crypt require ssl = False 2024-03-09T14:25:19.766 INFO:teuthology.orchestra.run.smithi088.stdout: rgw crypt s3 kms backend = testing 2024-03-09T14:25:19.766 INFO:teuthology.orchestra.run.smithi088.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-03-09T14:25:19.766 INFO:teuthology.orchestra.run.smithi088.stdout: rgw s3 auth use sts = True 2024-03-09T14:25:19.766 INFO:teuthology.orchestra.run.smithi088.stdout: rgw sts key = abcdefghijklmnop 2024-03-09T14:25:19.766 INFO:teuthology.orchestra.run.smithi088.stdout: rgw torrent flag = True 2024-03-09T14:25:19.766 INFO:teuthology.orchestra.run.smithi088.stdout: rgw user counters cache = True 2024-03-09T14:25:19.766 INFO:teuthology.orchestra.run.smithi088.stdout: setgroup = ceph 2024-03-09T14:25:19.767 INFO:teuthology.orchestra.run.smithi088.stdout: setuser = ceph 2024-03-09T14:25:19.767 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2024-03-09T14:25:19.767 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2024-03-09T14:25:19.767 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2024-03-09T14:25:19.767 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2024-03-09T14:25:19.767 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2024-03-09T14:25:19.767 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-09T14:25:19.767 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2024-03-09T14:25:19.767 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.767 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2024-03-09T14:25:19.768 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.768 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2024-03-09T14:25:19.768 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.768 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2024-03-09T14:25:19.768 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2024-03-09T14:25:19.768 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.768 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2024-03-09T14:25:19.768 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2024-03-09T14:25:19.768 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.768 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-09T14:25:19.768 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2024-03-09T14:25:19.768 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.768 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2024-03-09T14:25:19.768 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-09T14:25:19.769 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.769 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2024-03-09T14:25:19.769 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.769 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2024-03-09T14:25:19.769 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2024-03-09T14:25:19.769 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2024-03-09T14:25:19.769 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2024-03-09T14:25:19.769 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2024-03-09T14:25:19.769 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2024-03-09T14:25:19.769 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2024-03-09T14:25:19.769 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-09T14:25:19.769 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-09T14:25:19.769 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2024-03-09T14:25:19.769 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.770 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-09T14:25:19.770 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.770 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2024-03-09T14:25:19.770 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.770 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2024-03-09T14:25:19.770 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.770 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2024-03-09T14:25:19.770 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2024-03-09T14:25:19.770 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2024-03-09T14:25:19.770 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = "172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790],172.21.15.132" 2024-03-09T14:25:19.770 INFO:teuthology.orchestra.run.smithi132.stdout: mon client directed command retry = 5 2024-03-09T14:25:19.770 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject socket failures = 5000 2024-03-09T14:25:19.770 INFO:teuthology.orchestra.run.smithi132.stdout: osd heartbeat grace = 40 2024-03-09T14:25:19.770 INFO:teuthology.orchestra.run.smithi132.stdout: osd_max_pg_log_entries = 10 2024-03-09T14:25:19.771 INFO:teuthology.orchestra.run.smithi132.stdout: osd_min_pg_log_entries = 10 2024-03-09T14:25:19.771 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:25:19.771 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.771 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2024-03-09T14:25:19.771 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2024-03-09T14:25:19.771 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.771 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2024-03-09T14:25:19.771 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2024-03-09T14:25:19.771 INFO:teuthology.orchestra.run.smithi132.stdout: osd mclock profile = high_recovery_ops 2024-03-09T14:25:19.771 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.771 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2024-03-09T14:25:19.771 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2024-03-09T14:25:19.771 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.771 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2024-03-09T14:25:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2024-03-09T14:25:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2024-03-09T14:25:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug trim objects = true 2024-03-09T14:25:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2024-03-09T14:25:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2024-03-09T14:25:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2024-03-09T14:25:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2024-03-09T14:25:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2024-03-09T14:25:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2024-03-09T14:25:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2024-03-09T14:25:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2024-03-09T14:25:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2024-03-09T14:25:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: bdev async discard = True 2024-03-09T14:25:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: bdev enable discard = True 2024-03-09T14:25:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore allocator = bitmap 2024-03-09T14:25:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2024-03-09T14:25:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2024-03-09T14:25:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 1/20 2024-03-09T14:25:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 1/20 2024-03-09T14:25:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-03-09T14:25:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 20 2024-03-09T14:25:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 4/10 2024-03-09T14:25:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2024-03-09T14:25:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2024-03-09T14:25:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2024-03-09T14:25:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 0.95 2024-03-09T14:25:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: osd fast shutdown = False 2024-03-09T14:25:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = bluestore 2024-03-09T14:25:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: osd shutdown pgref assert = True 2024-03-09T14:25:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.774 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2024-03-09T14:25:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-03-09T14:25:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2024-03-09T14:25:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-03-09T14:25:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-03-09T14:25:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-03-09T14:25:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-03-09T14:25:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2024-03-09T14:25:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.775 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2024-03-09T14:25:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-03-09T14:25:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-03-09T14:25:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2024-03-09T14:25:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-03-09T14:25:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2024-03-09T14:25:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2024-03-09T14:25:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-03-09T14:25:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2024-03-09T14:25:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2024-03-09T14:25:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-03-09T14:25:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-09T14:25:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: auth mon ticket ttl = 660 # 11m 2024-03-09T14:25:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: auth service ticket ttl = 240 # 4m 2024-03-09T14:25:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: # don't complain about insecure global_id in the test suite 2024-03-09T14:25:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-09T14:25:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-09T14:25:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: # 1m isn't quite enough 2024-03-09T14:25:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: mon_down_mkfs_grace = 2m 2024-03-09T14:25:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_filestore_osds = false 2024-03-09T14:25:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd crush smoke test = False 2024-03-09T14:25:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-09T14:25:19.777 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2024-03-09T14:25:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2024-03-09T14:25:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2024-03-09T14:25:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2024-03-09T14:25:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-09T14:25:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-09T14:25:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: debug rgw = 20 2024-03-09T14:25:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: rgw bucket counters cache = True 2024-03-09T14:25:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: rgw crypt require ssl = False 2024-03-09T14:25:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: rgw crypt s3 kms backend = testing 2024-03-09T14:25:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-03-09T14:25:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: rgw s3 auth use sts = True 2024-03-09T14:25:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: rgw sts key = abcdefghijklmnop 2024-03-09T14:25:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: rgw torrent flag = True 2024-03-09T14:25:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: rgw user counters cache = True 2024-03-09T14:25:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: setgroup = ceph 2024-03-09T14:25:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: setuser = ceph 2024-03-09T14:25:19.778 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2024-03-09T14:25:19.778 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.c] 2024-03-09T14:25:19.778 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.b] 2024-03-09T14:25:19.779 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-09T14:25:19.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-09T14:25:19.887 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-09T14:25:19.887 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:19.887 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-09T14:25:19.914 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:19.914 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-09T14:25:19.981 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2024-03-09T14:25:19.981 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:19.982 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-09T14:25:19.982 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-09T14:25:20.073 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:20.073 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:25:20.139 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2024-03-09T14:25:20.139 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:20.140 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-09T14:25:20.140 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-09T14:25:20.193 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:20.193 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:25:20.261 INFO:tasks.ceph:Setting up mon nodes... 2024-03-09T14:25:20.261 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-09T14:25:20.261 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-09T14:25:20.328 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-09T14:25:20.331 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-09T14:25:20.406 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-09T14:25:20.408 INFO:tasks.ceph:Setting up mds nodes... 2024-03-09T14:25:20.408 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-09T14:25:20.409 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-09T14:25:20.463 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-09T14:25:20.478 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-09T14:25:20.532 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-09T14:25:20.548 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-09T14:25:20.548 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-09T14:25:20.548 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-09T14:25:20.589 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-09T14:25:20.589 INFO:tasks.ceph:role: osd.0 2024-03-09T14:25:20.589 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2024-03-09T14:25:20.589 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-09T14:25:20.675 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:25:20.675 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:25:20.675 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:25:20.675 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:25:20.675 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:25:20.675 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:25:20.675 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:25:20.675 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:25:20.675 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:25:20.675 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:25:21.165 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-03-09T14:25:21.167 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-03-09T14:25:21.167 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-09T14:25:21.255 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-09T14:25:21.302 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-09T14:25:21.341 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-09T14:25:21.341 INFO:tasks.ceph:role: osd.1 2024-03-09T14:25:21.341 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com 2024-03-09T14:25:21.341 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-09T14:25:21.429 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:25:21.429 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:25:21.429 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:25:21.430 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:25:21.430 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:25:21.430 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:25:21.430 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:25:21.430 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:25:21.430 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:25:21.430 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:25:21.885 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-03-09T14:25:21.886 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-03-09T14:25:21.887 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-09T14:25:21.934 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-09T14:25:21.979 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-09T14:25:22.060 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-09T14:25:22.060 INFO:tasks.ceph:role: osd.2 2024-03-09T14:25:22.060 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com 2024-03-09T14:25:22.060 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-09T14:25:22.148 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:25:22.149 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:25:22.149 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:25:22.149 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:25:22.149 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:25:22.149 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:25:22.149 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:25:22.149 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:25:22.149 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:25:22.149 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:25:22.622 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-03-09T14:25:22.624 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-03-09T14:25:22.624 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-09T14:25:22.690 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-09T14:25:22.734 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-09T14:25:22.815 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-09T14:25:22.815 INFO:tasks.ceph:role: osd.3 2024-03-09T14:25:22.815 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com 2024-03-09T14:25:22.815 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-09T14:25:22.904 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:25:22.904 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:25:22.904 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:25:22.904 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:25:22.905 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:25:22.905 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:25:22.905 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:25:22.905 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:25:22.905 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:25:22.905 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:25:23.414 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-03-09T14:25:23.416 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-03-09T14:25:23.416 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-09T14:25:23.525 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-09T14:25:23.572 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:25:23.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:23.641+0000 7f1f6a60c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-09T14:25:23.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:23.642+0000 7f1f6a60c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-09T14:25:23.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:23.642+0000 7f1f6a60c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-09T14:25:23.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:23.642+0000 7f1f6a60c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-09T14:25:23.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:23.642+0000 7f1f6a60c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-09T14:25:23.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:23.643+0000 7f1f6a60c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-09T14:25:26.492 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-09T14:25:26.537 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:25:26.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:26.598+0000 7fef59a1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-09T14:25:26.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:26.598+0000 7fef59a1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-09T14:25:26.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:26.598+0000 7fef59a1c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-09T14:25:26.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:26.598+0000 7fef59a1c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-09T14:25:26.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:26.598+0000 7fef59a1c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-09T14:25:26.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:26.599+0000 7fef59a1c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-09T14:25:29.463 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-09T14:25:29.508 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:25:29.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:29.569+0000 7f9f76e1f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-09T14:25:29.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:29.569+0000 7f9f76e1f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-09T14:25:29.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:29.569+0000 7f9f76e1f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-09T14:25:29.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:29.569+0000 7f9f76e1f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-09T14:25:29.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:29.569+0000 7f9f76e1f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-09T14:25:29.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:29.570+0000 7f9f76e1f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-09T14:25:32.429 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-09T14:25:32.473 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:25:32.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:32.574+0000 7f0462f9a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-09T14:25:32.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:32.574+0000 7f0462f9a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-09T14:25:32.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:32.574+0000 7f0462f9a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-09T14:25:32.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:32.574+0000 7f0462f9a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-09T14:25:32.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:32.574+0000 7f0462f9a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-09T14:25:32.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:32.575+0000 7f0462f9a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-09T14:25:35.432 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-09T14:25:35.477 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-09T14:25:35.524 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-09T14:25:35.524 INFO:tasks.ceph:role: osd.4 2024-03-09T14:25:35.524 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2024-03-09T14:25:35.524 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-09T14:25:35.574 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:25:35.574 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:25:35.574 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:25:35.574 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:25:35.574 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:25:35.574 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:25:35.574 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:25:35.575 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:25:35.575 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:25:35.575 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:25:36.078 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-03-09T14:25:36.081 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-03-09T14:25:36.081 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-09T14:25:36.207 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-09T14:25:36.258 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-09T14:25:36.299 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-09T14:25:36.299 INFO:tasks.ceph:role: osd.5 2024-03-09T14:25:36.299 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com 2024-03-09T14:25:36.300 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-09T14:25:36.387 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:25:36.388 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:25:36.388 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:25:36.388 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:25:36.388 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:25:36.388 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:25:36.388 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:25:36.388 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:25:36.388 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:25:36.388 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:25:36.843 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-03-09T14:25:36.845 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-03-09T14:25:36.845 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-09T14:25:36.902 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-09T14:25:36.945 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-09T14:25:37.024 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-09T14:25:37.025 INFO:tasks.ceph:role: osd.6 2024-03-09T14:25:37.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com 2024-03-09T14:25:37.025 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-09T14:25:37.112 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:25:37.112 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:25:37.112 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:25:37.112 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:25:37.112 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:25:37.112 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:25:37.112 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:25:37.112 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:25:37.112 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:25:37.112 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:25:37.605 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-03-09T14:25:37.607 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-03-09T14:25:37.607 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-09T14:25:37.710 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-09T14:25:37.754 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-09T14:25:37.834 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-09T14:25:37.834 INFO:tasks.ceph:role: osd.7 2024-03-09T14:25:37.834 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com 2024-03-09T14:25:37.834 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-09T14:25:37.921 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:25:37.921 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:25:37.921 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:25:37.921 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:25:37.922 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:25:37.922 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:25:37.922 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:25:37.922 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:25:37.922 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:25:37.922 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:25:38.441 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-03-09T14:25:38.443 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-03-09T14:25:38.443 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-09T14:25:38.564 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-09T14:25:38.612 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:25:38.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:38.686+0000 7f4edb00e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-09T14:25:38.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:38.687+0000 7f4edb00e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-09T14:25:38.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:38.687+0000 7f4edb00e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-09T14:25:38.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:38.687+0000 7f4edb00e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-09T14:25:38.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:38.687+0000 7f4edb00e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-09T14:25:38.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:38.687+0000 7f4edb00e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-09T14:25:41.542 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-09T14:25:41.588 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:25:41.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:41.650+0000 7f1f77a11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-09T14:25:41.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:41.650+0000 7f1f77a11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-09T14:25:41.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:41.650+0000 7f1f77a11640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-09T14:25:41.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:41.650+0000 7f1f77a11640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-09T14:25:41.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:41.650+0000 7f1f77a11640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-09T14:25:41.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:41.650+0000 7f1f77a11640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-09T14:25:44.501 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-09T14:25:44.546 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:25:44.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:44.607+0000 7f71a6e16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-09T14:25:44.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:44.607+0000 7f71a6e16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-09T14:25:44.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:44.607+0000 7f71a6e16640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-09T14:25:44.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:44.607+0000 7f71a6e16640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-09T14:25:44.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:44.607+0000 7f71a6e16640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-09T14:25:44.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:44.608+0000 7f71a6e16640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-09T14:25:47.484 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-09T14:25:47.529 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:25:47.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:47.590+0000 7f06c8c11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-09T14:25:47.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:47.590+0000 7f06c8c11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-09T14:25:47.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:47.590+0000 7f06c8c11640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-09T14:25:47.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:47.590+0000 7f06c8c11640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-09T14:25:47.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:47.590+0000 7f06c8c11640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-09T14:25:47.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-09T14:25:47.591+0000 7f06c8c11640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-09T14:25:50.445 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-09T14:25:50.489 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-09T14:25:50.489 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:50.489 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-09T14:25:50.536 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:50.536 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-09T14:25:50.619 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:50.619 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-09T14:25:50.701 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:50.702 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-09T14:25:50.782 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:50.782 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-09T14:25:50.863 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:50.863 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-09T14:25:50.909 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:50.909 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-09T14:25:50.993 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:50.994 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-09T14:25:51.077 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:51.077 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-09T14:25:51.159 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:51.159 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-09T14:25:51.239 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:51.239 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-09T14:25:51.271 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:51.271 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-09T14:25:51.307 INFO:tasks.ceph:Adding keys to all mons... 2024-03-09T14:25:51.308 DEBUG:teuthology.orchestra.run.smithi088:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-09T14:25:51.314 DEBUG:teuthology.orchestra.run.smithi132:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-09T14:25:51.351 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.y] 2024-03-09T14:25:51.351 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBQcexlW7KiExAA1mNvWXiYlxDmm9xZulCToA== 2024-03-09T14:25:51.351 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.0] 2024-03-09T14:25:51.351 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBTcexl8TxSJhAAtas4vN6D+LgT59DhUhM6TQ== 2024-03-09T14:25:51.351 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.1] 2024-03-09T14:25:51.351 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBWcexlVlXBIxAAYbDGK0RgLUOh+docxJxTSQ== 2024-03-09T14:25:51.351 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.2] 2024-03-09T14:25:51.351 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBZcexlb4AIIhAAEtD063QyzMo0KjjcEUc/0w== 2024-03-09T14:25:51.351 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.3] 2024-03-09T14:25:51.351 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBccexlPIFQIhAAjOIadbpGy5pZ7hdJe92wlA== 2024-03-09T14:25:51.351 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.x] 2024-03-09T14:25:51.352 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBQcexlW549GBAAXGvBWOcnzr6X2MJX9BgJ8A== 2024-03-09T14:25:51.352 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.4] 2024-03-09T14:25:51.352 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBicexluxkDKRAAASh8BzQy5dhqj+UMc+5nxQ== 2024-03-09T14:25:51.352 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.5] 2024-03-09T14:25:51.352 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBlcexlrPDRJhAAOl7ChEN1lmZ3OkApMvhwzg== 2024-03-09T14:25:51.352 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.6] 2024-03-09T14:25:51.352 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBocexlXpJFJBAAJdKpuXpax0LeEjoJVtjzig== 2024-03-09T14:25:51.352 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.7] 2024-03-09T14:25:51.352 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBrcexlRHBFIxAAnkGsgVnHYIHD9MUx+lOXkg== 2024-03-09T14:25:51.352 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2024-03-09T14:25:51.352 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBQcexl+y+pGxAA2m8cFMeIielYI9OqGQwLFA== 2024-03-09T14:25:51.352 INFO:teuthology.orchestra.run.smithi088.stdout:[client.1] 2024-03-09T14:25:51.352 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBQcexlSq/MHxAA2bfTY4D+P3RlQspYzu6x/Q== 2024-03-09T14:25:51.386 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.y] 2024-03-09T14:25:51.386 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBQcexlW7KiExAA1mNvWXiYlxDmm9xZulCToA== 2024-03-09T14:25:51.386 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.0] 2024-03-09T14:25:51.386 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBTcexl8TxSJhAAtas4vN6D+LgT59DhUhM6TQ== 2024-03-09T14:25:51.386 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.1] 2024-03-09T14:25:51.386 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBWcexlVlXBIxAAYbDGK0RgLUOh+docxJxTSQ== 2024-03-09T14:25:51.386 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2024-03-09T14:25:51.386 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBZcexlb4AIIhAAEtD063QyzMo0KjjcEUc/0w== 2024-03-09T14:25:51.386 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.3] 2024-03-09T14:25:51.386 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBccexlPIFQIhAAjOIadbpGy5pZ7hdJe92wlA== 2024-03-09T14:25:51.386 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.x] 2024-03-09T14:25:51.387 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBQcexlW549GBAAXGvBWOcnzr6X2MJX9BgJ8A== 2024-03-09T14:25:51.387 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.4] 2024-03-09T14:25:51.387 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBicexluxkDKRAAASh8BzQy5dhqj+UMc+5nxQ== 2024-03-09T14:25:51.387 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.5] 2024-03-09T14:25:51.387 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBlcexlrPDRJhAAOl7ChEN1lmZ3OkApMvhwzg== 2024-03-09T14:25:51.387 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.6] 2024-03-09T14:25:51.387 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBocexlXpJFJBAAJdKpuXpax0LeEjoJVtjzig== 2024-03-09T14:25:51.387 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.7] 2024-03-09T14:25:51.387 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBrcexlRHBFIxAAnkGsgVnHYIHD9MUx+lOXkg== 2024-03-09T14:25:51.387 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2024-03-09T14:25:51.387 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBQcexl+y+pGxAA2m8cFMeIielYI9OqGQwLFA== 2024-03-09T14:25:51.387 INFO:teuthology.orchestra.run.smithi132.stdout:[client.1] 2024-03-09T14:25:51.387 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBQcexlSq/MHxAA2bfTY4D+P3RlQspYzu6x/Q== 2024-03-09T14:25:51.388 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-09T14:25:51.396 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-09T14:25:51.492 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:51.494 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:51.558 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:51.560 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:51.624 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:51.626 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:51.691 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:51.694 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:51.758 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-09T14:25:51.760 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-09T14:25:51.823 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:51.825 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:51.889 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:51.891 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:51.956 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:51.958 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:52.023 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:52.025 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:25:52.089 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-09T14:25:52.091 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-09T14:25:52.159 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-09T14:25:52.161 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-09T14:25:52.228 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-09T14:25:52.228 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-09T14:25:52.267 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-09T14:25:52.376 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-09T14:25:52.415 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-09T14:25:52.495 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-09T14:25:52.604 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-09T14:25:52.643 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-09T14:25:52.684 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-09T14:25:52.795 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-09T14:25:52.834 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:25:52.836 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:25:52.900 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-09T14:25:52.900 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-09T14:25:52.901 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-09T14:25:52.904 INFO:tasks.ceph.mon.a:Started 2024-03-09T14:25:52.904 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-09T14:25:52.904 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-09T14:25:52.906 INFO:tasks.ceph.mon.c:Started 2024-03-09T14:25:52.906 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-09T14:25:52.906 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-09T14:25:52.942 INFO:tasks.ceph.mon.b:Started 2024-03-09T14:25:52.943 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-09T14:25:52.943 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-09T14:25:52.943 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-09T14:25:52.945 INFO:tasks.ceph.mgr.y:Started 2024-03-09T14:25:52.946 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-09T14:25:52.946 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-09T14:25:52.947 INFO:tasks.ceph.mgr.x:Started 2024-03-09T14:25:52.948 INFO:tasks.ceph:Setting crush tunables to default 2024-03-09T14:25:52.948 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd crush tunables default 2024-03-09T14:25:58.739 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:25:58.738+0000 7f0f29042040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-09T14:25:58.792 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:25:58.791+0000 7f0f29042040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-09T14:25:59.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:25:59.266+0000 7faca1058640 0 --2- 172.21.15.88:0/2517247742 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fac80006b10 0x7fac80006f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-09T14:25:59.326 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:25:59.326+0000 7f0f29042040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-09T14:25:59.340 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2024-03-09T14:25:59.351 INFO:tasks.ceph:check_enable_crimson: False 2024-03-09T14:25:59.351 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-09T14:25:59.351 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:59.352 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-09T14:25:59.381 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:25:59.379+0000 7f0f29042040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-09T14:25:59.392 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:59.392 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-09T14:25:59.425 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:25:59.424+0000 7f0f29042040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-09T14:25:59.474 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:59.475 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-09T14:25:59.478 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:25:59.477+0000 7f0f29042040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-09T14:25:59.519 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:25:59.519+0000 7f0f29042040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-09T14:25:59.534 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:25:59.534+0000 7fa6f1230040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-09T14:25:59.554 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:25:59.555 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-09T14:25:59.590 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:25:59.590+0000 7fa6f1230040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-09T14:25:59.630 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:59.630 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-09T14:25:59.633 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:25:59.633+0000 7f0f29042040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-09T14:25:59.671 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:59.671 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-09T14:25:59.708 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:25:59.707+0000 7f0f29042040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-09T14:25:59.711 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:59.711 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-09T14:25:59.755 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:25:59.755+0000 7f0f29042040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-09T14:25:59.792 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-09T14:25:59.792 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-09T14:25:59.810 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:25:59.810+0000 7f0f29042040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-09T14:25:59.851 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new d531a182-caf7-48a3-b1c6-6b1a1d03b78b 0 2024-03-09T14:25:59.862 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:25:59.860+0000 7f0f29042040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-09T14:26:00.060 INFO:teuthology.orchestra.run.smithi132.stdout:0 2024-03-09T14:26:00.072 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new f48391d3-6559-46bc-a653-d5c3fee9d3cc 1 2024-03-09T14:26:00.115 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:00.115+0000 7fa6f1230040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-09T14:26:00.168 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:00.168+0000 7fa6f1230040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-09T14:26:00.213 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:00.213+0000 7fa6f1230040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-09T14:26:00.259 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:26:00.258+0000 7f0f29042040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-09T14:26:00.266 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:00.267+0000 7fa6f1230040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-09T14:26:00.272 INFO:teuthology.orchestra.run.smithi132.stdout:1 2024-03-09T14:26:00.284 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 5fa8603b-cf11-4b51-804d-c4e50074282a 2 2024-03-09T14:26:00.309 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:00.309+0000 7fa6f1230040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-09T14:26:00.401 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:26:00.401+0000 7f0f29042040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-09T14:26:00.424 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:00.424+0000 7fa6f1230040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-09T14:26:00.486 INFO:teuthology.orchestra.run.smithi132.stdout:2 2024-03-09T14:26:00.493 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:00.493+0000 7fa6f1230040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-09T14:26:00.497 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new e48253bd-989b-4c33-8ef7-7653bd46398d 3 2024-03-09T14:26:00.522 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:26:00.521+0000 7f0f29042040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-09T14:26:00.539 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:00.539+0000 7fa6f1230040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-09T14:26:00.570 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:26:00.570+0000 7f0f29042040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-09T14:26:00.591 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:00.591+0000 7fa6f1230040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-09T14:26:00.638 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:00.639+0000 7fa6f1230040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-09T14:26:00.687 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:26:00.686+0000 7f0f29042040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-09T14:26:00.698 INFO:teuthology.orchestra.run.smithi132.stdout:3 2024-03-09T14:26:00.709 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 6a17d606-dc8c-49d4-ab53-e9a159f8c6aa 4 2024-03-09T14:26:00.787 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:26:00.786+0000 7f0f29042040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-09T14:26:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:4 2024-03-09T14:26:00.949 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:26:00.948+0000 7f0f29042040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-09T14:26:00.960 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new f37be8a2-bc4d-4e78-8bfa-3c25638c40aa 5 2024-03-09T14:26:00.993 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:26:00.992+0000 7f0f29042040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-09T14:26:01.015 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:01.016+0000 7fa6f1230040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-09T14:26:01.148 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:01.149+0000 7fa6f1230040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-09T14:26:01.155 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:26:01.155+0000 7f0f29042040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-09T14:26:01.191 INFO:teuthology.orchestra.run.smithi132.stdout:5 2024-03-09T14:26:01.203 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new cd0b6340-5c8c-42a3-a243-8844f6835578 6 2024-03-09T14:26:01.268 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:01.268+0000 7fa6f1230040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-09T14:26:01.313 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:01.313+0000 7fa6f1230040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-09T14:26:01.401 INFO:teuthology.orchestra.run.smithi132.stdout:6 2024-03-09T14:26:01.412 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new f1b5ac52-e196-4c45-8f7b-ab90275431fb 7 2024-03-09T14:26:01.426 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:01.425+0000 7fa6f1230040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-09T14:26:01.520 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:01.520+0000 7fa6f1230040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-09T14:26:01.610 INFO:teuthology.orchestra.run.smithi132.stdout:7 2024-03-09T14:26:01.623 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-09T14:26:01.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-09T14:26:01.626 INFO:tasks.ceph.osd.0:Started 2024-03-09T14:26:01.626 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-09T14:26:01.626 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-09T14:26:01.628 INFO:tasks.ceph.osd.1:Started 2024-03-09T14:26:01.628 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-09T14:26:01.628 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-09T14:26:01.630 INFO:tasks.ceph.osd.2:Started 2024-03-09T14:26:01.630 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-09T14:26:01.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-09T14:26:01.634 INFO:tasks.ceph.osd.3:Started 2024-03-09T14:26:01.634 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-09T14:26:01.634 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-09T14:26:01.636 INFO:tasks.ceph.osd.4:Started 2024-03-09T14:26:01.636 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-09T14:26:01.636 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-09T14:26:01.638 INFO:tasks.ceph.osd.5:Started 2024-03-09T14:26:01.638 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-09T14:26:01.638 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-09T14:26:01.640 INFO:tasks.ceph.osd.6:Started 2024-03-09T14:26:01.640 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-09T14:26:01.641 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-09T14:26:01.642 INFO:tasks.ceph.osd.7:Started 2024-03-09T14:26:01.643 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-09T14:26:01.692 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:01.691+0000 7fa6f1230040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-09T14:26:01.752 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:01.751+0000 7fa6f1230040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-09T14:26:01.849 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:26:01.849 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"fsid":"03df7284-17fe-4d16-b21b-e9f66257a07a","created":"2024-03-09T14:25:58.242538+0000","modified":"2024-03-09T14:26:01.605867+0000","last_up_change":"0.000000","last_in_change":"2024-03-09T14:26:01.605867+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d531a182-caf7-48a3-b1c6-6b1a1d03b78b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f48391d3-6559-46bc-a653-d5c3fee9d3cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5fa8603b-cf11-4b51-804d-c4e50074282a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e48253bd-989b-4c33-8ef7-7653bd46398d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6a17d606-dc8c-49d4-ab53-e9a159f8c6aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f37be8a2-bc4d-4e78-8bfa-3c25638c40aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cd0b6340-5c8c-42a3-a243-8844f6835578","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f1b5ac52-e196-4c45-8f7b-ab90275431fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:26:01.860 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-09T14:26:01.860 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-09T14:26:01.913 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:01.912+0000 7fa6f1230040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-09T14:26:02.002 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:26:02.001+0000 7f0f29042040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-09T14:26:02.253 INFO:tasks.ceph.osd.5.smithi132.stderr:2024-03-09T14:26:02.252+0000 7fe7f9eb5640 -1 Falling back to public interface 2024-03-09T14:26:02.261 INFO:tasks.ceph.osd.7.smithi132.stderr:2024-03-09T14:26:02.260+0000 7f9878e0d640 -1 Falling back to public interface 2024-03-09T14:26:02.261 INFO:tasks.ceph.osd.4.smithi132.stderr:2024-03-09T14:26:02.260+0000 7f1c7ce17640 -1 Falling back to public interface 2024-03-09T14:26:02.263 INFO:tasks.ceph.osd.7.smithi132.stderr:2024-03-09T14:26:02.262+0000 7f9877770640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6820/0: (98) Address already in use 2024-03-09T14:26:02.263 INFO:tasks.ceph.osd.6.smithi132.stderr:2024-03-09T14:26:02.262+0000 7f0b4ffac640 -1 Falling back to public interface 2024-03-09T14:26:02.264 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-03-09T14:26:02.263+0000 7f9ee3e0f640 -1 Falling back to public interface 2024-03-09T14:26:02.265 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-03-09T14:26:02.263+0000 7f5a4100c640 -1 Falling back to public interface 2024-03-09T14:26:02.265 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-03-09T14:26:02.263+0000 7f9ee26fc640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-03-09T14:26:02.265 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-03-09T14:26:02.264+0000 7fc2ffe25640 -1 Falling back to public interface 2024-03-09T14:26:02.265 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-03-09T14:26:02.264+0000 7f5a3f8dd640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2024-03-09T14:26:02.266 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-03-09T14:26:02.264+0000 7f161360d640 -1 Falling back to public interface 2024-03-09T14:26:02.266 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-03-09T14:26:02.264+0000 7f9ee26fc640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6803/0: (98) Address already in use 2024-03-09T14:26:02.266 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-03-09T14:26:02.264+0000 7f1611f70640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6804/0: (98) Address already in use 2024-03-09T14:26:02.266 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-03-09T14:26:02.264+0000 7f5a3f8dd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6806/0: (98) Address already in use 2024-03-09T14:26:02.282 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:26:02.282+0000 7f0f29042040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-09T14:26:02.333 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:26:02.333+0000 7f0f29042040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-09T14:26:02.449 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:26:02.448+0000 7f0f29042040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-09T14:26:02.665 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-09T14:26:02.758 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:02.757+0000 7fa6f1230040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-09T14:26:02.850 INFO:teuthology.misc.health.smithi088.stdout: 2024-03-09T14:26:02.850 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":10,"fsid":"03df7284-17fe-4d16-b21b-e9f66257a07a","created":"2024-03-09T14:25:58.242538+0000","modified":"2024-03-09T14:26:01.605867+0000","last_up_change":"0.000000","last_in_change":"2024-03-09T14:26:01.605867+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d531a182-caf7-48a3-b1c6-6b1a1d03b78b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f48391d3-6559-46bc-a653-d5c3fee9d3cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5fa8603b-cf11-4b51-804d-c4e50074282a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e48253bd-989b-4c33-8ef7-7653bd46398d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6a17d606-dc8c-49d4-ab53-e9a159f8c6aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f37be8a2-bc4d-4e78-8bfa-3c25638c40aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cd0b6340-5c8c-42a3-a243-8844f6835578","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f1b5ac52-e196-4c45-8f7b-ab90275431fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:26:02.861 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-09T14:26:03.046 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:03.045+0000 7fa6f1230040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-09T14:26:03.098 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:03.097+0000 7fa6f1230040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-09T14:26:03.211 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-03-09T14:26:03.210+0000 7fa6f1230040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-09T14:26:03.477 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:26:03.476+0000 7f0ec9c37640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-09T14:26:03.477 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:26:03.477+0000 7f0ec9c37640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-09T14:26:05.695 INFO:tasks.ceph.osd.5.smithi132.stderr:2024-03-09T14:26:05.696+0000 7fe7f9eb5640 -1 osd.5 0 log_to_monitors true 2024-03-09T14:26:05.741 INFO:tasks.ceph.osd.6.smithi132.stderr:2024-03-09T14:26:05.742+0000 7f0b4ffac640 -1 osd.6 0 log_to_monitors true 2024-03-09T14:26:05.752 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-03-09T14:26:05.751+0000 7fc2ffe25640 -1 osd.2 0 log_to_monitors true 2024-03-09T14:26:05.767 INFO:tasks.ceph.osd.7.smithi132.stderr:2024-03-09T14:26:05.767+0000 7f9878e0d640 -1 osd.7 0 log_to_monitors true 2024-03-09T14:26:05.775 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-03-09T14:26:05.774+0000 7f5a4100c640 -1 osd.3 0 log_to_monitors true 2024-03-09T14:26:05.784 INFO:tasks.ceph.osd.4.smithi132.stderr:2024-03-09T14:26:05.784+0000 7f1c7ce17640 -1 osd.4 0 log_to_monitors true 2024-03-09T14:26:05.800 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-03-09T14:26:05.799+0000 7f161360d640 -1 osd.1 0 log_to_monitors true 2024-03-09T14:26:05.802 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-03-09T14:26:05.801+0000 7f9ee3e0f640 -1 osd.0 0 log_to_monitors true 2024-03-09T14:26:09.510 INFO:tasks.ceph.osd.6.smithi132.stderr:2024-03-09T14:26:09.510+0000 7f0b4b71d640 -1 osd.6 0 waiting for initial osdmap 2024-03-09T14:26:09.520 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-03-09T14:26:09.520+0000 7f9edeec0640 -1 osd.0 0 waiting for initial osdmap 2024-03-09T14:26:09.522 INFO:tasks.ceph.osd.6.smithi132.stderr:2024-03-09T14:26:09.523+0000 7f0b43d4f640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:26:09.526 INFO:tasks.ceph.osd.4.smithi132.stderr:2024-03-09T14:26:09.526+0000 7f1c77eca640 -1 osd.4 0 waiting for initial osdmap 2024-03-09T14:26:09.532 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-03-09T14:26:09.531+0000 7fc2faf4c640 -1 osd.2 0 waiting for initial osdmap 2024-03-09T14:26:09.535 INFO:tasks.ceph.osd.4.smithi132.stderr:2024-03-09T14:26:09.536+0000 7f1c704fc640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:26:09.535 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-03-09T14:26:09.535+0000 7f9ed74f2640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:26:09.536 INFO:tasks.ceph.osd.7.smithi132.stderr:2024-03-09T14:26:09.537+0000 7f9873f34640 -1 osd.7 0 waiting for initial osdmap 2024-03-09T14:26:09.541 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-03-09T14:26:09.541+0000 7fc2f357e640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:26:09.544 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-03-09T14:26:09.544+0000 7f5a3c0a1640 -1 osd.3 0 waiting for initial osdmap 2024-03-09T14:26:09.551 INFO:tasks.ceph.osd.7.smithi132.stderr:2024-03-09T14:26:09.552+0000 7f986c566640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:26:09.560 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-03-09T14:26:09.560+0000 7f5a346d3640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:26:09.562 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-03-09T14:26:09.562+0000 7f160e734640 -1 osd.1 0 waiting for initial osdmap 2024-03-09T14:26:09.574 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-03-09T14:26:09.574+0000 7f1606d66640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:26:09.577 INFO:tasks.ceph.osd.5.smithi132.stderr:2024-03-09T14:26:09.578+0000 7fe7f5626640 -1 osd.5 0 waiting for initial osdmap 2024-03-09T14:26:09.587 INFO:tasks.ceph.osd.5.smithi132.stderr:2024-03-09T14:26:09.588+0000 7fe7edc58640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:26:09.669 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-09T14:26:09.954 INFO:teuthology.misc.health.smithi088.stdout: 2024-03-09T14:26:09.954 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":12,"fsid":"03df7284-17fe-4d16-b21b-e9f66257a07a","created":"2024-03-09T14:25:58.242538+0000","modified":"2024-03-09T14:26:07.475546+0000","last_up_change":"0.000000","last_in_change":"2024-03-09T14:26:01.605867+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d531a182-caf7-48a3-b1c6-6b1a1d03b78b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f48391d3-6559-46bc-a653-d5c3fee9d3cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5fa8603b-cf11-4b51-804d-c4e50074282a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e48253bd-989b-4c33-8ef7-7653bd46398d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6a17d606-dc8c-49d4-ab53-e9a159f8c6aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f37be8a2-bc4d-4e78-8bfa-3c25638c40aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cd0b6340-5c8c-42a3-a243-8844f6835578","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f1b5ac52-e196-4c45-8f7b-ab90275431fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:26:09.965 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-09T14:26:16.770 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-09T14:26:17.067 INFO:teuthology.misc.health.smithi088.stdout: 2024-03-09T14:26:17.067 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":17,"fsid":"03df7284-17fe-4d16-b21b-e9f66257a07a","created":"2024-03-09T14:25:58.242538+0000","modified":"2024-03-09T14:26:14.551953+0000","last_up_change":"2024-03-09T14:26:10.535661+0000","last_in_change":"2024-03-09T14:26:01.605867+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-09T14:26:12.498536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d531a182-caf7-48a3-b1c6-6b1a1d03b78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6801","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6804","nonce":2236481287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6807","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6810","nonce":2236481287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6824","nonce":2236481287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6818","nonce":2236481287}]},"public_addr":"172.21.15.88:6804/2236481287","cluster_addr":"172.21.15.88:6810/2236481287","heartbeat_back_addr":"172.21.15.88:6824/2236481287","heartbeat_front_addr":"172.21.15.88:6818/2236481287","state":["exists","up"]},{"osd":1,"uuid":"f48391d3-6559-46bc-a653-d5c3fee9d3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6805","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6809","nonce":1625923178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6817","nonce":1625923178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6831","nonce":1625923178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6826","nonce":1625923178}]},"public_addr":"172.21.15.88:6809/1625923178","cluster_addr":"172.21.15.88:6817/1625923178","heartbeat_back_addr":"172.21.15.88:6831/1625923178","heartbeat_front_addr":"172.21.15.88:6826/1625923178","state":["exists","up"]},{"osd":2,"uuid":"5fa8603b-cf11-4b51-804d-c4e50074282a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6803","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6806","nonce":583120953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6815","nonce":583120953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6827","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6830","nonce":583120953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6823","nonce":583120953}]},"public_addr":"172.21.15.88:6806/583120953","cluster_addr":"172.21.15.88:6815/583120953","heartbeat_back_addr":"172.21.15.88:6830/583120953","heartbeat_front_addr":"172.21.15.88:6823/583120953","state":["exists","up"]},{"osd":3,"uuid":"e48253bd-989b-4c33-8ef7-7653bd46398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6802","nonce":4216886240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6812","nonce":4216886240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6829","nonce":4216886240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6820","nonce":4216886240}]},"public_addr":"172.21.15.88:6802/4216886240","cluster_addr":"172.21.15.88:6812/4216886240","heartbeat_back_addr":"172.21.15.88:6829/4216886240","heartbeat_front_addr":"172.21.15.88:6820/4216886240","state":["exists","up"]},{"osd":4,"uuid":"6a17d606-dc8c-49d4-ab53-e9a159f8c6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6811","nonce":692310395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6815","nonce":692310395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6822","nonce":692310395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6819","nonce":692310395}]},"public_addr":"172.21.15.132:6811/692310395","cluster_addr":"172.21.15.132:6815/692310395","heartbeat_back_addr":"172.21.15.132:6822/692310395","heartbeat_front_addr":"172.21.15.132:6819/692310395","state":["exists","up"]},{"osd":5,"uuid":"f37be8a2-bc4d-4e78-8bfa-3c25638c40aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6801","nonce":1549387301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6803","nonce":1549387301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6807","nonce":1549387301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6805","nonce":1549387301}]},"public_addr":"172.21.15.132:6801/1549387301","cluster_addr":"172.21.15.132:6803/1549387301","heartbeat_back_addr":"172.21.15.132:6807/1549387301","heartbeat_front_addr":"172.21.15.132:6805/1549387301","state":["exists","up"]},{"osd":6,"uuid":"cd0b6340-5c8c-42a3-a243-8844f6835578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6825","nonce":731564406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6827","nonce":731564406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6831","nonce":731564406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6829","nonce":731564406}]},"public_addr":"172.21.15.132:6825/731564406","cluster_addr":"172.21.15.132:6827/731564406","heartbeat_back_addr":"172.21.15.132:6831/731564406","heartbeat_front_addr":"172.21.15.132:6829/731564406","state":["exists","up"]},{"osd":7,"uuid":"f1b5ac52-e196-4c45-8f7b-ab90275431fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6810","nonce":251080901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6814","nonce":251080901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6823","nonce":251080901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6818","nonce":251080901}]},"public_addr":"172.21.15.132:6810/251080901","cluster_addr":"172.21.15.132:6814/251080901","heartbeat_back_addr":"172.21.15.132:6823/251080901","heartbeat_front_addr":"172.21.15.132:6818/251080901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.782366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.849444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.738463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.810770+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.780862+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.684764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.707622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.740773+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:26:17.078 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-09T14:26:17.078 INFO:tasks.ceph:Creating RBD pool 2024-03-09T14:26:17.078 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd pool create rbd 8 2024-03-09T14:26:17.568 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'rbd' created 2024-03-09T14:26:17.581 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-03-09T14:26:18.569 INFO:teuthology.orchestra.run.smithi088.stderr:enabled application 'rbd' on pool 'rbd' 2024-03-09T14:26:18.587 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-09T14:26:18.588 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-09T14:26:18.588 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-09T14:26:18.588 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-09T14:26:18.588 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-09T14:26:18.936 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:26:18.947 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3170630856},{"type":"v1","addr":"172.21.15.132:6833","nonce":3170630856}]},"active_addr":"172.21.15.132:6833/3170630856","active_change":"2024-03-09T14:26:02.463850+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":3445778966}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":197802155}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":1286316284}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":1333211517}]}]} 2024-03-09T14:26:18.951 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-09T14:26:18.951 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-09T14:26:18.951 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-09T14:26:19.248 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:26:19.249 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"fsid":"03df7284-17fe-4d16-b21b-e9f66257a07a","created":"2024-03-09T14:25:58.242538+0000","modified":"2024-03-09T14:26:18.566421+0000","last_up_change":"2024-03-09T14:26:10.535661+0000","last_in_change":"2024-03-09T14:26:01.605867+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-09T14:26:12.498536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-09T14:26:17.375242+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d531a182-caf7-48a3-b1c6-6b1a1d03b78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6801","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6804","nonce":2236481287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6807","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6810","nonce":2236481287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6824","nonce":2236481287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6818","nonce":2236481287}]},"public_addr":"172.21.15.88:6804/2236481287","cluster_addr":"172.21.15.88:6810/2236481287","heartbeat_back_addr":"172.21.15.88:6824/2236481287","heartbeat_front_addr":"172.21.15.88:6818/2236481287","state":["exists","up"]},{"osd":1,"uuid":"f48391d3-6559-46bc-a653-d5c3fee9d3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6805","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6809","nonce":1625923178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6817","nonce":1625923178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6831","nonce":1625923178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6826","nonce":1625923178}]},"public_addr":"172.21.15.88:6809/1625923178","cluster_addr":"172.21.15.88:6817/1625923178","heartbeat_back_addr":"172.21.15.88:6831/1625923178","heartbeat_front_addr":"172.21.15.88:6826/1625923178","state":["exists","up"]},{"osd":2,"uuid":"5fa8603b-cf11-4b51-804d-c4e50074282a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6803","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6806","nonce":583120953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6815","nonce":583120953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6827","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6830","nonce":583120953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6823","nonce":583120953}]},"public_addr":"172.21.15.88:6806/583120953","cluster_addr":"172.21.15.88:6815/583120953","heartbeat_back_addr":"172.21.15.88:6830/583120953","heartbeat_front_addr":"172.21.15.88:6823/583120953","state":["exists","up"]},{"osd":3,"uuid":"e48253bd-989b-4c33-8ef7-7653bd46398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6802","nonce":4216886240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6812","nonce":4216886240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6829","nonce":4216886240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6820","nonce":4216886240}]},"public_addr":"172.21.15.88:6802/4216886240","cluster_addr":"172.21.15.88:6812/4216886240","heartbeat_back_addr":"172.21.15.88:6829/4216886240","heartbeat_front_addr":"172.21.15.88:6820/4216886240","state":["exists","up"]},{"osd":4,"uuid":"6a17d606-dc8c-49d4-ab53-e9a159f8c6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6811","nonce":692310395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6815","nonce":692310395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6822","nonce":692310395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6819","nonce":692310395}]},"public_addr":"172.21.15.132:6811/692310395","cluster_addr":"172.21.15.132:6815/692310395","heartbeat_back_addr":"172.21.15.132:6822/692310395","heartbeat_front_addr":"172.21.15.132:6819/692310395","state":["exists","up"]},{"osd":5,"uuid":"f37be8a2-bc4d-4e78-8bfa-3c25638c40aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6801","nonce":1549387301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6803","nonce":1549387301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6807","nonce":1549387301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6805","nonce":1549387301}]},"public_addr":"172.21.15.132:6801/1549387301","cluster_addr":"172.21.15.132:6803/1549387301","heartbeat_back_addr":"172.21.15.132:6807/1549387301","heartbeat_front_addr":"172.21.15.132:6805/1549387301","state":["exists","up"]},{"osd":6,"uuid":"cd0b6340-5c8c-42a3-a243-8844f6835578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6825","nonce":731564406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6827","nonce":731564406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6831","nonce":731564406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6829","nonce":731564406}]},"public_addr":"172.21.15.132:6825/731564406","cluster_addr":"172.21.15.132:6827/731564406","heartbeat_back_addr":"172.21.15.132:6831/731564406","heartbeat_front_addr":"172.21.15.132:6829/731564406","state":["exists","up"]},{"osd":7,"uuid":"f1b5ac52-e196-4c45-8f7b-ab90275431fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6810","nonce":251080901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6814","nonce":251080901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6823","nonce":251080901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6818","nonce":251080901}]},"public_addr":"172.21.15.132:6810/251080901","cluster_addr":"172.21.15.132:6814/251080901","heartbeat_back_addr":"172.21.15.132:6823/251080901","heartbeat_front_addr":"172.21.15.132:6818/251080901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.782366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.849444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.738463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.810770+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.780862+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.684764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.707622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.740773+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:26:19.262 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-09T14:26:19.262 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-09T14:26:19.559 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:26:19.559 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"fsid":"03df7284-17fe-4d16-b21b-e9f66257a07a","created":"2024-03-09T14:25:58.242538+0000","modified":"2024-03-09T14:26:18.566421+0000","last_up_change":"2024-03-09T14:26:10.535661+0000","last_in_change":"2024-03-09T14:26:01.605867+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-09T14:26:12.498536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-09T14:26:17.375242+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d531a182-caf7-48a3-b1c6-6b1a1d03b78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6801","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6804","nonce":2236481287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6807","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6810","nonce":2236481287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6824","nonce":2236481287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6818","nonce":2236481287}]},"public_addr":"172.21.15.88:6804/2236481287","cluster_addr":"172.21.15.88:6810/2236481287","heartbeat_back_addr":"172.21.15.88:6824/2236481287","heartbeat_front_addr":"172.21.15.88:6818/2236481287","state":["exists","up"]},{"osd":1,"uuid":"f48391d3-6559-46bc-a653-d5c3fee9d3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6805","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6809","nonce":1625923178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6817","nonce":1625923178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6831","nonce":1625923178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6826","nonce":1625923178}]},"public_addr":"172.21.15.88:6809/1625923178","cluster_addr":"172.21.15.88:6817/1625923178","heartbeat_back_addr":"172.21.15.88:6831/1625923178","heartbeat_front_addr":"172.21.15.88:6826/1625923178","state":["exists","up"]},{"osd":2,"uuid":"5fa8603b-cf11-4b51-804d-c4e50074282a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6803","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6806","nonce":583120953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6815","nonce":583120953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6827","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6830","nonce":583120953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6823","nonce":583120953}]},"public_addr":"172.21.15.88:6806/583120953","cluster_addr":"172.21.15.88:6815/583120953","heartbeat_back_addr":"172.21.15.88:6830/583120953","heartbeat_front_addr":"172.21.15.88:6823/583120953","state":["exists","up"]},{"osd":3,"uuid":"e48253bd-989b-4c33-8ef7-7653bd46398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6802","nonce":4216886240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6812","nonce":4216886240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6829","nonce":4216886240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6820","nonce":4216886240}]},"public_addr":"172.21.15.88:6802/4216886240","cluster_addr":"172.21.15.88:6812/4216886240","heartbeat_back_addr":"172.21.15.88:6829/4216886240","heartbeat_front_addr":"172.21.15.88:6820/4216886240","state":["exists","up"]},{"osd":4,"uuid":"6a17d606-dc8c-49d4-ab53-e9a159f8c6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6811","nonce":692310395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6815","nonce":692310395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6822","nonce":692310395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6819","nonce":692310395}]},"public_addr":"172.21.15.132:6811/692310395","cluster_addr":"172.21.15.132:6815/692310395","heartbeat_back_addr":"172.21.15.132:6822/692310395","heartbeat_front_addr":"172.21.15.132:6819/692310395","state":["exists","up"]},{"osd":5,"uuid":"f37be8a2-bc4d-4e78-8bfa-3c25638c40aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6801","nonce":1549387301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6803","nonce":1549387301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6807","nonce":1549387301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6805","nonce":1549387301}]},"public_addr":"172.21.15.132:6801/1549387301","cluster_addr":"172.21.15.132:6803/1549387301","heartbeat_back_addr":"172.21.15.132:6807/1549387301","heartbeat_front_addr":"172.21.15.132:6805/1549387301","state":["exists","up"]},{"osd":6,"uuid":"cd0b6340-5c8c-42a3-a243-8844f6835578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6825","nonce":731564406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6827","nonce":731564406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6831","nonce":731564406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6829","nonce":731564406}]},"public_addr":"172.21.15.132:6825/731564406","cluster_addr":"172.21.15.132:6827/731564406","heartbeat_back_addr":"172.21.15.132:6831/731564406","heartbeat_front_addr":"172.21.15.132:6829/731564406","state":["exists","up"]},{"osd":7,"uuid":"f1b5ac52-e196-4c45-8f7b-ab90275431fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6810","nonce":251080901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6814","nonce":251080901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6823","nonce":251080901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6818","nonce":251080901}]},"public_addr":"172.21.15.132:6810/251080901","cluster_addr":"172.21.15.132:6814/251080901","heartbeat_back_addr":"172.21.15.132:6823/251080901","heartbeat_front_addr":"172.21.15.132:6818/251080901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.782366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.849444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.738463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.810770+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.780862+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.684764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.707622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.740773+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:26:19.574 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-09T14:26:19.574 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-09T14:26:19.575 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-09T14:26:19.575 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-09T14:26:19.575 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-09T14:26:19.576 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-09T14:26:19.576 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-09T14:26:19.576 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-09T14:26:19.831 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-03-09T14:26:19.832 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-09T14:26:19.833 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-03-09T14:26:19.833 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-09T14:26:19.836 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-03-09T14:26:19.836 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-09T14:26:19.841 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-03-09T14:26:19.841 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-09T14:26:19.842 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-03-09T14:26:19.842 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-09T14:26:19.843 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-03-09T14:26:19.844 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-09T14:26:19.845 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-03-09T14:26:19.845 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-09T14:26:19.847 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-03-09T14:26:19.848 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-09T14:26:20.440 INFO:teuthology.orchestra.run.smithi088.stdout:55834574852 2024-03-09T14:26:20.451 INFO:teuthology.orchestra.run.smithi088.stdout:55834574852 2024-03-09T14:26:20.454 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-03-09T14:26:20.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-03-09T14:26:20.460 INFO:teuthology.orchestra.run.smithi088.stdout:55834574852 2024-03-09T14:26:20.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-03-09T14:26:20.472 INFO:teuthology.orchestra.run.smithi088.stdout:55834574852 2024-03-09T14:26:20.473 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-03-09T14:26:20.474 INFO:teuthology.orchestra.run.smithi088.stdout:55834574852 2024-03-09T14:26:20.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-03-09T14:26:20.478 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-03-09T14:26:20.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-03-09T14:26:20.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-03-09T14:26:20.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-03-09T14:26:20.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-03-09T14:26:20.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-03-09T14:26:21.461 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-09T14:26:21.471 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-09T14:26:21.479 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-09T14:26:21.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-09T14:26:21.493 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-09T14:26:21.493 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-09T14:26:21.495 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-09T14:26:21.498 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-09T14:26:22.050 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-03-09T14:26:22.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-03-09T14:26:22.070 DEBUG:teuthology.parallel:result is None 2024-03-09T14:26:22.099 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-03-09T14:26:22.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-03-09T14:26:22.112 DEBUG:teuthology.parallel:result is None 2024-03-09T14:26:22.124 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-03-09T14:26:22.124 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-03-09T14:26:22.128 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-03-09T14:26:22.130 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-03-09T14:26:22.131 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-03-09T14:26:22.141 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-03-09T14:26:22.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-03-09T14:26:22.149 DEBUG:teuthology.parallel:result is None 2024-03-09T14:26:22.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-03-09T14:26:22.150 DEBUG:teuthology.parallel:result is None 2024-03-09T14:26:22.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-03-09T14:26:22.151 DEBUG:teuthology.parallel:result is None 2024-03-09T14:26:22.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-03-09T14:26:22.154 DEBUG:teuthology.parallel:result is None 2024-03-09T14:26:22.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-03-09T14:26:22.154 DEBUG:teuthology.parallel:result is None 2024-03-09T14:26:22.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-03-09T14:26:22.157 DEBUG:teuthology.parallel:result is None 2024-03-09T14:26:22.157 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-09T14:26:22.157 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T14:26:22.492 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:26:22.493 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-03-09T14:26:22.505 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-03-09T14:26:22.474325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218908,"kb_used_data":2724,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755812,"statfs":{"total":773094113280,"available":772869951488,"internally_reserved":0,"allocated":2789376,"data_stored":1705372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.906977"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:19.845851+0000","last_change":"2024-03-09T14:26:18.578318+0000","last_active":"2024-03-09T14:26:19.845851+0000","last_peered":"2024-03-09T14:26:19.845851+0000","last_clean":"2024-03-09T14:26:19.845851+0000","last_became_active":"2024-03-09T14:26:18.577994+0000","last_became_peered":"2024-03-09T14:26:18.577994+0000","last_unstale":"2024-03-09T14:26:19.845851+0000","last_undegraded":"2024-03-09T14:26:19.845851+0000","last_fullsized":"2024-03-09T14:26:19.845851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:01:22.815335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:19.579692+0000","last_change":"2024-03-09T14:26:18.577844+0000","last_active":"2024-03-09T14:26:19.579692+0000","last_peered":"2024-03-09T14:26:19.579692+0000","last_clean":"2024-03-09T14:26:19.579692+0000","last_became_active":"2024-03-09T14:26:18.577564+0000","last_became_peered":"2024-03-09T14:26:18.577564+0000","last_unstale":"2024-03-09T14:26:19.579692+0000","last_undegraded":"2024-03-09T14:26:19.579692+0000","last_fullsized":"2024-03-09T14:26:19.579692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:23:41.274783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:21.281253+0000","last_change":"2024-03-09T14:26:18.582360+0000","last_active":"2024-03-09T14:26:21.281253+0000","last_peered":"2024-03-09T14:26:21.281253+0000","last_clean":"2024-03-09T14:26:21.281253+0000","last_became_active":"2024-03-09T14:26:18.581750+0000","last_became_peered":"2024-03-09T14:26:18.581750+0000","last_unstale":"2024-03-09T14:26:21.281253+0000","last_undegraded":"2024-03-09T14:26:21.281253+0000","last_fullsized":"2024-03-09T14:26:21.281253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:51.952352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:19.579757+0000","last_change":"2024-03-09T14:26:18.579051+0000","last_active":"2024-03-09T14:26:19.579757+0000","last_peered":"2024-03-09T14:26:19.579757+0000","last_clean":"2024-03-09T14:26:19.579757+0000","last_became_active":"2024-03-09T14:26:18.578807+0000","last_became_peered":"2024-03-09T14:26:18.578807+0000","last_unstale":"2024-03-09T14:26:19.579757+0000","last_undegraded":"2024-03-09T14:26:19.579757+0000","last_fullsized":"2024-03-09T14:26:19.579757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:16:28.179997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:19.579171+0000","last_change":"2024-03-09T14:26:18.581769+0000","last_active":"2024-03-09T14:26:19.579171+0000","last_peered":"2024-03-09T14:26:19.579171+0000","last_clean":"2024-03-09T14:26:19.579171+0000","last_became_active":"2024-03-09T14:26:18.581330+0000","last_became_peered":"2024-03-09T14:26:18.581330+0000","last_unstale":"2024-03-09T14:26:19.579171+0000","last_undegraded":"2024-03-09T14:26:19.579171+0000","last_fullsized":"2024-03-09T14:26:19.579171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:58.260466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:21.280068+0000","last_change":"2024-03-09T14:26:18.577541+0000","last_active":"2024-03-09T14:26:21.280068+0000","last_peered":"2024-03-09T14:26:21.280068+0000","last_clean":"2024-03-09T14:26:21.280068+0000","last_became_active":"2024-03-09T14:26:18.577041+0000","last_became_peered":"2024-03-09T14:26:18.577041+0000","last_unstale":"2024-03-09T14:26:21.280068+0000","last_undegraded":"2024-03-09T14:26:21.280068+0000","last_fullsized":"2024-03-09T14:26:21.280068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:35.300799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:21.281245+0000","last_change":"2024-03-09T14:26:18.582346+0000","last_active":"2024-03-09T14:26:21.281245+0000","last_peered":"2024-03-09T14:26:21.281245+0000","last_clean":"2024-03-09T14:26:21.281245+0000","last_became_active":"2024-03-09T14:26:18.581306+0000","last_became_peered":"2024-03-09T14:26:18.581306+0000","last_unstale":"2024-03-09T14:26:21.281245+0000","last_undegraded":"2024-03-09T14:26:21.281245+0000","last_fullsized":"2024-03-09T14:26:21.281245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:30.980957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:19.579141+0000","last_change":"2024-03-09T14:26:18.581955+0000","last_active":"2024-03-09T14:26:19.579141+0000","last_peered":"2024-03-09T14:26:19.579141+0000","last_clean":"2024-03-09T14:26:19.579141+0000","last_became_active":"2024-03-09T14:26:18.581598+0000","last_became_peered":"2024-03-09T14:26:18.581598+0000","last_unstale":"2024-03-09T14:26:19.579141+0000","last_undegraded":"2024-03-09T14:26:19.579141+0000","last_fullsized":"2024-03-09T14:26:19.579141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:38:36.176997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:21.281207+0000","last_change":"2024-03-09T14:26:13.798768+0000","last_active":"2024-03-09T14:26:21.281207+0000","last_peered":"2024-03-09T14:26:21.281207+0000","last_clean":"2024-03-09T14:26:21.281207+0000","last_became_active":"2024-03-09T14:26:13.797817+0000","last_became_peered":"2024-03-09T14:26:13.797817+0000","last_unstale":"2024-03-09T14:26:21.281207+0000","last_undegraded":"2024-03-09T14:26:21.281207+0000","last_fullsized":"2024-03-09T14:26:21.281207+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_clean_scrub_stamp":"2024-03-09T14:26:12.541311+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:56:57.729803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":786432,"data_stored":652355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":61987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":61987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":658103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T14:26:22.505 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T14:26:22.800 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:26:22.800 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-03-09T14:26:22.812 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-03-09T14:26:22.474325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218908,"kb_used_data":2724,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755812,"statfs":{"total":773094113280,"available":772869951488,"internally_reserved":0,"allocated":2789376,"data_stored":1705372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.906977"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:19.845851+0000","last_change":"2024-03-09T14:26:18.578318+0000","last_active":"2024-03-09T14:26:19.845851+0000","last_peered":"2024-03-09T14:26:19.845851+0000","last_clean":"2024-03-09T14:26:19.845851+0000","last_became_active":"2024-03-09T14:26:18.577994+0000","last_became_peered":"2024-03-09T14:26:18.577994+0000","last_unstale":"2024-03-09T14:26:19.845851+0000","last_undegraded":"2024-03-09T14:26:19.845851+0000","last_fullsized":"2024-03-09T14:26:19.845851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:01:22.815335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:19.579692+0000","last_change":"2024-03-09T14:26:18.577844+0000","last_active":"2024-03-09T14:26:19.579692+0000","last_peered":"2024-03-09T14:26:19.579692+0000","last_clean":"2024-03-09T14:26:19.579692+0000","last_became_active":"2024-03-09T14:26:18.577564+0000","last_became_peered":"2024-03-09T14:26:18.577564+0000","last_unstale":"2024-03-09T14:26:19.579692+0000","last_undegraded":"2024-03-09T14:26:19.579692+0000","last_fullsized":"2024-03-09T14:26:19.579692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:23:41.274783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:21.281253+0000","last_change":"2024-03-09T14:26:18.582360+0000","last_active":"2024-03-09T14:26:21.281253+0000","last_peered":"2024-03-09T14:26:21.281253+0000","last_clean":"2024-03-09T14:26:21.281253+0000","last_became_active":"2024-03-09T14:26:18.581750+0000","last_became_peered":"2024-03-09T14:26:18.581750+0000","last_unstale":"2024-03-09T14:26:21.281253+0000","last_undegraded":"2024-03-09T14:26:21.281253+0000","last_fullsized":"2024-03-09T14:26:21.281253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:51.952352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:19.579757+0000","last_change":"2024-03-09T14:26:18.579051+0000","last_active":"2024-03-09T14:26:19.579757+0000","last_peered":"2024-03-09T14:26:19.579757+0000","last_clean":"2024-03-09T14:26:19.579757+0000","last_became_active":"2024-03-09T14:26:18.578807+0000","last_became_peered":"2024-03-09T14:26:18.578807+0000","last_unstale":"2024-03-09T14:26:19.579757+0000","last_undegraded":"2024-03-09T14:26:19.579757+0000","last_fullsized":"2024-03-09T14:26:19.579757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:16:28.179997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:19.579171+0000","last_change":"2024-03-09T14:26:18.581769+0000","last_active":"2024-03-09T14:26:19.579171+0000","last_peered":"2024-03-09T14:26:19.579171+0000","last_clean":"2024-03-09T14:26:19.579171+0000","last_became_active":"2024-03-09T14:26:18.581330+0000","last_became_peered":"2024-03-09T14:26:18.581330+0000","last_unstale":"2024-03-09T14:26:19.579171+0000","last_undegraded":"2024-03-09T14:26:19.579171+0000","last_fullsized":"2024-03-09T14:26:19.579171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:58.260466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:21.280068+0000","last_change":"2024-03-09T14:26:18.577541+0000","last_active":"2024-03-09T14:26:21.280068+0000","last_peered":"2024-03-09T14:26:21.280068+0000","last_clean":"2024-03-09T14:26:21.280068+0000","last_became_active":"2024-03-09T14:26:18.577041+0000","last_became_peered":"2024-03-09T14:26:18.577041+0000","last_unstale":"2024-03-09T14:26:21.280068+0000","last_undegraded":"2024-03-09T14:26:21.280068+0000","last_fullsized":"2024-03-09T14:26:21.280068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:35.300799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:21.281245+0000","last_change":"2024-03-09T14:26:18.582346+0000","last_active":"2024-03-09T14:26:21.281245+0000","last_peered":"2024-03-09T14:26:21.281245+0000","last_clean":"2024-03-09T14:26:21.281245+0000","last_became_active":"2024-03-09T14:26:18.581306+0000","last_became_peered":"2024-03-09T14:26:18.581306+0000","last_unstale":"2024-03-09T14:26:21.281245+0000","last_undegraded":"2024-03-09T14:26:21.281245+0000","last_fullsized":"2024-03-09T14:26:21.281245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:30.980957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:19.579141+0000","last_change":"2024-03-09T14:26:18.581955+0000","last_active":"2024-03-09T14:26:19.579141+0000","last_peered":"2024-03-09T14:26:19.579141+0000","last_clean":"2024-03-09T14:26:19.579141+0000","last_became_active":"2024-03-09T14:26:18.581598+0000","last_became_peered":"2024-03-09T14:26:18.581598+0000","last_unstale":"2024-03-09T14:26:19.579141+0000","last_undegraded":"2024-03-09T14:26:19.579141+0000","last_fullsized":"2024-03-09T14:26:19.579141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:38:36.176997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:26:21.281207+0000","last_change":"2024-03-09T14:26:13.798768+0000","last_active":"2024-03-09T14:26:21.281207+0000","last_peered":"2024-03-09T14:26:21.281207+0000","last_clean":"2024-03-09T14:26:21.281207+0000","last_became_active":"2024-03-09T14:26:13.797817+0000","last_became_peered":"2024-03-09T14:26:13.797817+0000","last_unstale":"2024-03-09T14:26:21.281207+0000","last_undegraded":"2024-03-09T14:26:21.281207+0000","last_fullsized":"2024-03-09T14:26:21.281207+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_clean_scrub_stamp":"2024-03-09T14:26:12.541311+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:56:57.729803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":786432,"data_stored":652355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":61987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":61987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":658103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T14:26:22.813 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-09T14:26:22.813 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-09T14:26:22.813 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-09T14:26:22.813 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-09T14:26:23.145 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:26:23.145 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-09T14:26:23.157 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-09T14:26:23.158 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-03-09T14:26:23.169 INFO:teuthology.run_tasks:Running task rgw... 2024-03-09T14:26:23.182 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-03-09T14:26:23.182 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-03-09T14:26:23.182 INFO:tasks.rgw:Creating data pools 2024-03-09T14:26:23.182 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-03-09T14:26:23.182 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-03-09T14:26:23.609 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-03-09T14:26:25.609 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'default.rgw.buckets.data' created 2024-03-09T14:26:25.633 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-03-09T14:26:26.619 INFO:teuthology.orchestra.run.smithi088.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-03-09T14:26:26.648 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-03-09T14:26:27.622 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'default.rgw.buckets.index' created 2024-03-09T14:26:27.645 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-03-09T14:26:28.635 INFO:teuthology.orchestra.run.smithi088.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-03-09T14:26:28.668 DEBUG:tasks.rgw:Pools created 2024-03-09T14:26:28.668 INFO:tasks.rgw:Configuring compression type = random 2024-03-09T14:26:28.668 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-03-09T14:26:28.668 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-03-09T14:26:28.669 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-03-09T14:26:28.846 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:26:28.846 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:26:30.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.885+0000 7f27ab3cd640 0 -- 172.21.15.88:0/1296975345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55826212e400 msgr2=0x55826212e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:26:30.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.888+0000 7f27aabcc640 0 -- 172.21.15.88:0/2418240188 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55826213b500 msgr2=0x55826213b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:26:30.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.892+0000 7f27af40f800 20 rados->read ofs=0 len=0 2024-03-09T14:26:30.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.894+0000 7f27af40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:26:30.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.894+0000 7f27af40f800 20 realm 2024-03-09T14:26:30.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.894+0000 7f27af40f800 20 rados->read ofs=0 len=0 2024-03-09T14:26:30.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.894+0000 7f27af40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:26:30.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.894+0000 7f27af40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:26:30.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.894+0000 7f27af40f800 20 rados->read ofs=0 len=0 2024-03-09T14:26:30.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.895+0000 7f27af40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:26:30.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.895+0000 7f27af40f800 20 rados->read ofs=0 len=0 2024-03-09T14:26:30.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.896+0000 7f27af40f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:26:30.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.896+0000 7f27af40f800 20 rados->read ofs=0 len=0 2024-03-09T14:26:30.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.897+0000 7f27af40f800 20 rados_obj.operate() r=0 bl.length=957 2024-03-09T14:26:30.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.897+0000 7f27af40f800 20 searching for the correct realm 2024-03-09T14:26:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.909+0000 7f27af40f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:26:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.909+0000 7f27af40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:26:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.909+0000 7f27af40f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:26:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.909+0000 7f27af40f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:26:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.909+0000 7f27af40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:26:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.909+0000 7f27af40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:26:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.909+0000 7f27af40f800 20 rados->read ofs=0 len=0 2024-03-09T14:26:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.909+0000 7f27af40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:26:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.909+0000 7f27af40f800 20 rados->read ofs=0 len=0 2024-03-09T14:26:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.910+0000 7f27af40f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:26:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.910+0000 7f27af40f800 20 rados->read ofs=0 len=0 2024-03-09T14:26:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.911+0000 7f27af40f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-09T14:26:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.911+0000 7f27af40f800 20 zone default found 2024-03-09T14:26:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.911+0000 7f27af40f800 4 Realm: () 2024-03-09T14:26:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.911+0000 7f27af40f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:26:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.911+0000 7f27af40f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:26:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.911+0000 7f27af40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:26:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.911+0000 7f27af40f800 20 zonegroup default 2024-03-09T14:26:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.911+0000 7f27af40f800 20 rados->read ofs=0 len=0 2024-03-09T14:26:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.912+0000 7f27af40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:26:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:30.912+0000 7f27af40f800 20 rados->read ofs=0 len=0 2024-03-09T14:26:32.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:32.654+0000 7f27af40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:26:32.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:32.655+0000 7f27af40f800 20 rados->read ofs=0 len=0 2024-03-09T14:26:32.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:32.655+0000 7f27af40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:26:32.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:32.655+0000 7f27af40f800 20 started sync module instance, tier type = 2024-03-09T14:26:32.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:32.655+0000 7f27af40f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:26:34.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.691+0000 7f27af40f800 20 add_watcher() i=0 2024-03-09T14:26:34.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.691+0000 7f27af40f800 20 add_watcher() i=1 2024-03-09T14:26:34.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.691+0000 7f27af40f800 20 add_watcher() i=2 2024-03-09T14:26:34.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.691+0000 7f27af40f800 20 add_watcher() i=3 2024-03-09T14:26:34.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.691+0000 7f27af40f800 20 add_watcher() i=4 2024-03-09T14:26:34.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.691+0000 7f27af40f800 20 add_watcher() i=5 2024-03-09T14:26:34.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.691+0000 7f27af40f800 20 add_watcher() i=6 2024-03-09T14:26:34.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.692+0000 7f27af40f800 20 add_watcher() i=7 2024-03-09T14:26:34.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.692+0000 7f27af40f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:26:34.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.692+0000 7f27af40f800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-03-09T14:26:34.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.692+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-03-09T14:26:34.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.692+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.693+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-03-09T14:26:34.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.693+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-03-09T14:26:34.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.693+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.693+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-03-09T14:26:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.693+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-03-09T14:26:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.693+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.693+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-03-09T14:26:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.693+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-03-09T14:26:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.693+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.694+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-03-09T14:26:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.694+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-03-09T14:26:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.694+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.694+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-03-09T14:26:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.694+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-03-09T14:26:34.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.694+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.694+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-03-09T14:26:34.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.694+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-03-09T14:26:34.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.694+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.695+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-03-09T14:26:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.695+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-03-09T14:26:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.695+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.695+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-03-09T14:26:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.695+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-03-09T14:26:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.695+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.695+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-03-09T14:26:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.695+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-03-09T14:26:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.695+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.695+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-03-09T14:26:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.695+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-03-09T14:26:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.695+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.696+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-03-09T14:26:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.696+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-03-09T14:26:34.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.696+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.696+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-03-09T14:26:34.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.696+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-03-09T14:26:34.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.696+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.696+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-03-09T14:26:34.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.696+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-03-09T14:26:34.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.696+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.696+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-03-09T14:26:34.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.696+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-03-09T14:26:34.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.696+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.697+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-03-09T14:26:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.697+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-03-09T14:26:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.697+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.697+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-03-09T14:26:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.697+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-03-09T14:26:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.697+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.697+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-03-09T14:26:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.697+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-03-09T14:26:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.697+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.697+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-03-09T14:26:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.697+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-03-09T14:26:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.697+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.698+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-03-09T14:26:34.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.698+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-03-09T14:26:34.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.698+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.698+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-03-09T14:26:34.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.698+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-03-09T14:26:34.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.698+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.698+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-03-09T14:26:34.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.698+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-03-09T14:26:34.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.698+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.698+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-03-09T14:26:34.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.698+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-03-09T14:26:34.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.698+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.699+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-03-09T14:26:34.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.699+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-03-09T14:26:34.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.699+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.699+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-03-09T14:26:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.699+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-03-09T14:26:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.699+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.699+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-03-09T14:26:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.699+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-03-09T14:26:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.699+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.699+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-03-09T14:26:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.699+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-03-09T14:26:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.699+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.699+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-03-09T14:26:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.699+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-03-09T14:26:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.699+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.700+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-03-09T14:26:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.700+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-03-09T14:26:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.700+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.700+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-03-09T14:26:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.700+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-03-09T14:26:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.700+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.700+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-03-09T14:26:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.700+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-03-09T14:26:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.700+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.701+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-03-09T14:26:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.701+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-03-09T14:26:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.701+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.701+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-03-09T14:26:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.701+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-03-09T14:26:34.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.701+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.701+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-03-09T14:26:34.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.701+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-03-09T14:26:34.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.701+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.701+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-03-09T14:26:34.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.701+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-03-09T14:26:34.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.701+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.701+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-03-09T14:26:34.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.701+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-03-09T14:26:34.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.701+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.702+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-03-09T14:26:34.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.702+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-03-09T14:26:34.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.702+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.702+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-03-09T14:26:34.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.702+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-03-09T14:26:34.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.702+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.702+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-03-09T14:26:34.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.702+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-03-09T14:26:34.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.702+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.702+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-03-09T14:26:34.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.702+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-03-09T14:26:34.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.702+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.702+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-03-09T14:26:34.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.702+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-03-09T14:26:34.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.702+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.703+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-03-09T14:26:34.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.703+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-03-09T14:26:34.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.703+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.703+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-03-09T14:26:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.703+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-03-09T14:26:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.703+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.704+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-03-09T14:26:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.704+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-03-09T14:26:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.704+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.704+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-03-09T14:26:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.704+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-03-09T14:26:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.704+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.704+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-03-09T14:26:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.704+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-03-09T14:26:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.704+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.704+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-03-09T14:26:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.704+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-03-09T14:26:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.704+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.704+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-03-09T14:26:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.704+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-03-09T14:26:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.704+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.705+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-03-09T14:26:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.705+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-03-09T14:26:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.705+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.705+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-03-09T14:26:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.705+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-03-09T14:26:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.705+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.705+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-03-09T14:26:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.705+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-03-09T14:26:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.705+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.705+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-03-09T14:26:34.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.706+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-03-09T14:26:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.706+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.706+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-03-09T14:26:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.706+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-03-09T14:26:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.706+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.706+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-03-09T14:26:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.706+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-03-09T14:26:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.706+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.706+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-03-09T14:26:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.706+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-03-09T14:26:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.706+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.706+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-03-09T14:26:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.706+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-03-09T14:26:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.706+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.707+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-03-09T14:26:34.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.707+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-03-09T14:26:34.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.707+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.707+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-03-09T14:26:34.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.707+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-03-09T14:26:34.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.707+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.707+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-03-09T14:26:34.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.707+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-03-09T14:26:34.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.707+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.707+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-03-09T14:26:34.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.707+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-03-09T14:26:34.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.707+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.708+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-03-09T14:26:34.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.708+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-03-09T14:26:34.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.708+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.708+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-03-09T14:26:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.708+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-03-09T14:26:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.708+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.708+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-03-09T14:26:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.708+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-03-09T14:26:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.708+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.708+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-03-09T14:26:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.708+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-03-09T14:26:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.708+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.709+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-03-09T14:26:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.709+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-03-09T14:26:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.709+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.709+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-03-09T14:26:34.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.709+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-03-09T14:26:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.709+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.709+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-03-09T14:26:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.709+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-03-09T14:26:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.709+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.709+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-03-09T14:26:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.709+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-03-09T14:26:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.709+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.709+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-03-09T14:26:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.709+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-03-09T14:26:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.709+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.710+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-03-09T14:26:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.710+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-03-09T14:26:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.710+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.710+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-03-09T14:26:34.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.710+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-03-09T14:26:34.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.710+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.710+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-03-09T14:26:34.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.710+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-03-09T14:26:34.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.710+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.710+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-03-09T14:26:34.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.710+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-03-09T14:26:34.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.710+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.711+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-03-09T14:26:34.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.711+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-03-09T14:26:34.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.711+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.711+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-03-09T14:26:34.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.711+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-03-09T14:26:34.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.711+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.711+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-03-09T14:26:34.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.711+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-03-09T14:26:34.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.711+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.712+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-03-09T14:26:34.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.712+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-03-09T14:26:34.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.712+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.712+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-03-09T14:26:34.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.712+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-03-09T14:26:34.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.712+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.712+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-03-09T14:26:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.712+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-03-09T14:26:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.712+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.712+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-03-09T14:26:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.712+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-03-09T14:26:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.712+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.713+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-03-09T14:26:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.713+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-03-09T14:26:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.713+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.713+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-03-09T14:26:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.713+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-03-09T14:26:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.713+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.713+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-03-09T14:26:34.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.713+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-03-09T14:26:34.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.713+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.713+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-03-09T14:26:34.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.713+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-03-09T14:26:34.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.713+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.714+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-03-09T14:26:34.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.714+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-03-09T14:26:34.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.714+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.714+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-03-09T14:26:34.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.714+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-03-09T14:26:34.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.714+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.714+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-03-09T14:26:34.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.714+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-03-09T14:26:34.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.714+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.714+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-03-09T14:26:34.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.714+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-03-09T14:26:34.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.714+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.715+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-03-09T14:26:34.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.715+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-03-09T14:26:34.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.715+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.715+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-03-09T14:26:34.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.715+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-03-09T14:26:34.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.715+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.715+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-03-09T14:26:34.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.715+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-03-09T14:26:34.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.715+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.715+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-03-09T14:26:34.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.715+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-03-09T14:26:34.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.715+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.715+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-03-09T14:26:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.715+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-03-09T14:26:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.715+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.716+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-03-09T14:26:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.716+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-03-09T14:26:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.716+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.716+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-03-09T14:26:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.716+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-03-09T14:26:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.716+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.716+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-03-09T14:26:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.716+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-03-09T14:26:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.716+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.716+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-03-09T14:26:34.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.716+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-03-09T14:26:34.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.716+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.717+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-03-09T14:26:34.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.717+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-03-09T14:26:34.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.717+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.717+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-03-09T14:26:34.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.717+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-03-09T14:26:34.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.717+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.717+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-03-09T14:26:34.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.717+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-03-09T14:26:34.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.717+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.717+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-03-09T14:26:34.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.717+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-03-09T14:26:34.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.717+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.718+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-03-09T14:26:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.718+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-03-09T14:26:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.718+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.718+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-03-09T14:26:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.718+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-03-09T14:26:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.718+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.718+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-03-09T14:26:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.718+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-03-09T14:26:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.718+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.718+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-03-09T14:26:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.718+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-03-09T14:26:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.718+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.719+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-03-09T14:26:34.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.719+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-03-09T14:26:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.719+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.719+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-03-09T14:26:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.719+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-03-09T14:26:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.719+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.719+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-03-09T14:26:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.719+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-03-09T14:26:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.719+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.719+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-03-09T14:26:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.719+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-03-09T14:26:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.719+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.720+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-03-09T14:26:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.720+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-03-09T14:26:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.720+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.720+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-03-09T14:26:34.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.720+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-03-09T14:26:34.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.720+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.720+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-03-09T14:26:34.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.720+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-03-09T14:26:34.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.720+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.720+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-03-09T14:26:34.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.720+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-03-09T14:26:34.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.720+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.721+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-03-09T14:26:34.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.721+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-03-09T14:26:34.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.721+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.721+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-03-09T14:26:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.721+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-03-09T14:26:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.721+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.721+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-03-09T14:26:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.721+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-03-09T14:26:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.721+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.721+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-03-09T14:26:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.721+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-03-09T14:26:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.721+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.722+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-03-09T14:26:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.722+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-03-09T14:26:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.722+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.722+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-03-09T14:26:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.722+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-03-09T14:26:34.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.722+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.722+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.722+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.722+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.722+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.722+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.722+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.723+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.723+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.723+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.723+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.723+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.723+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.723+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.723+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.723+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.723+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-03-09T14:26:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.723+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-03-09T14:26:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.723+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.724+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-03-09T14:26:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.724+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-03-09T14:26:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.724+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.724+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-03-09T14:26:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.724+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-03-09T14:26:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.724+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.724+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-03-09T14:26:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.724+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-03-09T14:26:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.724+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.725+0000 7f27af40f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-03-09T14:26:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.725+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-03-09T14:26:34.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.726+0000 7f27af40f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:26:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.730+0000 7f26597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:26:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.730+0000 7f27af40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:26:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:34.730+0000 7f27af40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:26:37.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.663+0000 7f27af40f800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-03-09T14:26:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.663+0000 7f27af40f800 5 note: GC not initialized 2024-03-09T14:26:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.664+0000 7f27af40f800 20 init_complete bucket index max shards: 11 2024-03-09T14:26:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.664+0000 7f27af40f800 20 Filter name: none 2024-03-09T14:26:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.664+0000 7f25c1ffb640 20 reqs_thread_entry: start 2024-03-09T14:26:37.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.664+0000 7f25c3fff640 20 reqs_thread_entry: start 2024-03-09T14:26:37.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.689+0000 7f26597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:26:37.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.692+0000 7f27af40f800 20 remove_watcher() i=0 2024-03-09T14:26:37.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.692+0000 7f27af40f800 2 removed watcher, disabling cache 2024-03-09T14:26:37.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.693+0000 7f27af40f800 20 remove_watcher() i=1 2024-03-09T14:26:37.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.694+0000 7f27af40f800 20 remove_watcher() i=2 2024-03-09T14:26:37.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.698+0000 7f27af40f800 20 remove_watcher() i=3 2024-03-09T14:26:37.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.699+0000 7f27af40f800 20 remove_watcher() i=4 2024-03-09T14:26:37.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.700+0000 7f27af40f800 20 remove_watcher() i=5 2024-03-09T14:26:37.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.702+0000 7f27af40f800 20 remove_watcher() i=6 2024-03-09T14:26:37.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:37.703+0000 7f27af40f800 20 remove_watcher() i=7 2024-03-09T14:26:38.035 INFO:teuthology.orchestra.run.smithi088.stdout:[] 2024-03-09T14:26:38.035 DEBUG:tasks.util.rgw: json result: [] 2024-03-09T14:26:38.035 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-03-09T14:26:38.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-03-09T14:26:38.036 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-03-09T14:26:38.102 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:26:38.102 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:26:38.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.127+0000 7fb4c5f30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:26:38.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.127+0000 7fb4c5f30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:26:38.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.131+0000 7fb2f7fff640 20 reqs_thread_entry: start 2024-03-09T14:26:38.348 INFO:teuthology.orchestra.run.smithi088.stdout:{"id":"5d93e872-363b-498b-b665-658644296b85","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups"} 2024-03-09T14:26:38.349 DEBUG:tasks.util.rgw: json result: {'id': '5d93e872-363b-498b-b665-658644296b85', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups'} 2024-03-09T14:26:38.349 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-03-09T14:26:38.349 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-03-09T14:26:38.349 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-03-09T14:26:38.406 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:26:38.406 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:26:38.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.438+0000 7f70a90c0800 20 rados->read ofs=0 len=0 2024-03-09T14:26:38.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.439+0000 7f70a90c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:26:38.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.439+0000 7f70a90c0800 20 realm 2024-03-09T14:26:38.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.439+0000 7f70a90c0800 20 rados->read ofs=0 len=0 2024-03-09T14:26:38.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.439+0000 7f70a90c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:26:38.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.439+0000 7f70a90c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:26:38.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.439+0000 7f70a90c0800 20 rados->read ofs=0 len=0 2024-03-09T14:26:38.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.439+0000 7f70a90c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:26:38.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.439+0000 7f70a90c0800 20 rados->read ofs=0 len=0 2024-03-09T14:26:38.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.441+0000 7f70a90c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:26:38.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.441+0000 7f70a90c0800 20 rados->read ofs=0 len=0 2024-03-09T14:26:38.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.441+0000 7f70a90c0800 20 rados_obj.operate() r=0 bl.length=973 2024-03-09T14:26:38.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.441+0000 7f70a90c0800 20 searching for the correct realm 2024-03-09T14:26:38.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.444+0000 7f70a73c4640 0 -- 172.21.15.88:0/684597281 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f70a001b040 msgr2=0x7f70a002d520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:26:38.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.650+0000 7f70a63c2640 0 -- 172.21.15.88:0/684597281 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f70a0032420 msgr2=0x7f70a00328a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:26:38.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.857+0000 7f70a90c0800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:26:38.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.857+0000 7f70a90c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:26:38.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.857+0000 7f70a90c0800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:26:38.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.857+0000 7f70a90c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:26:38.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.857+0000 7f70a90c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:26:38.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.857+0000 7f70a90c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:26:38.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.857+0000 7f70a90c0800 20 rados->read ofs=0 len=0 2024-03-09T14:26:38.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.858+0000 7f70a90c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:26:38.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.858+0000 7f70a90c0800 20 rados->read ofs=0 len=0 2024-03-09T14:26:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.858+0000 7f70a90c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:26:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.858+0000 7f70a90c0800 20 rados->read ofs=0 len=0 2024-03-09T14:26:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.859+0000 7f70a90c0800 20 rados_obj.operate() r=0 bl.length=398 2024-03-09T14:26:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.859+0000 7f70a90c0800 20 zone default found 2024-03-09T14:26:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.859+0000 7f70a90c0800 4 Realm: () 2024-03-09T14:26:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.859+0000 7f70a90c0800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:26:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.859+0000 7f70a90c0800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:26:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.859+0000 7f70a90c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:26:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.859+0000 7f70a90c0800 20 zonegroup default 2024-03-09T14:26:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.859+0000 7f70a90c0800 20 rados->read ofs=0 len=0 2024-03-09T14:26:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.859+0000 7f70a90c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:26:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.859+0000 7f70a90c0800 20 rados->read ofs=0 len=0 2024-03-09T14:26:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.859+0000 7f70a90c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:26:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.859+0000 7f70a90c0800 20 rados->read ofs=0 len=0 2024-03-09T14:26:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.859+0000 7f70a90c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:26:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.859+0000 7f70a90c0800 20 started sync module instance, tier type = 2024-03-09T14:26:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.860+0000 7f70a90c0800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:26:38.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.883+0000 7f70a90c0800 20 add_watcher() i=0 2024-03-09T14:26:38.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.883+0000 7f70a90c0800 20 add_watcher() i=1 2024-03-09T14:26:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.883+0000 7f70a90c0800 20 add_watcher() i=2 2024-03-09T14:26:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.883+0000 7f70a90c0800 20 add_watcher() i=3 2024-03-09T14:26:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.883+0000 7f70a90c0800 20 add_watcher() i=4 2024-03-09T14:26:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.883+0000 7f70a90c0800 20 add_watcher() i=5 2024-03-09T14:26:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.883+0000 7f70a90c0800 20 add_watcher() i=6 2024-03-09T14:26:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.884+0000 7f70a90c0800 20 add_watcher() i=7 2024-03-09T14:26:38.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.884+0000 7f70a90c0800 2 all 8 watchers are set, enabling cache 2024-03-09T14:26:38.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.886+0000 7f6f5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:26:38.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.886+0000 7f70a90c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:26:38.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.886+0000 7f70a90c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:26:38.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.886+0000 7f70a90c0800 5 note: GC not initialized 2024-03-09T14:26:38.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.886+0000 7f6ed7fff640 20 reqs_thread_entry: start 2024-03-09T14:26:38.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.886+0000 7f70a90c0800 20 init_complete bucket index max shards: 11 2024-03-09T14:26:38.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.886+0000 7f70a90c0800 20 Filter name: none 2024-03-09T14:26:38.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.886+0000 7f6ed5ffb640 20 reqs_thread_entry: start 2024-03-09T14:26:38.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.898+0000 7f6f5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:26:38.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.900+0000 7f70a90c0800 20 remove_watcher() i=0 2024-03-09T14:26:38.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.900+0000 7f70a90c0800 2 removed watcher, disabling cache 2024-03-09T14:26:38.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.904+0000 7f70a90c0800 20 remove_watcher() i=1 2024-03-09T14:26:38.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.905+0000 7f70a90c0800 20 remove_watcher() i=2 2024-03-09T14:26:38.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.906+0000 7f70a90c0800 20 remove_watcher() i=3 2024-03-09T14:26:38.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.907+0000 7f70a90c0800 20 remove_watcher() i=4 2024-03-09T14:26:38.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.908+0000 7f70a90c0800 20 remove_watcher() i=5 2024-03-09T14:26:38.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.911+0000 7f70a90c0800 20 remove_watcher() i=6 2024-03-09T14:26:38.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:38.912+0000 7f70a90c0800 20 remove_watcher() i=7 2024-03-09T14:26:38.921 INFO:teuthology.orchestra.run.smithi088.stdout:[] 2024-03-09T14:26:38.921 DEBUG:tasks.util.rgw: json result: [] 2024-03-09T14:26:38.921 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-03-09T14:26:38.922 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-03-09T14:26:38.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-03-09T14:26:38.922 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-03-09T14:26:38.980 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:26:38.980 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:26:39.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:39.003+0000 7fa355f3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:26:39.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:39.003+0000 7fa355f3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:26:39.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:39.006+0000 7fa187fff640 20 reqs_thread_entry: start 2024-03-09T14:26:39.019 INFO:teuthology.orchestra.run.smithi088.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-03-09T14:26:39.019 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-03-09T14:26:39.019 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-03-09T14:26:39.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-03-09T14:26:39.020 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-03-09T14:26:39.080 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:26:39.080 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:26:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:39.103+0000 7f84eb824800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:26:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:39.103+0000 7f84eb824800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:26:39.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:39.106+0000 7f83277fe640 20 reqs_thread_entry: start 2024-03-09T14:26:39.123 INFO:teuthology.orchestra.run.smithi088.stdout:{"id":"5d93e872-363b-498b-b665-658644296b85","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups"} 2024-03-09T14:26:39.123 DEBUG:tasks.util.rgw: json result: {'id': '5d93e872-363b-498b-b665-658644296b85', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups'} 2024-03-09T14:26:39.124 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-03-09T14:26:39.124 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-03-09T14:26:39.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-03-09T14:26:39.124 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-03-09T14:26:39.183 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:26:39.183 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:26:39.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:39.206+0000 7fc1e660f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:26:39.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:39.206+0000 7fc1e660f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:26:39.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:39.209+0000 7fc017fff640 20 reqs_thread_entry: start 2024-03-09T14:26:39.222 INFO:teuthology.orchestra.run.smithi088.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-03-09T14:26:39.222 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-03-09T14:26:39.222 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-03-09T14:26:39.222 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-03-09T14:26:39.223 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-03-09T14:26:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:26:39.283 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:26:39.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:39.305+0000 7fb6039a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:26:39.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:39.305+0000 7fb6039a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:26:39.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:26:39.309+0000 7fb43f7fe640 20 reqs_thread_entry: start 2024-03-09T14:26:39.323 INFO:teuthology.orchestra.run.smithi088.stdout:{"id":"5d93e872-363b-498b-b665-658644296b85","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups"} 2024-03-09T14:26:39.324 DEBUG:tasks.util.rgw: json result: {'id': '5d93e872-363b-498b-b665-658644296b85', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups'} 2024-03-09T14:26:39.324 INFO:tasks.rgw:Starting rgw... 2024-03-09T14:26:39.324 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-03-09T14:26:39.324 INFO:tasks.rgw:Using beast as radosgw frontend 2024-03-09T14:26:39.324 DEBUG:teuthology.orchestra.run.smithi088:> sudo echo -n http://smithi088.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-03-09T14:26:39.365 INFO:teuthology.orchestra.run.smithi088.stdout:http://smithi088.front.sepia.ceph.com:80 2024-03-09T14:26:39.365 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-03-09T14:26:39.445 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-03-09T14:26:39.445 INFO:tasks.rgw.client.0:Restarting daemon 2024-03-09T14:26:39.446 DEBUG:teuthology.orchestra.run.smithi088:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-03-09T14:26:39.488 INFO:tasks.rgw.client.0:Started 2024-03-09T14:26:39.488 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi088.front.sepia.ceph.com:80/ 2024-03-09T14:26:39.488 DEBUG:teuthology.orchestra.run.smithi088:> curl http://smithi088.front.sepia.ceph.com:80/ 2024-03-09T14:26:39.569 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-09T14:26:39.570 INFO:teuthology.orchestra.run.smithi088.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-09T14:26:39.570 INFO:teuthology.orchestra.run.smithi088.stderr: Dload Upload Total Spent Left Speed 2024-03-09T14:26:39.570 INFO:teuthology.orchestra.run.smithi088.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-09T14:26:39.570 INFO:teuthology.orchestra.run.smithi088.stderr:curl: (7) Failed to connect to smithi088.front.sepia.ceph.com port 80: Connection refused 2024-03-09T14:26:40.571 DEBUG:teuthology.orchestra.run.smithi088:> curl http://smithi088.front.sepia.ceph.com:80/ 2024-03-09T14:26:40.602 INFO:teuthology.orchestra.run.smithi088.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-09T14:26:40.602 INFO:teuthology.orchestra.run.smithi088.stderr: Dload Upload Total Spent Left Speed 2024-03-09T14:26:40.602 INFO:teuthology.orchestra.run.smithi088.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-09T14:26:40.603 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-09T14:26:40.603 INFO:teuthology.orchestra.run.smithi088.stderr:curl: (7) Failed to connect to smithi088.front.sepia.ceph.com port 80: Connection refused 2024-03-09T14:26:42.605 DEBUG:teuthology.orchestra.run.smithi088:> curl http://smithi088.front.sepia.ceph.com:80/ 2024-03-09T14:26:42.635 INFO:teuthology.orchestra.run.smithi088.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-09T14:26:42.636 INFO:teuthology.orchestra.run.smithi088.stderr: Dload Upload Total Spent Left Speed 2024-03-09T14:26:42.637 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-09T14:26:42.638 INFO:teuthology.orchestra.run.smithi088.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-09T14:26:42.638 INFO:teuthology.orchestra.run.smithi088.stderr:curl: (7) Failed to connect to smithi088.front.sepia.ceph.com port 80: Connection refused 2024-03-09T14:26:46.639 DEBUG:teuthology.orchestra.run.smithi088:> curl http://smithi088.front.sepia.ceph.com:80/ 2024-03-09T14:26:46.670 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-09T14:26:46.671 INFO:teuthology.orchestra.run.smithi088.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-09T14:26:46.671 INFO:teuthology.orchestra.run.smithi088.stderr: Dload Upload Total Spent Left Speed 2024-03-09T14:26:46.671 INFO:teuthology.orchestra.run.smithi088.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-09T14:26:46.671 INFO:teuthology.orchestra.run.smithi088.stderr:curl: (7) Failed to connect to smithi088.front.sepia.ceph.com port 80: Connection refused 2024-03-09T14:26:54.672 DEBUG:teuthology.orchestra.run.smithi088:> curl http://smithi088.front.sepia.ceph.com:80/ 2024-03-09T14:26:54.704 INFO:teuthology.orchestra.run.smithi088.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-09T14:26:54.704 INFO:teuthology.orchestra.run.smithi088.stderr: Dload Upload Total Spent Left Speed 2024-03-09T14:26:54.704 INFO:teuthology.orchestra.run.smithi088.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-09T14:26:54.705 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-09T14:26:54.705 INFO:teuthology.orchestra.run.smithi088.stderr:curl: (7) Failed to connect to smithi088.front.sepia.ceph.com port 80: Connection refused 2024-03-09T14:27:10.706 DEBUG:teuthology.orchestra.run.smithi088:> curl http://smithi088.front.sepia.ceph.com:80/ 2024-03-09T14:27:10.743 INFO:teuthology.orchestra.run.smithi088.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-09T14:27:10.743 INFO:teuthology.orchestra.run.smithi088.stderr: Dload Upload Total Spent Left Speed 2024-03-09T14:27:11.056 INFO:teuthology.orchestra.run.smithi088.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 599 0 --:--:-- --:--:-- --:--:-- 599 2024-03-09T14:27:11.056 INFO:teuthology.orchestra.run.smithi088.stdout:anonymous 2024-03-09T14:27:11.056 INFO:teuthology.run_tasks:Running task tox... 2024-03-09T14:27:11.067 INFO:tasks.tox:Deploying tox from pip... 2024-03-09T14:27:11.067 DEBUG:teuthology.orchestra.run.smithi088:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-03-09T14:27:13.515 DEBUG:teuthology.orchestra.run.smithi088:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-03-09T14:27:14.057 INFO:teuthology.orchestra.run.smithi088.stdout:Collecting tox==3.15.0 2024-03-09T14:27:14.149 INFO:teuthology.orchestra.run.smithi088.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-03-09T14:27:14.315 INFO:teuthology.orchestra.run.smithi088.stdout:Collecting py<2,>=1.4.17 2024-03-09T14:27:14.332 INFO:teuthology.orchestra.run.smithi088.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-03-09T14:27:14.425 INFO:teuthology.orchestra.run.smithi088.stdout:Collecting pluggy<1,>=0.12.0 2024-03-09T14:27:14.442 INFO:teuthology.orchestra.run.smithi088.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-03-09T14:27:14.543 INFO:teuthology.orchestra.run.smithi088.stdout:Collecting filelock<4,>=3.0.0 2024-03-09T14:27:14.561 INFO:teuthology.orchestra.run.smithi088.stdout: Downloading filelock-3.13.1-py3-none-any.whl (11 kB) 2024-03-09T14:27:14.670 INFO:teuthology.orchestra.run.smithi088.stdout:Collecting packaging>=14 2024-03-09T14:27:14.687 INFO:teuthology.orchestra.run.smithi088.stdout: Downloading packaging-23.2-py3-none-any.whl (53 kB) 2024-03-09T14:27:14.774 INFO:teuthology.orchestra.run.smithi088.stdout:Collecting six<2,>=1.14.0 2024-03-09T14:27:14.791 INFO:teuthology.orchestra.run.smithi088.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-09T14:27:14.867 INFO:teuthology.orchestra.run.smithi088.stdout:Collecting toml>=0.9.4 2024-03-09T14:27:14.884 INFO:teuthology.orchestra.run.smithi088.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-03-09T14:27:15.154 INFO:teuthology.orchestra.run.smithi088.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-03-09T14:27:15.174 INFO:teuthology.orchestra.run.smithi088.stdout: Downloading virtualenv-20.25.1-py3-none-any.whl (3.8 MB) 2024-03-09T14:27:15.424 INFO:teuthology.orchestra.run.smithi088.stdout:Collecting platformdirs<5,>=3.9.1 2024-03-09T14:27:15.441 INFO:teuthology.orchestra.run.smithi088.stdout: Downloading platformdirs-4.2.0-py3-none-any.whl (17 kB) 2024-03-09T14:27:15.531 INFO:teuthology.orchestra.run.smithi088.stdout:Collecting distlib<1,>=0.3.7 2024-03-09T14:27:15.566 INFO:teuthology.orchestra.run.smithi088.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-03-09T14:27:15.703 INFO:teuthology.orchestra.run.smithi088.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-03-09T14:27:16.529 INFO:teuthology.orchestra.run.smithi088.stdout:Successfully installed distlib-0.3.8 filelock-3.13.1 packaging-23.2 platformdirs-4.2.0 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.25.1 2024-03-09T14:27:16.743 INFO:teuthology.orchestra.run.smithi088.stderr:WARNING: You are using pip version 21.2.3; however, version 24.0 is available. 2024-03-09T14:27:16.744 INFO:teuthology.orchestra.run.smithi088.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-03-09T14:27:16.805 INFO:teuthology.run_tasks:Running task workunit... 2024-03-09T14:27:16.819 INFO:tasks.workunit:Pulling workunits from ref c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:27:16.820 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-09T14:27:16.820 DEBUG:teuthology.orchestra.run.smithi088:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:27:16.851 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:27:16.851 INFO:teuthology.orchestra.run.smithi088.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-09T14:27:16.851 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:27:16.918 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-09T14:27:16.919 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-09T14:27:16.985 INFO:tasks.workunit:timeout=3h 2024-03-09T14:27:16.985 INFO:tasks.workunit:cleanup=True 2024-03-09T14:27:16.986 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:27:17.053 INFO:tasks.workunit.client.0.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-09T14:28:33.683 INFO:tasks.workunit.client.0.smithi088.stderr:Note: switching to 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'. 2024-03-09T14:28:33.684 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:33.684 INFO:tasks.workunit.client.0.smithi088.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-09T14:28:33.684 INFO:tasks.workunit.client.0.smithi088.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-09T14:28:33.684 INFO:tasks.workunit.client.0.smithi088.stderr:state without impacting any branches by switching back to a branch. 2024-03-09T14:28:33.684 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:33.684 INFO:tasks.workunit.client.0.smithi088.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-09T14:28:33.684 INFO:tasks.workunit.client.0.smithi088.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-09T14:28:33.684 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:33.685 INFO:tasks.workunit.client.0.smithi088.stderr: git switch -c 2024-03-09T14:28:33.685 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:33.685 INFO:tasks.workunit.client.0.smithi088.stderr:Or undo this operation with: 2024-03-09T14:28:33.685 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:33.685 INFO:tasks.workunit.client.0.smithi088.stderr: git switch - 2024-03-09T14:28:33.685 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:33.685 INFO:tasks.workunit.client.0.smithi088.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-09T14:28:33.685 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:33.685 INFO:tasks.workunit.client.0.smithi088.stderr:HEAD is now at c00d9c609fb DNM: point s3tests at branch cbodley:wip-iam-user-apis 2024-03-09T14:28:33.687 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-09T14:28:33.764 INFO:tasks.workunit.client.0.smithi088.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-09T14:28:33.766 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:28:33.766 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-09T14:28:34.408 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-09T14:28:34.496 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-09T14:28:34.537 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:28:34.538 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:28:34.538 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-09T14:28:34.577 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:28:34.580 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:28:34.580 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-09T14:28:34.650 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-03-09T14:28:34.651 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-03-09T14:28:34.651 DEBUG:teuthology.orchestra.run.smithi088:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-03-09T14:28:34.721 INFO:tasks.workunit.client.0.smithi088.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-03-09T14:28:34.721 INFO:tasks.workunit.client.0.smithi088.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:28:34.721 INFO:tasks.workunit.client.0.smithi088.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:28:37.104 INFO:tasks.workunit.client.0.smithi088.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-03-09T14:28:37.104 INFO:tasks.workunit.client.0.smithi088.stderr:++ deactivate nondestructive 2024-03-09T14:28:37.104 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' -n '' ']' 2024-03-09T14:28:37.104 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' -n '' ']' 2024-03-09T14:28:37.104 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:28:37.104 INFO:tasks.workunit.client.0.smithi088.stderr:++ hash -r 2024-03-09T14:28:37.104 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' -n '' ']' 2024-03-09T14:28:37.104 INFO:tasks.workunit.client.0.smithi088.stderr:++ unset VIRTUAL_ENV 2024-03-09T14:28:37.104 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-03-09T14:28:37.104 INFO:tasks.workunit.client.0.smithi088.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:28:37.104 INFO:tasks.workunit.client.0.smithi088.stderr:++ export VIRTUAL_ENV 2024-03-09T14:28:37.104 INFO:tasks.workunit.client.0.smithi088.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-09T14:28:37.105 INFO:tasks.workunit.client.0.smithi088.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-09T14:28:37.105 INFO:tasks.workunit.client.0.smithi088.stderr:++ export PATH 2024-03-09T14:28:37.105 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' -n '' ']' 2024-03-09T14:28:37.105 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' -z '' ']' 2024-03-09T14:28:37.106 INFO:tasks.workunit.client.0.smithi088.stderr:++ _OLD_VIRTUAL_PS1= 2024-03-09T14:28:37.106 INFO:tasks.workunit.client.0.smithi088.stderr:++ PS1='(rgw) ' 2024-03-09T14:28:37.106 INFO:tasks.workunit.client.0.smithi088.stderr:++ export PS1 2024-03-09T14:28:37.106 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:28:37.106 INFO:tasks.workunit.client.0.smithi088.stderr:++ hash -r 2024-03-09T14:28:37.106 INFO:tasks.workunit.client.0.smithi088.stderr:+ pip install pip --upgrade 2024-03-09T14:28:37.332 INFO:tasks.workunit.client.0.smithi088.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-03-09T14:28:37.540 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting pip 2024-03-09T14:28:37.618 INFO:tasks.workunit.client.0.smithi088.stdout: Downloading pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-09T14:28:37.815 INFO:tasks.workunit.client.0.smithi088.stdout:Installing collected packages: pip 2024-03-09T14:28:37.815 INFO:tasks.workunit.client.0.smithi088.stdout: Attempting uninstall: pip 2024-03-09T14:28:37.816 INFO:tasks.workunit.client.0.smithi088.stdout: Found existing installation: pip 21.2.3 2024-03-09T14:28:37.962 INFO:tasks.workunit.client.0.smithi088.stdout: Uninstalling pip-21.2.3: 2024-03-09T14:28:37.969 INFO:tasks.workunit.client.0.smithi088.stdout: Successfully uninstalled pip-21.2.3 2024-03-09T14:28:38.923 INFO:tasks.workunit.client.0.smithi088.stdout:Successfully installed pip-24.0 2024-03-09T14:28:39.394 INFO:tasks.workunit.client.0.smithi088.stderr:+ pip install boto3 2024-03-09T14:28:40.314 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting boto3 2024-03-09T14:28:40.390 INFO:tasks.workunit.client.0.smithi088.stdout: Downloading boto3-1.34.59-py3-none-any.whl.metadata (6.6 kB) 2024-03-09T14:28:41.058 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting botocore<1.35.0,>=1.34.59 (from boto3) 2024-03-09T14:28:41.076 INFO:tasks.workunit.client.0.smithi088.stdout: Downloading botocore-1.34.59-py3-none-any.whl.metadata (5.7 kB) 2024-03-09T14:28:41.209 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-03-09T14:28:41.231 INFO:tasks.workunit.client.0.smithi088.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-03-09T14:28:41.366 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-03-09T14:28:41.383 INFO:tasks.workunit.client.0.smithi088.stdout: Downloading s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-03-09T14:28:41.525 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:28:41.542 INFO:tasks.workunit.client.0.smithi088.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-03-09T14:28:41.692 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:28:41.710 INFO:tasks.workunit.client.0.smithi088.stdout: Downloading urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-03-09T14:28:41.788 INFO:tasks.workunit.client.0.smithi088.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.9/48.9 kB 512.8 kB/s eta 0:00:00 2024-03-09T14:28:42.024 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:28:42.041 INFO:tasks.workunit.client.0.smithi088.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-09T14:28:42.168 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading boto3-1.34.59-py3-none-any.whl (139 kB) 2024-03-09T14:28:42.248 INFO:tasks.workunit.client.0.smithi088.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.3/139.3 kB 1.7 MB/s eta 0:00:00 2024-03-09T14:28:42.268 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading botocore-1.34.59-py3-none-any.whl (12.0 MB) 2024-03-09T14:28:42.542 INFO:tasks.workunit.client.0.smithi088.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.0/12.0 MB 45.4 MB/s eta 0:00:00 2024-03-09T14:28:42.559 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-03-09T14:28:42.624 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-03-09T14:28:42.675 INFO:tasks.workunit.client.0.smithi088.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82.1/82.1 kB 1.5 MB/s eta 0:00:00 2024-03-09T14:28:42.693 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-03-09T14:28:42.742 INFO:tasks.workunit.client.0.smithi088.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 229.9/229.9 kB 4.6 MB/s eta 0:00:00 2024-03-09T14:28:42.760 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-03-09T14:28:42.801 INFO:tasks.workunit.client.0.smithi088.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.8/143.8 kB 3.4 MB/s eta 0:00:00 2024-03-09T14:28:42.817 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-09T14:28:42.961 INFO:tasks.workunit.client.0.smithi088.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-03-09T14:28:44.021 INFO:tasks.workunit.client.0.smithi088.stdout:Successfully installed boto3-1.34.59 botocore-1.34.59 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.0 six-1.16.0 urllib3-1.26.18 2024-03-09T14:28:44.159 INFO:tasks.workunit.client.0.smithi088.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-03-09T14:28:44.292 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-03-09T14:28:44.326 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:44.326 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:44.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.359+0000 7f3dc8844800 20 rados->read ofs=0 len=0 2024-03-09T14:28:44.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.360+0000 7f3dc8844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:44.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.360+0000 7f3dc8844800 20 realm 2024-03-09T14:28:44.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.360+0000 7f3dc8844800 20 rados->read ofs=0 len=0 2024-03-09T14:28:44.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.360+0000 7f3dc8844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:44.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.360+0000 7f3dc8844800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:44.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.360+0000 7f3dc8844800 20 rados->read ofs=0 len=0 2024-03-09T14:28:44.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.360+0000 7f3dc8844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:44.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.360+0000 7f3dc8844800 20 rados->read ofs=0 len=0 2024-03-09T14:28:44.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.362+0000 7f3dc8844800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:44.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.362+0000 7f3dc8844800 20 rados->read ofs=0 len=0 2024-03-09T14:28:44.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.362+0000 7f3dc8844800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:44.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.362+0000 7f3dc8844800 20 searching for the correct realm 2024-03-09T14:28:44.365 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.365+0000 7f3dc6b41640 0 -- 172.21.15.88:0/2783077348 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f3dc004ee30 msgr2=0x7f3dc0030830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:44.369 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.369+0000 7f3dc5b3f640 0 -- 172.21.15.88:0/2783077348 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f3dc00464f0 msgr2=0x7f3dc004dad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:28:44.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.575+0000 7f3dc8844800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:44.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.575+0000 7f3dc8844800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:44.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.575+0000 7f3dc8844800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:44.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.575+0000 7f3dc8844800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:44.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.575+0000 7f3dc8844800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:44.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.575+0000 7f3dc8844800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:44.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.575+0000 7f3dc8844800 20 rados->read ofs=0 len=0 2024-03-09T14:28:44.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.575+0000 7f3dc8844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:44.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.575+0000 7f3dc8844800 20 rados->read ofs=0 len=0 2024-03-09T14:28:44.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.575+0000 7f3dc8844800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:44.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.575+0000 7f3dc8844800 20 rados->read ofs=0 len=0 2024-03-09T14:28:44.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.576+0000 7f3dc8844800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:44.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.576+0000 7f3dc8844800 20 zone default found 2024-03-09T14:28:44.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.576+0000 7f3dc8844800 4 Realm: () 2024-03-09T14:28:44.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.576+0000 7f3dc8844800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:44.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.576+0000 7f3dc8844800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:44.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.576+0000 7f3dc8844800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:44.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.576+0000 7f3dc8844800 20 zonegroup default 2024-03-09T14:28:44.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.576+0000 7f3dc8844800 20 rados->read ofs=0 len=0 2024-03-09T14:28:44.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.576+0000 7f3dc8844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:44.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.576+0000 7f3dc8844800 20 rados->read ofs=0 len=0 2024-03-09T14:28:44.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.576+0000 7f3dc8844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:44.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.576+0000 7f3dc8844800 20 rados->read ofs=0 len=0 2024-03-09T14:28:44.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.577+0000 7f3dc8844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:44.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.577+0000 7f3dc8844800 20 started sync module instance, tier type = 2024-03-09T14:28:44.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.577+0000 7f3dc8844800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:44.593 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.593+0000 7f3dc8844800 20 add_watcher() i=0 2024-03-09T14:28:44.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.593+0000 7f3dc8844800 20 add_watcher() i=1 2024-03-09T14:28:44.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.593+0000 7f3dc8844800 20 add_watcher() i=2 2024-03-09T14:28:44.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.593+0000 7f3dc8844800 20 add_watcher() i=3 2024-03-09T14:28:44.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.593+0000 7f3dc8844800 20 add_watcher() i=4 2024-03-09T14:28:44.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.593+0000 7f3dc8844800 20 add_watcher() i=5 2024-03-09T14:28:44.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.593+0000 7f3dc8844800 20 add_watcher() i=6 2024-03-09T14:28:44.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.595+0000 7f3dc8844800 20 add_watcher() i=7 2024-03-09T14:28:44.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.595+0000 7f3dc8844800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:44.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.597+0000 7f3c7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:44.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.597+0000 7f3dc8844800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:44.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.597+0000 7f3dc8844800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:44.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.597+0000 7f3dc8844800 5 note: GC not initialized 2024-03-09T14:28:44.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.597+0000 7f3bf77fe640 20 reqs_thread_entry: start 2024-03-09T14:28:44.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.598+0000 7f3dc8844800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:44.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.598+0000 7f3dc8844800 20 Filter name: none 2024-03-09T14:28:44.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.598+0000 7f3bf57fa640 20 reqs_thread_entry: start 2024-03-09T14:28:44.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.598+0000 7f3dc8844800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-03-09T14:28:44.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.598+0000 7f3dc8844800 20 rados->read ofs=0 len=0 2024-03-09T14:28:44.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.598+0000 7f3dc8844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:44.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.598+0000 7f3dc8844800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-03-09T14:28:44.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.598+0000 7f3dc8844800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-03-09T14:28:44.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.598+0000 7f3dc8844800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-03-09T14:28:44.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.598+0000 7f3dc8844800 20 rados->read ofs=0 len=0 2024-03-09T14:28:44.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.598+0000 7f3dc8844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:44.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.598+0000 7f3dc8844800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-03-09T14:28:44.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.598+0000 7f3dc8844800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-03-09T14:28:44.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.598+0000 7f3dc8844800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-03-09T14:28:44.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.598+0000 7f3dc8844800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-03-09T14:28:44.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.600+0000 7f3dc8844800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-03-09T14:28:44.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.600+0000 7f3dc8844800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-03-09T14:28:44.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.600+0000 7f3dc8844800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-03-09T14:28:44.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.601+0000 7f3ca9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 94578393370064 notifier 4632 bl.length()=593 2024-03-09T14:28:44.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.601+0000 7f3ca9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-03-09T14:28:44.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.601+0000 7f3ca9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-03-09T14:28:44.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.625+0000 7f3dc8844800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-03-09T14:28:44.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.625+0000 7f3dc8844800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-03-09T14:28:44.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.625+0000 7f3dc8844800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-03-09T14:28:44.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.625+0000 7f3ca9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 94578393372272 notifier 4632 bl.length()=186 2024-03-09T14:28:44.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.625+0000 7f3ca9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-03-09T14:28:44.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.625+0000 7f3ca9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-03-09T14:28:44.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.628+0000 7f3c7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:44.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.631+0000 7f3dc8844800 20 remove_watcher() i=0 2024-03-09T14:28:44.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.631+0000 7f3dc8844800 2 removed watcher, disabling cache 2024-03-09T14:28:44.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.632+0000 7f3dc8844800 20 remove_watcher() i=1 2024-03-09T14:28:44.633 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.633+0000 7f3dc8844800 20 remove_watcher() i=2 2024-03-09T14:28:44.634 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.634+0000 7f3dc8844800 20 remove_watcher() i=3 2024-03-09T14:28:44.636 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.635+0000 7f3dc8844800 20 remove_watcher() i=4 2024-03-09T14:28:44.637 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.636+0000 7f3dc8844800 20 remove_watcher() i=5 2024-03-09T14:28:44.637 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.637+0000 7f3dc8844800 20 remove_watcher() i=6 2024-03-09T14:28:44.638 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:44.638+0000 7f3dc8844800 20 remove_watcher() i=7 2024-03-09T14:28:46.332 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: recalculated bucket check stats are correct 2024-03-09T14:28:46.332 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:46.334 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-03-09T14:28:46.361 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:46.361 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:46.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.394+0000 7fd0ba29d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.396 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.395+0000 7fd0ba29d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:46.396 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.395+0000 7fd0ba29d800 20 realm 2024-03-09T14:28:46.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.395+0000 7fd0ba29d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.396+0000 7fd0ba29d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:46.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.396+0000 7fd0ba29d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:46.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.396+0000 7fd0ba29d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.396+0000 7fd0ba29d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:46.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.396+0000 7fd0ba29d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.397+0000 7fd0ba29d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:46.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.397+0000 7fd0ba29d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.397+0000 7fd0ba29d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:46.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.397+0000 7fd0ba29d800 20 searching for the correct realm 2024-03-09T14:28:46.400 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.400+0000 7fd0b859a640 0 -- 172.21.15.88:0/29284122 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fd0a8076070 msgr2=0x7fd0a80cf8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:46.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.604+0000 7fd0b7598640 0 -- 172.21.15.88:0/29284122 >> [v2:172.21.15.132:6800/1549387301,v1:172.21.15.132:6801/1549387301] conn(0x560edf91d3d0 msgr2=0x560edf91f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:46.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.609+0000 7fd0ba29d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:46.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.609+0000 7fd0ba29d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:46.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.609+0000 7fd0ba29d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:46.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.609+0000 7fd0ba29d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:46.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.609+0000 7fd0ba29d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:46.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.609+0000 7fd0ba29d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:46.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.609+0000 7fd0ba29d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.610+0000 7fd0ba29d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:46.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.610+0000 7fd0ba29d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.610+0000 7fd0ba29d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:46.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.610+0000 7fd0ba29d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.610+0000 7fd0ba29d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:46.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.610+0000 7fd0ba29d800 20 zone default found 2024-03-09T14:28:46.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.610+0000 7fd0ba29d800 4 Realm: () 2024-03-09T14:28:46.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.610+0000 7fd0ba29d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:46.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.610+0000 7fd0ba29d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:46.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.610+0000 7fd0ba29d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:46.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.610+0000 7fd0ba29d800 20 zonegroup default 2024-03-09T14:28:46.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.610+0000 7fd0ba29d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.610+0000 7fd0ba29d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:46.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.611+0000 7fd0ba29d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.611+0000 7fd0ba29d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:46.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.611+0000 7fd0ba29d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.611+0000 7fd0ba29d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:46.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.611+0000 7fd0ba29d800 20 started sync module instance, tier type = 2024-03-09T14:28:46.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.611+0000 7fd0ba29d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:46.622 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.621+0000 7fd0ba29d800 20 add_watcher() i=0 2024-03-09T14:28:46.622 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.621+0000 7fd0ba29d800 20 add_watcher() i=1 2024-03-09T14:28:46.622 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.621+0000 7fd0ba29d800 20 add_watcher() i=2 2024-03-09T14:28:46.622 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.621+0000 7fd0ba29d800 20 add_watcher() i=3 2024-03-09T14:28:46.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.624+0000 7fd0ba29d800 20 add_watcher() i=4 2024-03-09T14:28:46.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.624+0000 7fd0ba29d800 20 add_watcher() i=5 2024-03-09T14:28:46.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.624+0000 7fd0ba29d800 20 add_watcher() i=6 2024-03-09T14:28:46.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.624+0000 7fd0ba29d800 20 add_watcher() i=7 2024-03-09T14:28:46.625 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.624+0000 7fd0ba29d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:46.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.625+0000 7fcf6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:46.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.626+0000 7fd0ba29d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:46.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.626+0000 7fd0ba29d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:46.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.626+0000 7fd0ba29d800 5 note: GC not initialized 2024-03-09T14:28:46.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.626+0000 7fcf6cfe1640 20 reqs_thread_entry: start 2024-03-09T14:28:46.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.626+0000 7fd0ba29d800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:46.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.626+0000 7fd0ba29d800 20 Filter name: none 2024-03-09T14:28:46.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.626+0000 7fcee67fc640 20 reqs_thread_entry: start 2024-03-09T14:28:46.628 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.626+0000 7fd0ba29d800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:28:46.628 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.626+0000 7fd0ba29d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.627+0000 7fd0ba29d800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:46.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.627+0000 7fd0ba29d800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:28:46.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.627+0000 7fd0ba29d800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:28:46.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.627+0000 7fd0ba29d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 : miss 2024-03-09T14:28:46.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.627+0000 7fd0ba29d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.627+0000 7fd0ba29d800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:46.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.627+0000 7fd0ba29d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 info.flags=0x17 2024-03-09T14:28:46.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.627+0000 7fd0ba29d800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 to cache LRU end 2024-03-09T14:28:46.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.627+0000 7fd0ba29d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:28:46.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.627+0000 7fd0ba29d800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:28:46.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.627+0000 7fd0ba29d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 2024-03-09T14:28:46.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.627+0000 7fd0ba29d800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:28:46.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.627+0000 7fd0ba29d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:28:46.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.628+0000 7fd0ba29d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:28:46.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.628+0000 7fd0ba29d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:28:46.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.628+0000 7fd0ba29d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:28:46.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.628+0000 7fd0ba29d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:28:46.636 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.635+0000 7fcf6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:46.639 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.638+0000 7fd0ba29d800 20 remove_watcher() i=0 2024-03-09T14:28:46.639 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.638+0000 7fd0ba29d800 2 removed watcher, disabling cache 2024-03-09T14:28:46.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.639+0000 7fd0ba29d800 20 remove_watcher() i=1 2024-03-09T14:28:46.643 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.642+0000 7fd0ba29d800 20 remove_watcher() i=2 2024-03-09T14:28:46.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.643+0000 7fd0ba29d800 20 remove_watcher() i=3 2024-03-09T14:28:46.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.645+0000 7fd0ba29d800 20 remove_watcher() i=4 2024-03-09T14:28:46.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.646+0000 7fd0ba29d800 20 remove_watcher() i=5 2024-03-09T14:28:46.647 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.647+0000 7fd0ba29d800 20 remove_watcher() i=6 2024-03-09T14:28:46.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.648+0000 7fd0ba29d800 20 remove_watcher() i=7 2024-03-09T14:28:46.659 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-03-09T14:28:46.686 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:46.687 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:46.719 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.719+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.721 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.720+0000 7fc70fa9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:46.721 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.720+0000 7fc70fa9d800 20 realm 2024-03-09T14:28:46.722 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.720+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.722 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.720+0000 7fc70fa9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:46.722 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.720+0000 7fc70fa9d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:46.722 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.720+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.722 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.721+0000 7fc70fa9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:46.722 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.721+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.723 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.721+0000 7fc70fa9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:46.723 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.721+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:46.723 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.722+0000 7fc70fa9d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:46.723 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.722+0000 7fc70fa9d800 20 searching for the correct realm 2024-03-09T14:28:46.725 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.724+0000 7fc70dd9a640 0 -- 172.21.15.88:0/516905978 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fc70806f040 msgr2=0x7fc708058f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:28:46.931 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:46.930+0000 7fc70cd98640 0 -- 172.21.15.88:0/516905978 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fc70805af00 msgr2=0x7fc7080576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:28:47.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.136+0000 7fc70fa9d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:47.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.136+0000 7fc70fa9d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:47.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.136+0000 7fc70fa9d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:47.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.136+0000 7fc70fa9d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:47.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.136+0000 7fc70fa9d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:47.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.136+0000 7fc70fa9d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:47.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.136+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.137+0000 7fc70fa9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:47.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.137+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.139 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.137+0000 7fc70fa9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:47.139 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.137+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.137+0000 7fc70fa9d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:47.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.137+0000 7fc70fa9d800 20 zone default found 2024-03-09T14:28:47.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.137+0000 7fc70fa9d800 4 Realm: () 2024-03-09T14:28:47.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.137+0000 7fc70fa9d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:47.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.137+0000 7fc70fa9d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:47.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.137+0000 7fc70fa9d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:47.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.137+0000 7fc70fa9d800 20 zonegroup default 2024-03-09T14:28:47.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.137+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.138+0000 7fc70fa9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:47.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.138+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.138+0000 7fc70fa9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:47.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.138+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.138+0000 7fc70fa9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:47.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.138+0000 7fc70fa9d800 20 started sync module instance, tier type = 2024-03-09T14:28:47.141 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.138+0000 7fc70fa9d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:47.157 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.157+0000 7fc70fa9d800 20 add_watcher() i=0 2024-03-09T14:28:47.158 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.157+0000 7fc70fa9d800 20 add_watcher() i=1 2024-03-09T14:28:47.158 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.157+0000 7fc70fa9d800 20 add_watcher() i=2 2024-03-09T14:28:47.158 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.157+0000 7fc70fa9d800 20 add_watcher() i=3 2024-03-09T14:28:47.158 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.157+0000 7fc70fa9d800 20 add_watcher() i=4 2024-03-09T14:28:47.158 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.157+0000 7fc70fa9d800 20 add_watcher() i=5 2024-03-09T14:28:47.158 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.157+0000 7fc70fa9d800 20 add_watcher() i=6 2024-03-09T14:28:47.158 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.158+0000 7fc70fa9d800 20 add_watcher() i=7 2024-03-09T14:28:47.158 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.158+0000 7fc70fa9d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:47.160 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.160+0000 7fc5c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:47.161 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.160+0000 7fc70fa9d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:47.161 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.160+0000 7fc70fa9d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:47.161 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.160+0000 7fc70fa9d800 5 note: GC not initialized 2024-03-09T14:28:47.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.160+0000 7fc5c27e4640 20 reqs_thread_entry: start 2024-03-09T14:28:47.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.160+0000 7fc70fa9d800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:47.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.160+0000 7fc70fa9d800 20 Filter name: none 2024-03-09T14:28:47.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.160+0000 7fc533fff640 20 reqs_thread_entry: start 2024-03-09T14:28:47.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.161+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.161+0000 7fc70fa9d800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:47.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.161+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.161+0000 7fc70fa9d800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:47.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.161+0000 7fc70fa9d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:28:47.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.161+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.162+0000 7fc70fa9d800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:47.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.162+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.162+0000 7fc70fa9d800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:47.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.162+0000 7fc70fa9d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:28:47.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.163+0000 7fc70fa9d800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.163+0000 7fc70fa9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:47.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.164+0000 7fc5c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:47.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.167+0000 7fc70fa9d800 20 remove_watcher() i=0 2024-03-09T14:28:47.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.167+0000 7fc70fa9d800 2 removed watcher, disabling cache 2024-03-09T14:28:47.169 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.169+0000 7fc70fa9d800 20 remove_watcher() i=1 2024-03-09T14:28:47.170 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.170+0000 7fc70fa9d800 20 remove_watcher() i=2 2024-03-09T14:28:47.172 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.171+0000 7fc70fa9d800 20 remove_watcher() i=3 2024-03-09T14:28:47.173 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.172+0000 7fc70fa9d800 20 remove_watcher() i=4 2024-03-09T14:28:47.174 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.173+0000 7fc70fa9d800 20 remove_watcher() i=5 2024-03-09T14:28:47.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.175+0000 7fc70fa9d800 20 remove_watcher() i=6 2024-03-09T14:28:47.176 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.176+0000 7fc70fa9d800 20 remove_watcher() i=7 2024-03-09T14:28:47.186 INFO:tasks.workunit.client.0.smithi088.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 79, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-03-09T14:28:47.186 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: bucket check unlinked does not report normal entries 2024-03-09T14:28:47.189 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:47.190 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-03-09T14:28:47.219 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:47.219 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:47.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.252+0000 7f42b6024800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.253+0000 7f42b6024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:47.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.253+0000 7f42b6024800 20 realm 2024-03-09T14:28:47.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.253+0000 7f42b6024800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.253+0000 7f42b6024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:47.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.253+0000 7f42b6024800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:47.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.253+0000 7f42b6024800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.253+0000 7f42b6024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:47.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.253+0000 7f42b6024800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.254+0000 7f42b6024800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:47.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.254+0000 7f42b6024800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.255+0000 7f42b6024800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:47.256 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.255+0000 7f42b6024800 20 searching for the correct realm 2024-03-09T14:28:47.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.258+0000 7f42b4328640 0 -- 172.21.15.88:0/414084815 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f42ac082470 msgr2=0x7f42ac0828b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:47.262 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.262+0000 7f42abfff640 0 -- 172.21.15.88:0/414084815 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f42ac08d930 msgr2=0x7f42ac0a03f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:28:47.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.468+0000 7f42b6024800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:47.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.468+0000 7f42b6024800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:47.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.468+0000 7f42b6024800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:47.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.468+0000 7f42b6024800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:47.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.468+0000 7f42b6024800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:47.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.468+0000 7f42b6024800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:47.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.468+0000 7f42b6024800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.468+0000 7f42b6024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:47.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.468+0000 7f42b6024800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.469+0000 7f42b6024800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:47.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.469+0000 7f42b6024800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.469+0000 7f42b6024800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:47.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.469+0000 7f42b6024800 20 zone default found 2024-03-09T14:28:47.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.469+0000 7f42b6024800 4 Realm: () 2024-03-09T14:28:47.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.469+0000 7f42b6024800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:47.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.469+0000 7f42b6024800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:47.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.469+0000 7f42b6024800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:47.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.469+0000 7f42b6024800 20 zonegroup default 2024-03-09T14:28:47.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.469+0000 7f42b6024800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.469+0000 7f42b6024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:47.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.469+0000 7f42b6024800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.470+0000 7f42b6024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:47.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.470+0000 7f42b6024800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.470+0000 7f42b6024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:47.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.470+0000 7f42b6024800 20 started sync module instance, tier type = 2024-03-09T14:28:47.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.470+0000 7f42b6024800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:47.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.484+0000 7f42b6024800 20 add_watcher() i=0 2024-03-09T14:28:47.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.484+0000 7f42b6024800 20 add_watcher() i=1 2024-03-09T14:28:47.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.484+0000 7f42b6024800 20 add_watcher() i=2 2024-03-09T14:28:47.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.484+0000 7f42b6024800 20 add_watcher() i=3 2024-03-09T14:28:47.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.484+0000 7f42b6024800 20 add_watcher() i=4 2024-03-09T14:28:47.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.484+0000 7f42b6024800 20 add_watcher() i=5 2024-03-09T14:28:47.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.484+0000 7f42b6024800 20 add_watcher() i=6 2024-03-09T14:28:47.486 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.485+0000 7f42b6024800 20 add_watcher() i=7 2024-03-09T14:28:47.486 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.485+0000 7f42b6024800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:47.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.488+0000 7f4169fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:47.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.488+0000 7f42b6024800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:47.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.488+0000 7f42b6024800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:47.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.488+0000 7f42b6024800 5 note: GC not initialized 2024-03-09T14:28:47.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.489+0000 7f4168fe1640 20 reqs_thread_entry: start 2024-03-09T14:28:47.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.489+0000 7f42b6024800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:47.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.489+0000 7f42b6024800 20 Filter name: none 2024-03-09T14:28:47.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.489+0000 7f40e27fc640 20 reqs_thread_entry: start 2024-03-09T14:28:47.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.489+0000 7f42b6024800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:28:47.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.489+0000 7f42b6024800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.489+0000 7f42b6024800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:47.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.489+0000 7f42b6024800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:28:47.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.489+0000 7f42b6024800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:28:47.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.489+0000 7f42b6024800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 : miss 2024-03-09T14:28:47.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.489+0000 7f42b6024800 20 rados->read ofs=0 len=0 2024-03-09T14:28:47.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.490+0000 7f42b6024800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:47.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.490+0000 7f42b6024800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 info.flags=0x17 2024-03-09T14:28:47.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.490+0000 7f42b6024800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 to cache LRU end 2024-03-09T14:28:47.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.490+0000 7f42b6024800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:28:47.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.490+0000 7f42b6024800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:28:47.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.490+0000 7f42b6024800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 2024-03-09T14:28:47.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.490+0000 7f42b6024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:28:47.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.490+0000 7f42b6024800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-09T14:28:47.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.490+0000 7f42b6024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:47.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.490+0000 7f42b6024800 1 NOTICE: finished shard 1 (0 entries found) 2024-03-09T14:28:47.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.491+0000 7f42b6024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:28:47.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.491+0000 7f42b6024800 1 NOTICE: finished shard 2 (0 entries found) 2024-03-09T14:28:47.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.491+0000 7f42b6024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:28:47.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.492+0000 7f42b6024800 1 NOTICE: finished shard 3 (0 entries found) 2024-03-09T14:28:47.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.492+0000 7f42b6024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:28:47.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.492+0000 7f42b6024800 1 NOTICE: finished shard 4 (0 entries found) 2024-03-09T14:28:47.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.492+0000 7f42b6024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:47.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.493+0000 7f42b6024800 1 NOTICE: finished shard 5 (0 entries found) 2024-03-09T14:28:47.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.493+0000 7f42b6024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:28:47.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.493+0000 7f42b6024800 1 NOTICE: finished shard 6 (0 entries found) 2024-03-09T14:28:47.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.493+0000 7f42b6024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:28:47.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.494+0000 7f42b6024800 1 NOTICE: finished shard 7 (0 entries found) 2024-03-09T14:28:47.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.494+0000 7f42b6024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:47.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.494+0000 7f42b6024800 1 NOTICE: finished shard 8 (0 entries found) 2024-03-09T14:28:47.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.494+0000 7f42b6024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:28:47.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.495+0000 7f42b6024800 1 NOTICE: finished shard 9 (0 entries found) 2024-03-09T14:28:47.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.495+0000 7f42b6024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:47.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.495+0000 7f42b6024800 1 NOTICE: finished shard 10 (0 entries found) 2024-03-09T14:28:47.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.495+0000 7f42b6024800 1 NOTICE: finished all shards (0 entries found) 2024-03-09T14:28:47.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.496+0000 7f4169fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:47.499 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.498+0000 7f42b6024800 20 remove_watcher() i=0 2024-03-09T14:28:47.499 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.498+0000 7f42b6024800 2 removed watcher, disabling cache 2024-03-09T14:28:47.500 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.500+0000 7f42b6024800 20 remove_watcher() i=1 2024-03-09T14:28:47.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.503+0000 7f42b6024800 20 remove_watcher() i=2 2024-03-09T14:28:47.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.504+0000 7f42b6024800 20 remove_watcher() i=3 2024-03-09T14:28:47.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.505+0000 7f42b6024800 20 remove_watcher() i=4 2024-03-09T14:28:47.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.506+0000 7f42b6024800 20 remove_watcher() i=5 2024-03-09T14:28:47.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.507+0000 7f42b6024800 20 remove_watcher() i=6 2024-03-09T14:28:47.508 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:47.508+0000 7f42b6024800 20 remove_watcher() i=7 2024-03-09T14:28:47.519 INFO:tasks.workunit.client.0.smithi088.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-03-09T14:28:47.903 INFO:tasks.workunit.client.0.smithi088.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-03-09T14:28:49.407 INFO:tasks.workunit.client.0.smithi088.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:28:49.408 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-09T14:28:49.436 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:49.437 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:49.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.469+0000 7f262ec24800 20 rados->read ofs=0 len=0 2024-03-09T14:28:49.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.470+0000 7f262ec24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:49.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.470+0000 7f262ec24800 20 realm 2024-03-09T14:28:49.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.470+0000 7f262ec24800 20 rados->read ofs=0 len=0 2024-03-09T14:28:49.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.471+0000 7f262ec24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:49.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.471+0000 7f262ec24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:49.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.471+0000 7f262ec24800 20 rados->read ofs=0 len=0 2024-03-09T14:28:49.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.471+0000 7f262ec24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:49.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.471+0000 7f262ec24800 20 rados->read ofs=0 len=0 2024-03-09T14:28:49.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.472+0000 7f262ec24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:49.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.472+0000 7f262ec24800 20 rados->read ofs=0 len=0 2024-03-09T14:28:49.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.472+0000 7f262ec24800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:49.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.472+0000 7f262ec24800 20 searching for the correct realm 2024-03-09T14:28:49.475 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.474+0000 7f262cf21640 0 -- 172.21.15.88:0/1269548404 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f26240ccc00 msgr2=0x7f26240828f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:28:49.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.681+0000 7f262bf1f640 0 -- 172.21.15.88:0/1269548404 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f26240cc330 msgr2=0x7f26240b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:49.890 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.888+0000 7f262ec24800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:49.890 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.888+0000 7f262ec24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:49.890 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.888+0000 7f262ec24800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:49.890 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.888+0000 7f262ec24800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:49.890 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.888+0000 7f262ec24800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:49.890 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.888+0000 7f262ec24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:49.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.888+0000 7f262ec24800 20 rados->read ofs=0 len=0 2024-03-09T14:28:49.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.888+0000 7f262ec24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:49.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.888+0000 7f262ec24800 20 rados->read ofs=0 len=0 2024-03-09T14:28:49.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.888+0000 7f262ec24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:49.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.888+0000 7f262ec24800 20 rados->read ofs=0 len=0 2024-03-09T14:28:49.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.889+0000 7f262ec24800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:49.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.889+0000 7f262ec24800 20 zone default found 2024-03-09T14:28:49.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.889+0000 7f262ec24800 4 Realm: () 2024-03-09T14:28:49.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.889+0000 7f262ec24800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:49.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.889+0000 7f262ec24800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:49.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.889+0000 7f262ec24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:49.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.889+0000 7f262ec24800 20 zonegroup default 2024-03-09T14:28:49.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.889+0000 7f262ec24800 20 rados->read ofs=0 len=0 2024-03-09T14:28:49.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.889+0000 7f262ec24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:49.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.889+0000 7f262ec24800 20 rados->read ofs=0 len=0 2024-03-09T14:28:49.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.889+0000 7f262ec24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:49.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.889+0000 7f262ec24800 20 rados->read ofs=0 len=0 2024-03-09T14:28:49.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.890+0000 7f262ec24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:49.893 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.890+0000 7f262ec24800 20 started sync module instance, tier type = 2024-03-09T14:28:49.893 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.890+0000 7f262ec24800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:49.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.906+0000 7f262ec24800 20 add_watcher() i=0 2024-03-09T14:28:49.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.906+0000 7f262ec24800 20 add_watcher() i=1 2024-03-09T14:28:49.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.906+0000 7f262ec24800 20 add_watcher() i=2 2024-03-09T14:28:49.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.906+0000 7f262ec24800 20 add_watcher() i=3 2024-03-09T14:28:49.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.906+0000 7f262ec24800 20 add_watcher() i=4 2024-03-09T14:28:49.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.906+0000 7f262ec24800 20 add_watcher() i=5 2024-03-09T14:28:49.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.906+0000 7f262ec24800 20 add_watcher() i=6 2024-03-09T14:28:49.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.909+0000 7f262ec24800 20 add_watcher() i=7 2024-03-09T14:28:49.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.909+0000 7f262ec24800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:49.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.911+0000 7f24e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:49.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.912+0000 7f262ec24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:49.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.912+0000 7f262ec24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:49.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.912+0000 7f262ec24800 5 note: GC not initialized 2024-03-09T14:28:49.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.912+0000 7f24e1fdb640 20 reqs_thread_entry: start 2024-03-09T14:28:49.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.912+0000 7f262ec24800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:49.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.912+0000 7f262ec24800 20 Filter name: none 2024-03-09T14:28:49.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.912+0000 7f24537fe640 20 reqs_thread_entry: start 2024-03-09T14:28:49.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.912+0000 7f262ec24800 20 rados->read ofs=0 len=0 2024-03-09T14:28:49.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.913+0000 7f262ec24800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:49.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.913+0000 7f262ec24800 20 rados->read ofs=0 len=0 2024-03-09T14:28:49.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.913+0000 7f262ec24800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:49.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.913+0000 7f262ec24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:28:49.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.913+0000 7f262ec24800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:28:49.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.913+0000 7f262ec24800 20 INFO: main: starting shard=0 2024-03-09T14:28:49.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.913+0000 7f262ec24800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:28:49.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.914+0000 7f262ec24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:49.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.914+0000 7f262ec24800 20 INFO: main: starting shard=1 2024-03-09T14:28:49.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.914+0000 7f262ec24800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:49.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.914+0000 7f262ec24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:49.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.914+0000 7f262ec24800 20 INFO: main: starting shard=2 2024-03-09T14:28:49.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.914+0000 7f262ec24800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:28:49.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.915+0000 7f262ec24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:49.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.915+0000 7f262ec24800 20 INFO: main: starting shard=3 2024-03-09T14:28:49.917 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.915+0000 7f262ec24800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:28:49.917 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.915+0000 7f262ec24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:49.917 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.915+0000 7f262ec24800 20 INFO: main: starting shard=4 2024-03-09T14:28:49.917 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.915+0000 7f262ec24800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:28:49.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.916+0000 7f262ec24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:49.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.916+0000 7f262ec24800 20 INFO: main: starting shard=5 2024-03-09T14:28:49.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.916+0000 7f262ec24800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:49.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.917+0000 7f262ec24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:49.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.917+0000 7f262ec24800 20 INFO: main: starting shard=6 2024-03-09T14:28:49.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.917+0000 7f262ec24800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:28:49.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.917+0000 7f262ec24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:49.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.917+0000 7f262ec24800 20 INFO: main: starting shard=7 2024-03-09T14:28:49.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.917+0000 7f262ec24800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:28:49.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.918+0000 7f262ec24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:49.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.918+0000 7f262ec24800 20 INFO: main: starting shard=8 2024-03-09T14:28:49.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.918+0000 7f262ec24800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:49.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.918+0000 7f262ec24800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-09T14:28:49.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.918+0000 7f262ec24800 20 INFO: main: starting shard=9 2024-03-09T14:28:49.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.918+0000 7f262ec24800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:28:49.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.919+0000 7f262ec24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:49.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.919+0000 7f262ec24800 20 INFO: main: starting shard=10 2024-03-09T14:28:49.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.919+0000 7f262ec24800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:49.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.920+0000 7f262ec24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:49.921 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.920+0000 7f262ec24800 20 INFO: main: done 2024-03-09T14:28:49.921 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.921+0000 7f24e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:49.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.923+0000 7f262ec24800 20 remove_watcher() i=0 2024-03-09T14:28:49.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.923+0000 7f262ec24800 2 removed watcher, disabling cache 2024-03-09T14:28:49.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.924+0000 7f262ec24800 20 remove_watcher() i=1 2024-03-09T14:28:49.927 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.927+0000 7f262ec24800 20 remove_watcher() i=2 2024-03-09T14:28:49.929 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.928+0000 7f262ec24800 20 remove_watcher() i=3 2024-03-09T14:28:49.930 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.930+0000 7f262ec24800 20 remove_watcher() i=4 2024-03-09T14:28:49.931 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.931+0000 7f262ec24800 20 remove_watcher() i=5 2024-03-09T14:28:49.932 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.932+0000 7f262ec24800 20 remove_watcher() i=6 2024-03-09T14:28:49.933 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:49.933+0000 7f262ec24800 20 remove_watcher() i=7 2024-03-09T14:28:50.053 INFO:tasks.workunit.client.0.smithi088.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:28:50.054 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-09T14:28:50.082 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:50.083 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:50.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.115+0000 7f9870c8c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.117+0000 7f9870c8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:50.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.117+0000 7f9870c8c800 20 realm 2024-03-09T14:28:50.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.117+0000 7f9870c8c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.117+0000 7f9870c8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:50.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.117+0000 7f9870c8c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:50.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.117+0000 7f9870c8c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.117+0000 7f9870c8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:50.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.117+0000 7f9870c8c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.118+0000 7f9870c8c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:50.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.118+0000 7f9870c8c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.119 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.118+0000 7f9870c8c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:50.119 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.118+0000 7f9870c8c800 20 searching for the correct realm 2024-03-09T14:28:50.121 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.121+0000 7f986ef89640 0 -- 172.21.15.88:0/3648849826 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f986805e040 msgr2=0x7f9868061940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:50.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.327+0000 7f986df87640 0 -- 172.21.15.88:0/3648849826 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f9868002810 msgr2=0x7f986808e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:50.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.533+0000 7f9870c8c800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:50.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.533+0000 7f9870c8c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:50.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.533+0000 7f9870c8c800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:50.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.533+0000 7f9870c8c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:50.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.533+0000 7f9870c8c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:50.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.533+0000 7f9870c8c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:50.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.533+0000 7f9870c8c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.533+0000 7f9870c8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:50.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.533+0000 7f9870c8c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.534+0000 7f9870c8c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:50.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.534+0000 7f9870c8c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.534+0000 7f9870c8c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:50.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.534+0000 7f9870c8c800 20 zone default found 2024-03-09T14:28:50.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.534+0000 7f9870c8c800 4 Realm: () 2024-03-09T14:28:50.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.534+0000 7f9870c8c800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:50.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.534+0000 7f9870c8c800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.534+0000 7f9870c8c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.534+0000 7f9870c8c800 20 zonegroup default 2024-03-09T14:28:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.534+0000 7f9870c8c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.534+0000 7f9870c8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.534+0000 7f9870c8c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.535+0000 7f9870c8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.535+0000 7f9870c8c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.535+0000 7f9870c8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.535+0000 7f9870c8c800 20 started sync module instance, tier type = 2024-03-09T14:28:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.535+0000 7f9870c8c800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:50.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.552+0000 7f9870c8c800 20 add_watcher() i=0 2024-03-09T14:28:50.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.552+0000 7f9870c8c800 20 add_watcher() i=1 2024-03-09T14:28:50.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.552+0000 7f9870c8c800 20 add_watcher() i=2 2024-03-09T14:28:50.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.552+0000 7f9870c8c800 20 add_watcher() i=3 2024-03-09T14:28:50.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.552+0000 7f9870c8c800 20 add_watcher() i=4 2024-03-09T14:28:50.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.552+0000 7f9870c8c800 20 add_watcher() i=5 2024-03-09T14:28:50.555 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.555+0000 7f9870c8c800 20 add_watcher() i=6 2024-03-09T14:28:50.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.555+0000 7f9870c8c800 20 add_watcher() i=7 2024-03-09T14:28:50.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.555+0000 7f9870c8c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:50.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.558+0000 7f9724fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:50.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.558+0000 7f9870c8c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:50.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.558+0000 7f9870c8c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:50.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.558+0000 7f9870c8c800 5 note: GC not initialized 2024-03-09T14:28:50.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.558+0000 7f969f7fe640 20 reqs_thread_entry: start 2024-03-09T14:28:50.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.558+0000 7f9870c8c800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:50.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.558+0000 7f9870c8c800 20 Filter name: none 2024-03-09T14:28:50.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.558+0000 7f969d7fa640 20 reqs_thread_entry: start 2024-03-09T14:28:50.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.558+0000 7f9870c8c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.559+0000 7f9870c8c800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:50.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.559+0000 7f9870c8c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.559+0000 7f9870c8c800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:50.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.559+0000 7f9870c8c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:28:50.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.559+0000 7f9870c8c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:28:50.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.559+0000 7f9870c8c800 20 INFO: main: starting shard=0 2024-03-09T14:28:50.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.559+0000 7f9870c8c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:28:50.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.559+0000 7f9870c8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:50.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.559+0000 7f9870c8c800 20 INFO: main: starting shard=1 2024-03-09T14:28:50.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.559+0000 7f9870c8c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:50.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.560+0000 7f9870c8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:50.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.560+0000 7f9870c8c800 20 INFO: main: starting shard=2 2024-03-09T14:28:50.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.560+0000 7f9870c8c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:28:50.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.561+0000 7f9870c8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:50.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.561+0000 7f9870c8c800 20 INFO: main: starting shard=3 2024-03-09T14:28:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.561+0000 7f9870c8c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:28:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.561+0000 7f9870c8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.561+0000 7f9870c8c800 20 INFO: main: starting shard=4 2024-03-09T14:28:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.561+0000 7f9870c8c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:28:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.562+0000 7f9870c8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.562+0000 7f9870c8c800 20 INFO: main: starting shard=5 2024-03-09T14:28:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.562+0000 7f9870c8c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.562+0000 7f9870c8c800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-09T14:28:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.563+0000 7f9870c8c800 20 INFO: main: starting shard=6 2024-03-09T14:28:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.563+0000 7f9870c8c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:28:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.563+0000 7f9870c8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.563+0000 7f9870c8c800 20 INFO: main: starting shard=7 2024-03-09T14:28:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.563+0000 7f9870c8c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:28:50.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.564+0000 7f9870c8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:50.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.564+0000 7f9870c8c800 20 INFO: main: starting shard=8 2024-03-09T14:28:50.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.564+0000 7f9870c8c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:50.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.564+0000 7f9870c8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:50.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.564+0000 7f9870c8c800 20 INFO: main: starting shard=9 2024-03-09T14:28:50.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.564+0000 7f9870c8c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:28:50.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.565+0000 7f9870c8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:50.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.565+0000 7f9870c8c800 20 INFO: main: starting shard=10 2024-03-09T14:28:50.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.565+0000 7f9870c8c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:50.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.566+0000 7f9870c8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:50.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.566+0000 7f9870c8c800 20 INFO: main: done 2024-03-09T14:28:50.567 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.566+0000 7f9724fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:50.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.570+0000 7f9870c8c800 20 remove_watcher() i=0 2024-03-09T14:28:50.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.570+0000 7f9870c8c800 2 removed watcher, disabling cache 2024-03-09T14:28:50.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.571+0000 7f9870c8c800 20 remove_watcher() i=1 2024-03-09T14:28:50.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.574+0000 7f9870c8c800 20 remove_watcher() i=2 2024-03-09T14:28:50.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.576+0000 7f9870c8c800 20 remove_watcher() i=3 2024-03-09T14:28:50.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.577+0000 7f9870c8c800 20 remove_watcher() i=4 2024-03-09T14:28:50.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.578+0000 7f9870c8c800 20 remove_watcher() i=5 2024-03-09T14:28:50.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.579+0000 7f9870c8c800 20 remove_watcher() i=6 2024-03-09T14:28:50.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.580+0000 7f9870c8c800 20 remove_watcher() i=7 2024-03-09T14:28:50.720 INFO:tasks.workunit.client.0.smithi088.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:28:50.721 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-03-09T14:28:50.750 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:50.750 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:50.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.782+0000 7fb203d3c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.783+0000 7fb203d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:50.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.783+0000 7fb203d3c800 20 realm 2024-03-09T14:28:50.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.783+0000 7fb203d3c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.783+0000 7fb203d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:50.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.783+0000 7fb203d3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:50.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.783+0000 7fb203d3c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.784+0000 7fb203d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:50.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.784+0000 7fb203d3c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.784+0000 7fb203d3c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:50.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.784+0000 7fb203d3c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:50.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.785+0000 7fb203d3c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:50.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.785+0000 7fb203d3c800 20 searching for the correct realm 2024-03-09T14:28:50.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.787+0000 7fb2002fb640 0 -- 172.21.15.88:0/2870773107 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fb1f808c040 msgr2=0x7fb1f8003e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:50.993 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:50.993+0000 7fb1f7fff640 0 -- 172.21.15.88:0/2870773107 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fb1f805e070 msgr2=0x7fb1f80d78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:51.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.199+0000 7fb203d3c800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:51.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.199+0000 7fb203d3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:51.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.199+0000 7fb203d3c800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:51.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.199+0000 7fb203d3c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:51.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.199+0000 7fb203d3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:51.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.199+0000 7fb203d3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:51.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.199+0000 7fb203d3c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.200+0000 7fb203d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:51.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.200+0000 7fb203d3c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.200+0000 7fb203d3c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:51.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.200+0000 7fb203d3c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.200+0000 7fb203d3c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:51.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.200+0000 7fb203d3c800 20 zone default found 2024-03-09T14:28:51.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.200+0000 7fb203d3c800 4 Realm: () 2024-03-09T14:28:51.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.200+0000 7fb203d3c800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:51.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.200+0000 7fb203d3c800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:51.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.200+0000 7fb203d3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:51.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.200+0000 7fb203d3c800 20 zonegroup default 2024-03-09T14:28:51.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.200+0000 7fb203d3c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.201+0000 7fb203d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:51.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.201+0000 7fb203d3c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.204 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.201+0000 7fb203d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:51.204 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.201+0000 7fb203d3c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.204 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.201+0000 7fb203d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:51.204 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.201+0000 7fb203d3c800 20 started sync module instance, tier type = 2024-03-09T14:28:51.204 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.201+0000 7fb203d3c800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:51.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.212+0000 7fb203d3c800 20 add_watcher() i=0 2024-03-09T14:28:51.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.213+0000 7fb203d3c800 20 add_watcher() i=1 2024-03-09T14:28:51.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.213+0000 7fb203d3c800 20 add_watcher() i=2 2024-03-09T14:28:51.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.213+0000 7fb203d3c800 20 add_watcher() i=3 2024-03-09T14:28:51.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.213+0000 7fb203d3c800 20 add_watcher() i=4 2024-03-09T14:28:51.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.213+0000 7fb203d3c800 20 add_watcher() i=5 2024-03-09T14:28:51.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.213+0000 7fb203d3c800 20 add_watcher() i=6 2024-03-09T14:28:51.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.213+0000 7fb203d3c800 20 add_watcher() i=7 2024-03-09T14:28:51.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.213+0000 7fb203d3c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:51.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.215+0000 7fb0b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:51.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.216+0000 7fb203d3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:51.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.216+0000 7fb203d3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:51.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.216+0000 7fb203d3c800 5 note: GC not initialized 2024-03-09T14:28:51.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.216+0000 7fb0b4fe1640 20 reqs_thread_entry: start 2024-03-09T14:28:51.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.216+0000 7fb203d3c800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:51.218 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.216+0000 7fb203d3c800 20 Filter name: none 2024-03-09T14:28:51.218 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.216+0000 7fb02e7fc640 20 reqs_thread_entry: start 2024-03-09T14:28:51.218 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.216+0000 7fb203d3c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.218 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.216+0000 7fb203d3c800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:51.218 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.216+0000 7fb203d3c800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.217+0000 7fb203d3c800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:51.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.217+0000 7fb203d3c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:28:51.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.217+0000 7fb203d3c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:28:51.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.217+0000 7fb203d3c800 20 INFO: main: starting shard=0 2024-03-09T14:28:51.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.217+0000 7fb203d3c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:28:51.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.217+0000 7fb203d3c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.217+0000 7fb203d3c800 20 INFO: main: starting shard=1 2024-03-09T14:28:51.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.217+0000 7fb203d3c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:51.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.218+0000 7fb203d3c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:28:51.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.218+0000 7fb203d3c800 20 INFO: main: starting shard=2 2024-03-09T14:28:51.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.218+0000 7fb203d3c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:28:51.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.218+0000 7fb203d3c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.218+0000 7fb203d3c800 20 INFO: main: starting shard=3 2024-03-09T14:28:51.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.218+0000 7fb203d3c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:28:51.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.219+0000 7fb203d3c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.219+0000 7fb203d3c800 20 INFO: main: starting shard=4 2024-03-09T14:28:51.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.219+0000 7fb203d3c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:28:51.223 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.219+0000 7fb203d3c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.223 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.219+0000 7fb203d3c800 20 INFO: main: starting shard=5 2024-03-09T14:28:51.223 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.219+0000 7fb203d3c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:51.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.220+0000 7fb203d3c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.220+0000 7fb203d3c800 20 INFO: main: starting shard=6 2024-03-09T14:28:51.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.220+0000 7fb203d3c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:28:51.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.220+0000 7fb203d3c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.220+0000 7fb203d3c800 20 INFO: main: starting shard=7 2024-03-09T14:28:51.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.220+0000 7fb203d3c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:28:51.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.221+0000 7fb203d3c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.221+0000 7fb203d3c800 20 INFO: main: starting shard=8 2024-03-09T14:28:51.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.221+0000 7fb203d3c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:51.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.221+0000 7fb203d3c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.221+0000 7fb203d3c800 20 INFO: main: starting shard=9 2024-03-09T14:28:51.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.221+0000 7fb203d3c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:28:51.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.222+0000 7fb203d3c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.222+0000 7fb203d3c800 20 INFO: main: starting shard=10 2024-03-09T14:28:51.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.222+0000 7fb203d3c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:51.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.222+0000 7fb203d3c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.222+0000 7fb203d3c800 20 INFO: main: done 2024-03-09T14:28:51.226 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.223+0000 7fb0b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:51.226 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.226+0000 7fb203d3c800 20 remove_watcher() i=0 2024-03-09T14:28:51.226 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.226+0000 7fb203d3c800 2 removed watcher, disabling cache 2024-03-09T14:28:51.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.227+0000 7fb203d3c800 20 remove_watcher() i=1 2024-03-09T14:28:51.228 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.228+0000 7fb203d3c800 20 remove_watcher() i=2 2024-03-09T14:28:51.230 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.229+0000 7fb203d3c800 20 remove_watcher() i=3 2024-03-09T14:28:51.230 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.230+0000 7fb203d3c800 20 remove_watcher() i=4 2024-03-09T14:28:51.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.231+0000 7fb203d3c800 20 remove_watcher() i=5 2024-03-09T14:28:51.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.232+0000 7fb203d3c800 20 remove_watcher() i=6 2024-03-09T14:28:51.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.233+0000 7fb203d3c800 20 remove_watcher() i=7 2024-03-09T14:28:51.347 INFO:tasks.workunit.client.0.smithi088.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:28:51.348 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-03-09T14:28:51.377 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:51.377 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:51.410 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.409+0000 7fbb1b731800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.411+0000 7fbb1b731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:51.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.411+0000 7fbb1b731800 20 realm 2024-03-09T14:28:51.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.411+0000 7fbb1b731800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.411+0000 7fbb1b731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:51.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.411+0000 7fbb1b731800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:51.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.411+0000 7fbb1b731800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.411+0000 7fbb1b731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:51.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.411+0000 7fbb1b731800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.412+0000 7fbb1b731800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:51.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.412+0000 7fbb1b731800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.412+0000 7fbb1b731800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:51.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.413+0000 7fbb1b731800 20 searching for the correct realm 2024-03-09T14:28:51.415 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.415+0000 7fbb17c65640 0 -- 172.21.15.88:0/1689391426 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fbb10017040 msgr2=0x7fbb1005fd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:51.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.621+0000 7fbb16c63640 0 -- 172.21.15.88:0/1689391426 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fbb10088640 msgr2=0x7fbb10088aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:28:51.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.827+0000 7fbb1b731800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:51.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.827+0000 7fbb1b731800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:51.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.827+0000 7fbb1b731800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:51.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.827+0000 7fbb1b731800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:51.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.827+0000 7fbb1b731800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:51.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.827+0000 7fbb1b731800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:51.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.827+0000 7fbb1b731800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.827+0000 7fbb1b731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:51.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.827+0000 7fbb1b731800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.827+0000 7fbb1b731800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:51.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.827+0000 7fbb1b731800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.828+0000 7fbb1b731800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:51.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.828+0000 7fbb1b731800 20 zone default found 2024-03-09T14:28:51.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.828+0000 7fbb1b731800 4 Realm: () 2024-03-09T14:28:51.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.828+0000 7fbb1b731800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:51.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.828+0000 7fbb1b731800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:51.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.828+0000 7fbb1b731800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:51.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.828+0000 7fbb1b731800 20 zonegroup default 2024-03-09T14:28:51.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.828+0000 7fbb1b731800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.828+0000 7fbb1b731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:51.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.828+0000 7fbb1b731800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.831 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.828+0000 7fbb1b731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:51.831 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.828+0000 7fbb1b731800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.831 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.829+0000 7fbb1b731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:51.831 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.829+0000 7fbb1b731800 20 started sync module instance, tier type = 2024-03-09T14:28:51.831 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.829+0000 7fbb1b731800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:51.840 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.840+0000 7fbb1b731800 20 add_watcher() i=0 2024-03-09T14:28:51.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.840+0000 7fbb1b731800 20 add_watcher() i=1 2024-03-09T14:28:51.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.840+0000 7fbb1b731800 20 add_watcher() i=2 2024-03-09T14:28:51.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.840+0000 7fbb1b731800 20 add_watcher() i=3 2024-03-09T14:28:51.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.840+0000 7fbb1b731800 20 add_watcher() i=4 2024-03-09T14:28:51.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.840+0000 7fbb1b731800 20 add_watcher() i=5 2024-03-09T14:28:51.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.840+0000 7fbb1b731800 20 add_watcher() i=6 2024-03-09T14:28:51.843 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.842+0000 7fbb1b731800 20 add_watcher() i=7 2024-03-09T14:28:51.843 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.842+0000 7fbb1b731800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:51.845 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.845+0000 7fb9cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:51.846 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.845+0000 7fbb1b731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:51.846 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.845+0000 7fbb1b731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:51.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.845+0000 7fbb1b731800 5 note: GC not initialized 2024-03-09T14:28:51.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.845+0000 7fb9ccfe1640 20 reqs_thread_entry: start 2024-03-09T14:28:51.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.845+0000 7fbb1b731800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:51.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.845+0000 7fbb1b731800 20 Filter name: none 2024-03-09T14:28:51.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.846+0000 7fb9467fc640 20 reqs_thread_entry: start 2024-03-09T14:28:51.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.846+0000 7fbb1b731800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.846+0000 7fbb1b731800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:51.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.846+0000 7fbb1b731800 20 rados->read ofs=0 len=0 2024-03-09T14:28:51.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.846+0000 7fbb1b731800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:51.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.846+0000 7fbb1b731800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:28:51.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.846+0000 7fbb1b731800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:28:51.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.846+0000 7fbb1b731800 20 INFO: main: starting shard=0 2024-03-09T14:28:51.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.846+0000 7fbb1b731800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:28:51.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.847+0000 7fbb1b731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.847+0000 7fbb1b731800 20 INFO: main: starting shard=1 2024-03-09T14:28:51.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.847+0000 7fbb1b731800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:51.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.847+0000 7fbb1b731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.847+0000 7fbb1b731800 20 INFO: main: starting shard=2 2024-03-09T14:28:51.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.847+0000 7fbb1b731800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:28:51.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.848+0000 7fbb1b731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.848+0000 7fbb1b731800 20 INFO: main: starting shard=3 2024-03-09T14:28:51.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.848+0000 7fbb1b731800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:28:51.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.849+0000 7fbb1b731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.849+0000 7fbb1b731800 20 INFO: main: starting shard=4 2024-03-09T14:28:51.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.849+0000 7fbb1b731800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:28:51.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.850+0000 7fbb1b731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.850+0000 7fbb1b731800 20 INFO: main: starting shard=5 2024-03-09T14:28:51.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.850+0000 7fbb1b731800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:51.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.850+0000 7fbb1b731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.850+0000 7fbb1b731800 20 INFO: main: starting shard=6 2024-03-09T14:28:51.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.850+0000 7fbb1b731800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:28:51.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.851+0000 7fbb1b731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.851+0000 7fbb1b731800 20 INFO: main: starting shard=7 2024-03-09T14:28:51.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.851+0000 7fbb1b731800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:28:51.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.851+0000 7fbb1b731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.851+0000 7fbb1b731800 20 INFO: main: starting shard=8 2024-03-09T14:28:51.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.851+0000 7fbb1b731800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:51.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.852+0000 7fbb1b731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.852+0000 7fbb1b731800 20 INFO: main: starting shard=9 2024-03-09T14:28:51.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.852+0000 7fbb1b731800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:28:51.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.853+0000 7fbb1b731800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:51.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.853+0000 7fbb1b731800 20 INFO: main: starting shard=10 2024-03-09T14:28:51.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.853+0000 7fbb1b731800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:51.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.853+0000 7fbb1b731800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:28:51.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.853+0000 7fbb1b731800 20 INFO: main: done 2024-03-09T14:28:51.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.854+0000 7fb9cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:51.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.857+0000 7fbb1b731800 20 remove_watcher() i=0 2024-03-09T14:28:51.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.857+0000 7fbb1b731800 2 removed watcher, disabling cache 2024-03-09T14:28:51.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.858+0000 7fbb1b731800 20 remove_watcher() i=1 2024-03-09T14:28:51.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.860+0000 7fbb1b731800 20 remove_watcher() i=2 2024-03-09T14:28:51.862 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.861+0000 7fbb1b731800 20 remove_watcher() i=3 2024-03-09T14:28:51.863 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.863+0000 7fbb1b731800 20 remove_watcher() i=4 2024-03-09T14:28:51.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.864+0000 7fbb1b731800 20 remove_watcher() i=5 2024-03-09T14:28:51.865 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.865+0000 7fbb1b731800 20 remove_watcher() i=6 2024-03-09T14:28:51.866 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:51.866+0000 7fbb1b731800 20 remove_watcher() i=7 2024-03-09T14:28:51.902 INFO:tasks.workunit.client.0.smithi088.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-03-09T14:28:52.296 INFO:tasks.workunit.client.0.smithi088.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-03-09T14:28:52.680 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: bucket check unlinked finds unlistable entries 2024-03-09T14:28:52.680 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:52.681 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-03-09T14:28:52.712 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:52.713 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:52.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.745+0000 7f8457333800 20 rados->read ofs=0 len=0 2024-03-09T14:28:52.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.746+0000 7f8457333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:52.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.746+0000 7f8457333800 20 realm 2024-03-09T14:28:52.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.746+0000 7f8457333800 20 rados->read ofs=0 len=0 2024-03-09T14:28:52.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.746+0000 7f8457333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:52.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.746+0000 7f8457333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:52.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.746+0000 7f8457333800 20 rados->read ofs=0 len=0 2024-03-09T14:28:52.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.746+0000 7f8457333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:52.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.746+0000 7f8457333800 20 rados->read ofs=0 len=0 2024-03-09T14:28:52.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.747+0000 7f8457333800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:52.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.747+0000 7f8457333800 20 rados->read ofs=0 len=0 2024-03-09T14:28:52.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.748+0000 7f8457333800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:52.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.748+0000 7f8457333800 20 searching for the correct realm 2024-03-09T14:28:52.751 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.750+0000 7f84537d4640 0 -- 172.21.15.88:0/4097285876 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f844c0022c0 msgr2=0x7f844c0573f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:52.755 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.754+0000 7f844bfff640 0 -- 172.21.15.88:0/4097285876 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f844c006bb0 msgr2=0x7f844c091a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:28:52.961 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.960+0000 7f8457333800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:52.961 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.960+0000 7f8457333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:52.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.960+0000 7f8457333800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:52.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.960+0000 7f8457333800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:52.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.960+0000 7f8457333800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:52.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.960+0000 7f8457333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:52.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.960+0000 7f8457333800 20 rados->read ofs=0 len=0 2024-03-09T14:28:52.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.960+0000 7f8457333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:52.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.960+0000 7f8457333800 20 rados->read ofs=0 len=0 2024-03-09T14:28:52.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.961+0000 7f8457333800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:52.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.961+0000 7f8457333800 20 rados->read ofs=0 len=0 2024-03-09T14:28:52.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.961+0000 7f8457333800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:52.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.961+0000 7f8457333800 20 zone default found 2024-03-09T14:28:52.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.961+0000 7f8457333800 4 Realm: () 2024-03-09T14:28:52.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.961+0000 7f8457333800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:52.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.961+0000 7f8457333800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:52.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.961+0000 7f8457333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:52.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.961+0000 7f8457333800 20 zonegroup default 2024-03-09T14:28:52.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.961+0000 7f8457333800 20 rados->read ofs=0 len=0 2024-03-09T14:28:52.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.961+0000 7f8457333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:52.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.961+0000 7f8457333800 20 rados->read ofs=0 len=0 2024-03-09T14:28:52.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.962+0000 7f8457333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:52.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.962+0000 7f8457333800 20 rados->read ofs=0 len=0 2024-03-09T14:28:52.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.962+0000 7f8457333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:52.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.962+0000 7f8457333800 20 started sync module instance, tier type = 2024-03-09T14:28:52.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.962+0000 7f8457333800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:52.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.974+0000 7f8457333800 20 add_watcher() i=0 2024-03-09T14:28:52.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.974+0000 7f8457333800 20 add_watcher() i=1 2024-03-09T14:28:52.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.974+0000 7f8457333800 20 add_watcher() i=2 2024-03-09T14:28:52.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.974+0000 7f8457333800 20 add_watcher() i=3 2024-03-09T14:28:52.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.974+0000 7f8457333800 20 add_watcher() i=4 2024-03-09T14:28:52.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.974+0000 7f8457333800 20 add_watcher() i=5 2024-03-09T14:28:52.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.974+0000 7f8457333800 20 add_watcher() i=6 2024-03-09T14:28:52.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.975+0000 7f8457333800 20 add_watcher() i=7 2024-03-09T14:28:52.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.975+0000 7f8457333800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:52.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.978+0000 7f83097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:52.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.978+0000 7f8457333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:52.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.978+0000 7f8457333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:52.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.978+0000 7f8457333800 5 note: GC not initialized 2024-03-09T14:28:52.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.978+0000 7f8283fff640 20 reqs_thread_entry: start 2024-03-09T14:28:52.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.978+0000 7f8457333800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:52.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.978+0000 7f8457333800 20 Filter name: none 2024-03-09T14:28:52.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.979+0000 7f8281ffb640 20 reqs_thread_entry: start 2024-03-09T14:28:52.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.979+0000 7f8457333800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:28:52.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.979+0000 7f8457333800 20 rados->read ofs=0 len=0 2024-03-09T14:28:52.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.979+0000 7f8457333800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:52.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.979+0000 7f8457333800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:28:52.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.979+0000 7f8457333800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:28:52.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.979+0000 7f8457333800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 : miss 2024-03-09T14:28:52.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.979+0000 7f8457333800 20 rados->read ofs=0 len=0 2024-03-09T14:28:52.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.979+0000 7f8457333800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:52.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.979+0000 7f8457333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 info.flags=0x17 2024-03-09T14:28:52.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.979+0000 7f8457333800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 to cache LRU end 2024-03-09T14:28:52.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.979+0000 7f8457333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:28:52.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.979+0000 7f8457333800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:28:52.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.979+0000 7f8457333800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 2024-03-09T14:28:52.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.979+0000 7f8457333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:28:52.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.980+0000 7f8457333800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-09T14:28:52.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.980+0000 7f8457333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:52.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.980+0000 7f8457333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:28:52.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.981+0000 7f8457333800 1 NOTICE: finished shard 2 (0 entries found) 2024-03-09T14:28:52.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.981+0000 7f8457333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:28:52.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.982+0000 7f8457333800 1 NOTICE: finished shard 3 (0 entries found) 2024-03-09T14:28:52.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.982+0000 7f8457333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:28:52.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.982+0000 7f8457333800 1 NOTICE: finished shard 4 (0 entries found) 2024-03-09T14:28:52.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.982+0000 7f8457333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:52.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.983+0000 7f8457333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:28:52.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.983+0000 7f8457333800 1 NOTICE: finished shard 6 (0 entries found) 2024-03-09T14:28:52.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.983+0000 7f8457333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:28:52.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.984+0000 7f8457333800 1 NOTICE: finished shard 7 (0 entries found) 2024-03-09T14:28:52.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.984+0000 7f8457333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:52.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.984+0000 7f8457333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:28:52.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.985+0000 7f8457333800 1 NOTICE: finished shard 9 (0 entries found) 2024-03-09T14:28:52.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.985+0000 7f8457333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:52.986 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.985+0000 7f8457333800 1 NOTICE: finished shard 1 (1 entries found) 2024-03-09T14:28:52.986 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.985+0000 7f8457333800 1 NOTICE: finished shard 5 (1 entries found) 2024-03-09T14:28:52.986 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.986+0000 7f8457333800 1 NOTICE: finished shard 8 (1 entries found) 2024-03-09T14:28:52.987 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.986+0000 7f8457333800 1 NOTICE: finished shard 10 (1 entries found) 2024-03-09T14:28:52.987 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.986+0000 7f8457333800 1 NOTICE: finished all shards (4 entries found) 2024-03-09T14:28:52.987 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.987+0000 7f83097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:52.989 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.989+0000 7f8457333800 20 remove_watcher() i=0 2024-03-09T14:28:52.990 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.989+0000 7f8457333800 2 removed watcher, disabling cache 2024-03-09T14:28:52.990 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.990+0000 7f8457333800 20 remove_watcher() i=1 2024-03-09T14:28:52.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.991+0000 7f8457333800 20 remove_watcher() i=2 2024-03-09T14:28:52.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.992+0000 7f8457333800 20 remove_watcher() i=3 2024-03-09T14:28:52.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.993+0000 7f8457333800 20 remove_watcher() i=4 2024-03-09T14:28:52.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.994+0000 7f8457333800 20 remove_watcher() i=5 2024-03-09T14:28:52.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.995+0000 7f8457333800 20 remove_watcher() i=6 2024-03-09T14:28:52.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:52.996+0000 7f8457333800 20 remove_watcher() i=7 2024-03-09T14:28:53.006 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: unlinked entries are not listable 2024-03-09T14:28:53.006 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:53.123 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-03-09T14:28:53.123 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:53.257 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-03-09T14:28:53.257 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:53.258 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-09T14:28:53.291 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:53.291 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:53.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.324+0000 7fd31a7a2800 20 rados->read ofs=0 len=0 2024-03-09T14:28:53.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.325+0000 7fd31a7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:53.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.325+0000 7fd31a7a2800 20 realm 2024-03-09T14:28:53.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.325+0000 7fd31a7a2800 20 rados->read ofs=0 len=0 2024-03-09T14:28:53.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.325+0000 7fd31a7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:53.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.325+0000 7fd31a7a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:53.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.325+0000 7fd31a7a2800 20 rados->read ofs=0 len=0 2024-03-09T14:28:53.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.325+0000 7fd31a7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:53.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.325+0000 7fd31a7a2800 20 rados->read ofs=0 len=0 2024-03-09T14:28:53.327 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.326+0000 7fd31a7a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:53.327 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.326+0000 7fd31a7a2800 20 rados->read ofs=0 len=0 2024-03-09T14:28:53.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.327+0000 7fd31a7a2800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:53.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.327+0000 7fd31a7a2800 20 searching for the correct realm 2024-03-09T14:28:53.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.330+0000 7fd318aa6640 0 -- 172.21.15.88:0/1913477154 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fd31001f050 msgr2=0x7fd31002c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:53.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.536+0000 7fd30ffff640 0 -- 172.21.15.88:0/1913477154 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fd310039400 msgr2=0x7fd310039880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:53.743 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.742+0000 7fd31a7a2800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:53.745 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.742+0000 7fd31a7a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:53.745 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.742+0000 7fd31a7a2800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:53.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.742+0000 7fd31a7a2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:53.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.742+0000 7fd31a7a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:53.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.742+0000 7fd31a7a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:53.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.742+0000 7fd31a7a2800 20 rados->read ofs=0 len=0 2024-03-09T14:28:53.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.742+0000 7fd31a7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:53.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.742+0000 7fd31a7a2800 20 rados->read ofs=0 len=0 2024-03-09T14:28:53.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.743+0000 7fd31a7a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:53.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.743+0000 7fd31a7a2800 20 rados->read ofs=0 len=0 2024-03-09T14:28:53.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.743+0000 7fd31a7a2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:53.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.743+0000 7fd31a7a2800 20 zone default found 2024-03-09T14:28:53.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.743+0000 7fd31a7a2800 4 Realm: () 2024-03-09T14:28:53.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.743+0000 7fd31a7a2800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:53.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.743+0000 7fd31a7a2800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:53.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.743+0000 7fd31a7a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:53.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.743+0000 7fd31a7a2800 20 zonegroup default 2024-03-09T14:28:53.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.743+0000 7fd31a7a2800 20 rados->read ofs=0 len=0 2024-03-09T14:28:53.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.744+0000 7fd31a7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:53.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.744+0000 7fd31a7a2800 20 rados->read ofs=0 len=0 2024-03-09T14:28:53.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.744+0000 7fd31a7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:53.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.744+0000 7fd31a7a2800 20 rados->read ofs=0 len=0 2024-03-09T14:28:53.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.744+0000 7fd31a7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:53.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.744+0000 7fd31a7a2800 20 started sync module instance, tier type = 2024-03-09T14:28:53.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.744+0000 7fd31a7a2800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:53.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.761+0000 7fd31a7a2800 20 add_watcher() i=0 2024-03-09T14:28:53.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.761+0000 7fd31a7a2800 20 add_watcher() i=1 2024-03-09T14:28:53.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.761+0000 7fd31a7a2800 20 add_watcher() i=2 2024-03-09T14:28:53.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.761+0000 7fd31a7a2800 20 add_watcher() i=3 2024-03-09T14:28:53.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.761+0000 7fd31a7a2800 20 add_watcher() i=4 2024-03-09T14:28:53.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.761+0000 7fd31a7a2800 20 add_watcher() i=5 2024-03-09T14:28:53.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.761+0000 7fd31a7a2800 20 add_watcher() i=6 2024-03-09T14:28:53.765 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.765+0000 7fd31a7a2800 20 add_watcher() i=7 2024-03-09T14:28:53.765 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.765+0000 7fd31a7a2800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:53.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.766+0000 7fd1cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:53.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.767+0000 7fd31a7a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:53.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.767+0000 7fd31a7a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:53.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.767+0000 7fd31a7a2800 5 note: GC not initialized 2024-03-09T14:28:53.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.767+0000 7fd1cdfdb640 20 reqs_thread_entry: start 2024-03-09T14:28:53.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.767+0000 7fd31a7a2800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:53.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.767+0000 7fd31a7a2800 20 Filter name: none 2024-03-09T14:28:53.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.767+0000 7fd13f7fe640 20 reqs_thread_entry: start 2024-03-09T14:28:53.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.767+0000 7fd31a7a2800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:28:53.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.767+0000 7fd31a7a2800 20 rados->read ofs=0 len=0 2024-03-09T14:28:53.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.767+0000 7fd31a7a2800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:53.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.767+0000 7fd31a7a2800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:28:53.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.767+0000 7fd31a7a2800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:28:53.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.768+0000 7fd31a7a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 : miss 2024-03-09T14:28:53.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.768+0000 7fd31a7a2800 20 rados->read ofs=0 len=0 2024-03-09T14:28:53.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.768+0000 7fd31a7a2800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:53.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.768+0000 7fd31a7a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 info.flags=0x17 2024-03-09T14:28:53.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.768+0000 7fd31a7a2800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 to cache LRU end 2024-03-09T14:28:53.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.768+0000 7fd31a7a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:28:53.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.768+0000 7fd31a7a2800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:28:53.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.768+0000 7fd31a7a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 2024-03-09T14:28:53.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.768+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:28:53.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.768+0000 7fd31a7a2800 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-09T14:28:53.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.768+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:53.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.769+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:28:53.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.769+0000 7fd31a7a2800 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-09T14:28:53.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.769+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:28:53.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.770+0000 7fd31a7a2800 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-09T14:28:53.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.770+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:28:53.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.770+0000 7fd31a7a2800 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-09T14:28:53.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.770+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:53.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.771+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:28:53.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.771+0000 7fd31a7a2800 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-09T14:28:53.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.771+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:28:53.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.772+0000 7fd31a7a2800 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-09T14:28:53.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.772+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:53.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.772+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:28:53.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.772+0000 7fd31a7a2800 1 NOTICE: finished shard 9 (0 entries removed) 2024-03-09T14:28:53.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.772+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:53.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.773+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:53.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.773+0000 7fd31a7a2800 20 get_obj_state: octx=0x55f33a6a3540 obj=check-bucket:e state=0x55f33a972378 s->prefetch_data=0 2024-03-09T14:28:53.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.773+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:53.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.774+0000 7fd31a7a2800 20 get_obj_state: octx=0x55f33a6cb150 obj=check-bucket:d state=0x55f33a96fac8 s->prefetch_data=0 2024-03-09T14:28:53.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.774+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:53.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.774+0000 7fd31a7a2800 20 get_obj_state: octx=0x55f33a979bd0 obj=check-bucket:c state=0x55f33a975e88 s->prefetch_data=0 2024-03-09T14:28:53.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.774+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:53.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.774+0000 7fd31a7a2800 20 get_obj_state: octx=0x55f33a97a8e0 obj=check-bucket:f state=0x55f33aa0f7a8 s->prefetch_data=0 2024-03-09T14:28:53.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.774+0000 7fd31a7a2800 20 get_obj_state: setting s->obj_tag to 5s8w2hbqsdp20bl8qea73ay9gmh64got 2024-03-09T14:28:53.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.774+0000 7fd31a7a2800 20 get_obj_state_impl: setting s->olh_tag to 1me8v89tg9krjndnrv4cixc4kqpuyvt2 2024-03-09T14:28:53.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.774+0000 7fd31a7a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1me8v89tg9krjndnrv4cixc4kqpuyvt2 2024-03-09T14:28:53.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.774+0000 7fd31a7a2800 20 get_obj_state: setting s->obj_tag to 3oybltweudqrfnzrt40f7lloc235b31k 2024-03-09T14:28:53.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.774+0000 7fd31a7a2800 20 get_obj_state_impl: setting s->olh_tag to 0xmxxjuxn3op4mlglo2hmjwvegdul306 2024-03-09T14:28:53.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.774+0000 7fd31a7a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0xmxxjuxn3op4mlglo2hmjwvegdul306 2024-03-09T14:28:53.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.774+0000 7fd31a7a2800 20 get_obj_state: setting s->obj_tag to pgg2ji32tt94owoecpsgaegz0wqolil0 2024-03-09T14:28:53.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.774+0000 7fd31a7a2800 20 get_obj_state_impl: setting s->olh_tag to twngq40f5t0secl812keml8l2rzposem 2024-03-09T14:28:53.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.774+0000 7fd31a7a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=twngq40f5t0secl812keml8l2rzposem 2024-03-09T14:28:53.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.775+0000 7fd31a7a2800 20 get_obj_state: setting s->obj_tag to olee9fn8p3n5xxegtae8rsf3ma78m108 2024-03-09T14:28:53.777 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.775+0000 7fd31a7a2800 20 get_obj_state_impl: setting s->olh_tag to xt9dzpbnntf35b04shcn2urhxu24jee5 2024-03-09T14:28:53.777 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.775+0000 7fd31a7a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xt9dzpbnntf35b04shcn2urhxu24jee5 2024-03-09T14:28:53.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.777+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:53.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.777+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:53.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.777+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:53.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.777+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:53.781 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.781+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:53.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.781+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:53.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.781+0000 7fd31a7a2800 20 olh_log_entry: epoch=3 op=3 key=c[34r67vnuv8V5DrKwdz6UtC360-mc2Hd] 2024-03-09T14:28:53.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.781+0000 7fd31a7a2800 20 get_obj_state: octx=0x55f33a979bd0 obj=check-bucket:_:34r67vnuv8V5DrKwdz6UtC360-mc2Hd_c state=0x55f33aa1f4f8 s->prefetch_data=0 2024-03-09T14:28:53.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.781+0000 7fd31a7a2800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-03-09T14:28:53.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.781+0000 7fd31a7a2800 20 olh_log_entry: epoch=2 op=3 key=e[-Zkc1QhKlcOiLd5f36bW3wOejdhY.WP] 2024-03-09T14:28:53.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.781+0000 7fd31a7a2800 20 get_obj_state: octx=0x55f33a6a3540 obj=check-bucket:_:-Zkc1QhKlcOiLd5f36bW3wOejdhY.WP_e state=0x55f33aa2ec68 s->prefetch_data=0 2024-03-09T14:28:53.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.781+0000 7fd31a7a2800 10 manifest: total_size = 22 2024-03-09T14:28:53.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.781+0000 7fd31a7a2800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.7755446377673984396 2024-03-09T14:28:53.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.781+0000 7fd31a7a2800 20 get_obj_state: octx=0x55f33a979bd0 obj=check-bucket:_:34r67vnuv8V5DrKwdz6UtC360-mc2Hd_c state=0x55f33aa1f4f8 s->prefetch_data=0 2024-03-09T14:28:53.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.781+0000 7fd31a7a2800 20 prepare_atomic_modification: state is not atomic. state=0x55f33aa1f4f8 2024-03-09T14:28:53.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.781+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:53.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.782+0000 7fd31a7a2800 10 manifest: total_size = 22 2024-03-09T14:28:53.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.782+0000 7fd31a7a2800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.3659805038111592045 2024-03-09T14:28:53.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.782+0000 7fd31a7a2800 20 get_obj_state: octx=0x55f33a6a3540 obj=check-bucket:_:-Zkc1QhKlcOiLd5f36bW3wOejdhY.WP_e state=0x55f33aa2ec68 s->prefetch_data=0 2024-03-09T14:28:53.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.782+0000 7fd31a7a2800 20 prepare_atomic_modification: state is not atomic. state=0x55f33aa2ec68 2024-03-09T14:28:53.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.782+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:53.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.782+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:53.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.782+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:53.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.782+0000 7fd31a7a2800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-03-09T14:28:53.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.782+0000 7fd31a7a2800 20 olh_log_entry: epoch=2 op=3 key=f[d3O9UdM4odau8KQOmKW7mClVQvh4KAD] 2024-03-09T14:28:53.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.782+0000 7fd31a7a2800 20 get_obj_state: octx=0x55f33a97a8e0 obj=check-bucket:_:d3O9UdM4odau8KQOmKW7mClVQvh4KAD_f state=0x55f33aa226b8 s->prefetch_data=0 2024-03-09T14:28:53.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.783+0000 7fd31a7a2800 20 olh_log_entry: epoch=3 op=3 key=d[B6kIwQr8NpM--.NVJ4AjONZkca539xM] 2024-03-09T14:28:53.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.783+0000 7fd31a7a2800 20 get_obj_state: octx=0x55f33a6cb150 obj=check-bucket:_:B6kIwQr8NpM--.NVJ4AjONZkca539xM_d state=0x55f33aa40f18 s->prefetch_data=0 2024-03-09T14:28:53.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.783+0000 7fd31a7a2800 10 manifest: total_size = 22 2024-03-09T14:28:53.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.783+0000 7fd31a7a2800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.9319839797335016318 2024-03-09T14:28:53.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.783+0000 7fd31a7a2800 20 get_obj_state: octx=0x55f33a97a8e0 obj=check-bucket:_:d3O9UdM4odau8KQOmKW7mClVQvh4KAD_f state=0x55f33aa226b8 s->prefetch_data=0 2024-03-09T14:28:53.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.783+0000 7fd31a7a2800 20 prepare_atomic_modification: state is not atomic. state=0x55f33aa226b8 2024-03-09T14:28:53.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.783+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:53.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.783+0000 7fd31a7a2800 10 manifest: total_size = 9 2024-03-09T14:28:53.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.783+0000 7fd31a7a2800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.8866761590558616315 2024-03-09T14:28:53.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.783+0000 7fd31a7a2800 20 get_obj_state: octx=0x55f33a6cb150 obj=check-bucket:_:B6kIwQr8NpM--.NVJ4AjONZkca539xM_d state=0x55f33aa40f18 s->prefetch_data=0 2024-03-09T14:28:53.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.783+0000 7fd31a7a2800 20 prepare_atomic_modification: state is not atomic. state=0x55f33aa40f18 2024-03-09T14:28:53.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.783+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:53.791 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.790+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:53.791 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.790+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:53.792 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.791+0000 7fd1ef7fe640 20 handle_completion(): completion ok for obj=c[34r67vnuv8V5DrKwdz6UtC360-mc2Hd] 2024-03-09T14:28:53.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.794+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:53.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.794+0000 7fd31a7a2800 1 NOTICE: finished shard 8 (1 entries removed) 2024-03-09T14:28:53.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.795+0000 7fd31a7a2800 20 get_obj_state: octx=0x55f33a97a8e0 obj=check-bucket:f state=0x55f33aa0f7a8 s->prefetch_data=0 2024-03-09T14:28:53.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.795+0000 7fd31a7a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xt9dzpbnntf35b04shcn2urhxu24jee5 2024-03-09T14:28:53.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.795+0000 7fd31a7a2800 20 get_obj_state: octx=0x55f33a6a3540 obj=check-bucket:e state=0x55f33a972378 s->prefetch_data=0 2024-03-09T14:28:53.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.795+0000 7fd31a7a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1me8v89tg9krjndnrv4cixc4kqpuyvt2 2024-03-09T14:28:53.797 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.797+0000 7fd1eeffd640 20 handle_completion(): completion ok for obj=e[-Zkc1QhKlcOiLd5f36bW3wOejdhY.WP] 2024-03-09T14:28:53.798 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.797+0000 7fd1eeffd640 20 handle_completion(): completion ok for obj=f[d3O9UdM4odau8KQOmKW7mClVQvh4KAD] 2024-03-09T14:28:53.800 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.799+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:53.800 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.799+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:53.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.802+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:53.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.802+0000 7fd1ef7fe640 20 handle_completion(): completion ok for obj=d[B6kIwQr8NpM--.NVJ4AjONZkca539xM] 2024-03-09T14:28:53.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.803+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:53.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.803+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:53.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.803+0000 7fd31a7a2800 1 NOTICE: finished shard 5 (1 entries removed) 2024-03-09T14:28:53.805 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.805+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:53.806 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.805+0000 7fd31a7a2800 1 NOTICE: finished shard 10 (1 entries removed) 2024-03-09T14:28:53.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.807+0000 7fd31a7a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:53.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.807+0000 7fd31a7a2800 1 NOTICE: finished shard 1 (1 entries removed) 2024-03-09T14:28:53.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.807+0000 7fd31a7a2800 1 NOTICE: finished all shards (4 entries removed) 2024-03-09T14:28:53.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.808+0000 7fd1cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:53.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.811+0000 7fd31a7a2800 20 remove_watcher() i=0 2024-03-09T14:28:53.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.811+0000 7fd31a7a2800 2 removed watcher, disabling cache 2024-03-09T14:28:53.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.812+0000 7fd31a7a2800 20 remove_watcher() i=1 2024-03-09T14:28:53.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.813+0000 7fd31a7a2800 20 remove_watcher() i=2 2024-03-09T14:28:53.815 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.814+0000 7fd31a7a2800 20 remove_watcher() i=3 2024-03-09T14:28:53.816 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.815+0000 7fd31a7a2800 20 remove_watcher() i=4 2024-03-09T14:28:53.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.816+0000 7fd31a7a2800 20 remove_watcher() i=5 2024-03-09T14:28:53.818 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.817+0000 7fd31a7a2800 20 remove_watcher() i=6 2024-03-09T14:28:53.818 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:53.818+0000 7fd31a7a2800 20 remove_watcher() i=7 2024-03-09T14:28:53.907 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: bucket check unlinked does not affect normal entries 2024-03-09T14:28:53.907 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:54.071 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-03-09T14:28:54.071 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:54.072 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-03-09T14:28:54.104 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:54.104 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:54.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.137+0000 7f3142b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:28:54.339 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.338+0000 7f3142b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:54.340 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.338+0000 7f3142b1f800 20 realm 2024-03-09T14:28:54.340 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.338+0000 7f3142b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:28:54.340 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.339+0000 7f3142b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:54.340 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.339+0000 7f3142b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:54.340 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.339+0000 7f3142b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:28:54.340 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.339+0000 7f3142b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:54.340 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.339+0000 7f3142b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:28:54.341 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.340+0000 7f3142b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:54.341 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.340+0000 7f3142b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:28:54.341 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.341+0000 7f3142b1f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:54.341 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.341+0000 7f3142b1f800 20 searching for the correct realm 2024-03-09T14:28:54.343 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.343+0000 7f313f0e9640 0 -- 172.21.15.88:0/3968188376 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f3138033060 msgr2=0x7f313805d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:54.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.549+0000 7f3137fff640 0 -- 172.21.15.88:0/3968188376 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f313807d960 msgr2=0x7f3138062150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:54.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.755+0000 7f3142b1f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:54.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.755+0000 7f3142b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:54.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.755+0000 7f3142b1f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:54.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.755+0000 7f3142b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:54.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.755+0000 7f3142b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:54.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.755+0000 7f3142b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:54.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.755+0000 7f3142b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:28:54.757 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.755+0000 7f3142b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:54.757 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.755+0000 7f3142b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:28:54.758 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.756+0000 7f3142b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:54.758 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.756+0000 7f3142b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:28:54.758 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.756+0000 7f3142b1f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:54.758 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.756+0000 7f3142b1f800 20 zone default found 2024-03-09T14:28:54.758 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.756+0000 7f3142b1f800 4 Realm: () 2024-03-09T14:28:54.758 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.756+0000 7f3142b1f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:54.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.756+0000 7f3142b1f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:54.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.756+0000 7f3142b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:54.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.756+0000 7f3142b1f800 20 zonegroup default 2024-03-09T14:28:54.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.756+0000 7f3142b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:28:54.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.756+0000 7f3142b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:54.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.756+0000 7f3142b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:28:54.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.757+0000 7f3142b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:54.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.757+0000 7f3142b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:28:54.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.757+0000 7f3142b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:54.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.757+0000 7f3142b1f800 20 started sync module instance, tier type = 2024-03-09T14:28:54.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.757+0000 7f3142b1f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:54.768 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.768+0000 7f3142b1f800 20 add_watcher() i=0 2024-03-09T14:28:54.768 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.768+0000 7f3142b1f800 20 add_watcher() i=1 2024-03-09T14:28:54.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.768+0000 7f3142b1f800 20 add_watcher() i=2 2024-03-09T14:28:54.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.768+0000 7f3142b1f800 20 add_watcher() i=3 2024-03-09T14:28:54.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.768+0000 7f3142b1f800 20 add_watcher() i=4 2024-03-09T14:28:54.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.768+0000 7f3142b1f800 20 add_watcher() i=5 2024-03-09T14:28:54.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.769+0000 7f3142b1f800 20 add_watcher() i=6 2024-03-09T14:28:54.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.770+0000 7f3142b1f800 20 add_watcher() i=7 2024-03-09T14:28:54.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.770+0000 7f3142b1f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:54.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.773+0000 7f2ff57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:54.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.773+0000 7f3142b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:54.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.773+0000 7f3142b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:54.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.773+0000 7f3142b1f800 5 note: GC not initialized 2024-03-09T14:28:54.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.773+0000 7f2f6ffff640 20 reqs_thread_entry: start 2024-03-09T14:28:54.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:54.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 20 Filter name: none 2024-03-09T14:28:54.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f2f6dffb640 20 reqs_thread_entry: start 2024-03-09T14:28:54.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:28:54.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:28:54.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:54.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:28:54.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:28:54.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 : miss 2024-03-09T14:28:54.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:28:54.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:54.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 info.flags=0x17 2024-03-09T14:28:54.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 to cache LRU end 2024-03-09T14:28:54.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:28:54.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:28:54.777 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 2024-03-09T14:28:54.777 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.774+0000 7f3142b1f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:28:54.777 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.775+0000 7f3142b1f800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-09T14:28:54.777 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.775+0000 7f3142b1f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:54.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.775+0000 7f3142b1f800 1 NOTICE: finished shard 1 (0 entries found) 2024-03-09T14:28:54.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.775+0000 7f3142b1f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:28:54.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.776+0000 7f3142b1f800 1 NOTICE: finished shard 2 (0 entries found) 2024-03-09T14:28:54.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.776+0000 7f3142b1f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:28:54.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.777+0000 7f3142b1f800 1 NOTICE: finished shard 3 (0 entries found) 2024-03-09T14:28:54.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.777+0000 7f3142b1f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:28:54.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.777+0000 7f3142b1f800 1 NOTICE: finished shard 4 (0 entries found) 2024-03-09T14:28:54.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.777+0000 7f3142b1f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:54.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.778+0000 7f3142b1f800 1 NOTICE: finished shard 5 (0 entries found) 2024-03-09T14:28:54.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.778+0000 7f3142b1f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:28:54.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.779+0000 7f3142b1f800 1 NOTICE: finished shard 6 (0 entries found) 2024-03-09T14:28:54.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.779+0000 7f3142b1f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:28:54.780 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.779+0000 7f3142b1f800 1 NOTICE: finished shard 7 (0 entries found) 2024-03-09T14:28:54.780 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.779+0000 7f3142b1f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:54.780 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.780+0000 7f3142b1f800 1 NOTICE: finished shard 8 (0 entries found) 2024-03-09T14:28:54.781 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.780+0000 7f3142b1f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:28:54.781 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.780+0000 7f3142b1f800 1 NOTICE: finished shard 9 (0 entries found) 2024-03-09T14:28:54.781 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.780+0000 7f3142b1f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:54.781 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.781+0000 7f3142b1f800 1 NOTICE: finished shard 10 (0 entries found) 2024-03-09T14:28:54.781 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.781+0000 7f3142b1f800 1 NOTICE: finished all shards (0 entries found) 2024-03-09T14:28:54.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.782+0000 7f2ff57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:54.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.784+0000 7f3142b1f800 20 remove_watcher() i=0 2024-03-09T14:28:54.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.784+0000 7f3142b1f800 2 removed watcher, disabling cache 2024-03-09T14:28:54.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.785+0000 7f3142b1f800 20 remove_watcher() i=1 2024-03-09T14:28:54.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.786+0000 7f3142b1f800 20 remove_watcher() i=2 2024-03-09T14:28:54.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.788+0000 7f3142b1f800 20 remove_watcher() i=3 2024-03-09T14:28:54.789 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.789+0000 7f3142b1f800 20 remove_watcher() i=4 2024-03-09T14:28:54.790 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.790+0000 7f3142b1f800 20 remove_watcher() i=5 2024-03-09T14:28:54.791 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.791+0000 7f3142b1f800 20 remove_watcher() i=6 2024-03-09T14:28:54.792 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:54.792+0000 7f3142b1f800 20 remove_watcher() i=7 2024-03-09T14:28:54.973 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-09T14:28:54.999 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:55.000 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:55.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.032+0000 7fab34311800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.033+0000 7fab34311800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:55.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.033+0000 7fab34311800 20 realm 2024-03-09T14:28:55.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.033+0000 7fab34311800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.033+0000 7fab34311800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:55.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.033+0000 7fab34311800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:55.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.034+0000 7fab34311800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.034+0000 7fab34311800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:55.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.034+0000 7fab34311800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.035+0000 7fab34311800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:55.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.035+0000 7fab34311800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.035+0000 7fab34311800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:55.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.035+0000 7fab34311800 20 searching for the correct realm 2024-03-09T14:28:55.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.038+0000 7fab3260e640 0 -- 172.21.15.88:0/1190061248 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fab2403f040 msgr2=0x7fab24018410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:55.244 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.243+0000 7fab3160c640 0 -- 172.21.15.88:0/1190061248 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fab24063960 msgr2=0x7fab2404a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:55.451 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.450+0000 7fab34311800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:55.451 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.450+0000 7fab34311800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:55.451 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.450+0000 7fab34311800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:55.451 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.450+0000 7fab34311800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:55.451 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.450+0000 7fab34311800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:55.451 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.450+0000 7fab34311800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:55.452 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.450+0000 7fab34311800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.452 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.450+0000 7fab34311800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:55.452 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.450+0000 7fab34311800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.451+0000 7fab34311800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:55.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.451+0000 7fab34311800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.451+0000 7fab34311800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:55.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.451+0000 7fab34311800 20 zone default found 2024-03-09T14:28:55.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.451+0000 7fab34311800 4 Realm: () 2024-03-09T14:28:55.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.451+0000 7fab34311800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:55.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.451+0000 7fab34311800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:55.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.451+0000 7fab34311800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:55.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.451+0000 7fab34311800 20 zonegroup default 2024-03-09T14:28:55.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.451+0000 7fab34311800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.451+0000 7fab34311800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:55.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.451+0000 7fab34311800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.452+0000 7fab34311800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:55.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.452+0000 7fab34311800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.452+0000 7fab34311800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:55.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.452+0000 7fab34311800 20 started sync module instance, tier type = 2024-03-09T14:28:55.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.452+0000 7fab34311800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:55.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.463+0000 7fab34311800 20 add_watcher() i=0 2024-03-09T14:28:55.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.463+0000 7fab34311800 20 add_watcher() i=1 2024-03-09T14:28:55.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.463+0000 7fab34311800 20 add_watcher() i=2 2024-03-09T14:28:55.464 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.463+0000 7fab34311800 20 add_watcher() i=3 2024-03-09T14:28:55.464 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.463+0000 7fab34311800 20 add_watcher() i=4 2024-03-09T14:28:55.464 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.463+0000 7fab34311800 20 add_watcher() i=5 2024-03-09T14:28:55.464 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.463+0000 7fab34311800 20 add_watcher() i=6 2024-03-09T14:28:55.464 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.464+0000 7fab34311800 20 add_watcher() i=7 2024-03-09T14:28:55.464 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.464+0000 7fab34311800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:55.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.465+0000 7fa9db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:55.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.466+0000 7fab34311800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:55.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.466+0000 7fab34311800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:55.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.466+0000 7fab34311800 5 note: GC not initialized 2024-03-09T14:28:55.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.466+0000 7fa9da7fc640 20 reqs_thread_entry: start 2024-03-09T14:28:55.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.466+0000 7fab34311800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:55.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.466+0000 7fab34311800 20 Filter name: none 2024-03-09T14:28:55.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.466+0000 7fa953fff640 20 reqs_thread_entry: start 2024-03-09T14:28:55.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.466+0000 7fab34311800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.468 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.467+0000 7fab34311800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:55.468 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.467+0000 7fab34311800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.467+0000 7fab34311800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:55.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.467+0000 7fab34311800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:28:55.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.467+0000 7fab34311800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:28:55.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.467+0000 7fab34311800 20 INFO: main: starting shard=0 2024-03-09T14:28:55.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.467+0000 7fab34311800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:28:55.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.468+0000 7fab34311800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.468+0000 7fab34311800 20 INFO: main: starting shard=1 2024-03-09T14:28:55.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.468+0000 7fab34311800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:55.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.468+0000 7fab34311800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.468+0000 7fab34311800 20 INFO: main: starting shard=2 2024-03-09T14:28:55.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.468+0000 7fab34311800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:28:55.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.469+0000 7fab34311800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.469+0000 7fab34311800 20 INFO: main: starting shard=3 2024-03-09T14:28:55.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.469+0000 7fab34311800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:28:55.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.469+0000 7fab34311800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.469+0000 7fab34311800 20 INFO: main: starting shard=4 2024-03-09T14:28:55.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.469+0000 7fab34311800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:28:55.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.470+0000 7fab34311800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.470+0000 7fab34311800 20 INFO: main: starting shard=5 2024-03-09T14:28:55.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.470+0000 7fab34311800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:55.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.470+0000 7fab34311800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-03-09T14:28:55.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.470+0000 7fab34311800 20 INFO: main: starting shard=6 2024-03-09T14:28:55.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.470+0000 7fab34311800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:28:55.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.471+0000 7fab34311800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.471+0000 7fab34311800 20 INFO: main: starting shard=7 2024-03-09T14:28:55.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.471+0000 7fab34311800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:28:55.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.471+0000 7fab34311800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.471+0000 7fab34311800 20 INFO: main: starting shard=8 2024-03-09T14:28:55.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.471+0000 7fab34311800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:55.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.472+0000 7fab34311800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.472+0000 7fab34311800 20 INFO: main: starting shard=9 2024-03-09T14:28:55.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.472+0000 7fab34311800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:28:55.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.472+0000 7fab34311800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.472+0000 7fab34311800 20 INFO: main: starting shard=10 2024-03-09T14:28:55.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.472+0000 7fab34311800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:55.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.473+0000 7fab34311800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.473+0000 7fab34311800 20 INFO: main: done 2024-03-09T14:28:55.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.474+0000 7fa9db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:55.477 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.476+0000 7fab34311800 20 remove_watcher() i=0 2024-03-09T14:28:55.477 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.476+0000 7fab34311800 2 removed watcher, disabling cache 2024-03-09T14:28:55.478 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.477+0000 7fab34311800 20 remove_watcher() i=1 2024-03-09T14:28:55.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.478+0000 7fab34311800 20 remove_watcher() i=2 2024-03-09T14:28:55.480 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.480+0000 7fab34311800 20 remove_watcher() i=3 2024-03-09T14:28:55.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.481+0000 7fab34311800 20 remove_watcher() i=4 2024-03-09T14:28:55.483 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.482+0000 7fab34311800 20 remove_watcher() i=5 2024-03-09T14:28:55.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.483+0000 7fab34311800 20 remove_watcher() i=6 2024-03-09T14:28:55.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.484+0000 7fab34311800 20 remove_watcher() i=7 2024-03-09T14:28:55.496 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-09T14:28:55.525 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:55.525 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:55.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.557+0000 7fe7c1d11800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.559+0000 7fe7c1d11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:55.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.559+0000 7fe7c1d11800 20 realm 2024-03-09T14:28:55.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.559+0000 7fe7c1d11800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.559+0000 7fe7c1d11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:55.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.559+0000 7fe7c1d11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:55.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.559+0000 7fe7c1d11800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.559+0000 7fe7c1d11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:55.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.559+0000 7fe7c1d11800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.560+0000 7fe7c1d11800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:55.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.560+0000 7fe7c1d11800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.560+0000 7fe7c1d11800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:55.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.561+0000 7fe7c1d11800 20 searching for the correct realm 2024-03-09T14:28:55.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.563+0000 7fe7c0015640 0 -- 172.21.15.88:0/2573217826 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fe7b805e050 msgr2=0x7fe7b8099300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:55.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.768+0000 7fe7bf013640 0 -- 172.21.15.88:0/2573217826 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fe7b8069720 msgr2=0x7fe7b80af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:55.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.975+0000 7fe7c1d11800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:55.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.975+0000 7fe7c1d11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:55.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.975+0000 7fe7c1d11800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:55.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.975+0000 7fe7c1d11800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:55.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.975+0000 7fe7c1d11800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:55.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.975+0000 7fe7c1d11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:55.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.975+0000 7fe7c1d11800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.975+0000 7fe7c1d11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:55.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.975+0000 7fe7c1d11800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.976+0000 7fe7c1d11800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:55.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.976+0000 7fe7c1d11800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.976+0000 7fe7c1d11800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:55.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.976+0000 7fe7c1d11800 20 zone default found 2024-03-09T14:28:55.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.976+0000 7fe7c1d11800 4 Realm: () 2024-03-09T14:28:55.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.976+0000 7fe7c1d11800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:55.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.976+0000 7fe7c1d11800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:55.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.976+0000 7fe7c1d11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:55.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.976+0000 7fe7c1d11800 20 zonegroup default 2024-03-09T14:28:55.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.976+0000 7fe7c1d11800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.976+0000 7fe7c1d11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:55.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.976+0000 7fe7c1d11800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.977+0000 7fe7c1d11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:55.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.977+0000 7fe7c1d11800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.977+0000 7fe7c1d11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:55.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.977+0000 7fe7c1d11800 20 started sync module instance, tier type = 2024-03-09T14:28:55.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.977+0000 7fe7c1d11800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:55.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.987+0000 7fe7c1d11800 20 add_watcher() i=0 2024-03-09T14:28:55.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.987+0000 7fe7c1d11800 20 add_watcher() i=1 2024-03-09T14:28:55.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.987+0000 7fe7c1d11800 20 add_watcher() i=2 2024-03-09T14:28:55.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.987+0000 7fe7c1d11800 20 add_watcher() i=3 2024-03-09T14:28:55.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.987+0000 7fe7c1d11800 20 add_watcher() i=4 2024-03-09T14:28:55.989 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.987+0000 7fe7c1d11800 20 add_watcher() i=5 2024-03-09T14:28:55.989 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.987+0000 7fe7c1d11800 20 add_watcher() i=6 2024-03-09T14:28:55.991 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.990+0000 7fe7c1d11800 20 add_watcher() i=7 2024-03-09T14:28:55.991 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.990+0000 7fe7c1d11800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:55.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.992+0000 7fe675fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:55.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.992+0000 7fe7c1d11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:55.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.992+0000 7fe7c1d11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:55.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.992+0000 7fe7c1d11800 5 note: GC not initialized 2024-03-09T14:28:55.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.992+0000 7fe674fe1640 20 reqs_thread_entry: start 2024-03-09T14:28:55.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.993+0000 7fe7c1d11800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:55.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.993+0000 7fe7c1d11800 20 Filter name: none 2024-03-09T14:28:55.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.993+0000 7fe5ee7fc640 20 reqs_thread_entry: start 2024-03-09T14:28:55.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.993+0000 7fe7c1d11800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.993+0000 7fe7c1d11800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:55.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.993+0000 7fe7c1d11800 20 rados->read ofs=0 len=0 2024-03-09T14:28:55.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.993+0000 7fe7c1d11800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:55.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.993+0000 7fe7c1d11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:28:55.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.993+0000 7fe7c1d11800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:28:55.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.993+0000 7fe7c1d11800 20 INFO: main: starting shard=0 2024-03-09T14:28:55.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.993+0000 7fe7c1d11800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:28:55.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.994+0000 7fe7c1d11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.994+0000 7fe7c1d11800 20 INFO: main: starting shard=1 2024-03-09T14:28:55.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.994+0000 7fe7c1d11800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:55.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.994+0000 7fe7c1d11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.994+0000 7fe7c1d11800 20 INFO: main: starting shard=2 2024-03-09T14:28:55.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.994+0000 7fe7c1d11800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:28:55.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.995+0000 7fe7c1d11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.995+0000 7fe7c1d11800 20 INFO: main: starting shard=3 2024-03-09T14:28:55.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.995+0000 7fe7c1d11800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:28:55.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.995+0000 7fe7c1d11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.995+0000 7fe7c1d11800 20 INFO: main: starting shard=4 2024-03-09T14:28:55.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.995+0000 7fe7c1d11800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:28:55.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.996+0000 7fe7c1d11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.996+0000 7fe7c1d11800 20 INFO: main: starting shard=5 2024-03-09T14:28:55.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.996+0000 7fe7c1d11800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:55.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.996+0000 7fe7c1d11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.997+0000 7fe7c1d11800 20 INFO: main: starting shard=6 2024-03-09T14:28:55.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.997+0000 7fe7c1d11800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:28:55.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.997+0000 7fe7c1d11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.997+0000 7fe7c1d11800 20 INFO: main: starting shard=7 2024-03-09T14:28:55.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.997+0000 7fe7c1d11800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:28:55.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.998+0000 7fe7c1d11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.998+0000 7fe7c1d11800 20 INFO: main: starting shard=8 2024-03-09T14:28:55.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.998+0000 7fe7c1d11800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:55.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.998+0000 7fe7c1d11800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-03-09T14:28:55.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.998+0000 7fe7c1d11800 20 INFO: main: starting shard=9 2024-03-09T14:28:55.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.998+0000 7fe7c1d11800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:28:55.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.999+0000 7fe7c1d11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:55.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.999+0000 7fe7c1d11800 20 INFO: main: starting shard=10 2024-03-09T14:28:56.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.999+0000 7fe7c1d11800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:56.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.999+0000 7fe7c1d11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:56.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:55.999+0000 7fe7c1d11800 20 INFO: main: done 2024-03-09T14:28:56.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.000+0000 7fe675fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:56.003 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.002+0000 7fe7c1d11800 20 remove_watcher() i=0 2024-03-09T14:28:56.003 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.002+0000 7fe7c1d11800 2 removed watcher, disabling cache 2024-03-09T14:28:56.004 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.003+0000 7fe7c1d11800 20 remove_watcher() i=1 2024-03-09T14:28:56.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.005+0000 7fe7c1d11800 20 remove_watcher() i=2 2024-03-09T14:28:56.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.006+0000 7fe7c1d11800 20 remove_watcher() i=3 2024-03-09T14:28:56.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.007+0000 7fe7c1d11800 20 remove_watcher() i=4 2024-03-09T14:28:56.009 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.008+0000 7fe7c1d11800 20 remove_watcher() i=5 2024-03-09T14:28:56.010 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.009+0000 7fe7c1d11800 20 remove_watcher() i=6 2024-03-09T14:28:56.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.010+0000 7fe7c1d11800 20 remove_watcher() i=7 2024-03-09T14:28:56.020 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: bucket check olh finds leftover OLH entries 2024-03-09T14:28:56.020 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:56.021 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-03-09T14:28:56.051 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:56.051 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:56.084 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.084+0000 7f258ad42800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.085+0000 7f258ad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.085+0000 7f258ad42800 20 realm 2024-03-09T14:28:56.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.085+0000 7f258ad42800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.085+0000 7f258ad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.085+0000 7f258ad42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:56.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.085+0000 7f258ad42800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.085+0000 7f258ad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.085+0000 7f258ad42800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.087 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.086+0000 7f258ad42800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:56.087 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.086+0000 7f258ad42800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.087 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.087+0000 7f258ad42800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:56.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.087+0000 7f258ad42800 20 searching for the correct realm 2024-03-09T14:28:56.090 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.089+0000 7f2587242640 0 -- 172.21.15.88:0/836463194 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f2580077070 msgr2=0x7f25800d1910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:56.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.295+0000 7f257e240640 0 -- 172.21.15.88:0/836463194 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f25800b4c00 msgr2=0x7f25800a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:28:56.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.501+0000 7f258ad42800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:56.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.501+0000 7f258ad42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:56.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.501+0000 7f258ad42800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:56.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.501+0000 7f258ad42800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:56.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.501+0000 7f258ad42800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:56.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.501+0000 7f258ad42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:56.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.501+0000 7f258ad42800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.501+0000 7f258ad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.501+0000 7f258ad42800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.502+0000 7f258ad42800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:56.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.502+0000 7f258ad42800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.502+0000 7f258ad42800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:56.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.502+0000 7f258ad42800 20 zone default found 2024-03-09T14:28:56.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.502+0000 7f258ad42800 4 Realm: () 2024-03-09T14:28:56.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.502+0000 7f258ad42800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:56.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.502+0000 7f258ad42800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:56.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.502+0000 7f258ad42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:56.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.502+0000 7f258ad42800 20 zonegroup default 2024-03-09T14:28:56.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.502+0000 7f258ad42800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.502+0000 7f258ad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.502+0000 7f258ad42800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.503+0000 7f258ad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.503+0000 7f258ad42800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.503+0000 7f258ad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.503+0000 7f258ad42800 20 started sync module instance, tier type = 2024-03-09T14:28:56.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.503+0000 7f258ad42800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:56.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.517+0000 7f258ad42800 20 add_watcher() i=0 2024-03-09T14:28:56.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.517+0000 7f258ad42800 20 add_watcher() i=1 2024-03-09T14:28:56.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.517+0000 7f258ad42800 20 add_watcher() i=2 2024-03-09T14:28:56.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.517+0000 7f258ad42800 20 add_watcher() i=3 2024-03-09T14:28:56.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.517+0000 7f258ad42800 20 add_watcher() i=4 2024-03-09T14:28:56.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.517+0000 7f258ad42800 20 add_watcher() i=5 2024-03-09T14:28:56.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.517+0000 7f258ad42800 20 add_watcher() i=6 2024-03-09T14:28:56.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.520+0000 7f258ad42800 20 add_watcher() i=7 2024-03-09T14:28:56.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.520+0000 7f258ad42800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:56.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.522+0000 7f243d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:56.523 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.522+0000 7f258ad42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:56.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.522+0000 7f258ad42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:56.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.522+0000 7f258ad42800 5 note: GC not initialized 2024-03-09T14:28:56.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.523+0000 7f23b7fff640 20 reqs_thread_entry: start 2024-03-09T14:28:56.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.523+0000 7f258ad42800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:56.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.523+0000 7f258ad42800 20 Filter name: none 2024-03-09T14:28:56.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.523+0000 7f23b5ffb640 20 reqs_thread_entry: start 2024-03-09T14:28:56.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.523+0000 7f258ad42800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:28:56.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.523+0000 7f258ad42800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.523+0000 7f258ad42800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:56.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.523+0000 7f258ad42800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:28:56.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.523+0000 7f258ad42800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:28:56.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.523+0000 7f258ad42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 : miss 2024-03-09T14:28:56.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.523+0000 7f258ad42800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.524+0000 7f258ad42800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:56.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.524+0000 7f258ad42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 info.flags=0x17 2024-03-09T14:28:56.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.524+0000 7f258ad42800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 to cache LRU end 2024-03-09T14:28:56.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.524+0000 7f258ad42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:28:56.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.524+0000 7f258ad42800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:28:56.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.524+0000 7f258ad42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 2024-03-09T14:28:56.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.524+0000 7f258ad42800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:28:56.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.524+0000 7f258ad42800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-09T14:28:56.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.524+0000 7f258ad42800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:56.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.525+0000 7f258ad42800 1 NOTICE: finished shard 1 (0 entries found) 2024-03-09T14:28:56.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.525+0000 7f258ad42800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:28:56.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.525+0000 7f258ad42800 1 NOTICE: finished shard 2 (0 entries found) 2024-03-09T14:28:56.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.525+0000 7f258ad42800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:28:56.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.525+0000 7f258ad42800 1 NOTICE: finished shard 3 (0 entries found) 2024-03-09T14:28:56.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.525+0000 7f258ad42800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:28:56.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.526+0000 7f258ad42800 1 NOTICE: finished shard 4 (0 entries found) 2024-03-09T14:28:56.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.526+0000 7f258ad42800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:56.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.526+0000 7f258ad42800 1 NOTICE: finished shard 5 (1 entries found) 2024-03-09T14:28:56.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.526+0000 7f258ad42800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:28:56.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.527+0000 7f258ad42800 1 NOTICE: finished shard 6 (0 entries found) 2024-03-09T14:28:56.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.527+0000 7f258ad42800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:28:56.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.527+0000 7f258ad42800 1 NOTICE: finished shard 7 (0 entries found) 2024-03-09T14:28:56.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.527+0000 7f258ad42800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:56.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.528+0000 7f258ad42800 1 NOTICE: finished shard 8 (1 entries found) 2024-03-09T14:28:56.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.528+0000 7f258ad42800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:28:56.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.528+0000 7f258ad42800 1 NOTICE: finished shard 9 (0 entries found) 2024-03-09T14:28:56.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.528+0000 7f258ad42800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:56.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.529+0000 7f258ad42800 1 NOTICE: finished shard 10 (0 entries found) 2024-03-09T14:28:56.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.529+0000 7f258ad42800 1 NOTICE: finished all shards (2 entries found) 2024-03-09T14:28:56.530 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.529+0000 7f243d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:56.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.532+0000 7f258ad42800 20 remove_watcher() i=0 2024-03-09T14:28:56.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.532+0000 7f258ad42800 2 removed watcher, disabling cache 2024-03-09T14:28:56.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.533+0000 7f258ad42800 20 remove_watcher() i=1 2024-03-09T14:28:56.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.535+0000 7f258ad42800 20 remove_watcher() i=2 2024-03-09T14:28:56.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.536+0000 7f258ad42800 20 remove_watcher() i=3 2024-03-09T14:28:56.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.537+0000 7f258ad42800 20 remove_watcher() i=4 2024-03-09T14:28:56.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.538+0000 7f258ad42800 20 remove_watcher() i=5 2024-03-09T14:28:56.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.539+0000 7f258ad42800 20 remove_watcher() i=6 2024-03-09T14:28:56.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.540+0000 7f258ad42800 20 remove_watcher() i=7 2024-03-09T14:28:56.550 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-03-09T14:28:56.550 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:56.551 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-09T14:28:56.582 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:56.582 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:56.616 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.615+0000 7f005c613800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.616+0000 7f005c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.616+0000 7f005c613800 20 realm 2024-03-09T14:28:56.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.616+0000 7f005c613800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.616+0000 7f005c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.616+0000 7f005c613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:56.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.616+0000 7f005c613800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.617+0000 7f005c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.617+0000 7f005c613800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.617+0000 7f005c613800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:56.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.617+0000 7f005c613800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.619 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.618+0000 7f005c613800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:56.619 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.618+0000 7f005c613800 20 searching for the correct realm 2024-03-09T14:28:56.622 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.621+0000 7f004ffff640 0 -- 172.21.15.88:0/546278660 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f0048057ee0 msgr2=0x7f0048056b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:56.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.624+0000 7f004ffff640 0 -- 172.21.15.88:0/546278660 >> [v2:172.21.15.132:6800/1549387301,v1:172.21.15.132:6801/1549387301] conn(0x55b1021725f0 msgr2=0x55b102174ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:56.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.629+0000 7f005c613800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:56.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.629+0000 7f005c613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:56.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.629+0000 7f005c613800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:56.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.629+0000 7f005c613800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:56.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.629+0000 7f005c613800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:56.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.629+0000 7f005c613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:56.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.629+0000 7f005c613800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.629+0000 7f005c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.629+0000 7f005c613800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.629+0000 7f005c613800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:56.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.629+0000 7f005c613800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.630+0000 7f005c613800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:56.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.630+0000 7f005c613800 20 zone default found 2024-03-09T14:28:56.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.630+0000 7f005c613800 4 Realm: () 2024-03-09T14:28:56.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.630+0000 7f005c613800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:56.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.630+0000 7f005c613800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:56.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.630+0000 7f005c613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:56.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.630+0000 7f005c613800 20 zonegroup default 2024-03-09T14:28:56.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.630+0000 7f005c613800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.630+0000 7f005c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.630+0000 7f005c613800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.630+0000 7f005c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.630+0000 7f005c613800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.633 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.630+0000 7f005c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.633 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.630+0000 7f005c613800 20 started sync module instance, tier type = 2024-03-09T14:28:56.633 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.630+0000 7f005c613800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:56.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.644+0000 7f005c613800 20 add_watcher() i=0 2024-03-09T14:28:56.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.644+0000 7f005c613800 20 add_watcher() i=1 2024-03-09T14:28:56.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.644+0000 7f005c613800 20 add_watcher() i=2 2024-03-09T14:28:56.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.644+0000 7f005c613800 20 add_watcher() i=3 2024-03-09T14:28:56.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.644+0000 7f005c613800 20 add_watcher() i=4 2024-03-09T14:28:56.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.644+0000 7f005c613800 20 add_watcher() i=5 2024-03-09T14:28:56.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.644+0000 7f005c613800 20 add_watcher() i=6 2024-03-09T14:28:56.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.645+0000 7f005c613800 20 add_watcher() i=7 2024-03-09T14:28:56.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.645+0000 7f005c613800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:56.647 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.646+0000 7eff0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:56.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.647+0000 7f005c613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:56.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.647+0000 7f005c613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:56.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.647+0000 7f005c613800 5 note: GC not initialized 2024-03-09T14:28:56.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.647+0000 7eff0cfe1640 20 reqs_thread_entry: start 2024-03-09T14:28:56.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.647+0000 7f005c613800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:56.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.647+0000 7f005c613800 20 Filter name: none 2024-03-09T14:28:56.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.647+0000 7efe867fc640 20 reqs_thread_entry: start 2024-03-09T14:28:56.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.647+0000 7f005c613800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:28:56.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.647+0000 7f005c613800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.648+0000 7f005c613800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:56.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.648+0000 7f005c613800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:28:56.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.648+0000 7f005c613800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:28:56.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.648+0000 7f005c613800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 : miss 2024-03-09T14:28:56.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.648+0000 7f005c613800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.648+0000 7f005c613800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:56.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.648+0000 7f005c613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 info.flags=0x17 2024-03-09T14:28:56.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.648+0000 7f005c613800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 to cache LRU end 2024-03-09T14:28:56.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.648+0000 7f005c613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:28:56.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.648+0000 7f005c613800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:28:56.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.648+0000 7f005c613800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 2024-03-09T14:28:56.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.648+0000 7f005c613800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:28:56.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.648+0000 7f005c613800 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-09T14:28:56.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.648+0000 7f005c613800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:56.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.649+0000 7f005c613800 1 NOTICE: finished shard 1 (0 entries removed) 2024-03-09T14:28:56.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.649+0000 7f005c613800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:28:56.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.649+0000 7f005c613800 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-09T14:28:56.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.649+0000 7f005c613800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:28:56.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.650+0000 7f005c613800 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-09T14:28:56.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.650+0000 7f005c613800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:28:56.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.650+0000 7f005c613800 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-09T14:28:56.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.650+0000 7f005c613800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:56.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.651+0000 7f005c613800 20 get_obj_state: octx=0x55b101edd510 obj=check-bucket:d state=0x55b1021a82e8 s->prefetch_data=0 2024-03-09T14:28:56.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.651+0000 7f005c613800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:28:56.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.651+0000 7f005c613800 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-09T14:28:56.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.651+0000 7f005c613800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:28:56.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.652+0000 7f005c613800 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-09T14:28:56.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.652+0000 7f005c613800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:56.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.652+0000 7f005c613800 20 get_obj_state: octx=0x55b101f05140 obj=check-bucket:c state=0x55b1021a8e48 s->prefetch_data=0 2024-03-09T14:28:56.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.652+0000 7f005c613800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:28:56.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.653+0000 7f005c613800 1 NOTICE: finished shard 9 (0 entries removed) 2024-03-09T14:28:56.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.653+0000 7f005c613800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:56.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.653+0000 7f005c613800 1 NOTICE: finished shard 10 (0 entries removed) 2024-03-09T14:28:56.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.653+0000 7f005c613800 20 get_obj_state: setting s->obj_tag to 3oybltweudqrfnzrt40f7lloc235b31k 2024-03-09T14:28:56.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.653+0000 7f005c613800 20 get_obj_state_impl: setting s->olh_tag to 0xmxxjuxn3op4mlglo2hmjwvegdul306 2024-03-09T14:28:56.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.653+0000 7f005c613800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:56.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.653+0000 7f005c613800 20 get_obj_state: setting s->obj_tag to pgg2ji32tt94owoecpsgaegz0wqolil0 2024-03-09T14:28:56.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.653+0000 7f005c613800 20 get_obj_state_impl: setting s->olh_tag to twngq40f5t0secl812keml8l2rzposem 2024-03-09T14:28:56.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.653+0000 7f005c613800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:56.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.654+0000 7f005c613800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-03-09T14:28:56.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.654+0000 7f005c613800 20 olh_log_entry: epoch=4 op=3 key=c[ftU78RRMCZ0KUcRkjZgBizqs06ZV2cB] 2024-03-09T14:28:56.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.654+0000 7f005c613800 20 get_obj_state: octx=0x55b102206cb0 obj=check-bucket:_:ftU78RRMCZ0KUcRkjZgBizqs06ZV2cB_c state=0x55b10220c568 s->prefetch_data=0 2024-03-09T14:28:56.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.654+0000 7f005c613800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-03-09T14:28:56.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.654+0000 7f005c613800 20 olh_log_entry: epoch=4 op=3 key=d[14YjXSHcmqTBhz0D2y3km9YQB3DPT24] 2024-03-09T14:28:56.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.654+0000 7f005c613800 20 get_obj_state: octx=0x55b1021e6cb0 obj=check-bucket:_:14YjXSHcmqTBhz0D2y3km9YQB3DPT24_d state=0x55b102214138 s->prefetch_data=0 2024-03-09T14:28:56.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.656+0000 7f005c613800 20 get_obj_state: octx=0x55b102206cb0 obj=check-bucket:c state=0x55b10220b558 s->prefetch_data=0 2024-03-09T14:28:56.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.656+0000 7f005c613800 20 get_obj_state: setting s->obj_tag to pgg2ji32tt94owoecpsgaegz0wqolil0 2024-03-09T14:28:56.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.656+0000 7f005c613800 20 get_obj_state_impl: setting s->olh_tag to twngq40f5t0secl812keml8l2rzposem 2024-03-09T14:28:56.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.656+0000 7f005c613800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=twngq40f5t0secl812keml8l2rzposem 2024-03-09T14:28:56.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.658+0000 7f005c613800 20 get_obj_state: octx=0x55b1021e6cb0 obj=check-bucket:d state=0x55b1021ab648 s->prefetch_data=0 2024-03-09T14:28:56.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.659+0000 7f005c613800 20 get_obj_state: setting s->obj_tag to 3oybltweudqrfnzrt40f7lloc235b31k 2024-03-09T14:28:56.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.659+0000 7f005c613800 20 get_obj_state_impl: setting s->olh_tag to 0xmxxjuxn3op4mlglo2hmjwvegdul306 2024-03-09T14:28:56.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.659+0000 7f005c613800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0xmxxjuxn3op4mlglo2hmjwvegdul306 2024-03-09T14:28:56.669 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.668+0000 7f005c613800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:56.669 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.668+0000 7f005c613800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:56.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.669+0000 7f005c613800 1 NOTICE: finished shard 8 (1 entries removed) 2024-03-09T14:28:56.672 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.671+0000 7f005c613800 1 NOTICE: finished shard 5 (1 entries removed) 2024-03-09T14:28:56.672 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.671+0000 7f005c613800 1 NOTICE: finished all shards (2 entries removed) 2024-03-09T14:28:56.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.672+0000 7eff0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:56.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.676+0000 7f005c613800 20 remove_watcher() i=0 2024-03-09T14:28:56.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.676+0000 7f005c613800 2 removed watcher, disabling cache 2024-03-09T14:28:56.678 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.677+0000 7f005c613800 20 remove_watcher() i=1 2024-03-09T14:28:56.679 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.678+0000 7f005c613800 20 remove_watcher() i=2 2024-03-09T14:28:56.681 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.680+0000 7f005c613800 20 remove_watcher() i=3 2024-03-09T14:28:56.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.681+0000 7f005c613800 20 remove_watcher() i=4 2024-03-09T14:28:56.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.682+0000 7f005c613800 20 remove_watcher() i=5 2024-03-09T14:28:56.685 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.685+0000 7f005c613800 20 remove_watcher() i=6 2024-03-09T14:28:56.686 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.686+0000 7f005c613800 20 remove_watcher() i=7 2024-03-09T14:28:56.697 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-09T14:28:56.726 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:56.726 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:56.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.759+0000 7f63c6f2e800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.760+0000 7f63c6f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.760+0000 7f63c6f2e800 20 realm 2024-03-09T14:28:56.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.760+0000 7f63c6f2e800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.760+0000 7f63c6f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.760+0000 7f63c6f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:56.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.760+0000 7f63c6f2e800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.760+0000 7f63c6f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.760+0000 7f63c6f2e800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.761+0000 7f63c6f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:56.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.761+0000 7f63c6f2e800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.762+0000 7f63c6f2e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:56.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.762+0000 7f63c6f2e800 20 searching for the correct realm 2024-03-09T14:28:56.765 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.765+0000 7f63c34f0640 0 -- 172.21.15.88:0/2572699636 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f63bc067070 msgr2=0x7f63bc054940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:28:56.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.769+0000 7f63ba4ee640 0 -- 172.21.15.88:0/2572699636 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f63bc067840 msgr2=0x7f63bc0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:56.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.975+0000 7f63c6f2e800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:56.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.975+0000 7f63c6f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:56.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.975+0000 7f63c6f2e800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:56.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.975+0000 7f63c6f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:56.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.975+0000 7f63c6f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:56.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.975+0000 7f63c6f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:56.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.975+0000 7f63c6f2e800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.975+0000 7f63c6f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.975+0000 7f63c6f2e800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.975+0000 7f63c6f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:56.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.975+0000 7f63c6f2e800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.976+0000 7f63c6f2e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:56.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.976+0000 7f63c6f2e800 20 zone default found 2024-03-09T14:28:56.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.976+0000 7f63c6f2e800 4 Realm: () 2024-03-09T14:28:56.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.976+0000 7f63c6f2e800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:56.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.976+0000 7f63c6f2e800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:56.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.976+0000 7f63c6f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:56.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.976+0000 7f63c6f2e800 20 zonegroup default 2024-03-09T14:28:56.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.976+0000 7f63c6f2e800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.976+0000 7f63c6f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.976+0000 7f63c6f2e800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.976+0000 7f63c6f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.976+0000 7f63c6f2e800 20 rados->read ofs=0 len=0 2024-03-09T14:28:56.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.976+0000 7f63c6f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:56.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.976+0000 7f63c6f2e800 20 started sync module instance, tier type = 2024-03-09T14:28:56.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.976+0000 7f63c6f2e800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:56.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.997+0000 7f63c6f2e800 20 add_watcher() i=0 2024-03-09T14:28:56.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.997+0000 7f63c6f2e800 20 add_watcher() i=1 2024-03-09T14:28:56.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.997+0000 7f63c6f2e800 20 add_watcher() i=2 2024-03-09T14:28:56.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.997+0000 7f63c6f2e800 20 add_watcher() i=3 2024-03-09T14:28:56.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.997+0000 7f63c6f2e800 20 add_watcher() i=4 2024-03-09T14:28:56.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.997+0000 7f63c6f2e800 20 add_watcher() i=5 2024-03-09T14:28:57.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:56.999+0000 7f63c6f2e800 20 add_watcher() i=6 2024-03-09T14:28:57.002 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.002+0000 7f63c6f2e800 20 add_watcher() i=7 2024-03-09T14:28:57.002 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.002+0000 7f63c6f2e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:57.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.004+0000 7f62797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:57.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.004+0000 7f63c6f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:57.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.004+0000 7f63c6f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:57.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.004+0000 7f63c6f2e800 5 note: GC not initialized 2024-03-09T14:28:57.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.004+0000 7f61f3fff640 20 reqs_thread_entry: start 2024-03-09T14:28:57.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.004+0000 7f63c6f2e800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:57.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.004+0000 7f63c6f2e800 20 Filter name: none 2024-03-09T14:28:57.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.005+0000 7f61f1ffb640 20 reqs_thread_entry: start 2024-03-09T14:28:57.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.005+0000 7f63c6f2e800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.005+0000 7f63c6f2e800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:57.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.005+0000 7f63c6f2e800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.005+0000 7f63c6f2e800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:57.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.005+0000 7f63c6f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:28:57.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.005+0000 7f63c6f2e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:28:57.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.005+0000 7f63c6f2e800 20 INFO: main: starting shard=0 2024-03-09T14:28:57.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.005+0000 7f63c6f2e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:28:57.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.006+0000 7f63c6f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.006+0000 7f63c6f2e800 20 INFO: main: starting shard=1 2024-03-09T14:28:57.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.006+0000 7f63c6f2e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:57.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.006+0000 7f63c6f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.006+0000 7f63c6f2e800 20 INFO: main: starting shard=2 2024-03-09T14:28:57.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.006+0000 7f63c6f2e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:28:57.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.007+0000 7f63c6f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.007+0000 7f63c6f2e800 20 INFO: main: starting shard=3 2024-03-09T14:28:57.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.007+0000 7f63c6f2e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:28:57.009 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.007+0000 7f63c6f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.009 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.007+0000 7f63c6f2e800 20 INFO: main: starting shard=4 2024-03-09T14:28:57.009 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.007+0000 7f63c6f2e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:28:57.009 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.008+0000 7f63c6f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.010 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.008+0000 7f63c6f2e800 20 INFO: main: starting shard=5 2024-03-09T14:28:57.010 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.008+0000 7f63c6f2e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:57.010 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.008+0000 7f63c6f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.010 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.008+0000 7f63c6f2e800 20 INFO: main: starting shard=6 2024-03-09T14:28:57.010 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.008+0000 7f63c6f2e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:28:57.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.009+0000 7f63c6f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.009+0000 7f63c6f2e800 20 INFO: main: starting shard=7 2024-03-09T14:28:57.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.009+0000 7f63c6f2e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:28:57.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.009+0000 7f63c6f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.009+0000 7f63c6f2e800 20 INFO: main: starting shard=8 2024-03-09T14:28:57.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.009+0000 7f63c6f2e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:57.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.010+0000 7f63c6f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.010+0000 7f63c6f2e800 20 INFO: main: starting shard=9 2024-03-09T14:28:57.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.010+0000 7f63c6f2e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:28:57.012 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.010+0000 7f63c6f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.012 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.010+0000 7f63c6f2e800 20 INFO: main: starting shard=10 2024-03-09T14:28:57.012 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.010+0000 7f63c6f2e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:57.012 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.011+0000 7f63c6f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.012 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.011+0000 7f63c6f2e800 20 INFO: main: done 2024-03-09T14:28:57.012 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.012+0000 7f62797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:57.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.014+0000 7f63c6f2e800 20 remove_watcher() i=0 2024-03-09T14:28:57.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.014+0000 7f63c6f2e800 2 removed watcher, disabling cache 2024-03-09T14:28:57.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.015+0000 7f63c6f2e800 20 remove_watcher() i=1 2024-03-09T14:28:57.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.016+0000 7f63c6f2e800 20 remove_watcher() i=2 2024-03-09T14:28:57.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.017+0000 7f63c6f2e800 20 remove_watcher() i=3 2024-03-09T14:28:57.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.018+0000 7f63c6f2e800 20 remove_watcher() i=4 2024-03-09T14:28:57.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.019+0000 7f63c6f2e800 20 remove_watcher() i=5 2024-03-09T14:28:57.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.020+0000 7f63c6f2e800 20 remove_watcher() i=6 2024-03-09T14:28:57.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.021+0000 7f63c6f2e800 20 remove_watcher() i=7 2024-03-09T14:28:57.032 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-09T14:28:57.061 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:57.061 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:57.094 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.094+0000 7fa57d511800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.095+0000 7fa57d511800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.095+0000 7fa57d511800 20 realm 2024-03-09T14:28:57.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.095+0000 7fa57d511800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.095+0000 7fa57d511800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.095+0000 7fa57d511800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:57.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.095+0000 7fa57d511800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.095+0000 7fa57d511800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.095+0000 7fa57d511800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.096+0000 7fa57d511800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:57.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.096+0000 7fa57d511800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.098 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.097+0000 7fa57d511800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:57.098 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.097+0000 7fa57d511800 20 searching for the correct realm 2024-03-09T14:28:57.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.099+0000 7fa57b80e640 0 -- 172.21.15.88:0/3275349932 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fa574002730 msgr2=0x7fa574009250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:57.104 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.104+0000 7fa57280c640 0 -- 172.21.15.88:0/3275349932 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fa574003b30 msgr2=0x7fa574079030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:57.312 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:57.312 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:57.312 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:57.312 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:57.312 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:57.312 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:57.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:57.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:57.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 20 zone default found 2024-03-09T14:28:57.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 4 Realm: () 2024-03-09T14:28:57.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:57.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:57.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:57.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 20 zonegroup default 2024-03-09T14:28:57.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.310+0000 7fa57d511800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.311+0000 7fa57d511800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.311+0000 7fa57d511800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.311+0000 7fa57d511800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.311+0000 7fa57d511800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.311+0000 7fa57d511800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.311+0000 7fa57d511800 20 started sync module instance, tier type = 2024-03-09T14:28:57.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.311+0000 7fa57d511800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:57.321 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.321+0000 7fa57d511800 20 add_watcher() i=0 2024-03-09T14:28:57.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.321+0000 7fa57d511800 20 add_watcher() i=1 2024-03-09T14:28:57.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.321+0000 7fa57d511800 20 add_watcher() i=2 2024-03-09T14:28:57.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.321+0000 7fa57d511800 20 add_watcher() i=3 2024-03-09T14:28:57.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.321+0000 7fa57d511800 20 add_watcher() i=4 2024-03-09T14:28:57.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.321+0000 7fa57d511800 20 add_watcher() i=5 2024-03-09T14:28:57.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.321+0000 7fa57d511800 20 add_watcher() i=6 2024-03-09T14:28:57.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.322+0000 7fa57d511800 20 add_watcher() i=7 2024-03-09T14:28:57.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.322+0000 7fa57d511800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:57.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.324+0000 7fa431fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:57.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.324+0000 7fa57d511800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:57.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.324+0000 7fa57d511800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:57.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.324+0000 7fa57d511800 5 note: GC not initialized 2024-03-09T14:28:57.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.325+0000 7fa430fe1640 20 reqs_thread_entry: start 2024-03-09T14:28:57.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.325+0000 7fa57d511800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:57.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.325+0000 7fa57d511800 20 Filter name: none 2024-03-09T14:28:57.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.325+0000 7fa3aa7fc640 20 reqs_thread_entry: start 2024-03-09T14:28:57.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.325+0000 7fa57d511800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.325+0000 7fa57d511800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:57.327 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.325+0000 7fa57d511800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.327 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.326+0000 7fa57d511800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:57.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.326+0000 7fa57d511800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:28:57.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.326+0000 7fa57d511800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:28:57.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.326+0000 7fa57d511800 20 INFO: main: starting shard=0 2024-03-09T14:28:57.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.326+0000 7fa57d511800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:28:57.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.326+0000 7fa57d511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.326+0000 7fa57d511800 20 INFO: main: starting shard=1 2024-03-09T14:28:57.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.326+0000 7fa57d511800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:57.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.326+0000 7fa57d511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.326+0000 7fa57d511800 20 INFO: main: starting shard=2 2024-03-09T14:28:57.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.326+0000 7fa57d511800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:28:57.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.327+0000 7fa57d511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.327+0000 7fa57d511800 20 INFO: main: starting shard=3 2024-03-09T14:28:57.329 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.327+0000 7fa57d511800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:28:57.329 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.327+0000 7fa57d511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.327+0000 7fa57d511800 20 INFO: main: starting shard=4 2024-03-09T14:28:57.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.327+0000 7fa57d511800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:28:57.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.328+0000 7fa57d511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.328+0000 7fa57d511800 20 INFO: main: starting shard=5 2024-03-09T14:28:57.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.328+0000 7fa57d511800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:57.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.328+0000 7fa57d511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.328+0000 7fa57d511800 20 INFO: main: starting shard=6 2024-03-09T14:28:57.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.328+0000 7fa57d511800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:28:57.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.329+0000 7fa57d511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.329+0000 7fa57d511800 20 INFO: main: starting shard=7 2024-03-09T14:28:57.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.329+0000 7fa57d511800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:28:57.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.329+0000 7fa57d511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.329+0000 7fa57d511800 20 INFO: main: starting shard=8 2024-03-09T14:28:57.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.329+0000 7fa57d511800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:57.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.330+0000 7fa57d511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.330+0000 7fa57d511800 20 INFO: main: starting shard=9 2024-03-09T14:28:57.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.330+0000 7fa57d511800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:28:57.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.330+0000 7fa57d511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.330+0000 7fa57d511800 20 INFO: main: starting shard=10 2024-03-09T14:28:57.332 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.330+0000 7fa57d511800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:57.332 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.331+0000 7fa57d511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:28:57.332 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.331+0000 7fa57d511800 20 INFO: main: done 2024-03-09T14:28:57.332 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.332+0000 7fa431fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:57.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.334+0000 7fa57d511800 20 remove_watcher() i=0 2024-03-09T14:28:57.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.334+0000 7fa57d511800 2 removed watcher, disabling cache 2024-03-09T14:28:57.335 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.335+0000 7fa57d511800 20 remove_watcher() i=1 2024-03-09T14:28:57.336 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.336+0000 7fa57d511800 20 remove_watcher() i=2 2024-03-09T14:28:57.337 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.337+0000 7fa57d511800 20 remove_watcher() i=3 2024-03-09T14:28:57.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.338+0000 7fa57d511800 20 remove_watcher() i=4 2024-03-09T14:28:57.339 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.339+0000 7fa57d511800 20 remove_watcher() i=5 2024-03-09T14:28:57.340 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.340+0000 7fa57d511800 20 remove_watcher() i=6 2024-03-09T14:28:57.341 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.341+0000 7fa57d511800 20 remove_watcher() i=7 2024-03-09T14:28:57.351 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-03-09T14:28:57.351 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:57.352 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-03-09T14:28:57.381 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:57.381 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:57.415 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.414+0000 7fbcd2937800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.415+0000 7fbcd2937800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.415+0000 7fbcd2937800 20 realm 2024-03-09T14:28:57.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.415+0000 7fbcd2937800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.415+0000 7fbcd2937800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.415+0000 7fbcd2937800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:57.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.415+0000 7fbcd2937800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.415+0000 7fbcd2937800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.417 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.416+0000 7fbcd2937800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.417 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.416+0000 7fbcd2937800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:57.417 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.416+0000 7fbcd2937800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.418 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.417+0000 7fbcd2937800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:28:57.418 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.417+0000 7fbcd2937800 20 searching for the correct realm 2024-03-09T14:28:57.419 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.419+0000 7fbcceeca640 0 -- 172.21.15.88:0/2407501057 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fbcc805e070 msgr2=0x7fbcc80022d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:57.625 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.625+0000 7fbcc5ec8640 0 -- 172.21.15.88:0/2407501057 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fbcc805fc60 msgr2=0x7fbcc80ba630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:57.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.831+0000 7fbcd2937800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:28:57.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.831+0000 7fbcd2937800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:57.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.831+0000 7fbcd2937800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:28:57.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.831+0000 7fbcd2937800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:57.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.831+0000 7fbcd2937800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:57.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.831+0000 7fbcd2937800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:57.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.831+0000 7fbcd2937800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.831+0000 7fbcd2937800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.831+0000 7fbcd2937800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.831+0000 7fbcd2937800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:57.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.831+0000 7fbcd2937800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.832+0000 7fbcd2937800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:28:57.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.832+0000 7fbcd2937800 20 zone default found 2024-03-09T14:28:57.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.832+0000 7fbcd2937800 4 Realm: () 2024-03-09T14:28:57.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.832+0000 7fbcd2937800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:28:57.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.832+0000 7fbcd2937800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:28:57.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.832+0000 7fbcd2937800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:57.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.832+0000 7fbcd2937800 20 zonegroup default 2024-03-09T14:28:57.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.832+0000 7fbcd2937800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.832+0000 7fbcd2937800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.832+0000 7fbcd2937800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.832+0000 7fbcd2937800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.832+0000 7fbcd2937800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.832+0000 7fbcd2937800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.832+0000 7fbcd2937800 20 started sync module instance, tier type = 2024-03-09T14:28:57.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.832+0000 7fbcd2937800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:28:57.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.848+0000 7fbcd2937800 20 add_watcher() i=0 2024-03-09T14:28:57.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.848+0000 7fbcd2937800 20 add_watcher() i=1 2024-03-09T14:28:57.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.848+0000 7fbcd2937800 20 add_watcher() i=2 2024-03-09T14:28:57.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.848+0000 7fbcd2937800 20 add_watcher() i=3 2024-03-09T14:28:57.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.848+0000 7fbcd2937800 20 add_watcher() i=4 2024-03-09T14:28:57.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.848+0000 7fbcd2937800 20 add_watcher() i=5 2024-03-09T14:28:57.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.848+0000 7fbcd2937800 20 add_watcher() i=6 2024-03-09T14:28:57.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.850+0000 7fbcd2937800 20 add_watcher() i=7 2024-03-09T14:28:57.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.850+0000 7fbcd2937800 2 all 8 watchers are set, enabling cache 2024-03-09T14:28:57.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.853+0000 7fbb84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:57.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.853+0000 7fbcd2937800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:28:57.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.853+0000 7fbcd2937800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:28:57.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.853+0000 7fbcd2937800 5 note: GC not initialized 2024-03-09T14:28:57.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.854+0000 7fbaff7fe640 20 reqs_thread_entry: start 2024-03-09T14:28:57.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.854+0000 7fbcd2937800 20 init_complete bucket index max shards: 11 2024-03-09T14:28:57.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.854+0000 7fbcd2937800 20 Filter name: none 2024-03-09T14:28:57.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.854+0000 7fbafd7fa640 20 reqs_thread_entry: start 2024-03-09T14:28:57.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.854+0000 7fbcd2937800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:28:57.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.854+0000 7fbcd2937800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.854+0000 7fbcd2937800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:28:57.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.854+0000 7fbcd2937800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:28:57.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.854+0000 7fbcd2937800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:28:57.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.854+0000 7fbcd2937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 : miss 2024-03-09T14:28:57.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.854+0000 7fbcd2937800 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.855+0000 7fbcd2937800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:28:57.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.855+0000 7fbcd2937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 info.flags=0x17 2024-03-09T14:28:57.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.855+0000 7fbcd2937800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 to cache LRU end 2024-03-09T14:28:57.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.855+0000 7fbcd2937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:28:57.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.855+0000 7fbcd2937800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:28:57.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.855+0000 7fbcd2937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 2024-03-09T14:28:57.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.855+0000 7fbcd2937800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:28:57.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.855+0000 7fbcd2937800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-09T14:28:57.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.855+0000 7fbcd2937800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:28:57.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.855+0000 7fbcd2937800 1 NOTICE: finished shard 1 (0 entries found) 2024-03-09T14:28:57.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.855+0000 7fbcd2937800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:28:57.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.856+0000 7fbcd2937800 1 NOTICE: finished shard 2 (0 entries found) 2024-03-09T14:28:57.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.856+0000 7fbcd2937800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:28:57.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.857+0000 7fbcd2937800 1 NOTICE: finished shard 3 (0 entries found) 2024-03-09T14:28:57.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.857+0000 7fbcd2937800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:28:57.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.857+0000 7fbcd2937800 1 NOTICE: finished shard 4 (0 entries found) 2024-03-09T14:28:57.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.857+0000 7fbcd2937800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:28:57.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.858+0000 7fbcd2937800 1 NOTICE: finished shard 5 (0 entries found) 2024-03-09T14:28:57.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.858+0000 7fbcd2937800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:28:57.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.858+0000 7fbcd2937800 1 NOTICE: finished shard 6 (0 entries found) 2024-03-09T14:28:57.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.858+0000 7fbcd2937800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:28:57.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.859+0000 7fbcd2937800 1 NOTICE: finished shard 7 (0 entries found) 2024-03-09T14:28:57.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.859+0000 7fbcd2937800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:28:57.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.859+0000 7fbcd2937800 1 NOTICE: finished shard 8 (0 entries found) 2024-03-09T14:28:57.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.859+0000 7fbcd2937800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:28:57.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.860+0000 7fbcd2937800 1 NOTICE: finished shard 9 (0 entries found) 2024-03-09T14:28:57.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.860+0000 7fbcd2937800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:28:57.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.860+0000 7fbcd2937800 1 NOTICE: finished shard 10 (0 entries found) 2024-03-09T14:28:57.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.860+0000 7fbcd2937800 1 NOTICE: finished all shards (0 entries found) 2024-03-09T14:28:57.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.861+0000 7fbb84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:28:57.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.863+0000 7fbcd2937800 20 remove_watcher() i=0 2024-03-09T14:28:57.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.863+0000 7fbcd2937800 2 removed watcher, disabling cache 2024-03-09T14:28:57.865 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.864+0000 7fbcd2937800 20 remove_watcher() i=1 2024-03-09T14:28:57.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.867+0000 7fbcd2937800 20 remove_watcher() i=2 2024-03-09T14:28:57.869 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.868+0000 7fbcd2937800 20 remove_watcher() i=3 2024-03-09T14:28:57.870 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.870+0000 7fbcd2937800 20 remove_watcher() i=4 2024-03-09T14:28:57.871 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.871+0000 7fbcd2937800 20 remove_watcher() i=5 2024-03-09T14:28:57.873 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.872+0000 7fbcd2937800 20 remove_watcher() i=6 2024-03-09T14:28:57.874 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:28:57.873+0000 7fbcd2937800 20 remove_watcher() i=7 2024-03-09T14:28:57.883 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-03-09T14:28:57.883 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:58.001 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-03-09T14:28:58.001 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:28:58.697 INFO:tasks.workunit.client.0.smithi088.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-03-09T14:28:59.077 INFO:tasks.workunit.client.0.smithi088.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-03-09T14:29:00.547 INFO:tasks.workunit.client.0.smithi088.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:29:00.548 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-09T14:29:00.579 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:29:00.579 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:29:00.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.614+0000 7f576250d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:00.616 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.616+0000 7f576250d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:00.616 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.616+0000 7f576250d800 20 realm 2024-03-09T14:29:00.616 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.616+0000 7f576250d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:00.616 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.616+0000 7f576250d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:00.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.616+0000 7f576250d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:29:00.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.616+0000 7f576250d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:00.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.616+0000 7f576250d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:00.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.616+0000 7f576250d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:00.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.617+0000 7f576250d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:00.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.617+0000 7f576250d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:00.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.618+0000 7f576250d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:29:00.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.618+0000 7f576250d800 20 searching for the correct realm 2024-03-09T14:29:00.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.619+0000 7f576080a640 0 -- 172.21.15.88:0/453489665 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x55a8f7c3c560 msgr2=0x55a8f7c3e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:00.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.825+0000 7f5757808640 0 -- 172.21.15.88:0/453489665 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f57500c5760 msgr2=0x7f575009a120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:00.831 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.831+0000 7f576250d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:29:00.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.831+0000 7f576250d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:29:00.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.831+0000 7f576250d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:29:00.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.831+0000 7f576250d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:29:00.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.831+0000 7f576250d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:29:00.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.831+0000 7f576250d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:29:00.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.831+0000 7f576250d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:00.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.831+0000 7f576250d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:00.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.831+0000 7f576250d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:00.833 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.831+0000 7f576250d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:00.833 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.831+0000 7f576250d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:00.833 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.832+0000 7f576250d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:29:00.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.832+0000 7f576250d800 20 zone default found 2024-03-09T14:29:00.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.832+0000 7f576250d800 4 Realm: () 2024-03-09T14:29:00.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.832+0000 7f576250d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:29:00.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.832+0000 7f576250d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:29:00.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.832+0000 7f576250d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:29:00.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.832+0000 7f576250d800 20 zonegroup default 2024-03-09T14:29:00.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.832+0000 7f576250d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:00.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.832+0000 7f576250d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:00.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.832+0000 7f576250d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:00.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.832+0000 7f576250d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:00.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.832+0000 7f576250d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:00.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.833+0000 7f576250d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:00.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.833+0000 7f576250d800 20 started sync module instance, tier type = 2024-03-09T14:29:00.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.833+0000 7f576250d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:29:00.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.847+0000 7f576250d800 20 add_watcher() i=0 2024-03-09T14:29:00.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.847+0000 7f576250d800 20 add_watcher() i=1 2024-03-09T14:29:00.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.847+0000 7f576250d800 20 add_watcher() i=2 2024-03-09T14:29:00.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.847+0000 7f576250d800 20 add_watcher() i=3 2024-03-09T14:29:00.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.847+0000 7f576250d800 20 add_watcher() i=4 2024-03-09T14:29:00.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.847+0000 7f576250d800 20 add_watcher() i=5 2024-03-09T14:29:00.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.847+0000 7f576250d800 20 add_watcher() i=6 2024-03-09T14:29:00.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.850+0000 7f576250d800 20 add_watcher() i=7 2024-03-09T14:29:00.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.850+0000 7f576250d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:29:00.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.852+0000 7f56167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:00.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.852+0000 7f576250d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:00.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.852+0000 7f576250d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:00.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.852+0000 7f576250d800 5 note: GC not initialized 2024-03-09T14:29:00.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.852+0000 7f56157e2640 20 reqs_thread_entry: start 2024-03-09T14:29:00.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.852+0000 7f576250d800 20 init_complete bucket index max shards: 11 2024-03-09T14:29:00.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.853+0000 7f576250d800 20 Filter name: none 2024-03-09T14:29:00.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.853+0000 7f5586ffd640 20 reqs_thread_entry: start 2024-03-09T14:29:00.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.853+0000 7f576250d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:00.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.853+0000 7f576250d800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:29:00.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.853+0000 7f576250d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:00.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.853+0000 7f576250d800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:29:00.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.853+0000 7f576250d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:29:00.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.853+0000 7f576250d800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:29:00.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.853+0000 7f576250d800 20 INFO: main: starting shard=0 2024-03-09T14:29:00.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.853+0000 7f576250d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:29:00.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.854+0000 7f576250d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:00.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.854+0000 7f576250d800 20 INFO: main: starting shard=1 2024-03-09T14:29:00.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.854+0000 7f576250d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:29:00.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.854+0000 7f576250d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:00.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.854+0000 7f576250d800 20 INFO: main: starting shard=2 2024-03-09T14:29:00.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.854+0000 7f576250d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:29:00.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.855+0000 7f576250d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:00.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.855+0000 7f576250d800 20 INFO: main: starting shard=3 2024-03-09T14:29:00.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.855+0000 7f576250d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:29:00.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.856+0000 7f576250d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:00.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.856+0000 7f576250d800 20 INFO: main: starting shard=4 2024-03-09T14:29:00.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.856+0000 7f576250d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:29:00.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.856+0000 7f576250d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:00.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.856+0000 7f576250d800 20 INFO: main: starting shard=5 2024-03-09T14:29:00.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.856+0000 7f576250d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:29:00.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.857+0000 7f576250d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:00.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.857+0000 7f576250d800 20 INFO: main: starting shard=6 2024-03-09T14:29:00.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.857+0000 7f576250d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:29:00.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.857+0000 7f576250d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:00.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.857+0000 7f576250d800 20 INFO: main: starting shard=7 2024-03-09T14:29:00.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.857+0000 7f576250d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:29:00.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.858+0000 7f576250d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:00.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.858+0000 7f576250d800 20 INFO: main: starting shard=8 2024-03-09T14:29:00.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.858+0000 7f576250d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:29:00.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.858+0000 7f576250d800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-09T14:29:00.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.858+0000 7f576250d800 20 INFO: main: starting shard=9 2024-03-09T14:29:00.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.858+0000 7f576250d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:29:00.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.859+0000 7f576250d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:00.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.859+0000 7f576250d800 20 INFO: main: starting shard=10 2024-03-09T14:29:00.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.859+0000 7f576250d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:29:00.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.859+0000 7f576250d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:00.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.859+0000 7f576250d800 20 INFO: main: done 2024-03-09T14:29:00.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.860+0000 7f56167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:00.863 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.863+0000 7f576250d800 20 remove_watcher() i=0 2024-03-09T14:29:00.863 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.863+0000 7f576250d800 2 removed watcher, disabling cache 2024-03-09T14:29:00.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.864+0000 7f576250d800 20 remove_watcher() i=1 2024-03-09T14:29:00.866 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.865+0000 7f576250d800 20 remove_watcher() i=2 2024-03-09T14:29:00.867 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.866+0000 7f576250d800 20 remove_watcher() i=3 2024-03-09T14:29:00.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.868+0000 7f576250d800 20 remove_watcher() i=4 2024-03-09T14:29:00.869 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.869+0000 7f576250d800 20 remove_watcher() i=5 2024-03-09T14:29:00.870 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.870+0000 7f576250d800 20 remove_watcher() i=6 2024-03-09T14:29:00.871 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:00.871+0000 7f576250d800 20 remove_watcher() i=7 2024-03-09T14:29:01.012 INFO:tasks.workunit.client.0.smithi088.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:29:01.013 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-09T14:29:01.042 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:29:01.042 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:29:01.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.074+0000 7f83c632f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.076+0000 7f83c632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:01.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.076+0000 7f83c632f800 20 realm 2024-03-09T14:29:01.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.076+0000 7f83c632f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.076+0000 7f83c632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:01.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.076+0000 7f83c632f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:29:01.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.076+0000 7f83c632f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.076+0000 7f83c632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:01.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.076+0000 7f83c632f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.077+0000 7f83c632f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:01.078 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.077+0000 7f83c632f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.078 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.077+0000 7f83c632f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:29:01.078 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.077+0000 7f83c632f800 20 searching for the correct realm 2024-03-09T14:29:01.080 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.080+0000 7f83c27d4640 0 -- 172.21.15.88:0/4025224349 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f83bc07d060 msgr2=0x7f83bc0b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:01.287 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.286+0000 7f83b97d2640 0 -- 172.21.15.88:0/4025224349 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f83bc0a7960 msgr2=0x7f83bc0b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:01.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.492+0000 7f83c632f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:29:01.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.492+0000 7f83c632f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:29:01.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.492+0000 7f83c632f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:29:01.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.492+0000 7f83c632f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:29:01.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.492+0000 7f83c632f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:29:01.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.492+0000 7f83c632f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:29:01.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.492+0000 7f83c632f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.493+0000 7f83c632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:01.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.493+0000 7f83c632f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.493+0000 7f83c632f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:01.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.493+0000 7f83c632f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.493+0000 7f83c632f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:29:01.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.493+0000 7f83c632f800 20 zone default found 2024-03-09T14:29:01.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.493+0000 7f83c632f800 4 Realm: () 2024-03-09T14:29:01.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.493+0000 7f83c632f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:29:01.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.493+0000 7f83c632f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:29:01.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.493+0000 7f83c632f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:29:01.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.493+0000 7f83c632f800 20 zonegroup default 2024-03-09T14:29:01.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.493+0000 7f83c632f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.494+0000 7f83c632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:01.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.494+0000 7f83c632f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.494+0000 7f83c632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:01.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.494+0000 7f83c632f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.494+0000 7f83c632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:01.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.494+0000 7f83c632f800 20 started sync module instance, tier type = 2024-03-09T14:29:01.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.494+0000 7f83c632f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:29:01.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.505+0000 7f83c632f800 20 add_watcher() i=0 2024-03-09T14:29:01.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.505+0000 7f83c632f800 20 add_watcher() i=1 2024-03-09T14:29:01.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.505+0000 7f83c632f800 20 add_watcher() i=2 2024-03-09T14:29:01.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.505+0000 7f83c632f800 20 add_watcher() i=3 2024-03-09T14:29:01.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.505+0000 7f83c632f800 20 add_watcher() i=4 2024-03-09T14:29:01.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.505+0000 7f83c632f800 20 add_watcher() i=5 2024-03-09T14:29:01.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.506+0000 7f83c632f800 20 add_watcher() i=6 2024-03-09T14:29:01.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.506+0000 7f83c632f800 20 add_watcher() i=7 2024-03-09T14:29:01.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.506+0000 7f83c632f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:29:01.509 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.508+0000 7f82737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:01.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.509+0000 7f83c632f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:01.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.509+0000 7f83c632f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:01.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.509+0000 7f83c632f800 5 note: GC not initialized 2024-03-09T14:29:01.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.509+0000 7f82727fc640 20 reqs_thread_entry: start 2024-03-09T14:29:01.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.509+0000 7f83c632f800 20 init_complete bucket index max shards: 11 2024-03-09T14:29:01.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.509+0000 7f83c632f800 20 Filter name: none 2024-03-09T14:29:01.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.509+0000 7f81e3fff640 20 reqs_thread_entry: start 2024-03-09T14:29:01.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.509+0000 7f83c632f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.509+0000 7f83c632f800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:29:01.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.509+0000 7f83c632f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.510+0000 7f83c632f800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:29:01.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.510+0000 7f83c632f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:29:01.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.510+0000 7f83c632f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:29:01.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.510+0000 7f83c632f800 20 INFO: main: starting shard=0 2024-03-09T14:29:01.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.510+0000 7f83c632f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:29:01.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.510+0000 7f83c632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.510+0000 7f83c632f800 20 INFO: main: starting shard=1 2024-03-09T14:29:01.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.510+0000 7f83c632f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:29:01.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.511+0000 7f83c632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.511+0000 7f83c632f800 20 INFO: main: starting shard=2 2024-03-09T14:29:01.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.511+0000 7f83c632f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:29:01.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.512+0000 7f83c632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.512+0000 7f83c632f800 20 INFO: main: starting shard=3 2024-03-09T14:29:01.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.512+0000 7f83c632f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:29:01.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.512+0000 7f83c632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.512+0000 7f83c632f800 20 INFO: main: starting shard=4 2024-03-09T14:29:01.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.512+0000 7f83c632f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:29:01.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.513+0000 7f83c632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.513+0000 7f83c632f800 20 INFO: main: starting shard=5 2024-03-09T14:29:01.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.513+0000 7f83c632f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:29:01.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.514+0000 7f83c632f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-09T14:29:01.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.514+0000 7f83c632f800 20 INFO: main: starting shard=6 2024-03-09T14:29:01.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.514+0000 7f83c632f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:29:01.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.514+0000 7f83c632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.514+0000 7f83c632f800 20 INFO: main: starting shard=7 2024-03-09T14:29:01.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.514+0000 7f83c632f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:29:01.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.515+0000 7f83c632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.515+0000 7f83c632f800 20 INFO: main: starting shard=8 2024-03-09T14:29:01.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.515+0000 7f83c632f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:29:01.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.515+0000 7f83c632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.515+0000 7f83c632f800 20 INFO: main: starting shard=9 2024-03-09T14:29:01.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.515+0000 7f83c632f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:29:01.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.516+0000 7f83c632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.516+0000 7f83c632f800 20 INFO: main: starting shard=10 2024-03-09T14:29:01.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.516+0000 7f83c632f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:29:01.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.516+0000 7f83c632f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.516+0000 7f83c632f800 20 INFO: main: done 2024-03-09T14:29:01.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.517+0000 7f82737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:01.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.520+0000 7f83c632f800 20 remove_watcher() i=0 2024-03-09T14:29:01.521 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.520+0000 7f83c632f800 2 removed watcher, disabling cache 2024-03-09T14:29:01.521 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.521+0000 7f83c632f800 20 remove_watcher() i=1 2024-03-09T14:29:01.523 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.522+0000 7f83c632f800 20 remove_watcher() i=2 2024-03-09T14:29:01.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.523+0000 7f83c632f800 20 remove_watcher() i=3 2024-03-09T14:29:01.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.524+0000 7f83c632f800 20 remove_watcher() i=4 2024-03-09T14:29:01.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.525+0000 7f83c632f800 20 remove_watcher() i=5 2024-03-09T14:29:01.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.526+0000 7f83c632f800 20 remove_watcher() i=6 2024-03-09T14:29:01.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.527+0000 7f83c632f800 20 remove_watcher() i=7 2024-03-09T14:29:01.666 INFO:tasks.workunit.client.0.smithi088.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:29:01.667 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-03-09T14:29:01.695 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:29:01.695 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:29:01.728 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.728+0000 7f7c00d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.729+0000 7f7c00d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:01.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.729+0000 7f7c00d2f800 20 realm 2024-03-09T14:29:01.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.729+0000 7f7c00d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.729+0000 7f7c00d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:01.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.729+0000 7f7c00d2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:29:01.731 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.729+0000 7f7c00d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.731 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.730+0000 7f7c00d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:01.731 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.730+0000 7f7c00d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.731 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.730+0000 7f7c00d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:01.731 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.730+0000 7f7c00d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.731+0000 7f7c00d2f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:29:01.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.731+0000 7f7c00d2f800 20 searching for the correct realm 2024-03-09T14:29:01.734 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.733+0000 7f7bfd1d4640 0 -- 172.21.15.88:0/481406659 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f7bf800e070 msgr2=0x7f7bf8081a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:01.738 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.738+0000 7f7bf41d2640 0 -- 172.21.15.88:0/481406659 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f7bf8060940 msgr2=0x7f7bf80688b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:01.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.944+0000 7f7c00d2f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:29:01.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.944+0000 7f7c00d2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:29:01.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.944+0000 7f7c00d2f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:29:01.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.944+0000 7f7c00d2f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:29:01.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.944+0000 7f7c00d2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:29:01.946 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.944+0000 7f7c00d2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:29:01.946 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.944+0000 7f7c00d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.946 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.944+0000 7f7c00d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:01.946 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.944+0000 7f7c00d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.947 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.945+0000 7f7c00d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:01.947 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.945+0000 7f7c00d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.947 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.945+0000 7f7c00d2f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:29:01.947 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.945+0000 7f7c00d2f800 20 zone default found 2024-03-09T14:29:01.947 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.945+0000 7f7c00d2f800 4 Realm: () 2024-03-09T14:29:01.947 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.945+0000 7f7c00d2f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:29:01.947 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.945+0000 7f7c00d2f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:29:01.948 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.945+0000 7f7c00d2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:29:01.948 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.945+0000 7f7c00d2f800 20 zonegroup default 2024-03-09T14:29:01.948 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.945+0000 7f7c00d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.948 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.945+0000 7f7c00d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:01.948 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.945+0000 7f7c00d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.948 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.946+0000 7f7c00d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:01.948 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.946+0000 7f7c00d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.948 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.946+0000 7f7c00d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:01.948 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.946+0000 7f7c00d2f800 20 started sync module instance, tier type = 2024-03-09T14:29:01.948 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.946+0000 7f7c00d2f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:29:01.957 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.956+0000 7f7c00d2f800 20 add_watcher() i=0 2024-03-09T14:29:01.957 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.956+0000 7f7c00d2f800 20 add_watcher() i=1 2024-03-09T14:29:01.957 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.956+0000 7f7c00d2f800 20 add_watcher() i=2 2024-03-09T14:29:01.957 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.956+0000 7f7c00d2f800 20 add_watcher() i=3 2024-03-09T14:29:01.957 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.956+0000 7f7c00d2f800 20 add_watcher() i=4 2024-03-09T14:29:01.957 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.956+0000 7f7c00d2f800 20 add_watcher() i=5 2024-03-09T14:29:01.957 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.956+0000 7f7c00d2f800 20 add_watcher() i=6 2024-03-09T14:29:01.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.961+0000 7f7c00d2f800 20 add_watcher() i=7 2024-03-09T14:29:01.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.961+0000 7f7c00d2f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:29:01.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.963+0000 7f7ab2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:01.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.964+0000 7f7c00d2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:01.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.964+0000 7f7c00d2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:01.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.964+0000 7f7c00d2f800 5 note: GC not initialized 2024-03-09T14:29:01.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.964+0000 7f7ab1fe3640 20 reqs_thread_entry: start 2024-03-09T14:29:01.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.964+0000 7f7c00d2f800 20 init_complete bucket index max shards: 11 2024-03-09T14:29:01.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.964+0000 7f7c00d2f800 20 Filter name: none 2024-03-09T14:29:01.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.964+0000 7f7a237fe640 20 reqs_thread_entry: start 2024-03-09T14:29:01.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.964+0000 7f7c00d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.966 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.965+0000 7f7c00d2f800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:29:01.966 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.965+0000 7f7c00d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:29:01.967 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.965+0000 7f7c00d2f800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:29:01.967 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.965+0000 7f7c00d2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:29:01.967 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.965+0000 7f7c00d2f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:29:01.967 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.965+0000 7f7c00d2f800 20 INFO: main: starting shard=0 2024-03-09T14:29:01.967 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.965+0000 7f7c00d2f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:29:01.967 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.966+0000 7f7c00d2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.967 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.966+0000 7f7c00d2f800 20 INFO: main: starting shard=1 2024-03-09T14:29:01.967 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.966+0000 7f7c00d2f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:29:01.967 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.966+0000 7f7c00d2f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:29:01.967 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.966+0000 7f7c00d2f800 20 INFO: main: starting shard=2 2024-03-09T14:29:01.967 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.966+0000 7f7c00d2f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:29:01.968 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.967+0000 7f7c00d2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.968 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.967+0000 7f7c00d2f800 20 INFO: main: starting shard=3 2024-03-09T14:29:01.968 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.967+0000 7f7c00d2f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:29:01.968 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.967+0000 7f7c00d2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.968 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.967+0000 7f7c00d2f800 20 INFO: main: starting shard=4 2024-03-09T14:29:01.968 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.967+0000 7f7c00d2f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:29:01.968 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.967+0000 7f7c00d2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.968+0000 7f7c00d2f800 20 INFO: main: starting shard=5 2024-03-09T14:29:01.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.968+0000 7f7c00d2f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:29:01.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.968+0000 7f7c00d2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.968+0000 7f7c00d2f800 20 INFO: main: starting shard=6 2024-03-09T14:29:01.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.968+0000 7f7c00d2f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:29:01.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.968+0000 7f7c00d2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.968+0000 7f7c00d2f800 20 INFO: main: starting shard=7 2024-03-09T14:29:01.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.968+0000 7f7c00d2f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:29:01.970 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.969+0000 7f7c00d2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.970 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.969+0000 7f7c00d2f800 20 INFO: main: starting shard=8 2024-03-09T14:29:01.970 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.969+0000 7f7c00d2f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:29:01.970 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.969+0000 7f7c00d2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.970 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.969+0000 7f7c00d2f800 20 INFO: main: starting shard=9 2024-03-09T14:29:01.970 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.969+0000 7f7c00d2f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:29:01.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.970+0000 7f7c00d2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.970+0000 7f7c00d2f800 20 INFO: main: starting shard=10 2024-03-09T14:29:01.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.970+0000 7f7c00d2f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:29:01.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.971+0000 7f7c00d2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:01.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.971+0000 7f7c00d2f800 20 INFO: main: done 2024-03-09T14:29:01.972 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.971+0000 7f7ab2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:01.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.974+0000 7f7c00d2f800 20 remove_watcher() i=0 2024-03-09T14:29:01.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.974+0000 7f7c00d2f800 2 removed watcher, disabling cache 2024-03-09T14:29:01.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.975+0000 7f7c00d2f800 20 remove_watcher() i=1 2024-03-09T14:29:01.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.976+0000 7f7c00d2f800 20 remove_watcher() i=2 2024-03-09T14:29:01.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.977+0000 7f7c00d2f800 20 remove_watcher() i=3 2024-03-09T14:29:01.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.979+0000 7f7c00d2f800 20 remove_watcher() i=4 2024-03-09T14:29:01.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.980+0000 7f7c00d2f800 20 remove_watcher() i=5 2024-03-09T14:29:01.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.980+0000 7f7c00d2f800 20 remove_watcher() i=6 2024-03-09T14:29:01.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:01.981+0000 7f7c00d2f800 20 remove_watcher() i=7 2024-03-09T14:29:02.097 INFO:tasks.workunit.client.0.smithi088.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:29:02.098 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-03-09T14:29:02.126 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:29:02.126 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:29:02.160 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.159+0000 7f96b093c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:02.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.161+0000 7f96b093c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:02.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.161+0000 7f96b093c800 20 realm 2024-03-09T14:29:02.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.161+0000 7f96b093c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:02.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.161+0000 7f96b093c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:02.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.161+0000 7f96b093c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:29:02.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.161+0000 7f96b093c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:02.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.161+0000 7f96b093c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:02.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.161+0000 7f96b093c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:02.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.162+0000 7f96b093c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:02.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.162+0000 7f96b093c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:02.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.163+0000 7f96b093c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:29:02.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.163+0000 7f96b093c800 20 searching for the correct realm 2024-03-09T14:29:02.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.164+0000 7f96ac6fa640 0 -- 172.21.15.88:0/2483397941 >> [v2:172.21.15.88:6800/4216886240,v1:172.21.15.88:6802/4216886240] conn(0x557219c7de80 msgr2=0x557219c80340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:02.168 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.167+0000 7f96ac6fa640 0 -- 172.21.15.88:0/2483397941 >> [v2:172.21.15.132:6824/731564406,v1:172.21.15.132:6825/731564406] conn(0x557219a2d400 msgr2=0x7f96a402c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:02.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.376+0000 7f96b093c800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:29:02.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.376+0000 7f96b093c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:29:02.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.376+0000 7f96b093c800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:29:02.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.376+0000 7f96b093c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:29:02.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.376+0000 7f96b093c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:29:02.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.376+0000 7f96b093c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:29:02.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.376+0000 7f96b093c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:02.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.376+0000 7f96b093c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:02.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.376+0000 7f96b093c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:02.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.377+0000 7f96b093c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:02.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.377+0000 7f96b093c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:02.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.377+0000 7f96b093c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:29:02.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.377+0000 7f96b093c800 20 zone default found 2024-03-09T14:29:02.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.377+0000 7f96b093c800 4 Realm: () 2024-03-09T14:29:02.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.377+0000 7f96b093c800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:29:02.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.377+0000 7f96b093c800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:29:02.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.377+0000 7f96b093c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:29:02.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.377+0000 7f96b093c800 20 zonegroup default 2024-03-09T14:29:02.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.377+0000 7f96b093c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:02.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.377+0000 7f96b093c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:02.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.377+0000 7f96b093c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:02.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.378+0000 7f96b093c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:02.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.378+0000 7f96b093c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:02.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.378+0000 7f96b093c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:02.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.378+0000 7f96b093c800 20 started sync module instance, tier type = 2024-03-09T14:29:02.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.378+0000 7f96b093c800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:29:02.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.396+0000 7f96b093c800 20 add_watcher() i=0 2024-03-09T14:29:02.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.396+0000 7f96b093c800 20 add_watcher() i=1 2024-03-09T14:29:02.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.396+0000 7f96b093c800 20 add_watcher() i=2 2024-03-09T14:29:02.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.396+0000 7f96b093c800 20 add_watcher() i=3 2024-03-09T14:29:02.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.396+0000 7f96b093c800 20 add_watcher() i=4 2024-03-09T14:29:02.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.396+0000 7f96b093c800 20 add_watcher() i=5 2024-03-09T14:29:02.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.397+0000 7f96b093c800 20 add_watcher() i=6 2024-03-09T14:29:02.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.397+0000 7f96b093c800 20 add_watcher() i=7 2024-03-09T14:29:02.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.397+0000 7f96b093c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:29:02.400 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.399+0000 7f95627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:02.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.400+0000 7f96b093c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:02.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.400+0000 7f96b093c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:02.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.400+0000 7f96b093c800 5 note: GC not initialized 2024-03-09T14:29:02.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.400+0000 7f95617e2640 20 reqs_thread_entry: start 2024-03-09T14:29:02.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.400+0000 7f96b093c800 20 init_complete bucket index max shards: 11 2024-03-09T14:29:02.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.400+0000 7f96b093c800 20 Filter name: none 2024-03-09T14:29:02.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.400+0000 7f94d2ffd640 20 reqs_thread_entry: start 2024-03-09T14:29:02.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.400+0000 7f96b093c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:02.402 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.401+0000 7f96b093c800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:29:02.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.401+0000 7f96b093c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:02.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.401+0000 7f96b093c800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:29:02.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.401+0000 7f96b093c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:29:02.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.401+0000 7f96b093c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:29:02.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.401+0000 7f96b093c800 20 INFO: main: starting shard=0 2024-03-09T14:29:02.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.401+0000 7f96b093c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:29:02.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.401+0000 7f96b093c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:02.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.401+0000 7f96b093c800 20 INFO: main: starting shard=1 2024-03-09T14:29:02.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.401+0000 7f96b093c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:29:02.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.402+0000 7f96b093c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:02.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.402+0000 7f96b093c800 20 INFO: main: starting shard=2 2024-03-09T14:29:02.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.402+0000 7f96b093c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:29:02.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.403+0000 7f96b093c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:02.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.403+0000 7f96b093c800 20 INFO: main: starting shard=3 2024-03-09T14:29:02.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.403+0000 7f96b093c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:29:02.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.403+0000 7f96b093c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:02.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.403+0000 7f96b093c800 20 INFO: main: starting shard=4 2024-03-09T14:29:02.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.403+0000 7f96b093c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:29:02.405 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.404+0000 7f96b093c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:02.405 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.404+0000 7f96b093c800 20 INFO: main: starting shard=5 2024-03-09T14:29:02.405 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.404+0000 7f96b093c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:29:02.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.405+0000 7f96b093c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:02.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.405+0000 7f96b093c800 20 INFO: main: starting shard=6 2024-03-09T14:29:02.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.405+0000 7f96b093c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:29:02.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.406+0000 7f96b093c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:02.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.406+0000 7f96b093c800 20 INFO: main: starting shard=7 2024-03-09T14:29:02.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.406+0000 7f96b093c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:29:02.407 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.406+0000 7f96b093c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:02.407 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.406+0000 7f96b093c800 20 INFO: main: starting shard=8 2024-03-09T14:29:02.407 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.406+0000 7f96b093c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:29:02.407 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.407+0000 7f96b093c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:02.408 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.407+0000 7f96b093c800 20 INFO: main: starting shard=9 2024-03-09T14:29:02.408 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.407+0000 7f96b093c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:29:02.408 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.407+0000 7f96b093c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:29:02.408 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.407+0000 7f96b093c800 20 INFO: main: starting shard=10 2024-03-09T14:29:02.408 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.407+0000 7f96b093c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:29:02.409 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.408+0000 7f96b093c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:29:02.409 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.408+0000 7f96b093c800 20 INFO: main: done 2024-03-09T14:29:02.409 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.409+0000 7f95627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:02.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.411+0000 7f96b093c800 20 remove_watcher() i=0 2024-03-09T14:29:02.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.411+0000 7f96b093c800 2 removed watcher, disabling cache 2024-03-09T14:29:02.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.412+0000 7f96b093c800 20 remove_watcher() i=1 2024-03-09T14:29:02.414 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.413+0000 7f96b093c800 20 remove_watcher() i=2 2024-03-09T14:29:02.415 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.415+0000 7f96b093c800 20 remove_watcher() i=3 2024-03-09T14:29:02.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.416+0000 7f96b093c800 20 remove_watcher() i=4 2024-03-09T14:29:02.417 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.417+0000 7f96b093c800 20 remove_watcher() i=5 2024-03-09T14:29:02.420 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.420+0000 7f96b093c800 20 remove_watcher() i=6 2024-03-09T14:29:02.421 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:02.421+0000 7f96b093c800 20 remove_watcher() i=7 2024-03-09T14:29:02.455 INFO:tasks.workunit.client.0.smithi088.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-03-09T14:29:02.837 INFO:tasks.workunit.client.0.smithi088.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-03-09T14:29:03.223 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-03-09T14:29:03.250 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:29:03.250 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:29:03.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.284+0000 7febf222d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.285+0000 7febf222d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:03.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.285+0000 7febf222d800 20 realm 2024-03-09T14:29:03.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.285+0000 7febf222d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.285+0000 7febf222d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:03.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.285+0000 7febf222d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:29:03.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.285+0000 7febf222d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.285+0000 7febf222d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:03.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.285+0000 7febf222d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.287 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.286+0000 7febf222d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:03.287 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.286+0000 7febf222d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.287 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.287+0000 7febf222d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:29:03.287 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.287+0000 7febf222d800 20 searching for the correct realm 2024-03-09T14:29:03.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.287+0000 7febed43c640 0 -- 172.21.15.88:0/3335537909 >> [v2:172.21.15.88:6800/4216886240,v1:172.21.15.88:6802/4216886240] conn(0x55fc0c299b40 msgr2=0x55fc0c29c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:03.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.291+0000 7febed43c640 0 -- 172.21.15.88:0/3335537909 >> [v2:172.21.15.132:6824/731564406,v1:172.21.15.132:6825/731564406] conn(0x7febdc003b00 msgr2=0x7febe808f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:03.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.500+0000 7febf222d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:29:03.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.500+0000 7febf222d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:29:03.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.500+0000 7febf222d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:29:03.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.500+0000 7febf222d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:29:03.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.500+0000 7febf222d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:29:03.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.500+0000 7febf222d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:29:03.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.500+0000 7febf222d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.500+0000 7febf222d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:03.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.500+0000 7febf222d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.500+0000 7febf222d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:03.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.500+0000 7febf222d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.501+0000 7febf222d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:29:03.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.501+0000 7febf222d800 20 zone default found 2024-03-09T14:29:03.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.501+0000 7febf222d800 4 Realm: () 2024-03-09T14:29:03.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.501+0000 7febf222d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:29:03.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.501+0000 7febf222d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:29:03.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.501+0000 7febf222d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:29:03.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.501+0000 7febf222d800 20 zonegroup default 2024-03-09T14:29:03.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.501+0000 7febf222d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.501+0000 7febf222d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:03.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.501+0000 7febf222d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.501+0000 7febf222d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:03.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.501+0000 7febf222d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.502+0000 7febf222d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:03.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.502+0000 7febf222d800 20 started sync module instance, tier type = 2024-03-09T14:29:03.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.502+0000 7febf222d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:29:03.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.518+0000 7febf222d800 20 add_watcher() i=0 2024-03-09T14:29:03.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.518+0000 7febf222d800 20 add_watcher() i=1 2024-03-09T14:29:03.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.518+0000 7febf222d800 20 add_watcher() i=2 2024-03-09T14:29:03.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.518+0000 7febf222d800 20 add_watcher() i=3 2024-03-09T14:29:03.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.518+0000 7febf222d800 20 add_watcher() i=4 2024-03-09T14:29:03.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.518+0000 7febf222d800 20 add_watcher() i=5 2024-03-09T14:29:03.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.519+0000 7febf222d800 20 add_watcher() i=6 2024-03-09T14:29:03.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.519+0000 7febf222d800 20 add_watcher() i=7 2024-03-09T14:29:03.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.519+0000 7febf222d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:29:03.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.521+0000 7feaa37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:03.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.522+0000 7febf222d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:03.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.522+0000 7febf222d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:03.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.522+0000 7febf222d800 5 note: GC not initialized 2024-03-09T14:29:03.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.522+0000 7feaa27e4640 20 reqs_thread_entry: start 2024-03-09T14:29:03.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.522+0000 7febf222d800 20 init_complete bucket index max shards: 11 2024-03-09T14:29:03.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.522+0000 7febf222d800 20 Filter name: none 2024-03-09T14:29:03.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.522+0000 7fea13fff640 20 reqs_thread_entry: start 2024-03-09T14:29:03.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.522+0000 7febf222d800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:29:03.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.522+0000 7febf222d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.523+0000 7febf222d800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:29:03.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.523+0000 7febf222d800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:29:03.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.523+0000 7febf222d800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:29:03.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.523+0000 7febf222d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 : miss 2024-03-09T14:29:03.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.523+0000 7febf222d800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.523+0000 7febf222d800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:29:03.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.523+0000 7febf222d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 info.flags=0x17 2024-03-09T14:29:03.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.523+0000 7febf222d800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 to cache LRU end 2024-03-09T14:29:03.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.523+0000 7febf222d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:29:03.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.523+0000 7febf222d800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:29:03.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.523+0000 7febf222d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 2024-03-09T14:29:03.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.523+0000 7febf222d800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:29:03.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.523+0000 7febf222d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:29:03.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.524+0000 7febf222d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:29:03.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.524+0000 7febf222d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:29:03.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.524+0000 7febf222d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:29:03.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.524+0000 7febf222d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:29:03.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.530+0000 7feaa37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:03.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.533+0000 7febf222d800 20 remove_watcher() i=0 2024-03-09T14:29:03.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.533+0000 7febf222d800 2 removed watcher, disabling cache 2024-03-09T14:29:03.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.534+0000 7febf222d800 20 remove_watcher() i=1 2024-03-09T14:29:03.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.535+0000 7febf222d800 20 remove_watcher() i=2 2024-03-09T14:29:03.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.536+0000 7febf222d800 20 remove_watcher() i=3 2024-03-09T14:29:03.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.537+0000 7febf222d800 20 remove_watcher() i=4 2024-03-09T14:29:03.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.538+0000 7febf222d800 20 remove_watcher() i=5 2024-03-09T14:29:03.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.539+0000 7febf222d800 20 remove_watcher() i=6 2024-03-09T14:29:03.541 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.540+0000 7febf222d800 20 remove_watcher() i=7 2024-03-09T14:29:03.551 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-09T14:29:03.585 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:29:03.585 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:29:03.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.618+0000 7fd3e6c12800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.619+0000 7fd3e6c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:03.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.619+0000 7fd3e6c12800 20 realm 2024-03-09T14:29:03.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.619+0000 7fd3e6c12800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.619+0000 7fd3e6c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:03.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.619+0000 7fd3e6c12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:29:03.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.619+0000 7fd3e6c12800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.619+0000 7fd3e6c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:03.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.619+0000 7fd3e6c12800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.620+0000 7fd3e6c12800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:03.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.620+0000 7fd3e6c12800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.621+0000 7fd3e6c12800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:29:03.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.621+0000 7fd3e6c12800 20 searching for the correct realm 2024-03-09T14:29:03.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.623+0000 7fd3e29f1640 0 -- 172.21.15.88:0/586205975 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fd3dc026040 msgr2=0x7fd3dc082e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:03.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.627+0000 7fd3dbfff640 0 -- 172.21.15.88:0/586205975 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fd3dc08d040 msgr2=0x7fd3dc043b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:03.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.833+0000 7fd3e6c12800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:29:03.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.833+0000 7fd3e6c12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:29:03.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.833+0000 7fd3e6c12800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:29:03.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.833+0000 7fd3e6c12800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:29:03.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.833+0000 7fd3e6c12800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:29:03.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.833+0000 7fd3e6c12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:29:03.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.833+0000 7fd3e6c12800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.833+0000 7fd3e6c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:03.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.833+0000 7fd3e6c12800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.834+0000 7fd3e6c12800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:03.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.834+0000 7fd3e6c12800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.834+0000 7fd3e6c12800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:29:03.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.834+0000 7fd3e6c12800 20 zone default found 2024-03-09T14:29:03.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.834+0000 7fd3e6c12800 4 Realm: () 2024-03-09T14:29:03.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.834+0000 7fd3e6c12800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:29:03.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.834+0000 7fd3e6c12800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:29:03.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.834+0000 7fd3e6c12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:29:03.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.834+0000 7fd3e6c12800 20 zonegroup default 2024-03-09T14:29:03.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.834+0000 7fd3e6c12800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.834+0000 7fd3e6c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:03.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.834+0000 7fd3e6c12800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.835+0000 7fd3e6c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:03.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.835+0000 7fd3e6c12800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.835+0000 7fd3e6c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:03.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.835+0000 7fd3e6c12800 20 started sync module instance, tier type = 2024-03-09T14:29:03.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.835+0000 7fd3e6c12800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:29:03.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.847+0000 7fd3e6c12800 20 add_watcher() i=0 2024-03-09T14:29:03.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.847+0000 7fd3e6c12800 20 add_watcher() i=1 2024-03-09T14:29:03.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.847+0000 7fd3e6c12800 20 add_watcher() i=2 2024-03-09T14:29:03.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.847+0000 7fd3e6c12800 20 add_watcher() i=3 2024-03-09T14:29:03.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.847+0000 7fd3e6c12800 20 add_watcher() i=4 2024-03-09T14:29:03.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.847+0000 7fd3e6c12800 20 add_watcher() i=5 2024-03-09T14:29:03.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.847+0000 7fd3e6c12800 20 add_watcher() i=6 2024-03-09T14:29:03.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.848+0000 7fd3e6c12800 20 add_watcher() i=7 2024-03-09T14:29:03.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.848+0000 7fd3e6c12800 2 all 8 watchers are set, enabling cache 2024-03-09T14:29:03.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.849+0000 7fd298fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:03.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.850+0000 7fd3e6c12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:03.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.850+0000 7fd3e6c12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:03.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.850+0000 7fd3e6c12800 5 note: GC not initialized 2024-03-09T14:29:03.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.850+0000 7fd2137fe640 20 reqs_thread_entry: start 2024-03-09T14:29:03.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.850+0000 7fd3e6c12800 20 init_complete bucket index max shards: 11 2024-03-09T14:29:03.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.850+0000 7fd3e6c12800 20 Filter name: none 2024-03-09T14:29:03.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.850+0000 7fd2117fa640 20 reqs_thread_entry: start 2024-03-09T14:29:03.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.850+0000 7fd3e6c12800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:29:03.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.850+0000 7fd3e6c12800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.851+0000 7fd3e6c12800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:29:03.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.851+0000 7fd3e6c12800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:29:03.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.851+0000 7fd3e6c12800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:29:03.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.851+0000 7fd3e6c12800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 : miss 2024-03-09T14:29:03.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.851+0000 7fd3e6c12800 20 rados->read ofs=0 len=0 2024-03-09T14:29:03.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.851+0000 7fd3e6c12800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:29:03.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.851+0000 7fd3e6c12800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 info.flags=0x17 2024-03-09T14:29:03.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.851+0000 7fd3e6c12800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 to cache LRU end 2024-03-09T14:29:03.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.851+0000 7fd3e6c12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:29:03.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.851+0000 7fd3e6c12800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:29:03.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.851+0000 7fd3e6c12800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:5d93e872-363b-498b-b665-658644296b85.4535.1 2024-03-09T14:29:03.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.851+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.0 2024-03-09T14:29:03.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.851+0000 7fd3e6c12800 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-09T14:29:03.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.852+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:29:03.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.852+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.2 2024-03-09T14:29:03.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.852+0000 7fd3e6c12800 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-09T14:29:03.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.852+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.3 2024-03-09T14:29:03.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.853+0000 7fd3e6c12800 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-09T14:29:03.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.853+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.4 2024-03-09T14:29:03.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.854+0000 7fd3e6c12800 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-09T14:29:03.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.854+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:29:03.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.854+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.6 2024-03-09T14:29:03.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.855+0000 7fd3e6c12800 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-09T14:29:03.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.855+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.7 2024-03-09T14:29:03.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.855+0000 7fd3e6c12800 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-09T14:29:03.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.855+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:29:03.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.856+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.9 2024-03-09T14:29:03.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.856+0000 7fd3e6c12800 1 NOTICE: finished shard 9 (0 entries removed) 2024-03-09T14:29:03.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.856+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:29:03.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.857+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:29:03.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.858+0000 7fd3e6c12800 20 get_obj_state: octx=0x55e6bcac2540 obj=check-bucket:e state=0x55e6bcd8f7c8 s->prefetch_data=0 2024-03-09T14:29:03.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.858+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:29:03.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.858+0000 7fd3e6c12800 20 get_obj_state: octx=0x55e6bcaea150 obj=check-bucket:d state=0x55e6bcd92228 s->prefetch_data=0 2024-03-09T14:29:03.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.858+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:29:03.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.858+0000 7fd3e6c12800 20 get_obj_state: octx=0x55e6bcd99a60 obj=check-bucket:c state=0x55e6bce2e9f8 s->prefetch_data=0 2024-03-09T14:29:03.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.858+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:29:03.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.859+0000 7fd3e6c12800 20 get_obj_state: octx=0x55e6bcd9a4c0 obj=check-bucket:f state=0x55e6bce2f558 s->prefetch_data=0 2024-03-09T14:29:03.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.859+0000 7fd3e6c12800 20 get_obj_state: setting s->obj_tag to 4f18n27u03j4qt4nmjuzb95u0sdoeuyk 2024-03-09T14:29:03.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.859+0000 7fd3e6c12800 20 get_obj_state_impl: setting s->olh_tag to 7ucypbp63p6f0he9ggzd12plt23a7u96 2024-03-09T14:29:03.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.859+0000 7fd3e6c12800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7ucypbp63p6f0he9ggzd12plt23a7u96 2024-03-09T14:29:03.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.859+0000 7fd3e6c12800 20 get_obj_state: setting s->obj_tag to gia6sasgzydh21xilp32o2bvyini0i47 2024-03-09T14:29:03.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.859+0000 7fd3e6c12800 20 get_obj_state_impl: setting s->olh_tag to elnj8qoe6g3dk1gl2ymxwz8jx96k557y 2024-03-09T14:29:03.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.859+0000 7fd3e6c12800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=elnj8qoe6g3dk1gl2ymxwz8jx96k557y 2024-03-09T14:29:03.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.859+0000 7fd3e6c12800 20 get_obj_state: setting s->obj_tag to ar2q1u2mz5107i0cym9adeu2w56b8drg 2024-03-09T14:29:03.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.859+0000 7fd3e6c12800 20 get_obj_state_impl: setting s->olh_tag to vsc3rp3q62hfe0mcsta14036jfezm5lj 2024-03-09T14:29:03.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.859+0000 7fd3e6c12800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vsc3rp3q62hfe0mcsta14036jfezm5lj 2024-03-09T14:29:03.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.860+0000 7fd3e6c12800 20 get_obj_state: setting s->obj_tag to aqlvmpkwb0jjozublnwjnp6cd3iu737m 2024-03-09T14:29:03.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.860+0000 7fd3e6c12800 20 get_obj_state_impl: setting s->olh_tag to 20jsgibssrt3qghkgp8fnwcf4uzhhe4v 2024-03-09T14:29:03.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.860+0000 7fd3e6c12800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=20jsgibssrt3qghkgp8fnwcf4uzhhe4v 2024-03-09T14:29:03.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.861+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:29:03.863 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.862+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:29:03.863 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.862+0000 7fd3e6c12800 20 olh_log_entry: epoch=3 op=3 key=c[ojLpoV4ls9UY3MajBVoXMzlyTEurBMF] 2024-03-09T14:29:03.863 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.862+0000 7fd3e6c12800 20 get_obj_state: octx=0x55e6bcd99a60 obj=check-bucket:_:ojLpoV4ls9UY3MajBVoXMzlyTEurBMF_c state=0x55e6bce42a28 s->prefetch_data=0 2024-03-09T14:29:03.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.863+0000 7fd3e6c12800 10 manifest: total_size = 9 2024-03-09T14:29:03.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.863+0000 7fd3e6c12800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.3859803984417203833 2024-03-09T14:29:03.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.863+0000 7fd3e6c12800 20 get_obj_state: octx=0x55e6bcd99a60 obj=check-bucket:_:ojLpoV4ls9UY3MajBVoXMzlyTEurBMF_c state=0x55e6bce42a28 s->prefetch_data=0 2024-03-09T14:29:03.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.863+0000 7fd3e6c12800 20 prepare_atomic_modification: state is not atomic. state=0x55e6bce42a28 2024-03-09T14:29:03.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.863+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:29:03.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.863+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:29:03.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.863+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:29:03.866 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.865+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:29:03.866 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.865+0000 7fd3e6c12800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-03-09T14:29:03.866 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.865+0000 7fd3e6c12800 20 olh_log_entry: epoch=2 op=3 key=e[t5B2oe8EuT7ykTU62Mm-rkJw52YLITO] 2024-03-09T14:29:03.866 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.865+0000 7fd3e6c12800 20 get_obj_state: octx=0x55e6bcac2540 obj=check-bucket:_:t5B2oe8EuT7ykTU62Mm-rkJw52YLITO_e state=0x55e6bce49cf8 s->prefetch_data=0 2024-03-09T14:29:03.866 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.866+0000 7fd3e6c12800 10 manifest: total_size = 22 2024-03-09T14:29:03.867 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.866+0000 7fd3e6c12800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.4348224682048502956 2024-03-09T14:29:03.867 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.866+0000 7fd3e6c12800 20 get_obj_state: octx=0x55e6bcac2540 obj=check-bucket:_:t5B2oe8EuT7ykTU62Mm-rkJw52YLITO_e state=0x55e6bce49cf8 s->prefetch_data=0 2024-03-09T14:29:03.867 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.866+0000 7fd3e6c12800 20 prepare_atomic_modification: state is not atomic. state=0x55e6bce49cf8 2024-03-09T14:29:03.867 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.866+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:29:03.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.866+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:29:03.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.866+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:29:03.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.867+0000 7fd2c57fa640 20 handle_completion(): completion ok for obj=c[ojLpoV4ls9UY3MajBVoXMzlyTEurBMF] 2024-03-09T14:29:03.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.867+0000 7fd3e6c12800 20 olh_log_entry: epoch=3 op=3 key=d[blhMGRoExVliarIghD0fMid2NM6PbSp] 2024-03-09T14:29:03.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.867+0000 7fd3e6c12800 20 get_obj_state: octx=0x55e6bcaea150 obj=check-bucket:_:blhMGRoExVliarIghD0fMid2NM6PbSp_d state=0x55e6bce58768 s->prefetch_data=0 2024-03-09T14:29:03.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.867+0000 7fd3e6c12800 10 manifest: total_size = 9 2024-03-09T14:29:03.869 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.867+0000 7fd3e6c12800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.6979187445392620257 2024-03-09T14:29:03.869 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.867+0000 7fd3e6c12800 20 get_obj_state: octx=0x55e6bcaea150 obj=check-bucket:_:blhMGRoExVliarIghD0fMid2NM6PbSp_d state=0x55e6bce58768 s->prefetch_data=0 2024-03-09T14:29:03.869 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.867+0000 7fd3e6c12800 20 prepare_atomic_modification: state is not atomic. state=0x55e6bce58768 2024-03-09T14:29:03.869 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.867+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:29:03.875 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.874+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:29:03.875 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.874+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:29:03.875 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.874+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:29:03.876 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.875+0000 7fd3e6c12800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-03-09T14:29:03.876 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.875+0000 7fd3e6c12800 20 olh_log_entry: epoch=2 op=3 key=f[gXyhu0mIOUAUc05c78IV.3tflF8Cos1] 2024-03-09T14:29:03.876 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.875+0000 7fd3e6c12800 20 get_obj_state: octx=0x55e6bcd9a4c0 obj=check-bucket:_:gXyhu0mIOUAUc05c78IV.3tflF8Cos1_f state=0x55e6bce3ee98 s->prefetch_data=0 2024-03-09T14:29:03.876 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.875+0000 7fd3e6c12800 10 manifest: total_size = 22 2024-03-09T14:29:03.876 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.875+0000 7fd3e6c12800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.2726735558317558090 2024-03-09T14:29:03.877 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.875+0000 7fd3e6c12800 20 get_obj_state: octx=0x55e6bcd9a4c0 obj=check-bucket:_:gXyhu0mIOUAUc05c78IV.3tflF8Cos1_f state=0x55e6bce3ee98 s->prefetch_data=0 2024-03-09T14:29:03.877 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.875+0000 7fd3e6c12800 20 prepare_atomic_modification: state is not atomic. state=0x55e6bce3ee98 2024-03-09T14:29:03.877 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.875+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:29:03.877 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.876+0000 7fd2c57fa640 20 handle_completion(): completion ok for obj=e[t5B2oe8EuT7ykTU62Mm-rkJw52YLITO] 2024-03-09T14:29:03.877 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.877+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.8 2024-03-09T14:29:03.877 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.877+0000 7fd3e6c12800 1 NOTICE: finished shard 8 (1 entries removed) 2024-03-09T14:29:03.878 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.878+0000 7fd3e6c12800 20 get_obj_state: octx=0x55e6bcac2540 obj=check-bucket:e state=0x55e6bcd8f7c8 s->prefetch_data=0 2024-03-09T14:29:03.878 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.878+0000 7fd3e6c12800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7ucypbp63p6f0he9ggzd12plt23a7u96 2024-03-09T14:29:03.881 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.881+0000 7fd2c5ffb640 20 handle_completion(): completion ok for obj=d[blhMGRoExVliarIghD0fMid2NM6PbSp] 2024-03-09T14:29:03.881 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.881+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:29:03.881 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.881+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:29:03.884 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.884+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:29:03.884 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.884+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.5 2024-03-09T14:29:03.884 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.884+0000 7fd3e6c12800 1 NOTICE: finished shard 5 (1 entries removed) 2024-03-09T14:29:03.885 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.885+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.1 2024-03-09T14:29:03.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.885+0000 7fd3e6c12800 1 NOTICE: finished shard 1 (1 entries removed) 2024-03-09T14:29:03.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.886+0000 7fd2c57fa640 20 handle_completion(): completion ok for obj=f[gXyhu0mIOUAUc05c78IV.3tflF8Cos1] 2024-03-09T14:29:03.889 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.889+0000 7fd3e6c12800 20 get_obj_state: octx=0x55e6bcd9a4c0 obj=check-bucket:f state=0x55e6bce2f558 s->prefetch_data=0 2024-03-09T14:29:03.889 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.889+0000 7fd3e6c12800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=20jsgibssrt3qghkgp8fnwcf4uzhhe4v 2024-03-09T14:29:03.897 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.897+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:29:03.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.899+0000 7fd3e6c12800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.1.10 2024-03-09T14:29:03.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.899+0000 7fd3e6c12800 1 NOTICE: finished shard 10 (1 entries removed) 2024-03-09T14:29:03.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.899+0000 7fd3e6c12800 1 NOTICE: finished all shards (4 entries removed) 2024-03-09T14:29:03.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.900+0000 7fd298fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:03.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.902+0000 7fd3e6c12800 20 remove_watcher() i=0 2024-03-09T14:29:03.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.902+0000 7fd3e6c12800 2 removed watcher, disabling cache 2024-03-09T14:29:03.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.904+0000 7fd3e6c12800 20 remove_watcher() i=1 2024-03-09T14:29:03.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.905+0000 7fd3e6c12800 20 remove_watcher() i=2 2024-03-09T14:29:03.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.906+0000 7fd3e6c12800 20 remove_watcher() i=3 2024-03-09T14:29:03.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.907+0000 7fd3e6c12800 20 remove_watcher() i=4 2024-03-09T14:29:03.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.908+0000 7fd3e6c12800 20 remove_watcher() i=5 2024-03-09T14:29:03.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.909+0000 7fd3e6c12800 20 remove_watcher() i=6 2024-03-09T14:29:03.910 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:03.910+0000 7fd3e6c12800 20 remove_watcher() i=7 2024-03-09T14:29:04.109 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-03-09T14:29:04.136 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:29:04.136 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:29:04.169 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.169+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.170+0000 7f424368c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:04.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.170+0000 7f424368c800 20 realm 2024-03-09T14:29:04.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.170+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.170+0000 7f424368c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:04.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.170+0000 7f424368c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:29:04.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.170+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.170+0000 7f424368c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:04.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.170+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.171+0000 7f424368c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:04.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.171+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.172+0000 7f424368c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:29:04.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.172+0000 7f424368c800 20 searching for the correct realm 2024-03-09T14:29:04.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.174+0000 7f4241989640 0 -- 172.21.15.88:0/3643326720 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f423c064aa0 msgr2=0x7f423c063890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:04.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.380+0000 7f423bfff640 0 -- 172.21.15.88:0/3643326720 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f423c054330 msgr2=0x7f423c082800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:29:04.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.586+0000 7f424368c800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:29:04.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.586+0000 7f424368c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:29:04.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.586+0000 7f424368c800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:29:04.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.586+0000 7f424368c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:29:04.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.586+0000 7f424368c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:29:04.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.586+0000 7f424368c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:29:04.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.586+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.586+0000 7f424368c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:04.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.586+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.586+0000 7f424368c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:04.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.586+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.587+0000 7f424368c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:29:04.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.587+0000 7f424368c800 20 zone default found 2024-03-09T14:29:04.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.587+0000 7f424368c800 4 Realm: () 2024-03-09T14:29:04.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.587+0000 7f424368c800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:29:04.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.587+0000 7f424368c800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:29:04.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.587+0000 7f424368c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:29:04.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.587+0000 7f424368c800 20 zonegroup default 2024-03-09T14:29:04.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.587+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.587+0000 7f424368c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:04.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.587+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.587+0000 7f424368c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:04.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.587+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.588+0000 7f424368c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:04.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.588+0000 7f424368c800 20 started sync module instance, tier type = 2024-03-09T14:29:04.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.588+0000 7f424368c800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:29:04.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.602+0000 7f424368c800 20 add_watcher() i=0 2024-03-09T14:29:04.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.602+0000 7f424368c800 20 add_watcher() i=1 2024-03-09T14:29:04.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.602+0000 7f424368c800 20 add_watcher() i=2 2024-03-09T14:29:04.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.602+0000 7f424368c800 20 add_watcher() i=3 2024-03-09T14:29:04.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.602+0000 7f424368c800 20 add_watcher() i=4 2024-03-09T14:29:04.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.602+0000 7f424368c800 20 add_watcher() i=5 2024-03-09T14:29:04.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.602+0000 7f424368c800 20 add_watcher() i=6 2024-03-09T14:29:04.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.603+0000 7f424368c800 20 add_watcher() i=7 2024-03-09T14:29:04.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.603+0000 7f424368c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:29:04.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.605+0000 7f40f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:04.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.605+0000 7f424368c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:04.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.605+0000 7f424368c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:04.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.605+0000 7f424368c800 5 note: GC not initialized 2024-03-09T14:29:04.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.605+0000 7f40f67e4640 20 reqs_thread_entry: start 2024-03-09T14:29:04.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.605+0000 7f424368c800 20 init_complete bucket index max shards: 11 2024-03-09T14:29:04.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.606+0000 7f424368c800 20 Filter name: none 2024-03-09T14:29:04.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.606+0000 7f4067fff640 20 reqs_thread_entry: start 2024-03-09T14:29:04.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.606+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.606+0000 7f424368c800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:29:04.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.606+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.606+0000 7f424368c800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:29:04.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.606+0000 7f424368c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:29:04.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.606+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.607+0000 7f424368c800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:29:04.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.607+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.607+0000 7f424368c800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:29:04.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.607+0000 7f424368c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:29:04.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.608+0000 7f424368c800 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.608+0000 7f424368c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:04.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.609+0000 7f40f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:04.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.611+0000 7f424368c800 20 remove_watcher() i=0 2024-03-09T14:29:04.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.611+0000 7f424368c800 2 removed watcher, disabling cache 2024-03-09T14:29:04.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.612+0000 7f424368c800 20 remove_watcher() i=1 2024-03-09T14:29:04.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.613+0000 7f424368c800 20 remove_watcher() i=2 2024-03-09T14:29:04.615 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.615+0000 7f424368c800 20 remove_watcher() i=3 2024-03-09T14:29:04.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.616+0000 7f424368c800 20 remove_watcher() i=4 2024-03-09T14:29:04.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.617+0000 7f424368c800 20 remove_watcher() i=5 2024-03-09T14:29:04.619 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.619+0000 7f424368c800 20 remove_watcher() i=6 2024-03-09T14:29:04.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:29:04.620+0000 7f424368c800 20 remove_watcher() i=7 2024-03-09T14:29:04.631 INFO:tasks.workunit.client.0.smithi088.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-03-09T14:29:04.631 INFO:tasks.workunit.client.0.smithi088.stderr:Deleting bucket check-bucket 2024-03-09T14:29:04.859 INFO:tasks.workunit.client.0.smithi088.stderr:Completed bucket check tests 2024-03-09T14:29:04.859 INFO:tasks.workunit.client.0.smithi088.stdout:connected to http://localhost:80 2024-03-09T14:29:04.916 INFO:tasks.workunit.client.0.smithi088.stderr:+ deactivate 2024-03-09T14:29:04.916 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-03-09T14:29:04.916 INFO:tasks.workunit.client.0.smithi088.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-09T14:29:04.916 INFO:tasks.workunit.client.0.smithi088.stderr:+ export PATH 2024-03-09T14:29:04.917 INFO:tasks.workunit.client.0.smithi088.stderr:+ unset _OLD_VIRTUAL_PATH 2024-03-09T14:29:04.917 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' -n '' ']' 2024-03-09T14:29:04.917 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:29:04.917 INFO:tasks.workunit.client.0.smithi088.stderr:+ hash -r 2024-03-09T14:29:04.917 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' -n '' ']' 2024-03-09T14:29:04.917 INFO:tasks.workunit.client.0.smithi088.stderr:+ unset VIRTUAL_ENV 2024-03-09T14:29:04.917 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' '!' '' = nondestructive ']' 2024-03-09T14:29:04.917 INFO:tasks.workunit.client.0.smithi088.stderr:+ unset -f deactivate 2024-03-09T14:29:04.917 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK. 2024-03-09T14:29:04.918 INFO:tasks.workunit.client.0.smithi088.stdout:OK. 2024-03-09T14:29:04.918 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:29:04.919 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:29:04.999 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-03-09T14:29:04.999 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-09T14:29:05.370 DEBUG:teuthology.parallel:result is None 2024-03-09T14:29:05.370 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:29:05.409 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:29:05.409 DEBUG:teuthology.orchestra.run.smithi088:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:29:05.491 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:29:05.492 INFO:teuthology.run_tasks:Running task workunit... 2024-03-09T14:29:05.502 INFO:tasks.workunit:Pulling workunits from ref c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:29:05.502 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-09T14:29:05.502 DEBUG:teuthology.orchestra.run.smithi088:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:29:05.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:29:05.559 INFO:teuthology.orchestra.run.smithi088.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-09T14:29:05.559 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:29:05.627 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-09T14:29:05.627 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-09T14:29:05.695 INFO:tasks.workunit:timeout=3h 2024-03-09T14:29:05.695 INFO:tasks.workunit:cleanup=True 2024-03-09T14:29:05.696 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:29:05.763 INFO:tasks.workunit.client.0.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-09T14:30:21.313 INFO:tasks.workunit.client.0.smithi088.stderr:Note: switching to 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'. 2024-03-09T14:30:21.313 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:30:21.313 INFO:tasks.workunit.client.0.smithi088.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-09T14:30:21.313 INFO:tasks.workunit.client.0.smithi088.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-09T14:30:21.313 INFO:tasks.workunit.client.0.smithi088.stderr:state without impacting any branches by switching back to a branch. 2024-03-09T14:30:21.313 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:30:21.313 INFO:tasks.workunit.client.0.smithi088.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-09T14:30:21.314 INFO:tasks.workunit.client.0.smithi088.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-09T14:30:21.314 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:30:21.314 INFO:tasks.workunit.client.0.smithi088.stderr: git switch -c 2024-03-09T14:30:21.314 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:30:21.314 INFO:tasks.workunit.client.0.smithi088.stderr:Or undo this operation with: 2024-03-09T14:30:21.314 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:30:21.314 INFO:tasks.workunit.client.0.smithi088.stderr: git switch - 2024-03-09T14:30:21.314 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:30:21.314 INFO:tasks.workunit.client.0.smithi088.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-09T14:30:21.314 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:30:21.314 INFO:tasks.workunit.client.0.smithi088.stderr:HEAD is now at c00d9c609fb DNM: point s3tests at branch cbodley:wip-iam-user-apis 2024-03-09T14:30:21.317 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-09T14:30:21.384 INFO:tasks.workunit.client.0.smithi088.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-09T14:30:21.386 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:30:21.387 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-09T14:30:21.436 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-09T14:30:21.485 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-09T14:30:21.524 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:30:21.526 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:30:21.526 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-09T14:30:21.564 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:30:21.567 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:30:21.568 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-09T14:30:21.637 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-03-09T14:30:21.639 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-03-09T14:30:21.639 DEBUG:teuthology.orchestra.run.smithi088:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-03-09T14:30:21.718 INFO:tasks.workunit.client.0.smithi088.stdout:Running main() from gmock_main.cc 2024-03-09T14:30:21.718 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 11 tests from 1 test suite. 2024-03-09T14:30:21.718 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:30:21.718 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 11 tests from ClsLock 2024-03-09T14:30:21.718 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-03-09T14:30:23.324 INFO:tasks.workunit.client.0.smithi088.stdout:lock: mylock 2024-03-09T14:30:23.324 INFO:tasks.workunit.client.0.smithi088.stdout: lock_type: exclusive 2024-03-09T14:30:23.324 INFO:tasks.workunit.client.0.smithi088.stdout: tag: 2024-03-09T14:30:23.324 INFO:tasks.workunit.client.0.smithi088.stdout: lockers: 2024-03-09T14:30:23.325 INFO:tasks.workunit.client.0.smithi088.stdout: client.5124 expiration=2024-03-09T14:32:23.320046+0000 addr=v1:172.21.15.88:0/277333542 cookie= 2024-03-09T14:30:23.328 INFO:tasks.workunit.client.0.smithi088.stdout:lock: mylock 2024-03-09T14:30:23.328 INFO:tasks.workunit.client.0.smithi088.stdout: lock_type: shared 2024-03-09T14:30:23.329 INFO:tasks.workunit.client.0.smithi088.stdout: tag: 2024-03-09T14:30:23.329 INFO:tasks.workunit.client.0.smithi088.stdout: lockers: 2024-03-09T14:30:23.329 INFO:tasks.workunit.client.0.smithi088.stdout: client.5015 expiration=0.000000 addr=v1:172.21.15.88:0/3975717769 cookie= 2024-03-09T14:30:23.329 INFO:tasks.workunit.client.0.smithi088.stdout: client.5124 expiration=2024-03-09T14:32:23.327985+0000 addr=v1:172.21.15.88:0/277333542 cookie= 2024-03-09T14:30:23.330 INFO:tasks.workunit.client.0.smithi088.stdout:lock: mylock 2024-03-09T14:30:23.330 INFO:tasks.workunit.client.0.smithi088.stdout: lock_type: shared 2024-03-09T14:30:23.330 INFO:tasks.workunit.client.0.smithi088.stdout: tag: 2024-03-09T14:30:23.330 INFO:tasks.workunit.client.0.smithi088.stdout: lockers: 2024-03-09T14:30:23.330 INFO:tasks.workunit.client.0.smithi088.stdout: client.5015 expiration=0.000000 addr=v1:172.21.15.88:0/3975717769 cookie= 2024-03-09T14:30:24.093 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] ClsLock.TestMultiLocking (2375 ms) 2024-03-09T14:30:24.093 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] ClsLock.TestMeta 2024-03-09T14:30:26.546 INFO:tasks.workunit.client.0.smithi088.stdout:lock: mylock 2024-03-09T14:30:26.546 INFO:tasks.workunit.client.0.smithi088.stdout: lock_type: shared 2024-03-09T14:30:26.546 INFO:tasks.workunit.client.0.smithi088.stdout: tag: 2024-03-09T14:30:26.546 INFO:tasks.workunit.client.0.smithi088.stdout: lockers: 2024-03-09T14:30:26.546 INFO:tasks.workunit.client.0.smithi088.stdout: client.5027 expiration=0.000000 addr=v1:172.21.15.88:0/3473079730 cookie= 2024-03-09T14:30:26.549 INFO:tasks.workunit.client.0.smithi088.stdout:lock: mylock 2024-03-09T14:30:26.549 INFO:tasks.workunit.client.0.smithi088.stdout: lock_type: exclusive 2024-03-09T14:30:26.549 INFO:tasks.workunit.client.0.smithi088.stdout: tag: new_tag 2024-03-09T14:30:26.549 INFO:tasks.workunit.client.0.smithi088.stdout: lockers: 2024-03-09T14:30:26.549 INFO:tasks.workunit.client.0.smithi088.stdout: client.5021 expiration=0.000000 addr=v1:172.21.15.88:0/896700996 cookie= 2024-03-09T14:30:27.112 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] ClsLock.TestMeta (3020 ms) 2024-03-09T14:30:27.112 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] ClsLock.TestCookie 2024-03-09T14:30:29.134 INFO:tasks.workunit.client.0.smithi088.stdout:lock: mylock 2024-03-09T14:30:29.135 INFO:tasks.workunit.client.0.smithi088.stdout: lock_type: exclusive 2024-03-09T14:30:29.135 INFO:tasks.workunit.client.0.smithi088.stdout: tag: 2024-03-09T14:30:29.135 INFO:tasks.workunit.client.0.smithi088.stdout: lockers: 2024-03-09T14:30:29.137 INFO:tasks.workunit.client.0.smithi088.stdout:lock: mylock 2024-03-09T14:30:29.137 INFO:tasks.workunit.client.0.smithi088.stdout: lock_type: shared 2024-03-09T14:30:29.137 INFO:tasks.workunit.client.0.smithi088.stdout: tag: 2024-03-09T14:30:29.137 INFO:tasks.workunit.client.0.smithi088.stdout: lockers: 2024-03-09T14:30:29.137 INFO:tasks.workunit.client.0.smithi088.stdout: client.5151 expiration=0.000000 addr=v1:172.21.15.88:0/2274035554 cookie= 2024-03-09T14:30:29.137 INFO:tasks.workunit.client.0.smithi088.stdout: client.5151 expiration=0.000000 addr=v1:172.21.15.88:0/2274035554 cookie=new cookie 2024-03-09T14:30:30.123 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] ClsLock.TestCookie (3010 ms) 2024-03-09T14:30:30.124 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-03-09T14:30:33.144 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] ClsLock.TestMultipleLocks (3021 ms) 2024-03-09T14:30:33.144 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] ClsLock.TestLockDuration 2024-03-09T14:30:40.223 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] ClsLock.TestLockDuration (7078 ms) 2024-03-09T14:30:40.223 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-03-09T14:30:43.257 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] ClsLock.TestAssertLocked (3036 ms) 2024-03-09T14:30:43.257 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] ClsLock.TestSetCookie 2024-03-09T14:30:46.262 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] ClsLock.TestSetCookie (3004 ms) 2024-03-09T14:30:46.262 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] ClsLock.TestRenew 2024-03-09T14:31:07.321 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] ClsLock.TestRenew (21056 ms) 2024-03-09T14:31:07.321 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-03-09T14:31:14.364 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7045 ms) 2024-03-09T14:31:14.364 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-03-09T14:31:21.635 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7271 ms) 2024-03-09T14:31:21.635 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-03-09T14:31:29.668 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8033 ms) 2024-03-09T14:31:29.668 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 11 tests from ClsLock (67950 ms total) 2024-03-09T14:31:29.668 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:31:29.668 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:31:29.668 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 11 tests from 1 test suite ran. (67950 ms total) 2024-03-09T14:31:29.668 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 11 tests. 2024-03-09T14:31:29.671 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:31:29.671 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:31:29.756 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-03-09T14:31:29.757 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-03-09T14:31:29.758 DEBUG:teuthology.orchestra.run.smithi088:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-03-09T14:31:29.801 INFO:tasks.workunit.client.0.smithi088.stdout:Running main() from gmock_main.cc 2024-03-09T14:31:29.801 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 4 tests from 1 test suite. 2024-03-09T14:31:29.801 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:31:29.801 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 4 tests from cls_log 2024-03-09T14:31:29.801 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-03-09T14:31:32.698 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_log.test_log_add_same_time (2896 ms) 2024-03-09T14:31:32.698 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-03-09T14:31:35.704 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_log.test_log_add_different_time (3007 ms) 2024-03-09T14:31:35.705 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_log.trim_by_time 2024-03-09T14:31:38.740 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_log.trim_by_time (3035 ms) 2024-03-09T14:31:38.741 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_log.trim_by_marker 2024-03-09T14:31:41.760 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_log.trim_by_marker (3021 ms) 2024-03-09T14:31:41.760 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 4 tests from cls_log (11959 ms total) 2024-03-09T14:31:41.760 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:31:41.761 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:31:41.761 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 4 tests from 1 test suite ran. (11959 ms total) 2024-03-09T14:31:41.761 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 4 tests. 2024-03-09T14:31:41.763 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:31:41.763 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:31:41.847 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-03-09T14:31:41.848 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-03-09T14:31:41.849 DEBUG:teuthology.orchestra.run.smithi088:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-03-09T14:31:41.931 INFO:tasks.workunit.client.0.smithi088.stdout:Running main() from gmock_main.cc 2024-03-09T14:31:41.931 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 10 tests from 1 test suite. 2024-03-09T14:31:41.931 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:31:41.932 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 10 tests from cls_refcount 2024-03-09T14:31:41.932 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_refcount.test_implicit 2024-03-09T14:31:44.782 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_refcount.test_implicit (2851 ms) 2024-03-09T14:31:44.782 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-03-09T14:31:47.796 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3012 ms) 2024-03-09T14:31:47.796 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_refcount.test_put_snap 2024-03-09T14:31:56.832 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_refcount.test_put_snap (9038 ms) 2024-03-09T14:31:56.832 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_refcount.test_explicit 2024-03-09T14:31:59.858 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_refcount.test_explicit (3025 ms) 2024-03-09T14:31:59.858 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_refcount.set 2024-03-09T14:32:02.877 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-03-09T14:32:02.877+0000 7f0ec442c640 -1 calc_pg_upmaps abort due to max <= 0 2024-03-09T14:32:02.880 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_refcount.set (3021 ms) 2024-03-09T14:32:02.880 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-03-09T14:32:09.913 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_refcount.test_implicit_ec (7034 ms) 2024-03-09T14:32:09.913 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-03-09T14:32:16.932 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7020 ms) 2024-03-09T14:32:16.933 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-03-09T14:32:29.035 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_refcount.test_put_snap_ec (12102 ms) 2024-03-09T14:32:29.035 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-03-09T14:32:36.045 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_refcount.test_explicit_ec (7010 ms) 2024-03-09T14:32:36.045 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_refcount.set_ec 2024-03-09T14:32:43.086 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_refcount.set_ec (7042 ms) 2024-03-09T14:32:43.087 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 10 tests from cls_refcount (61155 ms total) 2024-03-09T14:32:43.087 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:32:43.087 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:32:43.087 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 10 tests from 1 test suite ran. (61155 ms total) 2024-03-09T14:32:43.087 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 10 tests. 2024-03-09T14:32:43.090 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:32:43.090 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:32:43.133 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-03-09T14:32:43.134 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-03-09T14:32:43.134 DEBUG:teuthology.orchestra.run.smithi088:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-03-09T14:32:43.217 INFO:tasks.workunit.client.0.smithi088.stdout:Running main() from gmock_main.cc 2024-03-09T14:32:43.217 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 16 tests from 1 test suite. 2024-03-09T14:32:43.217 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:32:43.217 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 16 tests from cls_rgw 2024-03-09T14:32:45.105 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.index_basic 2024-03-09T14:32:45.150 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.index_basic (45 ms) 2024-03-09T14:32:45.150 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-03-09T14:32:45.180 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (30 ms) 2024-03-09T14:32:45.180 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.index_remove_object 2024-03-09T14:32:45.230 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.index_remove_object (50 ms) 2024-03-09T14:32:45.230 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.index_suggest 2024-03-09T14:32:46.758 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.index_suggest (1528 ms) 2024-03-09T14:32:46.758 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-03-09T14:32:46.765 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.index_suggest_complete (7 ms) 2024-03-09T14:32:46.765 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.index_list 2024-03-09T14:32:46.794 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.index_list (28 ms) 2024-03-09T14:32:46.794 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-03-09T14:33:05.696 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.index_list_delimited (18902 ms) 2024-03-09T14:33:05.696 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.bi_list 2024-03-09T14:33:05.768 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.bi_list (72 ms) 2024-03-09T14:33:05.768 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.gc_set 2024-03-09T14:33:05.777 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2024-03-09T14:33:05.777 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.gc_list 2024-03-09T14:33:05.787 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.gc_list (10 ms) 2024-03-09T14:33:05.787 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.gc_defer 2024-03-09T14:33:13.249 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.gc_defer (7461 ms) 2024-03-09T14:33:13.249 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.usage_basic 2024-03-09T14:33:13.335 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.usage_basic (87 ms) 2024-03-09T14:33:13.336 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-03-09T14:33:13.336 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-03-09T14:33:13.336 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.usage_clear 2024-03-09T14:33:13.430 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.usage_clear (93 ms) 2024-03-09T14:33:13.430 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-03-09T14:33:13.472 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.bi_log_trim (43 ms) 2024-03-09T14:33:13.472 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-03-09T14:33:13.496 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw.index_racing_removes (24 ms) 2024-03-09T14:33:14.251 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 16 tests from cls_rgw (28391 ms total) 2024-03-09T14:33:14.251 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:33:14.251 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:33:14.251 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 16 tests from 1 test suite ran. (31034 ms total) 2024-03-09T14:33:14.251 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 16 tests. 2024-03-09T14:33:14.254 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:33:14.254 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:33:14.319 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-03-09T14:33:14.320 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-03-09T14:33:14.320 DEBUG:teuthology.orchestra.run.smithi088:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-03-09T14:33:14.365 INFO:tasks.workunit.client.0.smithi088.stdout:Running main() from gmock_main.cc 2024-03-09T14:33:14.365 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 9 tests from 1 test suite. 2024-03-09T14:33:14.365 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:33:14.366 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 9 tests from cls_rgw_gc 2024-03-09T14:33:14.366 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw_gc.init 2024-03-09T14:33:16.262 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw_gc.init (1896 ms) 2024-03-09T14:33:16.262 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-03-09T14:33:16.288 INFO:tasks.workunit.client.0.smithi088.stderr:[ ] list info tag = chain-0 2024-03-09T14:33:16.288 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (27 ms) 2024-03-09T14:33:16.288 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-03-09T14:33:16.295 INFO:tasks.workunit.client.0.smithi088.stderr:[ ] next_marker is: = 0/4263 2024-03-09T14:33:16.295 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (7 ms) 2024-03-09T14:33:16.295 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-03-09T14:33:16.302 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (7 ms) 2024-03-09T14:33:16.302 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-03-09T14:33:16.407 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (105 ms) 2024-03-09T14:33:16.407 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-03-09T14:33:16.416 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (9 ms) 2024-03-09T14:33:16.416 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-03-09T14:33:16.423 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (7 ms) 2024-03-09T14:33:16.423 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-03-09T14:33:16.430 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (7 ms) 2024-03-09T14:33:16.430 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw_gc.finalize 2024-03-09T14:33:17.271 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw_gc.finalize (838 ms) 2024-03-09T14:33:17.271 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 9 tests from cls_rgw_gc (2903 ms total) 2024-03-09T14:33:17.271 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:33:17.271 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:33:17.271 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 9 tests from 1 test suite ran. (2903 ms total) 2024-03-09T14:33:17.271 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 9 tests. 2024-03-09T14:33:17.272 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:33:17.272 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:33:17.315 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-03-09T14:33:17.316 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-03-09T14:33:17.317 DEBUG:teuthology.orchestra.run.smithi088:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-03-09T14:33:17.405 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:33:17.405 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:33:17.405 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 1 test from 1 test suite. 2024-03-09T14:33:17.405 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:33:19.279 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 1 test from cls_rgw_stats 2024-03-09T14:33:19.279 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] cls_rgw_stats.simulate 2024-03-09T14:33:19.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.291+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~OE58VLPX6BYI.0 size=1048576 2024-03-09T14:33:19.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.292+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~OE58VLPX6BYI.1 size=1048576 2024-03-09T14:33:19.294 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.293+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~OE58VLPX6BYI.2 size=102974 2024-03-09T14:33:19.294 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.293+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=OE58VLPX6BYI tag=UDFAN4YP0U0C type=write size=3248702 2024-03-09T14:33:19.295 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.295+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=PE6REC7IULAT type=del size=462057 2024-03-09T14:33:19.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.296+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=XD6C6WHRSJH3 type=del size=3750625 2024-03-09T14:33:19.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.299+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~UYYN1AFDS7QI.0 size=235546 2024-03-09T14:33:19.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.299+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=UYYN1AFDS7QI tag=KN61UXJX80D9 type=write size=1284122 2024-03-09T14:33:19.301 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.301+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~STFVY4XMY9L0.0 size=1048576 2024-03-09T14:33:19.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.302+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~STFVY4XMY9L0.1 size=1048576 2024-03-09T14:33:19.304 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.303+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~STFVY4XMY9L0.2 size=723542 2024-03-09T14:33:19.304 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.303+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=STFVY4XMY9L0 tag=EGJBPH0YEDMP type=write size=3869270 2024-03-09T14:33:19.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.305+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~VMR9LLFFFP1L.0 size=1048576 2024-03-09T14:33:19.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.306+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~VMR9LLFFFP1L.1 size=1048576 2024-03-09T14:33:19.308 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.307+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~VMR9LLFFFP1L.2 size=469923 2024-03-09T14:33:19.308 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.307+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=VMR9LLFFFP1L tag=NX74N2P5DE8W type=write size=3615651 2024-03-09T14:33:19.309 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.308+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=MHE77PHYTEL3 type=del size=3800331 2024-03-09T14:33:19.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.310+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=MO8TUO6FWQWF type=del size=4129427 2024-03-09T14:33:19.311 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.311+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=MMQCURG107KR type=del size=3639581 2024-03-09T14:33:19.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.312+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=2B02BOFMWOUN type=del size=1599019 2024-03-09T14:33:19.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.314+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=7OYHNN05UW5P type=del size=3377831 2024-03-09T14:33:19.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.316+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~1XPN6D9HIWUQ.0 size=520956 2024-03-09T14:33:19.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.316+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=1XPN6D9HIWUQ tag=LWYFH60L64R6 type=write size=1569532 2024-03-09T14:33:19.318 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.317+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=S39OY4CMOP7K type=del size=167518 2024-03-09T14:33:19.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.318+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=DLECP5FHVXVF type=del size=2822998 2024-03-09T14:33:19.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.320+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=9S257E84YQYE type=del size=2830755 2024-03-09T14:33:19.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.322+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~7R3VZKSPWRG2.0 size=1048576 2024-03-09T14:33:19.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.323+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~7R3VZKSPWRG2.1 size=740745 2024-03-09T14:33:19.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.323+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=7R3VZKSPWRG2 tag=E3FMR5EW79BM type=write size=2837897 2024-03-09T14:33:19.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.324+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~OE58VLPX6BYI.0 size=1048576 2024-03-09T14:33:19.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.325+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~OE58VLPX6BYI.1 size=1048576 2024-03-09T14:33:19.327 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.326+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~OE58VLPX6BYI.2 size=102974 2024-03-09T14:33:19.329 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.328+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=OE58VLPX6BYI tag=UDFAN4YP0U0C type=write size=3248702 2024-03-09T14:33:19.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.330+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~SWRQY3246N53.0 size=1048576 2024-03-09T14:33:19.332 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.331+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~SWRQY3246N53.1 size=1048576 2024-03-09T14:33:19.333 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.332+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~SWRQY3246N53.2 size=17246 2024-03-09T14:33:19.333 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.332+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=SWRQY3246N53 tag=DFOX3S44ZX3R type=write size=3162974 2024-03-09T14:33:19.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.333+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=PE6REC7IULAT type=del 2024-03-09T14:33:19.335 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.335+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=MNFX5LHES0RR type=del size=433340 2024-03-09T14:33:19.336 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.336+0000 7f586ae3d780 1 < canceled operation key=LRI2GKBGVCWW tag=XD6C6WHRSJH3 type=del size=3750625 2024-03-09T14:33:19.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.337+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=ZHSVJDD8U07O type=del size=2550370 2024-03-09T14:33:19.339 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.338+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~UYYN1AFDS7QI.0 size=235546 2024-03-09T14:33:19.341 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.340+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=UYYN1AFDS7QI tag=KN61UXJX80D9 type=write size=1284122 2024-03-09T14:33:19.342 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.341+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=5FYEX3OYF7FS type=del size=1293236 2024-03-09T14:33:19.342 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.342+0000 7f586ae3d780 1 < canceled part key=_multipart_CAISZZZSOD34.2~STFVY4XMY9L0.0 size=1048576 2024-03-09T14:33:19.343 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.343+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~STFVY4XMY9L0.1 size=1048576 2024-03-09T14:33:19.344 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.344+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~STFVY4XMY9L0.2 size=723542 2024-03-09T14:33:19.346 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.346+0000 7f586ae3d780 1 < canceled multipart upload key=CAISZZZSOD34 upload=STFVY4XMY9L0 tag=EGJBPH0YEDMP type=write size=3869270 2024-03-09T14:33:19.347 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.347+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=AAQOJFOXOAHC type=del size=1804522 2024-03-09T14:33:19.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.348+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~VMR9LLFFFP1L.0 size=1048576 2024-03-09T14:33:19.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.348+0000 7f586ae3d780 1 < canceled part key=_multipart_OXBDXIILR3NS.2~VMR9LLFFFP1L.1 size=1048576 2024-03-09T14:33:19.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.349+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~VMR9LLFFFP1L.2 size=469923 2024-03-09T14:33:19.352 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.352+0000 7f586ae3d780 1 < canceled multipart upload key=OXBDXIILR3NS upload=VMR9LLFFFP1L tag=NX74N2P5DE8W type=write size=3615651 2024-03-09T14:33:19.353 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.353+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=PCNR1DCSBZ68 type=del size=2786336 2024-03-09T14:33:19.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.354+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=MHE77PHYTEL3 type=del 2024-03-09T14:33:19.357 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.356+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~8DKW81RDNZ6X.0 size=247014 2024-03-09T14:33:19.357 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.356+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=8DKW81RDNZ6X tag=NV5C6JIT2750 type=write size=1295590 2024-03-09T14:33:19.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.358+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=MO8TUO6FWQWF type=del 2024-03-09T14:33:19.360 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.360+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~2RNG0XCG6PZ6.0 size=1048576 2024-03-09T14:33:19.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.361+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~2RNG0XCG6PZ6.1 size=115227 2024-03-09T14:33:19.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.361+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=2RNG0XCG6PZ6 tag=VLCRWV4GDSOC type=write size=2212379 2024-03-09T14:33:19.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.362+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=MMQCURG107KR type=del 2024-03-09T14:33:19.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.364+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=HW5I1LT9F7YX type=del size=1312846 2024-03-09T14:33:19.365 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.365+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=2B02BOFMWOUN type=del 2024-03-09T14:33:19.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.367+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~T468F2RODAQZ.0 size=1048576 2024-03-09T14:33:19.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.368+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~T468F2RODAQZ.1 size=1048576 2024-03-09T14:33:19.369 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.369+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~T468F2RODAQZ.2 size=385738 2024-03-09T14:33:19.370 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.369+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=T468F2RODAQZ tag=LZJ7NS00USPV type=write size=3531466 2024-03-09T14:33:19.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.371+0000 7f586ae3d780 1 < suggested remove operation key=5PERWGS0GOJU tag=7OYHNN05UW5P type=del 2024-03-09T14:33:19.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.372+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=HR1YDUKWV2HL type=del size=2029160 2024-03-09T14:33:19.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.374+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~1XPN6D9HIWUQ.0 size=520956 2024-03-09T14:33:19.377 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.376+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=1XPN6D9HIWUQ tag=LWYFH60L64R6 type=write size=1569532 2024-03-09T14:33:19.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.377+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=KJ4E166Y06TV type=del size=1598063 2024-03-09T14:33:19.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.378+0000 7f586ae3d780 1 < canceled operation key=2BUCMVWK7J1V tag=S39OY4CMOP7K type=del size=167518 2024-03-09T14:33:19.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.380+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=KE78DQVNEV1S type=write size=649052 2024-03-09T14:33:19.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.382+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=DLECP5FHVXVF type=del 2024-03-09T14:33:19.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.383+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~UBDGGJN5L29U.0 size=1048576 2024-03-09T14:33:19.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.384+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~UBDGGJN5L29U.1 size=1048576 2024-03-09T14:33:19.385 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.385+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~UBDGGJN5L29U.2 size=230206 2024-03-09T14:33:19.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.385+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=UBDGGJN5L29U tag=KB8ZN5KGCCJT type=write size=3375934 2024-03-09T14:33:19.388 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.387+0000 7f586ae3d780 1 < suggested remove operation key=DGO3ZT8ST90A tag=9S257E84YQYE type=del 2024-03-09T14:33:19.389 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.389+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=OU3F9JMSPCUV type=write size=70857 2024-03-09T14:33:19.391 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.390+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~7R3VZKSPWRG2.0 size=1048576 2024-03-09T14:33:19.391 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.391+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~7R3VZKSPWRG2.1 size=740745 2024-03-09T14:33:19.393 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.393+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=7R3VZKSPWRG2 tag=E3FMR5EW79BM type=write size=2837897 2024-03-09T14:33:19.396 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.395+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~3DDRVH9CS7FH.0 size=1048576 2024-03-09T14:33:19.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.396+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~3DDRVH9CS7FH.1 size=921650 2024-03-09T14:33:19.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.396+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=3DDRVH9CS7FH tag=QH5PYNTH98D4 type=write size=3018802 2024-03-09T14:33:19.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.397+0000 7f586ae3d780 1 < canceled part key=_multipart_DJH53FNVMLGY.2~SWRQY3246N53.0 size=1048576 2024-03-09T14:33:19.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.398+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~SWRQY3246N53.1 size=1048576 2024-03-09T14:33:19.399 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.399+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~SWRQY3246N53.2 size=17246 2024-03-09T14:33:19.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.401+0000 7f586ae3d780 1 < canceled multipart upload key=DJH53FNVMLGY upload=SWRQY3246N53 tag=DFOX3S44ZX3R type=write size=3162974 2024-03-09T14:33:19.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.403+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~QMHFW5LDTEEW.0 size=224006 2024-03-09T14:33:19.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.403+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=QMHFW5LDTEEW tag=11JH20BWCI0V type=write size=1272582 2024-03-09T14:33:19.405 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.404+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=MNFX5LHES0RR type=del 2024-03-09T14:33:19.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.405+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=70G7I0NFAY00 type=del size=2526917 2024-03-09T14:33:19.410 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.407+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=ZHSVJDD8U07O type=del 2024-03-09T14:33:19.410 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.409+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~RY0GHW1JTLWG.0 size=1048576 2024-03-09T14:33:19.410 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.410+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~RY0GHW1JTLWG.1 size=1048576 2024-03-09T14:33:19.411 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.410+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~RY0GHW1JTLWG.2 size=980429 2024-03-09T14:33:19.411 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.410+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=RY0GHW1JTLWG tag=0CTD6Z6RQE1W type=write size=4126157 2024-03-09T14:33:19.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.412+0000 7f586ae3d780 1 < completed delete operation key=NHIOOLNXLZZC tag=5FYEX3OYF7FS type=del 2024-03-09T14:33:19.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.413+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=YVVKEFWBG21K type=write size=44078 2024-03-09T14:33:19.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.416+0000 7f586ae3d780 1 < suggested remove operation key=BHSYRD3IEJWW tag=AAQOJFOXOAHC type=del 2024-03-09T14:33:19.417 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.417+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=01D24DPT4KFD type=del size=1512727 2024-03-09T14:33:19.418 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.418+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=PCNR1DCSBZ68 type=del 2024-03-09T14:33:19.420 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.420+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~RMKRKSM83WP1.0 size=1048576 2024-03-09T14:33:19.421 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.421+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~RMKRKSM83WP1.1 size=225469 2024-03-09T14:33:19.421 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.421+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=RMKRKSM83WP1 tag=07DOUQF8PEMR type=write size=2322621 2024-03-09T14:33:19.423 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.422+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~8DKW81RDNZ6X.0 size=247014 2024-03-09T14:33:19.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.424+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=8DKW81RDNZ6X tag=NV5C6JIT2750 type=write size=1295590 2024-03-09T14:33:19.426 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.426+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~06CE2QKJLYY2.0 size=1048576 2024-03-09T14:33:19.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.427+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~06CE2QKJLYY2.1 size=272179 2024-03-09T14:33:19.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.427+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=06CE2QKJLYY2 tag=P6NJO9MV01AP type=write size=2369331 2024-03-09T14:33:19.428 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.428+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~2RNG0XCG6PZ6.0 size=1048576 2024-03-09T14:33:19.429 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.429+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~2RNG0XCG6PZ6.1 size=115227 2024-03-09T14:33:19.431 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.430+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=2RNG0XCG6PZ6 tag=VLCRWV4GDSOC type=write size=2212379 2024-03-09T14:33:19.432 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.432+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=ODYSUXN2FX9B type=del size=2114595 2024-03-09T14:33:19.433 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.433+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=HW5I1LT9F7YX type=del 2024-03-09T14:33:19.435 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.434+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=F5EIZ52NXRS1 type=write size=483359 2024-03-09T14:33:19.435 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.434+0000 7f586ae3d780 1 < canceled part key=_multipart_WNVN3EOUUBGR.2~T468F2RODAQZ.0 size=1048576 2024-03-09T14:33:19.435 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.435+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~T468F2RODAQZ.1 size=1048576 2024-03-09T14:33:19.436 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.436+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~T468F2RODAQZ.2 size=385738 2024-03-09T14:33:19.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.438+0000 7f586ae3d780 1 < canceled multipart upload key=WNVN3EOUUBGR upload=T468F2RODAQZ tag=LZJ7NS00USPV type=write size=3531466 2024-03-09T14:33:19.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.439+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=307AMRKR1WN1 type=del size=390868 2024-03-09T14:33:19.442 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.441+0000 7f586ae3d780 1 < suggested update operation key=NHIOOLNXLZZC tag=HR1YDUKWV2HL type=del size=2029160 2024-03-09T14:33:19.443 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.442+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=QNU9DJKLD7Z9 type=del size=3649304 2024-03-09T14:33:19.444 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.444+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=KJ4E166Y06TV type=del 2024-03-09T14:33:19.445 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.445+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=QDZ283UYL7S1 type=del size=1756844 2024-03-09T14:33:19.448 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.447+0000 7f586ae3d780 1 < suggested update operation key=C1UGQOQ6AE1E tag=KE78DQVNEV1S type=write size=649052 2024-03-09T14:33:19.450 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.449+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~A393HVR88APK.0 size=1048576 2024-03-09T14:33:19.450 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.450+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~A393HVR88APK.1 size=82114 2024-03-09T14:33:19.451 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.450+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=A393HVR88APK tag=KZM8VCECGSDY type=write size=2179266 2024-03-09T14:33:19.452 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.451+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~UBDGGJN5L29U.0 size=1048576 2024-03-09T14:33:19.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.452+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~UBDGGJN5L29U.1 size=1048576 2024-03-09T14:33:19.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.453+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~UBDGGJN5L29U.2 size=230206 2024-03-09T14:33:19.456 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.455+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=UBDGGJN5L29U tag=KB8ZN5KGCCJT type=write size=3375934 2024-03-09T14:33:19.458 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.457+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~NUVKPPLG3FW4.0 size=1048576 2024-03-09T14:33:19.459 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.458+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~NUVKPPLG3FW4.1 size=59486 2024-03-09T14:33:19.459 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.458+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=NUVKPPLG3FW4 tag=4AGP7T35PK52 type=write size=2156638 2024-03-09T14:33:19.460 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.460+0000 7f586ae3d780 1 < completed write operation key=IK528ND96157 tag=OU3F9JMSPCUV type=write size=70857 2024-03-09T14:33:19.461 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.461+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=PV6VP43KLLP4 type=del size=3536732 2024-03-09T14:33:19.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.463+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~3DDRVH9CS7FH.0 size=1048576 2024-03-09T14:33:19.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.463+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~3DDRVH9CS7FH.1 size=921650 2024-03-09T14:33:19.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.466+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=3DDRVH9CS7FH tag=QH5PYNTH98D4 type=write size=3018802 2024-03-09T14:33:19.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.467+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~LJU281T85DPS.0 size=1048576 2024-03-09T14:33:19.468 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.468+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~LJU281T85DPS.1 size=514401 2024-03-09T14:33:19.468 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.468+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=LJU281T85DPS tag=VPZ36XSUBLPD type=write size=2611553 2024-03-09T14:33:19.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.469+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~QMHFW5LDTEEW.0 size=224006 2024-03-09T14:33:19.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.471+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=QMHFW5LDTEEW tag=11JH20BWCI0V type=write size=1272582 2024-03-09T14:33:19.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.473+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=Q95XNX151TMU type=del size=580623 2024-03-09T14:33:19.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.474+0000 7f586ae3d780 1 < canceled operation key=5PERWGS0GOJU tag=70G7I0NFAY00 type=del size=2526917 2024-03-09T14:33:19.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.476+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~64H65B2QFCS0.0 size=1048576 2024-03-09T14:33:19.477 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.477+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~64H65B2QFCS0.1 size=1048576 2024-03-09T14:33:19.478 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.478+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~64H65B2QFCS0.2 size=831804 2024-03-09T14:33:19.478 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.478+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=64H65B2QFCS0 tag=76YZTMYFEP9Q type=write size=3977532 2024-03-09T14:33:19.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.479+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~RY0GHW1JTLWG.0 size=1048576 2024-03-09T14:33:19.482 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.481+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~RY0GHW1JTLWG.1 size=1048576 2024-03-09T14:33:19.482 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.483+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~RY0GHW1JTLWG.2 size=980429 2024-03-09T14:33:19.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.485+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=RY0GHW1JTLWG tag=0CTD6Z6RQE1W type=write size=4126157 2024-03-09T14:33:19.486 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.487+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~N6SPB6474955.0 size=1048576 2024-03-09T14:33:19.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.488+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~N6SPB6474955.1 size=1048576 2024-03-09T14:33:19.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.489+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~N6SPB6474955.2 size=864306 2024-03-09T14:33:19.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.489+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=N6SPB6474955 tag=G1DSN7P651HM type=write size=4010034 2024-03-09T14:33:19.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.491+0000 7f586ae3d780 1 < suggested remove operation key=UKPSUQ6LYWN8 tag=YVVKEFWBG21K type=write 2024-03-09T14:33:19.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.492+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=F10E1V7UWR3Q type=del size=3661371 2024-03-09T14:33:19.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.493+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=01D24DPT4KFD type=del 2024-03-09T14:33:19.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.494+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=PD43N88PPJCX type=del size=4065886 2024-03-09T14:33:19.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.496+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~RMKRKSM83WP1.0 size=1048576 2024-03-09T14:33:19.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.497+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~RMKRKSM83WP1.1 size=225469 2024-03-09T14:33:19.498 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.499+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=RMKRKSM83WP1 tag=07DOUQF8PEMR type=write size=2322621 2024-03-09T14:33:19.499 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.500+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=4KXK2WMF7F3P type=del size=3684792 2024-03-09T14:33:19.500 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.501+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~06CE2QKJLYY2.0 size=1048576 2024-03-09T14:33:19.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.502+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~06CE2QKJLYY2.1 size=272179 2024-03-09T14:33:19.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.504+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=06CE2QKJLYY2 tag=P6NJO9MV01AP type=write size=2369331 2024-03-09T14:33:19.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.505+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=U8LGTGULMNKK type=write size=333054 2024-03-09T14:33:19.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.506+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=ODYSUXN2FX9B type=del 2024-03-09T14:33:19.508 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.508+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~V0S3IHKE1I2J.0 size=1048576 2024-03-09T14:33:19.509 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.509+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~V0S3IHKE1I2J.1 size=1048576 2024-03-09T14:33:19.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.510+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~V0S3IHKE1I2J.2 size=889199 2024-03-09T14:33:19.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.510+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=V0S3IHKE1I2J tag=M8AI2VQ016FM type=write size=4034927 2024-03-09T14:33:19.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.511+0000 7f586ae3d780 1 < completed write operation key=UO072H74SHLP tag=F5EIZ52NXRS1 type=write size=483359 2024-03-09T14:33:19.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.513+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=J7V56J03Y0VF type=del size=3133308 2024-03-09T14:33:19.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.514+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=307AMRKR1WN1 type=del 2024-03-09T14:33:19.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.515+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=DQK742J1B8BG type=del size=3826874 2024-03-09T14:33:19.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.517+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=QNU9DJKLD7Z9 type=del 2024-03-09T14:33:19.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.518+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=6CHLNVR6LTGV type=write size=280063 2024-03-09T14:33:19.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.519+0000 7f586ae3d780 1 < canceled operation key=P3OUIQNAK1TC tag=QDZ283UYL7S1 type=del size=1756844 2024-03-09T14:33:19.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.520+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=XP8SXGBMYEGS type=del size=3771819 2024-03-09T14:33:19.521 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.522+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~A393HVR88APK.0 size=1048576 2024-03-09T14:33:19.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.523+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~A393HVR88APK.1 size=82114 2024-03-09T14:33:19.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.526+0000 7f586ae3d780 1 < completed multipart upload key=UAYZ55UT77VE upload=A393HVR88APK tag=KZM8VCECGSDY type=write size=2179266 2024-03-09T14:33:19.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.528+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~DJU7ZI9I84V9.0 size=1048576 2024-03-09T14:33:19.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.529+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~DJU7ZI9I84V9.1 size=1048576 2024-03-09T14:33:19.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.530+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~DJU7ZI9I84V9.2 size=820838 2024-03-09T14:33:19.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.530+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=DJU7ZI9I84V9 tag=CEGGBD2J2SNS type=write size=3966566 2024-03-09T14:33:19.530 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.531+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~NUVKPPLG3FW4.0 size=1048576 2024-03-09T14:33:19.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.532+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~NUVKPPLG3FW4.1 size=59486 2024-03-09T14:33:19.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.534+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=NUVKPPLG3FW4 tag=4AGP7T35PK52 type=write size=2156638 2024-03-09T14:33:19.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.535+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=CDM262JBDEXU type=del size=1493787 2024-03-09T14:33:19.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.536+0000 7f586ae3d780 1 < canceled operation key=DGO3ZT8ST90A tag=PV6VP43KLLP4 type=del size=3536732 2024-03-09T14:33:19.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.538+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=YYIBNL394ZJE type=write size=167406 2024-03-09T14:33:19.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.539+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~LJU281T85DPS.0 size=1048576 2024-03-09T14:33:19.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.540+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~LJU281T85DPS.1 size=514401 2024-03-09T14:33:19.541 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.542+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=LJU281T85DPS tag=VPZ36XSUBLPD type=write size=2611553 2024-03-09T14:33:19.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.543+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=LD6NJICN3BBD type=write size=995613 2024-03-09T14:33:19.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.544+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=Q95XNX151TMU type=del 2024-03-09T14:33:19.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.546+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=BXTTNSWG9M8V type=write size=276009 2024-03-09T14:33:19.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.547+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~64H65B2QFCS0.0 size=1048576 2024-03-09T14:33:19.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.548+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~64H65B2QFCS0.1 size=1048576 2024-03-09T14:33:19.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.549+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~64H65B2QFCS0.2 size=831804 2024-03-09T14:33:19.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.551+0000 7f586ae3d780 1 < completed multipart upload key=UAYZ55UT77VE upload=64H65B2QFCS0 tag=76YZTMYFEP9Q type=write size=3977532 2024-03-09T14:33:19.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.553+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=LO0DC88JQQR1 type=write size=248207 2024-03-09T14:33:19.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.554+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~N6SPB6474955.0 size=1048576 2024-03-09T14:33:19.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.555+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~N6SPB6474955.1 size=1048576 2024-03-09T14:33:19.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.555+0000 7f586ae3d780 1 < canceled part key=_multipart_2BUCMVWK7J1V.2~N6SPB6474955.2 size=864306 2024-03-09T14:33:19.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.557+0000 7f586ae3d780 1 < canceled multipart upload key=2BUCMVWK7J1V upload=N6SPB6474955 tag=G1DSN7P651HM type=write size=4010034 2024-03-09T14:33:19.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.558+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=53QP7M8XKXN5 type=write size=978073 2024-03-09T14:33:19.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.559+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=F10E1V7UWR3Q type=del 2024-03-09T14:33:19.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.561+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~5ZHTVOJ7WXXK.0 size=1048576 2024-03-09T14:33:19.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.563+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~5ZHTVOJ7WXXK.1 size=274882 2024-03-09T14:33:19.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.563+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=5ZHTVOJ7WXXK tag=DB151T61Z0UR type=write size=2372034 2024-03-09T14:33:19.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.564+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=PD43N88PPJCX type=del 2024-03-09T14:33:19.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.565+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=LGQ2DL64V0D0 type=del size=1471603 2024-03-09T14:33:19.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.566+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=4KXK2WMF7F3P type=del 2024-03-09T14:33:19.567 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.567+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=ZB1O555I1RO1 type=del size=1970764 2024-03-09T14:33:19.568 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.569+0000 7f586ae3d780 1 < completed write operation key=OXBDXIILR3NS tag=U8LGTGULMNKK type=write size=333054 2024-03-09T14:33:19.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.570+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=58PJMFPEO7FF type=del size=308677 2024-03-09T14:33:19.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.571+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~V0S3IHKE1I2J.0 size=1048576 2024-03-09T14:33:19.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.571+0000 7f586ae3d780 1 < canceled part key=_multipart_9ZPCSBP3P58P.2~V0S3IHKE1I2J.1 size=1048576 2024-03-09T14:33:19.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.572+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~V0S3IHKE1I2J.2 size=889199 2024-03-09T14:33:19.573 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.574+0000 7f586ae3d780 1 < canceled multipart upload key=9ZPCSBP3P58P upload=V0S3IHKE1I2J tag=M8AI2VQ016FM type=write size=4034927 2024-03-09T14:33:19.574 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.575+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=P8TD4GGZE9AE type=del size=318571 2024-03-09T14:33:19.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.576+0000 7f586ae3d780 1 < canceled operation key=6YWLPUULN5SY tag=J7V56J03Y0VF type=del size=3133308 2024-03-09T14:33:19.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.577+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=UG32ZNLXHK6T type=del size=1250716 2024-03-09T14:33:19.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.578+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=DQK742J1B8BG type=del 2024-03-09T14:33:19.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.580+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=OOLVL3NJZBLE type=del size=2808542 2024-03-09T14:33:19.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.582+0000 7f586ae3d780 1 < suggested update operation key=5PERWGS0GOJU tag=6CHLNVR6LTGV type=write size=280063 2024-03-09T14:33:19.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.583+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=59PTU5NWMECA type=del size=1430897 2024-03-09T14:33:19.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.584+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=XP8SXGBMYEGS type=del 2024-03-09T14:33:19.585 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.585+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=EAG1VF48CNHU type=del size=723874 2024-03-09T14:33:19.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.587+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~DJU7ZI9I84V9.0 size=1048576 2024-03-09T14:33:19.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.587+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~DJU7ZI9I84V9.1 size=1048576 2024-03-09T14:33:19.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.588+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~DJU7ZI9I84V9.2 size=820838 2024-03-09T14:33:19.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.590+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=DJU7ZI9I84V9 tag=CEGGBD2J2SNS type=write size=3966566 2024-03-09T14:33:19.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.592+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=4Z57ZGJ5CJH1 type=del size=3555856 2024-03-09T14:33:19.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.593+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=CDM262JBDEXU type=del 2024-03-09T14:33:19.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.595+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~TJ8ZZQISXVSL.0 size=1048576 2024-03-09T14:33:19.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.596+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~TJ8ZZQISXVSL.1 size=411536 2024-03-09T14:33:19.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.596+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=TJ8ZZQISXVSL tag=2BOKW1AWK683 type=write size=2508688 2024-03-09T14:33:19.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.597+0000 7f586ae3d780 1 < completed write operation key=W3HTK2F8ML3V tag=YYIBNL394ZJE type=write size=167406 2024-03-09T14:33:19.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.599+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~WI8KMQWHWZ0M.0 size=1048576 2024-03-09T14:33:19.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.600+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~WI8KMQWHWZ0M.1 size=661761 2024-03-09T14:33:19.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.600+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=WI8KMQWHWZ0M tag=T4TAH5F8V4FU type=write size=2758913 2024-03-09T14:33:19.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.601+0000 7f586ae3d780 1 < completed write operation key=O5L6RC16RS8E tag=LD6NJICN3BBD type=write size=995613 2024-03-09T14:33:19.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.603+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=OCXG71N8VUPY type=del size=3064741 2024-03-09T14:33:19.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.604+0000 7f586ae3d780 1 < completed write operation key=IK528ND96157 tag=BXTTNSWG9M8V type=write size=276009 2024-03-09T14:33:19.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.605+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=6D776KUQV95S type=del size=4181972 2024-03-09T14:33:19.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.606+0000 7f586ae3d780 1 < completed write operation key=9ZPCSBP3P58P tag=LO0DC88JQQR1 type=write size=248207 2024-03-09T14:33:19.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.607+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=C152XPYSVNF3 type=del size=2578762 2024-03-09T14:33:19.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.610+0000 7f586ae3d780 1 < suggested update operation key=O5L6RC16RS8E tag=53QP7M8XKXN5 type=write size=978073 2024-03-09T14:33:19.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.611+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=A1IJUVCYDBAF type=del size=2343307 2024-03-09T14:33:19.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.612+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~5ZHTVOJ7WXXK.0 size=1048576 2024-03-09T14:33:19.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.613+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~5ZHTVOJ7WXXK.1 size=274882 2024-03-09T14:33:19.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.615+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=5ZHTVOJ7WXXK tag=DB151T61Z0UR type=write size=2372034 2024-03-09T14:33:19.616 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.616+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=JAW6SEXNMDRW type=del size=2232436 2024-03-09T14:33:19.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.618+0000 7f586ae3d780 1 < suggested update operation key=9ZPCSBP3P58P tag=LGQ2DL64V0D0 type=del size=1471603 2024-03-09T14:33:19.619 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.619+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=23EI76UW9OXW type=write size=580203 2024-03-09T14:33:19.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.621+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=ZB1O555I1RO1 type=del 2024-03-09T14:33:19.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.622+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=CB28CDKHKUSK type=del size=4193705 2024-03-09T14:33:19.622 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.623+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=58PJMFPEO7FF type=del 2024-03-09T14:33:19.623 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.624+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=QUUQSNPIKNBJ type=del size=1006680 2024-03-09T14:33:19.625 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.625+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=P8TD4GGZE9AE type=del 2024-03-09T14:33:19.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.626+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=3YE164CV3F9M type=del size=2616188 2024-03-09T14:33:19.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.627+0000 7f586ae3d780 -1 < failed to complete operation key=9ZPCSBP3P58P tag=UG32ZNLXHK6T type=del size=1250716: (22) Invalid argument 2024-03-09T14:33:19.628 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.628+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=MXA531NV9TTE type=write size=656547 2024-03-09T14:33:19.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.630+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=OOLVL3NJZBLE type=del 2024-03-09T14:33:19.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.631+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=57CBMWXNV0J5 type=del size=3775602 2024-03-09T14:33:19.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.632+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=59PTU5NWMECA type=del 2024-03-09T14:33:19.633 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.634+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~35MM9IOVJE49.0 size=1048576 2024-03-09T14:33:19.634 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.635+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~35MM9IOVJE49.1 size=123803 2024-03-09T14:33:19.634 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.635+0000 7f586ae3d780 1 > prepared multipart upload key=C1UGQOQ6AE1E upload=35MM9IOVJE49 tag=5S4UWUM0X3WM type=write size=2220955 2024-03-09T14:33:19.637 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.638+0000 7f586ae3d780 1 < suggested remove operation key=2BUCMVWK7J1V tag=EAG1VF48CNHU type=del 2024-03-09T14:33:19.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.642+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~PD8GMFCIE7P2.0 size=7555 2024-03-09T14:33:19.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.642+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=PD8GMFCIE7P2 tag=QKJZ801GQNGV type=write size=1056131 2024-03-09T14:33:19.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.643+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=4Z57ZGJ5CJH1 type=del 2024-03-09T14:33:19.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.645+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=JCUDLTBV451P type=del size=1561927 2024-03-09T14:33:19.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.646+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~TJ8ZZQISXVSL.0 size=1048576 2024-03-09T14:33:19.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.647+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~TJ8ZZQISXVSL.1 size=411536 2024-03-09T14:33:19.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.649+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=TJ8ZZQISXVSL tag=2BOKW1AWK683 type=write size=2508688 2024-03-09T14:33:19.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.650+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=1T8YY64SB5KD type=del size=3612390 2024-03-09T14:33:19.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.652+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~WI8KMQWHWZ0M.0 size=1048576 2024-03-09T14:33:19.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.652+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~WI8KMQWHWZ0M.1 size=661761 2024-03-09T14:33:19.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.655+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=WI8KMQWHWZ0M tag=T4TAH5F8V4FU type=write size=2758913 2024-03-09T14:33:19.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.656+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=CTH7A63PJBXR type=del size=130601 2024-03-09T14:33:19.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.657+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=OCXG71N8VUPY type=del 2024-03-09T14:33:19.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.659+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~78J2V0YUBDXN.0 size=1048576 2024-03-09T14:33:19.660 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.660+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~78J2V0YUBDXN.1 size=443996 2024-03-09T14:33:19.660 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.660+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=78J2V0YUBDXN tag=UAD7AAMO078U type=write size=2541148 2024-03-09T14:33:19.661 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.662+0000 7f586ae3d780 -1 < failed to complete operation key=O5L6RC16RS8E tag=6D776KUQV95S type=del size=4181972: (22) Invalid argument 2024-03-09T14:33:19.663 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.664+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~BG1RT1LR9XMD.0 size=1048576 2024-03-09T14:33:19.664 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.665+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~BG1RT1LR9XMD.1 size=1048576 2024-03-09T14:33:19.665 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.666+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~BG1RT1LR9XMD.2 size=282712 2024-03-09T14:33:19.665 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.666+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=BG1RT1LR9XMD tag=URA3NXZX9CU5 type=write size=3428440 2024-03-09T14:33:19.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.668+0000 7f586ae3d780 1 < suggested remove operation key=IK528ND96157 tag=C152XPYSVNF3 type=del 2024-03-09T14:33:19.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.670+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~99TC9G2NGPQX.0 size=178831 2024-03-09T14:33:19.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.670+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=99TC9G2NGPQX tag=39T8QDFU2M96 type=write size=1227407 2024-03-09T14:33:19.671 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.671+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=A1IJUVCYDBAF type=del 2024-03-09T14:33:19.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.674+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~5LM8CKOELGR1.0 size=1048576 2024-03-09T14:33:19.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.674+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~5LM8CKOELGR1.1 size=552250 2024-03-09T14:33:19.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.674+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=5LM8CKOELGR1 tag=S7P889SOGTBJ type=write size=2649402 2024-03-09T14:33:19.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.676+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=JAW6SEXNMDRW type=del 2024-03-09T14:33:19.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.677+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=92QF319AE4J4 type=del size=572706 2024-03-09T14:33:19.677 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.678+0000 7f586ae3d780 1 < completed write operation key=P3OUIQNAK1TC tag=23EI76UW9OXW type=write size=580203 2024-03-09T14:33:19.679 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.679+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=1PE880K2SYQ3 type=del size=2887581 2024-03-09T14:33:19.681 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.681+0000 7f586ae3d780 1 < suggested remove operation key=UKPSUQ6LYWN8 tag=CB28CDKHKUSK type=del 2024-03-09T14:33:19.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.682+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=JMTS7PI0YE9S type=del size=3348505 2024-03-09T14:33:19.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.684+0000 7f586ae3d780 -1 < failed to complete operation key=2BUCMVWK7J1V tag=QUUQSNPIKNBJ type=del size=1006680: (22) Invalid argument 2024-03-09T14:33:19.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.685+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=AQ9DYW0Z4JRJ type=del size=128847 2024-03-09T14:33:19.687 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.687+0000 7f586ae3d780 1 < suggested remove operation key=WNVN3EOUUBGR tag=3YE164CV3F9M type=del 2024-03-09T14:33:19.689 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.689+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~UVP8KQ2MI44Q.0 size=1048576 2024-03-09T14:33:19.690 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.690+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~UVP8KQ2MI44Q.1 size=227640 2024-03-09T14:33:19.690 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.690+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=UVP8KQ2MI44Q tag=SHP02VJZEW35 type=write size=2324792 2024-03-09T14:33:19.691 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.691+0000 7f586ae3d780 1 < completed write operation key=509F17DT0C4I tag=MXA531NV9TTE type=write size=656547 2024-03-09T14:33:19.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.693+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=EY0SNYCP7FIY type=del size=1219227 2024-03-09T14:33:19.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.694+0000 7f586ae3d780 1 < canceled operation key=G2BIOBESOIK9 tag=57CBMWXNV0J5 type=del size=3775602 2024-03-09T14:33:19.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.696+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~CKM2UOWMO4WN.0 size=172165 2024-03-09T14:33:19.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.696+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=CKM2UOWMO4WN tag=N05GJ1VM1IK9 type=write size=1220741 2024-03-09T14:33:19.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.696+0000 7f586ae3d780 1 < canceled part key=_multipart_C1UGQOQ6AE1E.2~35MM9IOVJE49.0 size=1048576 2024-03-09T14:33:19.697 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.697+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~35MM9IOVJE49.1 size=123803 2024-03-09T14:33:19.699 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.699+0000 7f586ae3d780 1 < canceled multipart upload key=C1UGQOQ6AE1E upload=35MM9IOVJE49 tag=5S4UWUM0X3WM type=write size=2220955 2024-03-09T14:33:19.700 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.700+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=UGVQ3OQJFWDC type=del size=3685286 2024-03-09T14:33:19.701 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.701+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~PD8GMFCIE7P2.0 size=7555 2024-03-09T14:33:19.703 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.703+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=PD8GMFCIE7P2 tag=QKJZ801GQNGV type=write size=1056131 2024-03-09T14:33:19.705 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.705+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~0TTKVWCM5ZM0.0 size=1048576 2024-03-09T14:33:19.706 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.706+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~0TTKVWCM5ZM0.1 size=1048576 2024-03-09T14:33:19.706 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.707+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~0TTKVWCM5ZM0.2 size=783926 2024-03-09T14:33:19.707 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.707+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=0TTKVWCM5ZM0 tag=DOQ3FPR5SU5D type=write size=3929654 2024-03-09T14:33:19.708 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.708+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=JCUDLTBV451P type=del 2024-03-09T14:33:19.709 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.709+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=KOEUH5M9LEHT type=del size=1633751 2024-03-09T14:33:19.710 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.710+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=1T8YY64SB5KD type=del 2024-03-09T14:33:19.711 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.712+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=U7WB2UARXMQ8 type=del size=3759469 2024-03-09T14:33:19.713 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.714+0000 7f586ae3d780 1 < suggested update operation key=78Y2ZM3W6EUC tag=CTH7A63PJBXR type=del size=130601 2024-03-09T14:33:19.715 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.716+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~PMPVGBT84EXH.0 size=1048576 2024-03-09T14:33:19.716 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.717+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~PMPVGBT84EXH.1 size=1048576 2024-03-09T14:33:19.717 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.717+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~PMPVGBT84EXH.2 size=549916 2024-03-09T14:33:19.717 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.717+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=PMPVGBT84EXH tag=FJ0BZY8KK2S9 type=write size=3695644 2024-03-09T14:33:19.718 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.719+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~78J2V0YUBDXN.0 size=1048576 2024-03-09T14:33:19.719 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.720+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~78J2V0YUBDXN.1 size=443996 2024-03-09T14:33:19.721 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.721+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=78J2V0YUBDXN tag=UAD7AAMO078U type=write size=2541148 2024-03-09T14:33:19.722 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.723+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=ZF0EXPWR6971 type=write size=206190 2024-03-09T14:33:19.723 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.724+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~BG1RT1LR9XMD.0 size=1048576 2024-03-09T14:33:19.724 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.725+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~BG1RT1LR9XMD.1 size=1048576 2024-03-09T14:33:19.725 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.726+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~BG1RT1LR9XMD.2 size=282712 2024-03-09T14:33:19.727 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.727+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=BG1RT1LR9XMD tag=URA3NXZX9CU5 type=write size=3428440 2024-03-09T14:33:19.728 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.729+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=OO0G670DA07K type=del size=2069969 2024-03-09T14:33:19.729 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.730+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~99TC9G2NGPQX.0 size=178831 2024-03-09T14:33:19.731 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.732+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=99TC9G2NGPQX tag=39T8QDFU2M96 type=write size=1227407 2024-03-09T14:33:19.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.733+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=0FO7050ERD5X type=write size=615071 2024-03-09T14:33:19.734 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.734+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~5LM8CKOELGR1.0 size=1048576 2024-03-09T14:33:19.735 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.735+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~5LM8CKOELGR1.1 size=552250 2024-03-09T14:33:19.737 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.737+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=5LM8CKOELGR1 tag=S7P889SOGTBJ type=write size=2649402 2024-03-09T14:33:19.738 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.738+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=TE6KKYMGW81H type=del size=2567133 2024-03-09T14:33:19.739 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.739+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=92QF319AE4J4 type=del 2024-03-09T14:33:19.741 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.741+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~KO504RBWMX68.0 size=1048576 2024-03-09T14:33:19.742 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.742+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~KO504RBWMX68.1 size=774523 2024-03-09T14:33:19.742 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.742+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=KO504RBWMX68 tag=PJ21J6OZNJFC type=write size=2871675 2024-03-09T14:33:19.743 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.743+0000 7f586ae3d780 1 < completed delete operation key=NHIOOLNXLZZC tag=1PE880K2SYQ3 type=del 2024-03-09T14:33:19.744 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.745+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=3EURX547AT8H type=del size=2769590 2024-03-09T14:33:19.745 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.746+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=JMTS7PI0YE9S type=del 2024-03-09T14:33:19.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.748+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=4TX5WRJ25H4A type=del size=1834291 2024-03-09T14:33:19.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.749+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=AQ9DYW0Z4JRJ type=del 2024-03-09T14:33:19.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.751+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~DJY7YGCBJO9S.0 size=31503 2024-03-09T14:33:19.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.751+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=DJY7YGCBJO9S tag=5WZS4NJMNX6F type=write size=1080079 2024-03-09T14:33:19.751 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.752+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~UVP8KQ2MI44Q.0 size=1048576 2024-03-09T14:33:19.752 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.753+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~UVP8KQ2MI44Q.1 size=227640 2024-03-09T14:33:19.754 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.755+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=UVP8KQ2MI44Q tag=SHP02VJZEW35 type=write size=2324792 2024-03-09T14:33:19.755 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.756+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=HWZSWSH1F4E4 type=del size=1893008 2024-03-09T14:33:19.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.757+0000 7f586ae3d780 -1 < failed to complete operation key=78Y2ZM3W6EUC tag=EY0SNYCP7FIY type=del size=1219227: (22) Invalid argument 2024-03-09T14:33:19.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.759+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~V4F5E83TVJR4.0 size=1048576 2024-03-09T14:33:19.760 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.760+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~V4F5E83TVJR4.1 size=1048576 2024-03-09T14:33:19.760 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.761+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~V4F5E83TVJR4.2 size=224279 2024-03-09T14:33:19.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.761+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=V4F5E83TVJR4 tag=JNUWRFIOVBP6 type=write size=3370007 2024-03-09T14:33:19.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.762+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~CKM2UOWMO4WN.0 size=172165 2024-03-09T14:33:19.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.764+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=CKM2UOWMO4WN tag=N05GJ1VM1IK9 type=write size=1220741 2024-03-09T14:33:19.765 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.765+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=2KOSQF507TE1 type=write size=983326 2024-03-09T14:33:19.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.766+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=UGVQ3OQJFWDC type=del 2024-03-09T14:33:19.767 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.768+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=J7WTCE5K1U0L type=write size=986488 2024-03-09T14:33:19.768 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.769+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~0TTKVWCM5ZM0.0 size=1048576 2024-03-09T14:33:19.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.770+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~0TTKVWCM5ZM0.1 size=1048576 2024-03-09T14:33:19.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.771+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~0TTKVWCM5ZM0.2 size=783926 2024-03-09T14:33:19.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.773+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=0TTKVWCM5ZM0 tag=DOQ3FPR5SU5D type=write size=3929654 2024-03-09T14:33:19.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.775+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~LTQRI7UBN80L.0 size=1048576 2024-03-09T14:33:19.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.776+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~LTQRI7UBN80L.1 size=826243 2024-03-09T14:33:19.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.776+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=LTQRI7UBN80L tag=6BD4BV2Q6R89 type=write size=2923395 2024-03-09T14:33:19.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.777+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=KOEUH5M9LEHT type=del 2024-03-09T14:33:19.777 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.778+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=MIZ9WKRS3CJP type=write size=393115 2024-03-09T14:33:19.780 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.780+0000 7f586ae3d780 1 < suggested update operation key=509F17DT0C4I tag=U7WB2UARXMQ8 type=del size=3759469 2024-03-09T14:33:19.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.782+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~8DF2G02OVT8E.0 size=70825 2024-03-09T14:33:19.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.782+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=8DF2G02OVT8E tag=3AH2QAZ2730Z type=write size=1119401 2024-03-09T14:33:19.783 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.784+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~PMPVGBT84EXH.0 size=1048576 2024-03-09T14:33:19.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.784+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~PMPVGBT84EXH.1 size=1048576 2024-03-09T14:33:19.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.785+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~PMPVGBT84EXH.2 size=549916 2024-03-09T14:33:19.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.787+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=PMPVGBT84EXH tag=FJ0BZY8KK2S9 type=write size=3695644 2024-03-09T14:33:19.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.789+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=OIGP50JY5DQ5 type=del size=258024 2024-03-09T14:33:19.789 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.790+0000 7f586ae3d780 1 < completed write operation key=CAISZZZSOD34 tag=ZF0EXPWR6971 type=write size=206190 2024-03-09T14:33:19.791 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.792+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~Q4CQ3FC87W9C.0 size=527782 2024-03-09T14:33:19.791 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.792+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=Q4CQ3FC87W9C tag=5SC7F02VJOTI type=write size=1576358 2024-03-09T14:33:19.794 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.794+0000 7f586ae3d780 1 < suggested remove operation key=W4Q1MWHOQ4Y1 tag=OO0G670DA07K type=del 2024-03-09T14:33:19.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.795+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=2NKG1F00JESM type=del size=786731 2024-03-09T14:33:19.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.796+0000 7f586ae3d780 1 < completed write operation key=DJH53FNVMLGY tag=0FO7050ERD5X type=write size=615071 2024-03-09T14:33:19.797 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.798+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=78Y060Z691KX type=del size=2068382 2024-03-09T14:33:19.798 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.799+0000 7f586ae3d780 1 < canceled operation key=CAISZZZSOD34 tag=TE6KKYMGW81H type=del size=2567133 2024-03-09T14:33:19.800 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.801+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~L8J4OQ72THXC.0 size=1048576 2024-03-09T14:33:19.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.802+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~L8J4OQ72THXC.1 size=883394 2024-03-09T14:33:19.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.802+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=L8J4OQ72THXC tag=6MCGNAY8J3JF type=write size=2980546 2024-03-09T14:33:19.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.802+0000 7f586ae3d780 1 < canceled part key=_multipart_UKPSUQ6LYWN8.2~KO504RBWMX68.0 size=1048576 2024-03-09T14:33:19.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.803+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~KO504RBWMX68.1 size=774523 2024-03-09T14:33:19.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.805+0000 7f586ae3d780 1 < canceled multipart upload key=UKPSUQ6LYWN8 upload=KO504RBWMX68 tag=PJ21J6OZNJFC type=write size=2871675 2024-03-09T14:33:19.807 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.807+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~5WNRDOJKQHSZ.0 size=1048576 2024-03-09T14:33:19.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.808+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~5WNRDOJKQHSZ.1 size=773599 2024-03-09T14:33:19.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.808+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=5WNRDOJKQHSZ tag=ZBL7XSL44OD2 type=write size=2870751 2024-03-09T14:33:19.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.809+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=3EURX547AT8H type=del 2024-03-09T14:33:19.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.811+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~MVL0MZZFZEWI.0 size=1048576 2024-03-09T14:33:19.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.812+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~MVL0MZZFZEWI.1 size=1027592 2024-03-09T14:33:19.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.812+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=MVL0MZZFZEWI tag=MDBXJJ1JF1LG type=write size=3124744 2024-03-09T14:33:19.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.813+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=4TX5WRJ25H4A type=del 2024-03-09T14:33:19.814 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.815+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=2YL6XTFVIIP1 type=del size=1012136 2024-03-09T14:33:19.815 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.816+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~DJY7YGCBJO9S.0 size=31503 2024-03-09T14:33:19.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.818+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=DJY7YGCBJO9S tag=5WZS4NJMNX6F type=write size=1080079 2024-03-09T14:33:19.818 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.819+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=JU29PTNOGA4T type=del size=1964428 2024-03-09T14:33:19.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.821+0000 7f586ae3d780 1 < suggested remove operation key=LRI2GKBGVCWW tag=HWZSWSH1F4E4 type=del 2024-03-09T14:33:19.822 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.822+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=K5L03BLYTFM6 type=write size=914713 2024-03-09T14:33:19.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.824+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~V4F5E83TVJR4.0 size=1048576 2024-03-09T14:33:19.824 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.825+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~V4F5E83TVJR4.1 size=1048576 2024-03-09T14:33:19.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.826+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~V4F5E83TVJR4.2 size=224279 2024-03-09T14:33:19.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.828+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=V4F5E83TVJR4 tag=JNUWRFIOVBP6 type=write size=3370007 2024-03-09T14:33:19.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.830+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~4HEXJNLF4KQP.0 size=979703 2024-03-09T14:33:19.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.830+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=4HEXJNLF4KQP tag=1BC9S7SGQ4AV type=write size=2028279 2024-03-09T14:33:19.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.831+0000 7f586ae3d780 1 < completed write operation key=P3OUIQNAK1TC tag=2KOSQF507TE1 type=write size=983326 2024-03-09T14:33:19.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.833+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~MAJXBY2HB6FL.0 size=1048576 2024-03-09T14:33:19.833 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.834+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~MAJXBY2HB6FL.1 size=775574 2024-03-09T14:33:19.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.834+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=MAJXBY2HB6FL tag=3Y8CXACU1N2A type=write size=2872726 2024-03-09T14:33:19.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.835+0000 7f586ae3d780 1 < completed write operation key=XIYWPXSYCT6I tag=J7WTCE5K1U0L type=write size=986488 2024-03-09T14:33:19.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.836+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=2VLVD86LT0F0 type=del size=1988999 2024-03-09T14:33:19.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.838+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~LTQRI7UBN80L.0 size=1048576 2024-03-09T14:33:19.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.839+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~LTQRI7UBN80L.1 size=826243 2024-03-09T14:33:19.840 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.841+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=LTQRI7UBN80L tag=6BD4BV2Q6R89 type=write size=2923395 2024-03-09T14:33:19.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.842+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=XNZUUZDQNP8S type=del size=1615233 2024-03-09T14:33:19.842 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.843+0000 7f586ae3d780 1 < completed write operation key=O5L6RC16RS8E tag=MIZ9WKRS3CJP type=write size=393115 2024-03-09T14:33:19.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.844+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=WH2OOG2DMBB6 type=del size=4006213 2024-03-09T14:33:19.845 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.845+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~8DF2G02OVT8E.0 size=70825 2024-03-09T14:33:19.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.847+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=8DF2G02OVT8E tag=3AH2QAZ2730Z type=write size=1119401 2024-03-09T14:33:19.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.848+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=AI3W0SOB4VC2 type=write size=631433 2024-03-09T14:33:19.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.851+0000 7f586ae3d780 1 < suggested remove operation key=UO072H74SHLP tag=OIGP50JY5DQ5 type=del 2024-03-09T14:33:19.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.853+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~FY7P6NQG7M4F.0 size=1048576 2024-03-09T14:33:19.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.854+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~FY7P6NQG7M4F.1 size=1037790 2024-03-09T14:33:19.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.854+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=FY7P6NQG7M4F tag=BVCBU939M800 type=write size=3134942 2024-03-09T14:33:19.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.856+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~Q4CQ3FC87W9C.0 size=527782 2024-03-09T14:33:19.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.858+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=Q4CQ3FC87W9C tag=5SC7F02VJOTI type=write size=1576358 2024-03-09T14:33:19.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.859+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=6AVWCZA3IFYM type=write size=706564 2024-03-09T14:33:19.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.860+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=2NKG1F00JESM type=del 2024-03-09T14:33:19.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.861+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=VJX45KCR5GCP type=write size=643230 2024-03-09T14:33:19.862 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.862+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=78Y060Z691KX type=del 2024-03-09T14:33:19.863 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.863+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=YW91GNGK3YEE type=del size=1165304 2024-03-09T14:33:19.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.865+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~L8J4OQ72THXC.0 size=1048576 2024-03-09T14:33:19.865 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.866+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~L8J4OQ72THXC.1 size=883394 2024-03-09T14:33:19.867 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.868+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=L8J4OQ72THXC tag=6MCGNAY8J3JF type=write size=2980546 2024-03-09T14:33:19.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.869+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=POEXA2Y212H7 type=write size=954643 2024-03-09T14:33:19.870 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.870+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~5WNRDOJKQHSZ.0 size=1048576 2024-03-09T14:33:19.870 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.870+0000 7f586ae3d780 1 < canceled part key=_multipart_CAISZZZSOD34.2~5WNRDOJKQHSZ.1 size=773599 2024-03-09T14:33:19.872 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.872+0000 7f586ae3d780 1 < canceled multipart upload key=CAISZZZSOD34 upload=5WNRDOJKQHSZ tag=ZBL7XSL44OD2 type=write size=2870751 2024-03-09T14:33:19.873 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.873+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=C0LJKPZ8VTC2 type=write size=234976 2024-03-09T14:33:19.874 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.875+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~MVL0MZZFZEWI.0 size=1048576 2024-03-09T14:33:19.874 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.875+0000 7f586ae3d780 1 < canceled part key=_multipart_CZGAXNJ0GKU0.2~MVL0MZZFZEWI.1 size=1027592 2024-03-09T14:33:19.876 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.877+0000 7f586ae3d780 1 < canceled multipart upload key=CZGAXNJ0GKU0 upload=MVL0MZZFZEWI tag=MDBXJJ1JF1LG type=write size=3124744 2024-03-09T14:33:19.877 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.878+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=WQY5H31OSTZ2 type=del size=1637283 2024-03-09T14:33:19.878 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.879+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=2YL6XTFVIIP1 type=del 2024-03-09T14:33:19.880 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.880+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=CBUIQNPKU673 type=write size=783428 2024-03-09T14:33:19.882 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.882+0000 7f586ae3d780 1 < suggested update operation key=LRI2GKBGVCWW tag=JU29PTNOGA4T type=del size=1964428 2024-03-09T14:33:19.883 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.884+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=S14ID2MY0TKA type=del size=3987239 2024-03-09T14:33:19.884 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.885+0000 7f586ae3d780 1 < canceled operation key=78Y2ZM3W6EUC tag=K5L03BLYTFM6 type=write size=914713 2024-03-09T14:33:19.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.886+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=SZPKPV2SPXWN type=del size=4039116 2024-03-09T14:33:19.887 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.887+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~4HEXJNLF4KQP.0 size=979703 2024-03-09T14:33:19.889 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.889+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=4HEXJNLF4KQP tag=1BC9S7SGQ4AV type=write size=2028279 2024-03-09T14:33:19.890 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.891+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=3QYZIWJWCNDX type=del size=3694452 2024-03-09T14:33:19.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.892+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~MAJXBY2HB6FL.0 size=1048576 2024-03-09T14:33:19.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.894+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~MAJXBY2HB6FL.1 size=775574 2024-03-09T14:33:19.896 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.896+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=MAJXBY2HB6FL tag=3Y8CXACU1N2A type=write size=2872726 2024-03-09T14:33:19.897 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.897+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=0ZWPRG057M9B type=del size=1628861 2024-03-09T14:33:19.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.900+0000 7f586ae3d780 1 < suggested remove operation key=509F17DT0C4I tag=2VLVD86LT0F0 type=del 2024-03-09T14:33:19.901 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.902+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~M6T4M11TW5Y6.0 size=1048576 2024-03-09T14:33:19.902 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.903+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~M6T4M11TW5Y6.1 size=645453 2024-03-09T14:33:19.902 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.903+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=M6T4M11TW5Y6 tag=3L12A44MHGYH type=write size=2742605 2024-03-09T14:33:19.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.904+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=XNZUUZDQNP8S type=del 2024-03-09T14:33:19.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.906+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~7RCAF3625MRO.0 size=1048576 2024-03-09T14:33:19.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.907+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~7RCAF3625MRO.1 size=1048576 2024-03-09T14:33:19.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.908+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~7RCAF3625MRO.2 size=672547 2024-03-09T14:33:19.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.908+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=7RCAF3625MRO tag=JZ3MZOTQM7EE type=write size=3818275 2024-03-09T14:33:19.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.909+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=WH2OOG2DMBB6 type=del 2024-03-09T14:33:19.910 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.910+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=MSJDMWOF0665 type=del size=905096 2024-03-09T14:33:19.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.912+0000 7f586ae3d780 1 < completed write operation key=UAYZ55UT77VE tag=AI3W0SOB4VC2 type=write size=631433 2024-03-09T14:33:19.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.913+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=5T1MH3OXEMGU type=del size=2611120 2024-03-09T14:33:19.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.914+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~FY7P6NQG7M4F.0 size=1048576 2024-03-09T14:33:19.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.915+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~FY7P6NQG7M4F.1 size=1037790 2024-03-09T14:33:19.917 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.917+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=FY7P6NQG7M4F tag=BVCBU939M800 type=write size=3134942 2024-03-09T14:33:19.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.918+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=5CNKSABYT3OB type=write size=625773 2024-03-09T14:33:19.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.919+0000 7f586ae3d780 1 < completed write operation key=DJH53FNVMLGY tag=6AVWCZA3IFYM type=write size=706564 2024-03-09T14:33:19.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.921+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=YAKRAZBOALBZ type=del size=3472741 2024-03-09T14:33:19.921 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.922+0000 7f586ae3d780 -1 < failed to complete operation key=LRI2GKBGVCWW tag=VJX45KCR5GCP type=write size=643230: (22) Invalid argument 2024-03-09T14:33:19.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.923+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=O5X4R3S1N20R type=del size=219547 2024-03-09T14:33:19.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.924+0000 7f586ae3d780 1 < canceled operation key=FNZ3BNA7W12E tag=YW91GNGK3YEE type=del size=1165304 2024-03-09T14:33:19.926 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.926+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~NC69SD5U4OK8.0 size=1048576 2024-03-09T14:33:19.927 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.927+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~NC69SD5U4OK8.1 size=312540 2024-03-09T14:33:19.927 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.927+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=NC69SD5U4OK8 tag=K5WBVP573LFG type=write size=2409692 2024-03-09T14:33:19.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.928+0000 7f586ae3d780 1 < canceled operation key=UO072H74SHLP tag=POEXA2Y212H7 type=write size=954643 2024-03-09T14:33:19.929 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.929+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=9TYG5MV1DQOT type=del size=904352 2024-03-09T14:33:19.930 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.931+0000 7f586ae3d780 1 < completed write operation key=W4Q1MWHOQ4Y1 tag=C0LJKPZ8VTC2 type=write size=234976 2024-03-09T14:33:19.931 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.932+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=QDB5DIL0IYX7 type=del size=2274600 2024-03-09T14:33:19.932 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.933+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=WQY5H31OSTZ2 type=del 2024-03-09T14:33:19.934 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.935+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~WTQHHBXVCUFT.0 size=1048576 2024-03-09T14:33:19.935 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.936+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~WTQHHBXVCUFT.1 size=1048576 2024-03-09T14:33:19.936 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.937+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~WTQHHBXVCUFT.2 size=896168 2024-03-09T14:33:19.936 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.937+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=WTQHHBXVCUFT tag=F612ACS3O7ME type=write size=4041896 2024-03-09T14:33:19.937 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.938+0000 7f586ae3d780 1 < completed write operation key=G2BIOBESOIK9 tag=CBUIQNPKU673 type=write size=783428 2024-03-09T14:33:19.939 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.940+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~9LT4G877AVWW.0 size=1048576 2024-03-09T14:33:19.940 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.941+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~9LT4G877AVWW.1 size=1048576 2024-03-09T14:33:19.941 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.942+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~9LT4G877AVWW.2 size=900441 2024-03-09T14:33:19.941 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.942+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=9LT4G877AVWW tag=Q3D93QTX9BX9 type=write size=4046169 2024-03-09T14:33:19.942 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.943+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=S14ID2MY0TKA type=del 2024-03-09T14:33:19.943 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.944+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=LTGEESE205IE type=del size=446111 2024-03-09T14:33:19.944 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.944+0000 7f586ae3d780 -1 < no bi entry to suggest for operation key=509F17DT0C4I tag=SZPKPV2SPXWN type=del size=4039116: (2) No such file or directory 2024-03-09T14:33:19.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.945+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=IHE03Y4S593E type=del size=2430529 2024-03-09T14:33:19.946 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.947+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=3QYZIWJWCNDX type=del 2024-03-09T14:33:19.947 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.948+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=K3VTVOEAC5KI type=write size=849181 2024-03-09T14:33:19.949 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.950+0000 7f586ae3d780 1 < suggested update operation key=W4Q1MWHOQ4Y1 tag=0ZWPRG057M9B type=del size=1628861 2024-03-09T14:33:19.951 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.952+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~7DWYWZEOHZM6.0 size=1048576 2024-03-09T14:33:19.952 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.953+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~7DWYWZEOHZM6.1 size=41031 2024-03-09T14:33:19.952 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.953+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=7DWYWZEOHZM6 tag=PMGFJQM39PON type=write size=2138183 2024-03-09T14:33:19.953 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.954+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~M6T4M11TW5Y6.0 size=1048576 2024-03-09T14:33:19.954 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.955+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~M6T4M11TW5Y6.1 size=645453 2024-03-09T14:33:19.956 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.957+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=M6T4M11TW5Y6 tag=3L12A44MHGYH type=write size=2742605 2024-03-09T14:33:19.958 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.959+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~7OSXTU3BCF0M.0 size=1048576 2024-03-09T14:33:19.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.960+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~7OSXTU3BCF0M.1 size=150979 2024-03-09T14:33:19.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.960+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=7OSXTU3BCF0M tag=GNM8ORTAVNJ1 type=write size=2248131 2024-03-09T14:33:19.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.961+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~7RCAF3625MRO.0 size=1048576 2024-03-09T14:33:19.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.961+0000 7f586ae3d780 1 < canceled part key=_multipart_OU9IOY7J572N.2~7RCAF3625MRO.1 size=1048576 2024-03-09T14:33:19.961 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.962+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~7RCAF3625MRO.2 size=672547 2024-03-09T14:33:19.963 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.963+0000 7f586ae3d780 1 < canceled multipart upload key=OU9IOY7J572N upload=7RCAF3625MRO tag=JZ3MZOTQM7EE type=write size=3818275 2024-03-09T14:33:19.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.965+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=J9U4D8RXG0S0 type=del size=3285943 2024-03-09T14:33:19.966 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.966+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=MSJDMWOF0665 type=del 2024-03-09T14:33:19.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.970+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~5ANEUT2ILMAU.0 size=1048576 2024-03-09T14:33:19.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.972+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~5ANEUT2ILMAU.1 size=1048576 2024-03-09T14:33:19.972 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.973+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~5ANEUT2ILMAU.2 size=169187 2024-03-09T14:33:19.972 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.973+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=5ANEUT2ILMAU tag=6J9TKU5N86EH type=write size=3314915 2024-03-09T14:33:19.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.975+0000 7f586ae3d780 1 < suggested remove operation key=9ZPCSBP3P58P tag=5T1MH3OXEMGU type=del 2024-03-09T14:33:19.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.977+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~9P4OKV6IXAM4.0 size=1048576 2024-03-09T14:33:19.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.978+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~9P4OKV6IXAM4.1 size=1048576 2024-03-09T14:33:19.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.979+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~9P4OKV6IXAM4.2 size=953029 2024-03-09T14:33:19.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.979+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=9P4OKV6IXAM4 tag=HB49MCF3P4SR type=write size=4098757 2024-03-09T14:33:19.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.980+0000 7f586ae3d780 1 < canceled operation key=CAISZZZSOD34 tag=5CNKSABYT3OB type=write size=625773 2024-03-09T14:33:19.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.981+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=3PF706HR6DKL type=del size=2756925 2024-03-09T14:33:19.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.983+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=YAKRAZBOALBZ type=del 2024-03-09T14:33:19.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.984+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=EKMOMCI8NR8Y type=del size=3636711 2024-03-09T14:33:19.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.986+0000 7f586ae3d780 1 < suggested remove operation key=CZGAXNJ0GKU0 tag=O5X4R3S1N20R type=del 2024-03-09T14:33:19.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.988+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~ZGA2S2GR3HA7.0 size=849727 2024-03-09T14:33:19.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.988+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=ZGA2S2GR3HA7 tag=VFSYCKRV5WYH type=write size=1898303 2024-03-09T14:33:19.989 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.989+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~NC69SD5U4OK8.0 size=1048576 2024-03-09T14:33:19.990 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.990+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~NC69SD5U4OK8.1 size=312540 2024-03-09T14:33:19.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.992+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=NC69SD5U4OK8 tag=K5WBVP573LFG type=write size=2409692 2024-03-09T14:33:19.993 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.993+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=T44KOE1L1W5F type=del size=287775 2024-03-09T14:33:19.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.995+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=9TYG5MV1DQOT type=del 2024-03-09T14:33:19.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.997+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~5BHE6UYQ3JHI.0 size=1048576 2024-03-09T14:33:19.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.998+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~5BHE6UYQ3JHI.1 size=617067 2024-03-09T14:33:19.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.998+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=5BHE6UYQ3JHI tag=0BB3DTIOLSHP type=write size=2714219 2024-03-09T14:33:19.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:19.999+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=QDB5DIL0IYX7 type=del 2024-03-09T14:33:19.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.000+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=H9FCKA60ECB8 type=write size=724187 2024-03-09T14:33:20.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.001+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~WTQHHBXVCUFT.0 size=1048576 2024-03-09T14:33:20.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.002+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~WTQHHBXVCUFT.1 size=1048576 2024-03-09T14:33:20.002 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.003+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~WTQHHBXVCUFT.2 size=896168 2024-03-09T14:33:20.004 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.005+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=WTQHHBXVCUFT tag=F612ACS3O7ME type=write size=4041896 2024-03-09T14:33:20.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.007+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~V7JH3TJNXFXG.0 size=1048576 2024-03-09T14:33:20.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.007+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~V7JH3TJNXFXG.1 size=1048576 2024-03-09T14:33:20.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.008+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~V7JH3TJNXFXG.2 size=892631 2024-03-09T14:33:20.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.008+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=V7JH3TJNXFXG tag=XZURD4S7P732 type=write size=4038359 2024-03-09T14:33:20.009 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.009+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~9LT4G877AVWW.0 size=1048576 2024-03-09T14:33:20.010 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.010+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~9LT4G877AVWW.1 size=1048576 2024-03-09T14:33:20.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.011+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~9LT4G877AVWW.2 size=900441 2024-03-09T14:33:20.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.013+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=9LT4G877AVWW tag=Q3D93QTX9BX9 type=write size=4046169 2024-03-09T14:33:20.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.015+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~UW4HLQKDBLBO.0 size=1048576 2024-03-09T14:33:20.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.016+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~UW4HLQKDBLBO.1 size=1048576 2024-03-09T14:33:20.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.017+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~UW4HLQKDBLBO.2 size=678978 2024-03-09T14:33:20.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.017+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=UW4HLQKDBLBO tag=ZACHGKGVB3DM type=write size=3824706 2024-03-09T14:33:20.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.018+0000 7f586ae3d780 1 < canceled operation key=78Y2ZM3W6EUC tag=LTGEESE205IE type=del size=446111 2024-03-09T14:33:20.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.019+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=YTOOXBMXJ80Z type=del size=758652 2024-03-09T14:33:20.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.020+0000 7f586ae3d780 -1 < failed to complete operation key=CZGAXNJ0GKU0 tag=IHE03Y4S593E type=del size=2430529: (22) Invalid argument 2024-03-09T14:33:20.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.023+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~CVQ1XJJIH18O.0 size=368141 2024-03-09T14:33:20.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.023+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=CVQ1XJJIH18O tag=4DBUZR4XA3GX type=write size=1416717 2024-03-09T14:33:20.023 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.024+0000 7f586ae3d780 1 < completed write operation key=OU9IOY7J572N tag=K3VTVOEAC5KI type=write size=849181 2024-03-09T14:33:20.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.026+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~PW5639O2553Q.0 size=1048576 2024-03-09T14:33:20.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.027+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~PW5639O2553Q.1 size=182944 2024-03-09T14:33:20.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.027+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=PW5639O2553Q tag=DR4NEEUZIDVT type=write size=2280096 2024-03-09T14:33:20.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.028+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~7DWYWZEOHZM6.0 size=1048576 2024-03-09T14:33:20.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.029+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~7DWYWZEOHZM6.1 size=41031 2024-03-09T14:33:20.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.031+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=7DWYWZEOHZM6 tag=PMGFJQM39PON type=write size=2138183 2024-03-09T14:33:20.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.032+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=LVXG2AZ1IWEG type=del size=3347569 2024-03-09T14:33:20.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.033+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~7OSXTU3BCF0M.0 size=1048576 2024-03-09T14:33:20.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.034+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~7OSXTU3BCF0M.1 size=150979 2024-03-09T14:33:20.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.036+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=7OSXTU3BCF0M tag=GNM8ORTAVNJ1 type=write size=2248131 2024-03-09T14:33:20.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.037+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=XCHB5LS5MYHJ type=del size=2452688 2024-03-09T14:33:20.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.038+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=J9U4D8RXG0S0 type=del 2024-03-09T14:33:20.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.039+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=X9WNYFJBHEFJ type=del size=195267 2024-03-09T14:33:20.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.041+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~5ANEUT2ILMAU.0 size=1048576 2024-03-09T14:33:20.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.041+0000 7f586ae3d780 1 < canceled part key=_multipart_W4Q1MWHOQ4Y1.2~5ANEUT2ILMAU.1 size=1048576 2024-03-09T14:33:20.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.041+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~5ANEUT2ILMAU.2 size=169187 2024-03-09T14:33:20.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.043+0000 7f586ae3d780 1 < canceled multipart upload key=W4Q1MWHOQ4Y1 upload=5ANEUT2ILMAU tag=6J9TKU5N86EH type=write size=3314915 2024-03-09T14:33:20.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.044+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=BQG1LDWA1LCN type=del size=1193614 2024-03-09T14:33:20.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.046+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~9P4OKV6IXAM4.0 size=1048576 2024-03-09T14:33:20.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.046+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~9P4OKV6IXAM4.1 size=1048576 2024-03-09T14:33:20.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.047+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~9P4OKV6IXAM4.2 size=953029 2024-03-09T14:33:20.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.049+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=9P4OKV6IXAM4 tag=HB49MCF3P4SR type=write size=4098757 2024-03-09T14:33:20.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.050+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=PWEJOFH9NFWC type=del size=1639442 2024-03-09T14:33:20.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.052+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=3PF706HR6DKL type=del 2024-03-09T14:33:20.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.053+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=K3E5K8UX7CMC type=del size=2582862 2024-03-09T14:33:20.053 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.054+0000 7f586ae3d780 -1 < failed to complete operation key=CZGAXNJ0GKU0 tag=EKMOMCI8NR8Y type=del size=3636711: (22) Invalid argument 2024-03-09T14:33:20.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.055+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=MMI6ZMFSO19O type=del size=1918836 2024-03-09T14:33:20.056 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.056+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~ZGA2S2GR3HA7.0 size=849727 2024-03-09T14:33:20.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.058+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=ZGA2S2GR3HA7 tag=VFSYCKRV5WYH type=write size=1898303 2024-03-09T14:33:20.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.060+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~T5333UBLRS9W.0 size=605908 2024-03-09T14:33:20.060 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.060+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=T5333UBLRS9W tag=3E78HWIBT6QQ type=write size=1654484 2024-03-09T14:33:20.060 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.061+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=T44KOE1L1W5F type=del 2024-03-09T14:33:20.062 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.062+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=IQULQN8QY43P type=del size=3173970 2024-03-09T14:33:20.064 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.065+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~5BHE6UYQ3JHI.0 size=1048576 2024-03-09T14:33:20.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.066+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~5BHE6UYQ3JHI.1 size=617067 2024-03-09T14:33:20.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.068+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=5BHE6UYQ3JHI tag=0BB3DTIOLSHP type=write size=2714219 2024-03-09T14:33:20.068 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.069+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=TK0W8ACLSW62 type=del size=756746 2024-03-09T14:33:20.070 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.070+0000 7f586ae3d780 1 < completed write operation key=XIYWPXSYCT6I tag=H9FCKA60ECB8 type=write size=724187 2024-03-09T14:33:20.071 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.072+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=GAZXB6DFF931 type=write size=522340 2024-03-09T14:33:20.072 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.073+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~V7JH3TJNXFXG.0 size=1048576 2024-03-09T14:33:20.073 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.074+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~V7JH3TJNXFXG.1 size=1048576 2024-03-09T14:33:20.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.076+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~V7JH3TJNXFXG.2 size=892631 2024-03-09T14:33:20.078 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.078+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=V7JH3TJNXFXG tag=XZURD4S7P732 type=write size=4038359 2024-03-09T14:33:20.079 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.079+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=R6NKN004FYJY type=del size=2581839 2024-03-09T14:33:20.080 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.081+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~UW4HLQKDBLBO.0 size=1048576 2024-03-09T14:33:20.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.082+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~UW4HLQKDBLBO.1 size=1048576 2024-03-09T14:33:20.082 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.083+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~UW4HLQKDBLBO.2 size=678978 2024-03-09T14:33:20.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.085+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=UW4HLQKDBLBO tag=ZACHGKGVB3DM type=write size=3824706 2024-03-09T14:33:20.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.086+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=F52WR0Z4DF1Q type=del size=1951282 2024-03-09T14:33:20.087 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.087+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=YTOOXBMXJ80Z type=del 2024-03-09T14:33:20.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.089+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=Z0JJW0WRFANC type=del size=3258584 2024-03-09T14:33:20.089 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.090+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~CVQ1XJJIH18O.0 size=368141 2024-03-09T14:33:20.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.092+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=CVQ1XJJIH18O tag=4DBUZR4XA3GX type=write size=1416717 2024-03-09T14:33:20.094 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.094+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~M5IZQRPL0FVP.0 size=420051 2024-03-09T14:33:20.094 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.094+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=M5IZQRPL0FVP tag=JP0J8SI7XTBV type=write size=1468627 2024-03-09T14:33:20.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.095+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~PW5639O2553Q.0 size=1048576 2024-03-09T14:33:20.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.096+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~PW5639O2553Q.1 size=182944 2024-03-09T14:33:20.098 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.098+0000 7f586ae3d780 1 < completed multipart upload key=LRI2GKBGVCWW upload=PW5639O2553Q tag=DR4NEEUZIDVT type=write size=2280096 2024-03-09T14:33:20.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.100+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=X84LD220AQOU type=del size=2152744 2024-03-09T14:33:20.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.101+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=LVXG2AZ1IWEG type=del 2024-03-09T14:33:20.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.102+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=PWWT8BZ0ECHV type=del size=3653799 2024-03-09T14:33:20.102 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.103+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=XCHB5LS5MYHJ type=del 2024-03-09T14:33:20.104 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.105+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~R38J3YPHTXOJ.0 size=931461 2024-03-09T14:33:20.104 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.105+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=R38J3YPHTXOJ tag=IP3T2B2I4IF6 type=write size=1980037 2024-03-09T14:33:20.106 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.106+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=X9WNYFJBHEFJ type=del 2024-03-09T14:33:20.107 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.108+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=TF2Z1Z6AYD88 type=del size=2791086 2024-03-09T14:33:20.108 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.109+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=BQG1LDWA1LCN type=del 2024-03-09T14:33:20.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.110+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=497JBMC7NCQ6 type=del size=374443 2024-03-09T14:33:20.111 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.112+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=PWEJOFH9NFWC type=del 2024-03-09T14:33:20.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.114+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~RLDN1069H9Q8.0 size=1048576 2024-03-09T14:33:20.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.115+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~RLDN1069H9Q8.1 size=1048576 2024-03-09T14:33:20.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.116+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~RLDN1069H9Q8.2 size=372920 2024-03-09T14:33:20.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.116+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=RLDN1069H9Q8 tag=QX5QSCJU0TYD type=write size=3518648 2024-03-09T14:33:20.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.117+0000 7f586ae3d780 1 < canceled operation key=2BUCMVWK7J1V tag=K3E5K8UX7CMC type=del size=2582862 2024-03-09T14:33:20.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.119+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=5VRPXPMMWFBR type=del size=2458467 2024-03-09T14:33:20.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.120+0000 7f586ae3d780 1 < canceled operation key=04E9KDGUC274 tag=MMI6ZMFSO19O type=del size=1918836 2024-03-09T14:33:20.121 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.121+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=T3J33025CP0M type=del size=1918002 2024-03-09T14:33:20.122 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.123+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~T5333UBLRS9W.0 size=605908 2024-03-09T14:33:20.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.125+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=T5333UBLRS9W tag=3E78HWIBT6QQ type=write size=1654484 2024-03-09T14:33:20.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.127+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~R5RHLDGB5QU5.0 size=1048576 2024-03-09T14:33:20.127 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.128+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~R5RHLDGB5QU5.1 size=1048576 2024-03-09T14:33:20.129 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.129+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~R5RHLDGB5QU5.2 size=648334 2024-03-09T14:33:20.129 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.129+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=R5RHLDGB5QU5 tag=71N7OJV9RCRA type=write size=3794062 2024-03-09T14:33:20.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.130+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=IQULQN8QY43P type=del 2024-03-09T14:33:20.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.132+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=X4K04E6F4GSC type=del size=3275744 2024-03-09T14:33:20.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.133+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=TK0W8ACLSW62 type=del 2024-03-09T14:33:20.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.134+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=R0SB5B31S7Z8 type=del size=135195 2024-03-09T14:33:20.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.135+0000 7f586ae3d780 1 < completed write operation key=78Y2ZM3W6EUC tag=GAZXB6DFF931 type=write size=522340 2024-03-09T14:33:20.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.136+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=937E5DBSLDLH type=del size=1773257 2024-03-09T14:33:20.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.138+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=R6NKN004FYJY type=del 2024-03-09T14:33:20.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.139+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=GICFNGNPDCYI type=del size=2407323 2024-03-09T14:33:20.139 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.140+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=F52WR0Z4DF1Q type=del 2024-03-09T14:33:20.141 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.141+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=Z3HE4FSQU53E type=del size=1252320 2024-03-09T14:33:20.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.142+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=Z0JJW0WRFANC type=del 2024-03-09T14:33:20.143 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.144+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=CV5U2IFH94PL type=del size=3606775 2024-03-09T14:33:20.145 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.145+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~M5IZQRPL0FVP.0 size=420051 2024-03-09T14:33:20.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.147+0000 7f586ae3d780 1 < completed multipart upload key=IK528ND96157 upload=M5IZQRPL0FVP tag=JP0J8SI7XTBV type=write size=1468627 2024-03-09T14:33:20.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.148+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=M8YQD46KRAGC type=del size=1985998 2024-03-09T14:33:20.149 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.149+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=X84LD220AQOU type=del 2024-03-09T14:33:20.151 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.152+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~VGQJKJRK3RHC.0 size=606188 2024-03-09T14:33:20.151 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.152+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=VGQJKJRK3RHC tag=85PM95U82FZN type=write size=1654764 2024-03-09T14:33:20.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.153+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=PWWT8BZ0ECHV type=del 2024-03-09T14:33:20.153 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.154+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=GXCDV5BKCC58 type=del size=989798 2024-03-09T14:33:20.155 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.155+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~R38J3YPHTXOJ.0 size=931461 2024-03-09T14:33:20.157 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.158+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=R38J3YPHTXOJ tag=IP3T2B2I4IF6 type=write size=1980037 2024-03-09T14:33:20.158 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.159+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=9HTFCRXEQEAQ type=del size=2856274 2024-03-09T14:33:20.160 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.160+0000 7f586ae3d780 1 < canceled operation key=CAISZZZSOD34 tag=TF2Z1Z6AYD88 type=del size=2791086 2024-03-09T14:33:20.161 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.161+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=6M9QJZ0PP56E type=del size=2530980 2024-03-09T14:33:20.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.162+0000 7f586ae3d780 1 < canceled operation key=0JDF7910RACF tag=497JBMC7NCQ6 type=del size=374443 2024-03-09T14:33:20.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.164+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~8X92PGTNPHNH.0 size=1048576 2024-03-09T14:33:20.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.165+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~8X92PGTNPHNH.1 size=726287 2024-03-09T14:33:20.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.165+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=8X92PGTNPHNH tag=43I4XN1EO6DN type=write size=2823439 2024-03-09T14:33:20.166 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.167+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~RLDN1069H9Q8.0 size=1048576 2024-03-09T14:33:20.166 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.167+0000 7f586ae3d780 1 < canceled part key=_multipart_G2BIOBESOIK9.2~RLDN1069H9Q8.1 size=1048576 2024-03-09T14:33:20.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.167+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~RLDN1069H9Q8.2 size=372920 2024-03-09T14:33:20.169 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.169+0000 7f586ae3d780 1 < canceled multipart upload key=G2BIOBESOIK9 upload=RLDN1069H9Q8 tag=QX5QSCJU0TYD type=write size=3518648 2024-03-09T14:33:20.170 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.170+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=QU5PX72G11D0 type=del size=739067 2024-03-09T14:33:20.171 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.172+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=5VRPXPMMWFBR type=del 2024-03-09T14:33:20.172 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.173+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=F6Z3SXSXGRPM type=del size=2076435 2024-03-09T14:33:20.174 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.175+0000 7f586ae3d780 1 < suggested remove operation key=C1UGQOQ6AE1E tag=T3J33025CP0M type=del 2024-03-09T14:33:20.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.176+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=Q3LWZ3U1972D type=del size=1970203 2024-03-09T14:33:20.177 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.177+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~R5RHLDGB5QU5.0 size=1048576 2024-03-09T14:33:20.177 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.177+0000 7f586ae3d780 1 < canceled part key=_multipart_2BUCMVWK7J1V.2~R5RHLDGB5QU5.1 size=1048576 2024-03-09T14:33:20.177 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.178+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~R5RHLDGB5QU5.2 size=648334 2024-03-09T14:33:20.179 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.180+0000 7f586ae3d780 1 < canceled multipart upload key=2BUCMVWK7J1V upload=R5RHLDGB5QU5 tag=71N7OJV9RCRA type=write size=3794062 2024-03-09T14:33:20.180 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.181+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=4MBXTAMOHCB1 type=del size=3642077 2024-03-09T14:33:20.182 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.182+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=X4K04E6F4GSC type=del 2024-03-09T14:33:20.184 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.184+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~Y95E1XTVJHVB.0 size=658585 2024-03-09T14:33:20.184 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.184+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=Y95E1XTVJHVB tag=1LT18JMF0L62 type=write size=1707161 2024-03-09T14:33:20.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.185+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=R0SB5B31S7Z8 type=del 2024-03-09T14:33:20.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.186+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=QAK1H3OEYAKW type=del size=246511 2024-03-09T14:33:20.187 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.187+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=937E5DBSLDLH type=del 2024-03-09T14:33:20.190 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.190+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~DEABTLCKY6RF.0 size=1048576 2024-03-09T14:33:20.190 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.191+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~DEABTLCKY6RF.1 size=29049 2024-03-09T14:33:20.190 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.191+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=DEABTLCKY6RF tag=V7XI2287NI2K type=write size=2126201 2024-03-09T14:33:20.194 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.193+0000 7f586ae3d780 1 < suggested remove operation key=XIYWPXSYCT6I tag=GICFNGNPDCYI type=del 2024-03-09T14:33:20.194 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.194+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=CW3RLJJ6RO9H type=del size=1523746 2024-03-09T14:33:20.195 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.195+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=Z3HE4FSQU53E type=del 2024-03-09T14:33:20.197 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.197+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~PXDPV05SQF2O.0 size=500338 2024-03-09T14:33:20.197 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.197+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=PXDPV05SQF2O tag=F9AFUG68Y78V type=write size=1548914 2024-03-09T14:33:20.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.198+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=CV5U2IFH94PL type=del 2024-03-09T14:33:20.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.199+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=H9680JU1B61X type=del size=1172198 2024-03-09T14:33:20.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.200+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=M8YQD46KRAGC type=del 2024-03-09T14:33:20.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.202+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~JR4ZAU4KYQE2.0 size=266638 2024-03-09T14:33:20.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.202+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=JR4ZAU4KYQE2 tag=E7H62M74HE2J type=write size=1315214 2024-03-09T14:33:20.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.203+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~VGQJKJRK3RHC.0 size=606188 2024-03-09T14:33:20.205 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.206+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=VGQJKJRK3RHC tag=85PM95U82FZN type=write size=1654764 2024-03-09T14:33:20.206 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.207+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=AKTBVT309E8B type=del size=295478 2024-03-09T14:33:20.207 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.208+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=GXCDV5BKCC58 type=del 2024-03-09T14:33:20.209 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.209+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=HNBBHOZRZHFI type=del size=1745645 2024-03-09T14:33:20.209 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.210+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=9HTFCRXEQEAQ type=del 2024-03-09T14:33:20.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.211+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=S33YZTK6IEWP type=del size=1209856 2024-03-09T14:33:20.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.212+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=6M9QJZ0PP56E type=del 2024-03-09T14:33:20.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.213+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=HMRSQQLPBWR6 type=del size=1510890 2024-03-09T14:33:20.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.215+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~8X92PGTNPHNH.0 size=1048576 2024-03-09T14:33:20.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.216+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~8X92PGTNPHNH.1 size=726287 2024-03-09T14:33:20.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.217+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=8X92PGTNPHNH tag=43I4XN1EO6DN type=write size=2823439 2024-03-09T14:33:20.218 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.219+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=9UBT0V7V7CG9 type=del size=1676291 2024-03-09T14:33:20.219 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.220+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=QU5PX72G11D0 type=del 2024-03-09T14:33:20.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.221+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=XN8UCU2FNEM6 type=write size=329088 2024-03-09T14:33:20.222 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.223+0000 7f586ae3d780 1 < suggested update operation key=G2BIOBESOIK9 tag=F6Z3SXSXGRPM type=del size=2076435 2024-03-09T14:33:20.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.225+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~TUYIED1JS6M2.0 size=953156 2024-03-09T14:33:20.226 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.225+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=TUYIED1JS6M2 tag=7O7EQLHS7AQN type=write size=2001732 2024-03-09T14:33:20.226 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.226+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=Q3LWZ3U1972D type=del 2024-03-09T14:33:20.228 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.228+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~2PMQS8Z3KPAY.0 size=76076 2024-03-09T14:33:20.228 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.228+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=2PMQS8Z3KPAY tag=O2JYCEKVX6E0 type=write size=1124652 2024-03-09T14:33:20.229 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.230+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=4MBXTAMOHCB1 type=del 2024-03-09T14:33:20.231 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.232+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~TV0U0Y4P5KUN.0 size=58231 2024-03-09T14:33:20.231 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.232+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=TV0U0Y4P5KUN tag=37OAYY433REW type=write size=1106807 2024-03-09T14:33:20.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.233+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~Y95E1XTVJHVB.0 size=658585 2024-03-09T14:33:20.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.235+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=Y95E1XTVJHVB tag=1LT18JMF0L62 type=write size=1707161 2024-03-09T14:33:20.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.236+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=A42LGW2FE08E type=del size=999795 2024-03-09T14:33:20.236 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.237+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=QAK1H3OEYAKW type=del 2024-03-09T14:33:20.238 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.239+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~59CY3H774G8U.0 size=999866 2024-03-09T14:33:20.239 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.239+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=59CY3H774G8U tag=VN94YR2UTHTY type=write size=2048442 2024-03-09T14:33:20.240 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.240+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~DEABTLCKY6RF.0 size=1048576 2024-03-09T14:33:20.240 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.240+0000 7f586ae3d780 1 < canceled part key=_multipart_WNVN3EOUUBGR.2~DEABTLCKY6RF.1 size=29049 2024-03-09T14:33:20.241 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.242+0000 7f586ae3d780 1 < canceled multipart upload key=WNVN3EOUUBGR upload=DEABTLCKY6RF tag=V7XI2287NI2K type=write size=2126201 2024-03-09T14:33:20.243 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.243+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=TS33OXMC8A6Z type=write size=540605 2024-03-09T14:33:20.244 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.244+0000 7f586ae3d780 1 < canceled operation key=O5L6RC16RS8E tag=CW3RLJJ6RO9H type=del size=1523746 2024-03-09T14:33:20.245 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.245+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=H41R0GCDVS6O type=del size=3351599 2024-03-09T14:33:20.246 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.246+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~PXDPV05SQF2O.0 size=500338 2024-03-09T14:33:20.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.248+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=PXDPV05SQF2O tag=F9AFUG68Y78V type=write size=1548914 2024-03-09T14:33:20.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.249+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=U9YZ6YNXHLQQ type=del size=1330234 2024-03-09T14:33:20.250 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.251+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=H9680JU1B61X type=del 2024-03-09T14:33:20.252 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.252+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~NGCW47RY4D7R.0 size=1048576 2024-03-09T14:33:20.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.253+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~NGCW47RY4D7R.1 size=426023 2024-03-09T14:33:20.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.253+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=NGCW47RY4D7R tag=PLC9DG3I2LYV type=write size=2523175 2024-03-09T14:33:20.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.254+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~JR4ZAU4KYQE2.0 size=266638 2024-03-09T14:33:20.256 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.256+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=JR4ZAU4KYQE2 tag=E7H62M74HE2J type=write size=1315214 2024-03-09T14:33:20.257 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.258+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=3KV51099ZH6S type=del size=273364 2024-03-09T14:33:20.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.260+0000 7f586ae3d780 1 < suggested remove operation key=LRI2GKBGVCWW tag=AKTBVT309E8B type=del 2024-03-09T14:33:20.260 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.261+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=LH8OH2WE0372 type=del size=312549 2024-03-09T14:33:20.262 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.262+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=HNBBHOZRZHFI type=del 2024-03-09T14:33:20.263 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.263+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=LDOVUWRAXX96 type=del size=1669676 2024-03-09T14:33:20.264 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.264+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=S33YZTK6IEWP type=del 2024-03-09T14:33:20.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.266+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~HZZQ4LWPSNUN.0 size=57206 2024-03-09T14:33:20.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.266+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=HZZQ4LWPSNUN tag=S8LD6VEC4HGL type=write size=1105782 2024-03-09T14:33:20.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.268+0000 7f586ae3d780 -1 < failed to complete operation key=G2BIOBESOIK9 tag=HMRSQQLPBWR6 type=del size=1510890: (22) Invalid argument 2024-03-09T14:33:20.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.270+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~L7TYCSMRVSB5.0 size=680537 2024-03-09T14:33:20.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.270+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=L7TYCSMRVSB5 tag=2PEM8KMML0IG type=write size=1729113 2024-03-09T14:33:20.271 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.272+0000 7f586ae3d780 1 < suggested update operation key=UAYZ55UT77VE tag=9UBT0V7V7CG9 type=del size=1676291 2024-03-09T14:33:20.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.274+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~E6T2ZMORAIV5.0 size=1048576 2024-03-09T14:33:20.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.275+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~E6T2ZMORAIV5.1 size=731194 2024-03-09T14:33:20.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.275+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=E6T2ZMORAIV5 tag=05826X88JGYB type=write size=2828346 2024-03-09T14:33:20.276 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.277+0000 7f586ae3d780 1 < completed write operation key=DJH53FNVMLGY tag=XN8UCU2FNEM6 type=write size=329088 2024-03-09T14:33:20.281 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.282+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=ILH62GGJD29W type=del size=3502154 2024-03-09T14:33:20.281 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.282+0000 7f586ae3d780 1 < canceled part key=_multipart_BHSYRD3IEJWW.2~TUYIED1JS6M2.0 size=953156 2024-03-09T14:33:20.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.287+0000 7f586ae3d780 1 < canceled multipart upload key=BHSYRD3IEJWW upload=TUYIED1JS6M2 tag=7O7EQLHS7AQN type=write size=2001732 2024-03-09T14:33:20.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.288+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=TNTWB0NWPTHA type=del size=414970 2024-03-09T14:33:20.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.289+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~2PMQS8Z3KPAY.0 size=76076 2024-03-09T14:33:20.291 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.291+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=2PMQS8Z3KPAY tag=O2JYCEKVX6E0 type=write size=1124652 2024-03-09T14:33:20.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.293+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=OVYE2U46CQC3 type=del size=749357 2024-03-09T14:33:20.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.294+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~TV0U0Y4P5KUN.0 size=58231 2024-03-09T14:33:20.295 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.296+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=TV0U0Y4P5KUN tag=37OAYY433REW type=write size=1106807 2024-03-09T14:33:20.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.297+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=XD9TUCSWNHBP type=write size=351160 2024-03-09T14:33:20.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.298+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=A42LGW2FE08E type=del 2024-03-09T14:33:20.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.299+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=4POEEU617KSE type=del size=2545307 2024-03-09T14:33:20.300 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.300+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~59CY3H774G8U.0 size=999866 2024-03-09T14:33:20.301 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.302+0000 7f586ae3d780 1 < completed multipart upload key=UAYZ55UT77VE upload=59CY3H774G8U tag=VN94YR2UTHTY type=write size=2048442 2024-03-09T14:33:20.303 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.303+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=R84E3A24H215 type=del size=2720984 2024-03-09T14:33:20.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.305+0000 7f586ae3d780 1 < completed write operation key=DGO3ZT8ST90A tag=TS33OXMC8A6Z type=write size=540605 2024-03-09T14:33:20.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.306+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=KKE2HNCC0RU1 type=del size=3326264 2024-03-09T14:33:20.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.308+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=H41R0GCDVS6O type=del 2024-03-09T14:33:20.309 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.310+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~S7IZCDFUZ3G8.0 size=1048576 2024-03-09T14:33:20.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.311+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~S7IZCDFUZ3G8.1 size=283695 2024-03-09T14:33:20.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.311+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=S7IZCDFUZ3G8 tag=BT3NADI2KBVR type=write size=2380847 2024-03-09T14:33:20.311 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.312+0000 7f586ae3d780 -1 < failed to complete operation key=LRI2GKBGVCWW tag=U9YZ6YNXHLQQ type=del size=1330234: (22) Invalid argument 2024-03-09T14:33:20.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.314+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~YO6ZZ6B7Q8UK.0 size=1048576 2024-03-09T14:33:20.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.315+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~YO6ZZ6B7Q8UK.1 size=1048576 2024-03-09T14:33:20.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.316+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~YO6ZZ6B7Q8UK.2 size=462320 2024-03-09T14:33:20.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.316+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=YO6ZZ6B7Q8UK tag=DGE5T62391MT type=write size=3608048 2024-03-09T14:33:20.317 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.317+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~NGCW47RY4D7R.0 size=1048576 2024-03-09T14:33:20.317 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.318+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~NGCW47RY4D7R.1 size=426023 2024-03-09T14:33:20.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.320+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=NGCW47RY4D7R tag=PLC9DG3I2LYV type=write size=2523175 2024-03-09T14:33:20.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.322+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~3MGXX3TQAH9X.0 size=1048576 2024-03-09T14:33:20.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.323+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~3MGXX3TQAH9X.1 size=242527 2024-03-09T14:33:20.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.323+0000 7f586ae3d780 1 > prepared multipart upload key=C1UGQOQ6AE1E upload=3MGXX3TQAH9X tag=MLFBVQOCBNK5 type=write size=2339679 2024-03-09T14:33:20.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.324+0000 7f586ae3d780 -1 < failed to complete operation key=UAYZ55UT77VE tag=3KV51099ZH6S type=del size=273364: (22) Invalid argument 2024-03-09T14:33:20.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.327+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~D1UO1AK892C3.0 size=261699 2024-03-09T14:33:20.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.327+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=D1UO1AK892C3 tag=NSUW8L8JVT10 type=write size=1310275 2024-03-09T14:33:20.329 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.329+0000 7f586ae3d780 1 < suggested update operation key=78Y2ZM3W6EUC tag=LH8OH2WE0372 type=del size=312549 2024-03-09T14:33:20.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.330+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=93EER6WOC59C type=del size=1342045 2024-03-09T14:33:20.332 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.333+0000 7f586ae3d780 1 < suggested remove operation key=OXBDXIILR3NS tag=LDOVUWRAXX96 type=del 2024-03-09T14:33:20.333 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.334+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=WEFYH8FXGDWJ type=del size=2551241 2024-03-09T14:33:20.335 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.335+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~HZZQ4LWPSNUN.0 size=57206 2024-03-09T14:33:20.337 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.337+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=HZZQ4LWPSNUN tag=S8LD6VEC4HGL type=write size=1105782 2024-03-09T14:33:20.339 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.340+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~33S2P8RRE1ID.0 size=910812 2024-03-09T14:33:20.339 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.340+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=33S2P8RRE1ID tag=8J4ZRJHNOUCP type=write size=1959388 2024-03-09T14:33:20.340 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.341+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~L7TYCSMRVSB5.0 size=680537 2024-03-09T14:33:20.342 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.343+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=L7TYCSMRVSB5 tag=2PEM8KMML0IG type=write size=1729113 2024-03-09T14:33:20.344 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.345+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~DB381A2NQ6AN.0 size=1048576 2024-03-09T14:33:20.345 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.346+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~DB381A2NQ6AN.1 size=965338 2024-03-09T14:33:20.345 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.346+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=DB381A2NQ6AN tag=2I83A7FAYSXB type=write size=3062490 2024-03-09T14:33:20.347 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.347+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~E6T2ZMORAIV5.0 size=1048576 2024-03-09T14:33:20.348 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.348+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~E6T2ZMORAIV5.1 size=731194 2024-03-09T14:33:20.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.350+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=E6T2ZMORAIV5 tag=05826X88JGYB type=write size=2828346 2024-03-09T14:33:20.352 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.353+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~0267WBTEA1VO.0 size=1048576 2024-03-09T14:33:20.353 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.354+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~0267WBTEA1VO.1 size=1036382 2024-03-09T14:33:20.353 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.354+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=0267WBTEA1VO tag=7M3MYUZEC79I type=write size=3133534 2024-03-09T14:33:20.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.355+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=ILH62GGJD29W type=del 2024-03-09T14:33:20.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.356+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=ZOESO3Y6ZFYZ type=del size=2935860 2024-03-09T14:33:20.357 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.358+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=TNTWB0NWPTHA type=del 2024-03-09T14:33:20.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.359+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=U0MQ4BLFFP2S type=del size=1627806 2024-03-09T14:33:20.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.360+0000 7f586ae3d780 1 < canceled operation key=39ZIGOC6JZ1R tag=OVYE2U46CQC3 type=del size=749357 2024-03-09T14:33:20.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.361+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=MCQQV9PYXU01 type=write size=749232 2024-03-09T14:33:20.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.362+0000 7f586ae3d780 1 < completed write operation key=BHSYRD3IEJWW tag=XD9TUCSWNHBP type=write size=351160 2024-03-09T14:33:20.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.365+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~3FWNKSA4S1OL.0 size=1048576 2024-03-09T14:33:20.365 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.366+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~3FWNKSA4S1OL.1 size=1048576 2024-03-09T14:33:20.366 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.367+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~3FWNKSA4S1OL.2 size=119226 2024-03-09T14:33:20.366 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.367+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=3FWNKSA4S1OL tag=DAP1NROB00PC type=write size=3264954 2024-03-09T14:33:20.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.368+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=4POEEU617KSE type=del 2024-03-09T14:33:20.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.369+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=3KX4HVU95U7G type=del size=2222604 2024-03-09T14:33:20.370 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.370+0000 7f586ae3d780 -1 < failed to complete operation key=OXBDXIILR3NS tag=R84E3A24H215 type=del size=2720984: (22) Invalid argument 2024-03-09T14:33:20.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.371+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=SQZ0M5VCJRE1 type=del size=956002 2024-03-09T14:33:20.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.372+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=KKE2HNCC0RU1 type=del 2024-03-09T14:33:20.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.374+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=M437Z9MXVTPF type=write size=1011452 2024-03-09T14:33:20.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.374+0000 7f586ae3d780 1 < canceled part key=_multipart_WNVN3EOUUBGR.2~S7IZCDFUZ3G8.0 size=1048576 2024-03-09T14:33:20.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.375+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~S7IZCDFUZ3G8.1 size=283695 2024-03-09T14:33:20.376 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.377+0000 7f586ae3d780 1 < canceled multipart upload key=WNVN3EOUUBGR upload=S7IZCDFUZ3G8 tag=BT3NADI2KBVR type=write size=2380847 2024-03-09T14:33:20.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.379+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~SA1SVFN0ASZQ.0 size=1048576 2024-03-09T14:33:20.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.379+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~SA1SVFN0ASZQ.1 size=913221 2024-03-09T14:33:20.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.379+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=SA1SVFN0ASZQ tag=KOGZJXARZ08U type=write size=3010373 2024-03-09T14:33:20.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.380+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~YO6ZZ6B7Q8UK.0 size=1048576 2024-03-09T14:33:20.382 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.381+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~YO6ZZ6B7Q8UK.1 size=1048576 2024-03-09T14:33:20.382 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.382+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~YO6ZZ6B7Q8UK.2 size=462320 2024-03-09T14:33:20.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.384+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=YO6ZZ6B7Q8UK tag=DGE5T62391MT type=write size=3608048 2024-03-09T14:33:20.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.386+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~9ZHDGP8O1F5B.0 size=1028892 2024-03-09T14:33:20.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.386+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=9ZHDGP8O1F5B tag=MM60I1LP1BDW type=write size=2077468 2024-03-09T14:33:20.387 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.387+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~3MGXX3TQAH9X.0 size=1048576 2024-03-09T14:33:20.388 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.388+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~3MGXX3TQAH9X.1 size=242527 2024-03-09T14:33:20.390 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.390+0000 7f586ae3d780 1 < completed multipart upload key=C1UGQOQ6AE1E upload=3MGXX3TQAH9X tag=MLFBVQOCBNK5 type=write size=2339679 2024-03-09T14:33:20.391 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.392+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=YMV51GU3U1HL type=del size=1061879 2024-03-09T14:33:20.392 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.393+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~D1UO1AK892C3.0 size=261699 2024-03-09T14:33:20.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.395+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=D1UO1AK892C3 tag=NSUW8L8JVT10 type=write size=1310275 2024-03-09T14:33:20.396 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.396+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=NX7WD9Y5WDW1 type=del size=2517477 2024-03-09T14:33:20.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.397+0000 7f586ae3d780 1 < canceled operation key=OU9IOY7J572N tag=93EER6WOC59C type=del size=1342045 2024-03-09T14:33:20.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.398+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=Z3WU3R1TOZ0M type=del size=4049483 2024-03-09T14:33:20.399 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.400+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=WEFYH8FXGDWJ type=del 2024-03-09T14:33:20.400 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.401+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=CTPH2T3BDDJ0 type=del size=2778373 2024-03-09T14:33:20.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.402+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~33S2P8RRE1ID.0 size=910812 2024-03-09T14:33:20.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.404+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=33S2P8RRE1ID tag=8J4ZRJHNOUCP type=write size=1959388 2024-03-09T14:33:20.405 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.405+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=WN2MQZXJVOW9 type=del size=3710858 2024-03-09T14:33:20.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.407+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~DB381A2NQ6AN.0 size=1048576 2024-03-09T14:33:20.408 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.408+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~DB381A2NQ6AN.1 size=965338 2024-03-09T14:33:20.409 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.410+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=DB381A2NQ6AN tag=2I83A7FAYSXB type=write size=3062490 2024-03-09T14:33:20.411 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.412+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~20Q74T5AUXUN.0 size=1048576 2024-03-09T14:33:20.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.413+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~20Q74T5AUXUN.1 size=1048576 2024-03-09T14:33:20.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.414+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~20Q74T5AUXUN.2 size=947466 2024-03-09T14:33:20.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.414+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=20Q74T5AUXUN tag=ZPIVI9O16OEC type=write size=4093194 2024-03-09T14:33:20.415 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.416+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~0267WBTEA1VO.0 size=1048576 2024-03-09T14:33:20.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.417+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~0267WBTEA1VO.1 size=1036382 2024-03-09T14:33:20.420 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.420+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=0267WBTEA1VO tag=7M3MYUZEC79I type=write size=3133534 2024-03-09T14:33:20.422 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.423+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~YV1ZW4R67JC4.0 size=1048576 2024-03-09T14:33:20.426 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.424+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~YV1ZW4R67JC4.1 size=24535 2024-03-09T14:33:20.426 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.424+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=YV1ZW4R67JC4 tag=5YTR960JI9DF type=write size=2121687 2024-03-09T14:33:20.426 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.426+0000 7f586ae3d780 1 < suggested remove operation key=CZGAXNJ0GKU0 tag=ZOESO3Y6ZFYZ type=del 2024-03-09T14:33:20.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.427+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=IH8MU433S6RF type=del size=3178493 2024-03-09T14:33:20.428 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.428+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=U0MQ4BLFFP2S type=del 2024-03-09T14:33:20.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.430+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~Z63F12YKTF9I.0 size=605386 2024-03-09T14:33:20.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.430+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=Z63F12YKTF9I tag=CUD7XPR89J51 type=write size=1653962 2024-03-09T14:33:20.431 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.432+0000 7f586ae3d780 1 < completed write operation key=0JDF7910RACF tag=MCQQV9PYXU01 type=write size=749232 2024-03-09T14:33:20.432 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.433+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=170Y0OQJFIWY type=del size=2488177 2024-03-09T14:33:20.434 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.434+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~3FWNKSA4S1OL.0 size=1048576 2024-03-09T14:33:20.435 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.435+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~3FWNKSA4S1OL.1 size=1048576 2024-03-09T14:33:20.436 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.436+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~3FWNKSA4S1OL.2 size=119226 2024-03-09T14:33:20.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.439+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=3FWNKSA4S1OL tag=DAP1NROB00PC type=write size=3264954 2024-03-09T14:33:20.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.440+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=03O4FTCSA1NR type=write size=604023 2024-03-09T14:33:20.441 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.441+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=3KX4HVU95U7G type=del 2024-03-09T14:33:20.443 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.443+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~OBYA7VX3F0UI.0 size=1048576 2024-03-09T14:33:20.444 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.444+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~OBYA7VX3F0UI.1 size=1048576 2024-03-09T14:33:20.445 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.445+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~OBYA7VX3F0UI.2 size=667960 2024-03-09T14:33:20.445 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.445+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=OBYA7VX3F0UI tag=K943JHZZTPMR type=write size=3813688 2024-03-09T14:33:20.446 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.446+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=SQZ0M5VCJRE1 type=del 2024-03-09T14:33:20.448 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.448+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~32CIJY91DYS8.0 size=1048576 2024-03-09T14:33:20.449 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.449+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~32CIJY91DYS8.1 size=927145 2024-03-09T14:33:20.449 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.449+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=32CIJY91DYS8 tag=HCJPG4OQS90E type=write size=3024297 2024-03-09T14:33:20.450 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.451+0000 7f586ae3d780 1 < completed write operation key=OU9IOY7J572N tag=M437Z9MXVTPF type=write size=1011452 2024-03-09T14:33:20.451 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.452+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=938ZYNRRBKVO type=del size=3934968 2024-03-09T14:33:20.452 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.452+0000 7f586ae3d780 1 < canceled part key=_multipart_04E9KDGUC274.2~SA1SVFN0ASZQ.0 size=1048576 2024-03-09T14:33:20.452 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.453+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~SA1SVFN0ASZQ.1 size=913221 2024-03-09T14:33:20.455 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.455+0000 7f586ae3d780 1 < canceled multipart upload key=04E9KDGUC274 upload=SA1SVFN0ASZQ tag=KOGZJXARZ08U type=write size=3010373 2024-03-09T14:33:20.456 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.456+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=ZDP467LAYE4Y type=write size=285618 2024-03-09T14:33:20.458 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.457+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~9ZHDGP8O1F5B.0 size=1028892 2024-03-09T14:33:20.461 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.462+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=9ZHDGP8O1F5B tag=MM60I1LP1BDW type=write size=2077468 2024-03-09T14:33:20.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.464+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~CGJEUOB5P1B8.0 size=1048576 2024-03-09T14:33:20.464 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.465+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~CGJEUOB5P1B8.1 size=1048576 2024-03-09T14:33:20.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.466+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~CGJEUOB5P1B8.2 size=882707 2024-03-09T14:33:20.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.466+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=CGJEUOB5P1B8 tag=DTUBIVXL8PLS type=write size=4028435 2024-03-09T14:33:20.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.467+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=YMV51GU3U1HL type=del 2024-03-09T14:33:20.468 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.468+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=X8NJJG6VWIYY type=del size=3165555 2024-03-09T14:33:20.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.469+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=NX7WD9Y5WDW1 type=del 2024-03-09T14:33:20.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.471+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=2DGCQ1FZ7JO0 type=del size=3867875 2024-03-09T14:33:20.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.472+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=Z3WU3R1TOZ0M type=del 2024-03-09T14:33:20.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.474+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~95FF7EQECOSL.0 size=1048576 2024-03-09T14:33:20.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.475+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~95FF7EQECOSL.1 size=267774 2024-03-09T14:33:20.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.475+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=95FF7EQECOSL tag=X7SJJ28L18K3 type=write size=2364926 2024-03-09T14:33:20.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.476+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=CTPH2T3BDDJ0 type=del 2024-03-09T14:33:20.477 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.477+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=84WSJDLFQVPL type=del size=418439 2024-03-09T14:33:20.478 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.479+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=WN2MQZXJVOW9 type=del 2024-03-09T14:33:20.480 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.481+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~5KWTBW8DL99X.0 size=1048576 2024-03-09T14:33:20.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.482+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~5KWTBW8DL99X.1 size=1048576 2024-03-09T14:33:20.482 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.483+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~5KWTBW8DL99X.2 size=351883 2024-03-09T14:33:20.482 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.483+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=5KWTBW8DL99X tag=TT6S9D2HX3B2 type=write size=3497611 2024-03-09T14:33:20.483 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.484+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~20Q74T5AUXUN.0 size=1048576 2024-03-09T14:33:20.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.485+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~20Q74T5AUXUN.1 size=1048576 2024-03-09T14:33:20.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.486+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~20Q74T5AUXUN.2 size=947466 2024-03-09T14:33:20.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.488+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=20Q74T5AUXUN tag=ZPIVI9O16OEC type=write size=4093194 2024-03-09T14:33:20.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.489+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=J1U6P0B1S0RD type=write size=479075 2024-03-09T14:33:20.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.490+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~YV1ZW4R67JC4.0 size=1048576 2024-03-09T14:33:20.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.490+0000 7f586ae3d780 1 < canceled part key=_multipart_04E9KDGUC274.2~YV1ZW4R67JC4.1 size=24535 2024-03-09T14:33:20.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.492+0000 7f586ae3d780 1 < canceled multipart upload key=04E9KDGUC274 upload=YV1ZW4R67JC4 tag=5YTR960JI9DF type=write size=2121687 2024-03-09T14:33:20.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.493+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=CCW84I8U3KPC type=del size=1002355 2024-03-09T14:33:20.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.494+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=IH8MU433S6RF type=del 2024-03-09T14:33:20.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.497+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~QZWPNJT47EKJ.0 size=1048576 2024-03-09T14:33:20.497 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.498+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~QZWPNJT47EKJ.1 size=1048576 2024-03-09T14:33:20.498 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.499+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~QZWPNJT47EKJ.2 size=1035669 2024-03-09T14:33:20.498 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.499+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=QZWPNJT47EKJ tag=YYGV5UQ3CKOO type=write size=4181397 2024-03-09T14:33:20.499 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.500+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~Z63F12YKTF9I.0 size=605386 2024-03-09T14:33:20.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.502+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=Z63F12YKTF9I tag=CUD7XPR89J51 type=write size=1653962 2024-03-09T14:33:20.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.503+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=K6N82ZQGIAM6 type=del size=2309144 2024-03-09T14:33:20.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.504+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=170Y0OQJFIWY type=del 2024-03-09T14:33:20.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.506+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~SJFLY1GFAWPC.0 size=596066 2024-03-09T14:33:20.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.506+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=SJFLY1GFAWPC tag=5MFMIRTLZCQC type=write size=1644642 2024-03-09T14:33:20.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.508+0000 7f586ae3d780 1 < completed write operation key=OU9IOY7J572N tag=03O4FTCSA1NR type=write size=604023 2024-03-09T14:33:20.509 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.510+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~FJLOOBE9HTEV.0 size=1048576 2024-03-09T14:33:20.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.511+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~FJLOOBE9HTEV.1 size=558979 2024-03-09T14:33:20.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.511+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=FJLOOBE9HTEV tag=ANBTRDUEUVUP type=write size=2656131 2024-03-09T14:33:20.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.512+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~OBYA7VX3F0UI.0 size=1048576 2024-03-09T14:33:20.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.513+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~OBYA7VX3F0UI.1 size=1048576 2024-03-09T14:33:20.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.514+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~OBYA7VX3F0UI.2 size=667960 2024-03-09T14:33:20.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.516+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=OBYA7VX3F0UI tag=K943JHZZTPMR type=write size=3813688 2024-03-09T14:33:20.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.517+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=1VV5928VZ8SD type=del size=3783418 2024-03-09T14:33:20.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.518+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~32CIJY91DYS8.0 size=1048576 2024-03-09T14:33:20.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.519+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~32CIJY91DYS8.1 size=927145 2024-03-09T14:33:20.521 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.521+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=32CIJY91DYS8 tag=HCJPG4OQS90E type=write size=3024297 2024-03-09T14:33:20.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.522+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=5JS6C332BE5X type=write size=906244 2024-03-09T14:33:20.523 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.524+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=938ZYNRRBKVO type=del 2024-03-09T14:33:20.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.526+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~IC64QGSAW5TA.0 size=1048576 2024-03-09T14:33:20.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.526+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~IC64QGSAW5TA.1 size=1048576 2024-03-09T14:33:20.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.527+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~IC64QGSAW5TA.2 size=520311 2024-03-09T14:33:20.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.527+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=IC64QGSAW5TA tag=4QNRWDRV52T1 type=write size=3666039 2024-03-09T14:33:20.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.529+0000 7f586ae3d780 1 < completed write operation key=9ZPCSBP3P58P tag=ZDP467LAYE4Y type=write size=285618 2024-03-09T14:33:20.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.531+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~JVTRQ4QVRWQG.0 size=1048576 2024-03-09T14:33:20.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.532+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~JVTRQ4QVRWQG.1 size=842070 2024-03-09T14:33:20.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.532+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=JVTRQ4QVRWQG tag=E4DTSZAFMO1O type=write size=2939222 2024-03-09T14:33:20.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.533+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~CGJEUOB5P1B8.0 size=1048576 2024-03-09T14:33:20.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.534+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~CGJEUOB5P1B8.1 size=1048576 2024-03-09T14:33:20.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.535+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~CGJEUOB5P1B8.2 size=882707 2024-03-09T14:33:20.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.537+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=CGJEUOB5P1B8 tag=DTUBIVXL8PLS type=write size=4028435 2024-03-09T14:33:20.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.539+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~VSXEHB2M6UJL.0 size=1048576 2024-03-09T14:33:20.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.540+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~VSXEHB2M6UJL.1 size=297962 2024-03-09T14:33:20.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.540+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=VSXEHB2M6UJL tag=JV1QR2POK8SH type=write size=2395114 2024-03-09T14:33:20.541 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.541+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=X8NJJG6VWIYY type=del 2024-03-09T14:33:20.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.544+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~K84WHCPFVCFZ.0 size=1048576 2024-03-09T14:33:20.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.544+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~K84WHCPFVCFZ.1 size=1048576 2024-03-09T14:33:20.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.545+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~K84WHCPFVCFZ.2 size=287445 2024-03-09T14:33:20.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.545+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=K84WHCPFVCFZ tag=LP3MIKG36NYN type=write size=3433173 2024-03-09T14:33:20.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.547+0000 7f586ae3d780 1 < suggested update operation key=O5L6RC16RS8E tag=2DGCQ1FZ7JO0 type=del size=3867875 2024-03-09T14:33:20.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.548+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=4JN8OQM44LT0 type=write size=835790 2024-03-09T14:33:20.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.550+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~95FF7EQECOSL.0 size=1048576 2024-03-09T14:33:20.550 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.551+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~95FF7EQECOSL.1 size=267774 2024-03-09T14:33:20.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.552+0000 7f586ae3d780 1 < completed multipart upload key=IK528ND96157 upload=95FF7EQECOSL tag=X7SJJ28L18K3 type=write size=2364926 2024-03-09T14:33:20.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.554+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=X8ANH3KYIN3G type=write size=973931 2024-03-09T14:33:20.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.555+0000 7f586ae3d780 -1 < failed to complete operation key=O5L6RC16RS8E tag=84WSJDLFQVPL type=del size=418439: (22) Invalid argument 2024-03-09T14:33:20.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.557+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~I1V0824KIUEG.0 size=1048576 2024-03-09T14:33:20.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.558+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~I1V0824KIUEG.1 size=165237 2024-03-09T14:33:20.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.558+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=I1V0824KIUEG tag=7PTU350ISHB2 type=write size=2262389 2024-03-09T14:33:20.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.559+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~5KWTBW8DL99X.0 size=1048576 2024-03-09T14:33:20.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.560+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~5KWTBW8DL99X.1 size=1048576 2024-03-09T14:33:20.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.561+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~5KWTBW8DL99X.2 size=351883 2024-03-09T14:33:20.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.563+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=5KWTBW8DL99X tag=TT6S9D2HX3B2 type=write size=3497611 2024-03-09T14:33:20.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.565+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~NUCL0TBA1LMM.0 size=1048576 2024-03-09T14:33:20.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.566+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~NUCL0TBA1LMM.1 size=1048576 2024-03-09T14:33:20.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.566+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~NUCL0TBA1LMM.2 size=62060 2024-03-09T14:33:20.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.566+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=NUCL0TBA1LMM tag=99WBJ3RR8E06 type=write size=3207788 2024-03-09T14:33:20.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.568+0000 7f586ae3d780 1 < completed write operation key=39ZIGOC6JZ1R tag=J1U6P0B1S0RD type=write size=479075 2024-03-09T14:33:20.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.569+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=W9PFKVAAQ1E9 type=del size=1406633 2024-03-09T14:33:20.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.570+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=CCW84I8U3KPC type=del 2024-03-09T14:33:20.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.572+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~C5QK7FWGS2L1.0 size=528230 2024-03-09T14:33:20.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.572+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=C5QK7FWGS2L1 tag=E7URFPH03461 type=write size=1576806 2024-03-09T14:33:20.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.572+0000 7f586ae3d780 1 < canceled part key=_multipart_BHSYRD3IEJWW.2~QZWPNJT47EKJ.0 size=1048576 2024-03-09T14:33:20.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.573+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~QZWPNJT47EKJ.1 size=1048576 2024-03-09T14:33:20.573 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.574+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~QZWPNJT47EKJ.2 size=1035669 2024-03-09T14:33:20.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.576+0000 7f586ae3d780 1 < canceled multipart upload key=BHSYRD3IEJWW upload=QZWPNJT47EKJ tag=YYGV5UQ3CKOO type=write size=4181397 2024-03-09T14:33:20.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.578+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~FJZRHYAHJBUE.0 size=1048576 2024-03-09T14:33:20.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.579+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~FJZRHYAHJBUE.1 size=15148 2024-03-09T14:33:20.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.579+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=FJZRHYAHJBUE tag=D8B77JA731WG type=write size=2112300 2024-03-09T14:33:20.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.580+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=K6N82ZQGIAM6 type=del 2024-03-09T14:33:20.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.582+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~YBBFRKR5N0JF.0 size=1048576 2024-03-09T14:33:20.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.583+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~YBBFRKR5N0JF.1 size=1048576 2024-03-09T14:33:20.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.584+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~YBBFRKR5N0JF.2 size=836210 2024-03-09T14:33:20.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.584+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=YBBFRKR5N0JF tag=E7C3RJ3167MV type=write size=3981938 2024-03-09T14:33:20.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.585+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~SJFLY1GFAWPC.0 size=596066 2024-03-09T14:33:20.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.587+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=SJFLY1GFAWPC tag=5MFMIRTLZCQC type=write size=1644642 2024-03-09T14:33:20.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.588+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=ULNUDP02BU0M type=del size=1651565 2024-03-09T14:33:20.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.588+0000 7f586ae3d780 1 < canceled part key=_multipart_9ZPCSBP3P58P.2~FJLOOBE9HTEV.0 size=1048576 2024-03-09T14:33:20.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.589+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~FJLOOBE9HTEV.1 size=558979 2024-03-09T14:33:20.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.591+0000 7f586ae3d780 1 < canceled multipart upload key=9ZPCSBP3P58P upload=FJLOOBE9HTEV tag=ANBTRDUEUVUP type=write size=2656131 2024-03-09T14:33:20.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.592+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=L6X8BGQPBLNN type=del size=3067337 2024-03-09T14:33:20.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.594+0000 7f586ae3d780 1 < suggested update operation key=2BUCMVWK7J1V tag=1VV5928VZ8SD type=del size=3783418 2024-03-09T14:33:20.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.595+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=4D3UM1FEJPAD type=del size=2766995 2024-03-09T14:33:20.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.597+0000 7f586ae3d780 1 < completed write operation key=IK528ND96157 tag=5JS6C332BE5X type=write size=906244 2024-03-09T14:33:20.597 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.598+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=3ME95JQSLCAC type=write size=726479 2024-03-09T14:33:20.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.599+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~IC64QGSAW5TA.0 size=1048576 2024-03-09T14:33:20.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.599+0000 7f586ae3d780 1 < canceled part key=_multipart_BHSYRD3IEJWW.2~IC64QGSAW5TA.1 size=1048576 2024-03-09T14:33:20.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.600+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~IC64QGSAW5TA.2 size=520311 2024-03-09T14:33:20.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.602+0000 7f586ae3d780 1 < canceled multipart upload key=BHSYRD3IEJWW upload=IC64QGSAW5TA tag=4QNRWDRV52T1 type=write size=3666039 2024-03-09T14:33:20.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.603+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=D9URLIXOFD1Q type=del size=2137652 2024-03-09T14:33:20.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.603+0000 7f586ae3d780 1 < canceled part key=_multipart_04E9KDGUC274.2~JVTRQ4QVRWQG.0 size=1048576 2024-03-09T14:33:20.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.604+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~JVTRQ4QVRWQG.1 size=842070 2024-03-09T14:33:20.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.607+0000 7f586ae3d780 1 < canceled multipart upload key=04E9KDGUC274 upload=JVTRQ4QVRWQG tag=E4DTSZAFMO1O type=write size=2939222 2024-03-09T14:33:20.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.609+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~ZVQLW1QDLWBE.0 size=1048576 2024-03-09T14:33:20.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.610+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~ZVQLW1QDLWBE.1 size=180532 2024-03-09T14:33:20.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.610+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=ZVQLW1QDLWBE tag=YO94OCO3ZGB8 type=write size=2277684 2024-03-09T14:33:20.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.610+0000 7f586ae3d780 1 < canceled part key=_multipart_IK528ND96157.2~VSXEHB2M6UJL.0 size=1048576 2024-03-09T14:33:20.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.611+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~VSXEHB2M6UJL.1 size=297962 2024-03-09T14:33:20.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.613+0000 7f586ae3d780 1 < canceled multipart upload key=IK528ND96157 upload=VSXEHB2M6UJL tag=JV1QR2POK8SH type=write size=2395114 2024-03-09T14:33:20.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.615+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=G1777TXB0KBW type=write size=364546 2024-03-09T14:33:20.615 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.616+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~K84WHCPFVCFZ.0 size=1048576 2024-03-09T14:33:20.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.617+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~K84WHCPFVCFZ.1 size=1048576 2024-03-09T14:33:20.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.618+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~K84WHCPFVCFZ.2 size=287445 2024-03-09T14:33:20.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.620+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=K84WHCPFVCFZ tag=LP3MIKG36NYN type=write size=3433173 2024-03-09T14:33:20.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.621+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=JOXZDTCD5W2Q type=del size=3202828 2024-03-09T14:33:20.622 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.622+0000 7f586ae3d780 1 < completed write operation key=UO072H74SHLP tag=4JN8OQM44LT0 type=write size=835790 2024-03-09T14:33:20.623 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.624+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=R29F091G8FLP type=del size=2196224 2024-03-09T14:33:20.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.626+0000 7f586ae3d780 1 < suggested remove operation key=C1UGQOQ6AE1E tag=X8ANH3KYIN3G type=write 2024-03-09T14:33:20.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.627+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=TQAYPFHMK6NM type=del size=4160645 2024-03-09T14:33:20.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.628+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~I1V0824KIUEG.0 size=1048576 2024-03-09T14:33:20.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.629+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~I1V0824KIUEG.1 size=165237 2024-03-09T14:33:20.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.631+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=I1V0824KIUEG tag=7PTU350ISHB2 type=write size=2262389 2024-03-09T14:33:20.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.632+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=EQIB0KWR6B44 type=del size=2078697 2024-03-09T14:33:20.633 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.633+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~NUCL0TBA1LMM.0 size=1048576 2024-03-09T14:33:20.634 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.635+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~NUCL0TBA1LMM.1 size=1048576 2024-03-09T14:33:20.635 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.635+0000 7f586ae3d780 1 < canceled part key=_multipart_LRI2GKBGVCWW.2~NUCL0TBA1LMM.2 size=62060 2024-03-09T14:33:20.637 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.637+0000 7f586ae3d780 1 < canceled multipart upload key=LRI2GKBGVCWW upload=NUCL0TBA1LMM tag=99WBJ3RR8E06 type=write size=3207788 2024-03-09T14:33:20.638 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.639+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=UDML8DNS0PP0 type=del size=2000567 2024-03-09T14:33:20.639 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.640+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=W9PFKVAAQ1E9 type=del 2024-03-09T14:33:20.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.642+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=5WW4WHH2XJVG type=del size=607122 2024-03-09T14:33:20.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.643+0000 7f586ae3d780 1 < canceled part key=_multipart_UAYZ55UT77VE.2~C5QK7FWGS2L1.0 size=528230 2024-03-09T14:33:20.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.644+0000 7f586ae3d780 1 < canceled multipart upload key=UAYZ55UT77VE upload=C5QK7FWGS2L1 tag=E7URFPH03461 type=write size=1576806 2024-03-09T14:33:20.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.646+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~3PPIAM9JZXXX.0 size=1033708 2024-03-09T14:33:20.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.646+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=3PPIAM9JZXXX tag=CT962SCKMMMM type=write size=2082284 2024-03-09T14:33:20.647 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.647+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~FJZRHYAHJBUE.0 size=1048576 2024-03-09T14:33:20.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.648+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~FJZRHYAHJBUE.1 size=15148 2024-03-09T14:33:20.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.650+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=FJZRHYAHJBUE tag=D8B77JA731WG type=write size=2112300 2024-03-09T14:33:20.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.651+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=MKY5J1PI0R9K type=del size=1521778 2024-03-09T14:33:20.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.652+0000 7f586ae3d780 1 < canceled part key=_multipart_509F17DT0C4I.2~YBBFRKR5N0JF.0 size=1048576 2024-03-09T14:33:20.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.653+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~YBBFRKR5N0JF.1 size=1048576 2024-03-09T14:33:20.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.654+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~YBBFRKR5N0JF.2 size=836210 2024-03-09T14:33:20.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.656+0000 7f586ae3d780 1 < canceled multipart upload key=509F17DT0C4I upload=YBBFRKR5N0JF tag=E7C3RJ3167MV type=write size=3981938 2024-03-09T14:33:20.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.658+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~OXLV3LUSZ0AD.0 size=1048576 2024-03-09T14:33:20.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.659+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~OXLV3LUSZ0AD.1 size=1018976 2024-03-09T14:33:20.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.659+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=OXLV3LUSZ0AD tag=TCY2E4R8SKTY type=write size=3116128 2024-03-09T14:33:20.661 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.661+0000 7f586ae3d780 1 < suggested remove operation key=OU9IOY7J572N tag=ULNUDP02BU0M type=del 2024-03-09T14:33:20.662 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.662+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=OBYXYFEKNNP2 type=del size=4060264 2024-03-09T14:33:20.664 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.664+0000 7f586ae3d780 1 < suggested update operation key=W3HTK2F8ML3V tag=L6X8BGQPBLNN type=del size=3067337 2024-03-09T14:33:20.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.667+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~4K72LVBQFRXM.0 size=1048576 2024-03-09T14:33:20.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.667+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~4K72LVBQFRXM.1 size=540523 2024-03-09T14:33:20.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.667+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=4K72LVBQFRXM tag=0VU24EJL2BXN type=write size=2637675 2024-03-09T14:33:20.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.668+0000 7f586ae3d780 1 < completed delete operation key=NHIOOLNXLZZC tag=4D3UM1FEJPAD type=del 2024-03-09T14:33:20.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.671+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~G6MULW0IVBVM.0 size=478263 2024-03-09T14:33:20.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.671+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=G6MULW0IVBVM tag=3SPJ0UC0TAH9 type=write size=1526839 2024-03-09T14:33:20.672 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.673+0000 7f586ae3d780 1 < suggested remove operation key=6YWLPUULN5SY tag=3ME95JQSLCAC type=write 2024-03-09T14:33:20.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.675+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~WQIF3SSIMV8Z.0 size=117858 2024-03-09T14:33:20.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.675+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=WQIF3SSIMV8Z tag=HMR49VAH4I1Y type=write size=1166434 2024-03-09T14:33:20.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.676+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=D9URLIXOFD1Q type=del 2024-03-09T14:33:20.678 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.678+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~DLO01VDLTVRZ.0 size=1048576 2024-03-09T14:33:20.679 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.679+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~DLO01VDLTVRZ.1 size=893041 2024-03-09T14:33:20.679 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.679+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=DLO01VDLTVRZ tag=8IRI238VFJ9S type=write size=2990193 2024-03-09T14:33:20.680 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.680+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~ZVQLW1QDLWBE.0 size=1048576 2024-03-09T14:33:20.681 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.681+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~ZVQLW1QDLWBE.1 size=180532 2024-03-09T14:33:20.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.683+0000 7f586ae3d780 1 < completed multipart upload key=UAYZ55UT77VE upload=ZVQLW1QDLWBE tag=YO94OCO3ZGB8 type=write size=2277684 2024-03-09T14:33:20.686 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.685+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~T7F81TEETI1P.0 size=1048576 2024-03-09T14:33:20.686 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.686+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~T7F81TEETI1P.1 size=435716 2024-03-09T14:33:20.686 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.686+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=T7F81TEETI1P tag=S3QPXMMVZOBO type=write size=2532868 2024-03-09T14:33:20.687 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.687+0000 7f586ae3d780 1 < completed write operation key=FNZ3BNA7W12E tag=G1777TXB0KBW type=write size=364546 2024-03-09T14:33:20.688 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.689+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=B3ZZFM0N94Z0 type=write size=198701 2024-03-09T14:33:20.689 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.690+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=JOXZDTCD5W2Q type=del 2024-03-09T14:33:20.691 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.691+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=MF1X1F9BS7PL type=del size=2613865 2024-03-09T14:33:20.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.693+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=R29F091G8FLP type=del 2024-03-09T14:33:20.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.695+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~W157130UIV72.0 size=273734 2024-03-09T14:33:20.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.695+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=W157130UIV72 tag=OO66ACARMZ8H type=write size=1322310 2024-03-09T14:33:20.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.697+0000 7f586ae3d780 1 < suggested remove operation key=BHSYRD3IEJWW tag=TQAYPFHMK6NM type=del 2024-03-09T14:33:20.699 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.699+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~E2EVRBNY5DDU.0 size=489394 2024-03-09T14:33:20.699 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.699+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=E2EVRBNY5DDU tag=K69MJJLUFKSH type=write size=1537970 2024-03-09T14:33:20.700 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.700+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=EQIB0KWR6B44 type=del 2024-03-09T14:33:20.701 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.701+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=UTMA2ACC1YHV type=del size=993790 2024-03-09T14:33:20.702 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.703+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=UDML8DNS0PP0 type=del 2024-03-09T14:33:20.703 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.704+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=X19PXT90MQSF type=del size=385959 2024-03-09T14:33:20.704 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.705+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=5WW4WHH2XJVG type=del 2024-03-09T14:33:20.705 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.706+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=TEMD1IPKRVX2 type=del size=1344612 2024-03-09T14:33:20.707 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.707+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~3PPIAM9JZXXX.0 size=1033708 2024-03-09T14:33:20.709 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.709+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=3PPIAM9JZXXX tag=CT962SCKMMMM type=write size=2082284 2024-03-09T14:33:20.711 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.711+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~RCE0PVIOML9W.0 size=1048576 2024-03-09T14:33:20.712 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.712+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~RCE0PVIOML9W.1 size=750459 2024-03-09T14:33:20.712 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.712+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=RCE0PVIOML9W tag=IOGG9OFY5VUI type=write size=2847611 2024-03-09T14:33:20.713 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.714+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=MKY5J1PI0R9K type=del 2024-03-09T14:33:20.714 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.715+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=DGZQIW22L737 type=del size=3839176 2024-03-09T14:33:20.716 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.716+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~OXLV3LUSZ0AD.0 size=1048576 2024-03-09T14:33:20.716 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.717+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~OXLV3LUSZ0AD.1 size=1018976 2024-03-09T14:33:20.718 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.719+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=OXLV3LUSZ0AD tag=TCY2E4R8SKTY type=write size=3116128 2024-03-09T14:33:20.720 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.720+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=M2VFOVM2QDN3 type=del size=4102738 2024-03-09T14:33:20.721 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.722+0000 7f586ae3d780 -1 < failed to complete operation key=6YWLPUULN5SY tag=OBYXYFEKNNP2 type=del size=4060264: (22) Invalid argument 2024-03-09T14:33:20.722 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.723+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=8LA64PBLQRMA type=del size=1460568 2024-03-09T14:33:20.723 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.724+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~4K72LVBQFRXM.0 size=1048576 2024-03-09T14:33:20.725 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.725+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~4K72LVBQFRXM.1 size=540523 2024-03-09T14:33:20.727 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.727+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=4K72LVBQFRXM tag=0VU24EJL2BXN type=write size=2637675 2024-03-09T14:33:20.728 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.728+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=YIXA136ZC933 type=del size=1501799 2024-03-09T14:33:20.729 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.730+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~G6MULW0IVBVM.0 size=478263 2024-03-09T14:33:20.731 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.732+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=G6MULW0IVBVM tag=3SPJ0UC0TAH9 type=write size=1526839 2024-03-09T14:33:20.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.733+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=RBXZAEJRUAXB type=del size=3176936 2024-03-09T14:33:20.733 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.734+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~WQIF3SSIMV8Z.0 size=117858 2024-03-09T14:33:20.735 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.736+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=WQIF3SSIMV8Z tag=HMR49VAH4I1Y type=write size=1166434 2024-03-09T14:33:20.737 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.738+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~HQ4MC4YC8F6Y.0 size=795947 2024-03-09T14:33:20.737 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.738+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=HQ4MC4YC8F6Y tag=8EQZZJ59Q64R type=write size=1844523 2024-03-09T14:33:20.738 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.739+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~DLO01VDLTVRZ.0 size=1048576 2024-03-09T14:33:20.739 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.740+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~DLO01VDLTVRZ.1 size=893041 2024-03-09T14:33:20.741 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.742+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=DLO01VDLTVRZ tag=8IRI238VFJ9S type=write size=2990193 2024-03-09T14:33:20.742 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.743+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=EDCIJTIVFQVH type=del size=2623814 2024-03-09T14:33:20.744 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.744+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~T7F81TEETI1P.0 size=1048576 2024-03-09T14:33:20.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.746+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~T7F81TEETI1P.1 size=435716 2024-03-09T14:33:20.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.748+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=T7F81TEETI1P tag=S3QPXMMVZOBO type=write size=2532868 2024-03-09T14:33:20.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.750+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~326LGUW0XGU9.0 size=351617 2024-03-09T14:33:20.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.750+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=326LGUW0XGU9 tag=UB5ZHZJJ8XXJ type=write size=1400193 2024-03-09T14:33:20.751 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.752+0000 7f586ae3d780 1 < completed write operation key=CZGAXNJ0GKU0 tag=B3ZZFM0N94Z0 type=write size=198701 2024-03-09T14:33:20.753 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.754+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~T6E1OQ0NJH3Y.0 size=631961 2024-03-09T14:33:20.753 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.754+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=T6E1OQ0NJH3Y tag=QKB5FYK1874Y type=write size=1680537 2024-03-09T14:33:20.755 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.755+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=MF1X1F9BS7PL type=del 2024-03-09T14:33:20.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.756+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=KJIJ673QQ0DR type=del size=1927633 2024-03-09T14:33:20.757 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.757+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~W157130UIV72.0 size=273734 2024-03-09T14:33:20.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.759+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=W157130UIV72 tag=OO66ACARMZ8H type=write size=1322310 2024-03-09T14:33:20.760 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.761+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=CN9ZGMB1M9VP type=del size=4174451 2024-03-09T14:33:20.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.762+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~E2EVRBNY5DDU.0 size=489394 2024-03-09T14:33:20.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.764+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=E2EVRBNY5DDU tag=K69MJJLUFKSH type=write size=1537970 2024-03-09T14:33:20.764 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.765+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=PEHVWVFOCYUW type=del size=1912808 2024-03-09T14:33:20.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.766+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=UTMA2ACC1YHV type=del 2024-03-09T14:33:20.767 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.767+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=KP68QTYX68I2 type=del size=2911130 2024-03-09T14:33:20.768 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.768+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=X19PXT90MQSF type=del 2024-03-09T14:33:20.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.770+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=U7IKTG4HL57V type=del size=697430 2024-03-09T14:33:20.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.772+0000 7f586ae3d780 1 < suggested remove operation key=UAYZ55UT77VE tag=TEMD1IPKRVX2 type=del 2024-03-09T14:33:20.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.773+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=K4IU3WOZREKQ type=del size=1327292 2024-03-09T14:33:20.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.774+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~RCE0PVIOML9W.0 size=1048576 2024-03-09T14:33:20.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.775+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~RCE0PVIOML9W.1 size=750459 2024-03-09T14:33:20.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.777+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=RCE0PVIOML9W tag=IOGG9OFY5VUI type=write size=2847611 2024-03-09T14:33:20.777 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.778+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=GS4FF4K8RDX0 type=del size=3685533 2024-03-09T14:33:20.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.779+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=DGZQIW22L737 type=del 2024-03-09T14:33:20.781 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.781+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~QQUADMXQ3TFQ.0 size=1048576 2024-03-09T14:33:20.781 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.782+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~QQUADMXQ3TFQ.1 size=916787 2024-03-09T14:33:20.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.782+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=QQUADMXQ3TFQ tag=ZY26QW2ZN7UD type=write size=3013939 2024-03-09T14:33:20.783 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.784+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=M2VFOVM2QDN3 type=del 2024-03-09T14:33:20.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.786+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~3CQS7URU1L03.0 size=1048576 2024-03-09T14:33:20.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.787+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~3CQS7URU1L03.1 size=82104 2024-03-09T14:33:20.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.787+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=3CQS7URU1L03 tag=K5R0CQH0Z5HC type=write size=2179256 2024-03-09T14:33:20.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.788+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=8LA64PBLQRMA type=del 2024-03-09T14:33:20.789 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.790+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~J8DWLD9LCFZX.0 size=554565 2024-03-09T14:33:20.789 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.790+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=J8DWLD9LCFZX tag=NHXWDJRP6G7W type=write size=1603141 2024-03-09T14:33:20.790 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.791+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=YIXA136ZC933 type=del 2024-03-09T14:33:20.792 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.792+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=I55U3FN6WDLI type=del size=2201673 2024-03-09T14:33:20.793 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.793+0000 7f586ae3d780 1 < canceled operation key=78Y2ZM3W6EUC tag=RBXZAEJRUAXB type=del size=3176936 2024-03-09T14:33:20.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.795+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~BTQZHPUY6EUS.0 size=1048576 2024-03-09T14:33:20.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.796+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~BTQZHPUY6EUS.1 size=1048576 2024-03-09T14:33:20.797 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.797+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~BTQZHPUY6EUS.2 size=949154 2024-03-09T14:33:20.797 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.797+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=BTQZHPUY6EUS tag=0W3E4QF3C9W2 type=write size=4094882 2024-03-09T14:33:20.798 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.798+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~HQ4MC4YC8F6Y.0 size=795947 2024-03-09T14:33:20.800 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.800+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=HQ4MC4YC8F6Y tag=8EQZZJ59Q64R type=write size=1844523 2024-03-09T14:33:20.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.801+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=9BPNYTZR2BRA type=del size=11423 2024-03-09T14:33:20.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.802+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=EDCIJTIVFQVH type=del 2024-03-09T14:33:20.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.805+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~E39TJ2PIGK10.0 size=1048576 2024-03-09T14:33:20.805 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.805+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~E39TJ2PIGK10.1 size=112745 2024-03-09T14:33:20.805 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.805+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=E39TJ2PIGK10 tag=K7ZZRO7BBJO1 type=write size=2209897 2024-03-09T14:33:20.806 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.807+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~326LGUW0XGU9.0 size=351617 2024-03-09T14:33:20.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.809+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=326LGUW0XGU9 tag=UB5ZHZJJ8XXJ type=write size=1400193 2024-03-09T14:33:20.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.810+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=Q3DKK59W9BEJ type=del size=1597048 2024-03-09T14:33:20.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.810+0000 7f586ae3d780 1 < canceled part key=_multipart_OU9IOY7J572N.2~T6E1OQ0NJH3Y.0 size=631961 2024-03-09T14:33:20.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.812+0000 7f586ae3d780 1 < canceled multipart upload key=OU9IOY7J572N upload=T6E1OQ0NJH3Y tag=QKB5FYK1874Y type=write size=1680537 2024-03-09T14:33:20.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.813+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=962INP6PUKCH type=del size=2529593 2024-03-09T14:33:20.814 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.814+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=KJIJ673QQ0DR type=del 2024-03-09T14:33:20.816 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.816+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~9NFFZ83W7ODU.0 size=967558 2024-03-09T14:33:20.816 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.816+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=9NFFZ83W7ODU tag=UJMOLLAS2CX9 type=write size=2016134 2024-03-09T14:33:20.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.817+0000 7f586ae3d780 1 < canceled operation key=0JDF7910RACF tag=CN9ZGMB1M9VP type=del size=4174451 2024-03-09T14:33:20.818 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.819+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=4C1QI1Q16Z9D type=write size=109894 2024-03-09T14:33:20.819 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.820+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=PEHVWVFOCYUW type=del 2024-03-09T14:33:20.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.822+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~50DUR8JPI6SH.0 size=1048576 2024-03-09T14:33:20.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.823+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~50DUR8JPI6SH.1 size=724567 2024-03-09T14:33:20.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.823+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=50DUR8JPI6SH tag=RG7H57BUR2IR type=write size=2821719 2024-03-09T14:33:20.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.824+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=KP68QTYX68I2 type=del 2024-03-09T14:33:20.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.826+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~IK26IF3DKY48.0 size=1048576 2024-03-09T14:33:20.826 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.827+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~IK26IF3DKY48.1 size=1048576 2024-03-09T14:33:20.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.828+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~IK26IF3DKY48.2 size=93987 2024-03-09T14:33:20.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.828+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=IK26IF3DKY48 tag=K3IP8GZ8KYPY type=write size=3239715 2024-03-09T14:33:20.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.829+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=U7IKTG4HL57V type=del 2024-03-09T14:33:20.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.830+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=IG8JAFZCAUI5 type=del size=1689307 2024-03-09T14:33:20.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.831+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=K4IU3WOZREKQ type=del 2024-03-09T14:33:20.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.832+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=CPAFUDBUPE7J type=write size=951642 2024-03-09T14:33:20.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.834+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=GS4FF4K8RDX0 type=del 2024-03-09T14:33:20.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.835+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=TH69D0T19300 type=del size=3421878 2024-03-09T14:33:20.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.835+0000 7f586ae3d780 1 < canceled part key=_multipart_WNVN3EOUUBGR.2~QQUADMXQ3TFQ.0 size=1048576 2024-03-09T14:33:20.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.836+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~QQUADMXQ3TFQ.1 size=916787 2024-03-09T14:33:20.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.838+0000 7f586ae3d780 1 < canceled multipart upload key=WNVN3EOUUBGR upload=QQUADMXQ3TFQ tag=ZY26QW2ZN7UD type=write size=3013939 2024-03-09T14:33:20.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.839+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=6FOJELQSMQJ1 type=del size=1509975 2024-03-09T14:33:20.840 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.841+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~3CQS7URU1L03.0 size=1048576 2024-03-09T14:33:20.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.842+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~3CQS7URU1L03.1 size=82104 2024-03-09T14:33:20.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.844+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=3CQS7URU1L03 tag=K5R0CQH0Z5HC type=write size=2179256 2024-03-09T14:33:20.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.845+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=WJ0QI96FRW5C type=write size=450907 2024-03-09T14:33:20.845 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.846+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~J8DWLD9LCFZX.0 size=554565 2024-03-09T14:33:20.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.848+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=J8DWLD9LCFZX tag=NHXWDJRP6G7W type=write size=1603141 2024-03-09T14:33:20.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.849+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=2QO5T84Q08H0 type=del size=3055635 2024-03-09T14:33:20.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.850+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=I55U3FN6WDLI type=del 2024-03-09T14:33:20.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.852+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~DDK0TM3Z6CMS.0 size=967614 2024-03-09T14:33:20.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.852+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=DDK0TM3Z6CMS tag=8KZ76PPODUCV type=write size=2016190 2024-03-09T14:33:20.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.854+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~BTQZHPUY6EUS.0 size=1048576 2024-03-09T14:33:20.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.855+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~BTQZHPUY6EUS.1 size=1048576 2024-03-09T14:33:20.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.856+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~BTQZHPUY6EUS.2 size=949154 2024-03-09T14:33:20.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.858+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=BTQZHPUY6EUS tag=0W3E4QF3C9W2 type=write size=4094882 2024-03-09T14:33:20.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.862+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~XPIS80NNATF9.0 size=1048576 2024-03-09T14:33:20.862 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.863+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~XPIS80NNATF9.1 size=1048576 2024-03-09T14:33:20.863 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.863+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~XPIS80NNATF9.2 size=298804 2024-03-09T14:33:20.863 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.863+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=XPIS80NNATF9 tag=9194BLTMPF8K type=write size=3444532 2024-03-09T14:33:20.865 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.865+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=9BPNYTZR2BRA type=del 2024-03-09T14:33:20.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.867+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~A0FFRIU6STRF.0 size=291188 2024-03-09T14:33:20.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.867+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=A0FFRIU6STRF tag=DLU1MYHL3KE2 type=write size=1339764 2024-03-09T14:33:20.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.867+0000 7f586ae3d780 1 < canceled part key=_multipart_57OR9DHRPDCZ.2~E39TJ2PIGK10.0 size=1048576 2024-03-09T14:33:20.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.868+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~E39TJ2PIGK10.1 size=112745 2024-03-09T14:33:20.869 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.870+0000 7f586ae3d780 1 < canceled multipart upload key=57OR9DHRPDCZ upload=E39TJ2PIGK10 tag=K7ZZRO7BBJO1 type=write size=2209897 2024-03-09T14:33:20.870 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.871+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=6RHDJIOIKO3S type=del size=1593230 2024-03-09T14:33:20.872 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.872+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=Q3DKK59W9BEJ type=del 2024-03-09T14:33:20.873 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.874+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~ABM8SWCA5KRE.0 size=1048576 2024-03-09T14:33:20.874 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.875+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~ABM8SWCA5KRE.1 size=1048576 2024-03-09T14:33:20.875 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.875+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~ABM8SWCA5KRE.2 size=993433 2024-03-09T14:33:20.875 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.875+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=ABM8SWCA5KRE tag=LFU47M43HVAW type=write size=4139161 2024-03-09T14:33:20.876 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.877+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=962INP6PUKCH type=del 2024-03-09T14:33:20.877 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.878+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=LXJBJUQ4BPW3 type=write size=1021617 2024-03-09T14:33:20.879 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.879+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~9NFFZ83W7ODU.0 size=967558 2024-03-09T14:33:20.880 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.881+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=9NFFZ83W7ODU tag=UJMOLLAS2CX9 type=write size=2016134 2024-03-09T14:33:20.882 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.882+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=NY3IJW5IUQDC type=write size=895494 2024-03-09T14:33:20.883 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.884+0000 7f586ae3d780 1 < completed write operation key=FNZ3BNA7W12E tag=4C1QI1Q16Z9D type=write size=109894 2024-03-09T14:33:20.885 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.886+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~7SJ4EQ147V1H.0 size=1048576 2024-03-09T14:33:20.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.887+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~7SJ4EQ147V1H.1 size=1048576 2024-03-09T14:33:20.887 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.888+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~7SJ4EQ147V1H.2 size=159924 2024-03-09T14:33:20.887 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.888+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=7SJ4EQ147V1H tag=11R5WQ5WXS1R type=write size=3305652 2024-03-09T14:33:20.888 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.889+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~50DUR8JPI6SH.0 size=1048576 2024-03-09T14:33:20.889 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.890+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~50DUR8JPI6SH.1 size=724567 2024-03-09T14:33:20.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.892+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=50DUR8JPI6SH tag=RG7H57BUR2IR type=write size=2821719 2024-03-09T14:33:20.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.893+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=D98SIYC4G2GM type=del size=2113081 2024-03-09T14:33:20.893 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.894+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~IK26IF3DKY48.0 size=1048576 2024-03-09T14:33:20.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.895+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~IK26IF3DKY48.1 size=1048576 2024-03-09T14:33:20.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.896+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~IK26IF3DKY48.2 size=93987 2024-03-09T14:33:20.897 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.898+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=IK26IF3DKY48 tag=K3IP8GZ8KYPY type=write size=3239715 2024-03-09T14:33:20.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.899+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=TR459VSZSVKF type=del size=3358533 2024-03-09T14:33:20.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.900+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=IG8JAFZCAUI5 type=del 2024-03-09T14:33:20.901 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.901+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=JQDB8WYPU7KG type=del size=2021579 2024-03-09T14:33:20.902 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.903+0000 7f586ae3d780 1 < completed write operation key=0JDF7910RACF tag=CPAFUDBUPE7J type=write size=951642 2024-03-09T14:33:20.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.904+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=JQCWK9WDJ1IG type=del size=3390337 2024-03-09T14:33:20.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.905+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=TH69D0T19300 type=del 2024-03-09T14:33:20.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.906+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=EQJ1YMIXRNQO type=del size=1748475 2024-03-09T14:33:20.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.908+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=6FOJELQSMQJ1 type=del 2024-03-09T14:33:20.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.909+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=S0Z6YP1BABQY type=del size=107203 2024-03-09T14:33:20.910 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.910+0000 7f586ae3d780 1 < completed write operation key=509F17DT0C4I tag=WJ0QI96FRW5C type=write size=450907 2024-03-09T14:33:20.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.913+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~VVNWQKB384DR.0 size=1048576 2024-03-09T14:33:20.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.914+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~VVNWQKB384DR.1 size=347776 2024-03-09T14:33:20.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.914+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=VVNWQKB384DR tag=SH5N3VT71QUL type=write size=2444928 2024-03-09T14:33:20.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.915+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=2QO5T84Q08H0 type=del 2024-03-09T14:33:20.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.916+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=ERPY1WCRZUAE type=del size=2119791 2024-03-09T14:33:20.917 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.918+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~DDK0TM3Z6CMS.0 size=967614 2024-03-09T14:33:20.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.920+0000 7f586ae3d780 1 < completed multipart upload key=UAYZ55UT77VE upload=DDK0TM3Z6CMS tag=8KZ76PPODUCV type=write size=2016190 2024-03-09T14:33:20.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.922+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~XGZB4HQN6GBF.0 size=429292 2024-03-09T14:33:20.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.922+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=XGZB4HQN6GBF tag=GP31ZNCFJH05 type=write size=1477868 2024-03-09T14:33:20.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.923+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~XPIS80NNATF9.0 size=1048576 2024-03-09T14:33:20.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.924+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~XPIS80NNATF9.1 size=1048576 2024-03-09T14:33:20.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.926+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~XPIS80NNATF9.2 size=298804 2024-03-09T14:33:20.927 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.928+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=XPIS80NNATF9 tag=9194BLTMPF8K type=write size=3444532 2024-03-09T14:33:20.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.929+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=0USD22ZJB0BP type=write size=861124 2024-03-09T14:33:20.930 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.930+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~A0FFRIU6STRF.0 size=291188 2024-03-09T14:33:20.932 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.932+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=A0FFRIU6STRF tag=DLU1MYHL3KE2 type=write size=1339764 2024-03-09T14:33:20.933 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.934+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=9B9SB5WBA415 type=del size=667670 2024-03-09T14:33:20.936 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.936+0000 7f586ae3d780 1 < suggested update operation key=NHIOOLNXLZZC tag=6RHDJIOIKO3S type=del size=1593230 2024-03-09T14:33:20.938 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.938+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~5D6ZYVJ9OQMC.0 size=650056 2024-03-09T14:33:20.938 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.938+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=5D6ZYVJ9OQMC tag=K1MZLL7X61RB type=write size=1698632 2024-03-09T14:33:20.939 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.939+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~ABM8SWCA5KRE.0 size=1048576 2024-03-09T14:33:20.940 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.940+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~ABM8SWCA5KRE.1 size=1048576 2024-03-09T14:33:20.941 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.941+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~ABM8SWCA5KRE.2 size=993433 2024-03-09T14:33:20.943 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.943+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=ABM8SWCA5KRE tag=LFU47M43HVAW type=write size=4139161 2024-03-09T14:33:20.944 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.944+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=JGF67838FDAM type=del size=2150268 2024-03-09T14:33:20.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.945+0000 7f586ae3d780 1 < completed write operation key=UAYZ55UT77VE tag=LXJBJUQ4BPW3 type=write size=1021617 2024-03-09T14:33:20.947 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.947+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~1DGLD53WOQV1.0 size=1048576 2024-03-09T14:33:20.948 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.948+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~1DGLD53WOQV1.1 size=1048576 2024-03-09T14:33:20.949 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.949+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~1DGLD53WOQV1.2 size=551858 2024-03-09T14:33:20.949 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.949+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=1DGLD53WOQV1 tag=PWV0LE03LTXN type=write size=3697586 2024-03-09T14:33:20.950 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.951+0000 7f586ae3d780 1 < completed write operation key=W4Q1MWHOQ4Y1 tag=NY3IJW5IUQDC type=write size=895494 2024-03-09T14:33:20.951 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.952+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=14OUD1YR8V6Y type=del size=2244791 2024-03-09T14:33:20.952 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.953+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~7SJ4EQ147V1H.0 size=1048576 2024-03-09T14:33:20.953 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.954+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~7SJ4EQ147V1H.1 size=1048576 2024-03-09T14:33:20.954 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.955+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~7SJ4EQ147V1H.2 size=159924 2024-03-09T14:33:20.956 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.957+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=7SJ4EQ147V1H tag=11R5WQ5WXS1R type=write size=3305652 2024-03-09T14:33:20.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.959+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~4KFP7S8B3M0U.0 size=302496 2024-03-09T14:33:20.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.959+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=4KFP7S8B3M0U tag=UMM9CW7TZSMR type=write size=1351072 2024-03-09T14:33:20.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.961+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=D98SIYC4G2GM type=del 2024-03-09T14:33:20.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.963+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~WE7MTNG4L51I.0 size=1048576 2024-03-09T14:33:20.963 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.964+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~WE7MTNG4L51I.1 size=1048576 2024-03-09T14:33:20.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.965+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~WE7MTNG4L51I.2 size=468633 2024-03-09T14:33:20.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.965+0000 7f586ae3d780 1 > prepared multipart upload key=C1UGQOQ6AE1E upload=WE7MTNG4L51I tag=HN48N0S9NV7I type=write size=3614361 2024-03-09T14:33:20.966 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.967+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=TR459VSZSVKF type=del 2024-03-09T14:33:20.967 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.968+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=A85K2FVKRZWH type=del size=4175984 2024-03-09T14:33:20.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.969+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=JQDB8WYPU7KG type=del 2024-03-09T14:33:20.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.971+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~G4W5ZS5QSX3H.0 size=1048576 2024-03-09T14:33:20.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.972+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~G4W5ZS5QSX3H.1 size=1048576 2024-03-09T14:33:20.972 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.973+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~G4W5ZS5QSX3H.2 size=1024221 2024-03-09T14:33:20.973 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.973+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=G4W5ZS5QSX3H tag=5VL5Y7VZ5ZII type=write size=4169949 2024-03-09T14:33:20.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.974+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=JQCWK9WDJ1IG type=del 2024-03-09T14:33:20.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.976+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~OBJNZVRE6E4B.0 size=1048576 2024-03-09T14:33:20.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.977+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~OBJNZVRE6E4B.1 size=1048576 2024-03-09T14:33:20.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.978+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~OBJNZVRE6E4B.2 size=82561 2024-03-09T14:33:20.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.978+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=OBJNZVRE6E4B tag=G8UBWMKBD6UP type=write size=3228289 2024-03-09T14:33:20.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.979+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=EQJ1YMIXRNQO type=del 2024-03-09T14:33:20.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.980+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=11S271IU34PY type=del size=2162475 2024-03-09T14:33:20.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.981+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=S0Z6YP1BABQY type=del 2024-03-09T14:33:20.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.984+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~FNF7NIJH3F9P.0 size=993665 2024-03-09T14:33:20.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.984+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=FNF7NIJH3F9P tag=Q7QIA1GOYV08 type=write size=2042241 2024-03-09T14:33:20.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.985+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~VVNWQKB384DR.0 size=1048576 2024-03-09T14:33:20.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.986+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~VVNWQKB384DR.1 size=347776 2024-03-09T14:33:20.987 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.988+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=VVNWQKB384DR tag=SH5N3VT71QUL type=write size=2444928 2024-03-09T14:33:20.989 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.989+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=BLLLNK5ITPZD type=del size=2099714 2024-03-09T14:33:20.990 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.990+0000 7f586ae3d780 -1 < failed to complete operation key=NHIOOLNXLZZC tag=ERPY1WCRZUAE type=del size=2119791: (22) Invalid argument 2024-03-09T14:33:20.991 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.991+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=RFRH0LXZG71S type=del size=3629328 2024-03-09T14:33:20.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.993+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~XGZB4HQN6GBF.0 size=429292 2024-03-09T14:33:20.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.995+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=XGZB4HQN6GBF tag=GP31ZNCFJH05 type=write size=1477868 2024-03-09T14:33:20.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.996+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=Y70X112RVBU0 type=write size=94556 2024-03-09T14:33:20.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:20.998+0000 7f586ae3d780 1 < suggested update operation key=9ZPCSBP3P58P tag=0USD22ZJB0BP type=write size=861124 2024-03-09T14:33:20.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.000+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=NJFICSPB30UD type=del size=3218369 2024-03-09T14:33:21.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.002+0000 7f586ae3d780 1 < suggested update operation key=IK528ND96157 tag=9B9SB5WBA415 type=del size=667670 2024-03-09T14:33:21.003 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.004+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~3N0NTG1JIIBV.0 size=673670 2024-03-09T14:33:21.003 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.004+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=3N0NTG1JIIBV tag=2AJ90ZJ3501H type=write size=1722246 2024-03-09T14:33:21.004 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.005+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~5D6ZYVJ9OQMC.0 size=650056 2024-03-09T14:33:21.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.007+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=5D6ZYVJ9OQMC tag=K1MZLL7X61RB type=write size=1698632 2024-03-09T14:33:21.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.009+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~6DKY4W9OOKIE.0 size=1048576 2024-03-09T14:33:21.009 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.010+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~6DKY4W9OOKIE.1 size=998048 2024-03-09T14:33:21.009 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.010+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=6DKY4W9OOKIE tag=7O8J0LZWBQLX type=write size=3095200 2024-03-09T14:33:21.010 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.011+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=JGF67838FDAM type=del 2024-03-09T14:33:21.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.013+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~4X032PWCTW5A.0 size=1048576 2024-03-09T14:33:21.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.014+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~4X032PWCTW5A.1 size=1048576 2024-03-09T14:33:21.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.015+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~4X032PWCTW5A.2 size=499776 2024-03-09T14:33:21.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.015+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=4X032PWCTW5A tag=10C3ZCPHNBID type=write size=3645504 2024-03-09T14:33:21.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.016+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~1DGLD53WOQV1.0 size=1048576 2024-03-09T14:33:21.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.017+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~1DGLD53WOQV1.1 size=1048576 2024-03-09T14:33:21.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.017+0000 7f586ae3d780 1 < canceled part key=_multipart_W3HTK2F8ML3V.2~1DGLD53WOQV1.2 size=551858 2024-03-09T14:33:21.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.019+0000 7f586ae3d780 1 < canceled multipart upload key=W3HTK2F8ML3V upload=1DGLD53WOQV1 tag=PWV0LE03LTXN type=write size=3697586 2024-03-09T14:33:21.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.021+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~HIR229EZCCQS.0 size=1048576 2024-03-09T14:33:21.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.022+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~HIR229EZCCQS.1 size=75046 2024-03-09T14:33:21.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.022+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=HIR229EZCCQS tag=8I0DKAPOFEKU type=write size=2172198 2024-03-09T14:33:21.024 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.025+0000 7f586ae3d780 1 < suggested remove operation key=BHSYRD3IEJWW tag=14OUD1YR8V6Y type=del 2024-03-09T14:33:21.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.026+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=UZSLBNCF2L1H type=del size=3144250 2024-03-09T14:33:21.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.027+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~4KFP7S8B3M0U.0 size=302496 2024-03-09T14:33:21.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.029+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=4KFP7S8B3M0U tag=UMM9CW7TZSMR type=write size=1351072 2024-03-09T14:33:21.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.030+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=YWDRTQSIJ3WO type=del size=4115407 2024-03-09T14:33:21.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.032+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~WE7MTNG4L51I.0 size=1048576 2024-03-09T14:33:21.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.033+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~WE7MTNG4L51I.1 size=1048576 2024-03-09T14:33:21.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.034+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~WE7MTNG4L51I.2 size=468633 2024-03-09T14:33:21.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.036+0000 7f586ae3d780 1 < completed multipart upload key=C1UGQOQ6AE1E upload=WE7MTNG4L51I tag=HN48N0S9NV7I type=write size=3614361 2024-03-09T14:33:21.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.038+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~43SP6HD5X4TM.0 size=1048576 2024-03-09T14:33:21.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.039+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~43SP6HD5X4TM.1 size=1048576 2024-03-09T14:33:21.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.040+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~43SP6HD5X4TM.2 size=811938 2024-03-09T14:33:21.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.040+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=43SP6HD5X4TM tag=FDF28Q4BX93P type=write size=3957666 2024-03-09T14:33:21.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.041+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=A85K2FVKRZWH type=del 2024-03-09T14:33:21.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.042+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=12ADY2PS8MC5 type=del size=2223849 2024-03-09T14:33:21.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.044+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~G4W5ZS5QSX3H.0 size=1048576 2024-03-09T14:33:21.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.045+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~G4W5ZS5QSX3H.1 size=1048576 2024-03-09T14:33:21.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.046+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~G4W5ZS5QSX3H.2 size=1024221 2024-03-09T14:33:21.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.048+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=G4W5ZS5QSX3H tag=5VL5Y7VZ5ZII type=write size=4169949 2024-03-09T14:33:21.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.049+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=TVQSFMY51X7J type=del size=2689446 2024-03-09T14:33:21.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.050+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~OBJNZVRE6E4B.0 size=1048576 2024-03-09T14:33:21.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.051+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~OBJNZVRE6E4B.1 size=1048576 2024-03-09T14:33:21.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.052+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~OBJNZVRE6E4B.2 size=82561 2024-03-09T14:33:21.053 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.054+0000 7f586ae3d780 1 < completed multipart upload key=LRI2GKBGVCWW upload=OBJNZVRE6E4B tag=G8UBWMKBD6UP type=write size=3228289 2024-03-09T14:33:21.055 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.055+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=7A4S8TDK1OM2 type=write size=427449 2024-03-09T14:33:21.056 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.057+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=11S271IU34PY type=del 2024-03-09T14:33:21.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.058+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=5QFRACYGEA3P type=write size=356347 2024-03-09T14:33:21.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.059+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~FNF7NIJH3F9P.0 size=993665 2024-03-09T14:33:21.061 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.061+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=FNF7NIJH3F9P tag=Q7QIA1GOYV08 type=write size=2042241 2024-03-09T14:33:21.062 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.063+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=LP6XLX1YQX0J type=del size=4070281 2024-03-09T14:33:21.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.065+0000 7f586ae3d780 1 < suggested update operation key=6YWLPUULN5SY tag=BLLLNK5ITPZD type=del size=2099714 2024-03-09T14:33:21.066 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.066+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=K4W4SHNTMVRY type=del size=3119635 2024-03-09T14:33:21.068 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.069+0000 7f586ae3d780 1 < suggested remove operation key=CAISZZZSOD34 tag=RFRH0LXZG71S type=del 2024-03-09T14:33:21.070 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.070+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=3RFAWT4WCWDQ type=write size=865607 2024-03-09T14:33:21.071 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.071+0000 7f586ae3d780 1 < completed write operation key=2BUCMVWK7J1V tag=Y70X112RVBU0 type=write size=94556 2024-03-09T14:33:21.072 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.073+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=C6337MLSYSG0 type=del size=3986409 2024-03-09T14:33:21.073 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.074+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=NJFICSPB30UD type=del 2024-03-09T14:33:21.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.076+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~G03SGPVYF0Y8.0 size=1048576 2024-03-09T14:33:21.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.078+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~G03SGPVYF0Y8.1 size=1048576 2024-03-09T14:33:21.078 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.079+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~G03SGPVYF0Y8.2 size=24482 2024-03-09T14:33:21.078 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.079+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=G03SGPVYF0Y8 tag=LGG7COW8J7BT type=write size=3170210 2024-03-09T14:33:21.080 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.080+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~3N0NTG1JIIBV.0 size=673670 2024-03-09T14:33:21.082 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.082+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=3N0NTG1JIIBV tag=2AJ90ZJ3501H type=write size=1722246 2024-03-09T14:33:21.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.083+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=DZHAASB7U9RV type=del size=1971968 2024-03-09T14:33:21.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.085+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~6DKY4W9OOKIE.0 size=1048576 2024-03-09T14:33:21.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.086+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~6DKY4W9OOKIE.1 size=998048 2024-03-09T14:33:21.087 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.088+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=6DKY4W9OOKIE tag=7O8J0LZWBQLX type=write size=3095200 2024-03-09T14:33:21.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.089+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=ZQUAXFOUYRRM type=del size=3761558 2024-03-09T14:33:21.089 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.090+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~4X032PWCTW5A.0 size=1048576 2024-03-09T14:33:21.090 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.090+0000 7f586ae3d780 1 < canceled part key=_multipart_UAYZ55UT77VE.2~4X032PWCTW5A.1 size=1048576 2024-03-09T14:33:21.090 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.091+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~4X032PWCTW5A.2 size=499776 2024-03-09T14:33:21.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.093+0000 7f586ae3d780 1 < canceled multipart upload key=UAYZ55UT77VE upload=4X032PWCTW5A tag=10C3ZCPHNBID type=write size=3645504 2024-03-09T14:33:21.094 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.095+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~84ZJJR15N6PW.0 size=1048576 2024-03-09T14:33:21.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.096+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~84ZJJR15N6PW.1 size=1048576 2024-03-09T14:33:21.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.097+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~84ZJJR15N6PW.2 size=118864 2024-03-09T14:33:21.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.097+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=84ZJJR15N6PW tag=3LS141TQKCVQ type=write size=3264592 2024-03-09T14:33:21.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.098+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~HIR229EZCCQS.0 size=1048576 2024-03-09T14:33:21.098 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.099+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~HIR229EZCCQS.1 size=75046 2024-03-09T14:33:21.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.101+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=HIR229EZCCQS tag=8I0DKAPOFEKU type=write size=2172198 2024-03-09T14:33:21.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.102+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=ULL1DOUYQ05T type=del size=774849 2024-03-09T14:33:21.102 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.103+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=UZSLBNCF2L1H type=del 2024-03-09T14:33:21.103 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.104+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=M9G8D6IFSXTD type=del size=81769 2024-03-09T14:33:21.105 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.105+0000 7f586ae3d780 1 < canceled operation key=509F17DT0C4I tag=YWDRTQSIJ3WO type=del size=4115407 2024-03-09T14:33:21.107 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.107+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~AZ2Q3AJC0RIN.0 size=1048576 2024-03-09T14:33:21.107 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.108+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~AZ2Q3AJC0RIN.1 size=202442 2024-03-09T14:33:21.108 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.108+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=AZ2Q3AJC0RIN tag=Z90GGAZVIGAF type=write size=2299594 2024-03-09T14:33:21.109 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.109+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~43SP6HD5X4TM.0 size=1048576 2024-03-09T14:33:21.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.110+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~43SP6HD5X4TM.1 size=1048576 2024-03-09T14:33:21.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.111+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~43SP6HD5X4TM.2 size=811938 2024-03-09T14:33:21.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.113+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=43SP6HD5X4TM tag=FDF28Q4BX93P type=write size=3957666 2024-03-09T14:33:21.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.115+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~TB0RRP8COAQ9.0 size=1048576 2024-03-09T14:33:21.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.116+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~TB0RRP8COAQ9.1 size=1048576 2024-03-09T14:33:21.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.117+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~TB0RRP8COAQ9.2 size=941155 2024-03-09T14:33:21.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.117+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=TB0RRP8COAQ9 tag=FNFEK0C84P0Y type=write size=4086883 2024-03-09T14:33:21.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.118+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=12ADY2PS8MC5 type=del 2024-03-09T14:33:21.119 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.119+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=N15FDDK7COVL type=del size=1746053 2024-03-09T14:33:21.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.120+0000 7f586ae3d780 -1 < failed to complete operation key=6YWLPUULN5SY tag=TVQSFMY51X7J type=del size=2689446: (22) Invalid argument 2024-03-09T14:33:21.121 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.121+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=OQPV5ZDR96JF type=del size=1758154 2024-03-09T14:33:21.122 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.123+0000 7f586ae3d780 1 < completed write operation key=WNVN3EOUUBGR tag=7A4S8TDK1OM2 type=write size=427449 2024-03-09T14:33:21.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.125+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~ZUXWCFZU3S6D.0 size=1048576 2024-03-09T14:33:21.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.126+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~ZUXWCFZU3S6D.1 size=301924 2024-03-09T14:33:21.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.126+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=ZUXWCFZU3S6D tag=WGPLVR6UHCAG type=write size=2399076 2024-03-09T14:33:21.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.127+0000 7f586ae3d780 1 < completed write operation key=DJH53FNVMLGY tag=5QFRACYGEA3P type=write size=356347 2024-03-09T14:33:21.128 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.129+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~5WTY317U2JCR.0 size=916782 2024-03-09T14:33:21.128 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.129+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=5WTY317U2JCR tag=2DN8ZPTXADQT type=write size=1965358 2024-03-09T14:33:21.129 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.130+0000 7f586ae3d780 1 < canceled operation key=LRI2GKBGVCWW tag=LP6XLX1YQX0J type=del size=4070281 2024-03-09T14:33:21.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.131+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=187LZFSVATPL type=del size=2088830 2024-03-09T14:33:21.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.132+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=K4W4SHNTMVRY type=del 2024-03-09T14:33:21.133 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.133+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=FATQOON2H7MU type=write size=1030539 2024-03-09T14:33:21.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.135+0000 7f586ae3d780 1 < completed write operation key=6YWLPUULN5SY tag=3RFAWT4WCWDQ type=write size=865607 2024-03-09T14:33:21.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.136+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=AC0X6NH9AV3Y type=del size=3507671 2024-03-09T14:33:21.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.138+0000 7f586ae3d780 1 < suggested update operation key=5PERWGS0GOJU tag=C6337MLSYSG0 type=del size=3986409 2024-03-09T14:33:21.139 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.139+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=2PIONGV5P0AV type=del size=166943 2024-03-09T14:33:21.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.140+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~G03SGPVYF0Y8.0 size=1048576 2024-03-09T14:33:21.141 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.142+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~G03SGPVYF0Y8.1 size=1048576 2024-03-09T14:33:21.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.142+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~G03SGPVYF0Y8.2 size=24482 2024-03-09T14:33:21.144 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.144+0000 7f586ae3d780 1 < completed multipart upload key=IK528ND96157 upload=G03SGPVYF0Y8 tag=LGG7COW8J7BT type=write size=3170210 2024-03-09T14:33:21.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.146+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~SBTUOYIB2K8M.0 size=1048576 2024-03-09T14:33:21.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.147+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~SBTUOYIB2K8M.1 size=63327 2024-03-09T14:33:21.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.147+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=SBTUOYIB2K8M tag=EA0YIKO3TQ9P type=write size=2160479 2024-03-09T14:33:21.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.148+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=DZHAASB7U9RV type=del 2024-03-09T14:33:21.149 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.149+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=O5HOHE4AI26P type=write size=308258 2024-03-09T14:33:21.150 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.151+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=ZQUAXFOUYRRM type=del 2024-03-09T14:33:21.151 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.152+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=0BBAZGAU832W type=del size=3148665 2024-03-09T14:33:21.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.153+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~84ZJJR15N6PW.0 size=1048576 2024-03-09T14:33:21.153 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.154+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~84ZJJR15N6PW.1 size=1048576 2024-03-09T14:33:21.154 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.155+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~84ZJJR15N6PW.2 size=118864 2024-03-09T14:33:21.156 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.157+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=84ZJJR15N6PW tag=3LS141TQKCVQ type=write size=3264592 2024-03-09T14:33:21.157 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.158+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=S10IS97R8EVP type=del size=2562570 2024-03-09T14:33:21.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.159+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=ULL1DOUYQ05T type=del 2024-03-09T14:33:21.160 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.160+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=2AJZS4AXE9FC type=del size=1408606 2024-03-09T14:33:21.161 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.161+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=M9G8D6IFSXTD type=del 2024-03-09T14:33:21.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.164+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~0JIPU084TAEJ.0 size=1048576 2024-03-09T14:33:21.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.165+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~0JIPU084TAEJ.1 size=26111 2024-03-09T14:33:21.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.165+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=0JIPU084TAEJ tag=OT05QEUO5OX3 type=write size=2123263 2024-03-09T14:33:21.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.166+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~AZ2Q3AJC0RIN.0 size=1048576 2024-03-09T14:33:21.166 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.166+0000 7f586ae3d780 1 < canceled part key=_multipart_NHIOOLNXLZZC.2~AZ2Q3AJC0RIN.1 size=202442 2024-03-09T14:33:21.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.168+0000 7f586ae3d780 1 < canceled multipart upload key=NHIOOLNXLZZC upload=AZ2Q3AJC0RIN tag=Z90GGAZVIGAF type=write size=2299594 2024-03-09T14:33:21.169 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.170+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~W1UYSTHKSCXZ.0 size=1048576 2024-03-09T14:33:21.170 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.171+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~W1UYSTHKSCXZ.1 size=311993 2024-03-09T14:33:21.170 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.171+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=W1UYSTHKSCXZ tag=N7M4HXIYVXIX type=write size=2409145 2024-03-09T14:33:21.171 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.172+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~TB0RRP8COAQ9.0 size=1048576 2024-03-09T14:33:21.172 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.173+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~TB0RRP8COAQ9.1 size=1048576 2024-03-09T14:33:21.173 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.174+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~TB0RRP8COAQ9.2 size=941155 2024-03-09T14:33:21.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.176+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=TB0RRP8COAQ9 tag=FNFEK0C84P0Y type=write size=4086883 2024-03-09T14:33:21.176 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.177+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=YOB6ELWC9I8M type=write size=417728 2024-03-09T14:33:21.177 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.178+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=N15FDDK7COVL type=del 2024-03-09T14:33:21.179 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.180+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~YRVWW9D158XN.0 size=1048576 2024-03-09T14:33:21.180 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.181+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~YRVWW9D158XN.1 size=231025 2024-03-09T14:33:21.180 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.181+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=YRVWW9D158XN tag=3O0QAAJRP62T type=write size=2328177 2024-03-09T14:33:21.181 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.182+0000 7f586ae3d780 1 < canceled operation key=39ZIGOC6JZ1R tag=OQPV5ZDR96JF type=del size=1758154 2024-03-09T14:33:21.183 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.184+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=BLV1EW1IMLA8 type=write size=834133 2024-03-09T14:33:21.184 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.185+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~ZUXWCFZU3S6D.0 size=1048576 2024-03-09T14:33:21.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.186+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~ZUXWCFZU3S6D.1 size=301924 2024-03-09T14:33:21.187 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.188+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=ZUXWCFZU3S6D tag=WGPLVR6UHCAG type=write size=2399076 2024-03-09T14:33:21.189 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.189+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=3GF5XQQBQ0M3 type=del size=1686238 2024-03-09T14:33:21.190 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.190+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~5WTY317U2JCR.0 size=916782 2024-03-09T14:33:21.192 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.192+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=5WTY317U2JCR tag=2DN8ZPTXADQT type=write size=1965358 2024-03-09T14:33:21.194 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.194+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~8MU6LOEJRFHW.0 size=1048576 2024-03-09T14:33:21.195 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.195+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~8MU6LOEJRFHW.1 size=1048576 2024-03-09T14:33:21.195 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.196+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~8MU6LOEJRFHW.2 size=929797 2024-03-09T14:33:21.196 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.196+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=8MU6LOEJRFHW tag=ZVM18AI0QEIU type=write size=4075525 2024-03-09T14:33:21.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.198+0000 7f586ae3d780 1 < suggested update operation key=CAISZZZSOD34 tag=187LZFSVATPL type=del size=2088830 2024-03-09T14:33:21.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.200+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~GL4SSP4LS2D9.0 size=1048576 2024-03-09T14:33:21.201 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.201+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~GL4SSP4LS2D9.1 size=580819 2024-03-09T14:33:21.201 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.201+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=GL4SSP4LS2D9 tag=8D0LTQ5FHLK9 type=write size=2677971 2024-03-09T14:33:21.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.203+0000 7f586ae3d780 1 < completed write operation key=CZGAXNJ0GKU0 tag=FATQOON2H7MU type=write size=1030539 2024-03-09T14:33:21.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.204+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=BLRXPI2M7DXA type=del size=4069360 2024-03-09T14:33:21.204 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.205+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=AC0X6NH9AV3Y type=del 2024-03-09T14:33:21.207 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.207+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~PDKUKT09XBD7.0 size=238667 2024-03-09T14:33:21.207 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.207+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=PDKUKT09XBD7 tag=KABYSOSD6DEZ type=write size=1287243 2024-03-09T14:33:21.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.208+0000 7f586ae3d780 1 < canceled operation key=LRI2GKBGVCWW tag=2PIONGV5P0AV type=del size=166943 2024-03-09T14:33:21.209 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.210+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=2ROHZH10653W type=del size=3121620 2024-03-09T14:33:21.210 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.211+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~SBTUOYIB2K8M.0 size=1048576 2024-03-09T14:33:21.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.212+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~SBTUOYIB2K8M.1 size=63327 2024-03-09T14:33:21.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.214+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=SBTUOYIB2K8M tag=EA0YIKO3TQ9P type=write size=2160479 2024-03-09T14:33:21.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.215+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=3FS889HJHNG4 type=del size=1821520 2024-03-09T14:33:21.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.216+0000 7f586ae3d780 1 < completed write operation key=C1UGQOQ6AE1E tag=O5HOHE4AI26P type=write size=308258 2024-03-09T14:33:21.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.217+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=QBT7QMTAFPS4 type=del size=1325765 2024-03-09T14:33:21.218 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.219+0000 7f586ae3d780 1 < canceled operation key=509F17DT0C4I tag=0BBAZGAU832W type=del size=3148665 2024-03-09T14:33:21.219 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.220+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=L1N33LKZJB67 type=del size=2883828 2024-03-09T14:33:21.222 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.222+0000 7f586ae3d780 1 < suggested remove operation key=UO072H74SHLP tag=S10IS97R8EVP type=del 2024-03-09T14:33:21.223 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.223+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=KM22DG2MAH33 type=del size=3829543 2024-03-09T14:33:21.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.224+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=2AJZS4AXE9FC type=del 2024-03-09T14:33:21.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.226+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=RWMMH7J15PJA type=del size=2355383 2024-03-09T14:33:21.226 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.227+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~0JIPU084TAEJ.0 size=1048576 2024-03-09T14:33:21.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.228+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~0JIPU084TAEJ.1 size=26111 2024-03-09T14:33:21.229 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.230+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=0JIPU084TAEJ tag=OT05QEUO5OX3 type=write size=2123263 2024-03-09T14:33:21.230 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.231+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=V4TK5ZJ43E0S type=del size=1664376 2024-03-09T14:33:21.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.232+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~W1UYSTHKSCXZ.0 size=1048576 2024-03-09T14:33:21.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.233+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~W1UYSTHKSCXZ.1 size=311993 2024-03-09T14:33:21.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.235+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=W1UYSTHKSCXZ tag=N7M4HXIYVXIX type=write size=2409145 2024-03-09T14:33:21.236 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.236+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=IT9P9IW3OBY3 type=del size=3373555 2024-03-09T14:33:21.237 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.237+0000 7f586ae3d780 1 < completed write operation key=6YWLPUULN5SY tag=YOB6ELWC9I8M type=write size=417728 2024-03-09T14:33:21.242 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.239+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~IS3IJZHKJQP6.0 size=1048576 2024-03-09T14:33:21.242 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.240+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~IS3IJZHKJQP6.1 size=1048576 2024-03-09T14:33:21.242 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.241+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~IS3IJZHKJQP6.2 size=232460 2024-03-09T14:33:21.242 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.241+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=IS3IJZHKJQP6 tag=9RNIO83ZSZCE type=write size=3378188 2024-03-09T14:33:21.242 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.243+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~YRVWW9D158XN.0 size=1048576 2024-03-09T14:33:21.243 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.244+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~YRVWW9D158XN.1 size=231025 2024-03-09T14:33:21.245 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.246+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=YRVWW9D158XN tag=3O0QAAJRP62T type=write size=2328177 2024-03-09T14:33:21.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.247+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=P6CJSWQG0Z4J type=del size=2101078 2024-03-09T14:33:21.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.248+0000 7f586ae3d780 1 < completed write operation key=2BUCMVWK7J1V tag=BLV1EW1IMLA8 type=write size=834133 2024-03-09T14:33:21.250 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.250+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~CEO2WUAC2NKI.0 size=1048576 2024-03-09T14:33:21.251 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.251+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~CEO2WUAC2NKI.1 size=1048576 2024-03-09T14:33:21.252 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.252+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~CEO2WUAC2NKI.2 size=484843 2024-03-09T14:33:21.252 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.252+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=CEO2WUAC2NKI tag=7I96CHCPWJD1 type=write size=3630571 2024-03-09T14:33:21.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.253+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=3GF5XQQBQ0M3 type=del 2024-03-09T14:33:21.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.254+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=28XA9SJ3ASR1 type=del size=3790205 2024-03-09T14:33:21.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.255+0000 7f586ae3d780 1 < canceled part key=_multipart_57OR9DHRPDCZ.2~8MU6LOEJRFHW.0 size=1048576 2024-03-09T14:33:21.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.256+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~8MU6LOEJRFHW.1 size=1048576 2024-03-09T14:33:21.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.256+0000 7f586ae3d780 1 < canceled part key=_multipart_57OR9DHRPDCZ.2~8MU6LOEJRFHW.2 size=929797 2024-03-09T14:33:21.257 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.258+0000 7f586ae3d780 1 < canceled multipart upload key=57OR9DHRPDCZ upload=8MU6LOEJRFHW tag=ZVM18AI0QEIU type=write size=4075525 2024-03-09T14:33:21.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.260+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~0JZKF7VS6GOT.0 size=1048576 2024-03-09T14:33:21.260 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.261+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~0JZKF7VS6GOT.1 size=1048576 2024-03-09T14:33:21.261 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.262+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~0JZKF7VS6GOT.2 size=825072 2024-03-09T14:33:21.261 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.262+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=0JZKF7VS6GOT tag=3H4IQTXKS3WB type=write size=3970800 2024-03-09T14:33:21.262 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.263+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~GL4SSP4LS2D9.0 size=1048576 2024-03-09T14:33:21.263 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.264+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~GL4SSP4LS2D9.1 size=580819 2024-03-09T14:33:21.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.266+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=GL4SSP4LS2D9 tag=8D0LTQ5FHLK9 type=write size=2677971 2024-03-09T14:33:21.268 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.269+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~IYTR5GCTP2O1.0 size=1048576 2024-03-09T14:33:21.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.269+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~IYTR5GCTP2O1.1 size=1048576 2024-03-09T14:33:21.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.270+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~IYTR5GCTP2O1.2 size=599861 2024-03-09T14:33:21.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.270+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=IYTR5GCTP2O1 tag=G411DNY120PL type=write size=3745589 2024-03-09T14:33:21.271 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.272+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=BLRXPI2M7DXA type=del 2024-03-09T14:33:21.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.273+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=GO1Q4C8YE8NU type=del size=2516035 2024-03-09T14:33:21.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.274+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~PDKUKT09XBD7.0 size=238667 2024-03-09T14:33:21.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.276+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=PDKUKT09XBD7 tag=KABYSOSD6DEZ type=write size=1287243 2024-03-09T14:33:21.277 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.277+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=CM5HP03W0FMM type=write size=306768 2024-03-09T14:33:21.278 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.278+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=2ROHZH10653W type=del 2024-03-09T14:33:21.279 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.280+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=9FZORBUEESEK type=write size=682360 2024-03-09T14:33:21.280 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.281+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=3FS889HJHNG4 type=del 2024-03-09T14:33:21.281 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.282+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=DCQ2RN58C0CV type=del size=2231724 2024-03-09T14:33:21.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.285+0000 7f586ae3d780 1 < suggested remove operation key=P3OUIQNAK1TC tag=QBT7QMTAFPS4 type=del 2024-03-09T14:33:21.285 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.286+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=NQJRFN1VJKAX type=del size=2660604 2024-03-09T14:33:21.287 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.287+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=L1N33LKZJB67 type=del 2024-03-09T14:33:21.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.290+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~A4DDE6UNTB1Y.0 size=1048576 2024-03-09T14:33:21.290 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.290+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~A4DDE6UNTB1Y.1 size=1048576 2024-03-09T14:33:21.291 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.292+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~A4DDE6UNTB1Y.2 size=788888 2024-03-09T14:33:21.291 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.292+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=A4DDE6UNTB1Y tag=3ZC0097BLAS1 type=write size=3934616 2024-03-09T14:33:21.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.293+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=KM22DG2MAH33 type=del 2024-03-09T14:33:21.294 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.295+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=0J88WQZ5NP0A type=del size=1205461 2024-03-09T14:33:21.295 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.296+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=RWMMH7J15PJA type=del 2024-03-09T14:33:21.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.297+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=T05M0TGLUXU7 type=del size=3971654 2024-03-09T14:33:21.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.298+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=V4TK5ZJ43E0S type=del 2024-03-09T14:33:21.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.299+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=2FP360C08S5K type=del size=1646452 2024-03-09T14:33:21.300 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.300+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=IT9P9IW3OBY3 type=del 2024-03-09T14:33:21.301 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.301+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=5UVL2DRJIR61 type=del size=206826 2024-03-09T14:33:21.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.303+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~IS3IJZHKJQP6.0 size=1048576 2024-03-09T14:33:21.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.303+0000 7f586ae3d780 1 < canceled part key=_multipart_CAISZZZSOD34.2~IS3IJZHKJQP6.1 size=1048576 2024-03-09T14:33:21.303 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.304+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~IS3IJZHKJQP6.2 size=232460 2024-03-09T14:33:21.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.306+0000 7f586ae3d780 1 < canceled multipart upload key=CAISZZZSOD34 upload=IS3IJZHKJQP6 tag=9RNIO83ZSZCE type=write size=3378188 2024-03-09T14:33:21.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.307+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=G83N3AYUAGV5 type=write size=464977 2024-03-09T14:33:21.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.308+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=P6CJSWQG0Z4J type=del 2024-03-09T14:33:21.308 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.309+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=K2C8CNBCAUHU type=del size=4145706 2024-03-09T14:33:21.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.310+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~CEO2WUAC2NKI.0 size=1048576 2024-03-09T14:33:21.311 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.311+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~CEO2WUAC2NKI.1 size=1048576 2024-03-09T14:33:21.312 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.312+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~CEO2WUAC2NKI.2 size=484843 2024-03-09T14:33:21.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.314+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=CEO2WUAC2NKI tag=7I96CHCPWJD1 type=write size=3630571 2024-03-09T14:33:21.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.315+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=SRY20HRO61Z1 type=del size=1266427 2024-03-09T14:33:21.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.316+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=28XA9SJ3ASR1 type=del 2024-03-09T14:33:21.317 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.317+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=NYKBRNG2RT3E type=del size=3140302 2024-03-09T14:33:21.318 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.319+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~0JZKF7VS6GOT.0 size=1048576 2024-03-09T14:33:21.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.320+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~0JZKF7VS6GOT.1 size=1048576 2024-03-09T14:33:21.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.321+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~0JZKF7VS6GOT.2 size=825072 2024-03-09T14:33:21.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.323+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=0JZKF7VS6GOT tag=3H4IQTXKS3WB type=write size=3970800 2024-03-09T14:33:21.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.324+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=R5YBCNHJKUV2 type=del size=3061390 2024-03-09T14:33:21.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.325+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~IYTR5GCTP2O1.0 size=1048576 2024-03-09T14:33:21.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.325+0000 7f586ae3d780 1 < canceled part key=_multipart_UAYZ55UT77VE.2~IYTR5GCTP2O1.1 size=1048576 2024-03-09T14:33:21.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.326+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~IYTR5GCTP2O1.2 size=599861 2024-03-09T14:33:21.327 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.328+0000 7f586ae3d780 1 < canceled multipart upload key=UAYZ55UT77VE upload=IYTR5GCTP2O1 tag=G411DNY120PL type=write size=3745589 2024-03-09T14:33:21.329 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.330+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~5KMRP7TEHXVF.0 size=346886 2024-03-09T14:33:21.329 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.330+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=5KMRP7TEHXVF tag=QM4P4TS2A82K type=write size=1395462 2024-03-09T14:33:21.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.331+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=GO1Q4C8YE8NU type=del 2024-03-09T14:33:21.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.332+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=R2O02P6M213Z type=del size=1640540 2024-03-09T14:33:21.333 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.333+0000 7f586ae3d780 1 < completed write operation key=UKPSUQ6LYWN8 tag=CM5HP03W0FMM type=write size=306768 2024-03-09T14:33:21.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.335+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=M2SHX40TJTUD type=del size=92795 2024-03-09T14:33:21.337 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.337+0000 7f586ae3d780 1 < suggested update operation key=CZGAXNJ0GKU0 tag=9FZORBUEESEK type=write size=682360 2024-03-09T14:33:21.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.339+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=DVGTVHXL4L7J type=del size=4897 2024-03-09T14:33:21.340 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.340+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=DCQ2RN58C0CV type=del 2024-03-09T14:33:21.342 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.342+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~XCWT8AT3Q1HJ.0 size=1048576 2024-03-09T14:33:21.342 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.343+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~XCWT8AT3Q1HJ.1 size=1048576 2024-03-09T14:33:21.343 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.344+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~XCWT8AT3Q1HJ.2 size=640657 2024-03-09T14:33:21.344 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.344+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=XCWT8AT3Q1HJ tag=4QUFCCMASJW6 type=write size=3786385 2024-03-09T14:33:21.345 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.345+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=NQJRFN1VJKAX type=del 2024-03-09T14:33:21.346 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.346+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=65RQGM0KTHMY type=del size=1372860 2024-03-09T14:33:21.347 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.347+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~A4DDE6UNTB1Y.0 size=1048576 2024-03-09T14:33:21.348 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.348+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~A4DDE6UNTB1Y.1 size=1048576 2024-03-09T14:33:21.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.349+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~A4DDE6UNTB1Y.2 size=788888 2024-03-09T14:33:21.351 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.351+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=A4DDE6UNTB1Y tag=3ZC0097BLAS1 type=write size=3934616 2024-03-09T14:33:21.353 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.353+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~DGAOLII6YOCD.0 size=1048576 2024-03-09T14:33:21.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.354+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~DGAOLII6YOCD.1 size=854269 2024-03-09T14:33:21.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.354+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=DGAOLII6YOCD tag=DVPLQ9G93JP5 type=write size=2951421 2024-03-09T14:33:21.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.356+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=0J88WQZ5NP0A type=del 2024-03-09T14:33:21.357 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.358+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~39QQY3UU6QYT.0 size=506272 2024-03-09T14:33:21.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.358+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=39QQY3UU6QYT tag=LXRMDXKR300F type=write size=1554848 2024-03-09T14:33:21.360 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.360+0000 7f586ae3d780 1 < suggested remove operation key=LRI2GKBGVCWW tag=T05M0TGLUXU7 type=del 2024-03-09T14:33:21.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.363+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~O2ZQ2E72FQVB.0 size=1048576 2024-03-09T14:33:21.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.364+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~O2ZQ2E72FQVB.1 size=648455 2024-03-09T14:33:21.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.364+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=O2ZQ2E72FQVB tag=1HNI4ZANOUT3 type=write size=2745607 2024-03-09T14:33:21.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.365+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=2FP360C08S5K type=del 2024-03-09T14:33:21.366 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.367+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~E5FN8IQB1SHT.0 size=1048576 2024-03-09T14:33:21.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.368+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~E5FN8IQB1SHT.1 size=335346 2024-03-09T14:33:21.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.368+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=E5FN8IQB1SHT tag=1P9K0LREWSLG type=write size=2432498 2024-03-09T14:33:21.370 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.370+0000 7f586ae3d780 1 < suggested remove operation key=IK528ND96157 tag=5UVL2DRJIR61 type=del 2024-03-09T14:33:21.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.371+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=J09JBCJKPZO6 type=del size=613061 2024-03-09T14:33:21.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.373+0000 7f586ae3d780 1 < completed write operation key=6YWLPUULN5SY tag=G83N3AYUAGV5 type=write size=464977 2024-03-09T14:33:21.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.374+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=BX4Q1BT93DD2 type=del size=1453878 2024-03-09T14:33:21.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.375+0000 7f586ae3d780 1 < completed delete operation key=NHIOOLNXLZZC tag=K2C8CNBCAUHU type=del 2024-03-09T14:33:21.377 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.377+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~54Z58BKHIG2H.0 size=1048576 2024-03-09T14:33:21.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.378+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~54Z58BKHIG2H.1 size=1048576 2024-03-09T14:33:21.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.379+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~54Z58BKHIG2H.2 size=884240 2024-03-09T14:33:21.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.379+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=54Z58BKHIG2H tag=S4OFE0HMQBW1 type=write size=4029968 2024-03-09T14:33:21.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.381+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=SRY20HRO61Z1 type=del 2024-03-09T14:33:21.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.382+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=MH4B3T520XPF type=del size=2792261 2024-03-09T14:33:21.382 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.383+0000 7f586ae3d780 1 < canceled operation key=BHSYRD3IEJWW tag=NYKBRNG2RT3E type=del size=3140302 2024-03-09T14:33:21.385 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.385+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~TZYV2JEPBEG3.0 size=1048576 2024-03-09T14:33:21.385 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.386+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~TZYV2JEPBEG3.1 size=1048576 2024-03-09T14:33:21.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.387+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~TZYV2JEPBEG3.2 size=537378 2024-03-09T14:33:21.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.387+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=TZYV2JEPBEG3 tag=H5KUZMVVS03V type=write size=3683106 2024-03-09T14:33:21.388 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.388+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=R5YBCNHJKUV2 type=del 2024-03-09T14:33:21.389 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.389+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=8SP4NQS4CVR5 type=write size=588738 2024-03-09T14:33:21.390 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.391+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~5KMRP7TEHXVF.0 size=346886 2024-03-09T14:33:21.392 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.393+0000 7f586ae3d780 1 < completed multipart upload key=UAYZ55UT77VE upload=5KMRP7TEHXVF tag=QM4P4TS2A82K type=write size=1395462 2024-03-09T14:33:21.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.394+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=O35BKII15SWD type=write size=244967 2024-03-09T14:33:21.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.395+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=R2O02P6M213Z type=del 2024-03-09T14:33:21.396 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.397+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=XUGW3J0NYCQ3 type=del size=1152629 2024-03-09T14:33:21.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.398+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=M2SHX40TJTUD type=del 2024-03-09T14:33:21.399 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.399+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=1IBGBUH522M4 type=del size=2442335 2024-03-09T14:33:21.400 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.400+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=DVGTVHXL4L7J type=del 2024-03-09T14:33:21.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.401+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=0Y4T2WOQMZMV type=del size=1127486 2024-03-09T14:33:21.402 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.403+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~XCWT8AT3Q1HJ.0 size=1048576 2024-03-09T14:33:21.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.404+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~XCWT8AT3Q1HJ.1 size=1048576 2024-03-09T14:33:21.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.405+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~XCWT8AT3Q1HJ.2 size=640657 2024-03-09T14:33:21.407 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.408+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=XCWT8AT3Q1HJ tag=4QUFCCMASJW6 type=write size=3786385 2024-03-09T14:33:21.408 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.409+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=FDNR7E2903DJ type=write size=32494 2024-03-09T14:33:21.409 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.410+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=65RQGM0KTHMY type=del 2024-03-09T14:33:21.411 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.411+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=5X95AFS06NBG type=del size=451570 2024-03-09T14:33:21.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.412+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~DGAOLII6YOCD.0 size=1048576 2024-03-09T14:33:21.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.413+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~DGAOLII6YOCD.1 size=854269 2024-03-09T14:33:21.415 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.415+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=DGAOLII6YOCD tag=DVPLQ9G93JP5 type=write size=2951421 2024-03-09T14:33:21.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.416+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=GC0TK7G3BSGG type=del size=2190259 2024-03-09T14:33:21.417 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.418+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~39QQY3UU6QYT.0 size=506272 2024-03-09T14:33:21.419 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.420+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=39QQY3UU6QYT tag=LXRMDXKR300F type=write size=1554848 2024-03-09T14:33:21.420 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.421+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=2G7AFM8D0QY0 type=del size=2639024 2024-03-09T14:33:21.421 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.422+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~O2ZQ2E72FQVB.0 size=1048576 2024-03-09T14:33:21.422 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.423+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~O2ZQ2E72FQVB.1 size=648455 2024-03-09T14:33:21.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.425+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=O2ZQ2E72FQVB tag=1HNI4ZANOUT3 type=write size=2745607 2024-03-09T14:33:21.426 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.426+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=DD5HCU18IRPK type=del size=1362992 2024-03-09T14:33:21.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.428+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~E5FN8IQB1SHT.0 size=1048576 2024-03-09T14:33:21.428 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.429+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~E5FN8IQB1SHT.1 size=335346 2024-03-09T14:33:21.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.431+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=E5FN8IQB1SHT tag=1P9K0LREWSLG type=write size=2432498 2024-03-09T14:33:21.431 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.432+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=U0EWVSGP0114 type=del size=827825 2024-03-09T14:33:21.433 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.433+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=J09JBCJKPZO6 type=del 2024-03-09T14:33:21.435 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.435+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~BZ6JNP8Z52BN.0 size=1048576 2024-03-09T14:33:21.437 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.436+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~BZ6JNP8Z52BN.1 size=382734 2024-03-09T14:33:21.437 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.436+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=BZ6JNP8Z52BN tag=B17M322FJ1TY type=write size=2479886 2024-03-09T14:33:21.437 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.437+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=BX4Q1BT93DD2 type=del 2024-03-09T14:33:21.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.440+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~GDMFGPE5KLWY.0 size=252082 2024-03-09T14:33:21.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.440+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=GDMFGPE5KLWY tag=J3L2A0BEZPQA type=write size=1300658 2024-03-09T14:33:21.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.441+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~54Z58BKHIG2H.0 size=1048576 2024-03-09T14:33:21.442 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.442+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~54Z58BKHIG2H.1 size=1048576 2024-03-09T14:33:21.442 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.442+0000 7f586ae3d780 1 < canceled part key=_multipart_XIYWPXSYCT6I.2~54Z58BKHIG2H.2 size=884240 2024-03-09T14:33:21.445 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.444+0000 7f586ae3d780 1 < canceled multipart upload key=XIYWPXSYCT6I upload=54Z58BKHIG2H tag=S4OFE0HMQBW1 type=write size=4029968 2024-03-09T14:33:21.446 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.445+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=H5135XPJCKR9 type=del size=3262131 2024-03-09T14:33:21.447 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.448+0000 7f586ae3d780 1 < suggested update operation key=UO072H74SHLP tag=MH4B3T520XPF type=del size=2792261 2024-03-09T14:33:21.448 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.449+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=ZCP1ZG9XRUJT type=del size=1642540 2024-03-09T14:33:21.450 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.450+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~TZYV2JEPBEG3.0 size=1048576 2024-03-09T14:33:21.451 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.451+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~TZYV2JEPBEG3.1 size=1048576 2024-03-09T14:33:21.452 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.452+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~TZYV2JEPBEG3.2 size=537378 2024-03-09T14:33:21.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.454+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=TZYV2JEPBEG3 tag=H5KUZMVVS03V type=write size=3683106 2024-03-09T14:33:21.456 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.456+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~G062D5HXRA7N.0 size=1048576 2024-03-09T14:33:21.457 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.457+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~G062D5HXRA7N.1 size=46392 2024-03-09T14:33:21.457 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.457+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=G062D5HXRA7N tag=H32919IPTYZH type=write size=2143544 2024-03-09T14:33:21.458 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.459+0000 7f586ae3d780 1 < completed write operation key=BHSYRD3IEJWW tag=8SP4NQS4CVR5 type=write size=588738 2024-03-09T14:33:21.459 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.460+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=WZLPTISBEBF5 type=del size=838675 2024-03-09T14:33:21.460 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.461+0000 7f586ae3d780 1 < canceled operation key=57OR9DHRPDCZ tag=O35BKII15SWD type=write size=244967 2024-03-09T14:33:21.462 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.463+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~CEFXQBNR3XVM.0 size=1048576 2024-03-09T14:33:21.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.464+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~CEFXQBNR3XVM.1 size=1048576 2024-03-09T14:33:21.464 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.465+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~CEFXQBNR3XVM.2 size=822659 2024-03-09T14:33:21.464 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.465+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=CEFXQBNR3XVM tag=AWKP2KWAP9HW type=write size=3968387 2024-03-09T14:33:21.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.466+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=XUGW3J0NYCQ3 type=del 2024-03-09T14:33:21.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.467+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=XFC7NN41VJMU type=del size=748353 2024-03-09T14:33:21.468 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.469+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=1IBGBUH522M4 type=del 2024-03-09T14:33:21.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.471+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~2GXKNG6U61GN.0 size=1048576 2024-03-09T14:33:21.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.471+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~2GXKNG6U61GN.1 size=1048576 2024-03-09T14:33:21.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.472+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~2GXKNG6U61GN.2 size=436768 2024-03-09T14:33:21.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.472+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=2GXKNG6U61GN tag=YN6VVTRE1HKD type=write size=3582496 2024-03-09T14:33:21.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.474+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=0Y4T2WOQMZMV type=del 2024-03-09T14:33:21.475 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.476+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~ZQCYV3QKZ36X.0 size=1048576 2024-03-09T14:33:21.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.477+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~ZQCYV3QKZ36X.1 size=783648 2024-03-09T14:33:21.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.477+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=ZQCYV3QKZ36X tag=OEFN4HW7BQYG type=write size=2880800 2024-03-09T14:33:21.478 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.479+0000 7f586ae3d780 1 < suggested update operation key=W3HTK2F8ML3V tag=FDNR7E2903DJ type=write size=32494 2024-03-09T14:33:21.480 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.480+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=JB963NBRFML7 type=del size=1447510 2024-03-09T14:33:21.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.481+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=5X95AFS06NBG type=del 2024-03-09T14:33:21.483 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.483+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~XLVJG8V40DL4.0 size=751196 2024-03-09T14:33:21.483 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.483+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=XLVJG8V40DL4 tag=4DJ3T586TF0G type=write size=1799772 2024-03-09T14:33:21.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.484+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=GC0TK7G3BSGG type=del 2024-03-09T14:33:21.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.486+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=T3A5C200K5QG type=del size=36626 2024-03-09T14:33:21.486 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.487+0000 7f586ae3d780 -1 < failed to complete operation key=W3HTK2F8ML3V tag=2G7AFM8D0QY0 type=del size=2639024: (22) Invalid argument 2024-03-09T14:33:21.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.488+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=78RD33PPQB9B type=del size=3171066 2024-03-09T14:33:21.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.489+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=DD5HCU18IRPK type=del 2024-03-09T14:33:21.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.490+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=7VSSDDB2N4FN type=del size=1515435 2024-03-09T14:33:21.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.492+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=U0EWVSGP0114 type=del 2024-03-09T14:33:21.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.493+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=F1U1IAOQNFGP type=del size=3140758 2024-03-09T14:33:21.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.494+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~BZ6JNP8Z52BN.0 size=1048576 2024-03-09T14:33:21.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.495+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~BZ6JNP8Z52BN.1 size=382734 2024-03-09T14:33:21.497 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.497+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=BZ6JNP8Z52BN tag=B17M322FJ1TY type=write size=2479886 2024-03-09T14:33:21.498 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.499+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=SSB61MYYTUHB type=del size=4184624 2024-03-09T14:33:21.499 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.500+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~GDMFGPE5KLWY.0 size=252082 2024-03-09T14:33:21.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.502+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=GDMFGPE5KLWY tag=J3L2A0BEZPQA type=write size=1300658 2024-03-09T14:33:21.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.504+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~4SG4AV5PVZ86.0 size=1048576 2024-03-09T14:33:21.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.505+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~4SG4AV5PVZ86.1 size=749491 2024-03-09T14:33:21.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.505+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=4SG4AV5PVZ86 tag=A8TNG9DHUE4M type=write size=2846643 2024-03-09T14:33:21.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.507+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=H5135XPJCKR9 type=del 2024-03-09T14:33:21.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.508+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=AUQ7B69BWFL1 type=del size=1523333 2024-03-09T14:33:21.509 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.510+0000 7f586ae3d780 1 < suggested remove operation key=04E9KDGUC274 tag=ZCP1ZG9XRUJT type=del 2024-03-09T14:33:21.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.511+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=KK1OV4U08B3O type=del size=3677787 2024-03-09T14:33:21.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.512+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~G062D5HXRA7N.0 size=1048576 2024-03-09T14:33:21.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.513+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~G062D5HXRA7N.1 size=46392 2024-03-09T14:33:21.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.516+0000 7f586ae3d780 1 < completed multipart upload key=LRI2GKBGVCWW upload=G062D5HXRA7N tag=H32919IPTYZH type=write size=2143544 2024-03-09T14:33:21.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.517+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=25CPZS80BK78 type=del size=1843001 2024-03-09T14:33:21.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.519+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=WZLPTISBEBF5 type=del 2024-03-09T14:33:21.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.520+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=ZZLPO9VUKKXK type=del size=3129600 2024-03-09T14:33:21.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.521+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~CEFXQBNR3XVM.0 size=1048576 2024-03-09T14:33:21.521 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.522+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~CEFXQBNR3XVM.1 size=1048576 2024-03-09T14:33:21.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.523+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~CEFXQBNR3XVM.2 size=822659 2024-03-09T14:33:21.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.525+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=CEFXQBNR3XVM tag=AWKP2KWAP9HW type=write size=3968387 2024-03-09T14:33:21.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.526+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=RUK2VIBUOCG7 type=del size=1694169 2024-03-09T14:33:21.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.527+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=XFC7NN41VJMU type=del 2024-03-09T14:33:21.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.528+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=QA4MS39063Y0 type=del size=1923922 2024-03-09T14:33:21.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.529+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~2GXKNG6U61GN.0 size=1048576 2024-03-09T14:33:21.530 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.530+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~2GXKNG6U61GN.1 size=1048576 2024-03-09T14:33:21.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.531+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~2GXKNG6U61GN.2 size=436768 2024-03-09T14:33:21.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.533+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=2GXKNG6U61GN tag=YN6VVTRE1HKD type=write size=3582496 2024-03-09T14:33:21.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.535+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~QNRJH6RCO5IB.0 size=1048576 2024-03-09T14:33:21.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.536+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~QNRJH6RCO5IB.1 size=1048576 2024-03-09T14:33:21.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.537+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~QNRJH6RCO5IB.2 size=611513 2024-03-09T14:33:21.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.537+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=QNRJH6RCO5IB tag=IXUQ9SN5LH67 type=write size=3757241 2024-03-09T14:33:21.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.539+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~ZQCYV3QKZ36X.0 size=1048576 2024-03-09T14:33:21.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.540+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~ZQCYV3QKZ36X.1 size=783648 2024-03-09T14:33:21.541 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.542+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=ZQCYV3QKZ36X tag=OEFN4HW7BQYG type=write size=2880800 2024-03-09T14:33:21.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.543+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=51SPWEDFLM7B type=del size=2482725 2024-03-09T14:33:21.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.544+0000 7f586ae3d780 1 < canceled operation key=XIYWPXSYCT6I tag=JB963NBRFML7 type=del size=1447510 2024-03-09T14:33:21.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.545+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=I68GP2IK276P type=del size=3612466 2024-03-09T14:33:21.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.546+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~XLVJG8V40DL4.0 size=751196 2024-03-09T14:33:21.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.548+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=XLVJG8V40DL4 tag=4DJ3T586TF0G type=write size=1799772 2024-03-09T14:33:21.550 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.551+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~F7FI58Z5H1E3.0 size=581752 2024-03-09T14:33:21.550 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.551+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=F7FI58Z5H1E3 tag=WEIV6ZVDWZ7O type=write size=1630328 2024-03-09T14:33:21.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.553+0000 7f586ae3d780 1 < suggested update operation key=5PERWGS0GOJU tag=T3A5C200K5QG type=del size=36626 2024-03-09T14:33:21.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.554+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=DDN4IFC0VEKU type=write size=577870 2024-03-09T14:33:21.555 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.555+0000 7f586ae3d780 1 < canceled operation key=UAYZ55UT77VE tag=78RD33PPQB9B type=del size=3171066 2024-03-09T14:33:21.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.557+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=KJ8E5E4REOLW type=del size=230814 2024-03-09T14:33:21.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.558+0000 7f586ae3d780 1 < canceled operation key=WNVN3EOUUBGR tag=7VSSDDB2N4FN type=del size=1515435 2024-03-09T14:33:21.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.560+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~DIMBOGK2IH77.0 size=1048576 2024-03-09T14:33:21.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.561+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~DIMBOGK2IH77.1 size=23130 2024-03-09T14:33:21.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.561+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=DIMBOGK2IH77 tag=LKNL5KX9RN8W type=write size=2120282 2024-03-09T14:33:21.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.562+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=F1U1IAOQNFGP type=del 2024-03-09T14:33:21.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.564+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=WJUM9509FGNT type=del size=312059 2024-03-09T14:33:21.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.565+0000 7f586ae3d780 1 < canceled operation key=NHIOOLNXLZZC tag=SSB61MYYTUHB type=del size=4184624 2024-03-09T14:33:21.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.566+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=23PF0PUMWMJD type=write size=214873 2024-03-09T14:33:21.567 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.567+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~4SG4AV5PVZ86.0 size=1048576 2024-03-09T14:33:21.568 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.568+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~4SG4AV5PVZ86.1 size=749491 2024-03-09T14:33:21.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.570+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=4SG4AV5PVZ86 tag=A8TNG9DHUE4M type=write size=2846643 2024-03-09T14:33:21.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.573+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~2186BGVJ2ZM5.0 size=523793 2024-03-09T14:33:21.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.573+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=2186BGVJ2ZM5 tag=9H0YOSD4J5IJ type=write size=1572369 2024-03-09T14:33:21.573 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.574+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=AUQ7B69BWFL1 type=del 2024-03-09T14:33:21.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.576+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~9Z0B7OV5DYZM.0 size=1048576 2024-03-09T14:33:21.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.577+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~9Z0B7OV5DYZM.1 size=1048576 2024-03-09T14:33:21.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.578+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~9Z0B7OV5DYZM.2 size=258776 2024-03-09T14:33:21.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.578+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=9Z0B7OV5DYZM tag=NSBVAA2UICL1 type=write size=3404504 2024-03-09T14:33:21.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.579+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=KK1OV4U08B3O type=del 2024-03-09T14:33:21.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.582+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~BJNLU2024150.0 size=1048576 2024-03-09T14:33:21.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.583+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~BJNLU2024150.1 size=1048576 2024-03-09T14:33:21.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.584+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~BJNLU2024150.2 size=365738 2024-03-09T14:33:21.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.584+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=BJNLU2024150 tag=XPPU500Y2LZ3 type=write size=3511466 2024-03-09T14:33:21.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.585+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=25CPZS80BK78 type=del 2024-03-09T14:33:21.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.587+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~O0VU2TA38WPZ.0 size=595549 2024-03-09T14:33:21.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.587+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=O0VU2TA38WPZ tag=EBJ44K6OKA72 type=write size=1644125 2024-03-09T14:33:21.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.589+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=ZZLPO9VUKKXK type=del 2024-03-09T14:33:21.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.591+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~CWGUC366LUU4.0 size=1048576 2024-03-09T14:33:21.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.592+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~CWGUC366LUU4.1 size=1048576 2024-03-09T14:33:21.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.593+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~CWGUC366LUU4.2 size=96296 2024-03-09T14:33:21.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.593+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=CWGUC366LUU4 tag=JWFMDH0QS5B1 type=write size=3242024 2024-03-09T14:33:21.593 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.594+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=RUK2VIBUOCG7 type=del 2024-03-09T14:33:21.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.595+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=VXWCYD15FLKT type=del size=1454738 2024-03-09T14:33:21.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.597+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=QA4MS39063Y0 type=del 2024-03-09T14:33:21.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.599+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~SOVRG7IQVNTZ.0 size=53671 2024-03-09T14:33:21.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.599+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=SOVRG7IQVNTZ tag=LK0QKLNH98U8 type=write size=1102247 2024-03-09T14:33:21.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.600+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~QNRJH6RCO5IB.0 size=1048576 2024-03-09T14:33:21.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.601+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~QNRJH6RCO5IB.1 size=1048576 2024-03-09T14:33:21.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.602+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~QNRJH6RCO5IB.2 size=611513 2024-03-09T14:33:21.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.605+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=QNRJH6RCO5IB tag=IXUQ9SN5LH67 type=write size=3757241 2024-03-09T14:33:21.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.607+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~E8YXL11Y4X6H.0 size=639744 2024-03-09T14:33:21.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.607+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=E8YXL11Y4X6H tag=G80GLPBR158D type=write size=1688320 2024-03-09T14:33:21.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.608+0000 7f586ae3d780 1 < canceled operation key=W4Q1MWHOQ4Y1 tag=51SPWEDFLM7B type=del size=2482725 2024-03-09T14:33:21.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.610+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~CW68XS484OB5.0 size=1048576 2024-03-09T14:33:21.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.611+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~CW68XS484OB5.1 size=252142 2024-03-09T14:33:21.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.611+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=CW68XS484OB5 tag=WD8RRR4B354Z type=write size=2349294 2024-03-09T14:33:21.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.613+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=I68GP2IK276P type=del 2024-03-09T14:33:21.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.614+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=9XKG0VXHPQQ5 type=del size=1760556 2024-03-09T14:33:21.615 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.615+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~F7FI58Z5H1E3.0 size=581752 2024-03-09T14:33:21.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.617+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=F7FI58Z5H1E3 tag=WEIV6ZVDWZ7O type=write size=1630328 2024-03-09T14:33:21.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.619+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=A11EHFOAFLC7 type=del size=3501082 2024-03-09T14:33:21.619 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.620+0000 7f586ae3d780 1 < completed write operation key=UO072H74SHLP tag=DDN4IFC0VEKU type=write size=577870 2024-03-09T14:33:21.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.621+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=DYUMK0M6KHIW type=del size=4018318 2024-03-09T14:33:21.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.622+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=KJ8E5E4REOLW type=del 2024-03-09T14:33:21.623 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.623+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=Z71JLD3LIMAY type=del size=2434429 2024-03-09T14:33:21.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.625+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~DIMBOGK2IH77.0 size=1048576 2024-03-09T14:33:21.625 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.626+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~DIMBOGK2IH77.1 size=23130 2024-03-09T14:33:21.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.628+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=DIMBOGK2IH77 tag=LKNL5KX9RN8W type=write size=2120282 2024-03-09T14:33:21.628 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.629+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=AJ1K73D1KSHG type=del size=3888259 2024-03-09T14:33:21.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.632+0000 7f586ae3d780 1 < suggested remove operation key=W4Q1MWHOQ4Y1 tag=WJUM9509FGNT type=del 2024-03-09T14:33:21.634 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.635+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~GXXB4JNIIXEH.0 size=1048576 2024-03-09T14:33:21.635 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.635+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~GXXB4JNIIXEH.1 size=455020 2024-03-09T14:33:21.635 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.635+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=GXXB4JNIIXEH tag=F4QN2AV5IP5I type=write size=2552172 2024-03-09T14:33:21.636 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.637+0000 7f586ae3d780 1 < completed write operation key=OXBDXIILR3NS tag=23PF0PUMWMJD type=write size=214873 2024-03-09T14:33:21.638 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.639+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~YOIZL8NDIV4F.0 size=1048576 2024-03-09T14:33:21.639 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.640+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~YOIZL8NDIV4F.1 size=31560 2024-03-09T14:33:21.639 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.640+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=YOIZL8NDIV4F tag=N16B3WSKT5QF type=write size=2128712 2024-03-09T14:33:21.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.641+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~2186BGVJ2ZM5.0 size=523793 2024-03-09T14:33:21.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.643+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=2186BGVJ2ZM5 tag=9H0YOSD4J5IJ type=write size=1572369 2024-03-09T14:33:21.643 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.644+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=19W0WFP0XH2O type=del size=4046303 2024-03-09T14:33:21.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.645+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~9Z0B7OV5DYZM.0 size=1048576 2024-03-09T14:33:21.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.646+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~9Z0B7OV5DYZM.1 size=1048576 2024-03-09T14:33:21.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.647+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~9Z0B7OV5DYZM.2 size=258776 2024-03-09T14:33:21.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.649+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=9Z0B7OV5DYZM tag=NSBVAA2UICL1 type=write size=3404504 2024-03-09T14:33:21.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.651+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~DMQ5AI0H8VMO.0 size=1048576 2024-03-09T14:33:21.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.652+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~DMQ5AI0H8VMO.1 size=1048576 2024-03-09T14:33:21.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.652+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~DMQ5AI0H8VMO.2 size=660883 2024-03-09T14:33:21.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.652+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=DMQ5AI0H8VMO tag=NUO7X3EQMH3M type=write size=3806611 2024-03-09T14:33:21.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.654+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~BJNLU2024150.0 size=1048576 2024-03-09T14:33:21.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.655+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~BJNLU2024150.1 size=1048576 2024-03-09T14:33:21.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.656+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~BJNLU2024150.2 size=365738 2024-03-09T14:33:21.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.657+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=BJNLU2024150 tag=XPPU500Y2LZ3 type=write size=3511466 2024-03-09T14:33:21.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.659+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~WOFSZ1H5TFAV.0 size=1048576 2024-03-09T14:33:21.660 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.660+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~WOFSZ1H5TFAV.1 size=1048576 2024-03-09T14:33:21.661 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.661+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~WOFSZ1H5TFAV.2 size=548265 2024-03-09T14:33:21.661 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.661+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=WOFSZ1H5TFAV tag=F7N9WDTGLR8U type=write size=3693993 2024-03-09T14:33:21.662 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.662+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~O0VU2TA38WPZ.0 size=595549 2024-03-09T14:33:21.664 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.664+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=O0VU2TA38WPZ tag=EBJ44K6OKA72 type=write size=1644125 2024-03-09T14:33:21.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.667+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~PGGLK1MDN6EM.0 size=1048576 2024-03-09T14:33:21.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.668+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~PGGLK1MDN6EM.1 size=636632 2024-03-09T14:33:21.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.668+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=PGGLK1MDN6EM tag=4TSJ03FQXOXR type=write size=2733784 2024-03-09T14:33:21.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.669+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~CWGUC366LUU4.0 size=1048576 2024-03-09T14:33:21.669 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.670+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~CWGUC366LUU4.1 size=1048576 2024-03-09T14:33:21.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.671+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~CWGUC366LUU4.2 size=96296 2024-03-09T14:33:21.672 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.673+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=CWGUC366LUU4 tag=JWFMDH0QS5B1 type=write size=3242024 2024-03-09T14:33:21.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.674+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=J134Y3I2TGKR type=del size=2424936 2024-03-09T14:33:21.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.675+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=VXWCYD15FLKT type=del 2024-03-09T14:33:21.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.676+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=1BZ0913K94QP type=del size=1286394 2024-03-09T14:33:21.677 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.677+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~SOVRG7IQVNTZ.0 size=53671 2024-03-09T14:33:21.679 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.679+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=SOVRG7IQVNTZ tag=LK0QKLNH98U8 type=write size=1102247 2024-03-09T14:33:21.680 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.680+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=4YEI9SWNV2PB type=del size=1290306 2024-03-09T14:33:21.681 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.681+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~E8YXL11Y4X6H.0 size=639744 2024-03-09T14:33:21.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.683+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=E8YXL11Y4X6H tag=G80GLPBR158D type=write size=1688320 2024-03-09T14:33:21.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.684+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=DK1DZPPIQTJM type=del size=899328 2024-03-09T14:33:21.685 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.686+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~CW68XS484OB5.0 size=1048576 2024-03-09T14:33:21.686 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.687+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~CW68XS484OB5.1 size=252142 2024-03-09T14:33:21.688 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.689+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=CW68XS484OB5 tag=WD8RRR4B354Z type=write size=2349294 2024-03-09T14:33:21.690 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.691+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~JP311D04UA2O.0 size=1048576 2024-03-09T14:33:21.691 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.692+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~JP311D04UA2O.1 size=291454 2024-03-09T14:33:21.691 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.692+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=JP311D04UA2O tag=X93SH15DBNML type=write size=2388606 2024-03-09T14:33:21.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.693+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=9XKG0VXHPQQ5 type=del 2024-03-09T14:33:21.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.695+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~6XEGL9DWASWS.0 size=842895 2024-03-09T14:33:21.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.695+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=6XEGL9DWASWS tag=FUU5I9UE3VGH type=write size=1891471 2024-03-09T14:33:21.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.696+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=A11EHFOAFLC7 type=del 2024-03-09T14:33:21.698 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.698+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~A5OB3CYT5I1T.0 size=735804 2024-03-09T14:33:21.698 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.698+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=A5OB3CYT5I1T tag=CQU871JU2F87 type=write size=1784380 2024-03-09T14:33:21.700 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.701+0000 7f586ae3d780 1 < suggested remove operation key=OXBDXIILR3NS tag=DYUMK0M6KHIW type=del 2024-03-09T14:33:21.702 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.703+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~K52FMBFLUU2C.0 size=1048576 2024-03-09T14:33:21.703 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.704+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~K52FMBFLUU2C.1 size=1048576 2024-03-09T14:33:21.704 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.705+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~K52FMBFLUU2C.2 size=951593 2024-03-09T14:33:21.704 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.705+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=K52FMBFLUU2C tag=KKF2GAKVWK6B type=write size=4097321 2024-03-09T14:33:21.705 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.706+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=Z71JLD3LIMAY type=del 2024-03-09T14:33:21.706 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.707+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=BB7QL5B6P76S type=del size=3445768 2024-03-09T14:33:21.708 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.708+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=AJ1K73D1KSHG type=del 2024-03-09T14:33:21.709 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.709+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=LQOBPMDG3SCE type=del size=2581487 2024-03-09T14:33:21.709 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.710+0000 7f586ae3d780 1 < canceled part key=_multipart_0JDF7910RACF.2~GXXB4JNIIXEH.0 size=1048576 2024-03-09T14:33:21.710 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.710+0000 7f586ae3d780 1 < canceled part key=_multipart_0JDF7910RACF.2~GXXB4JNIIXEH.1 size=455020 2024-03-09T14:33:21.711 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.712+0000 7f586ae3d780 1 < canceled multipart upload key=0JDF7910RACF upload=GXXB4JNIIXEH tag=F4QN2AV5IP5I type=write size=2552172 2024-03-09T14:33:21.713 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.714+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~P9TK1M9CFXTC.0 size=1048576 2024-03-09T14:33:21.714 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.715+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~P9TK1M9CFXTC.1 size=1048576 2024-03-09T14:33:21.715 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.715+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~P9TK1M9CFXTC.2 size=533036 2024-03-09T14:33:21.715 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.715+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=P9TK1M9CFXTC tag=BV3I0EMS66WM type=write size=3678764 2024-03-09T14:33:21.716 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.717+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~YOIZL8NDIV4F.0 size=1048576 2024-03-09T14:33:21.717 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.718+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~YOIZL8NDIV4F.1 size=31560 2024-03-09T14:33:21.719 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.720+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=YOIZL8NDIV4F tag=N16B3WSKT5QF type=write size=2128712 2024-03-09T14:33:21.720 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.721+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=VROM8UFVL6FS type=write size=311123 2024-03-09T14:33:21.723 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.723+0000 7f586ae3d780 1 < suggested remove operation key=6YWLPUULN5SY tag=19W0WFP0XH2O type=del 2024-03-09T14:33:21.726 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.727+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~7P8P8L2MAMH9.0 size=1048576 2024-03-09T14:33:21.727 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.728+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~7P8P8L2MAMH9.1 size=1048576 2024-03-09T14:33:21.728 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.729+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~7P8P8L2MAMH9.2 size=335990 2024-03-09T14:33:21.728 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.729+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=7P8P8L2MAMH9 tag=HWG22WRYTII7 type=write size=3481718 2024-03-09T14:33:21.729 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.730+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~DMQ5AI0H8VMO.0 size=1048576 2024-03-09T14:33:21.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.731+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~DMQ5AI0H8VMO.1 size=1048576 2024-03-09T14:33:21.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.732+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~DMQ5AI0H8VMO.2 size=660883 2024-03-09T14:33:21.734 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.734+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=DMQ5AI0H8VMO tag=NUO7X3EQMH3M type=write size=3806611 2024-03-09T14:33:21.735 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.736+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~Z5KOJ41DDRA5.0 size=1048576 2024-03-09T14:33:21.736 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.737+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~Z5KOJ41DDRA5.1 size=274823 2024-03-09T14:33:21.736 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.737+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=Z5KOJ41DDRA5 tag=DCLENFPDIIBO type=write size=2371975 2024-03-09T14:33:21.738 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.739+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~WOFSZ1H5TFAV.0 size=1048576 2024-03-09T14:33:21.739 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.740+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~WOFSZ1H5TFAV.1 size=1048576 2024-03-09T14:33:21.740 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.741+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~WOFSZ1H5TFAV.2 size=548265 2024-03-09T14:33:21.742 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.743+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=WOFSZ1H5TFAV tag=F7N9WDTGLR8U type=write size=3693993 2024-03-09T14:33:21.743 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.744+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=L39MMPO6R92L type=write size=720939 2024-03-09T14:33:21.745 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.745+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~PGGLK1MDN6EM.0 size=1048576 2024-03-09T14:33:21.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.746+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~PGGLK1MDN6EM.1 size=636632 2024-03-09T14:33:21.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.748+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=PGGLK1MDN6EM tag=4TSJ03FQXOXR type=write size=2733784 2024-03-09T14:33:21.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.749+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=G27E0LXXD9CZ type=del size=2633624 2024-03-09T14:33:21.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.751+0000 7f586ae3d780 1 < completed delete operation key=NHIOOLNXLZZC tag=J134Y3I2TGKR type=del 2024-03-09T14:33:21.751 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.752+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=Z2WL4OMZJ57I type=del size=299329 2024-03-09T14:33:21.753 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.753+0000 7f586ae3d780 1 < canceled operation key=UKPSUQ6LYWN8 tag=1BZ0913K94QP type=del size=1286394 2024-03-09T14:33:21.755 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.755+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~G88DABG7AWQL.0 size=1048576 2024-03-09T14:33:21.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.756+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~G88DABG7AWQL.1 size=347685 2024-03-09T14:33:21.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.756+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=G88DABG7AWQL tag=Y5S5B091RW36 type=write size=2444837 2024-03-09T14:33:21.757 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.757+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=4YEI9SWNV2PB type=del 2024-03-09T14:33:21.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.760+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~PWQ9GNQZPXG5.0 size=1048576 2024-03-09T14:33:21.760 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.761+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~PWQ9GNQZPXG5.1 size=661218 2024-03-09T14:33:21.760 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.761+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=PWQ9GNQZPXG5 tag=WRA7MN724WCY type=write size=2758370 2024-03-09T14:33:21.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.762+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=DK1DZPPIQTJM type=del 2024-03-09T14:33:21.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.763+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=ITRSVTFXNF6S type=del size=767667 2024-03-09T14:33:21.764 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.765+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~JP311D04UA2O.0 size=1048576 2024-03-09T14:33:21.765 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.765+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~JP311D04UA2O.1 size=291454 2024-03-09T14:33:21.767 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.768+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=JP311D04UA2O tag=X93SH15DBNML type=write size=2388606 2024-03-09T14:33:21.768 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.769+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=TCUPZOGMM66N type=del size=130258 2024-03-09T14:33:21.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.770+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~6XEGL9DWASWS.0 size=842895 2024-03-09T14:33:21.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.772+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=6XEGL9DWASWS tag=FUU5I9UE3VGH type=write size=1891471 2024-03-09T14:33:21.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.773+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=80BWQGRNEHBB type=del size=1633141 2024-03-09T14:33:21.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.775+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~A5OB3CYT5I1T.0 size=735804 2024-03-09T14:33:21.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.776+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=A5OB3CYT5I1T tag=CQU871JU2F87 type=write size=1784380 2024-03-09T14:33:21.777 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.778+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=FSWZA297RGJT type=del size=2882942 2024-03-09T14:33:21.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.779+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~K52FMBFLUU2C.0 size=1048576 2024-03-09T14:33:21.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.779+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~K52FMBFLUU2C.1 size=1048576 2024-03-09T14:33:21.780 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.780+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~K52FMBFLUU2C.2 size=951593 2024-03-09T14:33:21.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.782+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=K52FMBFLUU2C tag=KKF2GAKVWK6B type=write size=4097321 2024-03-09T14:33:21.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.784+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~YS418E3P19IY.0 size=872264 2024-03-09T14:33:21.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.784+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=YS418E3P19IY tag=D5B9TYD816XN type=write size=1920840 2024-03-09T14:33:21.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.785+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=BB7QL5B6P76S type=del 2024-03-09T14:33:21.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.786+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=RKGLBRECZNV1 type=write size=129744 2024-03-09T14:33:21.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.787+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=LQOBPMDG3SCE type=del 2024-03-09T14:33:21.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.788+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=LWEYVBC1ATBO type=del size=4192223 2024-03-09T14:33:21.789 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.790+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~P9TK1M9CFXTC.0 size=1048576 2024-03-09T14:33:21.790 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.790+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~P9TK1M9CFXTC.1 size=1048576 2024-03-09T14:33:21.791 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.791+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~P9TK1M9CFXTC.2 size=533036 2024-03-09T14:33:21.793 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.793+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=P9TK1M9CFXTC tag=BV3I0EMS66WM type=write size=3678764 2024-03-09T14:33:21.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.795+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~UPHECF80U9B1.0 size=1048576 2024-03-09T14:33:21.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.796+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~UPHECF80U9B1.1 size=776515 2024-03-09T14:33:21.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.796+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=UPHECF80U9B1 tag=39YQE5WAP4IO type=write size=2873667 2024-03-09T14:33:21.797 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.797+0000 7f586ae3d780 1 < completed write operation key=C1UGQOQ6AE1E tag=VROM8UFVL6FS type=write size=311123 2024-03-09T14:33:21.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.799+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~VHIUMWLVJR7A.0 size=1048576 2024-03-09T14:33:21.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.800+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~VHIUMWLVJR7A.1 size=295598 2024-03-09T14:33:21.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.800+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=VHIUMWLVJR7A tag=EX2TNY05DUTQ type=write size=2392750 2024-03-09T14:33:21.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.801+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~7P8P8L2MAMH9.0 size=1048576 2024-03-09T14:33:21.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.802+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~7P8P8L2MAMH9.1 size=1048576 2024-03-09T14:33:21.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.803+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~7P8P8L2MAMH9.2 size=335990 2024-03-09T14:33:21.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.805+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=7P8P8L2MAMH9 tag=HWG22WRYTII7 type=write size=3481718 2024-03-09T14:33:21.805 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.806+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=UJFT04SMC865 type=del size=2733587 2024-03-09T14:33:21.806 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.807+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~Z5KOJ41DDRA5.0 size=1048576 2024-03-09T14:33:21.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.808+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~Z5KOJ41DDRA5.1 size=274823 2024-03-09T14:33:21.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.810+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=Z5KOJ41DDRA5 tag=DCLENFPDIIBO type=write size=2371975 2024-03-09T14:33:21.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.811+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=T0BMGWNMUDHP type=del size=2814667 2024-03-09T14:33:21.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.812+0000 7f586ae3d780 1 < completed write operation key=G2BIOBESOIK9 tag=L39MMPO6R92L type=write size=720939 2024-03-09T14:33:21.814 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.814+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~2ASCPXMMOL0B.0 size=1048576 2024-03-09T14:33:21.815 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.815+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~2ASCPXMMOL0B.1 size=290144 2024-03-09T14:33:21.815 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.815+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=2ASCPXMMOL0B tag=AQWDEU3GT8IC type=write size=2387296 2024-03-09T14:33:21.816 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.816+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=G27E0LXXD9CZ type=del 2024-03-09T14:33:21.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.817+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=C2ZD4U6F0YR9 type=write size=595105 2024-03-09T14:33:21.818 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.818+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=Z2WL4OMZJ57I type=del 2024-03-09T14:33:21.819 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.820+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=QPF8L5OKERT0 type=del size=122475 2024-03-09T14:33:21.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.821+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~G88DABG7AWQL.0 size=1048576 2024-03-09T14:33:21.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.822+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~G88DABG7AWQL.1 size=347685 2024-03-09T14:33:21.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.824+0000 7f586ae3d780 1 < completed multipart upload key=UAYZ55UT77VE upload=G88DABG7AWQL tag=Y5S5B091RW36 type=write size=2444837 2024-03-09T14:33:21.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.826+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~H07Z5DO4DLLH.0 size=1048576 2024-03-09T14:33:21.826 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.827+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~H07Z5DO4DLLH.1 size=1048576 2024-03-09T14:33:21.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.827+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~H07Z5DO4DLLH.2 size=510546 2024-03-09T14:33:21.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.827+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=H07Z5DO4DLLH tag=UCEQO6QM9ZQ1 type=write size=3656274 2024-03-09T14:33:21.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.829+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~PWQ9GNQZPXG5.0 size=1048576 2024-03-09T14:33:21.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.829+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~PWQ9GNQZPXG5.1 size=661218 2024-03-09T14:33:21.831 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.831+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=PWQ9GNQZPXG5 tag=WRA7MN724WCY type=write size=2758370 2024-03-09T14:33:21.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.833+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=3S4I1GMRTH6M type=del size=442803 2024-03-09T14:33:21.833 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.834+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=ITRSVTFXNF6S type=del 2024-03-09T14:33:21.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.835+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=6T6WTQ2FUV2F type=del size=554910 2024-03-09T14:33:21.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.837+0000 7f586ae3d780 1 < suggested remove operation key=NHIOOLNXLZZC tag=TCUPZOGMM66N type=del 2024-03-09T14:33:21.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.838+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=BD2KM0I2KT4E type=del size=3245822 2024-03-09T14:33:21.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.840+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=80BWQGRNEHBB type=del 2024-03-09T14:33:21.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.842+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~HMKIXUN9RWP7.0 size=35485 2024-03-09T14:33:21.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.842+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=HMKIXUN9RWP7 tag=K1AS070B0IMJ type=write size=1084061 2024-03-09T14:33:21.842 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.843+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=FSWZA297RGJT type=del 2024-03-09T14:33:21.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.845+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=9IA3OP8NNC6G type=del size=3422728 2024-03-09T14:33:21.845 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.846+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~YS418E3P19IY.0 size=872264 2024-03-09T14:33:21.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.848+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=YS418E3P19IY tag=D5B9TYD816XN type=write size=1920840 2024-03-09T14:33:21.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.850+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~2XP0LKVK853O.0 size=1048576 2024-03-09T14:33:21.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.850+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~2XP0LKVK853O.1 size=623064 2024-03-09T14:33:21.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.850+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=2XP0LKVK853O tag=76A7GGA4OYQY type=write size=2720216 2024-03-09T14:33:21.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.852+0000 7f586ae3d780 1 < completed write operation key=UO072H74SHLP tag=RKGLBRECZNV1 type=write size=129744 2024-03-09T14:33:21.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.853+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=YS87J0Y571H7 type=del size=1920204 2024-03-09T14:33:21.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.854+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=LWEYVBC1ATBO type=del 2024-03-09T14:33:21.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.855+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=7XDFE8U39B7S type=write size=728593 2024-03-09T14:33:21.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.856+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~UPHECF80U9B1.0 size=1048576 2024-03-09T14:33:21.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.857+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~UPHECF80U9B1.1 size=776515 2024-03-09T14:33:21.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.859+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=UPHECF80U9B1 tag=39YQE5WAP4IO type=write size=2873667 2024-03-09T14:33:21.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.861+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~MIJIY7KU6CV1.0 size=1048576 2024-03-09T14:33:21.862 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.862+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~MIJIY7KU6CV1.1 size=1048576 2024-03-09T14:33:21.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.863+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~MIJIY7KU6CV1.2 size=810718 2024-03-09T14:33:21.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.863+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=MIJIY7KU6CV1 tag=GJW9A6CAXZTC type=write size=3956446 2024-03-09T14:33:21.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.864+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~VHIUMWLVJR7A.0 size=1048576 2024-03-09T14:33:21.865 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.865+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~VHIUMWLVJR7A.1 size=295598 2024-03-09T14:33:21.867 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.867+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=VHIUMWLVJR7A tag=EX2TNY05DUTQ type=write size=2392750 2024-03-09T14:33:21.869 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.870+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~G81NXIOXTCHD.0 size=1048576 2024-03-09T14:33:21.870 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.871+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~G81NXIOXTCHD.1 size=824290 2024-03-09T14:33:21.870 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.871+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=G81NXIOXTCHD tag=N9F0HDUMB25G type=write size=2921442 2024-03-09T14:33:21.871 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.872+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=UJFT04SMC865 type=del 2024-03-09T14:33:21.873 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.873+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=1MDKU3G0TPKF type=del size=371557 2024-03-09T14:33:21.874 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.875+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=T0BMGWNMUDHP type=del 2024-03-09T14:33:21.876 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.876+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=50LMBZM1XHBS type=del size=1734076 2024-03-09T14:33:21.876 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.876+0000 7f586ae3d780 1 < canceled part key=_multipart_NHIOOLNXLZZC.2~2ASCPXMMOL0B.0 size=1048576 2024-03-09T14:33:21.877 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.877+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~2ASCPXMMOL0B.1 size=290144 2024-03-09T14:33:21.879 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.879+0000 7f586ae3d780 1 < canceled multipart upload key=NHIOOLNXLZZC upload=2ASCPXMMOL0B tag=AQWDEU3GT8IC type=write size=2387296 2024-03-09T14:33:21.881 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.881+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~TFC7B3CVKNHQ.0 size=353880 2024-03-09T14:33:21.881 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.881+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=TFC7B3CVKNHQ tag=R5HZBTLHIMPG type=write size=1402456 2024-03-09T14:33:21.882 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.882+0000 7f586ae3d780 1 < completed write operation key=IK528ND96157 tag=C2ZD4U6F0YR9 type=write size=595105 2024-03-09T14:33:21.883 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.884+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=9DXTX8Z7RDVC type=del size=2622078 2024-03-09T14:33:21.885 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.885+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=QPF8L5OKERT0 type=del 2024-03-09T14:33:21.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.886+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=HLA66T8HMBOA type=del size=3981208 2024-03-09T14:33:21.887 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.888+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~H07Z5DO4DLLH.0 size=1048576 2024-03-09T14:33:21.888 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.889+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~H07Z5DO4DLLH.1 size=1048576 2024-03-09T14:33:21.889 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.890+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~H07Z5DO4DLLH.2 size=510546 2024-03-09T14:33:21.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.892+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=H07Z5DO4DLLH tag=UCEQO6QM9ZQ1 type=write size=3656274 2024-03-09T14:33:21.893 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.893+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=TZTZQK03MQNY type=del size=4183140 2024-03-09T14:33:21.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.895+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=3S4I1GMRTH6M type=del 2024-03-09T14:33:21.896 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.897+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~IDW2A82DMHY6.0 size=1048576 2024-03-09T14:33:21.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.898+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~IDW2A82DMHY6.1 size=229803 2024-03-09T14:33:21.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.898+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=IDW2A82DMHY6 tag=LFOVOWEHP5P0 type=write size=2326955 2024-03-09T14:33:21.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.900+0000 7f586ae3d780 1 < suggested update operation key=CZGAXNJ0GKU0 tag=6T6WTQ2FUV2F type=del size=554910 2024-03-09T14:33:21.902 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.903+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~Z884KB29GSLG.0 size=387670 2024-03-09T14:33:21.902 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.903+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=Z884KB29GSLG tag=5OP932MM7FCA type=write size=1436246 2024-03-09T14:33:21.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.904+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=BD2KM0I2KT4E type=del 2024-03-09T14:33:21.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.905+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=W913CETUVXD7 type=del size=3379068 2024-03-09T14:33:21.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.906+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~HMKIXUN9RWP7.0 size=35485 2024-03-09T14:33:21.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.908+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=HMKIXUN9RWP7 tag=K1AS070B0IMJ type=write size=1084061 2024-03-09T14:33:21.910 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.910+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~FJWARVVI0LUJ.0 size=1048576 2024-03-09T14:33:21.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.911+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~FJWARVVI0LUJ.1 size=398406 2024-03-09T14:33:21.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.911+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=FJWARVVI0LUJ tag=Q3V77JI67WGH type=write size=2495558 2024-03-09T14:33:21.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.913+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=9IA3OP8NNC6G type=del 2024-03-09T14:33:21.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.915+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~ZX0E5CF7YFBR.0 size=542766 2024-03-09T14:33:21.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.915+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=ZX0E5CF7YFBR tag=DLWI9PJ8YCCE type=write size=1591342 2024-03-09T14:33:21.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.916+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~2XP0LKVK853O.0 size=1048576 2024-03-09T14:33:21.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.916+0000 7f586ae3d780 1 < canceled part key=_multipart_CAISZZZSOD34.2~2XP0LKVK853O.1 size=623064 2024-03-09T14:33:21.917 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.918+0000 7f586ae3d780 1 < canceled multipart upload key=CAISZZZSOD34 upload=2XP0LKVK853O tag=76A7GGA4OYQY type=write size=2720216 2024-03-09T14:33:21.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.920+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~IC8CZKCJ3EK0.0 size=1048576 2024-03-09T14:33:21.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.921+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~IC8CZKCJ3EK0.1 size=1048576 2024-03-09T14:33:21.921 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.921+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~IC8CZKCJ3EK0.2 size=189516 2024-03-09T14:33:21.921 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.921+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=IC8CZKCJ3EK0 tag=BPTQS44ZYCF1 type=write size=3335244 2024-03-09T14:33:21.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.923+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=YS87J0Y571H7 type=del 2024-03-09T14:33:21.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.924+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=AOZ0LFY2P3MK type=del size=2616899 2024-03-09T14:33:21.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.925+0000 7f586ae3d780 1 < completed write operation key=9ZPCSBP3P58P tag=7XDFE8U39B7S type=write size=728593 2024-03-09T14:33:21.926 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.927+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~SC8EYTNT24SD.0 size=1048576 2024-03-09T14:33:21.927 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.928+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~SC8EYTNT24SD.1 size=1048576 2024-03-09T14:33:21.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.929+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~SC8EYTNT24SD.2 size=386034 2024-03-09T14:33:21.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.929+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=SC8EYTNT24SD tag=1V36QT9NHN8W type=write size=3531762 2024-03-09T14:33:21.929 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.930+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~MIJIY7KU6CV1.0 size=1048576 2024-03-09T14:33:21.930 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.931+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~MIJIY7KU6CV1.1 size=1048576 2024-03-09T14:33:21.931 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.932+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~MIJIY7KU6CV1.2 size=810718 2024-03-09T14:33:21.933 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.934+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=MIJIY7KU6CV1 tag=GJW9A6CAXZTC type=write size=3956446 2024-03-09T14:33:21.934 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.935+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=20GMLKNTZHOT type=del size=1016654 2024-03-09T14:33:21.936 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.936+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~G81NXIOXTCHD.0 size=1048576 2024-03-09T14:33:21.936 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.936+0000 7f586ae3d780 1 < canceled part key=_multipart_509F17DT0C4I.2~G81NXIOXTCHD.1 size=824290 2024-03-09T14:33:21.938 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.939+0000 7f586ae3d780 1 < canceled multipart upload key=509F17DT0C4I upload=G81NXIOXTCHD tag=N9F0HDUMB25G type=write size=2921442 2024-03-09T14:33:21.939 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.940+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=ZOHPWUM1OXXI type=del size=1976580 2024-03-09T14:33:21.940 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.941+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=1MDKU3G0TPKF type=del 2024-03-09T14:33:21.943 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.943+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~F59VT77JM00E.0 size=1048576 2024-03-09T14:33:21.944 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.944+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~F59VT77JM00E.1 size=1048576 2024-03-09T14:33:21.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.945+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~F59VT77JM00E.2 size=1036133 2024-03-09T14:33:21.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.945+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=F59VT77JM00E tag=ZT0FCNREX90V type=write size=4181861 2024-03-09T14:33:21.946 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.946+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=50LMBZM1XHBS type=del 2024-03-09T14:33:21.947 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.948+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=377KH9HAJEVO type=del size=2209225 2024-03-09T14:33:21.948 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.949+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~TFC7B3CVKNHQ.0 size=353880 2024-03-09T14:33:21.951 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.951+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=TFC7B3CVKNHQ tag=R5HZBTLHIMPG type=write size=1402456 2024-03-09T14:33:21.952 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.952+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=1KN3YBGDY4B2 type=del size=410679 2024-03-09T14:33:21.953 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.954+0000 7f586ae3d780 -1 < failed to complete operation key=CZGAXNJ0GKU0 tag=9DXTX8Z7RDVC type=del size=2622078: (22) Invalid argument 2024-03-09T14:33:21.955 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.956+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=2H8YFUEGX9P2 type=del size=148961 2024-03-09T14:33:21.957 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.957+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=HLA66T8HMBOA type=del 2024-03-09T14:33:21.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.959+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~JQKOINFWQ4L5.0 size=152941 2024-03-09T14:33:21.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.959+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=JQKOINFWQ4L5 tag=M0TSHE9NSN4R type=write size=1201517 2024-03-09T14:33:21.961 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.962+0000 7f586ae3d780 1 < suggested update operation key=LRI2GKBGVCWW tag=TZTZQK03MQNY type=del size=4183140 2024-03-09T14:33:21.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.963+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=2EPJXHZWEEOO type=del size=2411242 2024-03-09T14:33:21.963 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.964+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~IDW2A82DMHY6.0 size=1048576 2024-03-09T14:33:21.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.965+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~IDW2A82DMHY6.1 size=229803 2024-03-09T14:33:21.966 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.967+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=IDW2A82DMHY6 tag=LFOVOWEHP5P0 type=write size=2326955 2024-03-09T14:33:21.968 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.969+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~TW6ZLYTOG4XA.0 size=1030667 2024-03-09T14:33:21.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.969+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=TW6ZLYTOG4XA tag=S20FO25UV6Z0 type=write size=2079243 2024-03-09T14:33:21.970 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.970+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~Z884KB29GSLG.0 size=387670 2024-03-09T14:33:21.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.972+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=Z884KB29GSLG tag=5OP932MM7FCA type=write size=1436246 2024-03-09T14:33:21.973 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.974+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~32W6P7LXC5X1.0 size=1048576 2024-03-09T14:33:21.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.975+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~32W6P7LXC5X1.1 size=942318 2024-03-09T14:33:21.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.975+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=32W6P7LXC5X1 tag=30BL478LVDCI type=write size=3039470 2024-03-09T14:33:21.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.976+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=W913CETUVXD7 type=del 2024-03-09T14:33:21.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.977+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=EU52XZVI3JLI type=del size=588777 2024-03-09T14:33:21.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.978+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~FJWARVVI0LUJ.0 size=1048576 2024-03-09T14:33:21.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.979+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~FJWARVVI0LUJ.1 size=398406 2024-03-09T14:33:21.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.981+0000 7f586ae3d780 1 < completed multipart upload key=IK528ND96157 upload=FJWARVVI0LUJ tag=Q3V77JI67WGH type=write size=2495558 2024-03-09T14:33:21.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.982+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=WXTQLRNQRFWU type=del size=2750712 2024-03-09T14:33:21.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.984+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~ZX0E5CF7YFBR.0 size=542766 2024-03-09T14:33:21.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.986+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=ZX0E5CF7YFBR tag=DLWI9PJ8YCCE type=write size=1591342 2024-03-09T14:33:21.986 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.987+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=OGA12TFRHNFE type=del size=2172020 2024-03-09T14:33:21.987 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.988+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~IC8CZKCJ3EK0.0 size=1048576 2024-03-09T14:33:21.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.989+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~IC8CZKCJ3EK0.1 size=1048576 2024-03-09T14:33:21.989 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.990+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~IC8CZKCJ3EK0.2 size=189516 2024-03-09T14:33:21.991 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.991+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=IC8CZKCJ3EK0 tag=BPTQS44ZYCF1 type=write size=3335244 2024-03-09T14:33:21.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.993+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=IOFXWJXY0OAM type=del size=1795507 2024-03-09T14:33:21.993 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.994+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=AOZ0LFY2P3MK type=del 2024-03-09T14:33:21.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.995+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=4H4Y3G933CFB type=del size=475783 2024-03-09T14:33:21.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.996+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~SC8EYTNT24SD.0 size=1048576 2024-03-09T14:33:21.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.997+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~SC8EYTNT24SD.1 size=1048576 2024-03-09T14:33:21.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:21.998+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~SC8EYTNT24SD.2 size=386034 2024-03-09T14:33:21.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.000+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=SC8EYTNT24SD tag=1V36QT9NHN8W type=write size=3531762 2024-03-09T14:33:22.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.002+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~79UN40E0AI97.0 size=1048576 2024-03-09T14:33:22.002 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.003+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~79UN40E0AI97.1 size=1048576 2024-03-09T14:33:22.003 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.003+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~79UN40E0AI97.2 size=926232 2024-03-09T14:33:22.003 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.003+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=79UN40E0AI97 tag=UMF8063DTS80 type=write size=4071960 2024-03-09T14:33:22.004 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.005+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=20GMLKNTZHOT type=del 2024-03-09T14:33:22.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.006+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=8X58CF47MVGI type=del size=820499 2024-03-09T14:33:22.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.007+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=ZOHPWUM1OXXI type=del 2024-03-09T14:33:22.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.008+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=YAB45L55WRE0 type=del size=4080498 2024-03-09T14:33:22.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.008+0000 7f586ae3d780 1 < canceled part key=_multipart_NHIOOLNXLZZC.2~F59VT77JM00E.0 size=1048576 2024-03-09T14:33:22.009 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.009+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~F59VT77JM00E.1 size=1048576 2024-03-09T14:33:22.010 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.010+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~F59VT77JM00E.2 size=1036133 2024-03-09T14:33:22.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.012+0000 7f586ae3d780 1 < canceled multipart upload key=NHIOOLNXLZZC upload=F59VT77JM00E tag=ZT0FCNREX90V type=write size=4181861 2024-03-09T14:33:22.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.013+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=UMRWGOI4XTQX type=del size=3168848 2024-03-09T14:33:22.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.014+0000 7f586ae3d780 1 < canceled operation key=UO072H74SHLP tag=377KH9HAJEVO type=del size=2209225 2024-03-09T14:33:22.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.016+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~HA8GJ0HE1B5Q.0 size=1048576 2024-03-09T14:33:22.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.017+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~HA8GJ0HE1B5Q.1 size=780029 2024-03-09T14:33:22.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.017+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=HA8GJ0HE1B5Q tag=T4E3UO139NHO type=write size=2877181 2024-03-09T14:33:22.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.018+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=1KN3YBGDY4B2 type=del 2024-03-09T14:33:22.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.020+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=CEPED2R0ZEJ3 type=del size=3389752 2024-03-09T14:33:22.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.021+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=2H8YFUEGX9P2 type=del 2024-03-09T14:33:22.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.022+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=H7OYP1WZLG88 type=del size=774968 2024-03-09T14:33:22.023 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.023+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~JQKOINFWQ4L5.0 size=152941 2024-03-09T14:33:22.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.025+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=JQKOINFWQ4L5 tag=M0TSHE9NSN4R type=write size=1201517 2024-03-09T14:33:22.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.027+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~Z78OR4WA2QON.0 size=913802 2024-03-09T14:33:22.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.027+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=Z78OR4WA2QON tag=TEE1UOK6UCE5 type=write size=1962378 2024-03-09T14:33:22.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.028+0000 7f586ae3d780 1 < canceled operation key=G2BIOBESOIK9 tag=2EPJXHZWEEOO type=del size=2411242 2024-03-09T14:33:22.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.029+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=CLZ8Q1QB0LC7 type=del size=2281422 2024-03-09T14:33:22.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.030+0000 7f586ae3d780 1 < canceled part key=_multipart_OU9IOY7J572N.2~TW6ZLYTOG4XA.0 size=1030667 2024-03-09T14:33:22.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.031+0000 7f586ae3d780 1 < canceled multipart upload key=OU9IOY7J572N upload=TW6ZLYTOG4XA tag=S20FO25UV6Z0 type=write size=2079243 2024-03-09T14:33:22.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.033+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~ZDEJ1SFWR6JF.0 size=275207 2024-03-09T14:33:22.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.033+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=ZDEJ1SFWR6JF tag=WA0UDXTHZJNM type=write size=1323783 2024-03-09T14:33:22.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.034+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~32W6P7LXC5X1.0 size=1048576 2024-03-09T14:33:22.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.035+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~32W6P7LXC5X1.1 size=942318 2024-03-09T14:33:22.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.037+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=32W6P7LXC5X1 tag=30BL478LVDCI type=write size=3039470 2024-03-09T14:33:22.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.038+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=05Q35VI8P8PH type=del size=1685294 2024-03-09T14:33:22.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.040+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=EU52XZVI3JLI type=del 2024-03-09T14:33:22.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.042+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~584IRW3Q2OP1.0 size=670173 2024-03-09T14:33:22.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.042+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=584IRW3Q2OP1 tag=UQQGT9HVR46E type=write size=1718749 2024-03-09T14:33:22.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.043+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=WXTQLRNQRFWU type=del 2024-03-09T14:33:22.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.044+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=FZ2QLQI1C854 type=del size=2190032 2024-03-09T14:33:22.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.045+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=OGA12TFRHNFE type=del 2024-03-09T14:33:22.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.046+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=75OKS5WEHMND type=write size=1023482 2024-03-09T14:33:22.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.049+0000 7f586ae3d780 1 < suggested update operation key=04E9KDGUC274 tag=IOFXWJXY0OAM type=del size=1795507 2024-03-09T14:33:22.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.051+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~8LI4355EUDYI.0 size=1048576 2024-03-09T14:33:22.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.052+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~8LI4355EUDYI.1 size=972030 2024-03-09T14:33:22.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.052+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=8LI4355EUDYI tag=LQW8IR8MPMXK type=write size=3069182 2024-03-09T14:33:22.053 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.053+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=4H4Y3G933CFB type=del 2024-03-09T14:33:22.055 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.055+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~TE98TN1M3RBN.0 size=1048576 2024-03-09T14:33:22.056 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.056+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~TE98TN1M3RBN.1 size=1048576 2024-03-09T14:33:22.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.057+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~TE98TN1M3RBN.2 size=908755 2024-03-09T14:33:22.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.057+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=TE98TN1M3RBN tag=ZGC9H4M2HG3L type=write size=4054483 2024-03-09T14:33:22.058 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.059+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~79UN40E0AI97.0 size=1048576 2024-03-09T14:33:22.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.060+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~79UN40E0AI97.1 size=1048576 2024-03-09T14:33:22.060 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.061+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~79UN40E0AI97.2 size=926232 2024-03-09T14:33:22.066 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.064+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=79UN40E0AI97 tag=UMF8063DTS80 type=write size=4071960 2024-03-09T14:33:22.066 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.065+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=DAYO39P9TH8S type=del size=1527110 2024-03-09T14:33:22.066 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.066+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=8X58CF47MVGI type=del 2024-03-09T14:33:22.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.068+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~ILQYJO33JGWY.0 size=1048576 2024-03-09T14:33:22.068 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.069+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~ILQYJO33JGWY.1 size=1048576 2024-03-09T14:33:22.069 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.070+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~ILQYJO33JGWY.2 size=829061 2024-03-09T14:33:22.069 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.070+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=ILQYJO33JGWY tag=Z500P5P0QEGU type=write size=3974789 2024-03-09T14:33:22.071 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.072+0000 7f586ae3d780 1 < suggested remove operation key=FNZ3BNA7W12E tag=YAB45L55WRE0 type=del 2024-03-09T14:33:22.073 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.073+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=2BE8NPBRL9MJ type=write size=68215 2024-03-09T14:33:22.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.074+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=UMRWGOI4XTQX type=del 2024-03-09T14:33:22.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.075+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=QIFFT9ANOW8M type=write size=583818 2024-03-09T14:33:22.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.077+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~HA8GJ0HE1B5Q.0 size=1048576 2024-03-09T14:33:22.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.078+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~HA8GJ0HE1B5Q.1 size=780029 2024-03-09T14:33:22.079 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.079+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=HA8GJ0HE1B5Q tag=T4E3UO139NHO type=write size=2877181 2024-03-09T14:33:22.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.082+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~72IQI6G3AXC1.0 size=1048576 2024-03-09T14:33:22.082 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.082+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~72IQI6G3AXC1.1 size=1048576 2024-03-09T14:33:22.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.083+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~72IQI6G3AXC1.2 size=3064 2024-03-09T14:33:22.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.083+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=72IQI6G3AXC1 tag=QHT40B0DHM16 type=write size=3148792 2024-03-09T14:33:22.084 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.084+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=CEPED2R0ZEJ3 type=del 2024-03-09T14:33:22.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.086+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=HZTEZFWCJOVT type=write size=959226 2024-03-09T14:33:22.087 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.088+0000 7f586ae3d780 1 < suggested remove operation key=LRI2GKBGVCWW tag=H7OYP1WZLG88 type=del 2024-03-09T14:33:22.089 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.090+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~4BMWREDFVINY.0 size=1048576 2024-03-09T14:33:22.090 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.091+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~4BMWREDFVINY.1 size=1048576 2024-03-09T14:33:22.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.092+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~4BMWREDFVINY.2 size=934386 2024-03-09T14:33:22.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.092+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=4BMWREDFVINY tag=0NWT9RRR6JTG type=write size=4080114 2024-03-09T14:33:22.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.093+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~Z78OR4WA2QON.0 size=913802 2024-03-09T14:33:22.094 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.095+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=Z78OR4WA2QON tag=TEE1UOK6UCE5 type=write size=1962378 2024-03-09T14:33:22.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.097+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~5D3JQ95FW51P.0 size=1048576 2024-03-09T14:33:22.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.098+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~5D3JQ95FW51P.1 size=780389 2024-03-09T14:33:22.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.098+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=5D3JQ95FW51P tag=BKD89G1NTVJH type=write size=2877541 2024-03-09T14:33:22.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.099+0000 7f586ae3d780 1 < canceled operation key=P3OUIQNAK1TC tag=CLZ8Q1QB0LC7 type=del size=2281422 2024-03-09T14:33:22.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.100+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=8SXTXN82ZI20 type=write size=5191 2024-03-09T14:33:22.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.101+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~ZDEJ1SFWR6JF.0 size=275207 2024-03-09T14:33:22.103 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.103+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=ZDEJ1SFWR6JF tag=WA0UDXTHZJNM type=write size=1323783 2024-03-09T14:33:22.104 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.105+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=XJEYXXBLX87L type=del size=3855535 2024-03-09T14:33:22.105 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.106+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=05Q35VI8P8PH type=del 2024-03-09T14:33:22.106 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.107+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=ZQU4JTHUA7F2 type=write size=743159 2024-03-09T14:33:22.107 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.107+0000 7f586ae3d780 1 < canceled part key=_multipart_NHIOOLNXLZZC.2~584IRW3Q2OP1.0 size=670173 2024-03-09T14:33:22.109 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.109+0000 7f586ae3d780 1 < canceled multipart upload key=NHIOOLNXLZZC upload=584IRW3Q2OP1 tag=UQQGT9HVR46E type=write size=1718749 2024-03-09T14:33:22.111 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.111+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~EY7HFVD3VM1D.0 size=420563 2024-03-09T14:33:22.111 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.111+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=EY7HFVD3VM1D tag=4E8HE9V64N2Q type=write size=1469139 2024-03-09T14:33:22.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.112+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=FZ2QLQI1C854 type=del 2024-03-09T14:33:22.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.114+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~Y2DKKD493Q2Q.0 size=1048576 2024-03-09T14:33:22.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.115+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~Y2DKKD493Q2Q.1 size=1048576 2024-03-09T14:33:22.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.116+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~Y2DKKD493Q2Q.2 size=916677 2024-03-09T14:33:22.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.116+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=Y2DKKD493Q2Q tag=9T2XR1RFB8FT type=write size=4062405 2024-03-09T14:33:22.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.117+0000 7f586ae3d780 1 < completed write operation key=509F17DT0C4I tag=75OKS5WEHMND type=write size=1023482 2024-03-09T14:33:22.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.119+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=RAGVH29IRSIX type=write size=476555 2024-03-09T14:33:22.119 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.120+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~8LI4355EUDYI.0 size=1048576 2024-03-09T14:33:22.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.121+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~8LI4355EUDYI.1 size=972030 2024-03-09T14:33:22.122 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.123+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=8LI4355EUDYI tag=LQW8IR8MPMXK type=write size=3069182 2024-03-09T14:33:22.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.124+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=4QURVRX2YHX7 type=del size=3474794 2024-03-09T14:33:22.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.125+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~TE98TN1M3RBN.0 size=1048576 2024-03-09T14:33:22.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.125+0000 7f586ae3d780 1 < canceled part key=_multipart_BHSYRD3IEJWW.2~TE98TN1M3RBN.1 size=1048576 2024-03-09T14:33:22.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.126+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~TE98TN1M3RBN.2 size=908755 2024-03-09T14:33:22.127 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.128+0000 7f586ae3d780 1 < canceled multipart upload key=BHSYRD3IEJWW upload=TE98TN1M3RBN tag=ZGC9H4M2HG3L type=write size=4054483 2024-03-09T14:33:22.129 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.129+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=GL7LBD2K62KA type=del size=304489 2024-03-09T14:33:22.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.130+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=DAYO39P9TH8S type=del 2024-03-09T14:33:22.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.132+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=E3Z6LESR60V1 type=del size=3384001 2024-03-09T14:33:22.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.133+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~ILQYJO33JGWY.0 size=1048576 2024-03-09T14:33:22.133 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.134+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~ILQYJO33JGWY.1 size=1048576 2024-03-09T14:33:22.133 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.134+0000 7f586ae3d780 1 < canceled part key=_multipart_NHIOOLNXLZZC.2~ILQYJO33JGWY.2 size=829061 2024-03-09T14:33:22.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.136+0000 7f586ae3d780 1 < canceled multipart upload key=NHIOOLNXLZZC upload=ILQYJO33JGWY tag=Z500P5P0QEGU type=write size=3974789 2024-03-09T14:33:22.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.138+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~H73GVJUO12M8.0 size=299943 2024-03-09T14:33:22.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.138+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=H73GVJUO12M8 tag=5XNKNGV3XETM type=write size=1348519 2024-03-09T14:33:22.139 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.139+0000 7f586ae3d780 1 < canceled operation key=DGO3ZT8ST90A tag=2BE8NPBRL9MJ type=write size=68215 2024-03-09T14:33:22.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.140+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=LU6RS8IQE43M type=del size=395961 2024-03-09T14:33:22.141 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.141+0000 7f586ae3d780 1 < completed write operation key=5PERWGS0GOJU tag=QIFFT9ANOW8M type=write size=583818 2024-03-09T14:33:22.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.143+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=BFJ9OCWVK32Z type=del size=3482296 2024-03-09T14:33:22.143 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.144+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~72IQI6G3AXC1.0 size=1048576 2024-03-09T14:33:22.144 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.145+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~72IQI6G3AXC1.1 size=1048576 2024-03-09T14:33:22.145 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.146+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~72IQI6G3AXC1.2 size=3064 2024-03-09T14:33:22.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.148+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=72IQI6G3AXC1 tag=QHT40B0DHM16 type=write size=3148792 2024-03-09T14:33:22.150 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.150+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~9PDT9TJSXGOY.0 size=1048576 2024-03-09T14:33:22.151 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.152+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~9PDT9TJSXGOY.1 size=1048576 2024-03-09T14:33:22.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.153+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~9PDT9TJSXGOY.2 size=668772 2024-03-09T14:33:22.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.153+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=9PDT9TJSXGOY tag=S0IMXXHU86RL type=write size=3814500 2024-03-09T14:33:22.155 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.155+0000 7f586ae3d780 1 < suggested remove operation key=DJH53FNVMLGY tag=HZTEZFWCJOVT type=write 2024-03-09T14:33:22.157 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.158+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~53RZ7SLA7ZCS.0 size=1048576 2024-03-09T14:33:22.158 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.158+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~53RZ7SLA7ZCS.1 size=1048576 2024-03-09T14:33:22.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.159+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~53RZ7SLA7ZCS.2 size=667945 2024-03-09T14:33:22.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.159+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=53RZ7SLA7ZCS tag=N2JSMPPOYC6E type=write size=3813673 2024-03-09T14:33:22.160 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.161+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~4BMWREDFVINY.0 size=1048576 2024-03-09T14:33:22.161 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.161+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~4BMWREDFVINY.1 size=1048576 2024-03-09T14:33:22.161 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.161+0000 7f586ae3d780 1 < canceled part key=_multipart_IK528ND96157.2~4BMWREDFVINY.2 size=934386 2024-03-09T14:33:22.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.163+0000 7f586ae3d780 1 < canceled multipart upload key=IK528ND96157 upload=4BMWREDFVINY tag=0NWT9RRR6JTG type=write size=4080114 2024-03-09T14:33:22.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.165+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~XEAXYV0WSHQN.0 size=561602 2024-03-09T14:33:22.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.165+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=XEAXYV0WSHQN tag=PFEBICY9CJAG type=write size=1610178 2024-03-09T14:33:22.166 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.167+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~5D3JQ95FW51P.0 size=1048576 2024-03-09T14:33:22.166 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.167+0000 7f586ae3d780 1 < canceled part key=_multipart_0JDF7910RACF.2~5D3JQ95FW51P.1 size=780389 2024-03-09T14:33:22.168 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.169+0000 7f586ae3d780 1 < canceled multipart upload key=0JDF7910RACF upload=5D3JQ95FW51P tag=BKD89G1NTVJH type=write size=2877541 2024-03-09T14:33:22.171 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.171+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~HOUGXPKA6GJS.0 size=374144 2024-03-09T14:33:22.171 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.171+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=HOUGXPKA6GJS tag=JVGNT4DVWK4S type=write size=1422720 2024-03-09T14:33:22.173 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.174+0000 7f586ae3d780 1 < completed write operation key=2BUCMVWK7J1V tag=8SXTXN82ZI20 type=write size=5191 2024-03-09T14:33:22.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.175+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=BAEN5ZBDZ0UM type=del size=3109852 2024-03-09T14:33:22.177 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.178+0000 7f586ae3d780 1 < suggested update operation key=OU9IOY7J572N tag=XJEYXXBLX87L type=del size=3855535 2024-03-09T14:33:22.178 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.179+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=C9Z9G5UQ6EJY type=del size=380376 2024-03-09T14:33:22.180 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.181+0000 7f586ae3d780 1 < suggested remove operation key=XIYWPXSYCT6I tag=ZQU4JTHUA7F2 type=write 2024-03-09T14:33:22.182 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.183+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~7FLJGZI7S33Y.0 size=714022 2024-03-09T14:33:22.182 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.183+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=7FLJGZI7S33Y tag=VQD0X2USCZGQ type=write size=1762598 2024-03-09T14:33:22.184 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.184+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~EY7HFVD3VM1D.0 size=420563 2024-03-09T14:33:22.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.186+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=EY7HFVD3VM1D tag=4E8HE9V64N2Q type=write size=1469139 2024-03-09T14:33:22.190 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.187+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=VOV8FSAJ3EWL type=del size=3651434 2024-03-09T14:33:22.190 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.188+0000 7f586ae3d780 1 < canceled part key=_multipart_XIYWPXSYCT6I.2~Y2DKKD493Q2Q.0 size=1048576 2024-03-09T14:33:22.190 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.189+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~Y2DKKD493Q2Q.1 size=1048576 2024-03-09T14:33:22.190 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.189+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~Y2DKKD493Q2Q.2 size=916677 2024-03-09T14:33:22.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.191+0000 7f586ae3d780 1 < canceled multipart upload key=XIYWPXSYCT6I upload=Y2DKKD493Q2Q tag=9T2XR1RFB8FT type=write size=4062405 2024-03-09T14:33:22.193 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.193+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~DWPVFQNGT51F.0 size=1048576 2024-03-09T14:33:22.194 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.194+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~DWPVFQNGT51F.1 size=1048576 2024-03-09T14:33:22.195 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.195+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~DWPVFQNGT51F.2 size=124885 2024-03-09T14:33:22.195 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.195+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=DWPVFQNGT51F tag=LUO9R65TA7HY type=write size=3270613 2024-03-09T14:33:22.196 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.196+0000 7f586ae3d780 1 < canceled operation key=CZGAXNJ0GKU0 tag=RAGVH29IRSIX type=write size=476555 2024-03-09T14:33:22.197 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.197+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=9GVVDCIJ0CR0 type=del size=1243792 2024-03-09T14:33:22.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.200+0000 7f586ae3d780 1 < suggested remove operation key=O5L6RC16RS8E tag=4QURVRX2YHX7 type=del 2024-03-09T14:33:22.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.201+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=W5RDAMM46768 type=del size=837557 2024-03-09T14:33:22.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.202+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=GL7LBD2K62KA type=del 2024-03-09T14:33:22.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.204+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=KEXE8AEQGMFV type=del size=1757100 2024-03-09T14:33:22.206 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.206+0000 7f586ae3d780 1 < suggested update operation key=57OR9DHRPDCZ tag=E3Z6LESR60V1 type=del size=3384001 2024-03-09T14:33:22.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.208+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~9PBDE4IK0O2D.0 size=1048576 2024-03-09T14:33:22.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.209+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~9PBDE4IK0O2D.1 size=1002891 2024-03-09T14:33:22.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.209+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=9PBDE4IK0O2D tag=PBXG91YZ2DRH type=write size=3100043 2024-03-09T14:33:22.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.211+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~H73GVJUO12M8.0 size=299943 2024-03-09T14:33:22.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.213+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=H73GVJUO12M8 tag=5XNKNGV3XETM type=write size=1348519 2024-03-09T14:33:22.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.214+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=NR6PTARMR0O6 type=write size=172050 2024-03-09T14:33:22.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.215+0000 7f586ae3d780 1 < canceled operation key=0JDF7910RACF tag=LU6RS8IQE43M type=del size=395961 2024-03-09T14:33:22.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.218+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~VFRTB39SHUQT.0 size=1048576 2024-03-09T14:33:22.218 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.219+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~VFRTB39SHUQT.1 size=62077 2024-03-09T14:33:22.218 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.219+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=VFRTB39SHUQT tag=DGX49T9RRUGX type=write size=2159229 2024-03-09T14:33:22.219 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.220+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=BFJ9OCWVK32Z type=del 2024-03-09T14:33:22.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.222+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~3QVN84H14GLJ.0 size=1003894 2024-03-09T14:33:22.222 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.222+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=3QVN84H14GLJ tag=NS8EZB0XO3Q2 type=write size=2052470 2024-03-09T14:33:22.223 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.223+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~9PDT9TJSXGOY.0 size=1048576 2024-03-09T14:33:22.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.224+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~9PDT9TJSXGOY.1 size=1048576 2024-03-09T14:33:22.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.225+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~9PDT9TJSXGOY.2 size=668772 2024-03-09T14:33:22.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.227+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=9PDT9TJSXGOY tag=S0IMXXHU86RL type=write size=3814500 2024-03-09T14:33:22.228 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.228+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=3T55FK82IVTO type=del size=1246233 2024-03-09T14:33:22.228 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.229+0000 7f586ae3d780 1 < canceled part key=_multipart_UKPSUQ6LYWN8.2~53RZ7SLA7ZCS.0 size=1048576 2024-03-09T14:33:22.229 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.230+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~53RZ7SLA7ZCS.1 size=1048576 2024-03-09T14:33:22.230 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.231+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~53RZ7SLA7ZCS.2 size=667945 2024-03-09T14:33:22.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.233+0000 7f586ae3d780 1 < canceled multipart upload key=UKPSUQ6LYWN8 upload=53RZ7SLA7ZCS tag=N2JSMPPOYC6E type=write size=3813673 2024-03-09T14:33:22.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.235+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~PRXNDZJ6OEOY.0 size=1048576 2024-03-09T14:33:22.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.236+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~PRXNDZJ6OEOY.1 size=298956 2024-03-09T14:33:22.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.236+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=PRXNDZJ6OEOY tag=ZNK1CHU2QAUH type=write size=2396108 2024-03-09T14:33:22.236 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.237+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~XEAXYV0WSHQN.0 size=561602 2024-03-09T14:33:22.238 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.239+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=XEAXYV0WSHQN tag=PFEBICY9CJAG type=write size=1610178 2024-03-09T14:33:22.239 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.240+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=0MGT4R1UKW5Z type=del size=414743 2024-03-09T14:33:22.241 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.241+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~HOUGXPKA6GJS.0 size=374144 2024-03-09T14:33:22.242 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.243+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=HOUGXPKA6GJS tag=JVGNT4DVWK4S type=write size=1422720 2024-03-09T14:33:22.243 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.244+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=6FEV7C5KQF8Y type=del size=3242434 2024-03-09T14:33:22.245 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.245+0000 7f586ae3d780 -1 < failed to complete operation key=OU9IOY7J572N tag=BAEN5ZBDZ0UM type=del size=3109852: (22) Invalid argument 2024-03-09T14:33:22.246 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.247+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=KUORKSH911W9 type=del size=2719743 2024-03-09T14:33:22.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.248+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=C9Z9G5UQ6EJY type=del 2024-03-09T14:33:22.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.249+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=3B47WHJOC3L8 type=del size=3938809 2024-03-09T14:33:22.250 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.250+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~7FLJGZI7S33Y.0 size=714022 2024-03-09T14:33:22.252 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.252+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=7FLJGZI7S33Y tag=VQD0X2USCZGQ type=write size=1762598 2024-03-09T14:33:22.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.254+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=PMRGD7JL8LZU type=del size=160096 2024-03-09T14:33:22.256 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.256+0000 7f586ae3d780 1 < suggested remove operation key=O5L6RC16RS8E tag=VOV8FSAJ3EWL type=del 2024-03-09T14:33:22.257 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.257+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=CE22GTB85RR7 type=del size=2001198 2024-03-09T14:33:22.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.259+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~DWPVFQNGT51F.0 size=1048576 2024-03-09T14:33:22.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.260+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~DWPVFQNGT51F.1 size=1048576 2024-03-09T14:33:22.260 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.261+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~DWPVFQNGT51F.2 size=124885 2024-03-09T14:33:22.262 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.263+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=DWPVFQNGT51F tag=LUO9R65TA7HY type=write size=3270613 2024-03-09T14:33:22.264 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.264+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=3G377XLOSFP7 type=del size=985424 2024-03-09T14:33:22.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.265+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=9GVVDCIJ0CR0 type=del 2024-03-09T14:33:22.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.268+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~OM95GBR8EU1F.0 size=1048576 2024-03-09T14:33:22.268 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.269+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~OM95GBR8EU1F.1 size=980130 2024-03-09T14:33:22.268 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.269+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=OM95GBR8EU1F tag=U6D08C2B2GV1 type=write size=3077282 2024-03-09T14:33:22.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.270+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=W5RDAMM46768 type=del 2024-03-09T14:33:22.271 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.272+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~RV5J8VX0BH33.0 size=1048576 2024-03-09T14:33:22.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.273+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~RV5J8VX0BH33.1 size=1048576 2024-03-09T14:33:22.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.274+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~RV5J8VX0BH33.2 size=631587 2024-03-09T14:33:22.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.274+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=RV5J8VX0BH33 tag=Q16QQZDWTYP1 type=write size=3777315 2024-03-09T14:33:22.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.275+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=KEXE8AEQGMFV type=del 2024-03-09T14:33:22.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.276+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=8U02YLISE2SA type=del size=3744645 2024-03-09T14:33:22.277 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.277+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~9PBDE4IK0O2D.0 size=1048576 2024-03-09T14:33:22.277 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.278+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~9PBDE4IK0O2D.1 size=1002891 2024-03-09T14:33:22.279 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.280+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=9PBDE4IK0O2D tag=PBXG91YZ2DRH type=write size=3100043 2024-03-09T14:33:22.282 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.283+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~XUCR65R5SV1T.0 size=1048576 2024-03-09T14:33:22.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.284+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~XUCR65R5SV1T.1 size=647861 2024-03-09T14:33:22.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.284+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=XUCR65R5SV1T tag=AM0F6B265R0B type=write size=2745013 2024-03-09T14:33:22.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.285+0000 7f586ae3d780 1 < canceled operation key=W4Q1MWHOQ4Y1 tag=NR6PTARMR0O6 type=write size=172050 2024-03-09T14:33:22.285 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.286+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=WPYG3NAJCI79 type=del size=1334176 2024-03-09T14:33:22.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.287+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~VFRTB39SHUQT.0 size=1048576 2024-03-09T14:33:22.287 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.288+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~VFRTB39SHUQT.1 size=62077 2024-03-09T14:33:22.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.290+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=VFRTB39SHUQT tag=DGX49T9RRUGX type=write size=2159229 2024-03-09T14:33:22.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.292+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~CZGMIQ2HJSX7.0 size=1048576 2024-03-09T14:33:22.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.293+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~CZGMIQ2HJSX7.1 size=1048576 2024-03-09T14:33:22.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.294+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~CZGMIQ2HJSX7.2 size=250351 2024-03-09T14:33:22.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.294+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=CZGMIQ2HJSX7 tag=QQHX5TYSY3BZ type=write size=3396079 2024-03-09T14:33:22.294 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.295+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~3QVN84H14GLJ.0 size=1003894 2024-03-09T14:33:22.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.297+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=3QVN84H14GLJ tag=NS8EZB0XO3Q2 type=write size=2052470 2024-03-09T14:33:22.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.298+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=LROLK2CFJMV7 type=del size=2499071 2024-03-09T14:33:22.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.299+0000 7f586ae3d780 -1 < failed to complete operation key=O5L6RC16RS8E tag=3T55FK82IVTO type=del size=1246233: (22) Invalid argument 2024-03-09T14:33:22.300 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.301+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=8UE690RL5RC3 type=write size=525192 2024-03-09T14:33:22.301 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.302+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~PRXNDZJ6OEOY.0 size=1048576 2024-03-09T14:33:22.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.303+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~PRXNDZJ6OEOY.1 size=298956 2024-03-09T14:33:22.304 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.305+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=PRXNDZJ6OEOY tag=ZNK1CHU2QAUH type=write size=2396108 2024-03-09T14:33:22.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.306+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=NJND0NBB1YHH type=del size=928755 2024-03-09T14:33:22.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.307+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=0MGT4R1UKW5Z type=del 2024-03-09T14:33:22.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.308+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=HWX3A0BIJ3GR type=del size=1462184 2024-03-09T14:33:22.309 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.309+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=6FEV7C5KQF8Y type=del 2024-03-09T14:33:22.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.310+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=LDVZREYPSGXI type=del size=501332 2024-03-09T14:33:22.311 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.311+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=KUORKSH911W9 type=del 2024-03-09T14:33:22.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.313+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~D0K3JIC3IC37.0 size=1048576 2024-03-09T14:33:22.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.314+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~D0K3JIC3IC37.1 size=1048576 2024-03-09T14:33:22.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.315+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~D0K3JIC3IC37.2 size=265969 2024-03-09T14:33:22.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.315+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=D0K3JIC3IC37 tag=2THBHMOI7FT0 type=write size=3411697 2024-03-09T14:33:22.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.316+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=3B47WHJOC3L8 type=del 2024-03-09T14:33:22.317 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.317+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=F7ON57T47RA2 type=write size=175832 2024-03-09T14:33:22.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.320+0000 7f586ae3d780 1 < suggested update operation key=5PERWGS0GOJU tag=PMRGD7JL8LZU type=del size=160096 2024-03-09T14:33:22.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.321+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=64CIG4Q46DYQ type=del size=885604 2024-03-09T14:33:22.321 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.322+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=CE22GTB85RR7 type=del 2024-03-09T14:33:22.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.324+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~43IZ4V7MEYEY.0 size=650655 2024-03-09T14:33:22.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.324+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=43IZ4V7MEYEY tag=T8OPPSBS0TMO type=write size=1699231 2024-03-09T14:33:22.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.325+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=3G377XLOSFP7 type=del 2024-03-09T14:33:22.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.326+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=42RFX3PY82QU type=del size=2126261 2024-03-09T14:33:22.327 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.327+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~OM95GBR8EU1F.0 size=1048576 2024-03-09T14:33:22.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.328+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~OM95GBR8EU1F.1 size=980130 2024-03-09T14:33:22.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.330+0000 7f586ae3d780 1 < completed multipart upload key=LRI2GKBGVCWW upload=OM95GBR8EU1F tag=U6D08C2B2GV1 type=write size=3077282 2024-03-09T14:33:22.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.332+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=RBOTJ0UZGQ0J type=del size=700532 2024-03-09T14:33:22.332 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.333+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~RV5J8VX0BH33.0 size=1048576 2024-03-09T14:33:22.333 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.334+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~RV5J8VX0BH33.1 size=1048576 2024-03-09T14:33:22.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.335+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~RV5J8VX0BH33.2 size=631587 2024-03-09T14:33:22.336 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.337+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=RV5J8VX0BH33 tag=Q16QQZDWTYP1 type=write size=3777315 2024-03-09T14:33:22.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.338+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=2P9KM0475RYA type=write size=516535 2024-03-09T14:33:22.339 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.339+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=8U02YLISE2SA type=del 2024-03-09T14:33:22.340 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.341+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=1TUKA23KB9X9 type=del size=1781439 2024-03-09T14:33:22.341 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.342+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~XUCR65R5SV1T.0 size=1048576 2024-03-09T14:33:22.342 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.343+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~XUCR65R5SV1T.1 size=647861 2024-03-09T14:33:22.344 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.345+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=XUCR65R5SV1T tag=AM0F6B265R0B type=write size=2745013 2024-03-09T14:33:22.346 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.346+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=Q2XA2LWUMYU4 type=del size=3331711 2024-03-09T14:33:22.347 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.347+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=WPYG3NAJCI79 type=del 2024-03-09T14:33:22.348 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.349+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=NLEIYZSS2DCE type=write size=687476 2024-03-09T14:33:22.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.350+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~CZGMIQ2HJSX7.0 size=1048576 2024-03-09T14:33:22.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.351+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~CZGMIQ2HJSX7.1 size=1048576 2024-03-09T14:33:22.351 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.352+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~CZGMIQ2HJSX7.2 size=250351 2024-03-09T14:33:22.353 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.354+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=CZGMIQ2HJSX7 tag=QQHX5TYSY3BZ type=write size=3396079 2024-03-09T14:33:22.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.355+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=X1TPT2UL2XMD type=del size=3740912 2024-03-09T14:33:22.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.356+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=LROLK2CFJMV7 type=del 2024-03-09T14:33:22.357 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.357+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=FZUXMSCZ5WW9 type=write size=449938 2024-03-09T14:33:22.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.359+0000 7f586ae3d780 -1 < failed to complete operation key=5PERWGS0GOJU tag=8UE690RL5RC3 type=write size=525192: (22) Invalid argument 2024-03-09T14:33:22.360 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.361+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~CKHWXTLSGEOR.0 size=1048576 2024-03-09T14:33:22.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.362+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~CKHWXTLSGEOR.1 size=1048576 2024-03-09T14:33:22.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.363+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~CKHWXTLSGEOR.2 size=909769 2024-03-09T14:33:22.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.363+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=CKHWXTLSGEOR tag=3EYJWY3RPQ2T type=write size=4055497 2024-03-09T14:33:22.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.364+0000 7f586ae3d780 1 < canceled operation key=WNVN3EOUUBGR tag=NJND0NBB1YHH type=del size=928755 2024-03-09T14:33:22.365 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.366+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=75H2PUJUYVN7 type=del size=2076801 2024-03-09T14:33:22.366 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.367+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=HWX3A0BIJ3GR type=del 2024-03-09T14:33:22.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.368+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=FVSGD4NQ6UAG type=del size=2389942 2024-03-09T14:33:22.369 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.369+0000 7f586ae3d780 1 < canceled operation key=P3OUIQNAK1TC tag=LDVZREYPSGXI type=del size=501332 2024-03-09T14:33:22.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.372+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~J7VPI8EA710P.0 size=785800 2024-03-09T14:33:22.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.372+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=J7VPI8EA710P tag=L4QAEZ3ZYITB type=write size=1834376 2024-03-09T14:33:22.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.373+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~D0K3JIC3IC37.0 size=1048576 2024-03-09T14:33:22.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.373+0000 7f586ae3d780 1 < canceled part key=_multipart_39ZIGOC6JZ1R.2~D0K3JIC3IC37.1 size=1048576 2024-03-09T14:33:22.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.374+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~D0K3JIC3IC37.2 size=265969 2024-03-09T14:33:22.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.376+0000 7f586ae3d780 1 < canceled multipart upload key=39ZIGOC6JZ1R upload=D0K3JIC3IC37 tag=2THBHMOI7FT0 type=write size=3411697 2024-03-09T14:33:22.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.378+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~GB8985EQE3KQ.0 size=1048576 2024-03-09T14:33:22.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.379+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~GB8985EQE3KQ.1 size=6952 2024-03-09T14:33:22.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.379+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=GB8985EQE3KQ tag=XPGJIMMIX3R3 type=write size=2104104 2024-03-09T14:33:22.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.380+0000 7f586ae3d780 1 < completed write operation key=2BUCMVWK7J1V tag=F7ON57T47RA2 type=write size=175832 2024-03-09T14:33:22.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.382+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=52WD4RV9OKUY type=del size=817602 2024-03-09T14:33:22.382 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.383+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=64CIG4Q46DYQ type=del 2024-03-09T14:33:22.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.384+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=VUR6YQVA5FZ0 type=del size=2814602 2024-03-09T14:33:22.385 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.385+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~43IZ4V7MEYEY.0 size=650655 2024-03-09T14:33:22.387 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.387+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=43IZ4V7MEYEY tag=T8OPPSBS0TMO type=write size=1699231 2024-03-09T14:33:22.388 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.389+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=X2U9O0QJP290 type=write size=258133 2024-03-09T14:33:22.389 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.390+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=42RFX3PY82QU type=del 2024-03-09T14:33:22.391 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.391+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=XP1JEU9SOKQN type=write size=566047 2024-03-09T14:33:22.392 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.392+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=RBOTJ0UZGQ0J type=del 2024-03-09T14:33:22.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.394+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=OJW70QLAA8ZO type=del size=805493 2024-03-09T14:33:22.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.396+0000 7f586ae3d780 1 < completed write operation key=CAISZZZSOD34 tag=2P9KM0475RYA type=write size=516535 2024-03-09T14:33:22.396 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.397+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=HYGRK6MDKO9U type=del size=3381042 2024-03-09T14:33:22.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.398+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=1TUKA23KB9X9 type=del 2024-03-09T14:33:22.400 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.401+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~1JQ247BYEVK4.0 size=928671 2024-03-09T14:33:22.400 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.401+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=1JQ247BYEVK4 tag=UNEQCMJGB39X type=write size=1977247 2024-03-09T14:33:22.402 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.402+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=Q2XA2LWUMYU4 type=del 2024-03-09T14:33:22.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.404+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~HAIHRQY94JJV.0 size=1048576 2024-03-09T14:33:22.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.405+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~HAIHRQY94JJV.1 size=1048576 2024-03-09T14:33:22.405 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.406+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~HAIHRQY94JJV.2 size=129876 2024-03-09T14:33:22.405 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.406+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=HAIHRQY94JJV tag=TBG83EC6C9IE type=write size=3275604 2024-03-09T14:33:22.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.407+0000 7f586ae3d780 1 < canceled operation key=WNVN3EOUUBGR tag=NLEIYZSS2DCE type=write size=687476 2024-03-09T14:33:22.408 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.409+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~9YO6MBMSSADX.0 size=1048576 2024-03-09T14:33:22.409 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.410+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~9YO6MBMSSADX.1 size=1048576 2024-03-09T14:33:22.410 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.411+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~9YO6MBMSSADX.2 size=11001 2024-03-09T14:33:22.410 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.411+0000 7f586ae3d780 1 > prepared multipart upload key=C1UGQOQ6AE1E upload=9YO6MBMSSADX tag=CKLEMBMQGG96 type=write size=3156729 2024-03-09T14:33:22.411 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.412+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=X1TPT2UL2XMD type=del 2024-03-09T14:33:22.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.413+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=1C153F0IPOJX type=del size=1441473 2024-03-09T14:33:22.414 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.414+0000 7f586ae3d780 1 < completed write operation key=CZGAXNJ0GKU0 tag=FZUXMSCZ5WW9 type=write size=449938 2024-03-09T14:33:22.415 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.415+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=QPG8FDW3OKFL type=del size=2330401 2024-03-09T14:33:22.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.416+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~CKHWXTLSGEOR.0 size=1048576 2024-03-09T14:33:22.417 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.417+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~CKHWXTLSGEOR.1 size=1048576 2024-03-09T14:33:22.418 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.418+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~CKHWXTLSGEOR.2 size=909769 2024-03-09T14:33:22.419 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.420+0000 7f586ae3d780 1 < completed multipart upload key=IK528ND96157 upload=CKHWXTLSGEOR tag=3EYJWY3RPQ2T type=write size=4055497 2024-03-09T14:33:22.421 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.422+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~BVHX519HVQS4.0 size=1048576 2024-03-09T14:33:22.422 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.423+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~BVHX519HVQS4.1 size=1048576 2024-03-09T14:33:22.423 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.424+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~BVHX519HVQS4.2 size=122844 2024-03-09T14:33:22.423 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.424+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=BVHX519HVQS4 tag=2DPNBDI5P4GD type=write size=3268572 2024-03-09T14:33:22.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.425+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=75H2PUJUYVN7 type=del 2024-03-09T14:33:22.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.426+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=SURN10WXXR5O type=del size=3975565 2024-03-09T14:33:22.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.427+0000 7f586ae3d780 1 < completed delete operation key=NHIOOLNXLZZC tag=FVSGD4NQ6UAG type=del 2024-03-09T14:33:22.428 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.428+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=N8J2ZSZ6VH5F type=del size=1535186 2024-03-09T14:33:22.429 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.430+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~J7VPI8EA710P.0 size=785800 2024-03-09T14:33:22.431 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.431+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=J7VPI8EA710P tag=L4QAEZ3ZYITB type=write size=1834376 2024-03-09T14:33:22.433 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.433+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~K0ZQXWC6A25E.0 size=1016150 2024-03-09T14:33:22.433 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.433+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=K0ZQXWC6A25E tag=YLWBVK14RAII type=write size=2064726 2024-03-09T14:33:22.434 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.434+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~GB8985EQE3KQ.0 size=1048576 2024-03-09T14:33:22.435 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.435+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~GB8985EQE3KQ.1 size=6952 2024-03-09T14:33:22.437 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.437+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=GB8985EQE3KQ tag=XPGJIMMIX3R3 type=write size=2104104 2024-03-09T14:33:22.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.439+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~UNCRI2QO7O8I.0 size=845520 2024-03-09T14:33:22.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.439+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=UNCRI2QO7O8I tag=MGFJW4L5RG6W type=write size=1894096 2024-03-09T14:33:22.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.440+0000 7f586ae3d780 1 < canceled operation key=CZGAXNJ0GKU0 tag=52WD4RV9OKUY type=del size=817602 2024-03-09T14:33:22.441 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.441+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=S6K4ORG117ER type=del size=3018364 2024-03-09T14:33:22.443 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.444+0000 7f586ae3d780 1 < suggested remove operation key=NHIOOLNXLZZC tag=VUR6YQVA5FZ0 type=del 2024-03-09T14:33:22.444 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.445+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=QP4DN9TJ8F6E type=del size=3449906 2024-03-09T14:33:22.446 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.447+0000 7f586ae3d780 1 < suggested update operation key=IK528ND96157 tag=X2U9O0QJP290 type=write size=258133 2024-03-09T14:33:22.448 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.448+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=BMSLVLIX7DLO type=write size=1019784 2024-03-09T14:33:22.449 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.449+0000 7f586ae3d780 1 < completed write operation key=0JDF7910RACF tag=XP1JEU9SOKQN type=write size=566047 2024-03-09T14:33:22.451 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.451+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~9I7PEHZO2XPR.0 size=69988 2024-03-09T14:33:22.451 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.451+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=9I7PEHZO2XPR tag=TQ1Q0X0ZY5UQ type=write size=1118564 2024-03-09T14:33:22.452 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.452+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=OJW70QLAA8ZO type=del 2024-03-09T14:33:22.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.454+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=GYG2H93CPDQA type=del size=1943485 2024-03-09T14:33:22.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.455+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=HYGRK6MDKO9U type=del 2024-03-09T14:33:22.456 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.457+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~3L2DENDIJSP7.0 size=925211 2024-03-09T14:33:22.456 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.457+0000 7f586ae3d780 1 > prepared multipart upload key=C1UGQOQ6AE1E upload=3L2DENDIJSP7 tag=KWC72GN0W3E7 type=write size=1973787 2024-03-09T14:33:22.457 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.458+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~1JQ247BYEVK4.0 size=928671 2024-03-09T14:33:22.459 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.460+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=1JQ247BYEVK4 tag=UNEQCMJGB39X type=write size=1977247 2024-03-09T14:33:22.460 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.461+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=O2H57ZMC9MCE type=del size=3094816 2024-03-09T14:33:22.461 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.461+0000 7f586ae3d780 1 < canceled part key=_multipart_5PERWGS0GOJU.2~HAIHRQY94JJV.0 size=1048576 2024-03-09T14:33:22.461 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.462+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~HAIHRQY94JJV.1 size=1048576 2024-03-09T14:33:22.462 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.463+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~HAIHRQY94JJV.2 size=129876 2024-03-09T14:33:22.464 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.465+0000 7f586ae3d780 1 < canceled multipart upload key=5PERWGS0GOJU upload=HAIHRQY94JJV tag=TBG83EC6C9IE type=write size=3275604 2024-03-09T14:33:22.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.466+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=WCE2KS0SFUDZ type=del size=842260 2024-03-09T14:33:22.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.467+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~9YO6MBMSSADX.0 size=1048576 2024-03-09T14:33:22.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.468+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~9YO6MBMSSADX.1 size=1048576 2024-03-09T14:33:22.468 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.469+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~9YO6MBMSSADX.2 size=11001 2024-03-09T14:33:22.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.471+0000 7f586ae3d780 1 < completed multipart upload key=C1UGQOQ6AE1E upload=9YO6MBMSSADX tag=CKLEMBMQGG96 type=write size=3156729 2024-03-09T14:33:22.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.473+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~VZM3Y4E52X0Z.0 size=1048576 2024-03-09T14:33:22.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.474+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~VZM3Y4E52X0Z.1 size=958779 2024-03-09T14:33:22.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.474+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=VZM3Y4E52X0Z tag=CRX2DWVCLVXO type=write size=3055931 2024-03-09T14:33:22.478 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.475+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=1C153F0IPOJX type=del 2024-03-09T14:33:22.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.477+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~YFKAIGVUGLWZ.0 size=1048576 2024-03-09T14:33:22.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.478+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~YFKAIGVUGLWZ.1 size=980677 2024-03-09T14:33:22.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.478+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=YFKAIGVUGLWZ tag=FFNHSVRJ9MBV type=write size=3077829 2024-03-09T14:33:22.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.480+0000 7f586ae3d780 1 < canceled operation key=P3OUIQNAK1TC tag=QPG8FDW3OKFL type=del size=2330401 2024-03-09T14:33:22.480 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.481+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=F4CVPLWVCP4C type=del size=2628396 2024-03-09T14:33:22.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.482+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~BVHX519HVQS4.0 size=1048576 2024-03-09T14:33:22.482 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.483+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~BVHX519HVQS4.1 size=1048576 2024-03-09T14:33:22.483 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.484+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~BVHX519HVQS4.2 size=122844 2024-03-09T14:33:22.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.486+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=BVHX519HVQS4 tag=2DPNBDI5P4GD type=write size=3268572 2024-03-09T14:33:22.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.488+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~4401TZ7O23Y5.0 size=1048576 2024-03-09T14:33:22.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.489+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~4401TZ7O23Y5.1 size=585506 2024-03-09T14:33:22.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.489+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=4401TZ7O23Y5 tag=1HW1P52L4M8E type=write size=2682658 2024-03-09T14:33:22.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.490+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=SURN10WXXR5O type=del 2024-03-09T14:33:22.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.491+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=DZ5SJT37IQO9 type=del size=110114 2024-03-09T14:33:22.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.492+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=N8J2ZSZ6VH5F type=del 2024-03-09T14:33:22.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.493+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=WSR4W7DQX824 type=del size=3031870 2024-03-09T14:33:22.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.494+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~K0ZQXWC6A25E.0 size=1016150 2024-03-09T14:33:22.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.496+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=K0ZQXWC6A25E tag=YLWBVK14RAII type=write size=2064726 2024-03-09T14:33:22.497 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.497+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=25I1I5DIV92N type=del size=1704249 2024-03-09T14:33:22.498 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.499+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~UNCRI2QO7O8I.0 size=845520 2024-03-09T14:33:22.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.501+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=UNCRI2QO7O8I tag=MGFJW4L5RG6W type=write size=1894096 2024-03-09T14:33:22.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.502+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=RLAWRPFO3GOQ type=del size=1677014 2024-03-09T14:33:22.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.503+0000 7f586ae3d780 -1 < failed to complete operation key=IK528ND96157 tag=S6K4ORG117ER type=del size=3018364: (22) Invalid argument 2024-03-09T14:33:22.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.505+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=IO82AV2IP25Z type=del size=1239395 2024-03-09T14:33:22.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.506+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=QP4DN9TJ8F6E type=del 2024-03-09T14:33:22.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.508+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~BB076GGKHRI5.0 size=1048576 2024-03-09T14:33:22.508 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.508+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~BB076GGKHRI5.1 size=1048576 2024-03-09T14:33:22.509 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.509+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~BB076GGKHRI5.2 size=995659 2024-03-09T14:33:22.509 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.509+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=BB076GGKHRI5 tag=XK3X94N1I5B8 type=write size=4141387 2024-03-09T14:33:22.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.511+0000 7f586ae3d780 1 < completed write operation key=XIYWPXSYCT6I tag=BMSLVLIX7DLO type=write size=1019784 2024-03-09T14:33:22.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.512+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=OOBCTQUA9YL6 type=write size=981193 2024-03-09T14:33:22.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.512+0000 7f586ae3d780 1 < canceled part key=_multipart_OU9IOY7J572N.2~9I7PEHZO2XPR.0 size=69988 2024-03-09T14:33:22.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.514+0000 7f586ae3d780 1 < canceled multipart upload key=OU9IOY7J572N upload=9I7PEHZO2XPR tag=TQ1Q0X0ZY5UQ type=write size=1118564 2024-03-09T14:33:22.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.515+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=WVSDYWM4UVNQ type=del size=933489 2024-03-09T14:33:22.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.517+0000 7f586ae3d780 1 < suggested remove operation key=0JDF7910RACF tag=GYG2H93CPDQA type=del 2024-03-09T14:33:22.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.519+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~QD0VLWHBWCQV.0 size=1048576 2024-03-09T14:33:22.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.520+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~QD0VLWHBWCQV.1 size=972662 2024-03-09T14:33:22.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.520+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=QD0VLWHBWCQV tag=ZRVN1RSO3WDF type=write size=3069814 2024-03-09T14:33:22.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.521+0000 7f586ae3d780 1 < canceled part key=_multipart_C1UGQOQ6AE1E.2~3L2DENDIJSP7.0 size=925211 2024-03-09T14:33:22.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.522+0000 7f586ae3d780 1 < canceled multipart upload key=C1UGQOQ6AE1E upload=3L2DENDIJSP7 tag=KWC72GN0W3E7 type=write size=1973787 2024-03-09T14:33:22.523 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.523+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=65H6V0THHL5Y type=write size=797690 2024-03-09T14:33:22.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.526+0000 7f586ae3d780 1 < suggested update operation key=9ZPCSBP3P58P tag=O2H57ZMC9MCE type=del size=3094816 2024-03-09T14:33:22.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.528+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~LC5V240YBGWE.0 size=1048576 2024-03-09T14:33:22.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.529+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~LC5V240YBGWE.1 size=928706 2024-03-09T14:33:22.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.529+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=LC5V240YBGWE tag=IDOQ6VMHD8VF type=write size=3025858 2024-03-09T14:33:22.530 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.531+0000 7f586ae3d780 1 < suggested remove operation key=2BUCMVWK7J1V tag=WCE2KS0SFUDZ type=del 2024-03-09T14:33:22.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.532+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=E3XR3FV537LA type=del size=4091439 2024-03-09T14:33:22.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.533+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~VZM3Y4E52X0Z.0 size=1048576 2024-03-09T14:33:22.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.534+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~VZM3Y4E52X0Z.1 size=958779 2024-03-09T14:33:22.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.536+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=VZM3Y4E52X0Z tag=CRX2DWVCLVXO type=write size=3055931 2024-03-09T14:33:22.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.537+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=0HKYAE4HOP5M type=write size=945445 2024-03-09T14:33:22.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.537+0000 7f586ae3d780 1 < canceled part key=_multipart_39ZIGOC6JZ1R.2~YFKAIGVUGLWZ.0 size=1048576 2024-03-09T14:33:22.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.538+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~YFKAIGVUGLWZ.1 size=980677 2024-03-09T14:33:22.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.540+0000 7f586ae3d780 1 < canceled multipart upload key=39ZIGOC6JZ1R upload=YFKAIGVUGLWZ tag=FFNHSVRJ9MBV type=write size=3077829 2024-03-09T14:33:22.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.542+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~R9SN590HGEDH.0 size=205943 2024-03-09T14:33:22.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.542+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=R9SN590HGEDH tag=JKT1U63340S0 type=write size=1254519 2024-03-09T14:33:22.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.545+0000 7f586ae3d780 1 < suggested update operation key=DGO3ZT8ST90A tag=F4CVPLWVCP4C type=del size=2628396 2024-03-09T14:33:22.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.547+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~NBJ280NA984N.0 size=1048576 2024-03-09T14:33:22.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.548+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~NBJ280NA984N.1 size=475868 2024-03-09T14:33:22.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.548+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=NBJ280NA984N tag=OIR4W1H9ZE0R type=write size=2573020 2024-03-09T14:33:22.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.549+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~4401TZ7O23Y5.0 size=1048576 2024-03-09T14:33:22.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.550+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~4401TZ7O23Y5.1 size=585506 2024-03-09T14:33:22.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.552+0000 7f586ae3d780 1 < completed multipart upload key=LRI2GKBGVCWW upload=4401TZ7O23Y5 tag=1HW1P52L4M8E type=write size=2682658 2024-03-09T14:33:22.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.553+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=L0OMNXA99BDE type=del size=2632888 2024-03-09T14:33:22.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.554+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=DZ5SJT37IQO9 type=del 2024-03-09T14:33:22.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.555+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=VOCWK4929DKO type=del size=3245532 2024-03-09T14:33:22.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.556+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=WSR4W7DQX824 type=del 2024-03-09T14:33:22.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.558+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~NOR6C6U07ACY.0 size=784794 2024-03-09T14:33:22.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.558+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=NOR6C6U07ACY tag=799FG7GGGW31 type=write size=1833370 2024-03-09T14:33:22.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.560+0000 7f586ae3d780 1 < suggested update operation key=XIYWPXSYCT6I tag=25I1I5DIV92N type=del size=1704249 2024-03-09T14:33:22.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.562+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=Q3PTH3Z33S6M type=write size=727836 2024-03-09T14:33:22.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.563+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=RLAWRPFO3GOQ type=del 2024-03-09T14:33:22.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.564+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=SZ3PN8V10Q5J type=del size=3427948 2024-03-09T14:33:22.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.565+0000 7f586ae3d780 -1 < failed to complete operation key=XIYWPXSYCT6I tag=IO82AV2IP25Z type=del size=1239395: (22) Invalid argument 2024-03-09T14:33:22.567 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.567+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~DNANNHJMUZDB.0 size=1048576 2024-03-09T14:33:22.568 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.568+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~DNANNHJMUZDB.1 size=657878 2024-03-09T14:33:22.568 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.568+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=DNANNHJMUZDB tag=CK1TSH80XBR0 type=write size=2755030 2024-03-09T14:33:22.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.569+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~BB076GGKHRI5.0 size=1048576 2024-03-09T14:33:22.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.569+0000 7f586ae3d780 1 < canceled part key=_multipart_5PERWGS0GOJU.2~BB076GGKHRI5.1 size=1048576 2024-03-09T14:33:22.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.570+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~BB076GGKHRI5.2 size=995659 2024-03-09T14:33:22.573 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.573+0000 7f586ae3d780 1 < canceled multipart upload key=5PERWGS0GOJU upload=BB076GGKHRI5 tag=XK3X94N1I5B8 type=write size=4141387 2024-03-09T14:33:22.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.575+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~ERWJR5OOSTBD.0 size=1048576 2024-03-09T14:33:22.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.576+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~ERWJR5OOSTBD.1 size=1048576 2024-03-09T14:33:22.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.577+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~ERWJR5OOSTBD.2 size=376254 2024-03-09T14:33:22.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.577+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=ERWJR5OOSTBD tag=05CGUGOSV95S type=write size=3521982 2024-03-09T14:33:22.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.579+0000 7f586ae3d780 1 < completed write operation key=5PERWGS0GOJU tag=OOBCTQUA9YL6 type=write size=981193 2024-03-09T14:33:22.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.580+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=TLY2RG2LXBUT type=del size=3396005 2024-03-09T14:33:22.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.581+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=WVSDYWM4UVNQ type=del 2024-03-09T14:33:22.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.582+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=KTMS7FGXT3KN type=del size=2352500 2024-03-09T14:33:22.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.583+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~QD0VLWHBWCQV.0 size=1048576 2024-03-09T14:33:22.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.584+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~QD0VLWHBWCQV.1 size=972662 2024-03-09T14:33:22.585 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.586+0000 7f586ae3d780 1 < completed multipart upload key=LRI2GKBGVCWW upload=QD0VLWHBWCQV tag=ZRVN1RSO3WDF type=write size=3069814 2024-03-09T14:33:22.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.587+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=1R0ZI495ZASF type=write size=1041972 2024-03-09T14:33:22.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.590+0000 7f586ae3d780 1 < suggested update operation key=509F17DT0C4I tag=65H6V0THHL5Y type=write size=797690 2024-03-09T14:33:22.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.591+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=ETLIBKCM0AYM type=write size=934439 2024-03-09T14:33:22.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.592+0000 7f586ae3d780 1 < canceled part key=_multipart_NHIOOLNXLZZC.2~LC5V240YBGWE.0 size=1048576 2024-03-09T14:33:22.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.592+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~LC5V240YBGWE.1 size=928706 2024-03-09T14:33:22.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.594+0000 7f586ae3d780 1 < canceled multipart upload key=NHIOOLNXLZZC upload=LC5V240YBGWE tag=IDOQ6VMHD8VF type=write size=3025858 2024-03-09T14:33:22.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.595+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=P6A41LZNWRUW type=del size=1054898 2024-03-09T14:33:22.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.597+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=E3XR3FV537LA type=del 2024-03-09T14:33:22.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.599+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~KESK68EJN85U.0 size=1048576 2024-03-09T14:33:22.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.600+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~KESK68EJN85U.1 size=1048576 2024-03-09T14:33:22.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.600+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~KESK68EJN85U.2 size=104272 2024-03-09T14:33:22.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.600+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=KESK68EJN85U tag=O2DZ8BSHETZZ type=write size=3250000 2024-03-09T14:33:22.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.602+0000 7f586ae3d780 1 < completed write operation key=UAYZ55UT77VE tag=0HKYAE4HOP5M type=write size=945445 2024-03-09T14:33:22.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.604+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~KVZD169KQFOP.0 size=615856 2024-03-09T14:33:22.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.604+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=KVZD169KQFOP tag=IWS9RI8Z4YFW type=write size=1664432 2024-03-09T14:33:22.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.605+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~R9SN590HGEDH.0 size=205943 2024-03-09T14:33:22.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.607+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=R9SN590HGEDH tag=JKT1U63340S0 type=write size=1254519 2024-03-09T14:33:22.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.609+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=RFIRNA6XSQ7K type=write size=350939 2024-03-09T14:33:22.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.610+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~NBJ280NA984N.0 size=1048576 2024-03-09T14:33:22.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.611+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~NBJ280NA984N.1 size=475868 2024-03-09T14:33:22.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.613+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=NBJ280NA984N tag=OIR4W1H9ZE0R type=write size=2573020 2024-03-09T14:33:22.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.614+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=76NAXY2NK4EA type=write size=450927 2024-03-09T14:33:22.615 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.615+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=L0OMNXA99BDE type=del 2024-03-09T14:33:22.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.618+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~WCKPRHAQF2A5.0 size=1048576 2024-03-09T14:33:22.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.619+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~WCKPRHAQF2A5.1 size=1048576 2024-03-09T14:33:22.619 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.620+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~WCKPRHAQF2A5.2 size=470689 2024-03-09T14:33:22.619 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.620+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=WCKPRHAQF2A5 tag=RESW8DL7N4U8 type=write size=3616417 2024-03-09T14:33:22.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.621+0000 7f586ae3d780 1 < canceled operation key=DGO3ZT8ST90A tag=VOCWK4929DKO type=del size=3245532 2024-03-09T14:33:22.622 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.622+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=X8YNUVLFCXTN type=del size=2824480 2024-03-09T14:33:22.623 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.623+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~NOR6C6U07ACY.0 size=784794 2024-03-09T14:33:22.625 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.626+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=NOR6C6U07ACY tag=799FG7GGGW31 type=write size=1833370 2024-03-09T14:33:22.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.628+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~2K1U710NX3O6.0 size=1048576 2024-03-09T14:33:22.628 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.629+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~2K1U710NX3O6.1 size=276254 2024-03-09T14:33:22.628 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.629+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=2K1U710NX3O6 tag=91RCY33ADRHI type=write size=2373406 2024-03-09T14:33:22.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.630+0000 7f586ae3d780 1 < completed write operation key=78Y2ZM3W6EUC tag=Q3PTH3Z33S6M type=write size=727836 2024-03-09T14:33:22.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.632+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~MDAU7BH9171X.0 size=1048576 2024-03-09T14:33:22.633 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.633+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~MDAU7BH9171X.1 size=501373 2024-03-09T14:33:22.633 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.633+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=MDAU7BH9171X tag=IRAJ2Q2OWYY0 type=write size=2598525 2024-03-09T14:33:22.635 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.635+0000 7f586ae3d780 1 < suggested remove operation key=W4Q1MWHOQ4Y1 tag=SZ3PN8V10Q5J type=del 2024-03-09T14:33:22.636 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.637+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=DSXCPKTGBVXC type=write size=345006 2024-03-09T14:33:22.638 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.638+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~DNANNHJMUZDB.0 size=1048576 2024-03-09T14:33:22.639 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.639+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~DNANNHJMUZDB.1 size=657878 2024-03-09T14:33:22.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.641+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=DNANNHJMUZDB tag=CK1TSH80XBR0 type=write size=2755030 2024-03-09T14:33:22.643 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.644+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~2YZYG5C5LRAT.0 size=1048576 2024-03-09T14:33:22.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.645+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~2YZYG5C5LRAT.1 size=1048576 2024-03-09T14:33:22.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.646+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~2YZYG5C5LRAT.2 size=863712 2024-03-09T14:33:22.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.646+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=2YZYG5C5LRAT tag=P853HOD5R5QG type=write size=4009440 2024-03-09T14:33:22.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.647+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~ERWJR5OOSTBD.0 size=1048576 2024-03-09T14:33:22.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.648+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~ERWJR5OOSTBD.1 size=1048576 2024-03-09T14:33:22.649 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.649+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~ERWJR5OOSTBD.2 size=376254 2024-03-09T14:33:22.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.651+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=ERWJR5OOSTBD tag=05CGUGOSV95S type=write size=3521982 2024-03-09T14:33:22.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.655+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~0IJS9QYX2ICL.0 size=1048576 2024-03-09T14:33:22.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.656+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~0IJS9QYX2ICL.1 size=595857 2024-03-09T14:33:22.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.656+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=0IJS9QYX2ICL tag=ZRZ3N5WI9YGN type=write size=2693009 2024-03-09T14:33:22.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.657+0000 7f586ae3d780 1 < canceled operation key=WNVN3EOUUBGR tag=TLY2RG2LXBUT type=del size=3396005 2024-03-09T14:33:22.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.658+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=EK8Q4YBQZ8UF type=del size=1632850 2024-03-09T14:33:22.660 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.661+0000 7f586ae3d780 1 < suggested remove operation key=G2BIOBESOIK9 tag=KTMS7FGXT3KN type=del 2024-03-09T14:33:22.661 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.662+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=NLU553U87RZB type=del size=3278809 2024-03-09T14:33:22.662 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.663+0000 7f586ae3d780 1 < completed write operation key=P3OUIQNAK1TC tag=1R0ZI495ZASF type=write size=1041972 2024-03-09T14:33:22.665 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.665+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~VARSJNY0KT5Z.0 size=1048576 2024-03-09T14:33:22.665 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.666+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~VARSJNY0KT5Z.1 size=1048576 2024-03-09T14:33:22.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.667+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~VARSJNY0KT5Z.2 size=95880 2024-03-09T14:33:22.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.667+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=VARSJNY0KT5Z tag=HE3DPP67F6ZL type=write size=3241608 2024-03-09T14:33:22.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.668+0000 7f586ae3d780 1 < canceled operation key=WNVN3EOUUBGR tag=ETLIBKCM0AYM type=write size=934439 2024-03-09T14:33:22.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.670+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~LC6DEOPUHEUQ.0 size=643949 2024-03-09T14:33:22.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.670+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=LC6DEOPUHEUQ tag=MYVHP26W025T type=write size=1692525 2024-03-09T14:33:22.671 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.671+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=P6A41LZNWRUW type=del 2024-03-09T14:33:22.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.673+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~UD9I8KBZVHSA.0 size=1048576 2024-03-09T14:33:22.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.674+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~UD9I8KBZVHSA.1 size=777310 2024-03-09T14:33:22.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.674+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=UD9I8KBZVHSA tag=VZLX4W65UUVT type=write size=2874462 2024-03-09T14:33:22.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.676+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~KESK68EJN85U.0 size=1048576 2024-03-09T14:33:22.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.676+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~KESK68EJN85U.1 size=1048576 2024-03-09T14:33:22.677 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.677+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~KESK68EJN85U.2 size=104272 2024-03-09T14:33:22.679 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.679+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=KESK68EJN85U tag=O2DZ8BSHETZZ type=write size=3250000 2024-03-09T14:33:22.680 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.680+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=HJ68H6PXFULW type=del size=3673319 2024-03-09T14:33:22.681 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.682+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~KVZD169KQFOP.0 size=615856 2024-03-09T14:33:22.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.683+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=KVZD169KQFOP tag=IWS9RI8Z4YFW type=write size=1664432 2024-03-09T14:33:22.685 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.686+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~X75ZII8FQLZW.0 size=1048576 2024-03-09T14:33:22.686 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.687+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~X75ZII8FQLZW.1 size=847218 2024-03-09T14:33:22.686 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.687+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=X75ZII8FQLZW tag=OPN0D15CUSZ6 type=write size=2944370 2024-03-09T14:33:22.687 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.688+0000 7f586ae3d780 1 < completed write operation key=CAISZZZSOD34 tag=RFIRNA6XSQ7K type=write size=350939 2024-03-09T14:33:22.688 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.689+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=04RFYMBAGNUE type=del size=1443228 2024-03-09T14:33:22.690 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.690+0000 7f586ae3d780 1 < completed write operation key=5PERWGS0GOJU tag=76NAXY2NK4EA type=write size=450927 2024-03-09T14:33:22.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.692+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~N3MYL4QJZ8EV.0 size=1048576 2024-03-09T14:33:22.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.693+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~N3MYL4QJZ8EV.1 size=1048576 2024-03-09T14:33:22.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.694+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~N3MYL4QJZ8EV.2 size=1028637 2024-03-09T14:33:22.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.694+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=N3MYL4QJZ8EV tag=1GWXL1TAELSE type=write size=4174365 2024-03-09T14:33:22.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.695+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~WCKPRHAQF2A5.0 size=1048576 2024-03-09T14:33:22.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.696+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~WCKPRHAQF2A5.1 size=1048576 2024-03-09T14:33:22.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.697+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~WCKPRHAQF2A5.2 size=470689 2024-03-09T14:33:22.698 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.699+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=WCKPRHAQF2A5 tag=RESW8DL7N4U8 type=write size=3616417 2024-03-09T14:33:22.701 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.701+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~CA3FLEOP9W3T.0 size=1048576 2024-03-09T14:33:22.701 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.702+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~CA3FLEOP9W3T.1 size=764764 2024-03-09T14:33:22.702 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.702+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=CA3FLEOP9W3T tag=0HBJDKQW4QDH type=write size=2861916 2024-03-09T14:33:22.703 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.703+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=X8YNUVLFCXTN type=del 2024-03-09T14:33:22.704 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.704+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=FDU7T55XUQFM type=del size=3415840 2024-03-09T14:33:22.705 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.705+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~2K1U710NX3O6.0 size=1048576 2024-03-09T14:33:22.706 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.706+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~2K1U710NX3O6.1 size=276254 2024-03-09T14:33:22.708 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.708+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=2K1U710NX3O6 tag=91RCY33ADRHI type=write size=2373406 2024-03-09T14:33:22.710 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.710+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~N91G86TA5Q1B.0 size=1048576 2024-03-09T14:33:22.711 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.711+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~N91G86TA5Q1B.1 size=1048576 2024-03-09T14:33:22.712 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.712+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~N91G86TA5Q1B.2 size=132380 2024-03-09T14:33:22.712 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.712+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=N91G86TA5Q1B tag=REE6KTKTOBC5 type=write size=3278108 2024-03-09T14:33:22.712 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.712+0000 7f586ae3d780 1 < canceled part key=_multipart_G2BIOBESOIK9.2~MDAU7BH9171X.0 size=1048576 2024-03-09T14:33:22.713 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.713+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~MDAU7BH9171X.1 size=501373 2024-03-09T14:33:22.715 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.715+0000 7f586ae3d780 1 < canceled multipart upload key=G2BIOBESOIK9 upload=MDAU7BH9171X tag=IRAJ2Q2OWYY0 type=write size=2598525 2024-03-09T14:33:22.716 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.716+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=SKFGUXNPBQ86 type=del size=2887908 2024-03-09T14:33:22.718 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.718+0000 7f586ae3d780 1 < completed write operation key=W4Q1MWHOQ4Y1 tag=DSXCPKTGBVXC type=write size=345006 2024-03-09T14:33:22.719 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.720+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=V145TYOXRFEH type=del size=2119210 2024-03-09T14:33:22.720 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.721+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~2YZYG5C5LRAT.0 size=1048576 2024-03-09T14:33:22.721 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.722+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~2YZYG5C5LRAT.1 size=1048576 2024-03-09T14:33:22.723 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.723+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~2YZYG5C5LRAT.2 size=863712 2024-03-09T14:33:22.725 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.725+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=2YZYG5C5LRAT tag=P853HOD5R5QG type=write size=4009440 2024-03-09T14:33:22.726 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.726+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=N4CH3QDO9AUC type=write size=656608 2024-03-09T14:33:22.727 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.727+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~0IJS9QYX2ICL.0 size=1048576 2024-03-09T14:33:22.728 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.728+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~0IJS9QYX2ICL.1 size=595857 2024-03-09T14:33:22.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.730+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=0IJS9QYX2ICL tag=ZRZ3N5WI9YGN type=write size=2693009 2024-03-09T14:33:22.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.732+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~JAXM43G7B48I.0 size=539888 2024-03-09T14:33:22.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.732+0000 7f586ae3d780 1 > prepared multipart upload key=C1UGQOQ6AE1E upload=JAXM43G7B48I tag=K7PAGCNKP43R type=write size=1588464 2024-03-09T14:33:22.733 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.733+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=EK8Q4YBQZ8UF type=del 2024-03-09T14:33:22.734 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.735+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=BI9PZXQJM1TK type=write size=955711 2024-03-09T14:33:22.736 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.737+0000 7f586ae3d780 1 < suggested update operation key=OU9IOY7J572N tag=NLU553U87RZB type=del size=3278809 2024-03-09T14:33:22.737 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.738+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=QQ12RJEHMYUG type=del size=2038507 2024-03-09T14:33:22.739 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.739+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~VARSJNY0KT5Z.0 size=1048576 2024-03-09T14:33:22.740 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.740+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~VARSJNY0KT5Z.1 size=1048576 2024-03-09T14:33:22.741 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.741+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~VARSJNY0KT5Z.2 size=95880 2024-03-09T14:33:22.742 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.743+0000 7f586ae3d780 1 < completed multipart upload key=IK528ND96157 upload=VARSJNY0KT5Z tag=HE3DPP67F6ZL type=write size=3241608 2024-03-09T14:33:22.744 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.745+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~UL15W1HGSS6L.0 size=1048576 2024-03-09T14:33:22.745 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.746+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~UL15W1HGSS6L.1 size=237955 2024-03-09T14:33:22.745 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.746+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=UL15W1HGSS6L tag=EET4DPZWKJIL type=write size=2335107 2024-03-09T14:33:22.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.747+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~LC6DEOPUHEUQ.0 size=643949 2024-03-09T14:33:22.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.749+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=LC6DEOPUHEUQ tag=MYVHP26W025T type=write size=1692525 2024-03-09T14:33:22.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.750+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=IMSZXI5TCMU0 type=del size=2940273 2024-03-09T14:33:22.751 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.751+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~UD9I8KBZVHSA.0 size=1048576 2024-03-09T14:33:22.752 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.752+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~UD9I8KBZVHSA.1 size=777310 2024-03-09T14:33:22.753 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.754+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=UD9I8KBZVHSA tag=VZLX4W65UUVT type=write size=2874462 2024-03-09T14:33:22.755 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.756+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~REVELVVYFC9G.0 size=1048576 2024-03-09T14:33:22.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.757+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~REVELVVYFC9G.1 size=683808 2024-03-09T14:33:22.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.757+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=REVELVVYFC9G tag=2898854BHIDJ type=write size=2780960 2024-03-09T14:33:22.757 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.758+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=HJ68H6PXFULW type=del 2024-03-09T14:33:22.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.759+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=50TT9FBPZ43M type=del size=902794 2024-03-09T14:33:22.760 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.760+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~X75ZII8FQLZW.0 size=1048576 2024-03-09T14:33:22.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.761+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~X75ZII8FQLZW.1 size=847218 2024-03-09T14:33:22.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.763+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=X75ZII8FQLZW tag=OPN0D15CUSZ6 type=write size=2944370 2024-03-09T14:33:22.764 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.765+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=ZBAFME4GDPJS type=del size=1887055 2024-03-09T14:33:22.765 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.766+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=04RFYMBAGNUE type=del 2024-03-09T14:33:22.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.767+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=BTW1RTDW9UTQ type=del size=2288281 2024-03-09T14:33:22.768 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.768+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~N3MYL4QJZ8EV.0 size=1048576 2024-03-09T14:33:22.768 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.769+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~N3MYL4QJZ8EV.1 size=1048576 2024-03-09T14:33:22.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.770+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~N3MYL4QJZ8EV.2 size=1028637 2024-03-09T14:33:22.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.772+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=N3MYL4QJZ8EV tag=1GWXL1TAELSE type=write size=4174365 2024-03-09T14:33:22.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.774+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~RIW1I4BPBP9S.0 size=182404 2024-03-09T14:33:22.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.774+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=RIW1I4BPBP9S tag=GAZTO093UIMP type=write size=1230980 2024-03-09T14:33:22.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.774+0000 7f586ae3d780 1 < canceled part key=_multipart_39ZIGOC6JZ1R.2~CA3FLEOP9W3T.0 size=1048576 2024-03-09T14:33:22.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.775+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~CA3FLEOP9W3T.1 size=764764 2024-03-09T14:33:22.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.779+0000 7f586ae3d780 1 < canceled multipart upload key=39ZIGOC6JZ1R upload=CA3FLEOP9W3T tag=0HBJDKQW4QDH type=write size=2861916 2024-03-09T14:33:22.780 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.780+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=BXKW0GHYV06W type=del size=2697957 2024-03-09T14:33:22.781 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.782+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=FDU7T55XUQFM type=del 2024-03-09T14:33:22.783 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.783+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=1WV5Z0N2Q049 type=write size=89735 2024-03-09T14:33:22.783 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.784+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~N91G86TA5Q1B.0 size=1048576 2024-03-09T14:33:22.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.784+0000 7f586ae3d780 1 < canceled part key=_multipart_OU9IOY7J572N.2~N91G86TA5Q1B.1 size=1048576 2024-03-09T14:33:22.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.785+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~N91G86TA5Q1B.2 size=132380 2024-03-09T14:33:22.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.787+0000 7f586ae3d780 1 < canceled multipart upload key=OU9IOY7J572N upload=N91G86TA5Q1B tag=REE6KTKTOBC5 type=write size=3278108 2024-03-09T14:33:22.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.789+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~47RMIXFN3SBZ.0 size=303480 2024-03-09T14:33:22.789 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.789+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=47RMIXFN3SBZ tag=GDKZ1C7TN1OM type=write size=1352056 2024-03-09T14:33:22.791 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.791+0000 7f586ae3d780 1 < suggested remove operation key=NHIOOLNXLZZC tag=SKFGUXNPBQ86 type=del 2024-03-09T14:33:22.793 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.793+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~H8L39P235J9X.0 size=1048576 2024-03-09T14:33:22.794 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.794+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~H8L39P235J9X.1 size=1048576 2024-03-09T14:33:22.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.795+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~H8L39P235J9X.2 size=1010767 2024-03-09T14:33:22.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.795+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=H8L39P235J9X tag=9M0QJFS92TA7 type=write size=4156495 2024-03-09T14:33:22.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.796+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=V145TYOXRFEH type=del 2024-03-09T14:33:22.798 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.799+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~E7HTWOU0YJPX.0 size=928909 2024-03-09T14:33:22.798 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.799+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=E7HTWOU0YJPX tag=Z21TN9MZMTZP type=write size=1977485 2024-03-09T14:33:22.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.800+0000 7f586ae3d780 1 < completed write operation key=9ZPCSBP3P58P tag=N4CH3QDO9AUC type=write size=656608 2024-03-09T14:33:22.800 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.801+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=6SLIQLT9X21B type=write size=715113 2024-03-09T14:33:22.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.802+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~JAXM43G7B48I.0 size=539888 2024-03-09T14:33:22.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.804+0000 7f586ae3d780 1 < completed multipart upload key=C1UGQOQ6AE1E upload=JAXM43G7B48I tag=K7PAGCNKP43R type=write size=1588464 2024-03-09T14:33:22.806 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.806+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~2IVK09AAYE2J.0 size=242103 2024-03-09T14:33:22.806 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.806+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=2IVK09AAYE2J tag=DO023VH9A8KF type=write size=1290679 2024-03-09T14:33:22.807 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.807+0000 7f586ae3d780 1 < completed write operation key=C1UGQOQ6AE1E tag=BI9PZXQJM1TK type=write size=955711 2024-03-09T14:33:22.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.808+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=RYVLA88NHIHK type=del size=2324795 2024-03-09T14:33:22.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.810+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=QQ12RJEHMYUG type=del 2024-03-09T14:33:22.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.811+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=O9ZKCI5ZP5E9 type=del size=3176183 2024-03-09T14:33:22.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.812+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~UL15W1HGSS6L.0 size=1048576 2024-03-09T14:33:22.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.813+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~UL15W1HGSS6L.1 size=237955 2024-03-09T14:33:22.814 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.815+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=UL15W1HGSS6L tag=EET4DPZWKJIL type=write size=2335107 2024-03-09T14:33:22.816 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.817+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~79B4SO5C0845.0 size=1048576 2024-03-09T14:33:22.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.818+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~79B4SO5C0845.1 size=1048576 2024-03-09T14:33:22.818 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.819+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~79B4SO5C0845.2 size=855711 2024-03-09T14:33:22.818 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.819+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=79B4SO5C0845 tag=M49MMFE36ZIG type=write size=4001439 2024-03-09T14:33:22.819 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.820+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=IMSZXI5TCMU0 type=del 2024-03-09T14:33:22.820 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.821+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=YUZQ21S43D0Y type=del size=2032988 2024-03-09T14:33:22.822 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.822+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~REVELVVYFC9G.0 size=1048576 2024-03-09T14:33:22.822 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.823+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~REVELVVYFC9G.1 size=683808 2024-03-09T14:33:22.824 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.825+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=REVELVVYFC9G tag=2898854BHIDJ type=write size=2780960 2024-03-09T14:33:22.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.827+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=6Q6HZYKXSX1A type=del size=540106 2024-03-09T14:33:22.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.828+0000 7f586ae3d780 1 < canceled operation key=BHSYRD3IEJWW tag=50TT9FBPZ43M type=del size=902794 2024-03-09T14:33:22.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.829+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=N5NQE617Y1X0 type=del size=2585059 2024-03-09T14:33:22.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.831+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=ZBAFME4GDPJS type=del 2024-03-09T14:33:22.831 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.832+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=A5H0YXTWIW6W type=del size=3777545 2024-03-09T14:33:22.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.833+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=BTW1RTDW9UTQ type=del 2024-03-09T14:33:22.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.835+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~3PJ9S1EW0IQ1.0 size=923628 2024-03-09T14:33:22.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.835+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=3PJ9S1EW0IQ1 tag=SS8V304VQ209 type=write size=1972204 2024-03-09T14:33:22.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.836+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~RIW1I4BPBP9S.0 size=182404 2024-03-09T14:33:22.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.838+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=RIW1I4BPBP9S tag=GAZTO093UIMP type=write size=1230980 2024-03-09T14:33:22.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.840+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~1Y2TRW9L7PLJ.0 size=1048576 2024-03-09T14:33:22.840 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.841+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~1Y2TRW9L7PLJ.1 size=1048576 2024-03-09T14:33:22.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.842+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~1Y2TRW9L7PLJ.2 size=166830 2024-03-09T14:33:22.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.842+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=1Y2TRW9L7PLJ tag=3L30SXSIT108 type=write size=3312558 2024-03-09T14:33:22.842 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.843+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=BXKW0GHYV06W type=del 2024-03-09T14:33:22.843 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.844+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=V3V68DW3BXBZ type=del size=1221405 2024-03-09T14:33:22.845 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.845+0000 7f586ae3d780 1 < completed write operation key=W4Q1MWHOQ4Y1 tag=1WV5Z0N2Q049 type=write size=89735 2024-03-09T14:33:22.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.847+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~S8GIVBL0Q12B.0 size=247527 2024-03-09T14:33:22.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.847+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=S8GIVBL0Q12B tag=MOXQ914L02A6 type=write size=1296103 2024-03-09T14:33:22.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.848+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~47RMIXFN3SBZ.0 size=303480 2024-03-09T14:33:22.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.850+0000 7f586ae3d780 1 < completed multipart upload key=LRI2GKBGVCWW upload=47RMIXFN3SBZ tag=GDKZ1C7TN1OM type=write size=1352056 2024-03-09T14:33:22.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.852+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~C152D31BYMHS.0 size=1048576 2024-03-09T14:33:22.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.853+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~C152D31BYMHS.1 size=1048576 2024-03-09T14:33:22.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.854+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~C152D31BYMHS.2 size=568518 2024-03-09T14:33:22.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.854+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=C152D31BYMHS tag=BQ608913ENID type=write size=3714246 2024-03-09T14:33:22.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.855+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~H8L39P235J9X.0 size=1048576 2024-03-09T14:33:22.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.856+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~H8L39P235J9X.1 size=1048576 2024-03-09T14:33:22.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.857+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~H8L39P235J9X.2 size=1010767 2024-03-09T14:33:22.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.859+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=H8L39P235J9X tag=9M0QJFS92TA7 type=write size=4156495 2024-03-09T14:33:22.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.860+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=Z69HM0P0G1H1 type=del size=25075 2024-03-09T14:33:22.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.861+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~E7HTWOU0YJPX.0 size=928909 2024-03-09T14:33:22.863 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.863+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=E7HTWOU0YJPX tag=Z21TN9MZMTZP type=write size=1977485 2024-03-09T14:33:22.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.864+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=9ZFJZXGRDCOJ type=write size=24442 2024-03-09T14:33:22.865 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.865+0000 7f586ae3d780 1 < completed write operation key=NHIOOLNXLZZC tag=6SLIQLT9X21B type=write size=715113 2024-03-09T14:33:22.866 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.866+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=SAM3H36ZU9IG type=del size=3331386 2024-03-09T14:33:22.867 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.867+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~2IVK09AAYE2J.0 size=242103 2024-03-09T14:33:22.869 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.869+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=2IVK09AAYE2J tag=DO023VH9A8KF type=write size=1290679 2024-03-09T14:33:22.871 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.871+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~ZEYGZK60KIX2.0 size=1048576 2024-03-09T14:33:22.871 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.872+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~ZEYGZK60KIX2.1 size=401929 2024-03-09T14:33:22.872 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.872+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=ZEYGZK60KIX2 tag=N1GL2TZVD0VL type=write size=2499081 2024-03-09T14:33:22.873 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.873+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=RYVLA88NHIHK type=del 2024-03-09T14:33:22.875 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.874+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=D5PCE4L0ZY1R type=del size=1832246 2024-03-09T14:33:22.875 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.876+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=O9ZKCI5ZP5E9 type=del 2024-03-09T14:33:22.876 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.877+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=ED6GP6J1C5NX type=write size=272995 2024-03-09T14:33:22.878 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.878+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~79B4SO5C0845.0 size=1048576 2024-03-09T14:33:22.879 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.879+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~79B4SO5C0845.1 size=1048576 2024-03-09T14:33:22.880 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.880+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~79B4SO5C0845.2 size=855711 2024-03-09T14:33:22.882 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.882+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=79B4SO5C0845 tag=M49MMFE36ZIG type=write size=4001439 2024-03-09T14:33:22.885 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.885+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~LM488JX6JHSW.0 size=1048576 2024-03-09T14:33:22.885 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.886+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~LM488JX6JHSW.1 size=311292 2024-03-09T14:33:22.885 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.886+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=LM488JX6JHSW tag=JSSA2ASJQZQ6 type=write size=2408444 2024-03-09T14:33:22.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.887+0000 7f586ae3d780 1 < canceled operation key=57OR9DHRPDCZ tag=YUZQ21S43D0Y type=del size=2032988 2024-03-09T14:33:22.888 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.889+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~S726KRA2S50V.0 size=1048576 2024-03-09T14:33:22.889 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.890+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~S726KRA2S50V.1 size=1048576 2024-03-09T14:33:22.890 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.891+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~S726KRA2S50V.2 size=660981 2024-03-09T14:33:22.890 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.891+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=S726KRA2S50V tag=BPAZ7ZQATMOR type=write size=3806709 2024-03-09T14:33:22.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.892+0000 7f586ae3d780 1 < canceled operation key=78Y2ZM3W6EUC tag=6Q6HZYKXSX1A type=del size=540106 2024-03-09T14:33:22.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.893+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=VJXRE46PDLSQ type=del size=2917684 2024-03-09T14:33:22.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.894+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=N5NQE617Y1X0 type=del 2024-03-09T14:33:22.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.895+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=SN5BQT35NI3W type=del size=3919089 2024-03-09T14:33:22.896 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.896+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=A5H0YXTWIW6W type=del 2024-03-09T14:33:22.897 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.898+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=TL8M6347IIPM type=del size=399284 2024-03-09T14:33:22.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.899+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~3PJ9S1EW0IQ1.0 size=923628 2024-03-09T14:33:22.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.901+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=3PJ9S1EW0IQ1 tag=SS8V304VQ209 type=write size=1972204 2024-03-09T14:33:22.902 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.903+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~XGC0LM36K5F9.0 size=1048576 2024-03-09T14:33:22.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.904+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~XGC0LM36K5F9.1 size=1048576 2024-03-09T14:33:22.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.905+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~XGC0LM36K5F9.2 size=274787 2024-03-09T14:33:22.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.905+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=XGC0LM36K5F9 tag=K40UM674827B type=write size=3420515 2024-03-09T14:33:22.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.906+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~1Y2TRW9L7PLJ.0 size=1048576 2024-03-09T14:33:22.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.907+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~1Y2TRW9L7PLJ.1 size=1048576 2024-03-09T14:33:22.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.907+0000 7f586ae3d780 1 < canceled part key=_multipart_LRI2GKBGVCWW.2~1Y2TRW9L7PLJ.2 size=166830 2024-03-09T14:33:22.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.909+0000 7f586ae3d780 1 < canceled multipart upload key=LRI2GKBGVCWW upload=1Y2TRW9L7PLJ tag=3L30SXSIT108 type=write size=3312558 2024-03-09T14:33:22.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.910+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=EFMNLCZWPZHS type=write size=925268 2024-03-09T14:33:22.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.911+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=V3V68DW3BXBZ type=del 2024-03-09T14:33:22.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.912+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=QSCTZYZG08N2 type=del size=2467236 2024-03-09T14:33:22.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.914+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~S8GIVBL0Q12B.0 size=247527 2024-03-09T14:33:22.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.916+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=S8GIVBL0Q12B tag=MOXQ914L02A6 type=write size=1296103 2024-03-09T14:33:22.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.917+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=KSV041UW0RUA type=del size=3598504 2024-03-09T14:33:22.917 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.918+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~C152D31BYMHS.0 size=1048576 2024-03-09T14:33:22.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.919+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~C152D31BYMHS.1 size=1048576 2024-03-09T14:33:22.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.920+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~C152D31BYMHS.2 size=568518 2024-03-09T14:33:22.921 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.922+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=C152D31BYMHS tag=BQ608913ENID type=write size=3714246 2024-03-09T14:33:22.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.924+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~O2UGVLFCTENF.0 size=1048576 2024-03-09T14:33:22.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.925+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~O2UGVLFCTENF.1 size=351723 2024-03-09T14:33:22.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.925+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=O2UGVLFCTENF tag=KPCMUALF4ZAL type=write size=2448875 2024-03-09T14:33:22.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.926+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=Z69HM0P0G1H1 type=del 2024-03-09T14:33:22.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.928+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~F3O8EA369E3J.0 size=1048576 2024-03-09T14:33:22.929 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.929+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~F3O8EA369E3J.1 size=719821 2024-03-09T14:33:22.929 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.929+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=F3O8EA369E3J tag=GWRZ5G9SGMO2 type=write size=2816973 2024-03-09T14:33:22.930 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.930+0000 7f586ae3d780 1 < completed write operation key=78Y2ZM3W6EUC tag=9ZFJZXGRDCOJ type=write size=24442 2024-03-09T14:33:22.931 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.932+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=TCM56LMXKU5I type=del size=3305493 2024-03-09T14:33:22.934 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.934+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=SAM3H36ZU9IG type=del 2024-03-09T14:33:22.935 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.935+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=IMU1HN99WJR9 type=del size=2833343 2024-03-09T14:33:22.936 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.937+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~ZEYGZK60KIX2.0 size=1048576 2024-03-09T14:33:22.937 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.938+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~ZEYGZK60KIX2.1 size=401929 2024-03-09T14:33:22.939 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.940+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=ZEYGZK60KIX2 tag=N1GL2TZVD0VL type=write size=2499081 2024-03-09T14:33:22.941 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.941+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=DLL2OIIVZF1B type=del size=774341 2024-03-09T14:33:22.941 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.942+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=D5PCE4L0ZY1R type=del 2024-03-09T14:33:22.944 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.944+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~23NCCPDS2SS8.0 size=1048576 2024-03-09T14:33:22.944 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.945+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~23NCCPDS2SS8.1 size=1048576 2024-03-09T14:33:22.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.946+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~23NCCPDS2SS8.2 size=876421 2024-03-09T14:33:22.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.946+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=23NCCPDS2SS8 tag=CF28ABKLUQZ9 type=write size=4022149 2024-03-09T14:33:22.947 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.947+0000 7f586ae3d780 1 < completed write operation key=UKPSUQ6LYWN8 tag=ED6GP6J1C5NX type=write size=272995 2024-03-09T14:33:22.949 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.949+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~1DDI5DF5IYX5.0 size=1048576 2024-03-09T14:33:22.949 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.950+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~1DDI5DF5IYX5.1 size=1048576 2024-03-09T14:33:22.950 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.951+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~1DDI5DF5IYX5.2 size=1035070 2024-03-09T14:33:22.950 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.951+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=1DDI5DF5IYX5 tag=2BSJC6UU9PBB type=write size=4180798 2024-03-09T14:33:22.951 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.952+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~LM488JX6JHSW.0 size=1048576 2024-03-09T14:33:22.952 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.953+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~LM488JX6JHSW.1 size=311292 2024-03-09T14:33:22.954 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.955+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=LM488JX6JHSW tag=JSSA2ASJQZQ6 type=write size=2408444 2024-03-09T14:33:22.955 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.956+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=66FV8W5JX3CN type=del size=3899431 2024-03-09T14:33:22.956 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.957+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~S726KRA2S50V.0 size=1048576 2024-03-09T14:33:22.957 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.958+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~S726KRA2S50V.1 size=1048576 2024-03-09T14:33:22.958 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.959+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~S726KRA2S50V.2 size=660981 2024-03-09T14:33:22.961 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.961+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=S726KRA2S50V tag=BPAZ7ZQATMOR type=write size=3806709 2024-03-09T14:33:22.961 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.962+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=894PBNXAQSZ7 type=write size=153133 2024-03-09T14:33:22.963 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.963+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=VJXRE46PDLSQ type=del 2024-03-09T14:33:22.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.965+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~DGOONHHI9PE1.0 size=1048576 2024-03-09T14:33:22.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.966+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~DGOONHHI9PE1.1 size=174875 2024-03-09T14:33:22.966 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.966+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=DGOONHHI9PE1 tag=FQG2XTF0EOHF type=write size=2272027 2024-03-09T14:33:22.967 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.967+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=SN5BQT35NI3W type=del 2024-03-09T14:33:22.968 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.968+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=J31RDR9LIB2Q type=del size=69035 2024-03-09T14:33:22.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.969+0000 7f586ae3d780 1 < canceled operation key=OU9IOY7J572N tag=TL8M6347IIPM type=del size=399284 2024-03-09T14:33:22.970 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.971+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=OB8R7OVBZ6ND type=del size=2352865 2024-03-09T14:33:22.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.972+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~XGC0LM36K5F9.0 size=1048576 2024-03-09T14:33:22.972 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.973+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~XGC0LM36K5F9.1 size=1048576 2024-03-09T14:33:22.973 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.974+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~XGC0LM36K5F9.2 size=274787 2024-03-09T14:33:22.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.976+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=XGC0LM36K5F9 tag=K40UM674827B type=write size=3420515 2024-03-09T14:33:22.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.977+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=RRP6IN1XTLWV type=del size=1615022 2024-03-09T14:33:22.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.978+0000 7f586ae3d780 1 < completed write operation key=WNVN3EOUUBGR tag=EFMNLCZWPZHS type=write size=925268 2024-03-09T14:33:22.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.979+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=R6KF7S85XEGW type=write size=740843 2024-03-09T14:33:22.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.980+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=QSCTZYZG08N2 type=del 2024-03-09T14:33:22.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.982+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~T7SYPWD0G8KX.0 size=752018 2024-03-09T14:33:22.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.982+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=T7SYPWD0G8KX tag=HA94NOIWSQGQ type=write size=1800594 2024-03-09T14:33:22.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.984+0000 7f586ae3d780 1 < canceled operation key=OXBDXIILR3NS tag=KSV041UW0RUA type=del size=3598504 2024-03-09T14:33:22.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.985+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=HMB3L2M08BHS type=del size=615060 2024-03-09T14:33:22.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.986+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~O2UGVLFCTENF.0 size=1048576 2024-03-09T14:33:22.986 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.987+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~O2UGVLFCTENF.1 size=351723 2024-03-09T14:33:22.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.989+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=O2UGVLFCTENF tag=KPCMUALF4ZAL type=write size=2448875 2024-03-09T14:33:22.990 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.991+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~OOVOQ5N7OBBI.0 size=1048576 2024-03-09T14:33:22.991 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.992+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~OOVOQ5N7OBBI.1 size=1040422 2024-03-09T14:33:22.991 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.992+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=OOVOQ5N7OBBI tag=EXB3EB293PYT type=write size=3137574 2024-03-09T14:33:22.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.992+0000 7f586ae3d780 1 < canceled part key=_multipart_WNVN3EOUUBGR.2~F3O8EA369E3J.0 size=1048576 2024-03-09T14:33:22.993 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.993+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~F3O8EA369E3J.1 size=719821 2024-03-09T14:33:22.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.995+0000 7f586ae3d780 1 < canceled multipart upload key=WNVN3EOUUBGR upload=F3O8EA369E3J tag=GWRZ5G9SGMO2 type=write size=2816973 2024-03-09T14:33:22.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.996+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=5CLN9O4FAAGS type=del size=235414 2024-03-09T14:33:22.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.997+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=TCM56LMXKU5I type=del 2024-03-09T14:33:22.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:22.998+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=1WNS2HIVVEFK type=del size=3259196 2024-03-09T14:33:22.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.000+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=IMU1HN99WJR9 type=del 2024-03-09T14:33:23.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.001+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=3C0JEGZUJJ2G type=del size=1188459 2024-03-09T14:33:23.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.002+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=DLL2OIIVZF1B type=del 2024-03-09T14:33:23.003 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.003+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=SQJ8HO7E634W type=del size=1919679 2024-03-09T14:33:23.004 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.004+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~23NCCPDS2SS8.0 size=1048576 2024-03-09T14:33:23.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.005+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~23NCCPDS2SS8.1 size=1048576 2024-03-09T14:33:23.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.006+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~23NCCPDS2SS8.2 size=876421 2024-03-09T14:33:23.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.008+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=23NCCPDS2SS8 tag=CF28ABKLUQZ9 type=write size=4022149 2024-03-09T14:33:23.009 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.010+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=SXWBWP7SOGG3 type=write size=824825 2024-03-09T14:33:23.010 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.011+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~1DDI5DF5IYX5.0 size=1048576 2024-03-09T14:33:23.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.012+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~1DDI5DF5IYX5.1 size=1048576 2024-03-09T14:33:23.012 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.013+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~1DDI5DF5IYX5.2 size=1035070 2024-03-09T14:33:23.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.015+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=1DDI5DF5IYX5 tag=2BSJC6UU9PBB type=write size=4180798 2024-03-09T14:33:23.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.016+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=0LZHLPUR8TT8 type=del size=3056199 2024-03-09T14:33:23.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.017+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=66FV8W5JX3CN type=del 2024-03-09T14:33:23.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.018+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=1812V1C6F7XA type=del size=927152 2024-03-09T14:33:23.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.019+0000 7f586ae3d780 1 < completed write operation key=CZGAXNJ0GKU0 tag=894PBNXAQSZ7 type=write size=153133 2024-03-09T14:33:23.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.021+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=KKV5PVC7TX47 type=del size=74539 2024-03-09T14:33:23.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.022+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~DGOONHHI9PE1.0 size=1048576 2024-03-09T14:33:23.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.023+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~DGOONHHI9PE1.1 size=174875 2024-03-09T14:33:23.024 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.025+0000 7f586ae3d780 1 < completed multipart upload key=LRI2GKBGVCWW upload=DGOONHHI9PE1 tag=FQG2XTF0EOHF type=write size=2272027 2024-03-09T14:33:23.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.027+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~2W2P4LIXG49C.0 size=287743 2024-03-09T14:33:23.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.027+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=2W2P4LIXG49C tag=YWPFGOTJ3TKB type=write size=1336319 2024-03-09T14:33:23.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.028+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=J31RDR9LIB2Q type=del 2024-03-09T14:33:23.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.029+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=7TJ9PCY1SQBM type=write size=720066 2024-03-09T14:33:23.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.031+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=OB8R7OVBZ6ND type=del 2024-03-09T14:33:23.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.033+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~2WGMRDEI3TUR.0 size=1048576 2024-03-09T14:33:23.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.034+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~2WGMRDEI3TUR.1 size=1048576 2024-03-09T14:33:23.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.035+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~2WGMRDEI3TUR.2 size=614083 2024-03-09T14:33:23.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.035+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=2WGMRDEI3TUR tag=G419R9HXC5J0 type=write size=3759811 2024-03-09T14:33:23.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.038+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=RRP6IN1XTLWV type=del 2024-03-09T14:33:23.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.040+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~2S4ISI5ZXFY7.0 size=1048576 2024-03-09T14:33:23.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.041+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~2S4ISI5ZXFY7.1 size=71707 2024-03-09T14:33:23.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.041+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=2S4ISI5ZXFY7 tag=SU7ORU4XUB72 type=write size=2168859 2024-03-09T14:33:23.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.043+0000 7f586ae3d780 1 < completed write operation key=P3OUIQNAK1TC tag=R6KF7S85XEGW type=write size=740843 2024-03-09T14:33:23.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.046+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~YIFT6YXE5PCF.0 size=1048576 2024-03-09T14:33:23.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.047+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~YIFT6YXE5PCF.1 size=521526 2024-03-09T14:33:23.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.047+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=YIFT6YXE5PCF tag=ESHA5Q8N9RXF type=write size=2618678 2024-03-09T14:33:23.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.049+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~T7SYPWD0G8KX.0 size=752018 2024-03-09T14:33:23.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.050+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=T7SYPWD0G8KX tag=HA94NOIWSQGQ type=write size=1800594 2024-03-09T14:33:23.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.052+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=S74O6I6NGF67 type=del size=3245582 2024-03-09T14:33:23.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.053+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=HMB3L2M08BHS type=del 2024-03-09T14:33:23.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.055+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~QL4PVF2RXZB1.0 size=1048576 2024-03-09T14:33:23.055 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.056+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~QL4PVF2RXZB1.1 size=117402 2024-03-09T14:33:23.055 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.056+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=QL4PVF2RXZB1 tag=1OSQDRN7U8AU type=write size=2214554 2024-03-09T14:33:23.056 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.057+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~OOVOQ5N7OBBI.0 size=1048576 2024-03-09T14:33:23.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.058+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~OOVOQ5N7OBBI.1 size=1040422 2024-03-09T14:33:23.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.060+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=OOVOQ5N7OBBI tag=EXB3EB293PYT type=write size=3137574 2024-03-09T14:33:23.060 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.061+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=S02J1XBUADHV type=write size=84122 2024-03-09T14:33:23.062 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.062+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=5CLN9O4FAAGS type=del 2024-03-09T14:33:23.062 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.063+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=IGF3UISIILCA type=del size=3661429 2024-03-09T14:33:23.064 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.064+0000 7f586ae3d780 1 < canceled operation key=78Y2ZM3W6EUC tag=1WNS2HIVVEFK type=del size=3259196 2024-03-09T14:33:23.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.066+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=672A0C2P3X2R type=del size=493254 2024-03-09T14:33:23.066 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.067+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=3C0JEGZUJJ2G type=del 2024-03-09T14:33:23.068 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.068+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=TS1KNQYPX0FN type=write size=632102 2024-03-09T14:33:23.069 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.069+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=SQJ8HO7E634W type=del 2024-03-09T14:33:23.071 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.071+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~D0DAR2SSDE00.0 size=724402 2024-03-09T14:33:23.071 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.071+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=D0DAR2SSDE00 tag=FQL7VVEB7AXM type=write size=1772978 2024-03-09T14:33:23.072 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.073+0000 7f586ae3d780 1 < completed write operation key=NHIOOLNXLZZC tag=SXWBWP7SOGG3 type=write size=824825 2024-03-09T14:33:23.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.075+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~HY0BSKFK22O4.0 size=928203 2024-03-09T14:33:23.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.075+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=HY0BSKFK22O4 tag=7E9O26IOB58A type=write size=1976779 2024-03-09T14:33:23.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.076+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=0LZHLPUR8TT8 type=del 2024-03-09T14:33:23.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.077+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=1VD5QWSDPAU2 type=del size=1668292 2024-03-09T14:33:23.078 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.078+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=1812V1C6F7XA type=del 2024-03-09T14:33:23.080 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.081+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~JWBI8P1DMDHG.0 size=1048576 2024-03-09T14:33:23.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.082+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~JWBI8P1DMDHG.1 size=28506 2024-03-09T14:33:23.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.082+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=JWBI8P1DMDHG tag=IEH9MDM5GDEK type=write size=2125658 2024-03-09T14:33:23.082 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.083+0000 7f586ae3d780 1 < canceled operation key=O5L6RC16RS8E tag=KKV5PVC7TX47 type=del size=74539 2024-03-09T14:33:23.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.084+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=X6XJ4K1BH6FP type=del size=2796030 2024-03-09T14:33:23.084 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.084+0000 7f586ae3d780 1 < canceled part key=_multipart_9ZPCSBP3P58P.2~2W2P4LIXG49C.0 size=287743 2024-03-09T14:33:23.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.086+0000 7f586ae3d780 1 < canceled multipart upload key=9ZPCSBP3P58P upload=2W2P4LIXG49C tag=YWPFGOTJ3TKB type=write size=1336319 2024-03-09T14:33:23.090 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.088+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~OC9V8HR80MKT.0 size=246080 2024-03-09T14:33:23.090 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.088+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=OC9V8HR80MKT tag=0BZ4WO8UEOVE type=write size=1294656 2024-03-09T14:33:23.090 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.089+0000 7f586ae3d780 1 < completed write operation key=UO072H74SHLP tag=7TJ9PCY1SQBM type=write size=720066 2024-03-09T14:33:23.090 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.090+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=JX4UEGHS4VCW type=del size=439541 2024-03-09T14:33:23.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.092+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~2WGMRDEI3TUR.0 size=1048576 2024-03-09T14:33:23.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.093+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~2WGMRDEI3TUR.1 size=1048576 2024-03-09T14:33:23.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.094+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~2WGMRDEI3TUR.2 size=614083 2024-03-09T14:33:23.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.096+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=2WGMRDEI3TUR tag=G419R9HXC5J0 type=write size=3759811 2024-03-09T14:33:23.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.097+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=PPBNR0QXRW77 type=del size=3383440 2024-03-09T14:33:23.098 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.099+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~2S4ISI5ZXFY7.0 size=1048576 2024-03-09T14:33:23.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.100+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~2S4ISI5ZXFY7.1 size=71707 2024-03-09T14:33:23.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.102+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=2S4ISI5ZXFY7 tag=SU7ORU4XUB72 type=write size=2168859 2024-03-09T14:33:23.104 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.104+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~14GS29YPVJEO.0 size=1048576 2024-03-09T14:33:23.105 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.105+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~14GS29YPVJEO.1 size=1048576 2024-03-09T14:33:23.106 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.106+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~14GS29YPVJEO.2 size=242879 2024-03-09T14:33:23.106 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.106+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=14GS29YPVJEO tag=HOAREH28UMFE type=write size=3388607 2024-03-09T14:33:23.107 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.108+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~YIFT6YXE5PCF.0 size=1048576 2024-03-09T14:33:23.107 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.108+0000 7f586ae3d780 1 < canceled part key=_multipart_509F17DT0C4I.2~YIFT6YXE5PCF.1 size=521526 2024-03-09T14:33:23.109 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.110+0000 7f586ae3d780 1 < canceled multipart upload key=509F17DT0C4I upload=YIFT6YXE5PCF tag=ESHA5Q8N9RXF type=write size=2618678 2024-03-09T14:33:23.111 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.111+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=9FYVHXGTBKLP type=write size=841810 2024-03-09T14:33:23.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.112+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=S74O6I6NGF67 type=del 2024-03-09T14:33:23.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.114+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=1F5D3JLJBTLQ type=del size=3720361 2024-03-09T14:33:23.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.115+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~QL4PVF2RXZB1.0 size=1048576 2024-03-09T14:33:23.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.116+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~QL4PVF2RXZB1.1 size=117402 2024-03-09T14:33:23.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.118+0000 7f586ae3d780 1 < completed multipart upload key=UAYZ55UT77VE upload=QL4PVF2RXZB1 tag=1OSQDRN7U8AU type=write size=2214554 2024-03-09T14:33:23.119 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.119+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=7CVVSD4PIARU type=del size=909517 2024-03-09T14:33:23.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.120+0000 7f586ae3d780 1 < completed write operation key=FNZ3BNA7W12E tag=S02J1XBUADHV type=write size=84122 2024-03-09T14:33:23.121 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.122+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=HE3JEE6Y1CAK type=del size=2022637 2024-03-09T14:33:23.122 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.123+0000 7f586ae3d780 1 < canceled operation key=04E9KDGUC274 tag=IGF3UISIILCA type=del size=3661429 2024-03-09T14:33:23.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.125+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~5CHGFVV2ETRC.0 size=845399 2024-03-09T14:33:23.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.125+0000 7f586ae3d780 1 > prepared multipart upload key=C1UGQOQ6AE1E upload=5CHGFVV2ETRC tag=HX0EOPBG4V06 type=write size=1893975 2024-03-09T14:33:23.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.127+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=672A0C2P3X2R type=del 2024-03-09T14:33:23.127 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.128+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=2ANCEO4PL3FI type=del size=1821059 2024-03-09T14:33:23.129 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.129+0000 7f586ae3d780 1 < completed write operation key=NHIOOLNXLZZC tag=TS1KNQYPX0FN type=write size=632102 2024-03-09T14:33:23.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.131+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=MUK0Z3OP5LFY type=del size=1579036 2024-03-09T14:33:23.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.132+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~D0DAR2SSDE00.0 size=724402 2024-03-09T14:33:23.133 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.134+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=D0DAR2SSDE00 tag=FQL7VVEB7AXM type=write size=1772978 2024-03-09T14:33:23.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.135+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=0SWR8J9TXGJY type=del size=3815665 2024-03-09T14:33:23.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.136+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~HY0BSKFK22O4.0 size=928203 2024-03-09T14:33:23.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.138+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=HY0BSKFK22O4 tag=7E9O26IOB58A type=write size=1976779 2024-03-09T14:33:23.139 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.139+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=6S3458E6YU0N type=del size=1860529 2024-03-09T14:33:23.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.140+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=1VD5QWSDPAU2 type=del 2024-03-09T14:33:23.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.142+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~5GGOKSN09FC3.0 size=1048576 2024-03-09T14:33:23.143 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.143+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~5GGOKSN09FC3.1 size=1048576 2024-03-09T14:33:23.144 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.144+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~5GGOKSN09FC3.2 size=831490 2024-03-09T14:33:23.144 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.144+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=5GGOKSN09FC3 tag=9OVZOAY452M1 type=write size=3977218 2024-03-09T14:33:23.145 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.145+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~JWBI8P1DMDHG.0 size=1048576 2024-03-09T14:33:23.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.146+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~JWBI8P1DMDHG.1 size=28506 2024-03-09T14:33:23.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.148+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=JWBI8P1DMDHG tag=IEH9MDM5GDEK type=write size=2125658 2024-03-09T14:33:23.150 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.150+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~N12R6BPUE98D.0 size=1048576 2024-03-09T14:33:23.151 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.151+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~N12R6BPUE98D.1 size=1048576 2024-03-09T14:33:23.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.152+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~N12R6BPUE98D.2 size=343969 2024-03-09T14:33:23.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.152+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=N12R6BPUE98D tag=976DV6CEJFKD type=write size=3489697 2024-03-09T14:33:23.154 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.154+0000 7f586ae3d780 1 < suggested remove operation key=2BUCMVWK7J1V tag=X6XJ4K1BH6FP type=del 2024-03-09T14:33:23.155 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.156+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=7T7P5GER48J3 type=del size=1424292 2024-03-09T14:33:23.157 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.158+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~OC9V8HR80MKT.0 size=246080 2024-03-09T14:33:23.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.160+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=OC9V8HR80MKT tag=0BZ4WO8UEOVE type=write size=1294656 2024-03-09T14:33:23.160 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.161+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=WQKG6780S64V type=del size=1035971 2024-03-09T14:33:23.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.163+0000 7f586ae3d780 1 < suggested update operation key=W4Q1MWHOQ4Y1 tag=JX4UEGHS4VCW type=del size=439541 2024-03-09T14:33:23.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.165+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~VYRFRKHC8YK4.0 size=1048576 2024-03-09T14:33:23.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.166+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~VYRFRKHC8YK4.1 size=236339 2024-03-09T14:33:23.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.166+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=VYRFRKHC8YK4 tag=07V4ZB95N2JM type=write size=2333491 2024-03-09T14:33:23.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.168+0000 7f586ae3d780 1 < suggested remove operation key=P3OUIQNAK1TC tag=PPBNR0QXRW77 type=del 2024-03-09T14:33:23.169 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.170+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=6TXUSN2M9ZA6 type=del size=3098226 2024-03-09T14:33:23.170 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.171+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~14GS29YPVJEO.0 size=1048576 2024-03-09T14:33:23.171 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.172+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~14GS29YPVJEO.1 size=1048576 2024-03-09T14:33:23.172 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.173+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~14GS29YPVJEO.2 size=242879 2024-03-09T14:33:23.174 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.174+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=14GS29YPVJEO tag=HOAREH28UMFE type=write size=3388607 2024-03-09T14:33:23.176 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.176+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~52CEUID24SHV.0 size=1048576 2024-03-09T14:33:23.177 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.177+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~52CEUID24SHV.1 size=905680 2024-03-09T14:33:23.177 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.177+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=52CEUID24SHV tag=I72N1R70LUWF type=write size=3002832 2024-03-09T14:33:23.179 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.180+0000 7f586ae3d780 1 < suggested update operation key=G2BIOBESOIK9 tag=9FYVHXGTBKLP type=write size=841810 2024-03-09T14:33:23.180 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.181+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=ZHLX5FN2YC06 type=del size=545210 2024-03-09T14:33:23.181 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.182+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=1F5D3JLJBTLQ type=del 2024-03-09T14:33:23.182 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.183+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=GG7ZKR3BCP44 type=del size=3796870 2024-03-09T14:33:23.184 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.184+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=7CVVSD4PIARU type=del 2024-03-09T14:33:23.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.186+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~8YR8D9AJ8KVT.0 size=1048576 2024-03-09T14:33:23.187 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.187+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~8YR8D9AJ8KVT.1 size=1048576 2024-03-09T14:33:23.188 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.188+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~8YR8D9AJ8KVT.2 size=472238 2024-03-09T14:33:23.188 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.188+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=8YR8D9AJ8KVT tag=EZJMEEW7XSN6 type=write size=3617966 2024-03-09T14:33:23.190 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.190+0000 7f586ae3d780 1 < suggested remove operation key=C1UGQOQ6AE1E tag=HE3JEE6Y1CAK type=del 2024-03-09T14:33:23.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.192+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=ZLFPHPWFENXW type=del size=76277 2024-03-09T14:33:23.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.192+0000 7f586ae3d780 1 < canceled part key=_multipart_C1UGQOQ6AE1E.2~5CHGFVV2ETRC.0 size=845399 2024-03-09T14:33:23.193 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.194+0000 7f586ae3d780 1 < canceled multipart upload key=C1UGQOQ6AE1E upload=5CHGFVV2ETRC tag=HX0EOPBG4V06 type=write size=1893975 2024-03-09T14:33:23.195 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.196+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~171WT5P24ZLA.0 size=455282 2024-03-09T14:33:23.195 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.196+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=171WT5P24ZLA tag=9FVZ3VA6S2CC type=write size=1503858 2024-03-09T14:33:23.196 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.197+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=2ANCEO4PL3FI type=del 2024-03-09T14:33:23.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.199+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~9EW377AJPJVA.0 size=1048576 2024-03-09T14:33:23.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.200+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~9EW377AJPJVA.1 size=604748 2024-03-09T14:33:23.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.200+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=9EW377AJPJVA tag=P1467K4IFODD type=write size=2701900 2024-03-09T14:33:23.201 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.201+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=MUK0Z3OP5LFY type=del 2024-03-09T14:33:23.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.202+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=EPQS8ZFFM0OY type=del size=3945338 2024-03-09T14:33:23.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.204+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=0SWR8J9TXGJY type=del 2024-03-09T14:33:23.205 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.206+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~KZZ92FN3VQVU.0 size=1048576 2024-03-09T14:33:23.206 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.207+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~KZZ92FN3VQVU.1 size=1048576 2024-03-09T14:33:23.207 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.208+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~KZZ92FN3VQVU.2 size=77387 2024-03-09T14:33:23.207 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.208+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=KZZ92FN3VQVU tag=M8Q77YO6VR4I type=write size=3223115 2024-03-09T14:33:23.209 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.210+0000 7f586ae3d780 1 < suggested update operation key=UAYZ55UT77VE tag=6S3458E6YU0N type=del size=1860529 2024-03-09T14:33:23.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.212+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~6MDQOPYM2F0W.0 size=1048576 2024-03-09T14:33:23.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.213+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~6MDQOPYM2F0W.1 size=64661 2024-03-09T14:33:23.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.213+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=6MDQOPYM2F0W tag=BPRURLFERTFA type=write size=2161813 2024-03-09T14:33:23.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.214+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~5GGOKSN09FC3.0 size=1048576 2024-03-09T14:33:23.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.215+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~5GGOKSN09FC3.1 size=1048576 2024-03-09T14:33:23.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.216+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~5GGOKSN09FC3.2 size=831490 2024-03-09T14:33:23.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.218+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=5GGOKSN09FC3 tag=9OVZOAY452M1 type=write size=3977218 2024-03-09T14:33:23.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.220+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~VTCRD73U54NB.0 size=1048576 2024-03-09T14:33:23.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.221+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~VTCRD73U54NB.1 size=1048576 2024-03-09T14:33:23.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.222+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~VTCRD73U54NB.2 size=795340 2024-03-09T14:33:23.222 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.222+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=VTCRD73U54NB tag=Y567OTOZMC6J type=write size=3941068 2024-03-09T14:33:23.223 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.223+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~N12R6BPUE98D.0 size=1048576 2024-03-09T14:33:23.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.224+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~N12R6BPUE98D.1 size=1048576 2024-03-09T14:33:23.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.225+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~N12R6BPUE98D.2 size=343969 2024-03-09T14:33:23.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.227+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=N12R6BPUE98D tag=976DV6CEJFKD type=write size=3489697 2024-03-09T14:33:23.229 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.229+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~L9HCG34RBANS.0 size=280963 2024-03-09T14:33:23.229 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.229+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=L9HCG34RBANS tag=X8K6BA2G301H type=write size=1329539 2024-03-09T14:33:23.231 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.231+0000 7f586ae3d780 1 < suggested update operation key=IK528ND96157 tag=7T7P5GER48J3 type=del size=1424292 2024-03-09T14:33:23.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.233+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=9SMHG1P8LOC1 type=del size=3253108 2024-03-09T14:33:23.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.234+0000 7f586ae3d780 1 < canceled operation key=DJH53FNVMLGY tag=WQKG6780S64V type=del size=1035971 2024-03-09T14:33:23.236 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.236+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~X27WUD434H0O.0 size=1042432 2024-03-09T14:33:23.236 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.236+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=X27WUD434H0O tag=EBVAR7U5VEKP type=write size=2091008 2024-03-09T14:33:23.237 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.237+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~VYRFRKHC8YK4.0 size=1048576 2024-03-09T14:33:23.238 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.238+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~VYRFRKHC8YK4.1 size=236339 2024-03-09T14:33:23.240 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.240+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=VYRFRKHC8YK4 tag=07V4ZB95N2JM type=write size=2333491 2024-03-09T14:33:23.241 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.242+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=D3Y5T8JOYIG6 type=del size=2244417 2024-03-09T14:33:23.242 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.243+0000 7f586ae3d780 1 < canceled operation key=UKPSUQ6LYWN8 tag=6TXUSN2M9ZA6 type=del size=3098226 2024-03-09T14:33:23.243 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.244+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=EM567K6I465L type=del size=2328837 2024-03-09T14:33:23.245 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.245+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~52CEUID24SHV.0 size=1048576 2024-03-09T14:33:23.246 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.246+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~52CEUID24SHV.1 size=905680 2024-03-09T14:33:23.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.249+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=52CEUID24SHV tag=I72N1R70LUWF type=write size=3002832 2024-03-09T14:33:23.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.250+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=M5Y43JD53MTO type=del size=1586399 2024-03-09T14:33:23.250 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.251+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=ZHLX5FN2YC06 type=del 2024-03-09T14:33:23.251 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.252+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=KK08RSX10WH9 type=del size=3692536 2024-03-09T14:33:23.252 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.253+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=GG7ZKR3BCP44 type=del 2024-03-09T14:33:23.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.255+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~AB0IISAXMKO2.0 size=1048576 2024-03-09T14:33:23.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.256+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~AB0IISAXMKO2.1 size=1048576 2024-03-09T14:33:23.256 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.257+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~AB0IISAXMKO2.2 size=854615 2024-03-09T14:33:23.256 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.257+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=AB0IISAXMKO2 tag=KA6QTR5VK9HB type=write size=4000343 2024-03-09T14:33:23.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.258+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~8YR8D9AJ8KVT.0 size=1048576 2024-03-09T14:33:23.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.259+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~8YR8D9AJ8KVT.1 size=1048576 2024-03-09T14:33:23.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.260+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~8YR8D9AJ8KVT.2 size=472238 2024-03-09T14:33:23.262 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.262+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=8YR8D9AJ8KVT tag=EZJMEEW7XSN6 type=write size=3617966 2024-03-09T14:33:23.263 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.264+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=CLTHU7ON0ENV type=del size=3144679 2024-03-09T14:33:23.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.266+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=ZLFPHPWFENXW type=del 2024-03-09T14:33:23.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.267+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=D3V0VE42QEOM type=write size=242813 2024-03-09T14:33:23.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.267+0000 7f586ae3d780 1 < canceled part key=_multipart_78Y2ZM3W6EUC.2~171WT5P24ZLA.0 size=455282 2024-03-09T14:33:23.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.269+0000 7f586ae3d780 1 < canceled multipart upload key=78Y2ZM3W6EUC upload=171WT5P24ZLA tag=9FVZ3VA6S2CC type=write size=1503858 2024-03-09T14:33:23.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.271+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=CY5E0SYLTKNF type=del size=3499147 2024-03-09T14:33:23.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.271+0000 7f586ae3d780 1 < canceled part key=_multipart_UO072H74SHLP.2~9EW377AJPJVA.0 size=1048576 2024-03-09T14:33:23.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.272+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~9EW377AJPJVA.1 size=604748 2024-03-09T14:33:23.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.274+0000 7f586ae3d780 1 < canceled multipart upload key=UO072H74SHLP upload=9EW377AJPJVA tag=P1467K4IFODD type=write size=2701900 2024-03-09T14:33:23.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.275+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=UQ7QTV0ET7C4 type=del size=2943638 2024-03-09T14:33:23.276 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.277+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=EPQS8ZFFM0OY type=del 2024-03-09T14:33:23.278 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.279+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~J1EFFPACLLSK.0 size=877526 2024-03-09T14:33:23.278 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.279+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=J1EFFPACLLSK tag=UAS2SLZPJBOG type=write size=1926102 2024-03-09T14:33:23.279 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.279+0000 7f586ae3d780 1 < canceled part key=_multipart_NHIOOLNXLZZC.2~KZZ92FN3VQVU.0 size=1048576 2024-03-09T14:33:23.280 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.280+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~KZZ92FN3VQVU.1 size=1048576 2024-03-09T14:33:23.280 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.280+0000 7f586ae3d780 1 < canceled part key=_multipart_NHIOOLNXLZZC.2~KZZ92FN3VQVU.2 size=77387 2024-03-09T14:33:23.282 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.282+0000 7f586ae3d780 1 < canceled multipart upload key=NHIOOLNXLZZC upload=KZZ92FN3VQVU tag=M8Q77YO6VR4I type=write size=3223115 2024-03-09T14:33:23.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.283+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=A1XH32J5AOEJ type=del size=3609287 2024-03-09T14:33:23.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.284+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~6MDQOPYM2F0W.0 size=1048576 2024-03-09T14:33:23.285 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.285+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~6MDQOPYM2F0W.1 size=64661 2024-03-09T14:33:23.287 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.288+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=6MDQOPYM2F0W tag=BPRURLFERTFA type=write size=2161813 2024-03-09T14:33:23.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.290+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~BLY98TEI0XK5.0 size=632567 2024-03-09T14:33:23.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.290+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=BLY98TEI0XK5 tag=80C954VPCSTB type=write size=1681143 2024-03-09T14:33:23.290 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.291+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~VTCRD73U54NB.0 size=1048576 2024-03-09T14:33:23.291 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.292+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~VTCRD73U54NB.1 size=1048576 2024-03-09T14:33:23.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.292+0000 7f586ae3d780 1 < canceled part key=_multipart_6YWLPUULN5SY.2~VTCRD73U54NB.2 size=795340 2024-03-09T14:33:23.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.294+0000 7f586ae3d780 1 < canceled multipart upload key=6YWLPUULN5SY upload=VTCRD73U54NB tag=Y567OTOZMC6J type=write size=3941068 2024-03-09T14:33:23.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.296+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~IM0RG51DH031.0 size=1048576 2024-03-09T14:33:23.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.297+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~IM0RG51DH031.1 size=564495 2024-03-09T14:33:23.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.297+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=IM0RG51DH031 tag=U7J4BMDAGSWV type=write size=2661647 2024-03-09T14:33:23.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.298+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~L9HCG34RBANS.0 size=280963 2024-03-09T14:33:23.300 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.300+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=L9HCG34RBANS tag=X8K6BA2G301H type=write size=1329539 2024-03-09T14:33:23.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.302+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~9U7GQWUBVOEJ.0 size=235040 2024-03-09T14:33:23.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.302+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=9U7GQWUBVOEJ tag=W18TJ3MW37T5 type=write size=1283616 2024-03-09T14:33:23.303 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.303+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=9SMHG1P8LOC1 type=del 2024-03-09T14:33:23.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.305+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~RJCOCEKDC50E.0 size=1048576 2024-03-09T14:33:23.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.306+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~RJCOCEKDC50E.1 size=1048576 2024-03-09T14:33:23.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.307+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~RJCOCEKDC50E.2 size=652857 2024-03-09T14:33:23.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.307+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=RJCOCEKDC50E tag=NKLM9IWRVI10 type=write size=3798585 2024-03-09T14:33:23.308 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.308+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~X27WUD434H0O.0 size=1042432 2024-03-09T14:33:23.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.310+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=X27WUD434H0O tag=EBVAR7U5VEKP type=write size=2091008 2024-03-09T14:33:23.312 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.312+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~KCOYLW00NNJN.0 size=1048576 2024-03-09T14:33:23.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.313+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~KCOYLW00NNJN.1 size=913003 2024-03-09T14:33:23.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.313+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=KCOYLW00NNJN tag=70CW2N4QDPXP type=write size=3010155 2024-03-09T14:33:23.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.314+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=D3Y5T8JOYIG6 type=del 2024-03-09T14:33:23.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.315+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=SGVYDUZPIKVP type=write size=1004335 2024-03-09T14:33:23.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.317+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=EM567K6I465L type=del 2024-03-09T14:33:23.318 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.319+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~RIN1DDS0WSLE.0 size=1048576 2024-03-09T14:33:23.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.319+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~RIN1DDS0WSLE.1 size=666308 2024-03-09T14:33:23.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.319+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=RIN1DDS0WSLE tag=4035F1PA6QAA type=write size=2763460 2024-03-09T14:33:23.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.321+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=M5Y43JD53MTO type=del 2024-03-09T14:33:23.321 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.322+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=F01KMIHYNXTD type=del size=3521146 2024-03-09T14:33:23.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.323+0000 7f586ae3d780 1 < canceled operation key=BHSYRD3IEJWW tag=KK08RSX10WH9 type=del size=3692536 2024-03-09T14:33:23.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.326+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~OQ9OJ6Y8NRKZ.0 size=961904 2024-03-09T14:33:23.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.326+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=OQ9OJ6Y8NRKZ tag=C56LOMF9K2DJ type=write size=2010480 2024-03-09T14:33:23.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.328+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~AB0IISAXMKO2.0 size=1048576 2024-03-09T14:33:23.329 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.329+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~AB0IISAXMKO2.1 size=1048576 2024-03-09T14:33:23.329 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.329+0000 7f586ae3d780 1 < canceled part key=_multipart_NHIOOLNXLZZC.2~AB0IISAXMKO2.2 size=854615 2024-03-09T14:33:23.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.331+0000 7f586ae3d780 1 < canceled multipart upload key=NHIOOLNXLZZC upload=AB0IISAXMKO2 tag=KA6QTR5VK9HB type=write size=4000343 2024-03-09T14:33:23.333 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.333+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~ETEY6NU0M1BO.0 size=975464 2024-03-09T14:33:23.333 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.333+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=ETEY6NU0M1BO tag=UI4D3TQYUKMM type=write size=2024040 2024-03-09T14:33:23.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.334+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=CLTHU7ON0ENV type=del 2024-03-09T14:33:23.335 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.336+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=FYQHL8KKRYQV type=del size=2345780 2024-03-09T14:33:23.336 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.337+0000 7f586ae3d780 1 < completed write operation key=O5L6RC16RS8E tag=D3V0VE42QEOM type=write size=242813 2024-03-09T14:33:23.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.338+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=NZEE1UO7IU99 type=del size=2309573 2024-03-09T14:33:23.339 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.339+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=CY5E0SYLTKNF type=del 2024-03-09T14:33:23.340 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.341+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=M1RXRR6X4Y3Y type=del size=3148939 2024-03-09T14:33:23.341 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.342+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=UQ7QTV0ET7C4 type=del 2024-03-09T14:33:23.343 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.343+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=ZRRQXRMJ4GB2 type=del size=1188462 2024-03-09T14:33:23.344 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.344+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~J1EFFPACLLSK.0 size=877526 2024-03-09T14:33:23.346 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.346+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=J1EFFPACLLSK tag=UAS2SLZPJBOG type=write size=1926102 2024-03-09T14:33:23.347 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.347+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=3E3SLR2H2YOO type=del size=361356 2024-03-09T14:33:23.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.349+0000 7f586ae3d780 1 < suggested update operation key=04E9KDGUC274 tag=A1XH32J5AOEJ type=del size=3609287 2024-03-09T14:33:23.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.351+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=SMXBWU7X5TR9 type=del size=3180623 2024-03-09T14:33:23.351 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.352+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~BLY98TEI0XK5.0 size=632567 2024-03-09T14:33:23.353 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.354+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=BLY98TEI0XK5 tag=80C954VPCSTB type=write size=1681143 2024-03-09T14:33:23.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.355+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=1LLD32228BJX type=del size=2162669 2024-03-09T14:33:23.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.356+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~IM0RG51DH031.0 size=1048576 2024-03-09T14:33:23.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.357+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~IM0RG51DH031.1 size=564495 2024-03-09T14:33:23.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.359+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=IM0RG51DH031 tag=U7J4BMDAGSWV type=write size=2661647 2024-03-09T14:33:23.360 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.361+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~JOTG4GARMJQM.0 size=857299 2024-03-09T14:33:23.360 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.361+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=JOTG4GARMJQM tag=W54ZB1RNH6HC type=write size=1905875 2024-03-09T14:33:23.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.362+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~9U7GQWUBVOEJ.0 size=235040 2024-03-09T14:33:23.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.364+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=9U7GQWUBVOEJ tag=W18TJ3MW37T5 type=write size=1283616 2024-03-09T14:33:23.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.365+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=SCWZTLJRHTTC type=del size=1953826 2024-03-09T14:33:23.366 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.366+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~RJCOCEKDC50E.0 size=1048576 2024-03-09T14:33:23.366 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.367+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~RJCOCEKDC50E.1 size=1048576 2024-03-09T14:33:23.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.368+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~RJCOCEKDC50E.2 size=652857 2024-03-09T14:33:23.369 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.370+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=RJCOCEKDC50E tag=NKLM9IWRVI10 type=write size=3798585 2024-03-09T14:33:23.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.371+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=ZJEPZZAUT89Y type=write size=358752 2024-03-09T14:33:23.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.373+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~KCOYLW00NNJN.0 size=1048576 2024-03-09T14:33:23.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.374+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~KCOYLW00NNJN.1 size=913003 2024-03-09T14:33:23.377 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.377+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=KCOYLW00NNJN tag=70CW2N4QDPXP type=write size=3010155 2024-03-09T14:33:23.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.378+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=4ELBRO3NH3ZR type=del size=1206057 2024-03-09T14:33:23.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.379+0000 7f586ae3d780 1 < completed write operation key=NHIOOLNXLZZC tag=SGVYDUZPIKVP type=write size=1004335 2024-03-09T14:33:23.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.381+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~4V0RHU3YIOT4.0 size=1048576 2024-03-09T14:33:23.382 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.382+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~4V0RHU3YIOT4.1 size=309922 2024-03-09T14:33:23.382 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.382+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=4V0RHU3YIOT4 tag=2DG6WXO01NNX type=write size=2407074 2024-03-09T14:33:23.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.384+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~RIN1DDS0WSLE.0 size=1048576 2024-03-09T14:33:23.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.384+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~RIN1DDS0WSLE.1 size=666308 2024-03-09T14:33:23.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.387+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=RIN1DDS0WSLE tag=4035F1PA6QAA type=write size=2763460 2024-03-09T14:33:23.387 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.388+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=L8I1KDQ53KAV type=write size=810494 2024-03-09T14:33:23.389 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.389+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=F01KMIHYNXTD type=del 2024-03-09T14:33:23.391 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.392+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~71FIZMEXDM3C.0 size=1048576 2024-03-09T14:33:23.392 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.392+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~71FIZMEXDM3C.1 size=1048576 2024-03-09T14:33:23.393 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.393+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~71FIZMEXDM3C.2 size=385396 2024-03-09T14:33:23.393 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.393+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=71FIZMEXDM3C tag=A7AQEJ5IU0XN type=write size=3531124 2024-03-09T14:33:23.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.395+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~OQ9OJ6Y8NRKZ.0 size=961904 2024-03-09T14:33:23.396 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.397+0000 7f586ae3d780 1 < completed multipart upload key=UAYZ55UT77VE upload=OQ9OJ6Y8NRKZ tag=C56LOMF9K2DJ type=write size=2010480 2024-03-09T14:33:23.399 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.399+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~28VLEDN9B5QA.0 size=1048576 2024-03-09T14:33:23.399 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.400+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~28VLEDN9B5QA.1 size=1048576 2024-03-09T14:33:23.400 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.401+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~28VLEDN9B5QA.2 size=757764 2024-03-09T14:33:23.400 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.401+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=28VLEDN9B5QA tag=636H7PA3NCF1 type=write size=3903492 2024-03-09T14:33:23.402 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.402+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~ETEY6NU0M1BO.0 size=975464 2024-03-09T14:33:23.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.404+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=ETEY6NU0M1BO tag=UI4D3TQYUKMM type=write size=2024040 2024-03-09T14:33:23.405 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.405+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=1ADL166K8MRF type=del size=2847760 2024-03-09T14:33:23.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.407+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=FYQHL8KKRYQV type=del 2024-03-09T14:33:23.408 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.409+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~CW2DZGZ3B9SX.0 size=1048576 2024-03-09T14:33:23.409 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.410+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~CW2DZGZ3B9SX.1 size=239422 2024-03-09T14:33:23.409 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.410+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=CW2DZGZ3B9SX tag=YYXQOX2WZRK4 type=write size=2336574 2024-03-09T14:33:23.410 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.411+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=NZEE1UO7IU99 type=del 2024-03-09T14:33:23.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.413+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~5SPMCI22F8TH.0 size=1048576 2024-03-09T14:33:23.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.413+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~5SPMCI22F8TH.1 size=384167 2024-03-09T14:33:23.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.413+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=5SPMCI22F8TH tag=LHLX7HF3Z14W type=write size=2481319 2024-03-09T14:33:23.414 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.415+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=M1RXRR6X4Y3Y type=del 2024-03-09T14:33:23.415 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.416+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=CD8S76LFKN6H type=del size=2006445 2024-03-09T14:33:23.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.417+0000 7f586ae3d780 1 < completed delete operation key=NHIOOLNXLZZC tag=ZRRQXRMJ4GB2 type=del 2024-03-09T14:33:23.417 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.418+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=NMKXYNA5O4F3 type=write size=649574 2024-03-09T14:33:23.418 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.419+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=3E3SLR2H2YOO type=del 2024-03-09T14:33:23.420 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.420+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=BV5LPHRXXBZS type=del size=3460527 2024-03-09T14:33:23.421 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.421+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=SMXBWU7X5TR9 type=del 2024-03-09T14:33:23.422 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.422+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=YOV7E0FSOO15 type=del size=499489 2024-03-09T14:33:23.423 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.423+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=1LLD32228BJX type=del 2024-03-09T14:33:23.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.425+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=7STXBUJR6ZLZ type=del size=1384859 2024-03-09T14:33:23.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.426+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~JOTG4GARMJQM.0 size=857299 2024-03-09T14:33:23.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.428+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=JOTG4GARMJQM tag=W54ZB1RNH6HC type=write size=1905875 2024-03-09T14:33:23.428 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.429+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=7201PLMXSE9I type=del size=3658574 2024-03-09T14:33:23.429 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.430+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=SCWZTLJRHTTC type=del 2024-03-09T14:33:23.431 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.432+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~KI6FU6Z4557E.0 size=1048576 2024-03-09T14:33:23.432 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.433+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~KI6FU6Z4557E.1 size=1048576 2024-03-09T14:33:23.433 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.434+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~KI6FU6Z4557E.2 size=25343 2024-03-09T14:33:23.433 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.434+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=KI6FU6Z4557E tag=LYX8JLRFG5I7 type=write size=3171071 2024-03-09T14:33:23.434 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.435+0000 7f586ae3d780 1 < completed write operation key=0JDF7910RACF tag=ZJEPZZAUT89Y type=write size=358752 2024-03-09T14:33:23.435 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.436+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=V01TIGQUEWDS type=del size=3448298 2024-03-09T14:33:23.436 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.437+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=4ELBRO3NH3ZR type=del 2024-03-09T14:33:23.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.438+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=2NFPRIV3X8JQ type=del size=2624904 2024-03-09T14:33:23.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.439+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~4V0RHU3YIOT4.0 size=1048576 2024-03-09T14:33:23.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.439+0000 7f586ae3d780 1 < canceled part key=_multipart_W3HTK2F8ML3V.2~4V0RHU3YIOT4.1 size=309922 2024-03-09T14:33:23.441 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.441+0000 7f586ae3d780 1 < canceled multipart upload key=W3HTK2F8ML3V upload=4V0RHU3YIOT4 tag=2DG6WXO01NNX type=write size=2407074 2024-03-09T14:33:23.443 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.443+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~QWHUQBN21E0I.0 size=1048576 2024-03-09T14:33:23.443 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.444+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~QWHUQBN21E0I.1 size=983164 2024-03-09T14:33:23.444 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.444+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=QWHUQBN21E0I tag=UJPZBHQQHUFG type=write size=3080316 2024-03-09T14:33:23.445 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.445+0000 7f586ae3d780 1 < canceled operation key=P3OUIQNAK1TC tag=L8I1KDQ53KAV type=write size=810494 2024-03-09T14:33:23.446 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.446+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=AVQPATQ5N04J type=del size=989375 2024-03-09T14:33:23.447 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.448+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~71FIZMEXDM3C.0 size=1048576 2024-03-09T14:33:23.448 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.449+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~71FIZMEXDM3C.1 size=1048576 2024-03-09T14:33:23.449 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.450+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~71FIZMEXDM3C.2 size=385396 2024-03-09T14:33:23.451 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.451+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=71FIZMEXDM3C tag=A7AQEJ5IU0XN type=write size=3531124 2024-03-09T14:33:23.452 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.453+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=JX04J13LGR2T type=del size=1488703 2024-03-09T14:33:23.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.454+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~28VLEDN9B5QA.0 size=1048576 2024-03-09T14:33:23.456 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.456+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~28VLEDN9B5QA.1 size=1048576 2024-03-09T14:33:23.457 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.457+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~28VLEDN9B5QA.2 size=757764 2024-03-09T14:33:23.459 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.459+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=28VLEDN9B5QA tag=636H7PA3NCF1 type=write size=3903492 2024-03-09T14:33:23.461 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.461+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~BG277C3W4NM4.0 size=1048576 2024-03-09T14:33:23.462 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.462+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~BG277C3W4NM4.1 size=14536 2024-03-09T14:33:23.462 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.462+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=BG277C3W4NM4 tag=M23PJFOUY3UN type=write size=2111688 2024-03-09T14:33:23.464 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.464+0000 7f586ae3d780 1 < suggested remove operation key=W4Q1MWHOQ4Y1 tag=1ADL166K8MRF type=del 2024-03-09T14:33:23.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.465+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=2OR6A5ESXPCH type=del size=3059704 2024-03-09T14:33:23.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.467+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~CW2DZGZ3B9SX.0 size=1048576 2024-03-09T14:33:23.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.468+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~CW2DZGZ3B9SX.1 size=239422 2024-03-09T14:33:23.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.470+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=CW2DZGZ3B9SX tag=YYXQOX2WZRK4 type=write size=2336574 2024-03-09T14:33:23.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.472+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~2BUSAQ8K0TSF.0 size=1048576 2024-03-09T14:33:23.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.473+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~2BUSAQ8K0TSF.1 size=1048576 2024-03-09T14:33:23.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.474+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~2BUSAQ8K0TSF.2 size=263978 2024-03-09T14:33:23.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.474+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=2BUSAQ8K0TSF tag=0JGUIG0FZDN1 type=write size=3409706 2024-03-09T14:33:23.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.475+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~5SPMCI22F8TH.0 size=1048576 2024-03-09T14:33:23.475 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.476+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~5SPMCI22F8TH.1 size=384167 2024-03-09T14:33:23.478 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.478+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=5SPMCI22F8TH tag=LHLX7HF3Z14W type=write size=2481319 2024-03-09T14:33:23.480 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.480+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~43B02PB74U18.0 size=1048576 2024-03-09T14:33:23.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.481+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~43B02PB74U18.1 size=128967 2024-03-09T14:33:23.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.481+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=43B02PB74U18 tag=019HTW0JQDO1 type=write size=2226119 2024-03-09T14:33:23.482 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.483+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=CD8S76LFKN6H type=del 2024-03-09T14:33:23.483 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.484+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=FJQMOQ5C1KS3 type=del size=4177883 2024-03-09T14:33:23.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.486+0000 7f586ae3d780 1 < completed write operation key=FNZ3BNA7W12E tag=NMKXYNA5O4F3 type=write size=649574 2024-03-09T14:33:23.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.487+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=5V572G6X4W7E type=del size=2260889 2024-03-09T14:33:23.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.488+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=BV5LPHRXXBZS type=del 2024-03-09T14:33:23.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.489+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=2B4DN82OJM2K type=del size=799653 2024-03-09T14:33:23.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.491+0000 7f586ae3d780 1 < canceled operation key=W3HTK2F8ML3V tag=YOV7E0FSOO15 type=del size=499489 2024-03-09T14:33:23.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.493+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~DNHZZIHVTIK1.0 size=1048576 2024-03-09T14:33:23.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.494+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~DNHZZIHVTIK1.1 size=74216 2024-03-09T14:33:23.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.494+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=DNHZZIHVTIK1 tag=PMKAO2O13E4I type=write size=2171368 2024-03-09T14:33:23.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.495+0000 7f586ae3d780 -1 < failed to complete operation key=W4Q1MWHOQ4Y1 tag=7STXBUJR6ZLZ type=del size=1384859: (22) Invalid argument 2024-03-09T14:33:23.498 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.496+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=NA86IIHTILHU type=write size=769137 2024-03-09T14:33:23.498 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.497+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=7201PLMXSE9I type=del 2024-03-09T14:33:23.498 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.499+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~K3H7N8SWADJC.0 size=1048576 2024-03-09T14:33:23.499 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.500+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~K3H7N8SWADJC.1 size=270342 2024-03-09T14:33:23.500 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.500+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=K3H7N8SWADJC tag=XAWRNH6W6YA2 type=write size=2367494 2024-03-09T14:33:23.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.501+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~KI6FU6Z4557E.0 size=1048576 2024-03-09T14:33:23.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.502+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~KI6FU6Z4557E.1 size=1048576 2024-03-09T14:33:23.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.503+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~KI6FU6Z4557E.2 size=25343 2024-03-09T14:33:23.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.505+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=KI6FU6Z4557E tag=LYX8JLRFG5I7 type=write size=3171071 2024-03-09T14:33:23.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.506+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=76EE2YFA1ADH type=del size=3049140 2024-03-09T14:33:23.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.507+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=V01TIGQUEWDS type=del 2024-03-09T14:33:23.508 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.508+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=3AZM7ZXPK5JO type=del size=2905771 2024-03-09T14:33:23.509 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.510+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=2NFPRIV3X8JQ type=del 2024-03-09T14:33:23.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.511+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=WWKXAZL3272N type=del size=532137 2024-03-09T14:33:23.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.512+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~QWHUQBN21E0I.0 size=1048576 2024-03-09T14:33:23.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.513+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~QWHUQBN21E0I.1 size=983164 2024-03-09T14:33:23.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.515+0000 7f586ae3d780 1 < completed multipart upload key=LRI2GKBGVCWW upload=QWHUQBN21E0I tag=UJPZBHQQHUFG type=write size=3080316 2024-03-09T14:33:23.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.517+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~C5BZAYXITNKZ.0 size=1048576 2024-03-09T14:33:23.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.518+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~C5BZAYXITNKZ.1 size=1048576 2024-03-09T14:33:23.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.519+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~C5BZAYXITNKZ.2 size=474150 2024-03-09T14:33:23.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.519+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=C5BZAYXITNKZ tag=XC31QYA8VH90 type=write size=3619878 2024-03-09T14:33:23.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.520+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=AVQPATQ5N04J type=del 2024-03-09T14:33:23.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.521+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=GR2NMQZOTIJX type=del size=2319999 2024-03-09T14:33:23.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.522+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=JX04J13LGR2T type=del 2024-03-09T14:33:23.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.524+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~WJW143X14OWR.0 size=1048576 2024-03-09T14:33:23.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.525+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~WJW143X14OWR.1 size=6591 2024-03-09T14:33:23.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.525+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=WJW143X14OWR tag=DM8MJJUW9H3T type=write size=2103743 2024-03-09T14:33:23.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.526+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~BG277C3W4NM4.0 size=1048576 2024-03-09T14:33:23.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.527+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~BG277C3W4NM4.1 size=14536 2024-03-09T14:33:23.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.529+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=BG277C3W4NM4 tag=M23PJFOUY3UN type=write size=2111688 2024-03-09T14:33:23.530 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.530+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=D4R4MRZCMC28 type=del size=2183781 2024-03-09T14:33:23.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.531+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=2OR6A5ESXPCH type=del 2024-03-09T14:33:23.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.532+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=TN1CJE1BB5I6 type=write size=757964 2024-03-09T14:33:23.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.534+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~2BUSAQ8K0TSF.0 size=1048576 2024-03-09T14:33:23.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.534+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~2BUSAQ8K0TSF.1 size=1048576 2024-03-09T14:33:23.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.535+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~2BUSAQ8K0TSF.2 size=263978 2024-03-09T14:33:23.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.537+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=2BUSAQ8K0TSF tag=0JGUIG0FZDN1 type=write size=3409706 2024-03-09T14:33:23.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.538+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=5QHP3TYC707I type=write size=657060 2024-03-09T14:33:23.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.540+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~43B02PB74U18.0 size=1048576 2024-03-09T14:33:23.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.541+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~43B02PB74U18.1 size=128967 2024-03-09T14:33:23.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.542+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=43B02PB74U18 tag=019HTW0JQDO1 type=write size=2226119 2024-03-09T14:33:23.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.544+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=Y0HZSPBN5W8Z type=del size=3664422 2024-03-09T14:33:23.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.545+0000 7f586ae3d780 1 < canceled operation key=XIYWPXSYCT6I tag=FJQMOQ5C1KS3 type=del size=4177883 2024-03-09T14:33:23.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.546+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=OE0CK3HW8L8T type=write size=552772 2024-03-09T14:33:23.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.547+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=5V572G6X4W7E type=del 2024-03-09T14:33:23.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.548+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=HAYJFC14Z0PM type=write size=536844 2024-03-09T14:33:23.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.549+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=2B4DN82OJM2K type=del 2024-03-09T14:33:23.550 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.550+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=9X32GJF14JKL type=del size=3392226 2024-03-09T14:33:23.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.552+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~DNHZZIHVTIK1.0 size=1048576 2024-03-09T14:33:23.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.552+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~DNHZZIHVTIK1.1 size=74216 2024-03-09T14:33:23.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.554+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=DNHZZIHVTIK1 tag=PMKAO2O13E4I type=write size=2171368 2024-03-09T14:33:23.555 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.556+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=P7VY3N6OLPZ5 type=del size=3415374 2024-03-09T14:33:23.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.557+0000 7f586ae3d780 1 < canceled operation key=NHIOOLNXLZZC tag=NA86IIHTILHU type=write size=769137 2024-03-09T14:33:23.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.559+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~5EB3I1WLP375.0 size=785016 2024-03-09T14:33:23.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.559+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=5EB3I1WLP375 tag=T6XIFNABWR8J type=write size=1833592 2024-03-09T14:33:23.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.559+0000 7f586ae3d780 1 < canceled part key=_multipart_CZGAXNJ0GKU0.2~K3H7N8SWADJC.0 size=1048576 2024-03-09T14:33:23.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.560+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~K3H7N8SWADJC.1 size=270342 2024-03-09T14:33:23.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.562+0000 7f586ae3d780 1 < canceled multipart upload key=CZGAXNJ0GKU0 upload=K3H7N8SWADJC tag=XAWRNH6W6YA2 type=write size=2367494 2024-03-09T14:33:23.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.564+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~PQDDI5SXVJUZ.0 size=1048576 2024-03-09T14:33:23.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.565+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~PQDDI5SXVJUZ.1 size=1048576 2024-03-09T14:33:23.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.566+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~PQDDI5SXVJUZ.2 size=720488 2024-03-09T14:33:23.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.566+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=PQDDI5SXVJUZ tag=TRQ3DVKYUD1F type=write size=3866216 2024-03-09T14:33:23.567 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.568+0000 7f586ae3d780 1 < canceled operation key=9ZPCSBP3P58P tag=76EE2YFA1ADH type=del size=3049140 2024-03-09T14:33:23.568 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.569+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=XIRAAVRX811K type=del size=774572 2024-03-09T14:33:23.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.570+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=3AZM7ZXPK5JO type=del 2024-03-09T14:33:23.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.571+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=9LXPWFEH2VP8 type=del size=1432700 2024-03-09T14:33:23.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.572+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=WWKXAZL3272N type=del 2024-03-09T14:33:23.574 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.574+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~ZEDI42TH6DOD.0 size=1048576 2024-03-09T14:33:23.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.575+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~ZEDI42TH6DOD.1 size=1048576 2024-03-09T14:33:23.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.576+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~ZEDI42TH6DOD.2 size=570666 2024-03-09T14:33:23.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.576+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=ZEDI42TH6DOD tag=G0YFSJN0RSVC type=write size=3716394 2024-03-09T14:33:23.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.577+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~C5BZAYXITNKZ.0 size=1048576 2024-03-09T14:33:23.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.578+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~C5BZAYXITNKZ.1 size=1048576 2024-03-09T14:33:23.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.579+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~C5BZAYXITNKZ.2 size=474150 2024-03-09T14:33:23.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.581+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=C5BZAYXITNKZ tag=XC31QYA8VH90 type=write size=3619878 2024-03-09T14:33:23.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.583+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~AQ052M70SF8G.0 size=988454 2024-03-09T14:33:23.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.583+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=AQ052M70SF8G tag=XDP6Z9YVA9IM type=write size=2037030 2024-03-09T14:33:23.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.584+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=GR2NMQZOTIJX type=del 2024-03-09T14:33:23.585 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.585+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=3QHH0Q1R6XBU type=del size=2803799 2024-03-09T14:33:23.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.587+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~WJW143X14OWR.0 size=1048576 2024-03-09T14:33:23.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.588+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~WJW143X14OWR.1 size=6591 2024-03-09T14:33:23.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.589+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=WJW143X14OWR tag=DM8MJJUW9H3T type=write size=2103743 2024-03-09T14:33:23.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.592+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~6E5C6JDPN4NY.0 size=1048576 2024-03-09T14:33:23.593 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.593+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~6E5C6JDPN4NY.1 size=1048576 2024-03-09T14:33:23.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.594+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~6E5C6JDPN4NY.2 size=336131 2024-03-09T14:33:23.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.594+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=6E5C6JDPN4NY tag=KO6J0SMW67LN type=write size=3481859 2024-03-09T14:33:23.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.596+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=D4R4MRZCMC28 type=del 2024-03-09T14:33:23.597 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.597+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=5FEIMQXFD2NF type=del size=616066 2024-03-09T14:33:23.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.598+0000 7f586ae3d780 1 < completed write operation key=XIYWPXSYCT6I tag=TN1CJE1BB5I6 type=write size=757964 2024-03-09T14:33:23.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.600+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~JY8WORTSCC1B.0 size=1048576 2024-03-09T14:33:23.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.601+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~JY8WORTSCC1B.1 size=235639 2024-03-09T14:33:23.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.601+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=JY8WORTSCC1B tag=Y146DZI71CKE type=write size=2332791 2024-03-09T14:33:23.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.602+0000 7f586ae3d780 1 < completed write operation key=O5L6RC16RS8E tag=5QHP3TYC707I type=write size=657060 2024-03-09T14:33:23.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.604+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=7KW1J0XU3673 type=write size=407287 2024-03-09T14:33:23.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.605+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=Y0HZSPBN5W8Z type=del 2024-03-09T14:33:23.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.607+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~CJ4QU9T7WZEG.0 size=253365 2024-03-09T14:33:23.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.607+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=CJ4QU9T7WZEG tag=K1YAF2X138X5 type=write size=1301941 2024-03-09T14:33:23.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.608+0000 7f586ae3d780 1 < completed write operation key=OU9IOY7J572N tag=OE0CK3HW8L8T type=write size=552772 2024-03-09T14:33:23.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.609+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=ZQO490Y3NHGP type=write size=453999 2024-03-09T14:33:23.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.610+0000 7f586ae3d780 1 < completed write operation key=W3HTK2F8ML3V tag=HAYJFC14Z0PM type=write size=536844 2024-03-09T14:33:23.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.612+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~011JB72R7ILM.0 size=1048576 2024-03-09T14:33:23.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.613+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~011JB72R7ILM.1 size=1048576 2024-03-09T14:33:23.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.614+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~011JB72R7ILM.2 size=879767 2024-03-09T14:33:23.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.614+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=011JB72R7ILM tag=QDGUG29VDXFX type=write size=4025495 2024-03-09T14:33:23.615 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.615+0000 7f586ae3d780 1 < canceled operation key=IK528ND96157 tag=9X32GJF14JKL type=del size=3392226 2024-03-09T14:33:23.616 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.616+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=92X7XNOTFE28 type=del size=1351790 2024-03-09T14:33:23.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.619+0000 7f586ae3d780 1 < suggested update operation key=9ZPCSBP3P58P tag=P7VY3N6OLPZ5 type=del size=3415374 2024-03-09T14:33:23.619 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.620+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=EXVULTNQ8PYU type=del size=2497912 2024-03-09T14:33:23.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.621+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~5EB3I1WLP375.0 size=785016 2024-03-09T14:33:23.622 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.623+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=5EB3I1WLP375 tag=T6XIFNABWR8J type=write size=1833592 2024-03-09T14:33:23.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.624+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=4GUBXX1QXIOP type=del size=152641 2024-03-09T14:33:23.625 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.626+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~PQDDI5SXVJUZ.0 size=1048576 2024-03-09T14:33:23.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.626+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~PQDDI5SXVJUZ.1 size=1048576 2024-03-09T14:33:23.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.627+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~PQDDI5SXVJUZ.2 size=720488 2024-03-09T14:33:23.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.629+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=PQDDI5SXVJUZ tag=TRQ3DVKYUD1F type=write size=3866216 2024-03-09T14:33:23.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.631+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=6NO47F1AWGHW type=del size=2554601 2024-03-09T14:33:23.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.632+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=XIRAAVRX811K type=del 2024-03-09T14:33:23.633 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.634+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~ABZA4RNNUGL5.0 size=1048576 2024-03-09T14:33:23.634 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.635+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~ABZA4RNNUGL5.1 size=1018389 2024-03-09T14:33:23.634 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.635+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=ABZA4RNNUGL5 tag=JREMPRMNKHZS type=write size=3115541 2024-03-09T14:33:23.636 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.636+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=9LXPWFEH2VP8 type=del 2024-03-09T14:33:23.637 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.637+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=F2AKJO8Y0JVD type=del size=2439849 2024-03-09T14:33:23.638 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.639+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~ZEDI42TH6DOD.0 size=1048576 2024-03-09T14:33:23.639 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.639+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~ZEDI42TH6DOD.1 size=1048576 2024-03-09T14:33:23.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.640+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~ZEDI42TH6DOD.2 size=570666 2024-03-09T14:33:23.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.642+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=ZEDI42TH6DOD tag=G0YFSJN0RSVC type=write size=3716394 2024-03-09T14:33:23.643 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.644+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=WABA6MCF7UXB type=del size=1592619 2024-03-09T14:33:23.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.645+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~AQ052M70SF8G.0 size=988454 2024-03-09T14:33:23.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.647+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=AQ052M70SF8G tag=XDP6Z9YVA9IM type=write size=2037030 2024-03-09T14:33:23.647 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.648+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=0F9G52KGF49E type=write size=92937 2024-03-09T14:33:23.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.649+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=3QHH0Q1R6XBU type=del 2024-03-09T14:33:23.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.651+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~ZMKY9Z7UIJKH.0 size=1048576 2024-03-09T14:33:23.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.652+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~ZMKY9Z7UIJKH.1 size=1048576 2024-03-09T14:33:23.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.653+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~ZMKY9Z7UIJKH.2 size=79206 2024-03-09T14:33:23.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.653+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=ZMKY9Z7UIJKH tag=SXHM8V8QG0P9 type=write size=3224934 2024-03-09T14:33:23.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.654+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~6E5C6JDPN4NY.0 size=1048576 2024-03-09T14:33:23.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.655+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~6E5C6JDPN4NY.1 size=1048576 2024-03-09T14:33:23.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.656+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~6E5C6JDPN4NY.2 size=336131 2024-03-09T14:33:23.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.658+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=6E5C6JDPN4NY tag=KO6J0SMW67LN type=write size=3481859 2024-03-09T14:33:23.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.659+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=SLIBTIGJKN5B type=write size=836324 2024-03-09T14:33:23.660 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.660+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=5FEIMQXFD2NF type=del 2024-03-09T14:33:23.661 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.662+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=5IB3V6R6G01K type=del size=2182796 2024-03-09T14:33:23.662 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.663+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~JY8WORTSCC1B.0 size=1048576 2024-03-09T14:33:23.663 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.664+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~JY8WORTSCC1B.1 size=235639 2024-03-09T14:33:23.665 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.666+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=JY8WORTSCC1B tag=Y146DZI71CKE type=write size=2332791 2024-03-09T14:33:23.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.667+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=ZV6A9QSXXQV0 type=del size=948750 2024-03-09T14:33:23.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.668+0000 7f586ae3d780 1 < completed write operation key=FNZ3BNA7W12E tag=7KW1J0XU3673 type=write size=407287 2024-03-09T14:33:23.669 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.669+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=LK63752T5THS type=del size=1843804 2024-03-09T14:33:23.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.671+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~CJ4QU9T7WZEG.0 size=253365 2024-03-09T14:33:23.672 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.673+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=CJ4QU9T7WZEG tag=K1YAF2X138X5 type=write size=1301941 2024-03-09T14:33:23.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.675+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~187OFQDPUULC.0 size=1048576 2024-03-09T14:33:23.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.676+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~187OFQDPUULC.1 size=1048576 2024-03-09T14:33:23.677 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.677+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~187OFQDPUULC.2 size=294990 2024-03-09T14:33:23.677 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.677+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=187OFQDPUULC tag=LOUYFGGYAFY7 type=write size=3440718 2024-03-09T14:33:23.678 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.678+0000 7f586ae3d780 1 < completed write operation key=CZGAXNJ0GKU0 tag=ZQO490Y3NHGP type=write size=453999 2024-03-09T14:33:23.679 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.679+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=TBBS20MLOLCE type=del size=2535402 2024-03-09T14:33:23.680 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.681+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~011JB72R7ILM.0 size=1048576 2024-03-09T14:33:23.681 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.682+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~011JB72R7ILM.1 size=1048576 2024-03-09T14:33:23.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.683+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~011JB72R7ILM.2 size=879767 2024-03-09T14:33:23.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.685+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=011JB72R7ILM tag=QDGUG29VDXFX type=write size=4025495 2024-03-09T14:33:23.686 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.686+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=JDFOQX7HQBGN type=del size=1233972 2024-03-09T14:33:23.687 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.687+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=92X7XNOTFE28 type=del 2024-03-09T14:33:23.689 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.689+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~5GL8J6YPAH0Z.0 size=1048576 2024-03-09T14:33:23.690 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.690+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~5GL8J6YPAH0Z.1 size=1048576 2024-03-09T14:33:23.690 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.691+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~5GL8J6YPAH0Z.2 size=880375 2024-03-09T14:33:23.690 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.691+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=5GL8J6YPAH0Z tag=U4VIBVS4B2DE type=write size=4026103 2024-03-09T14:33:23.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.692+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=EXVULTNQ8PYU type=del 2024-03-09T14:33:23.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.693+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=P1B60V0IAX6E type=del size=1575516 2024-03-09T14:33:23.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.694+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=4GUBXX1QXIOP type=del 2024-03-09T14:33:23.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.696+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=US08JRDU0JKS type=del size=2831481 2024-03-09T14:33:23.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.697+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=6NO47F1AWGHW type=del 2024-03-09T14:33:23.698 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.699+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~41EVEBOAZ7NJ.0 size=1048576 2024-03-09T14:33:23.702 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.700+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~41EVEBOAZ7NJ.1 size=1048576 2024-03-09T14:33:23.702 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.701+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~41EVEBOAZ7NJ.2 size=953431 2024-03-09T14:33:23.702 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.701+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=41EVEBOAZ7NJ tag=LAVI6ACIJ0LI type=write size=4099159 2024-03-09T14:33:23.702 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.703+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~ABZA4RNNUGL5.0 size=1048576 2024-03-09T14:33:23.703 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.704+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~ABZA4RNNUGL5.1 size=1018389 2024-03-09T14:33:23.705 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.705+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=ABZA4RNNUGL5 tag=JREMPRMNKHZS type=write size=3115541 2024-03-09T14:33:23.707 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.707+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~ECAWM1DGZJPL.0 size=1048576 2024-03-09T14:33:23.708 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.708+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~ECAWM1DGZJPL.1 size=1048576 2024-03-09T14:33:23.709 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.709+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~ECAWM1DGZJPL.2 size=1014119 2024-03-09T14:33:23.709 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.709+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=ECAWM1DGZJPL tag=AHA9UVIOVDBF type=write size=4159847 2024-03-09T14:33:23.710 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.710+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=F2AKJO8Y0JVD type=del 2024-03-09T14:33:23.711 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.711+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=F4A96AEATEN7 type=del size=3274266 2024-03-09T14:33:23.712 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.712+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=WABA6MCF7UXB type=del 2024-03-09T14:33:23.714 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.714+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~AJO0R1BW1MAV.0 size=62284 2024-03-09T14:33:23.714 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.714+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=AJO0R1BW1MAV tag=SD8AMRKIZJY5 type=write size=1110860 2024-03-09T14:33:23.715 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.716+0000 7f586ae3d780 1 < completed write operation key=04E9KDGUC274 tag=0F9G52KGF49E type=write size=92937 2024-03-09T14:33:23.717 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.718+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~EKPFMZ8LRQ4Q.0 size=1048576 2024-03-09T14:33:23.718 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.719+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~EKPFMZ8LRQ4Q.1 size=529300 2024-03-09T14:33:23.719 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.719+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=EKPFMZ8LRQ4Q tag=5DTCGPDM2IRQ type=write size=2626452 2024-03-09T14:33:23.720 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.720+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~ZMKY9Z7UIJKH.0 size=1048576 2024-03-09T14:33:23.720 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.720+0000 7f586ae3d780 1 < canceled part key=_multipart_W3HTK2F8ML3V.2~ZMKY9Z7UIJKH.1 size=1048576 2024-03-09T14:33:23.721 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.722+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~ZMKY9Z7UIJKH.2 size=79206 2024-03-09T14:33:23.724 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.724+0000 7f586ae3d780 1 < canceled multipart upload key=W3HTK2F8ML3V upload=ZMKY9Z7UIJKH tag=SXHM8V8QG0P9 type=write size=3224934 2024-03-09T14:33:23.725 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.725+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=G6M9YDYPCQ32 type=write size=350504 2024-03-09T14:33:23.726 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.727+0000 7f586ae3d780 1 < completed write operation key=G2BIOBESOIK9 tag=SLIBTIGJKN5B type=write size=836324 2024-03-09T14:33:23.728 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.728+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=VC8Q53QZXNDP type=del size=468107 2024-03-09T14:33:23.729 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.729+0000 7f586ae3d780 1 < canceled operation key=5PERWGS0GOJU tag=5IB3V6R6G01K type=del size=2182796 2024-03-09T14:33:23.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.730+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=4H2GDIYK2KBP type=del size=320977 2024-03-09T14:33:23.731 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.732+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=ZV6A9QSXXQV0 type=del 2024-03-09T14:33:23.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.733+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=641QIMXYJWIW type=del size=862235 2024-03-09T14:33:23.733 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.734+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=LK63752T5THS type=del 2024-03-09T14:33:23.734 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.735+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=F0VYMDQZKVQU type=del size=1944992 2024-03-09T14:33:23.736 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.736+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~187OFQDPUULC.0 size=1048576 2024-03-09T14:33:23.736 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.737+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~187OFQDPUULC.1 size=1048576 2024-03-09T14:33:23.738 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.738+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~187OFQDPUULC.2 size=294990 2024-03-09T14:33:23.739 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.740+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=187OFQDPUULC tag=LOUYFGGYAFY7 type=write size=3440718 2024-03-09T14:33:23.741 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.741+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=NGAS1FBBRIEY type=del size=3665254 2024-03-09T14:33:23.742 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.742+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=TBBS20MLOLCE type=del 2024-03-09T14:33:23.744 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.744+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~FKFGM16S73ES.0 size=1048576 2024-03-09T14:33:23.744 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.745+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~FKFGM16S73ES.1 size=1048576 2024-03-09T14:33:23.745 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.746+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~FKFGM16S73ES.2 size=1036160 2024-03-09T14:33:23.745 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.746+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=FKFGM16S73ES tag=XCY4DJ9CANCB type=write size=4181888 2024-03-09T14:33:23.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.747+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=JDFOQX7HQBGN type=del 2024-03-09T14:33:23.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.748+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=TW4GZ3RWVEMQ type=del size=491984 2024-03-09T14:33:23.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.749+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~5GL8J6YPAH0Z.0 size=1048576 2024-03-09T14:33:23.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.750+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~5GL8J6YPAH0Z.1 size=1048576 2024-03-09T14:33:23.751 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.751+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~5GL8J6YPAH0Z.2 size=880375 2024-03-09T14:33:23.753 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.753+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=5GL8J6YPAH0Z tag=U4VIBVS4B2DE type=write size=4026103 2024-03-09T14:33:23.754 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.754+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=T1OVG118DSJE type=del size=2548150 2024-03-09T14:33:23.755 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.756+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=P1B60V0IAX6E type=del 2024-03-09T14:33:23.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.757+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=9YOSQOULQC00 type=write size=649841 2024-03-09T14:33:23.757 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.758+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=US08JRDU0JKS type=del 2024-03-09T14:33:23.758 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.759+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=MU7BMYHE40T2 type=del size=1683455 2024-03-09T14:33:23.760 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.760+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~41EVEBOAZ7NJ.0 size=1048576 2024-03-09T14:33:23.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.761+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~41EVEBOAZ7NJ.1 size=1048576 2024-03-09T14:33:23.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.761+0000 7f586ae3d780 1 < canceled part key=_multipart_IK528ND96157.2~41EVEBOAZ7NJ.2 size=953431 2024-03-09T14:33:23.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.763+0000 7f586ae3d780 1 < canceled multipart upload key=IK528ND96157 upload=41EVEBOAZ7NJ tag=LAVI6ACIJ0LI type=write size=4099159 2024-03-09T14:33:23.764 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.764+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=1OS1JFNIWHG5 type=del size=2081240 2024-03-09T14:33:23.764 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.765+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~ECAWM1DGZJPL.0 size=1048576 2024-03-09T14:33:23.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.766+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~ECAWM1DGZJPL.1 size=1048576 2024-03-09T14:33:23.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.766+0000 7f586ae3d780 1 < canceled part key=_multipart_04E9KDGUC274.2~ECAWM1DGZJPL.2 size=1014119 2024-03-09T14:33:23.768 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.768+0000 7f586ae3d780 1 < canceled multipart upload key=04E9KDGUC274 upload=ECAWM1DGZJPL tag=AHA9UVIOVDBF type=write size=4159847 2024-03-09T14:33:23.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.771+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~YPL31IM3J5RA.0 size=1048576 2024-03-09T14:33:23.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.771+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~YPL31IM3J5RA.1 size=490056 2024-03-09T14:33:23.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.771+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=YPL31IM3J5RA tag=8M0HLBAMI86I type=write size=2587208 2024-03-09T14:33:23.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.773+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=F4A96AEATEN7 type=del 2024-03-09T14:33:23.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.774+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=AL0002GFEJ6Z type=del size=409065 2024-03-09T14:33:23.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.775+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~AJO0R1BW1MAV.0 size=62284 2024-03-09T14:33:23.777 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.777+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=AJO0R1BW1MAV tag=SD8AMRKIZJY5 type=write size=1110860 2024-03-09T14:33:23.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.780+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~U6BRA3LU6ZXA.0 size=530539 2024-03-09T14:33:23.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.780+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=U6BRA3LU6ZXA tag=MREG1UFWOG1L type=write size=1579115 2024-03-09T14:33:23.780 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.781+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~EKPFMZ8LRQ4Q.0 size=1048576 2024-03-09T14:33:23.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.782+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~EKPFMZ8LRQ4Q.1 size=529300 2024-03-09T14:33:23.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.784+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=EKPFMZ8LRQ4Q tag=5DTCGPDM2IRQ type=write size=2626452 2024-03-09T14:33:23.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.786+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~ZMMNP579ID62.0 size=1048576 2024-03-09T14:33:23.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.787+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~ZMMNP579ID62.1 size=1048576 2024-03-09T14:33:23.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.788+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~ZMMNP579ID62.2 size=882030 2024-03-09T14:33:23.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.788+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=ZMMNP579ID62 tag=0QJX3N219OMJ type=write size=4027758 2024-03-09T14:33:23.790 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.791+0000 7f586ae3d780 1 < suggested update operation key=CZGAXNJ0GKU0 tag=G6M9YDYPCQ32 type=write size=350504 2024-03-09T14:33:23.792 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.793+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~L3D8IWAZ4S7G.0 size=1048576 2024-03-09T14:33:23.793 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.794+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~L3D8IWAZ4S7G.1 size=887342 2024-03-09T14:33:23.793 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.794+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=L3D8IWAZ4S7G tag=5439O3YFXWHU type=write size=2984494 2024-03-09T14:33:23.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.795+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=VC8Q53QZXNDP type=del 2024-03-09T14:33:23.797 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.797+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~NIDHF8CH91YS.0 size=1048576 2024-03-09T14:33:23.798 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.798+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~NIDHF8CH91YS.1 size=1048576 2024-03-09T14:33:23.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.799+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~NIDHF8CH91YS.2 size=172433 2024-03-09T14:33:23.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.799+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=NIDHF8CH91YS tag=LDPVPGPX0QAD type=write size=3318161 2024-03-09T14:33:23.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.801+0000 7f586ae3d780 1 < suggested remove operation key=W3HTK2F8ML3V tag=4H2GDIYK2KBP type=del 2024-03-09T14:33:23.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.803+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=S8IORS0HAD8J type=del size=2888092 2024-03-09T14:33:23.805 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.805+0000 7f586ae3d780 1 < suggested remove operation key=CAISZZZSOD34 tag=641QIMXYJWIW type=del 2024-03-09T14:33:23.806 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.806+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=R9UX0FICQ7MT type=del size=3851988 2024-03-09T14:33:23.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.809+0000 7f586ae3d780 1 < suggested update operation key=78Y2ZM3W6EUC tag=F0VYMDQZKVQU type=del size=1944992 2024-03-09T14:33:23.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.810+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=G1LXSI37E3VY type=del size=980698 2024-03-09T14:33:23.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.812+0000 7f586ae3d780 1 < canceled operation key=G2BIOBESOIK9 tag=NGAS1FBBRIEY type=del size=3665254 2024-03-09T14:33:23.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.814+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~6E6S88DEABT1.0 size=66606 2024-03-09T14:33:23.814 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.814+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=6E6S88DEABT1 tag=VCQNE64VFU8R type=write size=1115182 2024-03-09T14:33:23.815 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.815+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~FKFGM16S73ES.0 size=1048576 2024-03-09T14:33:23.816 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.816+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~FKFGM16S73ES.1 size=1048576 2024-03-09T14:33:23.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.817+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~FKFGM16S73ES.2 size=1036160 2024-03-09T14:33:23.819 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.819+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=FKFGM16S73ES tag=XCY4DJ9CANCB type=write size=4181888 2024-03-09T14:33:23.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.821+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~URIYTVU31H61.0 size=1048576 2024-03-09T14:33:23.822 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.822+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~URIYTVU31H61.1 size=1048576 2024-03-09T14:33:23.822 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.823+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~URIYTVU31H61.2 size=909615 2024-03-09T14:33:23.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.823+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=URIYTVU31H61 tag=29ZB4Q4N8RNC type=write size=4055343 2024-03-09T14:33:23.824 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.824+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=TW4GZ3RWVEMQ type=del 2024-03-09T14:33:23.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.825+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=3SUQ89R6QH4K type=del size=3282521 2024-03-09T14:33:23.826 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.826+0000 7f586ae3d780 -1 < failed to complete operation key=78Y2ZM3W6EUC tag=T1OVG118DSJE type=del size=2548150: (22) Invalid argument 2024-03-09T14:33:23.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.828+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=LE9WXEDWRD6J type=del size=1625254 2024-03-09T14:33:23.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.829+0000 7f586ae3d780 -1 < failed to complete operation key=78Y2ZM3W6EUC tag=9YOSQOULQC00 type=write size=649841: (22) Invalid argument 2024-03-09T14:33:23.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.830+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=5RTIRCKT2MFP type=del size=1955046 2024-03-09T14:33:23.831 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.831+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=MU7BMYHE40T2 type=del 2024-03-09T14:33:23.833 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.833+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~2QV9Y23F3373.0 size=515201 2024-03-09T14:33:23.833 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.833+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=2QV9Y23F3373 tag=YK9Y3QUDBZ73 type=write size=1563777 2024-03-09T14:33:23.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.834+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=1OS1JFNIWHG5 type=del 2024-03-09T14:33:23.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.836+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=EDV1QV45M2HD type=del size=4110611 2024-03-09T14:33:23.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.837+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~YPL31IM3J5RA.0 size=1048576 2024-03-09T14:33:23.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.838+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~YPL31IM3J5RA.1 size=490056 2024-03-09T14:33:23.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.840+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=YPL31IM3J5RA tag=8M0HLBAMI86I type=write size=2587208 2024-03-09T14:33:23.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.842+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~Q5VA85BO4RRR.0 size=319857 2024-03-09T14:33:23.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.842+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=Q5VA85BO4RRR tag=5PW6E8LSIE3M type=write size=1368433 2024-03-09T14:33:23.842 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.843+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=AL0002GFEJ6Z type=del 2024-03-09T14:33:23.845 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.845+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~WU3EXK01Z2HC.0 size=695902 2024-03-09T14:33:23.845 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.845+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=WU3EXK01Z2HC tag=75RUWTHU968S type=write size=1744478 2024-03-09T14:33:23.846 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.846+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~U6BRA3LU6ZXA.0 size=530539 2024-03-09T14:33:23.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.848+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=U6BRA3LU6ZXA tag=MREG1UFWOG1L type=write size=1579115 2024-03-09T14:33:23.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.849+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=4LUTM4H5OQFJ type=del size=1657307 2024-03-09T14:33:23.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.849+0000 7f586ae3d780 1 < canceled part key=_multipart_DGO3ZT8ST90A.2~ZMMNP579ID62.0 size=1048576 2024-03-09T14:33:23.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.850+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~ZMMNP579ID62.1 size=1048576 2024-03-09T14:33:23.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.851+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~ZMMNP579ID62.2 size=882030 2024-03-09T14:33:23.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.855+0000 7f586ae3d780 1 < canceled multipart upload key=DGO3ZT8ST90A upload=ZMMNP579ID62 tag=0QJX3N219OMJ type=write size=4027758 2024-03-09T14:33:23.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.856+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=JGDF11ZC9QHI type=del size=2615218 2024-03-09T14:33:23.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.858+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~L3D8IWAZ4S7G.0 size=1048576 2024-03-09T14:33:23.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.859+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~L3D8IWAZ4S7G.1 size=887342 2024-03-09T14:33:23.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.861+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=L3D8IWAZ4S7G tag=5439O3YFXWHU type=write size=2984494 2024-03-09T14:33:23.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.862+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=2UXCJ7HW62YE type=del size=933658 2024-03-09T14:33:23.862 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.863+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~NIDHF8CH91YS.0 size=1048576 2024-03-09T14:33:23.863 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.864+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~NIDHF8CH91YS.1 size=1048576 2024-03-09T14:33:23.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.865+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~NIDHF8CH91YS.2 size=172433 2024-03-09T14:33:23.866 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.867+0000 7f586ae3d780 1 < completed multipart upload key=UAYZ55UT77VE upload=NIDHF8CH91YS tag=LDPVPGPX0QAD type=write size=3318161 2024-03-09T14:33:23.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.869+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~NC55PX5DA2XJ.0 size=773201 2024-03-09T14:33:23.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.869+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=NC55PX5DA2XJ tag=WP9SE1F3KZ2Z type=write size=1821777 2024-03-09T14:33:23.869 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.870+0000 7f586ae3d780 -1 < failed to complete operation key=78Y2ZM3W6EUC tag=S8IORS0HAD8J type=del size=2888092: (22) Invalid argument 2024-03-09T14:33:23.871 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.872+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~ARSQ7G5V6W2H.0 size=1048576 2024-03-09T14:33:23.873 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.873+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~ARSQ7G5V6W2H.1 size=600653 2024-03-09T14:33:23.873 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.873+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=ARSQ7G5V6W2H tag=J2YWT5YTX2JK type=write size=2697805 2024-03-09T14:33:23.875 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.876+0000 7f586ae3d780 1 < suggested remove operation key=OXBDXIILR3NS tag=R9UX0FICQ7MT type=del 2024-03-09T14:33:23.876 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.877+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=3NDHR6JT3R02 type=del size=3458394 2024-03-09T14:33:23.877 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.878+0000 7f586ae3d780 1 < canceled operation key=9ZPCSBP3P58P tag=G1LXSI37E3VY type=del size=980698 2024-03-09T14:33:23.879 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.879+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=8Q3DMWZTLXMX type=write size=670157 2024-03-09T14:33:23.880 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.880+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~6E6S88DEABT1.0 size=66606 2024-03-09T14:33:23.882 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.882+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=6E6S88DEABT1 tag=VCQNE64VFU8R type=write size=1115182 2024-03-09T14:33:23.883 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.883+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=GSUHVQDBGCR6 type=del size=3381211 2024-03-09T14:33:23.884 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.885+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~URIYTVU31H61.0 size=1048576 2024-03-09T14:33:23.885 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.885+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~URIYTVU31H61.1 size=1048576 2024-03-09T14:33:23.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.886+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~URIYTVU31H61.2 size=909615 2024-03-09T14:33:23.888 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.888+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=URIYTVU31H61 tag=29ZB4Q4N8RNC type=write size=4055343 2024-03-09T14:33:23.889 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.890+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=62I5MZ1OHV30 type=del size=1315460 2024-03-09T14:33:23.890 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.891+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=3SUQ89R6QH4K type=del 2024-03-09T14:33:23.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.892+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=T3X384E2O4LA type=del size=4047807 2024-03-09T14:33:23.893 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.894+0000 7f586ae3d780 1 < suggested remove operation key=UKPSUQ6LYWN8 tag=LE9WXEDWRD6J type=del 2024-03-09T14:33:23.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.896+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~RVJ1QN2804OU.0 size=1048576 2024-03-09T14:33:23.896 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.897+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~RVJ1QN2804OU.1 size=1048576 2024-03-09T14:33:23.897 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.898+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~RVJ1QN2804OU.2 size=692983 2024-03-09T14:33:23.897 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.898+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=RVJ1QN2804OU tag=L7MSVLF3HK3T type=write size=3838711 2024-03-09T14:33:23.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.899+0000 7f586ae3d780 1 < canceled operation key=0JDF7910RACF tag=5RTIRCKT2MFP type=del size=1955046 2024-03-09T14:33:23.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.900+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=UOZABSFX7LCI type=write size=790222 2024-03-09T14:33:23.901 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.901+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~2QV9Y23F3373.0 size=515201 2024-03-09T14:33:23.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.903+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=2QV9Y23F3373 tag=YK9Y3QUDBZ73 type=write size=1563777 2024-03-09T14:33:23.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.904+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=4I9UDNDY4QKS type=del size=2291275 2024-03-09T14:33:23.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.906+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=EDV1QV45M2HD type=del 2024-03-09T14:33:23.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.907+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=SO2M0CSSSSF2 type=write size=503972 2024-03-09T14:33:23.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.908+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~Q5VA85BO4RRR.0 size=319857 2024-03-09T14:33:23.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.910+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=Q5VA85BO4RRR tag=5PW6E8LSIE3M type=write size=1368433 2024-03-09T14:33:23.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.912+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~5NXPPQDC5DP9.0 size=1048576 2024-03-09T14:33:23.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.913+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~5NXPPQDC5DP9.1 size=1048576 2024-03-09T14:33:23.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.914+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~5NXPPQDC5DP9.2 size=357433 2024-03-09T14:33:23.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.914+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=5NXPPQDC5DP9 tag=2MGV58D5QBIZ type=write size=3503161 2024-03-09T14:33:23.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.915+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~WU3EXK01Z2HC.0 size=695902 2024-03-09T14:33:23.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.917+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=WU3EXK01Z2HC tag=75RUWTHU968S type=write size=1744478 2024-03-09T14:33:23.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.918+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=HZZ4C75OOV3A type=write size=500788 2024-03-09T14:33:23.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.919+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=4LUTM4H5OQFJ type=del 2024-03-09T14:33:23.921 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.921+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=XNMEXV9OXV76 type=del size=2848426 2024-03-09T14:33:23.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.923+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=JGDF11ZC9QHI type=del 2024-03-09T14:33:23.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.925+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~5N4L6BQRVEM7.0 size=1048576 2024-03-09T14:33:23.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.925+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~5N4L6BQRVEM7.1 size=435781 2024-03-09T14:33:23.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.925+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=5N4L6BQRVEM7 tag=QOXWYAS0Z7AV type=write size=2532933 2024-03-09T14:33:23.926 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.927+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=2UXCJ7HW62YE type=del 2024-03-09T14:33:23.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.929+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~CP18UJPKPIF6.0 size=1048576 2024-03-09T14:33:23.929 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.929+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~CP18UJPKPIF6.1 size=1048576 2024-03-09T14:33:23.930 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.930+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~CP18UJPKPIF6.2 size=7004 2024-03-09T14:33:23.930 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.930+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=CP18UJPKPIF6 tag=TZHA0375QECD type=write size=3152732 2024-03-09T14:33:23.931 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.932+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~NC55PX5DA2XJ.0 size=773201 2024-03-09T14:33:23.933 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.933+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=NC55PX5DA2XJ tag=WP9SE1F3KZ2Z type=write size=1821777 2024-03-09T14:33:23.935 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.936+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~XI8BAG18PJUH.0 size=520863 2024-03-09T14:33:23.935 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.936+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=XI8BAG18PJUH tag=DZLY16JORXVE type=write size=1569439 2024-03-09T14:33:23.936 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.937+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~ARSQ7G5V6W2H.0 size=1048576 2024-03-09T14:33:23.937 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.938+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~ARSQ7G5V6W2H.1 size=600653 2024-03-09T14:33:23.939 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.940+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=ARSQ7G5V6W2H tag=J2YWT5YTX2JK type=write size=2697805 2024-03-09T14:33:23.941 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.942+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~1TR0VZ439J4J.0 size=1048576 2024-03-09T14:33:23.942 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.943+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~1TR0VZ439J4J.1 size=702221 2024-03-09T14:33:23.942 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.943+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=1TR0VZ439J4J tag=OX655IFFQ4KM type=write size=2799373 2024-03-09T14:33:23.944 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.944+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=3NDHR6JT3R02 type=del 2024-03-09T14:33:23.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.945+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=DOW1676H5DCF type=del size=3904994 2024-03-09T14:33:23.948 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.948+0000 7f586ae3d780 1 < suggested update operation key=FNZ3BNA7W12E tag=8Q3DMWZTLXMX type=write size=670157 2024-03-09T14:33:23.949 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.949+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=CNWJ5LP8X6O0 type=del size=2086779 2024-03-09T14:33:23.950 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.950+0000 7f586ae3d780 -1 < failed to complete operation key=FNZ3BNA7W12E tag=GSUHVQDBGCR6 type=del size=3381211: (22) Invalid argument 2024-03-09T14:33:23.951 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.952+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=XZKHSMM6ZN6G type=del size=2199638 2024-03-09T14:33:23.952 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.953+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=62I5MZ1OHV30 type=del 2024-03-09T14:33:23.953 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.954+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=1SPG6SQUITFZ type=del size=1185256 2024-03-09T14:33:23.956 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.956+0000 7f586ae3d780 1 < suggested update operation key=O5L6RC16RS8E tag=T3X384E2O4LA type=del size=4047807 2024-03-09T14:33:23.958 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.958+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~H29RC3WI03Y1.0 size=1048576 2024-03-09T14:33:23.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.959+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~H29RC3WI03Y1.1 size=666232 2024-03-09T14:33:23.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.959+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=H29RC3WI03Y1 tag=BL85BXIBC649 type=write size=2763384 2024-03-09T14:33:23.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.960+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~RVJ1QN2804OU.0 size=1048576 2024-03-09T14:33:23.961 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.961+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~RVJ1QN2804OU.1 size=1048576 2024-03-09T14:33:23.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.962+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~RVJ1QN2804OU.2 size=692983 2024-03-09T14:33:23.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.964+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=RVJ1QN2804OU tag=L7MSVLF3HK3T type=write size=3838711 2024-03-09T14:33:23.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.966+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=Q8HP4KG6TJX1 type=del size=2551312 2024-03-09T14:33:23.967 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.967+0000 7f586ae3d780 1 < completed write operation key=DGO3ZT8ST90A tag=UOZABSFX7LCI type=write size=790222 2024-03-09T14:33:23.968 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.968+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=2H4GAEMUZU2O type=del size=3059151 2024-03-09T14:33:23.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.970+0000 7f586ae3d780 -1 < failed to complete operation key=FNZ3BNA7W12E tag=4I9UDNDY4QKS type=del size=2291275: (22) Invalid argument 2024-03-09T14:33:23.970 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.971+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=UD3291ZHSV0C type=write size=686047 2024-03-09T14:33:23.972 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.972+0000 7f586ae3d780 1 < completed write operation key=CAISZZZSOD34 tag=SO2M0CSSSSF2 type=write size=503972 2024-03-09T14:33:23.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.974+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~KU0ZRSGZQPH8.0 size=1048576 2024-03-09T14:33:23.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.975+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~KU0ZRSGZQPH8.1 size=1048576 2024-03-09T14:33:23.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.976+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~KU0ZRSGZQPH8.2 size=119398 2024-03-09T14:33:23.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.976+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=KU0ZRSGZQPH8 tag=PCVB1STYHZPK type=write size=3265126 2024-03-09T14:33:23.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.978+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~5NXPPQDC5DP9.0 size=1048576 2024-03-09T14:33:23.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.978+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~5NXPPQDC5DP9.1 size=1048576 2024-03-09T14:33:23.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.980+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~5NXPPQDC5DP9.2 size=357433 2024-03-09T14:33:23.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.982+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=5NXPPQDC5DP9 tag=2MGV58D5QBIZ type=write size=3503161 2024-03-09T14:33:23.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.983+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=XSX0H25L0MEK type=del size=16278 2024-03-09T14:33:23.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.984+0000 7f586ae3d780 1 < canceled operation key=W3HTK2F8ML3V tag=HZZ4C75OOV3A type=write size=500788 2024-03-09T14:33:23.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.986+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~4ICN4VESHVK9.0 size=1048576 2024-03-09T14:33:23.986 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.987+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~4ICN4VESHVK9.1 size=904165 2024-03-09T14:33:23.986 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.987+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=4ICN4VESHVK9 tag=2ZPZ2X5Z5KMS type=write size=3001317 2024-03-09T14:33:23.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.988+0000 7f586ae3d780 1 < canceled operation key=W4Q1MWHOQ4Y1 tag=XNMEXV9OXV76 type=del size=2848426 2024-03-09T14:33:23.989 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.989+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=7Q875UY64Z9I type=del size=3293227 2024-03-09T14:33:23.990 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.990+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~5N4L6BQRVEM7.0 size=1048576 2024-03-09T14:33:23.990 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.990+0000 7f586ae3d780 1 < canceled part key=_multipart_OXBDXIILR3NS.2~5N4L6BQRVEM7.1 size=435781 2024-03-09T14:33:23.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.993+0000 7f586ae3d780 1 < canceled multipart upload key=OXBDXIILR3NS upload=5N4L6BQRVEM7 tag=QOXWYAS0Z7AV type=write size=2532933 2024-03-09T14:33:23.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.995+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~MOKN4NTB81YT.0 size=1048576 2024-03-09T14:33:23.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.996+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~MOKN4NTB81YT.1 size=1048576 2024-03-09T14:33:23.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.997+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~MOKN4NTB81YT.2 size=605024 2024-03-09T14:33:23.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.997+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=MOKN4NTB81YT tag=AAI26LFTKRAY type=write size=3750752 2024-03-09T14:33:23.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.998+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~CP18UJPKPIF6.0 size=1048576 2024-03-09T14:33:23.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:23.999+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~CP18UJPKPIF6.1 size=1048576 2024-03-09T14:33:23.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.000+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~CP18UJPKPIF6.2 size=7004 2024-03-09T14:33:24.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.002+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=CP18UJPKPIF6 tag=TZHA0375QECD type=write size=3152732 2024-03-09T14:33:24.002 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.003+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=HA4V185YF9CN type=del size=653613 2024-03-09T14:33:24.004 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.004+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~XI8BAG18PJUH.0 size=520863 2024-03-09T14:33:24.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.006+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=XI8BAG18PJUH tag=DZLY16JORXVE type=write size=1569439 2024-03-09T14:33:24.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.008+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~BVAIK095MJA3.0 size=1048576 2024-03-09T14:33:24.009 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.009+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~BVAIK095MJA3.1 size=253494 2024-03-09T14:33:24.009 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.009+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=BVAIK095MJA3 tag=47ARD64IQNHD type=write size=2350646 2024-03-09T14:33:24.010 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.010+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~1TR0VZ439J4J.0 size=1048576 2024-03-09T14:33:24.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.012+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~1TR0VZ439J4J.1 size=702221 2024-03-09T14:33:24.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.013+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=1TR0VZ439J4J tag=OX655IFFQ4KM type=write size=2799373 2024-03-09T14:33:24.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.015+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=1T94Z1VIJWNF type=del size=1113741 2024-03-09T14:33:24.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.018+0000 7f586ae3d780 1 < suggested update operation key=6YWLPUULN5SY tag=DOW1676H5DCF type=del size=3904994 2024-03-09T14:33:24.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.020+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~2CWSIZT9PDYM.0 size=826419 2024-03-09T14:33:24.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.020+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=2CWSIZT9PDYM tag=PEVMRJY8QTDD type=write size=1874995 2024-03-09T14:33:24.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.021+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=CNWJ5LP8X6O0 type=del 2024-03-09T14:33:24.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.022+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=BKO3D5YH3KJ7 type=del size=1236658 2024-03-09T14:33:24.023 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.024+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=XZKHSMM6ZN6G type=del 2024-03-09T14:33:24.024 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.025+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=IX69UWRA82HA type=write size=856178 2024-03-09T14:33:24.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.026+0000 7f586ae3d780 1 < canceled operation key=DJH53FNVMLGY tag=1SPG6SQUITFZ type=del size=1185256 2024-03-09T14:33:24.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.027+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=E42URPLFD7NO type=del size=612651 2024-03-09T14:33:24.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.029+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~H29RC3WI03Y1.0 size=1048576 2024-03-09T14:33:24.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.030+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~H29RC3WI03Y1.1 size=666232 2024-03-09T14:33:24.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.033+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=H29RC3WI03Y1 tag=BL85BXIBC649 type=write size=2763384 2024-03-09T14:33:24.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.035+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=F8CEU4F2UZO0 type=del size=3271819 2024-03-09T14:33:24.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.037+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=Q8HP4KG6TJX1 type=del 2024-03-09T14:33:24.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.039+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~X4OEA94SYRK2.0 size=1048576 2024-03-09T14:33:24.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.040+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~X4OEA94SYRK2.1 size=386070 2024-03-09T14:33:24.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.040+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=X4OEA94SYRK2 tag=F1M4GNQ60KV8 type=write size=2483222 2024-03-09T14:33:24.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.041+0000 7f586ae3d780 1 < canceled operation key=BHSYRD3IEJWW tag=2H4GAEMUZU2O type=del size=3059151 2024-03-09T14:33:24.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.043+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~3JA8LQ2OD13D.0 size=1048576 2024-03-09T14:33:24.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.044+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~3JA8LQ2OD13D.1 size=1048576 2024-03-09T14:33:24.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.045+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~3JA8LQ2OD13D.2 size=460526 2024-03-09T14:33:24.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.045+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=3JA8LQ2OD13D tag=44ATOH5D3H00 type=write size=3606254 2024-03-09T14:33:24.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.046+0000 7f586ae3d780 1 < completed write operation key=O5L6RC16RS8E tag=UD3291ZHSV0C type=write size=686047 2024-03-09T14:33:24.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.048+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~WJUQVIGCFSPF.0 size=1048576 2024-03-09T14:33:24.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.049+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~WJUQVIGCFSPF.1 size=1048576 2024-03-09T14:33:24.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.050+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~WJUQVIGCFSPF.2 size=689054 2024-03-09T14:33:24.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.050+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=WJUQVIGCFSPF tag=29T29D9B4NHT type=write size=3834782 2024-03-09T14:33:24.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.051+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~KU0ZRSGZQPH8.0 size=1048576 2024-03-09T14:33:24.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.052+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~KU0ZRSGZQPH8.1 size=1048576 2024-03-09T14:33:24.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.053+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~KU0ZRSGZQPH8.2 size=119398 2024-03-09T14:33:24.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.054+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=KU0ZRSGZQPH8 tag=PCVB1STYHZPK type=write size=3265126 2024-03-09T14:33:24.055 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.056+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=8VSEQF10S0V4 type=write size=614195 2024-03-09T14:33:24.056 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.057+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=XSX0H25L0MEK type=del 2024-03-09T14:33:24.058 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.058+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=OE6SQEN41LAW type=write size=91783 2024-03-09T14:33:24.058 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.058+0000 7f586ae3d780 1 < canceled part key=_multipart_UKPSUQ6LYWN8.2~4ICN4VESHVK9.0 size=1048576 2024-03-09T14:33:24.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.059+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~4ICN4VESHVK9.1 size=904165 2024-03-09T14:33:24.061 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.061+0000 7f586ae3d780 1 < canceled multipart upload key=UKPSUQ6LYWN8 upload=4ICN4VESHVK9 tag=2ZPZ2X5Z5KMS type=write size=3001317 2024-03-09T14:33:24.062 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.063+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~IH90R0KKMX5N.0 size=1048576 2024-03-09T14:33:24.063 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.064+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~IH90R0KKMX5N.1 size=128249 2024-03-09T14:33:24.063 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.064+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=IH90R0KKMX5N tag=T83DFD0MJHC5 type=write size=2225401 2024-03-09T14:33:24.064 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.065+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=7Q875UY64Z9I type=del 2024-03-09T14:33:24.066 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.066+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=CBYOHW0V7C8W type=del size=2198364 2024-03-09T14:33:24.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.068+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~MOKN4NTB81YT.0 size=1048576 2024-03-09T14:33:24.068 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.068+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~MOKN4NTB81YT.1 size=1048576 2024-03-09T14:33:24.069 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.069+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~MOKN4NTB81YT.2 size=605024 2024-03-09T14:33:24.071 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.071+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=MOKN4NTB81YT tag=AAI26LFTKRAY type=write size=3750752 2024-03-09T14:33:24.072 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.073+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=SI0MP5HTU3WV type=del size=2857035 2024-03-09T14:33:24.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.074+0000 7f586ae3d780 1 < canceled operation key=BHSYRD3IEJWW tag=HA4V185YF9CN type=del size=653613 2024-03-09T14:33:24.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.075+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=M3LU91KOT1FB type=del size=1135569 2024-03-09T14:33:24.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.076+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~BVAIK095MJA3.0 size=1048576 2024-03-09T14:33:24.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.078+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~BVAIK095MJA3.1 size=253494 2024-03-09T14:33:24.079 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.079+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=BVAIK095MJA3 tag=47ARD64IQNHD type=write size=2350646 2024-03-09T14:33:24.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.082+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~D2TX3AO4QBLG.0 size=395385 2024-03-09T14:33:24.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.082+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=D2TX3AO4QBLG tag=ZVCHRX2O3O5Q type=write size=1443961 2024-03-09T14:33:24.082 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.083+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=1T94Z1VIJWNF type=del 2024-03-09T14:33:24.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.085+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~DA1YAG6TT6O1.0 size=1048576 2024-03-09T14:33:24.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.086+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~DA1YAG6TT6O1.1 size=1048576 2024-03-09T14:33:24.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.087+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~DA1YAG6TT6O1.2 size=174123 2024-03-09T14:33:24.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.087+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=DA1YAG6TT6O1 tag=R73J177PBSI7 type=write size=3319851 2024-03-09T14:33:24.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.088+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~2CWSIZT9PDYM.0 size=826419 2024-03-09T14:33:24.090 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.090+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=2CWSIZT9PDYM tag=PEVMRJY8QTDD type=write size=1874995 2024-03-09T14:33:24.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.092+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~H6KKS2OM7YT2.0 size=1048576 2024-03-09T14:33:24.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.093+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~H6KKS2OM7YT2.1 size=1048576 2024-03-09T14:33:24.094 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.094+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~H6KKS2OM7YT2.2 size=557814 2024-03-09T14:33:24.094 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.094+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=H6KKS2OM7YT2 tag=8DH0IOME6JA6 type=write size=3703542 2024-03-09T14:33:24.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.096+0000 7f586ae3d780 1 < completed delete operation key=NHIOOLNXLZZC tag=BKO3D5YH3KJ7 type=del 2024-03-09T14:33:24.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.097+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=QKIVLAFS2B5X type=del size=3034500 2024-03-09T14:33:24.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.098+0000 7f586ae3d780 1 < completed write operation key=78Y2ZM3W6EUC tag=IX69UWRA82HA type=write size=856178 2024-03-09T14:33:24.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.100+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~A8T2OEKO3Q6Z.0 size=1048576 2024-03-09T14:33:24.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.101+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~A8T2OEKO3Q6Z.1 size=630654 2024-03-09T14:33:24.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.101+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=A8T2OEKO3Q6Z tag=AXNL0ZU8WS41 type=write size=2727806 2024-03-09T14:33:24.103 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.103+0000 7f586ae3d780 1 < suggested remove operation key=P3OUIQNAK1TC tag=E42URPLFD7NO type=del 2024-03-09T14:33:24.104 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.104+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=POMQHX71PXHF type=del size=2311967 2024-03-09T14:33:24.106 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.107+0000 7f586ae3d780 1 < suggested update operation key=9ZPCSBP3P58P tag=F8CEU4F2UZO0 type=del size=3271819 2024-03-09T14:33:24.108 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.109+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~2OKD0Y1QIQ73.0 size=1048576 2024-03-09T14:33:24.109 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.110+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~2OKD0Y1QIQ73.1 size=1048576 2024-03-09T14:33:24.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.111+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~2OKD0Y1QIQ73.2 size=570916 2024-03-09T14:33:24.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.111+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=2OKD0Y1QIQ73 tag=QKD49GPDQC0A type=write size=3716644 2024-03-09T14:33:24.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.112+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~X4OEA94SYRK2.0 size=1048576 2024-03-09T14:33:24.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.113+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~X4OEA94SYRK2.1 size=386070 2024-03-09T14:33:24.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.115+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=X4OEA94SYRK2 tag=F1M4GNQ60KV8 type=write size=2483222 2024-03-09T14:33:24.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.116+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=NVH62M3CFE00 type=write size=385437 2024-03-09T14:33:24.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.118+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~3JA8LQ2OD13D.0 size=1048576 2024-03-09T14:33:24.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.119+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~3JA8LQ2OD13D.1 size=1048576 2024-03-09T14:33:24.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.120+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~3JA8LQ2OD13D.2 size=460526 2024-03-09T14:33:24.121 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.121+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=3JA8LQ2OD13D tag=44ATOH5D3H00 type=write size=3606254 2024-03-09T14:33:24.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.124+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~3H8BO9LE03M8.0 size=74661 2024-03-09T14:33:24.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.124+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=3H8BO9LE03M8 tag=7SCAJWYPTNYK type=write size=1123237 2024-03-09T14:33:24.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.125+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~WJUQVIGCFSPF.0 size=1048576 2024-03-09T14:33:24.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.126+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~WJUQVIGCFSPF.1 size=1048576 2024-03-09T14:33:24.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.127+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~WJUQVIGCFSPF.2 size=689054 2024-03-09T14:33:24.128 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.129+0000 7f586ae3d780 1 < completed multipart upload key=LRI2GKBGVCWW upload=WJUQVIGCFSPF tag=29T29D9B4NHT type=write size=3834782 2024-03-09T14:33:24.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.131+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~Z6HQ8NTX1GNZ.0 size=1048576 2024-03-09T14:33:24.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.132+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~Z6HQ8NTX1GNZ.1 size=265387 2024-03-09T14:33:24.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.132+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=Z6HQ8NTX1GNZ tag=XM57DSHLBRNS type=write size=2362539 2024-03-09T14:33:24.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.133+0000 7f586ae3d780 -1 < failed to complete operation key=9ZPCSBP3P58P tag=8VSEQF10S0V4 type=write size=614195: (22) Invalid argument 2024-03-09T14:33:24.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.135+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~EX6XTQ2J8HID.0 size=1048576 2024-03-09T14:33:24.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.136+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~EX6XTQ2J8HID.1 size=277308 2024-03-09T14:33:24.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.136+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=EX6XTQ2J8HID tag=19L83UZK1WBS type=write size=2374460 2024-03-09T14:33:24.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.138+0000 7f586ae3d780 1 < suggested update operation key=G2BIOBESOIK9 tag=OE6SQEN41LAW type=write size=91783 2024-03-09T14:33:24.139 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.140+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=S68RK275L2WZ type=del size=1202465 2024-03-09T14:33:24.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.142+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~IH90R0KKMX5N.0 size=1048576 2024-03-09T14:33:24.143 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.143+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~IH90R0KKMX5N.1 size=128249 2024-03-09T14:33:24.145 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.145+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=IH90R0KKMX5N tag=T83DFD0MJHC5 type=write size=2225401 2024-03-09T14:33:24.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.147+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~2SEVXPWGWXPM.0 size=720502 2024-03-09T14:33:24.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.147+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=2SEVXPWGWXPM tag=Q9P7VFHTD1CB type=write size=1769078 2024-03-09T14:33:24.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.149+0000 7f586ae3d780 1 < canceled operation key=CZGAXNJ0GKU0 tag=CBYOHW0V7C8W type=del size=2198364 2024-03-09T14:33:24.150 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.151+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~ASXNG12E5END.0 size=1048576 2024-03-09T14:33:24.151 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.151+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~ASXNG12E5END.1 size=990212 2024-03-09T14:33:24.151 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.151+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=ASXNG12E5END tag=CVD8L775CJ2X type=write size=3087364 2024-03-09T14:33:24.153 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.154+0000 7f586ae3d780 1 < suggested remove operation key=CZGAXNJ0GKU0 tag=SI0MP5HTU3WV type=del 2024-03-09T14:33:24.154 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.155+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=BZZSVXRK9XPU type=write size=579933 2024-03-09T14:33:24.155 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.156+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=M3LU91KOT1FB type=del 2024-03-09T14:33:24.157 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.157+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=89A9LIPLFWKT type=del size=1169544 2024-03-09T14:33:24.158 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.158+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~D2TX3AO4QBLG.0 size=395385 2024-03-09T14:33:24.160 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.160+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=D2TX3AO4QBLG tag=ZVCHRX2O3O5Q type=write size=1443961 2024-03-09T14:33:24.161 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.161+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=8BG44PT5W5RA type=del size=174794 2024-03-09T14:33:24.161 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.162+0000 7f586ae3d780 1 < canceled part key=_multipart_G2BIOBESOIK9.2~DA1YAG6TT6O1.0 size=1048576 2024-03-09T14:33:24.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.163+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~DA1YAG6TT6O1.1 size=1048576 2024-03-09T14:33:24.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.164+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~DA1YAG6TT6O1.2 size=174123 2024-03-09T14:33:24.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.165+0000 7f586ae3d780 1 < canceled multipart upload key=G2BIOBESOIK9 upload=DA1YAG6TT6O1 tag=R73J177PBSI7 type=write size=3319851 2024-03-09T14:33:24.166 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.167+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=VJQDI1F1MW7Y type=write size=80048 2024-03-09T14:33:24.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.168+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~H6KKS2OM7YT2.0 size=1048576 2024-03-09T14:33:24.168 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.169+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~H6KKS2OM7YT2.1 size=1048576 2024-03-09T14:33:24.169 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.170+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~H6KKS2OM7YT2.2 size=557814 2024-03-09T14:33:24.171 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.172+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=H6KKS2OM7YT2 tag=8DH0IOME6JA6 type=write size=3703542 2024-03-09T14:33:24.172 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.173+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=C0ILFCO2T3R4 type=write size=110387 2024-03-09T14:33:24.173 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.174+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=QKIVLAFS2B5X type=del 2024-03-09T14:33:24.176 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.176+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~554KERXVY6CD.0 size=1048576 2024-03-09T14:33:24.176 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.177+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~554KERXVY6CD.1 size=241548 2024-03-09T14:33:24.176 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.177+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=554KERXVY6CD tag=Y3D23V3IC0EN type=write size=2338700 2024-03-09T14:33:24.178 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.178+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~A8T2OEKO3Q6Z.0 size=1048576 2024-03-09T14:33:24.179 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.179+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~A8T2OEKO3Q6Z.1 size=630654 2024-03-09T14:33:24.180 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.181+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=A8T2OEKO3Q6Z tag=AXNL0ZU8WS41 type=write size=2727806 2024-03-09T14:33:24.181 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.182+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=ZFWOOUZ1ZL5T type=del size=1205762 2024-03-09T14:33:24.184 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.185+0000 7f586ae3d780 1 < suggested update operation key=OU9IOY7J572N tag=POMQHX71PXHF type=del size=2311967 2024-03-09T14:33:24.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.187+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~D0NWZ8XKWHQB.0 size=268836 2024-03-09T14:33:24.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.187+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=D0NWZ8XKWHQB tag=13AT5OGSRW26 type=write size=1317412 2024-03-09T14:33:24.187 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.188+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~2OKD0Y1QIQ73.0 size=1048576 2024-03-09T14:33:24.188 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.189+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~2OKD0Y1QIQ73.1 size=1048576 2024-03-09T14:33:24.189 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.189+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~2OKD0Y1QIQ73.2 size=570916 2024-03-09T14:33:24.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.191+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=2OKD0Y1QIQ73 tag=QKD49GPDQC0A type=write size=3716644 2024-03-09T14:33:24.193 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.193+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~ZYDJQN4I191Z.0 size=1048576 2024-03-09T14:33:24.194 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.194+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~ZYDJQN4I191Z.1 size=1048576 2024-03-09T14:33:24.195 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.195+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~ZYDJQN4I191Z.2 size=313804 2024-03-09T14:33:24.195 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.195+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=ZYDJQN4I191Z tag=02G053P2XOSH type=write size=3459532 2024-03-09T14:33:24.196 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.196+0000 7f586ae3d780 1 < completed write operation key=FNZ3BNA7W12E tag=NVH62M3CFE00 type=write size=385437 2024-03-09T14:33:24.197 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.197+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=S1S7JZYX13R1 type=del size=4113225 2024-03-09T14:33:24.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.198+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~3H8BO9LE03M8.0 size=74661 2024-03-09T14:33:24.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.200+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=3H8BO9LE03M8 tag=7SCAJWYPTNYK type=write size=1123237 2024-03-09T14:33:24.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.202+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~VCKDUK63AUE1.0 size=1048576 2024-03-09T14:33:24.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.203+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~VCKDUK63AUE1.1 size=361864 2024-03-09T14:33:24.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.203+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=VCKDUK63AUE1 tag=YGH04P612UIC type=write size=2459016 2024-03-09T14:33:24.204 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.204+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~Z6HQ8NTX1GNZ.0 size=1048576 2024-03-09T14:33:24.204 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.205+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~Z6HQ8NTX1GNZ.1 size=265387 2024-03-09T14:33:24.207 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.207+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=Z6HQ8NTX1GNZ tag=XM57DSHLBRNS type=write size=2362539 2024-03-09T14:33:24.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.208+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=DRIU6UD5N2HT type=del size=2879888 2024-03-09T14:33:24.209 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.210+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~EX6XTQ2J8HID.0 size=1048576 2024-03-09T14:33:24.210 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.210+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~EX6XTQ2J8HID.1 size=277308 2024-03-09T14:33:24.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.212+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=EX6XTQ2J8HID tag=19L83UZK1WBS type=write size=2374460 2024-03-09T14:33:24.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.214+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=OCBAOQUMT56L type=del size=3773983 2024-03-09T14:33:24.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.216+0000 7f586ae3d780 1 < suggested update operation key=UO072H74SHLP tag=S68RK275L2WZ type=del size=1202465 2024-03-09T14:33:24.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.217+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=007LUZXU9S47 type=del size=2824791 2024-03-09T14:33:24.218 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.218+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~2SEVXPWGWXPM.0 size=720502 2024-03-09T14:33:24.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.220+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=2SEVXPWGWXPM tag=Q9P7VFHTD1CB type=write size=1769078 2024-03-09T14:33:24.222 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.222+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~L1KWVC8G3E1K.0 size=1048576 2024-03-09T14:33:24.223 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.223+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~L1KWVC8G3E1K.1 size=1048576 2024-03-09T14:33:24.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.224+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~L1KWVC8G3E1K.2 size=249412 2024-03-09T14:33:24.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.224+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=L1KWVC8G3E1K tag=7L9L63ZVNZBS type=write size=3395140 2024-03-09T14:33:24.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.224+0000 7f586ae3d780 1 < canceled part key=_multipart_DJH53FNVMLGY.2~ASXNG12E5END.0 size=1048576 2024-03-09T14:33:24.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.225+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~ASXNG12E5END.1 size=990212 2024-03-09T14:33:24.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.227+0000 7f586ae3d780 1 < canceled multipart upload key=DJH53FNVMLGY upload=ASXNG12E5END tag=CVD8L775CJ2X type=write size=3087364 2024-03-09T14:33:24.228 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.228+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=YNHNDXXG48NW type=del size=963236 2024-03-09T14:33:24.230 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.230+0000 7f586ae3d780 1 < suggested remove operation key=DGO3ZT8ST90A tag=BZZSVXRK9XPU type=write 2024-03-09T14:33:24.231 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.232+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=39JWIGZB6F1N type=del size=3297288 2024-03-09T14:33:24.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.233+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=89A9LIPLFWKT type=del 2024-03-09T14:33:24.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.234+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=2OHDXJX4PA2V type=del size=2797956 2024-03-09T14:33:24.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.235+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=8BG44PT5W5RA type=del 2024-03-09T14:33:24.236 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.236+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=GB5TJY2J42ZY type=del size=3984169 2024-03-09T14:33:24.237 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.237+0000 7f586ae3d780 1 < completed write operation key=5PERWGS0GOJU tag=VJQDI1F1MW7Y type=write size=80048 2024-03-09T14:33:24.239 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.240+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~Q646QKENUFLY.0 size=380161 2024-03-09T14:33:24.239 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.240+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=Q646QKENUFLY tag=NK52279AQNYJ type=write size=1428737 2024-03-09T14:33:24.240 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.241+0000 7f586ae3d780 1 < completed write operation key=57OR9DHRPDCZ tag=C0ILFCO2T3R4 type=write size=110387 2024-03-09T14:33:24.242 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.243+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~L4MH0SL4MCB4.0 size=1048576 2024-03-09T14:33:24.243 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.244+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~L4MH0SL4MCB4.1 size=1048576 2024-03-09T14:33:24.244 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.245+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~L4MH0SL4MCB4.2 size=800197 2024-03-09T14:33:24.244 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.245+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=L4MH0SL4MCB4 tag=P28OAYNMQJAR type=write size=3945925 2024-03-09T14:33:24.245 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.246+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~554KERXVY6CD.0 size=1048576 2024-03-09T14:33:24.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.248+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~554KERXVY6CD.1 size=241548 2024-03-09T14:33:24.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.250+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=554KERXVY6CD tag=Y3D23V3IC0EN type=write size=2338700 2024-03-09T14:33:24.251 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.252+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~CB5UXHL1LQBE.0 size=1048576 2024-03-09T14:33:24.252 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.253+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~CB5UXHL1LQBE.1 size=1048576 2024-03-09T14:33:24.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.254+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~CB5UXHL1LQBE.2 size=52394 2024-03-09T14:33:24.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.254+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=CB5UXHL1LQBE tag=MK97HF8WNST1 type=write size=3198122 2024-03-09T14:33:24.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.256+0000 7f586ae3d780 1 < suggested update operation key=0JDF7910RACF tag=ZFWOOUZ1ZL5T type=del size=1205762 2024-03-09T14:33:24.257 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.258+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~PM86OYAV8LOW.0 size=1048576 2024-03-09T14:33:24.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.259+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~PM86OYAV8LOW.1 size=497426 2024-03-09T14:33:24.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.259+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=PM86OYAV8LOW tag=EYSEEI51LSK0 type=write size=2594578 2024-03-09T14:33:24.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.260+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~D0NWZ8XKWHQB.0 size=268836 2024-03-09T14:33:24.261 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.262+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=D0NWZ8XKWHQB tag=13AT5OGSRW26 type=write size=1317412 2024-03-09T14:33:24.262 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.263+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=OQY92ZPH2PQG type=del size=3249136 2024-03-09T14:33:24.264 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.264+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~ZYDJQN4I191Z.0 size=1048576 2024-03-09T14:33:24.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.265+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~ZYDJQN4I191Z.1 size=1048576 2024-03-09T14:33:24.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.266+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~ZYDJQN4I191Z.2 size=313804 2024-03-09T14:33:24.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.268+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=ZYDJQN4I191Z tag=02G053P2XOSH type=write size=3459532 2024-03-09T14:33:24.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.270+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~MAEV5G98QA86.0 size=622304 2024-03-09T14:33:24.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.270+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=MAEV5G98QA86 tag=I5ZH7C0SFI53 type=write size=1670880 2024-03-09T14:33:24.271 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.271+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=S1S7JZYX13R1 type=del 2024-03-09T14:33:24.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.272+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=0RRCJGUPIZ05 type=del size=1630470 2024-03-09T14:33:24.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.274+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~VCKDUK63AUE1.0 size=1048576 2024-03-09T14:33:24.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.274+0000 7f586ae3d780 1 < canceled part key=_multipart_DGO3ZT8ST90A.2~VCKDUK63AUE1.1 size=361864 2024-03-09T14:33:24.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.276+0000 7f586ae3d780 1 < canceled multipart upload key=DGO3ZT8ST90A upload=VCKDUK63AUE1 tag=YGH04P612UIC type=write size=2459016 2024-03-09T14:33:24.276 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.277+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=3O2NFEG6SVB6 type=del size=960959 2024-03-09T14:33:24.278 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.279+0000 7f586ae3d780 1 < suggested update operation key=WNVN3EOUUBGR tag=DRIU6UD5N2HT type=del size=2879888 2024-03-09T14:33:24.280 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.281+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~3BG3U6K30Q82.0 size=1048576 2024-03-09T14:33:24.281 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.282+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~3BG3U6K30Q82.1 size=815634 2024-03-09T14:33:24.281 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.282+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=3BG3U6K30Q82 tag=6PEUVWEO3U3K type=write size=2912786 2024-03-09T14:33:24.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.283+0000 7f586ae3d780 1 < canceled operation key=5PERWGS0GOJU tag=OCBAOQUMT56L type=del size=3773983 2024-03-09T14:33:24.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.284+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=I5KM9IRIH31X type=del size=2363993 2024-03-09T14:33:24.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.286+0000 7f586ae3d780 1 < suggested remove operation key=OU9IOY7J572N tag=007LUZXU9S47 type=del 2024-03-09T14:33:24.287 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.288+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=BEPQNFMO16RK type=write size=263384 2024-03-09T14:33:24.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.289+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~L1KWVC8G3E1K.0 size=1048576 2024-03-09T14:33:24.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.290+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~L1KWVC8G3E1K.1 size=1048576 2024-03-09T14:33:24.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.290+0000 7f586ae3d780 1 < canceled part key=_multipart_509F17DT0C4I.2~L1KWVC8G3E1K.2 size=249412 2024-03-09T14:33:24.291 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.292+0000 7f586ae3d780 1 < canceled multipart upload key=509F17DT0C4I upload=L1KWVC8G3E1K tag=7L9L63ZVNZBS type=write size=3395140 2024-03-09T14:33:24.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.293+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=6V35GW5Q6V8Z type=del size=800267 2024-03-09T14:33:24.294 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.294+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=YNHNDXXG48NW type=del 2024-03-09T14:33:24.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.296+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~L8BJZM9197HT.0 size=1048576 2024-03-09T14:33:24.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.297+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~L8BJZM9197HT.1 size=65386 2024-03-09T14:33:24.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.297+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=L8BJZM9197HT tag=OEG2BEDBSEMF type=write size=2162538 2024-03-09T14:33:24.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.299+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=39JWIGZB6F1N type=del 2024-03-09T14:33:24.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.300+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=P2I4EIMS9BU3 type=del size=3025047 2024-03-09T14:33:24.301 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.301+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=2OHDXJX4PA2V type=del 2024-03-09T14:33:24.303 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.304+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~IGKWBKSTD8MF.0 size=1048576 2024-03-09T14:33:24.304 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.305+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~IGKWBKSTD8MF.1 size=487690 2024-03-09T14:33:24.304 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.305+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=IGKWBKSTD8MF tag=AGGNDTTZ670D type=write size=2584842 2024-03-09T14:33:24.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.306+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=GB5TJY2J42ZY type=del 2024-03-09T14:33:24.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.308+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=PS70W90YCQAK type=write size=181375 2024-03-09T14:33:24.308 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.309+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~Q646QKENUFLY.0 size=380161 2024-03-09T14:33:24.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.311+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=Q646QKENUFLY tag=NK52279AQNYJ type=write size=1428737 2024-03-09T14:33:24.312 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.313+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~ZDS19TSGCUJS.0 size=1048576 2024-03-09T14:33:24.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.314+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~ZDS19TSGCUJS.1 size=1048576 2024-03-09T14:33:24.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.315+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~ZDS19TSGCUJS.2 size=25306 2024-03-09T14:33:24.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.315+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=ZDS19TSGCUJS tag=60JOREM3DBH6 type=write size=3171034 2024-03-09T14:33:24.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.316+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~L4MH0SL4MCB4.0 size=1048576 2024-03-09T14:33:24.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.317+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~L4MH0SL4MCB4.1 size=1048576 2024-03-09T14:33:24.317 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.318+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~L4MH0SL4MCB4.2 size=800197 2024-03-09T14:33:24.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.320+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=L4MH0SL4MCB4 tag=P28OAYNMQJAR type=write size=3945925 2024-03-09T14:33:24.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.322+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~NG0BX824MJMH.0 size=1048576 2024-03-09T14:33:24.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.323+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~NG0BX824MJMH.1 size=619006 2024-03-09T14:33:24.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.323+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=NG0BX824MJMH tag=DIB5513NW71S type=write size=2716158 2024-03-09T14:33:24.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.324+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~CB5UXHL1LQBE.0 size=1048576 2024-03-09T14:33:24.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.324+0000 7f586ae3d780 1 < canceled part key=_multipart_W4Q1MWHOQ4Y1.2~CB5UXHL1LQBE.1 size=1048576 2024-03-09T14:33:24.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.325+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~CB5UXHL1LQBE.2 size=52394 2024-03-09T14:33:24.327 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.327+0000 7f586ae3d780 1 < canceled multipart upload key=W4Q1MWHOQ4Y1 upload=CB5UXHL1LQBE tag=MK97HF8WNST1 type=write size=3198122 2024-03-09T14:33:24.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.328+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=QS586LGOAOOG type=del size=1061988 2024-03-09T14:33:24.329 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.330+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~PM86OYAV8LOW.0 size=1048576 2024-03-09T14:33:24.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.331+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~PM86OYAV8LOW.1 size=497426 2024-03-09T14:33:24.332 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.333+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=PM86OYAV8LOW tag=EYSEEI51LSK0 type=write size=2594578 2024-03-09T14:33:24.333 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.334+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=OD96YFHC74BE type=write size=626030 2024-03-09T14:33:24.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.335+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=OQY92ZPH2PQG type=del 2024-03-09T14:33:24.337 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.337+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~7T37RT2UNM64.0 size=826082 2024-03-09T14:33:24.337 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.337+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=7T37RT2UNM64 tag=POAUBQFZM2C3 type=write size=1874658 2024-03-09T14:33:24.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.338+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~MAEV5G98QA86.0 size=622304 2024-03-09T14:33:24.341 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.342+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=MAEV5G98QA86 tag=I5ZH7C0SFI53 type=write size=1670880 2024-03-09T14:33:24.344 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.344+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~K3BBZUD5GMH1.0 size=1048576 2024-03-09T14:33:24.345 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.345+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~K3BBZUD5GMH1.1 size=354111 2024-03-09T14:33:24.345 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.345+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=K3BBZUD5GMH1 tag=KHY96CQY5L9H type=write size=2451263 2024-03-09T14:33:24.347 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.347+0000 7f586ae3d780 1 < suggested remove operation key=C1UGQOQ6AE1E tag=0RRCJGUPIZ05 type=del 2024-03-09T14:33:24.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.349+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~G3MOFC7IPDJ3.0 size=710974 2024-03-09T14:33:24.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.349+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=G3MOFC7IPDJ3 tag=9NX0IES0ESWE type=write size=1759550 2024-03-09T14:33:24.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.351+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=3O2NFEG6SVB6 type=del 2024-03-09T14:33:24.351 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.352+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=52TLFN438IGE type=write size=453001 2024-03-09T14:33:24.353 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.353+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~3BG3U6K30Q82.0 size=1048576 2024-03-09T14:33:24.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.354+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~3BG3U6K30Q82.1 size=815634 2024-03-09T14:33:24.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.356+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=3BG3U6K30Q82 tag=6PEUVWEO3U3K type=write size=2912786 2024-03-09T14:33:24.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.359+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~DK8XO31D7RAD.0 size=564834 2024-03-09T14:33:24.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.359+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=DK8XO31D7RAD tag=GPF9IGR12209 type=write size=1613410 2024-03-09T14:33:24.360 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.361+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=I5KM9IRIH31X type=del 2024-03-09T14:33:24.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.362+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=KREU2CQAMJDG type=del size=2815939 2024-03-09T14:33:24.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.363+0000 7f586ae3d780 1 < completed write operation key=OXBDXIILR3NS tag=BEPQNFMO16RK type=write size=263384 2024-03-09T14:33:24.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.364+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=DDSX70QBRF4O type=write size=302789 2024-03-09T14:33:24.365 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.365+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=6V35GW5Q6V8Z type=del 2024-03-09T14:33:24.366 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.366+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=8VDNOX32BORK type=del size=602285 2024-03-09T14:33:24.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.368+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~L8BJZM9197HT.0 size=1048576 2024-03-09T14:33:24.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.368+0000 7f586ae3d780 1 < canceled part key=_multipart_UAYZ55UT77VE.2~L8BJZM9197HT.1 size=65386 2024-03-09T14:33:24.369 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.370+0000 7f586ae3d780 1 < canceled multipart upload key=UAYZ55UT77VE upload=L8BJZM9197HT tag=OEG2BEDBSEMF type=write size=2162538 2024-03-09T14:33:24.370 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.371+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=O3L8LGQPLSNK type=del size=4125638 2024-03-09T14:33:24.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.372+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=P2I4EIMS9BU3 type=del 2024-03-09T14:33:24.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.374+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~1STKOENDBCYZ.0 size=1048576 2024-03-09T14:33:24.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.375+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~1STKOENDBCYZ.1 size=1048576 2024-03-09T14:33:24.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.376+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~1STKOENDBCYZ.2 size=374742 2024-03-09T14:33:24.376 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.376+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=1STKOENDBCYZ tag=MLFSS0XPNNUZ type=write size=3520470 2024-03-09T14:33:24.377 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.377+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~IGKWBKSTD8MF.0 size=1048576 2024-03-09T14:33:24.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.378+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~IGKWBKSTD8MF.1 size=487690 2024-03-09T14:33:24.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.380+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=IGKWBKSTD8MF tag=AGGNDTTZ670D type=write size=2584842 2024-03-09T14:33:24.382 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.383+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~1KKPQG803A91.0 size=731135 2024-03-09T14:33:24.382 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.383+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=1KKPQG803A91 tag=1T3TDW6BE5NJ type=write size=1779711 2024-03-09T14:33:24.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.384+0000 7f586ae3d780 1 < completed write operation key=BHSYRD3IEJWW tag=PS70W90YCQAK type=write size=181375 2024-03-09T14:33:24.385 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.385+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=2V9OSVYKBCF9 type=del size=228557 2024-03-09T14:33:24.385 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.385+0000 7f586ae3d780 1 < canceled part key=_multipart_W4Q1MWHOQ4Y1.2~ZDS19TSGCUJS.0 size=1048576 2024-03-09T14:33:24.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.386+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~ZDS19TSGCUJS.1 size=1048576 2024-03-09T14:33:24.387 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.387+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~ZDS19TSGCUJS.2 size=25306 2024-03-09T14:33:24.390 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.389+0000 7f586ae3d780 1 < canceled multipart upload key=W4Q1MWHOQ4Y1 upload=ZDS19TSGCUJS tag=60JOREM3DBH6 type=write size=3171034 2024-03-09T14:33:24.391 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.390+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=44EVIEXSD0MB type=write size=747100 2024-03-09T14:33:24.391 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.392+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~NG0BX824MJMH.0 size=1048576 2024-03-09T14:33:24.392 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.393+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~NG0BX824MJMH.1 size=619006 2024-03-09T14:33:24.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.395+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=NG0BX824MJMH tag=DIB5513NW71S type=write size=2716158 2024-03-09T14:33:24.396 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.397+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~RIEFB8XE1Q1C.0 size=1048576 2024-03-09T14:33:24.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.398+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~RIEFB8XE1Q1C.1 size=440146 2024-03-09T14:33:24.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.398+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=RIEFB8XE1Q1C tag=L6EYBAAHZF0F type=write size=2537298 2024-03-09T14:33:24.399 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.399+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=QS586LGOAOOG type=del 2024-03-09T14:33:24.400 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.400+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=3M8J4KZA7E3E type=del size=2517371 2024-03-09T14:33:24.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.402+0000 7f586ae3d780 1 < completed write operation key=57OR9DHRPDCZ tag=OD96YFHC74BE type=write size=626030 2024-03-09T14:33:24.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.404+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~C8DAISO2F5K6.0 size=1048576 2024-03-09T14:33:24.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.405+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~C8DAISO2F5K6.1 size=459502 2024-03-09T14:33:24.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.405+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=C8DAISO2F5K6 tag=2LEJA6FV9QZR type=write size=2556654 2024-03-09T14:33:24.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.406+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~7T37RT2UNM64.0 size=826082 2024-03-09T14:33:24.408 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.408+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=7T37RT2UNM64 tag=POAUBQFZM2C3 type=write size=1874658 2024-03-09T14:33:24.409 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.409+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=B2XGC8N3SOJK type=del size=166417 2024-03-09T14:33:24.410 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.411+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~K3BBZUD5GMH1.0 size=1048576 2024-03-09T14:33:24.411 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.412+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~K3BBZUD5GMH1.1 size=354111 2024-03-09T14:33:24.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.414+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=K3BBZUD5GMH1 tag=KHY96CQY5L9H type=write size=2451263 2024-03-09T14:33:24.414 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.415+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=8X38N5Y3QCFX type=del size=2510571 2024-03-09T14:33:24.415 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.416+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~G3MOFC7IPDJ3.0 size=710974 2024-03-09T14:33:24.417 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.418+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=G3MOFC7IPDJ3 tag=9NX0IES0ESWE type=write size=1759550 2024-03-09T14:33:24.418 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.419+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=XSPAF09VC2QJ type=del size=3925750 2024-03-09T14:33:24.420 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.421+0000 7f586ae3d780 1 < suggested update operation key=6YWLPUULN5SY tag=52TLFN438IGE type=write size=453001 2024-03-09T14:33:24.422 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.423+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=J34VAA8QTBU6 type=del size=1957830 2024-03-09T14:33:24.423 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.424+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~DK8XO31D7RAD.0 size=564834 2024-03-09T14:33:24.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.426+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=DK8XO31D7RAD tag=GPF9IGR12209 type=write size=1613410 2024-03-09T14:33:24.426 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.427+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=JZVON76P2MDI type=del size=3023490 2024-03-09T14:33:24.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.428+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=KREU2CQAMJDG type=del 2024-03-09T14:33:24.429 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.429+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=D0XAN7NQK2TH type=del size=2707569 2024-03-09T14:33:24.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.430+0000 7f586ae3d780 1 < completed write operation key=57OR9DHRPDCZ tag=DDSX70QBRF4O type=write size=302789 2024-03-09T14:33:24.431 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.432+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=796LA1GZ33GE type=del size=192984 2024-03-09T14:33:24.432 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.433+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=8VDNOX32BORK type=del 2024-03-09T14:33:24.434 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.434+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=SO2049C157Z7 type=del size=1762360 2024-03-09T14:33:24.436 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.436+0000 7f586ae3d780 1 < suggested update operation key=04E9KDGUC274 tag=O3L8LGQPLSNK type=del size=4125638 2024-03-09T14:33:24.437 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.438+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=9I3UVXLT7R7X type=write size=151730 2024-03-09T14:33:24.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.439+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~1STKOENDBCYZ.0 size=1048576 2024-03-09T14:33:24.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.440+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~1STKOENDBCYZ.1 size=1048576 2024-03-09T14:33:24.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.441+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~1STKOENDBCYZ.2 size=374742 2024-03-09T14:33:24.442 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.443+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=1STKOENDBCYZ tag=MLFSS0XPNNUZ type=write size=3520470 2024-03-09T14:33:24.444 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.445+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~7T3JZC1AYBS2.0 size=1048576 2024-03-09T14:33:24.445 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.446+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~7T3JZC1AYBS2.1 size=988119 2024-03-09T14:33:24.445 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.446+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=7T3JZC1AYBS2 tag=3WYI5XPRWZ4J type=write size=3085271 2024-03-09T14:33:24.446 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.447+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~1KKPQG803A91.0 size=731135 2024-03-09T14:33:24.449 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.449+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=1KKPQG803A91 tag=1T3TDW6BE5NJ type=write size=1779711 2024-03-09T14:33:24.450 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.450+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=TY3H5N88FPHL type=del size=1742388 2024-03-09T14:33:24.452 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.453+0000 7f586ae3d780 1 < suggested remove operation key=UKPSUQ6LYWN8 tag=2V9OSVYKBCF9 type=del 2024-03-09T14:33:24.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.454+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=K1TEH0JD9521 type=del size=2849236 2024-03-09T14:33:24.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.455+0000 7f586ae3d780 1 < completed write operation key=P3OUIQNAK1TC tag=44EVIEXSD0MB type=write size=747100 2024-03-09T14:33:24.457 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.458+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~9M0BOIYZVMJ0.0 size=1048576 2024-03-09T14:33:24.458 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.459+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~9M0BOIYZVMJ0.1 size=612166 2024-03-09T14:33:24.458 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.459+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=9M0BOIYZVMJ0 tag=QWPF10EVQ58T type=write size=2709318 2024-03-09T14:33:24.459 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.460+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~RIEFB8XE1Q1C.0 size=1048576 2024-03-09T14:33:24.460 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.461+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~RIEFB8XE1Q1C.1 size=440146 2024-03-09T14:33:24.462 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.463+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=RIEFB8XE1Q1C tag=L6EYBAAHZF0F type=write size=2537298 2024-03-09T14:33:24.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.465+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~54U1P625PHB6.0 size=1048576 2024-03-09T14:33:24.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.466+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~54U1P625PHB6.1 size=1048576 2024-03-09T14:33:24.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.467+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~54U1P625PHB6.2 size=396665 2024-03-09T14:33:24.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.467+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=54U1P625PHB6 tag=WH57O9PKPVQN type=write size=3542393 2024-03-09T14:33:24.468 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.468+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=3M8J4KZA7E3E type=del 2024-03-09T14:33:24.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.471+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~XUWFRLKZU8J0.0 size=1048576 2024-03-09T14:33:24.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.472+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~XUWFRLKZU8J0.1 size=741698 2024-03-09T14:33:24.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.472+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=XUWFRLKZU8J0 tag=NBOZJ092TMHP type=write size=2838850 2024-03-09T14:33:24.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.473+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~C8DAISO2F5K6.0 size=1048576 2024-03-09T14:33:24.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.474+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~C8DAISO2F5K6.1 size=459502 2024-03-09T14:33:24.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.476+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=C8DAISO2F5K6 tag=2LEJA6FV9QZR type=write size=2556654 2024-03-09T14:33:24.477 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.478+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=KQ8PP8JY97J3 type=del size=3395698 2024-03-09T14:33:24.478 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.479+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=B2XGC8N3SOJK type=del 2024-03-09T14:33:24.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.481+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~YN4B3H0VUUSZ.0 size=1048576 2024-03-09T14:33:24.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.482+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~YN4B3H0VUUSZ.1 size=1048576 2024-03-09T14:33:24.482 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.483+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~YN4B3H0VUUSZ.2 size=333708 2024-03-09T14:33:24.482 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.483+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=YN4B3H0VUUSZ tag=PC4Y156CK2BN type=write size=3479436 2024-03-09T14:33:24.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.485+0000 7f586ae3d780 1 < suggested remove operation key=W3HTK2F8ML3V tag=8X38N5Y3QCFX type=del 2024-03-09T14:33:24.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.486+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=TOFYARHYHU95 type=del size=2794489 2024-03-09T14:33:24.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.487+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=XSPAF09VC2QJ type=del 2024-03-09T14:33:24.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.489+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=OKS2GE9NF9GY type=write size=878029 2024-03-09T14:33:24.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.490+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=J34VAA8QTBU6 type=del 2024-03-09T14:33:24.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.492+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~R39WT9TGI2CZ.0 size=308949 2024-03-09T14:33:24.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.492+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=R39WT9TGI2CZ tag=53IO169Y30E4 type=write size=1357525 2024-03-09T14:33:24.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.494+0000 7f586ae3d780 1 < suggested update operation key=CZGAXNJ0GKU0 tag=JZVON76P2MDI type=del size=3023490 2024-03-09T14:33:24.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.495+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=U9WV9QFJT55K type=del size=4084229 2024-03-09T14:33:24.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.496+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=D0XAN7NQK2TH type=del 2024-03-09T14:33:24.498 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.499+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~O5NJNP3L12S6.0 size=1048576 2024-03-09T14:33:24.499 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.500+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~O5NJNP3L12S6.1 size=687653 2024-03-09T14:33:24.499 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.500+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=O5NJNP3L12S6 tag=L3Y3A37OXR9G type=write size=2784805 2024-03-09T14:33:24.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.502+0000 7f586ae3d780 1 < suggested update operation key=OU9IOY7J572N tag=796LA1GZ33GE type=del size=192984 2024-03-09T14:33:24.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.503+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=2G9EC18F5G94 type=del size=2971073 2024-03-09T14:33:24.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.505+0000 7f586ae3d780 1 < suggested update operation key=LRI2GKBGVCWW tag=SO2049C157Z7 type=del size=1762360 2024-03-09T14:33:24.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.507+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=5N5X977X9SDK type=del size=1753542 2024-03-09T14:33:24.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.508+0000 7f586ae3d780 1 < completed write operation key=WNVN3EOUUBGR tag=9I3UVXLT7R7X type=write size=151730 2024-03-09T14:33:24.508 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.509+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=2L8BD24QYD17 type=del size=2148513 2024-03-09T14:33:24.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.510+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~7T3JZC1AYBS2.0 size=1048576 2024-03-09T14:33:24.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.511+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~7T3JZC1AYBS2.1 size=988119 2024-03-09T14:33:24.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.513+0000 7f586ae3d780 1 < completed multipart upload key=LRI2GKBGVCWW upload=7T3JZC1AYBS2 tag=3WYI5XPRWZ4J type=write size=3085271 2024-03-09T14:33:24.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.515+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~K2V7UZ0PR7UX.0 size=719449 2024-03-09T14:33:24.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.515+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=K2V7UZ0PR7UX tag=FZOE0AR4Z69Z type=write size=1768025 2024-03-09T14:33:24.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.516+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=TY3H5N88FPHL type=del 2024-03-09T14:33:24.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.517+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=DL8G1SGAMETD type=write size=414617 2024-03-09T14:33:24.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.520+0000 7f586ae3d780 1 < suggested update operation key=NHIOOLNXLZZC tag=K1TEH0JD9521 type=del size=2849236 2024-03-09T14:33:24.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.521+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=OEARSRN9WK30 type=del size=142254 2024-03-09T14:33:24.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.522+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~9M0BOIYZVMJ0.0 size=1048576 2024-03-09T14:33:24.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.523+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~9M0BOIYZVMJ0.1 size=612166 2024-03-09T14:33:24.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.525+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=9M0BOIYZVMJ0 tag=QWPF10EVQ58T type=write size=2709318 2024-03-09T14:33:24.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.527+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~9ZUZA49UQI86.0 size=1048576 2024-03-09T14:33:24.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.528+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~9ZUZA49UQI86.1 size=1048576 2024-03-09T14:33:24.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.529+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~9ZUZA49UQI86.2 size=521440 2024-03-09T14:33:24.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.529+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=9ZUZA49UQI86 tag=ARE5K3H198JV type=write size=3667168 2024-03-09T14:33:24.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.529+0000 7f586ae3d780 1 < canceled part key=_multipart_NHIOOLNXLZZC.2~54U1P625PHB6.0 size=1048576 2024-03-09T14:33:24.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.530+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~54U1P625PHB6.1 size=1048576 2024-03-09T14:33:24.530 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.531+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~54U1P625PHB6.2 size=396665 2024-03-09T14:33:24.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.533+0000 7f586ae3d780 1 < canceled multipart upload key=NHIOOLNXLZZC upload=54U1P625PHB6 tag=WH57O9PKPVQN type=write size=3542393 2024-03-09T14:33:24.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.535+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~OJFNFE5Z5A2V.0 size=542990 2024-03-09T14:33:24.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.535+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=OJFNFE5Z5A2V tag=SH1JYBQ776WL type=write size=1591566 2024-03-09T14:33:24.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.536+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~XUWFRLKZU8J0.0 size=1048576 2024-03-09T14:33:24.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.537+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~XUWFRLKZU8J0.1 size=741698 2024-03-09T14:33:24.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.539+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=XUWFRLKZU8J0 tag=NBOZJ092TMHP type=write size=2838850 2024-03-09T14:33:24.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.540+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=RNE5B0JMGZTF type=del size=1266456 2024-03-09T14:33:24.541 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.541+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=KQ8PP8JY97J3 type=del 2024-03-09T14:33:24.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.542+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=ISJQ7TT4KU70 type=del size=865601 2024-03-09T14:33:24.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.543+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~YN4B3H0VUUSZ.0 size=1048576 2024-03-09T14:33:24.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.544+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~YN4B3H0VUUSZ.1 size=1048576 2024-03-09T14:33:24.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.545+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~YN4B3H0VUUSZ.2 size=333708 2024-03-09T14:33:24.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.547+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=YN4B3H0VUUSZ tag=PC4Y156CK2BN type=write size=3479436 2024-03-09T14:33:24.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.549+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=DX4YUI3YMKF6 type=del size=1884580 2024-03-09T14:33:24.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.550+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=TOFYARHYHU95 type=del 2024-03-09T14:33:24.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.552+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~409ID27BP5GQ.0 size=1048576 2024-03-09T14:33:24.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.553+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~409ID27BP5GQ.1 size=1048576 2024-03-09T14:33:24.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.554+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~409ID27BP5GQ.2 size=234874 2024-03-09T14:33:24.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.554+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=409ID27BP5GQ tag=GLL05ZQNL1C1 type=write size=3380602 2024-03-09T14:33:24.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.555+0000 7f586ae3d780 -1 < failed to complete operation key=NHIOOLNXLZZC tag=OKS2GE9NF9GY type=write size=878029: (22) Invalid argument 2024-03-09T14:33:24.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.556+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=RLKLP9N9D2N2 type=del size=18786 2024-03-09T14:33:24.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.557+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~R39WT9TGI2CZ.0 size=308949 2024-03-09T14:33:24.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.559+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=R39WT9TGI2CZ tag=53IO169Y30E4 type=write size=1357525 2024-03-09T14:33:24.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.561+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=PDLGV4J97A31 type=write size=888297 2024-03-09T14:33:24.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.562+0000 7f586ae3d780 -1 < failed to complete operation key=OU9IOY7J572N tag=U9WV9QFJT55K type=del size=4084229: (22) Invalid argument 2024-03-09T14:33:24.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.563+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=5P77YW2N5STC type=write size=322056 2024-03-09T14:33:24.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.564+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~O5NJNP3L12S6.0 size=1048576 2024-03-09T14:33:24.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.565+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~O5NJNP3L12S6.1 size=687653 2024-03-09T14:33:24.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.567+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=O5NJNP3L12S6 tag=L3Y3A37OXR9G type=write size=2784805 2024-03-09T14:33:24.568 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.568+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=7V7B0342ITKU type=del size=2718759 2024-03-09T14:33:24.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.569+0000 7f586ae3d780 1 < canceled operation key=UKPSUQ6LYWN8 tag=2G9EC18F5G94 type=del size=2971073 2024-03-09T14:33:24.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.572+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~F57J9CQCPQGH.0 size=138940 2024-03-09T14:33:24.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.572+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=F57J9CQCPQGH tag=POGU8T43GLLA type=write size=1187516 2024-03-09T14:33:24.573 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.574+0000 7f586ae3d780 1 < suggested update operation key=BHSYRD3IEJWW tag=5N5X977X9SDK type=del size=1753542 2024-03-09T14:33:24.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.575+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=UXN2DZ3QOKYQ type=del size=481662 2024-03-09T14:33:24.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.577+0000 7f586ae3d780 1 < suggested remove operation key=OXBDXIILR3NS tag=2L8BD24QYD17 type=del 2024-03-09T14:33:24.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.581+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~497BMHRT3AHL.0 size=1048576 2024-03-09T14:33:24.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.581+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~497BMHRT3AHL.1 size=1048576 2024-03-09T14:33:24.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.582+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~497BMHRT3AHL.2 size=351010 2024-03-09T14:33:24.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.582+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=497BMHRT3AHL tag=KTWCZ9CU0XJD type=write size=3496738 2024-03-09T14:33:24.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.584+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~K2V7UZ0PR7UX.0 size=719449 2024-03-09T14:33:24.585 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.585+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=K2V7UZ0PR7UX tag=FZOE0AR4Z69Z type=write size=1768025 2024-03-09T14:33:24.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.588+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~GHVT7V5U8IFA.0 size=1048576 2024-03-09T14:33:24.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.588+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~GHVT7V5U8IFA.1 size=534544 2024-03-09T14:33:24.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.588+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=GHVT7V5U8IFA tag=S3WV3JCTDY6W type=write size=2631696 2024-03-09T14:33:24.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.590+0000 7f586ae3d780 1 < completed write operation key=04E9KDGUC274 tag=DL8G1SGAMETD type=write size=414617 2024-03-09T14:33:24.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.591+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=46QBZNNUBKAJ type=del size=92794 2024-03-09T14:33:24.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.593+0000 7f586ae3d780 1 < suggested update operation key=CZGAXNJ0GKU0 tag=OEARSRN9WK30 type=del size=142254 2024-03-09T14:33:24.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.594+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=X4O7W67YAVCX type=del size=1700853 2024-03-09T14:33:24.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.595+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~9ZUZA49UQI86.0 size=1048576 2024-03-09T14:33:24.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.596+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~9ZUZA49UQI86.1 size=1048576 2024-03-09T14:33:24.597 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.597+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~9ZUZA49UQI86.2 size=521440 2024-03-09T14:33:24.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.599+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=9ZUZA49UQI86 tag=ARE5K3H198JV type=write size=3667168 2024-03-09T14:33:24.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.600+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=5PHU5UQ0UJ5N type=del size=4140168 2024-03-09T14:33:24.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.602+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~OJFNFE5Z5A2V.0 size=542990 2024-03-09T14:33:24.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.604+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=OJFNFE5Z5A2V tag=SH1JYBQ776WL type=write size=1591566 2024-03-09T14:33:24.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.605+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=02TH1O5LEQXP type=del size=628149 2024-03-09T14:33:24.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.607+0000 7f586ae3d780 1 < suggested update operation key=NHIOOLNXLZZC tag=RNE5B0JMGZTF type=del size=1266456 2024-03-09T14:33:24.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.609+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~F79BL9BES77Q.0 size=301552 2024-03-09T14:33:24.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.609+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=F79BL9BES77Q tag=CEV1RLPLS1H3 type=write size=1350128 2024-03-09T14:33:24.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.610+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=ISJQ7TT4KU70 type=del 2024-03-09T14:33:24.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.613+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~1ZIX9MZI8LMM.0 size=278807 2024-03-09T14:33:24.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.613+0000 7f586ae3d780 1 > prepared multipart upload key=C1UGQOQ6AE1E upload=1ZIX9MZI8LMM tag=LYXU48Q9RG2T type=write size=1327383 2024-03-09T14:33:24.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.614+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=DX4YUI3YMKF6 type=del 2024-03-09T14:33:24.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.615+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=TGFCN27LTD7H type=del size=1387289 2024-03-09T14:33:24.616 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.616+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~409ID27BP5GQ.0 size=1048576 2024-03-09T14:33:24.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.617+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~409ID27BP5GQ.1 size=1048576 2024-03-09T14:33:24.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.618+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~409ID27BP5GQ.2 size=234874 2024-03-09T14:33:24.619 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.620+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=409ID27BP5GQ tag=GLL05ZQNL1C1 type=write size=3380602 2024-03-09T14:33:24.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.621+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=8VDLSZBSRCHV type=del size=2630325 2024-03-09T14:33:24.622 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.622+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=RLKLP9N9D2N2 type=del 2024-03-09T14:33:24.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.624+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~X0A5VEUH1LT8.0 size=483827 2024-03-09T14:33:24.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.624+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=X0A5VEUH1LT8 tag=09VROE3IYQ5O type=write size=1532403 2024-03-09T14:33:24.625 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.625+0000 7f586ae3d780 1 < completed write operation key=XIYWPXSYCT6I tag=PDLGV4J97A31 type=write size=888297 2024-03-09T14:33:24.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.626+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=50XD0W8CQAV7 type=del size=1367941 2024-03-09T14:33:24.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.628+0000 7f586ae3d780 1 < completed write operation key=5PERWGS0GOJU tag=5P77YW2N5STC type=write size=322056 2024-03-09T14:33:24.628 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.629+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=D0G1AH6Q7U3M type=del size=3659460 2024-03-09T14:33:24.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.632+0000 7f586ae3d780 1 < suggested update operation key=W4Q1MWHOQ4Y1 tag=7V7B0342ITKU type=del size=2718759 2024-03-09T14:33:24.633 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.633+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=GF7YNLQO9FQG type=del size=2564928 2024-03-09T14:33:24.634 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.634+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~F57J9CQCPQGH.0 size=138940 2024-03-09T14:33:24.636 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.636+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=F57J9CQCPQGH tag=POGU8T43GLLA type=write size=1187516 2024-03-09T14:33:24.637 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.638+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=7TQOHAXALI84 type=del size=2907561 2024-03-09T14:33:24.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.640+0000 7f586ae3d780 1 < suggested update operation key=G2BIOBESOIK9 tag=UXN2DZ3QOKYQ type=del size=481662 2024-03-09T14:33:24.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.642+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=8B4SAF726H1U type=write size=74827 2024-03-09T14:33:24.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.643+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~497BMHRT3AHL.0 size=1048576 2024-03-09T14:33:24.643 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.644+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~497BMHRT3AHL.1 size=1048576 2024-03-09T14:33:24.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.645+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~497BMHRT3AHL.2 size=351010 2024-03-09T14:33:24.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.647+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=497BMHRT3AHL tag=KTWCZ9CU0XJD type=write size=3496738 2024-03-09T14:33:24.649 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.649+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~NN99NCB65MNR.0 size=1048576 2024-03-09T14:33:24.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.650+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~NN99NCB65MNR.1 size=478013 2024-03-09T14:33:24.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.650+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=NN99NCB65MNR tag=NL5JPVATQ26L type=write size=2575165 2024-03-09T14:33:24.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.652+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~GHVT7V5U8IFA.0 size=1048576 2024-03-09T14:33:24.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.653+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~GHVT7V5U8IFA.1 size=534544 2024-03-09T14:33:24.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.655+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=GHVT7V5U8IFA tag=S3WV3JCTDY6W type=write size=2631696 2024-03-09T14:33:24.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.657+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~M22RP3JM6K4Q.0 size=1048576 2024-03-09T14:33:24.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.658+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~M22RP3JM6K4Q.1 size=144018 2024-03-09T14:33:24.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.658+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=M22RP3JM6K4Q tag=O5L0KS9088MB type=write size=2241170 2024-03-09T14:33:24.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.660+0000 7f586ae3d780 1 < canceled operation key=IK528ND96157 tag=46QBZNNUBKAJ type=del size=92794 2024-03-09T14:33:24.661 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.661+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=L2GNP5XR3CLY type=del size=539392 2024-03-09T14:33:24.663 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.663+0000 7f586ae3d780 1 < suggested update operation key=9ZPCSBP3P58P tag=X4O7W67YAVCX type=del size=1700853 2024-03-09T14:33:24.665 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.665+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~G2GCX7629DOV.0 size=1048576 2024-03-09T14:33:24.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.666+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~G2GCX7629DOV.1 size=1048576 2024-03-09T14:33:24.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.667+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~G2GCX7629DOV.2 size=655052 2024-03-09T14:33:24.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.667+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=G2GCX7629DOV tag=D37U8OI8OWWA type=write size=3800780 2024-03-09T14:33:24.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.668+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=5PHU5UQ0UJ5N type=del 2024-03-09T14:33:24.669 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.669+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=KS4L77ZA8J1H type=del size=2705925 2024-03-09T14:33:24.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.671+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=02TH1O5LEQXP type=del 2024-03-09T14:33:24.671 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.672+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=0G1ZZW3S9K0K type=del size=3582245 2024-03-09T14:33:24.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.673+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~F79BL9BES77Q.0 size=301552 2024-03-09T14:33:24.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.675+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=F79BL9BES77Q tag=CEV1RLPLS1H3 type=write size=1350128 2024-03-09T14:33:24.677 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.677+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~3OHNK1LIFDF0.0 size=695125 2024-03-09T14:33:24.677 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.677+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=3OHNK1LIFDF0 tag=S9A3HAZFQG5G type=write size=1743701 2024-03-09T14:33:24.678 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.678+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~1ZIX9MZI8LMM.0 size=278807 2024-03-09T14:33:24.680 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.680+0000 7f586ae3d780 1 < completed multipart upload key=C1UGQOQ6AE1E upload=1ZIX9MZI8LMM tag=LYXU48Q9RG2T type=write size=1327383 2024-03-09T14:33:24.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.682+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~14P030JU1QC1.0 size=306315 2024-03-09T14:33:24.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.682+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=14P030JU1QC1 tag=C02WYA9ORW5P type=write size=1354891 2024-03-09T14:33:24.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.684+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=TGFCN27LTD7H type=del 2024-03-09T14:33:24.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.685+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=6IDCF4B4VCWT type=del size=3312876 2024-03-09T14:33:24.685 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.686+0000 7f586ae3d780 1 < canceled operation key=UO072H74SHLP tag=8VDLSZBSRCHV type=del size=2630325 2024-03-09T14:33:24.688 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.688+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~3ZTJXFYSDP04.0 size=1048576 2024-03-09T14:33:24.688 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.689+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~3ZTJXFYSDP04.1 size=1048576 2024-03-09T14:33:24.690 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.691+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~3ZTJXFYSDP04.2 size=822326 2024-03-09T14:33:24.691 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.691+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=3ZTJXFYSDP04 tag=FIATIHGSQZ5R type=write size=3968054 2024-03-09T14:33:24.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.692+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~X0A5VEUH1LT8.0 size=483827 2024-03-09T14:33:24.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.694+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=X0A5VEUH1LT8 tag=09VROE3IYQ5O type=write size=1532403 2024-03-09T14:33:24.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.696+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~T73H419E767L.0 size=1048576 2024-03-09T14:33:24.697 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.697+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~T73H419E767L.1 size=1048576 2024-03-09T14:33:24.698 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.698+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~T73H419E767L.2 size=336677 2024-03-09T14:33:24.698 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.698+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=T73H419E767L tag=ON06BYS1N8BW type=write size=3482405 2024-03-09T14:33:24.699 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.699+0000 7f586ae3d780 1 < canceled operation key=NHIOOLNXLZZC tag=50XD0W8CQAV7 type=del size=1367941 2024-03-09T14:33:24.700 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.700+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=SXTTJSEA8CSM type=del size=1798222 2024-03-09T14:33:24.701 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.702+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=D0G1AH6Q7U3M type=del 2024-03-09T14:33:24.702 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.703+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=X4O4STG3LONI type=del size=1221127 2024-03-09T14:33:24.704 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.704+0000 7f586ae3d780 -1 < failed to complete operation key=G2BIOBESOIK9 tag=GF7YNLQO9FQG type=del size=2564928: (22) Invalid argument 2024-03-09T14:33:24.705 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.705+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=F5EKDAW7OMXT type=del size=3805694 2024-03-09T14:33:24.706 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.706+0000 7f586ae3d780 -1 < failed to complete operation key=9ZPCSBP3P58P tag=7TQOHAXALI84 type=del size=2907561: (22) Invalid argument 2024-03-09T14:33:24.708 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.708+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~EOZ1DD55J6VH.0 size=1048576 2024-03-09T14:33:24.709 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.709+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~EOZ1DD55J6VH.1 size=360173 2024-03-09T14:33:24.709 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.709+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=EOZ1DD55J6VH tag=12SQCSOUI67K type=write size=2457325 2024-03-09T14:33:24.710 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.711+0000 7f586ae3d780 1 < completed write operation key=2BUCMVWK7J1V tag=8B4SAF726H1U type=write size=74827 2024-03-09T14:33:24.712 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.713+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~HQLHW4OKQBYD.0 size=688496 2024-03-09T14:33:24.713 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.713+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=HQLHW4OKQBYD tag=ZNJTEIDFY6LU type=write size=1737072 2024-03-09T14:33:24.713 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.713+0000 7f586ae3d780 1 < canceled part key=_multipart_04E9KDGUC274.2~NN99NCB65MNR.0 size=1048576 2024-03-09T14:33:24.713 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.713+0000 7f586ae3d780 1 < canceled part key=_multipart_04E9KDGUC274.2~NN99NCB65MNR.1 size=478013 2024-03-09T14:33:24.714 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.715+0000 7f586ae3d780 1 < canceled multipart upload key=04E9KDGUC274 upload=NN99NCB65MNR tag=NL5JPVATQ26L type=write size=2575165 2024-03-09T14:33:24.716 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.716+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=P3TR9F4FH33A type=del size=1641000 2024-03-09T14:33:24.717 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.717+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~M22RP3JM6K4Q.0 size=1048576 2024-03-09T14:33:24.719 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.718+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~M22RP3JM6K4Q.1 size=144018 2024-03-09T14:33:24.720 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.720+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=M22RP3JM6K4Q tag=O5L0KS9088MB type=write size=2241170 2024-03-09T14:33:24.721 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.722+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=EOKCVMPP7FD1 type=del size=1759974 2024-03-09T14:33:24.726 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.723+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=L2GNP5XR3CLY type=del 2024-03-09T14:33:24.726 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.724+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=SE7I305IICVE type=del size=3875471 2024-03-09T14:33:24.726 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.724+0000 7f586ae3d780 1 < canceled part key=_multipart_CZGAXNJ0GKU0.2~G2GCX7629DOV.0 size=1048576 2024-03-09T14:33:24.726 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.725+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~G2GCX7629DOV.1 size=1048576 2024-03-09T14:33:24.726 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.727+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~G2GCX7629DOV.2 size=655052 2024-03-09T14:33:24.728 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.729+0000 7f586ae3d780 1 < canceled multipart upload key=CZGAXNJ0GKU0 upload=G2GCX7629DOV tag=D37U8OI8OWWA type=write size=3800780 2024-03-09T14:33:24.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.731+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~0NPH2IC6UM14.0 size=1048576 2024-03-09T14:33:24.731 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.732+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~0NPH2IC6UM14.1 size=1048576 2024-03-09T14:33:24.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.733+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~0NPH2IC6UM14.2 size=801876 2024-03-09T14:33:24.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.733+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=0NPH2IC6UM14 tag=AT5JE287WKEY type=write size=3947604 2024-03-09T14:33:24.733 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.734+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=KS4L77ZA8J1H type=del 2024-03-09T14:33:24.734 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.735+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=8SVOH8GDU5SS type=write size=892693 2024-03-09T14:33:24.737 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.737+0000 7f586ae3d780 1 < suggested update operation key=6YWLPUULN5SY tag=0G1ZZW3S9K0K type=del size=3582245 2024-03-09T14:33:24.738 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.738+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=6R695ZY0R71Z type=del size=298049 2024-03-09T14:33:24.739 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.739+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~3OHNK1LIFDF0.0 size=695125 2024-03-09T14:33:24.741 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.741+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=3OHNK1LIFDF0 tag=S9A3HAZFQG5G type=write size=1743701 2024-03-09T14:33:24.743 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.743+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~CIRG87XQ9ICS.0 size=1048576 2024-03-09T14:33:24.743 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.744+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~CIRG87XQ9ICS.1 size=1048576 2024-03-09T14:33:24.744 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.745+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~CIRG87XQ9ICS.2 size=439826 2024-03-09T14:33:24.744 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.745+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=CIRG87XQ9ICS tag=U383SRDXUQLQ type=write size=3585554 2024-03-09T14:33:24.745 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.746+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~14P030JU1QC1.0 size=306315 2024-03-09T14:33:24.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.748+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=14P030JU1QC1 tag=C02WYA9ORW5P type=write size=1354891 2024-03-09T14:33:24.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.749+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=2NENUWBHJE25 type=write size=976581 2024-03-09T14:33:24.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.750+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=6IDCF4B4VCWT type=del 2024-03-09T14:33:24.751 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.751+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=M964QKJD37Y7 type=del size=966567 2024-03-09T14:33:24.752 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.753+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~3ZTJXFYSDP04.0 size=1048576 2024-03-09T14:33:24.753 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.754+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~3ZTJXFYSDP04.1 size=1048576 2024-03-09T14:33:24.754 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.755+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~3ZTJXFYSDP04.2 size=822326 2024-03-09T14:33:24.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.757+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=3ZTJXFYSDP04 tag=FIATIHGSQZ5R type=write size=3968054 2024-03-09T14:33:24.758 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.759+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~H3J2AOUQ7R84.0 size=142089 2024-03-09T14:33:24.758 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.759+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=H3J2AOUQ7R84 tag=9X2BRU1E4WDN type=write size=1190665 2024-03-09T14:33:24.760 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.760+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~T73H419E767L.0 size=1048576 2024-03-09T14:33:24.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.761+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~T73H419E767L.1 size=1048576 2024-03-09T14:33:24.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.762+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~T73H419E767L.2 size=336677 2024-03-09T14:33:24.764 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.765+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=T73H419E767L tag=ON06BYS1N8BW type=write size=3482405 2024-03-09T14:33:24.765 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.766+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=ZL8Q1ZWU7JB4 type=del size=2902853 2024-03-09T14:33:24.767 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.767+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=SXTTJSEA8CSM type=del 2024-03-09T14:33:24.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.770+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~DILRT9QYI2XT.0 size=237683 2024-03-09T14:33:24.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.770+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=DILRT9QYI2XT tag=O5W5PH4VUQAM type=write size=1286259 2024-03-09T14:33:24.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.772+0000 7f586ae3d780 1 < suggested update operation key=DGO3ZT8ST90A tag=X4O4STG3LONI type=del size=1221127 2024-03-09T14:33:24.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.774+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~TT2C7ND3QQCQ.0 size=901687 2024-03-09T14:33:24.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.774+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=TT2C7ND3QQCQ tag=VKS30EO096X6 type=write size=1950263 2024-03-09T14:33:24.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.776+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=F5EKDAW7OMXT type=del 2024-03-09T14:33:24.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.778+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~JWP35KEETUBF.0 size=1048576 2024-03-09T14:33:24.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.779+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~JWP35KEETUBF.1 size=895267 2024-03-09T14:33:24.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.779+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=JWP35KEETUBF tag=NJ1FZABT72NW type=write size=2992419 2024-03-09T14:33:24.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.780+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~EOZ1DD55J6VH.0 size=1048576 2024-03-09T14:33:24.780 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.781+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~EOZ1DD55J6VH.1 size=360173 2024-03-09T14:33:24.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.783+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=EOZ1DD55J6VH tag=12SQCSOUI67K type=write size=2457325 2024-03-09T14:33:24.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.784+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=D6UPIUZESOTN type=del size=3709190 2024-03-09T14:33:24.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.784+0000 7f586ae3d780 1 < canceled part key=_multipart_6YWLPUULN5SY.2~HQLHW4OKQBYD.0 size=688496 2024-03-09T14:33:24.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.786+0000 7f586ae3d780 1 < canceled multipart upload key=6YWLPUULN5SY upload=HQLHW4OKQBYD tag=ZNJTEIDFY6LU type=write size=1737072 2024-03-09T14:33:24.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.789+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~CFNACOPDKQ5C.0 size=1048576 2024-03-09T14:33:24.789 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.790+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~CFNACOPDKQ5C.1 size=1048576 2024-03-09T14:33:24.790 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.791+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~CFNACOPDKQ5C.2 size=567134 2024-03-09T14:33:24.790 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.791+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=CFNACOPDKQ5C tag=KW6LB96NBN6C type=write size=3712862 2024-03-09T14:33:24.791 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.792+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=P3TR9F4FH33A type=del 2024-03-09T14:33:24.794 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.794+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~PXLBSRRP69YO.0 size=1048576 2024-03-09T14:33:24.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.795+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~PXLBSRRP69YO.1 size=1048576 2024-03-09T14:33:24.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.796+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~PXLBSRRP69YO.2 size=985160 2024-03-09T14:33:24.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.796+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=PXLBSRRP69YO tag=7GK8YMLP0539 type=write size=4130888 2024-03-09T14:33:24.797 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.797+0000 7f586ae3d780 -1 < failed to complete operation key=DGO3ZT8ST90A tag=EOKCVMPP7FD1 type=del size=1759974: (22) Invalid argument 2024-03-09T14:33:24.798 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.799+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=LDZIILOXC5FH type=write size=655289 2024-03-09T14:33:24.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.800+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=SE7I305IICVE type=del 2024-03-09T14:33:24.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.802+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=044X6RBPVF0U type=del size=2051271 2024-03-09T14:33:24.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.804+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~0NPH2IC6UM14.0 size=1048576 2024-03-09T14:33:24.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.805+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~0NPH2IC6UM14.1 size=1048576 2024-03-09T14:33:24.805 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.806+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~0NPH2IC6UM14.2 size=801876 2024-03-09T14:33:24.807 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.808+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=0NPH2IC6UM14 tag=AT5JE287WKEY type=write size=3947604 2024-03-09T14:33:24.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.809+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=WB29YEKU0ODH type=del size=2089250 2024-03-09T14:33:24.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.810+0000 7f586ae3d780 1 < completed write operation key=39ZIGOC6JZ1R tag=8SVOH8GDU5SS type=write size=892693 2024-03-09T14:33:24.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.812+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~TTWQM641JT5K.0 size=1048576 2024-03-09T14:33:24.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.813+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~TTWQM641JT5K.1 size=1048576 2024-03-09T14:33:24.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.814+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~TTWQM641JT5K.2 size=1020224 2024-03-09T14:33:24.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.814+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=TTWQM641JT5K tag=X2SD2071GP5T type=write size=4165952 2024-03-09T14:33:24.815 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.815+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=6R695ZY0R71Z type=del 2024-03-09T14:33:24.816 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.816+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=F6NV9HM9SETZ type=del size=1772389 2024-03-09T14:33:24.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.817+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~CIRG87XQ9ICS.0 size=1048576 2024-03-09T14:33:24.818 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.818+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~CIRG87XQ9ICS.1 size=1048576 2024-03-09T14:33:24.819 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.819+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~CIRG87XQ9ICS.2 size=439826 2024-03-09T14:33:24.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.821+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=CIRG87XQ9ICS tag=U383SRDXUQLQ type=write size=3585554 2024-03-09T14:33:24.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.824+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~XNH8BZOLJYNB.0 size=1048576 2024-03-09T14:33:24.824 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.825+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~XNH8BZOLJYNB.1 size=510632 2024-03-09T14:33:24.824 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.825+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=XNH8BZOLJYNB tag=31V4RFFXO39X type=write size=2607784 2024-03-09T14:33:24.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.827+0000 7f586ae3d780 1 < suggested remove operation key=9ZPCSBP3P58P tag=2NENUWBHJE25 type=write 2024-03-09T14:33:24.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.828+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=ZKO3E9CZZUBL type=del size=3318584 2024-03-09T14:33:24.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.830+0000 7f586ae3d780 -1 < failed to complete operation key=DGO3ZT8ST90A tag=M964QKJD37Y7 type=del size=966567: (22) Invalid argument 2024-03-09T14:33:24.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.831+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=KUDJBUK7K5YU type=del size=3837923 2024-03-09T14:33:24.831 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.832+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~H3J2AOUQ7R84.0 size=142089 2024-03-09T14:33:24.833 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.834+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=H3J2AOUQ7R84 tag=9X2BRU1E4WDN type=write size=1190665 2024-03-09T14:33:24.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.836+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~GF8RHFVCMXQG.0 size=1048576 2024-03-09T14:33:24.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.837+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~GF8RHFVCMXQG.1 size=109767 2024-03-09T14:33:24.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.837+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=GF8RHFVCMXQG tag=T0D1O81H9DR5 type=write size=2206919 2024-03-09T14:33:24.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.839+0000 7f586ae3d780 1 < canceled operation key=CZGAXNJ0GKU0 tag=ZL8Q1ZWU7JB4 type=del size=2902853 2024-03-09T14:33:24.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.840+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=635B0MJE0FM1 type=del size=345373 2024-03-09T14:33:24.840 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.841+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~DILRT9QYI2XT.0 size=237683 2024-03-09T14:33:24.842 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.843+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=DILRT9QYI2XT tag=O5W5PH4VUQAM type=write size=1286259 2024-03-09T14:33:24.843 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.844+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=DPVD6YKKS0ST type=del size=4043448 2024-03-09T14:33:24.845 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.845+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~TT2C7ND3QQCQ.0 size=901687 2024-03-09T14:33:24.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.848+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=TT2C7ND3QQCQ tag=VKS30EO096X6 type=write size=1950263 2024-03-09T14:33:24.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.850+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~2AEBZREBKBLQ.0 size=1048576 2024-03-09T14:33:24.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.851+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~2AEBZREBKBLQ.1 size=1048576 2024-03-09T14:33:24.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.852+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~2AEBZREBKBLQ.2 size=768405 2024-03-09T14:33:24.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.852+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=2AEBZREBKBLQ tag=TDIST3VLBU26 type=write size=3914133 2024-03-09T14:33:24.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.853+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~JWP35KEETUBF.0 size=1048576 2024-03-09T14:33:24.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.854+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~JWP35KEETUBF.1 size=895267 2024-03-09T14:33:24.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.856+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=JWP35KEETUBF tag=NJ1FZABT72NW type=write size=2992419 2024-03-09T14:33:24.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.858+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~Z6NA07Y0I2UM.0 size=1048576 2024-03-09T14:33:24.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.859+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~Z6NA07Y0I2UM.1 size=937508 2024-03-09T14:33:24.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.859+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=Z6NA07Y0I2UM tag=KE0T0F7B2VUR type=write size=3034660 2024-03-09T14:33:24.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.860+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=D6UPIUZESOTN type=del 2024-03-09T14:33:24.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.861+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=BW2QOPBOSHYL type=del size=328994 2024-03-09T14:33:24.862 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.863+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~CFNACOPDKQ5C.0 size=1048576 2024-03-09T14:33:24.863 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.864+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~CFNACOPDKQ5C.1 size=1048576 2024-03-09T14:33:24.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.865+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~CFNACOPDKQ5C.2 size=567134 2024-03-09T14:33:24.866 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.867+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=CFNACOPDKQ5C tag=KW6LB96NBN6C type=write size=3712862 2024-03-09T14:33:24.867 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.868+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=J2F13B1WMJ1Q type=del size=3628815 2024-03-09T14:33:24.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.869+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~PXLBSRRP69YO.0 size=1048576 2024-03-09T14:33:24.869 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.870+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~PXLBSRRP69YO.1 size=1048576 2024-03-09T14:33:24.870 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.871+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~PXLBSRRP69YO.2 size=985160 2024-03-09T14:33:24.872 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.873+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=PXLBSRRP69YO tag=7GK8YMLP0539 type=write size=4130888 2024-03-09T14:33:24.874 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.874+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=TRZGZK8RMW71 type=del size=4024536 2024-03-09T14:33:24.876 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.877+0000 7f586ae3d780 1 < suggested remove operation key=DJH53FNVMLGY tag=LDZIILOXC5FH type=write 2024-03-09T14:33:24.877 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.878+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=I2T4THT12HC6 type=del size=1565567 2024-03-09T14:33:24.878 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.878+0000 7f586ae3d780 -1 < no bi entry to suggest for operation key=DJH53FNVMLGY tag=044X6RBPVF0U type=del size=2051271: (2) No such file or directory 2024-03-09T14:33:24.880 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.880+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~EWEQU0K0RDXU.0 size=1048576 2024-03-09T14:33:24.881 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.881+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~EWEQU0K0RDXU.1 size=1048576 2024-03-09T14:33:24.882 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.882+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~EWEQU0K0RDXU.2 size=954907 2024-03-09T14:33:24.882 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.882+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=EWEQU0K0RDXU tag=8NUGVGR72JAT type=write size=4100635 2024-03-09T14:33:24.883 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.884+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=WB29YEKU0ODH type=del 2024-03-09T14:33:24.885 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.886+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~3T8DYZUEQ0ZZ.0 size=1048576 2024-03-09T14:33:24.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.887+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~3T8DYZUEQ0ZZ.1 size=1048576 2024-03-09T14:33:24.887 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.887+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~3T8DYZUEQ0ZZ.2 size=321391 2024-03-09T14:33:24.887 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.887+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=3T8DYZUEQ0ZZ tag=60QNWR1ST8Z8 type=write size=3467119 2024-03-09T14:33:24.889 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.889+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~TTWQM641JT5K.0 size=1048576 2024-03-09T14:33:24.890 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.890+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~TTWQM641JT5K.1 size=1048576 2024-03-09T14:33:24.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.891+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~TTWQM641JT5K.2 size=1020224 2024-03-09T14:33:24.893 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.893+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=TTWQM641JT5K tag=X2SD2071GP5T type=write size=4165952 2024-03-09T14:33:24.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.895+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=8LA235441W28 type=write size=1013069 2024-03-09T14:33:24.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.896+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=F6NV9HM9SETZ type=del 2024-03-09T14:33:24.896 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.897+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=A9U2D4GU4XNK type=del size=3731371 2024-03-09T14:33:24.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.898+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~XNH8BZOLJYNB.0 size=1048576 2024-03-09T14:33:24.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.899+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~XNH8BZOLJYNB.1 size=510632 2024-03-09T14:33:24.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.901+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=XNH8BZOLJYNB tag=31V4RFFXO39X type=write size=2607784 2024-03-09T14:33:24.902 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.903+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~ITQF123GJ7HB.0 size=1048576 2024-03-09T14:33:24.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.904+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~ITQF123GJ7HB.1 size=1048576 2024-03-09T14:33:24.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.905+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~ITQF123GJ7HB.2 size=567256 2024-03-09T14:33:24.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.905+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=ITQF123GJ7HB tag=L5SQMVT3WASN type=write size=3712984 2024-03-09T14:33:24.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.907+0000 7f586ae3d780 1 < suggested remove operation key=78Y2ZM3W6EUC tag=ZKO3E9CZZUBL type=del 2024-03-09T14:33:24.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.909+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~O15A5TG75V06.0 size=1048576 2024-03-09T14:33:24.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.910+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~O15A5TG75V06.1 size=1048576 2024-03-09T14:33:24.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.912+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~O15A5TG75V06.2 size=43105 2024-03-09T14:33:24.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.912+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=O15A5TG75V06 tag=Z6PWPOFHA0JD type=write size=3188833 2024-03-09T14:33:24.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.913+0000 7f586ae3d780 1 < canceled operation key=O5L6RC16RS8E tag=KUDJBUK7K5YU type=del size=3837923 2024-03-09T14:33:24.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.915+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~X6E2654AVLRQ.0 size=1048576 2024-03-09T14:33:24.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.916+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~X6E2654AVLRQ.1 size=453831 2024-03-09T14:33:24.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.916+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=X6E2654AVLRQ tag=RQ13HT4W3K4T type=write size=2550983 2024-03-09T14:33:24.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.916+0000 7f586ae3d780 1 < canceled part key=_multipart_6YWLPUULN5SY.2~GF8RHFVCMXQG.0 size=1048576 2024-03-09T14:33:24.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.917+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~GF8RHFVCMXQG.1 size=109767 2024-03-09T14:33:24.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.919+0000 7f586ae3d780 1 < canceled multipart upload key=6YWLPUULN5SY upload=GF8RHFVCMXQG tag=T0D1O81H9DR5 type=write size=2206919 2024-03-09T14:33:24.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.920+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=4ZGB5LEAKFR6 type=del size=3254830 2024-03-09T14:33:24.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.921+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=635B0MJE0FM1 type=del 2024-03-09T14:33:24.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.922+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=2XBMPGTCK1EI type=del size=3180089 2024-03-09T14:33:24.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.923+0000 7f586ae3d780 1 < canceled operation key=0JDF7910RACF tag=DPVD6YKKS0ST type=del size=4043448 2024-03-09T14:33:24.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.924+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=SWS5WBD65K69 type=del size=879183 2024-03-09T14:33:24.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.925+0000 7f586ae3d780 1 < canceled part key=_multipart_P3OUIQNAK1TC.2~2AEBZREBKBLQ.0 size=1048576 2024-03-09T14:33:24.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.925+0000 7f586ae3d780 1 < canceled part key=_multipart_P3OUIQNAK1TC.2~2AEBZREBKBLQ.1 size=1048576 2024-03-09T14:33:24.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.926+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~2AEBZREBKBLQ.2 size=768405 2024-03-09T14:33:24.927 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.927+0000 7f586ae3d780 1 < canceled multipart upload key=P3OUIQNAK1TC upload=2AEBZREBKBLQ tag=TDIST3VLBU26 type=write size=3914133 2024-03-09T14:33:24.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.929+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=S2K1YZJVSM2E type=write size=348844 2024-03-09T14:33:24.929 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.930+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~Z6NA07Y0I2UM.0 size=1048576 2024-03-09T14:33:24.930 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.931+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~Z6NA07Y0I2UM.1 size=937508 2024-03-09T14:33:24.932 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.932+0000 7f586ae3d780 1 < completed multipart upload key=IK528ND96157 upload=Z6NA07Y0I2UM tag=KE0T0F7B2VUR type=write size=3034660 2024-03-09T14:33:24.933 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.934+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=1TRHBEO7L14T type=write size=298207 2024-03-09T14:33:24.934 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.935+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=BW2QOPBOSHYL type=del 2024-03-09T14:33:24.936 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.937+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~1MFUKJULNGT3.0 size=981232 2024-03-09T14:33:24.936 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.937+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=1MFUKJULNGT3 tag=L894X327PV5J type=write size=2029808 2024-03-09T14:33:24.937 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.938+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=J2F13B1WMJ1Q type=del 2024-03-09T14:33:24.939 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.940+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~53R3HEJPSMWZ.0 size=1048576 2024-03-09T14:33:24.940 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.941+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~53R3HEJPSMWZ.1 size=1048576 2024-03-09T14:33:24.941 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.942+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~53R3HEJPSMWZ.2 size=276909 2024-03-09T14:33:24.941 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.942+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=53R3HEJPSMWZ tag=0F5IVEMO3MCE type=write size=3422637 2024-03-09T14:33:24.942 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.943+0000 7f586ae3d780 1 < canceled operation key=XIYWPXSYCT6I tag=TRZGZK8RMW71 type=del size=4024536 2024-03-09T14:33:24.944 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.944+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=AE7UJ31DSIKL type=del size=41125 2024-03-09T14:33:24.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.945+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=I2T4THT12HC6 type=del 2024-03-09T14:33:24.946 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.946+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=JG7EFJBCKK76 type=del size=168002 2024-03-09T14:33:24.947 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.948+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~EWEQU0K0RDXU.0 size=1048576 2024-03-09T14:33:24.947 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.948+0000 7f586ae3d780 1 < canceled part key=_multipart_WNVN3EOUUBGR.2~EWEQU0K0RDXU.1 size=1048576 2024-03-09T14:33:24.948 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.949+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~EWEQU0K0RDXU.2 size=954907 2024-03-09T14:33:24.950 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.951+0000 7f586ae3d780 1 < canceled multipart upload key=WNVN3EOUUBGR upload=EWEQU0K0RDXU tag=8NUGVGR72JAT type=write size=4100635 2024-03-09T14:33:24.952 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.952+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=6YQHB1NU5UB1 type=del size=1459553 2024-03-09T14:33:24.953 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.953+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~3T8DYZUEQ0ZZ.0 size=1048576 2024-03-09T14:33:24.954 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.954+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~3T8DYZUEQ0ZZ.1 size=1048576 2024-03-09T14:33:24.954 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.954+0000 7f586ae3d780 1 < canceled part key=_multipart_OXBDXIILR3NS.2~3T8DYZUEQ0ZZ.2 size=321391 2024-03-09T14:33:24.956 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.956+0000 7f586ae3d780 1 < canceled multipart upload key=OXBDXIILR3NS upload=3T8DYZUEQ0ZZ tag=60QNWR1ST8Z8 type=write size=3467119 2024-03-09T14:33:24.958 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.958+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~CXSV7AYZZ2C4.0 size=1048576 2024-03-09T14:33:24.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.959+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~CXSV7AYZZ2C4.1 size=1048576 2024-03-09T14:33:24.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.960+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~CXSV7AYZZ2C4.2 size=1033977 2024-03-09T14:33:24.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.960+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=CXSV7AYZZ2C4 tag=K18F6QMB9FSA type=write size=4179705 2024-03-09T14:33:24.961 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.961+0000 7f586ae3d780 1 < completed write operation key=IK528ND96157 tag=8LA235441W28 type=write size=1013069 2024-03-09T14:33:24.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.962+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=GNI7LP8IJMR9 type=del size=4042540 2024-03-09T14:33:24.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.965+0000 7f586ae3d780 1 < suggested remove operation key=UAYZ55UT77VE tag=A9U2D4GU4XNK type=del 2024-03-09T14:33:24.966 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.967+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~N1KB3Z7E11C1.0 size=1048576 2024-03-09T14:33:24.968 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.968+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~N1KB3Z7E11C1.1 size=82832 2024-03-09T14:33:24.968 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.968+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=N1KB3Z7E11C1 tag=NEHKIKQ3QMY1 type=write size=2179984 2024-03-09T14:33:24.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.969+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~ITQF123GJ7HB.0 size=1048576 2024-03-09T14:33:24.970 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.970+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~ITQF123GJ7HB.1 size=1048576 2024-03-09T14:33:24.970 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.970+0000 7f586ae3d780 1 < canceled part key=_multipart_6YWLPUULN5SY.2~ITQF123GJ7HB.2 size=567256 2024-03-09T14:33:24.972 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.972+0000 7f586ae3d780 1 < canceled multipart upload key=6YWLPUULN5SY upload=ITQF123GJ7HB tag=L5SQMVT3WASN type=write size=3712984 2024-03-09T14:33:24.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.975+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~73FCCRURS8LF.0 size=1048576 2024-03-09T14:33:24.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.975+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~73FCCRURS8LF.1 size=586749 2024-03-09T14:33:24.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.975+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=73FCCRURS8LF tag=F8DO39DV5K33 type=write size=2683901 2024-03-09T14:33:24.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.977+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~O15A5TG75V06.0 size=1048576 2024-03-09T14:33:24.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.978+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~O15A5TG75V06.1 size=1048576 2024-03-09T14:33:24.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.979+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~O15A5TG75V06.2 size=43105 2024-03-09T14:33:24.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.981+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=O15A5TG75V06 tag=Z6PWPOFHA0JD type=write size=3188833 2024-03-09T14:33:24.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.983+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~AZV54IN7C5NG.0 size=1048576 2024-03-09T14:33:24.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.984+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~AZV54IN7C5NG.1 size=1048576 2024-03-09T14:33:24.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.984+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~AZV54IN7C5NG.2 size=1017787 2024-03-09T14:33:24.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.984+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=AZV54IN7C5NG tag=SDXE65DCPEB7 type=write size=4163515 2024-03-09T14:33:24.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.985+0000 7f586ae3d780 1 < canceled part key=_multipart_UO072H74SHLP.2~X6E2654AVLRQ.0 size=1048576 2024-03-09T14:33:24.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.986+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~X6E2654AVLRQ.1 size=453831 2024-03-09T14:33:24.987 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.988+0000 7f586ae3d780 1 < canceled multipart upload key=UO072H74SHLP upload=X6E2654AVLRQ tag=RQ13HT4W3K4T type=write size=2550983 2024-03-09T14:33:24.989 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.990+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~K5WOFYVB713Z.0 size=778301 2024-03-09T14:33:24.989 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.990+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=K5WOFYVB713Z tag=9PZJWE2R4RX5 type=write size=1826877 2024-03-09T14:33:24.991 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.992+0000 7f586ae3d780 1 < suggested update operation key=OXBDXIILR3NS tag=4ZGB5LEAKFR6 type=del size=3254830 2024-03-09T14:33:24.993 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.994+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~TJCU7264B7UK.0 size=1048576 2024-03-09T14:33:24.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.995+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~TJCU7264B7UK.1 size=1048576 2024-03-09T14:33:24.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.996+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~TJCU7264B7UK.2 size=988069 2024-03-09T14:33:24.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.996+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=TJCU7264B7UK tag=35TQ2B46CWPR type=write size=4133797 2024-03-09T14:33:24.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:24.998+0000 7f586ae3d780 1 < suggested update operation key=9ZPCSBP3P58P tag=2XBMPGTCK1EI type=del size=3180089 2024-03-09T14:33:25.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.000+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~GLER9F187DAU.0 size=1048576 2024-03-09T14:33:25.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.001+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~GLER9F187DAU.1 size=16168 2024-03-09T14:33:25.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.001+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=GLER9F187DAU tag=53D3RCXOU1R1 type=write size=2113320 2024-03-09T14:33:25.002 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.002+0000 7f586ae3d780 -1 < failed to complete operation key=9ZPCSBP3P58P tag=SWS5WBD65K69 type=del size=879183: (22) Invalid argument 2024-03-09T14:33:25.003 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.003+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=KI074SLPW9FQ type=write size=496854 2024-03-09T14:33:25.004 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.004+0000 7f586ae3d780 1 < canceled operation key=LRI2GKBGVCWW tag=S2K1YZJVSM2E type=write size=348844 2024-03-09T14:33:25.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.006+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~TU6XYC94K2QK.0 size=1048576 2024-03-09T14:33:25.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.007+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~TU6XYC94K2QK.1 size=1048576 2024-03-09T14:33:25.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.008+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~TU6XYC94K2QK.2 size=529828 2024-03-09T14:33:25.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.008+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=TU6XYC94K2QK tag=01J0N6HLTLIS type=write size=3675556 2024-03-09T14:33:25.009 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.009+0000 7f586ae3d780 1 < completed write operation key=W4Q1MWHOQ4Y1 tag=1TRHBEO7L14T type=write size=298207 2024-03-09T14:33:25.010 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.010+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=MDEJU474CPSW type=del size=243945 2024-03-09T14:33:25.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.012+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~1MFUKJULNGT3.0 size=981232 2024-03-09T14:33:25.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.014+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=1MFUKJULNGT3 tag=L894X327PV5J type=write size=2029808 2024-03-09T14:33:25.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.016+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~KGRIRLQPSZ5E.0 size=1048576 2024-03-09T14:33:25.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.018+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~KGRIRLQPSZ5E.1 size=56133 2024-03-09T14:33:25.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.018+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=KGRIRLQPSZ5E tag=JW9OHINRN66T type=write size=2153285 2024-03-09T14:33:25.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.019+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~53R3HEJPSMWZ.0 size=1048576 2024-03-09T14:33:25.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.020+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~53R3HEJPSMWZ.1 size=1048576 2024-03-09T14:33:25.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.020+0000 7f586ae3d780 1 < canceled part key=_multipart_UAYZ55UT77VE.2~53R3HEJPSMWZ.2 size=276909 2024-03-09T14:33:25.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.022+0000 7f586ae3d780 1 < canceled multipart upload key=UAYZ55UT77VE upload=53R3HEJPSMWZ tag=0F5IVEMO3MCE type=write size=3422637 2024-03-09T14:33:25.023 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.024+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=3TW320X4T3NC type=del size=3602908 2024-03-09T14:33:25.024 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.025+0000 7f586ae3d780 1 < canceled operation key=CZGAXNJ0GKU0 tag=AE7UJ31DSIKL type=del size=41125 2024-03-09T14:33:25.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.026+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=ZJHFZY3LCNJL type=del size=3757573 2024-03-09T14:33:25.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.027+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=JG7EFJBCKK76 type=del 2024-03-09T14:33:25.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.029+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=BH7CH7BAKYZM type=del size=279414 2024-03-09T14:33:25.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.030+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=6YQHB1NU5UB1 type=del 2024-03-09T14:33:25.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.031+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=T809ZYG5KGA7 type=del size=1525969 2024-03-09T14:33:25.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.032+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~CXSV7AYZZ2C4.0 size=1048576 2024-03-09T14:33:25.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.033+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~CXSV7AYZZ2C4.1 size=1048576 2024-03-09T14:33:25.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.034+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~CXSV7AYZZ2C4.2 size=1033977 2024-03-09T14:33:25.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.036+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=CXSV7AYZZ2C4 tag=K18F6QMB9FSA type=write size=4179705 2024-03-09T14:33:25.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.039+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~S0A3YBB8943U.0 size=1048576 2024-03-09T14:33:25.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.040+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~S0A3YBB8943U.1 size=49449 2024-03-09T14:33:25.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.040+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=S0A3YBB8943U tag=PDHXW45MQGV6 type=write size=2146601 2024-03-09T14:33:25.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.041+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=GNI7LP8IJMR9 type=del 2024-03-09T14:33:25.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.043+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~Z5VJ34ZY6Z08.0 size=814225 2024-03-09T14:33:25.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.043+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=Z5VJ34ZY6Z08 tag=7WSJ2ALIR15I type=write size=1862801 2024-03-09T14:33:25.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.045+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~N1KB3Z7E11C1.0 size=1048576 2024-03-09T14:33:25.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.046+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~N1KB3Z7E11C1.1 size=82832 2024-03-09T14:33:25.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.048+0000 7f586ae3d780 1 < completed multipart upload key=IK528ND96157 upload=N1KB3Z7E11C1 tag=NEHKIKQ3QMY1 type=write size=2179984 2024-03-09T14:33:25.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.049+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=SAD22PMWZ5WA type=del size=3429167 2024-03-09T14:33:25.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.051+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~73FCCRURS8LF.0 size=1048576 2024-03-09T14:33:25.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.051+0000 7f586ae3d780 1 < canceled part key=_multipart_78Y2ZM3W6EUC.2~73FCCRURS8LF.1 size=586749 2024-03-09T14:33:25.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.053+0000 7f586ae3d780 1 < canceled multipart upload key=78Y2ZM3W6EUC upload=73FCCRURS8LF tag=F8DO39DV5K33 type=write size=2683901 2024-03-09T14:33:25.053 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.054+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=KAIB3O8C8A8P type=del size=2613786 2024-03-09T14:33:25.055 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.055+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~AZV54IN7C5NG.0 size=1048576 2024-03-09T14:33:25.056 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.056+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~AZV54IN7C5NG.1 size=1048576 2024-03-09T14:33:25.056 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.056+0000 7f586ae3d780 1 < canceled part key=_multipart_04E9KDGUC274.2~AZV54IN7C5NG.2 size=1017787 2024-03-09T14:33:25.058 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.058+0000 7f586ae3d780 1 < canceled multipart upload key=04E9KDGUC274 upload=AZV54IN7C5NG tag=SDXE65DCPEB7 type=write size=4163515 2024-03-09T14:33:25.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.059+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=YLWQEUA1RZWM type=write size=979857 2024-03-09T14:33:25.060 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.061+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~K5WOFYVB713Z.0 size=778301 2024-03-09T14:33:25.062 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.063+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=K5WOFYVB713Z tag=9PZJWE2R4RX5 type=write size=1826877 2024-03-09T14:33:25.064 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.065+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~846GOHNKVR7D.0 size=1048576 2024-03-09T14:33:25.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.066+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~846GOHNKVR7D.1 size=285583 2024-03-09T14:33:25.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.066+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=846GOHNKVR7D tag=PK5NOWPPTY24 type=write size=2382735 2024-03-09T14:33:25.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.067+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~TJCU7264B7UK.0 size=1048576 2024-03-09T14:33:25.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.067+0000 7f586ae3d780 1 < canceled part key=_multipart_78Y2ZM3W6EUC.2~TJCU7264B7UK.1 size=1048576 2024-03-09T14:33:25.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.067+0000 7f586ae3d780 1 < canceled part key=_multipart_78Y2ZM3W6EUC.2~TJCU7264B7UK.2 size=988069 2024-03-09T14:33:25.069 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.069+0000 7f586ae3d780 1 < canceled multipart upload key=78Y2ZM3W6EUC upload=TJCU7264B7UK tag=35TQ2B46CWPR type=write size=4133797 2024-03-09T14:33:25.070 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.070+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=OYMQGQOPS74Y type=del size=2877446 2024-03-09T14:33:25.071 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.072+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~GLER9F187DAU.0 size=1048576 2024-03-09T14:33:25.071 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.072+0000 7f586ae3d780 1 < canceled part key=_multipart_W4Q1MWHOQ4Y1.2~GLER9F187DAU.1 size=16168 2024-03-09T14:33:25.073 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.074+0000 7f586ae3d780 1 < canceled multipart upload key=W4Q1MWHOQ4Y1 upload=GLER9F187DAU tag=53D3RCXOU1R1 type=write size=2113320 2024-03-09T14:33:25.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.075+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=5ANJ4FY5E16I type=del size=2029154 2024-03-09T14:33:25.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.077+0000 7f586ae3d780 1 < suggested update operation key=5PERWGS0GOJU tag=KI074SLPW9FQ type=write size=496854 2024-03-09T14:33:25.078 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.078+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=HQSHHYA9F5VP type=del size=977728 2024-03-09T14:33:25.079 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.080+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~TU6XYC94K2QK.0 size=1048576 2024-03-09T14:33:25.080 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.081+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~TU6XYC94K2QK.1 size=1048576 2024-03-09T14:33:25.080 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.081+0000 7f586ae3d780 1 < canceled part key=_multipart_IK528ND96157.2~TU6XYC94K2QK.2 size=529828 2024-03-09T14:33:25.082 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.083+0000 7f586ae3d780 1 < canceled multipart upload key=IK528ND96157 upload=TU6XYC94K2QK tag=01J0N6HLTLIS type=write size=3675556 2024-03-09T14:33:25.084 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.085+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~D4TZMKCPE6SD.0 size=1048576 2024-03-09T14:33:25.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.086+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~D4TZMKCPE6SD.1 size=869188 2024-03-09T14:33:25.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.086+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=D4TZMKCPE6SD tag=BVNFNVY872JD type=write size=2966340 2024-03-09T14:33:25.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.088+0000 7f586ae3d780 1 < suggested remove operation key=W3HTK2F8ML3V tag=MDEJU474CPSW type=del 2024-03-09T14:33:25.089 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.089+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=ITW2CZQ14BL8 type=write size=213747 2024-03-09T14:33:25.090 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.091+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~KGRIRLQPSZ5E.0 size=1048576 2024-03-09T14:33:25.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.092+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~KGRIRLQPSZ5E.1 size=56133 2024-03-09T14:33:25.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.094+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=KGRIRLQPSZ5E tag=JW9OHINRN66T type=write size=2153285 2024-03-09T14:33:25.094 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.095+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=70JHNO01GH62 type=del size=2392398 2024-03-09T14:33:25.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.096+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=3TW320X4T3NC type=del 2024-03-09T14:33:25.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.098+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~H1X6XS1E3DG1.0 size=716563 2024-03-09T14:33:25.098 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.098+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=H1X6XS1E3DG1 tag=7YET8Y8JH47A type=write size=1765139 2024-03-09T14:33:25.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.100+0000 7f586ae3d780 1 < suggested remove operation key=C1UGQOQ6AE1E tag=ZJHFZY3LCNJL type=del 2024-03-09T14:33:25.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.102+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=LY760GCTWVT1 type=del size=1064837 2024-03-09T14:33:25.102 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.103+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=BH7CH7BAKYZM type=del 2024-03-09T14:33:25.104 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.104+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=772PTCT063JJ type=del size=2821012 2024-03-09T14:33:25.105 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.105+0000 7f586ae3d780 -1 < failed to complete operation key=5PERWGS0GOJU tag=T809ZYG5KGA7 type=del size=1525969: (22) Invalid argument 2024-03-09T14:33:25.106 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.107+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=UX5T6YBHYNP6 type=del size=1344686 2024-03-09T14:33:25.107 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.108+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~S0A3YBB8943U.0 size=1048576 2024-03-09T14:33:25.108 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.109+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~S0A3YBB8943U.1 size=49449 2024-03-09T14:33:25.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.111+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=S0A3YBB8943U tag=PDHXW45MQGV6 type=write size=2146601 2024-03-09T14:33:25.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.113+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~R3J9BNQ0D63M.0 size=1048576 2024-03-09T14:33:25.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.114+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~R3J9BNQ0D63M.1 size=1048576 2024-03-09T14:33:25.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.115+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~R3J9BNQ0D63M.2 size=559649 2024-03-09T14:33:25.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.115+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=R3J9BNQ0D63M tag=MFR5OAV3LKJE type=write size=3705377 2024-03-09T14:33:25.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.116+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~Z5VJ34ZY6Z08.0 size=814225 2024-03-09T14:33:25.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.118+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=Z5VJ34ZY6Z08 tag=7WSJ2ALIR15I type=write size=1862801 2024-03-09T14:33:25.119 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.119+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=RZ1WH3ABIO2F type=del size=3550266 2024-03-09T14:33:25.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.121+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=SAD22PMWZ5WA type=del 2024-03-09T14:33:25.121 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.122+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=ONRGQ066T0OE type=del size=1195864 2024-03-09T14:33:25.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.123+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=KAIB3O8C8A8P type=del 2024-03-09T14:33:25.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.124+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=ZMVW62QQN90N type=del size=3533068 2024-03-09T14:33:25.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.126+0000 7f586ae3d780 1 < completed write operation key=78Y2ZM3W6EUC tag=YLWQEUA1RZWM type=write size=979857 2024-03-09T14:33:25.127 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.127+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=H8N4H3H72WRH type=write size=952026 2024-03-09T14:33:25.128 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.129+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~846GOHNKVR7D.0 size=1048576 2024-03-09T14:33:25.129 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.130+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~846GOHNKVR7D.1 size=285583 2024-03-09T14:33:25.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.132+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=846GOHNKVR7D tag=PK5NOWPPTY24 type=write size=2382735 2024-03-09T14:33:25.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.134+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=DFYQ38J5OZX1 type=del size=3951673 2024-03-09T14:33:25.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.135+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=OYMQGQOPS74Y type=del 2024-03-09T14:33:25.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.137+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~J30LWIX1JSC9.0 size=1048576 2024-03-09T14:33:25.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.138+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~J30LWIX1JSC9.1 size=286436 2024-03-09T14:33:25.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.138+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=J30LWIX1JSC9 tag=RZBXGXQ2THKQ type=write size=2383588 2024-03-09T14:33:25.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.139+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=5ANJ4FY5E16I type=del 2024-03-09T14:33:25.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.141+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~0PT0XCUNOM1W.0 size=1048576 2024-03-09T14:33:25.141 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.142+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~0PT0XCUNOM1W.1 size=1048576 2024-03-09T14:33:25.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.142+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~0PT0XCUNOM1W.2 size=549295 2024-03-09T14:33:25.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.142+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=0PT0XCUNOM1W tag=T0IMG332JCA0 type=write size=3695023 2024-03-09T14:33:25.143 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.144+0000 7f586ae3d780 -1 < failed to complete operation key=C1UGQOQ6AE1E tag=HQSHHYA9F5VP type=del size=977728: (22) Invalid argument 2024-03-09T14:33:25.144 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.145+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=J60VWK8VE9FA type=del size=1917919 2024-03-09T14:33:25.145 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.146+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~D4TZMKCPE6SD.0 size=1048576 2024-03-09T14:33:25.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.147+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~D4TZMKCPE6SD.1 size=869188 2024-03-09T14:33:25.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.149+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=D4TZMKCPE6SD tag=BVNFNVY872JD type=write size=2966340 2024-03-09T14:33:25.151 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.151+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~OSZV1WGZG7Y6.0 size=1048576 2024-03-09T14:33:25.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.152+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~OSZV1WGZG7Y6.1 size=741122 2024-03-09T14:33:25.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.152+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=OSZV1WGZG7Y6 tag=113FEC8ICIHY type=write size=2838274 2024-03-09T14:33:25.153 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.153+0000 7f586ae3d780 1 < canceled operation key=0JDF7910RACF tag=ITW2CZQ14BL8 type=write size=213747 2024-03-09T14:33:25.154 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.155+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=TW33YB01Q8WS type=del size=3909401 2024-03-09T14:33:25.155 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.156+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=70JHNO01GH62 type=del 2024-03-09T14:33:25.156 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.157+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=DH886R53J3CI type=del size=916837 2024-03-09T14:33:25.158 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.158+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~H1X6XS1E3DG1.0 size=716563 2024-03-09T14:33:25.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.160+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=H1X6XS1E3DG1 tag=7YET8Y8JH47A type=write size=1765139 2024-03-09T14:33:25.161 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.161+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=ZHJ11LY762EQ type=write size=496783 2024-03-09T14:33:25.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.162+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=LY760GCTWVT1 type=del 2024-03-09T14:33:25.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.164+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~VN1JEWLVY390.0 size=952074 2024-03-09T14:33:25.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.164+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=VN1JEWLVY390 tag=LMHG091ZRPSA type=write size=2000650 2024-03-09T14:33:25.166 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.167+0000 7f586ae3d780 1 < suggested update operation key=04E9KDGUC274 tag=772PTCT063JJ type=del size=2821012 2024-03-09T14:33:25.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.168+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=PYFZZ4UH85N9 type=del size=1487568 2024-03-09T14:33:25.170 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.170+0000 7f586ae3d780 1 < suggested update operation key=UKPSUQ6LYWN8 tag=UX5T6YBHYNP6 type=del size=1344686 2024-03-09T14:33:25.172 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.172+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~MQFW09K7QQG5.0 size=1048576 2024-03-09T14:33:25.173 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.173+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~MQFW09K7QQG5.1 size=1020467 2024-03-09T14:33:25.173 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.173+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=MQFW09K7QQG5 tag=SPBBTQQ5WJOS type=write size=3117619 2024-03-09T14:33:25.174 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.174+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~R3J9BNQ0D63M.0 size=1048576 2024-03-09T14:33:25.174 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.174+0000 7f586ae3d780 1 < canceled part key=_multipart_9ZPCSBP3P58P.2~R3J9BNQ0D63M.1 size=1048576 2024-03-09T14:33:25.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.175+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~R3J9BNQ0D63M.2 size=559649 2024-03-09T14:33:25.177 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.177+0000 7f586ae3d780 1 < canceled multipart upload key=9ZPCSBP3P58P upload=R3J9BNQ0D63M tag=MFR5OAV3LKJE type=write size=3705377 2024-03-09T14:33:25.178 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.178+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=8PPVHC59FDCA type=del size=3512455 2024-03-09T14:33:25.180 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.181+0000 7f586ae3d780 1 < suggested remove operation key=5PERWGS0GOJU tag=RZ1WH3ABIO2F type=del 2024-03-09T14:33:25.181 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.182+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=R8W4E6JNPHHY type=del size=2255544 2024-03-09T14:33:25.182 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.183+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=ONRGQ066T0OE type=del 2024-03-09T14:33:25.183 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.184+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=8ZAEYJ6L0RZE type=del size=135332 2024-03-09T14:33:25.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.186+0000 7f586ae3d780 1 < suggested remove operation key=P3OUIQNAK1TC tag=ZMVW62QQN90N type=del 2024-03-09T14:33:25.187 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.187+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=7CPCG2GQHGWS type=del size=2333386 2024-03-09T14:33:25.188 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.188+0000 7f586ae3d780 -1 < failed to complete operation key=P3OUIQNAK1TC tag=H8N4H3H72WRH type=write size=952026: (22) Invalid argument 2024-03-09T14:33:25.189 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.190+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=7HMKL26WG18X type=del size=279115 2024-03-09T14:33:25.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.192+0000 7f586ae3d780 1 < suggested remove operation key=OXBDXIILR3NS tag=DFYQ38J5OZX1 type=del 2024-03-09T14:33:25.192 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.193+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=B3IYJ74B94FG type=del size=3722539 2024-03-09T14:33:25.193 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.194+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~J30LWIX1JSC9.0 size=1048576 2024-03-09T14:33:25.194 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.195+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~J30LWIX1JSC9.1 size=286436 2024-03-09T14:33:25.197 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.197+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=J30LWIX1JSC9 tag=RZBXGXQ2THKQ type=write size=2383588 2024-03-09T14:33:25.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.199+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~T0W2PMB05TIP.0 size=1048576 2024-03-09T14:33:25.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.200+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~T0W2PMB05TIP.1 size=1048576 2024-03-09T14:33:25.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.201+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~T0W2PMB05TIP.2 size=745323 2024-03-09T14:33:25.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.201+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=T0W2PMB05TIP tag=N2STQA5WM9KL type=write size=3891051 2024-03-09T14:33:25.201 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.202+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~0PT0XCUNOM1W.0 size=1048576 2024-03-09T14:33:25.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.203+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~0PT0XCUNOM1W.1 size=1048576 2024-03-09T14:33:25.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.203+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~0PT0XCUNOM1W.2 size=549295 2024-03-09T14:33:25.205 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.205+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=0PT0XCUNOM1W tag=T0IMG332JCA0 type=write size=3695023 2024-03-09T14:33:25.206 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.206+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=J28JUAJFT6W3 type=del size=210078 2024-03-09T14:33:25.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.209+0000 7f586ae3d780 1 < suggested update operation key=NHIOOLNXLZZC tag=J60VWK8VE9FA type=del size=1917919 2024-03-09T14:33:25.209 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.210+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=0U5S53LSWT48 type=del size=57661 2024-03-09T14:33:25.210 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.211+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~OSZV1WGZG7Y6.0 size=1048576 2024-03-09T14:33:25.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.212+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~OSZV1WGZG7Y6.1 size=741122 2024-03-09T14:33:25.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.214+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=OSZV1WGZG7Y6 tag=113FEC8ICIHY type=write size=2838274 2024-03-09T14:33:25.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.215+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=2AU8FAMKH2T2 type=del size=1075181 2024-03-09T14:33:25.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.216+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=TW33YB01Q8WS type=del 2024-03-09T14:33:25.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.217+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=QZYW34M1DVTB type=write size=56232 2024-03-09T14:33:25.218 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.218+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=DH886R53J3CI type=del 2024-03-09T14:33:25.219 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.219+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=GV8D3YYQ2BWQ type=del size=1188388 2024-03-09T14:33:25.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.220+0000 7f586ae3d780 1 < completed write operation key=57OR9DHRPDCZ tag=ZHJ11LY762EQ type=write size=496783 2024-03-09T14:33:25.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.221+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=XAGHEMS0PJSM type=del size=4095809 2024-03-09T14:33:25.222 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.223+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~VN1JEWLVY390.0 size=952074 2024-03-09T14:33:25.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.224+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=VN1JEWLVY390 tag=LMHG091ZRPSA type=write size=2000650 2024-03-09T14:33:25.226 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.226+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~G1QJ5D0CYCW5.0 size=1048576 2024-03-09T14:33:25.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.227+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~G1QJ5D0CYCW5.1 size=802542 2024-03-09T14:33:25.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.227+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=G1QJ5D0CYCW5 tag=2URKI1AP2IKO type=write size=2899694 2024-03-09T14:33:25.228 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.229+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=PYFZZ4UH85N9 type=del 2024-03-09T14:33:25.229 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.230+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=9GQA6WQIV29I type=del size=1135746 2024-03-09T14:33:25.230 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.231+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~MQFW09K7QQG5.0 size=1048576 2024-03-09T14:33:25.231 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.232+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~MQFW09K7QQG5.1 size=1020467 2024-03-09T14:33:25.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.234+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=MQFW09K7QQG5 tag=SPBBTQQ5WJOS type=write size=3117619 2024-03-09T14:33:25.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.236+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~M2JN1HOR20VH.0 size=351384 2024-03-09T14:33:25.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.236+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=M2JN1HOR20VH tag=0X01L7GA6Z18 type=write size=1399960 2024-03-09T14:33:25.236 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.237+0000 7f586ae3d780 -1 < failed to complete operation key=P3OUIQNAK1TC tag=8PPVHC59FDCA type=del size=3512455: (22) Invalid argument 2024-03-09T14:33:25.239 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.240+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~7RI17A15XMHE.0 size=1048576 2024-03-09T14:33:25.240 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.241+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~7RI17A15XMHE.1 size=704989 2024-03-09T14:33:25.240 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.241+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=7RI17A15XMHE tag=6X12N06EX53S type=write size=2802141 2024-03-09T14:33:25.242 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.243+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=R8W4E6JNPHHY type=del 2024-03-09T14:33:25.243 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.244+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=H937A7NJJEUU type=del size=1645503 2024-03-09T14:33:25.244 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.245+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=8ZAEYJ6L0RZE type=del 2024-03-09T14:33:25.246 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.247+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~GG2JZFNPKMZ1.0 size=1048576 2024-03-09T14:33:25.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.248+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~GG2JZFNPKMZ1.1 size=77839 2024-03-09T14:33:25.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.248+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=GG2JZFNPKMZ1 tag=GR55WZSV2EGE type=write size=2174991 2024-03-09T14:33:25.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.249+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=7CPCG2GQHGWS type=del 2024-03-09T14:33:25.250 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.250+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=8XWQ4JLZ1Z1S type=write size=656041 2024-03-09T14:33:25.251 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.251+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=7HMKL26WG18X type=del 2024-03-09T14:33:25.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.254+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~29YP28S4PQTD.0 size=1048576 2024-03-09T14:33:25.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.255+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~29YP28S4PQTD.1 size=635192 2024-03-09T14:33:25.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.255+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=29YP28S4PQTD tag=61N5KTA22IVO type=write size=2732344 2024-03-09T14:33:25.256 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.256+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=B3IYJ74B94FG type=del 2024-03-09T14:33:25.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.258+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~MOLXAU03GOT9.0 size=37172 2024-03-09T14:33:25.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.258+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=MOLXAU03GOT9 tag=U375QPPE21U2 type=write size=1085748 2024-03-09T14:33:25.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.260+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~T0W2PMB05TIP.0 size=1048576 2024-03-09T14:33:25.260 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.261+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~T0W2PMB05TIP.1 size=1048576 2024-03-09T14:33:25.260 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.261+0000 7f586ae3d780 1 < canceled part key=_multipart_9ZPCSBP3P58P.2~T0W2PMB05TIP.2 size=745323 2024-03-09T14:33:25.262 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.263+0000 7f586ae3d780 1 < canceled multipart upload key=9ZPCSBP3P58P upload=T0W2PMB05TIP tag=N2STQA5WM9KL type=write size=3891051 2024-03-09T14:33:25.263 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.264+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=T5DNDPB18JB1 type=del size=3892951 2024-03-09T14:33:25.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.265+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=J28JUAJFT6W3 type=del 2024-03-09T14:33:25.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.267+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~7GXXFB7IHKHM.0 size=1048576 2024-03-09T14:33:25.268 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.268+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~7GXXFB7IHKHM.1 size=1048576 2024-03-09T14:33:25.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.269+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~7GXXFB7IHKHM.2 size=226304 2024-03-09T14:33:25.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.269+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=7GXXFB7IHKHM tag=LWUWYGZLW699 type=write size=3372032 2024-03-09T14:33:25.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.271+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=0U5S53LSWT48 type=del 2024-03-09T14:33:25.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.273+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~NEIZRGDDV5O9.0 size=1048576 2024-03-09T14:33:25.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.274+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~NEIZRGDDV5O9.1 size=1048576 2024-03-09T14:33:25.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.275+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~NEIZRGDDV5O9.2 size=265038 2024-03-09T14:33:25.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.275+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=NEIZRGDDV5O9 tag=GJYOPSN1RKYA type=write size=3410766 2024-03-09T14:33:25.276 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.276+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=2AU8FAMKH2T2 type=del 2024-03-09T14:33:25.277 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.278+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=SZDHJXWLC20A type=del size=3983389 2024-03-09T14:33:25.279 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.279+0000 7f586ae3d780 1 < completed write operation key=CAISZZZSOD34 tag=QZYW34M1DVTB type=write size=56232 2024-03-09T14:33:25.280 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.280+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=YHKAH2ZRP1H6 type=del size=2682678 2024-03-09T14:33:25.281 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.282+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=GV8D3YYQ2BWQ type=del 2024-03-09T14:33:25.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.284+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~1LQNMH7PX9PO.0 size=573032 2024-03-09T14:33:25.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.284+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=1LQNMH7PX9PO tag=GMO8FAA9LPQ4 type=write size=1621608 2024-03-09T14:33:25.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.286+0000 7f586ae3d780 1 < suggested remove operation key=04E9KDGUC274 tag=XAGHEMS0PJSM type=del 2024-03-09T14:33:25.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.289+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~HQJ89YJ61E3H.0 size=1048576 2024-03-09T14:33:25.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.290+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~HQJ89YJ61E3H.1 size=173651 2024-03-09T14:33:25.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.290+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=HQJ89YJ61E3H tag=OMNI2OJEEAOO type=write size=2270803 2024-03-09T14:33:25.290 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.291+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~G1QJ5D0CYCW5.0 size=1048576 2024-03-09T14:33:25.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.292+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~G1QJ5D0CYCW5.1 size=802542 2024-03-09T14:33:25.294 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.294+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=G1QJ5D0CYCW5 tag=2URKI1AP2IKO type=write size=2899694 2024-03-09T14:33:25.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.297+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~33KGIIA527Q9.0 size=1048576 2024-03-09T14:33:25.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.298+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~33KGIIA527Q9.1 size=429738 2024-03-09T14:33:25.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.298+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=33KGIIA527Q9 tag=UY9VCLLSIEOO type=write size=2526890 2024-03-09T14:33:25.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.299+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=9GQA6WQIV29I type=del 2024-03-09T14:33:25.300 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.301+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=GN8ZR0QI5V2C type=del size=3634239 2024-03-09T14:33:25.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.302+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~M2JN1HOR20VH.0 size=351384 2024-03-09T14:33:25.304 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.304+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=M2JN1HOR20VH tag=0X01L7GA6Z18 type=write size=1399960 2024-03-09T14:33:25.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.305+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=OW2UVFTTN85T type=del size=1340374 2024-03-09T14:33:25.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.307+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~7RI17A15XMHE.0 size=1048576 2024-03-09T14:33:25.308 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.308+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~7RI17A15XMHE.1 size=704989 2024-03-09T14:33:25.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.310+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=7RI17A15XMHE tag=6X12N06EX53S type=write size=2802141 2024-03-09T14:33:25.311 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.311+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=0A504WGN30J3 type=del size=1718129 2024-03-09T14:33:25.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.314+0000 7f586ae3d780 1 < suggested remove operation key=78Y2ZM3W6EUC tag=H937A7NJJEUU type=del 2024-03-09T14:33:25.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.316+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~15D3SRP8KX39.0 size=1013167 2024-03-09T14:33:25.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.316+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=15D3SRP8KX39 tag=21NBCW4570TQ type=write size=2061743 2024-03-09T14:33:25.317 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.317+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~GG2JZFNPKMZ1.0 size=1048576 2024-03-09T14:33:25.317 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.318+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~GG2JZFNPKMZ1.1 size=77839 2024-03-09T14:33:25.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.320+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=GG2JZFNPKMZ1 tag=GR55WZSV2EGE type=write size=2174991 2024-03-09T14:33:25.321 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.321+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=ZYI77NVV253Z type=del size=4186842 2024-03-09T14:33:25.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.323+0000 7f586ae3d780 1 < completed write operation key=O5L6RC16RS8E tag=8XWQ4JLZ1Z1S type=write size=656041 2024-03-09T14:33:25.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.324+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=CULOR5Z1APA3 type=del size=2307800 2024-03-09T14:33:25.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.325+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~29YP28S4PQTD.0 size=1048576 2024-03-09T14:33:25.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.325+0000 7f586ae3d780 1 < canceled part key=_multipart_UAYZ55UT77VE.2~29YP28S4PQTD.1 size=635192 2024-03-09T14:33:25.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.327+0000 7f586ae3d780 1 < canceled multipart upload key=UAYZ55UT77VE upload=29YP28S4PQTD tag=61N5KTA22IVO type=write size=2732344 2024-03-09T14:33:25.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.328+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=FJ36G3IDFU18 type=del size=3891766 2024-03-09T14:33:25.329 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.329+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~MOLXAU03GOT9.0 size=37172 2024-03-09T14:33:25.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.331+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=MOLXAU03GOT9 tag=U375QPPE21U2 type=write size=1085748 2024-03-09T14:33:25.333 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.334+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~A3380TRYZR8K.0 size=1048576 2024-03-09T14:33:25.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.334+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~A3380TRYZR8K.1 size=486105 2024-03-09T14:33:25.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.334+0000 7f586ae3d780 1 > prepared multipart upload key=C1UGQOQ6AE1E upload=A3380TRYZR8K tag=KYDPCCM7M6ZW type=write size=2583257 2024-03-09T14:33:25.336 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.337+0000 7f586ae3d780 1 < suggested update operation key=BHSYRD3IEJWW tag=T5DNDPB18JB1 type=del size=3892951 2024-03-09T14:33:25.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.339+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~T31EN3LCR4P8.0 size=1048576 2024-03-09T14:33:25.339 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.340+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~T31EN3LCR4P8.1 size=1048576 2024-03-09T14:33:25.341 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.341+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~T31EN3LCR4P8.2 size=111935 2024-03-09T14:33:25.341 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.341+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=T31EN3LCR4P8 tag=QA608GAZMCWY type=write size=3257663 2024-03-09T14:33:25.342 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.342+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~7GXXFB7IHKHM.0 size=1048576 2024-03-09T14:33:25.343 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.343+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~7GXXFB7IHKHM.1 size=1048576 2024-03-09T14:33:25.344 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.344+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~7GXXFB7IHKHM.2 size=226304 2024-03-09T14:33:25.346 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.346+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=7GXXFB7IHKHM tag=LWUWYGZLW699 type=write size=3372032 2024-03-09T14:33:25.347 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.348+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=GU38FIDFHWJU type=del size=3613454 2024-03-09T14:33:25.348 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.349+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~NEIZRGDDV5O9.0 size=1048576 2024-03-09T14:33:25.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.350+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~NEIZRGDDV5O9.1 size=1048576 2024-03-09T14:33:25.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.351+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~NEIZRGDDV5O9.2 size=265038 2024-03-09T14:33:25.353 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.354+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=NEIZRGDDV5O9 tag=GJYOPSN1RKYA type=write size=3410766 2024-03-09T14:33:25.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.357+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=3M7RR95763OA type=del size=3623154 2024-03-09T14:33:25.357 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.358+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=SZDHJXWLC20A type=del 2024-03-09T14:33:25.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.360+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~7MWYDH56YR31.0 size=1048576 2024-03-09T14:33:25.360 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.361+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~7MWYDH56YR31.1 size=1037228 2024-03-09T14:33:25.360 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.361+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=7MWYDH56YR31 tag=T1YXSAUTROV4 type=write size=3134380 2024-03-09T14:33:25.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.363+0000 7f586ae3d780 1 < suggested remove operation key=O5L6RC16RS8E tag=YHKAH2ZRP1H6 type=del 2024-03-09T14:33:25.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.364+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=9C9PCHMIUN6M type=del size=195502 2024-03-09T14:33:25.365 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.365+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~1LQNMH7PX9PO.0 size=573032 2024-03-09T14:33:25.366 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.367+0000 7f586ae3d780 1 < completed multipart upload key=UAYZ55UT77VE upload=1LQNMH7PX9PO tag=GMO8FAA9LPQ4 type=write size=1621608 2024-03-09T14:33:25.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.369+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~UHPV7DSV39XY.0 size=1048576 2024-03-09T14:33:25.369 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.370+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~UHPV7DSV39XY.1 size=1048576 2024-03-09T14:33:25.370 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.371+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~UHPV7DSV39XY.2 size=850589 2024-03-09T14:33:25.370 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.371+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=UHPV7DSV39XY tag=5N5NUK3XW04H type=write size=3996317 2024-03-09T14:33:25.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.372+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~HQJ89YJ61E3H.0 size=1048576 2024-03-09T14:33:25.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.373+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~HQJ89YJ61E3H.1 size=173651 2024-03-09T14:33:25.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.375+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=HQJ89YJ61E3H tag=OMNI2OJEEAOO type=write size=2270803 2024-03-09T14:33:25.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.376+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=A59WMP67JMXV type=del size=375298 2024-03-09T14:33:25.376 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.377+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~33KGIIA527Q9.0 size=1048576 2024-03-09T14:33:25.377 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.378+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~33KGIIA527Q9.1 size=429738 2024-03-09T14:33:25.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.380+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=33KGIIA527Q9 tag=UY9VCLLSIEOO type=write size=2526890 2024-03-09T14:33:25.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.382+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~CAU0S5YTXXYG.0 size=1048576 2024-03-09T14:33:25.382 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.383+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~CAU0S5YTXXYG.1 size=800457 2024-03-09T14:33:25.382 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.383+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=CAU0S5YTXXYG tag=DX9N3QXB42AP type=write size=2897609 2024-03-09T14:33:25.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.384+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=GN8ZR0QI5V2C type=del 2024-03-09T14:33:25.385 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.386+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~SPQCFJGCZ182.0 size=871062 2024-03-09T14:33:25.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.386+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=SPQCFJGCZ182 tag=94DAKUFDWOHI type=write size=1919638 2024-03-09T14:33:25.388 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.388+0000 7f586ae3d780 1 < suggested update operation key=DJH53FNVMLGY tag=OW2UVFTTN85T type=del size=1340374 2024-03-09T14:33:25.389 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.390+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=I6TNGPL6E48G type=del size=1925791 2024-03-09T14:33:25.390 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.391+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=0A504WGN30J3 type=del 2024-03-09T14:33:25.391 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.392+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=CPP58NR0ZQ9A type=write size=631582 2024-03-09T14:33:25.393 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.393+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~15D3SRP8KX39.0 size=1013167 2024-03-09T14:33:25.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.395+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=15D3SRP8KX39 tag=21NBCW4570TQ type=write size=2061743 2024-03-09T14:33:25.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.397+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~K3GSCMWNPPCO.0 size=1048576 2024-03-09T14:33:25.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.398+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~K3GSCMWNPPCO.1 size=1048576 2024-03-09T14:33:25.399 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.399+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~K3GSCMWNPPCO.2 size=354120 2024-03-09T14:33:25.399 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.399+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=K3GSCMWNPPCO tag=NTB1ENXDDHTC type=write size=3499848 2024-03-09T14:33:25.400 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.400+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=ZYI77NVV253Z type=del 2024-03-09T14:33:25.402 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.403+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~ZMTO5TPPXN35.0 size=1048576 2024-03-09T14:33:25.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.404+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~ZMTO5TPPXN35.1 size=467565 2024-03-09T14:33:25.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.404+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=ZMTO5TPPXN35 tag=Z67QLGYIDO3K type=write size=2564717 2024-03-09T14:33:25.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.405+0000 7f586ae3d780 1 < canceled operation key=509F17DT0C4I tag=CULOR5Z1APA3 type=del size=2307800 2024-03-09T14:33:25.405 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.406+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=5U3ZCUDJGELX type=del size=1759422 2024-03-09T14:33:25.407 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.407+0000 7f586ae3d780 -1 < failed to complete operation key=DJH53FNVMLGY tag=FJ36G3IDFU18 type=del size=3891766: (22) Invalid argument 2024-03-09T14:33:25.408 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.408+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=RG0Z56OA0QU2 type=del size=1859137 2024-03-09T14:33:25.409 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.410+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~A3380TRYZR8K.0 size=1048576 2024-03-09T14:33:25.410 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.411+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~A3380TRYZR8K.1 size=486105 2024-03-09T14:33:25.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.413+0000 7f586ae3d780 1 < completed multipart upload key=C1UGQOQ6AE1E upload=A3380TRYZR8K tag=KYDPCCM7M6ZW type=write size=2583257 2024-03-09T14:33:25.414 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.415+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~VWO37EFODAJ3.0 size=1048576 2024-03-09T14:33:25.415 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.416+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~VWO37EFODAJ3.1 size=91390 2024-03-09T14:33:25.415 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.416+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=VWO37EFODAJ3 tag=W07MVAQ2UGIG type=write size=2188542 2024-03-09T14:33:25.417 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.417+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~T31EN3LCR4P8.0 size=1048576 2024-03-09T14:33:25.418 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.418+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~T31EN3LCR4P8.1 size=1048576 2024-03-09T14:33:25.419 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.419+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~T31EN3LCR4P8.2 size=111935 2024-03-09T14:33:25.421 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.421+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=T31EN3LCR4P8 tag=QA608GAZMCWY type=write size=3257663 2024-03-09T14:33:25.422 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.422+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=LCAI87F8LBLR type=del size=18208 2024-03-09T14:33:25.423 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.424+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=GU38FIDFHWJU type=del 2024-03-09T14:33:25.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.425+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=HLN8D63XLJDO type=del size=3794784 2024-03-09T14:33:25.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.426+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=3M7RR95763OA type=del 2024-03-09T14:33:25.428 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.428+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~8JN1MT272G3C.0 size=1048576 2024-03-09T14:33:25.429 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.429+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~8JN1MT272G3C.1 size=1048576 2024-03-09T14:33:25.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.431+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~8JN1MT272G3C.2 size=906618 2024-03-09T14:33:25.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.431+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=8JN1MT272G3C tag=613U0NM42ZSK type=write size=4052346 2024-03-09T14:33:25.431 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.432+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~7MWYDH56YR31.0 size=1048576 2024-03-09T14:33:25.432 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.433+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~7MWYDH56YR31.1 size=1037228 2024-03-09T14:33:25.434 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.435+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=7MWYDH56YR31 tag=T1YXSAUTROV4 type=write size=3134380 2024-03-09T14:33:25.436 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.436+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=OVIEZEAR09GQ type=del size=2074030 2024-03-09T14:33:25.437 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.437+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=9C9PCHMIUN6M type=del 2024-03-09T14:33:25.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.440+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~T9QMFT9AE9WA.0 size=1048576 2024-03-09T14:33:25.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.441+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~T9QMFT9AE9WA.1 size=770806 2024-03-09T14:33:25.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.441+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=T9QMFT9AE9WA tag=UCM8UUO5M71Z type=write size=2867958 2024-03-09T14:33:25.441 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.442+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~UHPV7DSV39XY.0 size=1048576 2024-03-09T14:33:25.442 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.443+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~UHPV7DSV39XY.1 size=1048576 2024-03-09T14:33:25.443 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.444+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~UHPV7DSV39XY.2 size=850589 2024-03-09T14:33:25.445 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.446+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=UHPV7DSV39XY tag=5N5NUK3XW04H type=write size=3996317 2024-03-09T14:33:25.446 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.447+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=TF5RULB26O29 type=del size=2965464 2024-03-09T14:33:25.448 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.448+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=A59WMP67JMXV type=del 2024-03-09T14:33:25.449 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.450+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=W3W4XY642302 type=del size=772639 2024-03-09T14:33:25.450 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.451+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~CAU0S5YTXXYG.0 size=1048576 2024-03-09T14:33:25.451 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.452+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~CAU0S5YTXXYG.1 size=800457 2024-03-09T14:33:25.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.454+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=CAU0S5YTXXYG tag=DX9N3QXB42AP type=write size=2897609 2024-03-09T14:33:25.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.455+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=WB286P22Q6Y0 type=write size=489273 2024-03-09T14:33:25.456 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.456+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~SPQCFJGCZ182.0 size=871062 2024-03-09T14:33:25.458 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.458+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=SPQCFJGCZ182 tag=94DAKUFDWOHI type=write size=1919638 2024-03-09T14:33:25.459 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.459+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=EJH9YG62NKZN type=del size=1517008 2024-03-09T14:33:25.460 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.461+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=I6TNGPL6E48G type=del 2024-03-09T14:33:25.461 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.462+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=T6AH0MENLFZ7 type=del size=351620 2024-03-09T14:33:25.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.465+0000 7f586ae3d780 1 < suggested remove operation key=CAISZZZSOD34 tag=CPP58NR0ZQ9A type=write 2024-03-09T14:33:25.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.467+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=9323BZ8WUL5E type=del size=1251360 2024-03-09T14:33:25.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.468+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~K3GSCMWNPPCO.0 size=1048576 2024-03-09T14:33:25.468 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.469+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~K3GSCMWNPPCO.1 size=1048576 2024-03-09T14:33:25.468 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.469+0000 7f586ae3d780 1 < canceled part key=_multipart_39ZIGOC6JZ1R.2~K3GSCMWNPPCO.2 size=354120 2024-03-09T14:33:25.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.471+0000 7f586ae3d780 1 < canceled multipart upload key=39ZIGOC6JZ1R upload=K3GSCMWNPPCO tag=NTB1ENXDDHTC type=write size=3499848 2024-03-09T14:33:25.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.472+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=V6LB7IJ13C3T type=del size=1740673 2024-03-09T14:33:25.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.473+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~ZMTO5TPPXN35.0 size=1048576 2024-03-09T14:33:25.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.474+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~ZMTO5TPPXN35.1 size=467565 2024-03-09T14:33:25.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.476+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=ZMTO5TPPXN35 tag=Z67QLGYIDO3K type=write size=2564717 2024-03-09T14:33:25.477 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.477+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=G91UXVC91CEK type=del size=3399069 2024-03-09T14:33:25.478 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.479+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=5U3ZCUDJGELX type=del 2024-03-09T14:33:25.480 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.481+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~2JZ4GTKULEUL.0 size=897023 2024-03-09T14:33:25.480 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.481+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=2JZ4GTKULEUL tag=HN1YRQBCZKA7 type=write size=1945599 2024-03-09T14:33:25.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.482+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=RG0Z56OA0QU2 type=del 2024-03-09T14:33:25.482 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.483+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=DYHJMFB1GKMX type=del size=2828169 2024-03-09T14:33:25.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.484+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~VWO37EFODAJ3.0 size=1048576 2024-03-09T14:33:25.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.485+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~VWO37EFODAJ3.1 size=91390 2024-03-09T14:33:25.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.487+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=VWO37EFODAJ3 tag=W07MVAQ2UGIG type=write size=2188542 2024-03-09T14:33:25.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.488+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=AVQLFKQZGKIZ type=del size=2363427 2024-03-09T14:33:25.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.489+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=LCAI87F8LBLR type=del 2024-03-09T14:33:25.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.492+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~H1A1J4BJ6M15.0 size=1048576 2024-03-09T14:33:25.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.492+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~H1A1J4BJ6M15.1 size=627772 2024-03-09T14:33:25.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.492+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=H1A1J4BJ6M15 tag=UM7RJIN7XGSQ type=write size=2724924 2024-03-09T14:33:25.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.494+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=HLN8D63XLJDO type=del 2024-03-09T14:33:25.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.496+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~8VKNLKQ7ET4L.0 size=1048576 2024-03-09T14:33:25.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.497+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~8VKNLKQ7ET4L.1 size=638888 2024-03-09T14:33:25.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.497+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=8VKNLKQ7ET4L tag=1J9NEMQ7DEPT type=write size=2736040 2024-03-09T14:33:25.497 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.498+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~8JN1MT272G3C.0 size=1048576 2024-03-09T14:33:25.498 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.499+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~8JN1MT272G3C.1 size=1048576 2024-03-09T14:33:25.499 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.500+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~8JN1MT272G3C.2 size=906618 2024-03-09T14:33:25.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.502+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=8JN1MT272G3C tag=613U0NM42ZSK type=write size=4052346 2024-03-09T14:33:25.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.503+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=YPQX50M13HUJ type=del size=3650610 2024-03-09T14:33:25.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.504+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=OVIEZEAR09GQ type=del 2024-03-09T14:33:25.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.506+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~L6ASDU49WMT1.0 size=301334 2024-03-09T14:33:25.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.506+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=L6ASDU49WMT1 tag=NCTIHBC1MUBD type=write size=1349910 2024-03-09T14:33:25.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.507+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~T9QMFT9AE9WA.0 size=1048576 2024-03-09T14:33:25.508 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.508+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~T9QMFT9AE9WA.1 size=770806 2024-03-09T14:33:25.509 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.510+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=T9QMFT9AE9WA tag=UCM8UUO5M71Z type=write size=2867958 2024-03-09T14:33:25.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.511+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=DYXLV0DKN3KT type=del size=423601 2024-03-09T14:33:25.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.513+0000 7f586ae3d780 1 < canceled operation key=WNVN3EOUUBGR tag=TF5RULB26O29 type=del size=2965464 2024-03-09T14:33:25.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.514+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=0RRT3TRU35BR type=write size=88255 2024-03-09T14:33:25.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.515+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=W3W4XY642302 type=del 2024-03-09T14:33:25.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.517+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~5JFE389XWAXB.0 size=1048576 2024-03-09T14:33:25.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.518+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~5JFE389XWAXB.1 size=919883 2024-03-09T14:33:25.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.518+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=5JFE389XWAXB tag=7H3WL4P3SPE5 type=write size=3017035 2024-03-09T14:33:25.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.519+0000 7f586ae3d780 1 < completed write operation key=78Y2ZM3W6EUC tag=WB286P22Q6Y0 type=write size=489273 2024-03-09T14:33:25.521 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.521+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~I5TWC0NZ3EFG.0 size=1048576 2024-03-09T14:33:25.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.522+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~I5TWC0NZ3EFG.1 size=576093 2024-03-09T14:33:25.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.522+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=I5TWC0NZ3EFG tag=BV817PKF3RZL type=write size=2673245 2024-03-09T14:33:25.523 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.524+0000 7f586ae3d780 1 < canceled operation key=5PERWGS0GOJU tag=EJH9YG62NKZN type=del size=1517008 2024-03-09T14:33:25.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.525+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=WEGU1LBLP27S type=del size=3115982 2024-03-09T14:33:25.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.526+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=T6AH0MENLFZ7 type=del 2024-03-09T14:33:25.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.528+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~R6L5NUAGPLNK.0 size=1048576 2024-03-09T14:33:25.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.530+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~R6L5NUAGPLNK.1 size=988631 2024-03-09T14:33:25.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.530+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=R6L5NUAGPLNK tag=SHFPJYDW0Q9D type=write size=3085783 2024-03-09T14:33:25.530 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.531+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=9323BZ8WUL5E type=del 2024-03-09T14:33:25.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.532+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=AH1FEIRLWHH8 type=del size=2796921 2024-03-09T14:33:25.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.533+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=V6LB7IJ13C3T type=del 2024-03-09T14:33:25.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.535+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=FR89SKE07LA0 type=del size=56811 2024-03-09T14:33:25.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.537+0000 7f586ae3d780 1 < suggested remove operation key=509F17DT0C4I tag=G91UXVC91CEK type=del 2024-03-09T14:33:25.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.538+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=JQL9IDFL6XWX type=del size=2556177 2024-03-09T14:33:25.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.539+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~2JZ4GTKULEUL.0 size=897023 2024-03-09T14:33:25.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.541+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=2JZ4GTKULEUL tag=HN1YRQBCZKA7 type=write size=1945599 2024-03-09T14:33:25.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.543+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~SCPP4R3EZ791.0 size=1048576 2024-03-09T14:33:25.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.544+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~SCPP4R3EZ791.1 size=1048576 2024-03-09T14:33:25.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.545+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~SCPP4R3EZ791.2 size=336103 2024-03-09T14:33:25.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.545+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=SCPP4R3EZ791 tag=IX0FJL3QYQ2T type=write size=3481831 2024-03-09T14:33:25.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.546+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=DYHJMFB1GKMX type=del 2024-03-09T14:33:25.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.547+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=57YKP6UFH6FX type=del size=120218 2024-03-09T14:33:25.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.548+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=AVQLFKQZGKIZ type=del 2024-03-09T14:33:25.550 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.550+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~XLW52ZTJWQXK.0 size=151398 2024-03-09T14:33:25.550 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.550+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=XLW52ZTJWQXK tag=VDJ1D5ZJCUNA type=write size=1199974 2024-03-09T14:33:25.550 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.551+0000 7f586ae3d780 1 < canceled part key=_multipart_6YWLPUULN5SY.2~H1A1J4BJ6M15.0 size=1048576 2024-03-09T14:33:25.550 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.551+0000 7f586ae3d780 1 < canceled part key=_multipart_6YWLPUULN5SY.2~H1A1J4BJ6M15.1 size=627772 2024-03-09T14:33:25.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.552+0000 7f586ae3d780 1 < canceled multipart upload key=6YWLPUULN5SY upload=H1A1J4BJ6M15 tag=UM7RJIN7XGSQ type=write size=2724924 2024-03-09T14:33:25.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.554+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~856P7HOT5BKL.0 size=683901 2024-03-09T14:33:25.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.554+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=856P7HOT5BKL tag=59P7NIAQ8EYZ type=write size=1732477 2024-03-09T14:33:25.555 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.556+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~8VKNLKQ7ET4L.0 size=1048576 2024-03-09T14:33:25.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.557+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~8VKNLKQ7ET4L.1 size=638888 2024-03-09T14:33:25.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.558+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=8VKNLKQ7ET4L tag=1J9NEMQ7DEPT type=write size=2736040 2024-03-09T14:33:25.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.559+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=IIONA9YO39OJ type=del size=3517152 2024-03-09T14:33:25.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.561+0000 7f586ae3d780 1 < canceled operation key=0JDF7910RACF tag=YPQX50M13HUJ type=del size=3650610 2024-03-09T14:33:25.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.562+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=9LVYCWMYGEM4 type=del size=268459 2024-03-09T14:33:25.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.563+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~L6ASDU49WMT1.0 size=301334 2024-03-09T14:33:25.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.565+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=L6ASDU49WMT1 tag=NCTIHBC1MUBD type=write size=1349910 2024-03-09T14:33:25.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.566+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=Y3G20IOF3TP0 type=write size=440170 2024-03-09T14:33:25.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.567+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=DYXLV0DKN3KT type=del 2024-03-09T14:33:25.568 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.568+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=H0T55UQW0CQ5 type=del size=2034493 2024-03-09T14:33:25.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.569+0000 7f586ae3d780 1 < completed write operation key=57OR9DHRPDCZ tag=0RRT3TRU35BR type=write size=88255 2024-03-09T14:33:25.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.571+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=R2VTIZ68CICI type=write size=1001551 2024-03-09T14:33:25.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.572+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~5JFE389XWAXB.0 size=1048576 2024-03-09T14:33:25.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.573+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~5JFE389XWAXB.1 size=919883 2024-03-09T14:33:25.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.576+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=5JFE389XWAXB tag=7H3WL4P3SPE5 type=write size=3017035 2024-03-09T14:33:25.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.577+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=SKFMF3J8ZTEW type=del size=2998936 2024-03-09T14:33:25.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.578+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~I5TWC0NZ3EFG.0 size=1048576 2024-03-09T14:33:25.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.579+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~I5TWC0NZ3EFG.1 size=576093 2024-03-09T14:33:25.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.581+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=I5TWC0NZ3EFG tag=BV817PKF3RZL type=write size=2673245 2024-03-09T14:33:25.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.582+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=8PXE6RJ9WIF0 type=write size=562905 2024-03-09T14:33:25.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.585+0000 7f586ae3d780 1 < suggested remove operation key=C1UGQOQ6AE1E tag=WEGU1LBLP27S type=del 2024-03-09T14:33:25.585 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.586+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=2TD6EZYQ0B4E type=del size=57615 2024-03-09T14:33:25.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.587+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~R6L5NUAGPLNK.0 size=1048576 2024-03-09T14:33:25.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.588+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~R6L5NUAGPLNK.1 size=988631 2024-03-09T14:33:25.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.590+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=R6L5NUAGPLNK tag=SHFPJYDW0Q9D type=write size=3085783 2024-03-09T14:33:25.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.591+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=1N4WYODRUGNO type=del size=2896786 2024-03-09T14:33:25.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.592+0000 7f586ae3d780 1 < canceled operation key=UO072H74SHLP tag=AH1FEIRLWHH8 type=del size=2796921 2024-03-09T14:33:25.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.593+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=ZECG443MS5XE type=del size=1301392 2024-03-09T14:33:25.593 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.594+0000 7f586ae3d780 -1 < failed to complete operation key=C1UGQOQ6AE1E tag=FR89SKE07LA0 type=del size=56811: (22) Invalid argument 2024-03-09T14:33:25.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.596+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~GBIFESP2VRBP.0 size=948109 2024-03-09T14:33:25.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.596+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=GBIFESP2VRBP tag=IYSGEMM5YDHL type=write size=1996685 2024-03-09T14:33:25.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.598+0000 7f586ae3d780 1 < suggested remove operation key=9ZPCSBP3P58P tag=JQL9IDFL6XWX type=del 2024-03-09T14:33:25.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.600+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~LDRHDFH53SCZ.0 size=1048576 2024-03-09T14:33:25.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.601+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~LDRHDFH53SCZ.1 size=423202 2024-03-09T14:33:25.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.601+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=LDRHDFH53SCZ tag=C236HL0P0ZZH type=write size=2520354 2024-03-09T14:33:25.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.602+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~SCPP4R3EZ791.0 size=1048576 2024-03-09T14:33:25.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.603+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~SCPP4R3EZ791.1 size=1048576 2024-03-09T14:33:25.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.603+0000 7f586ae3d780 1 < canceled part key=_multipart_LRI2GKBGVCWW.2~SCPP4R3EZ791.2 size=336103 2024-03-09T14:33:25.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.605+0000 7f586ae3d780 1 < canceled multipart upload key=LRI2GKBGVCWW upload=SCPP4R3EZ791 tag=IX0FJL3QYQ2T type=write size=3481831 2024-03-09T14:33:25.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.606+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=UDSE9OBNF4KS type=del size=2385011 2024-03-09T14:33:25.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.607+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=57YKP6UFH6FX type=del 2024-03-09T14:33:25.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.610+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~3XKN1GHITE3U.0 size=1048576 2024-03-09T14:33:25.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.611+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~3XKN1GHITE3U.1 size=1048576 2024-03-09T14:33:25.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.612+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~3XKN1GHITE3U.2 size=199718 2024-03-09T14:33:25.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.612+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=3XKN1GHITE3U tag=HMQN8QX1H9U5 type=write size=3345446 2024-03-09T14:33:25.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.613+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~XLW52ZTJWQXK.0 size=151398 2024-03-09T14:33:25.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.615+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=XLW52ZTJWQXK tag=VDJ1D5ZJCUNA type=write size=1199974 2024-03-09T14:33:25.616 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.617+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~Y8FRQIODQA8F.0 size=1048576 2024-03-09T14:33:25.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.618+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~Y8FRQIODQA8F.1 size=1048576 2024-03-09T14:33:25.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.619+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~Y8FRQIODQA8F.2 size=681117 2024-03-09T14:33:25.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.619+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=Y8FRQIODQA8F tag=JB8IAN0HT0TA type=write size=3826845 2024-03-09T14:33:25.619 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.620+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~856P7HOT5BKL.0 size=683901 2024-03-09T14:33:25.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.622+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=856P7HOT5BKL tag=59P7NIAQ8EYZ type=write size=1732477 2024-03-09T14:33:25.623 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.624+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~IDNEMLX0RW26.0 size=247741 2024-03-09T14:33:25.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.624+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=IDNEMLX0RW26 tag=MAHJ2DN6OXPU type=write size=1296317 2024-03-09T14:33:25.625 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.625+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=IIONA9YO39OJ type=del 2024-03-09T14:33:25.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.627+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=3AQ7CET2CK4P type=del size=2105589 2024-03-09T14:33:25.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.628+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=9LVYCWMYGEM4 type=del 2024-03-09T14:33:25.628 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.629+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=LL7MDSKPLC0W type=del size=2739266 2024-03-09T14:33:25.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.630+0000 7f586ae3d780 1 < canceled operation key=XIYWPXSYCT6I tag=Y3G20IOF3TP0 type=write size=440170 2024-03-09T14:33:25.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.632+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~R7T5N0BEC23E.0 size=1048576 2024-03-09T14:33:25.633 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.633+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~R7T5N0BEC23E.1 size=1048576 2024-03-09T14:33:25.634 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.634+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~R7T5N0BEC23E.2 size=1029853 2024-03-09T14:33:25.634 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.634+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=R7T5N0BEC23E tag=CIIEFZHZF1RK type=write size=4175581 2024-03-09T14:33:25.637 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.638+0000 7f586ae3d780 1 < suggested remove operation key=DJH53FNVMLGY tag=H0T55UQW0CQ5 type=del 2024-03-09T14:33:25.638 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.639+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=B5YYLV1WRUJ1 type=del size=1981226 2024-03-09T14:33:25.639 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.640+0000 7f586ae3d780 1 < completed write operation key=W4Q1MWHOQ4Y1 tag=R2VTIZ68CICI type=write size=1001551 2024-03-09T14:33:25.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.641+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=B7ISIETT01D2 type=del size=3547394 2024-03-09T14:33:25.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.642+0000 7f586ae3d780 1 < canceled operation key=G2BIOBESOIK9 tag=SKFMF3J8ZTEW type=del size=2998936 2024-03-09T14:33:25.643 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.643+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=NO3FQSD48Z4J type=write size=689809 2024-03-09T14:33:25.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.644+0000 7f586ae3d780 1 < completed write operation key=UAYZ55UT77VE tag=8PXE6RJ9WIF0 type=write size=562905 2024-03-09T14:33:25.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.646+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=TO7V7Q92897D type=del size=2884811 2024-03-09T14:33:25.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.648+0000 7f586ae3d780 1 < suggested update operation key=78Y2ZM3W6EUC tag=2TD6EZYQ0B4E type=del size=57615 2024-03-09T14:33:25.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.649+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=7TODTMD8FMVS type=del size=2881703 2024-03-09T14:33:25.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.650+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=1N4WYODRUGNO type=del 2024-03-09T14:33:25.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.651+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=SOJE8PO6ZO6S type=del size=50323 2024-03-09T14:33:25.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.653+0000 7f586ae3d780 1 < suggested remove operation key=WNVN3EOUUBGR tag=ZECG443MS5XE type=del 2024-03-09T14:33:25.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.656+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~1WQ10H71CI7K.0 size=1048576 2024-03-09T14:33:25.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.656+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~1WQ10H71CI7K.1 size=1048576 2024-03-09T14:33:25.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.657+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~1WQ10H71CI7K.2 size=11430 2024-03-09T14:33:25.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.657+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=1WQ10H71CI7K tag=H0Q6058T4YI4 type=write size=3157158 2024-03-09T14:33:25.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.658+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~GBIFESP2VRBP.0 size=948109 2024-03-09T14:33:25.660 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.660+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=GBIFESP2VRBP tag=IYSGEMM5YDHL type=write size=1996685 2024-03-09T14:33:25.661 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.661+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=3JO0NUCHCW48 type=del size=2404545 2024-03-09T14:33:25.662 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.663+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~LDRHDFH53SCZ.0 size=1048576 2024-03-09T14:33:25.663 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.664+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~LDRHDFH53SCZ.1 size=423202 2024-03-09T14:33:25.665 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.665+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=LDRHDFH53SCZ tag=C236HL0P0ZZH type=write size=2520354 2024-03-09T14:33:25.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.666+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=6F9EVICR9QPN type=del size=2084643 2024-03-09T14:33:25.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.668+0000 7f586ae3d780 1 < canceled operation key=IK528ND96157 tag=UDSE9OBNF4KS type=del size=2385011 2024-03-09T14:33:25.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.669+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=7N6PFKVIYVL2 type=write size=768756 2024-03-09T14:33:25.669 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.670+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~3XKN1GHITE3U.0 size=1048576 2024-03-09T14:33:25.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.671+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~3XKN1GHITE3U.1 size=1048576 2024-03-09T14:33:25.671 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.672+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~3XKN1GHITE3U.2 size=199718 2024-03-09T14:33:25.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.673+0000 7f586ae3d780 1 < completed multipart upload key=IK528ND96157 upload=3XKN1GHITE3U tag=HMQN8QX1H9U5 type=write size=3345446 2024-03-09T14:33:25.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.675+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~YGY86JQGK1LG.0 size=351931 2024-03-09T14:33:25.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.675+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=YGY86JQGK1LG tag=5EG5VWE3JY6D type=write size=1400507 2024-03-09T14:33:25.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.676+0000 7f586ae3d780 1 < canceled part key=_multipart_UAYZ55UT77VE.2~Y8FRQIODQA8F.0 size=1048576 2024-03-09T14:33:25.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.676+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~Y8FRQIODQA8F.1 size=1048576 2024-03-09T14:33:25.677 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.677+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~Y8FRQIODQA8F.2 size=681117 2024-03-09T14:33:25.679 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.679+0000 7f586ae3d780 1 < canceled multipart upload key=UAYZ55UT77VE upload=Y8FRQIODQA8F tag=JB8IAN0HT0TA type=write size=3826845 2024-03-09T14:33:25.680 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.680+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=NYEJONAQIWKD type=del size=1031531 2024-03-09T14:33:25.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.682+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~IDNEMLX0RW26.0 size=247741 2024-03-09T14:33:25.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.684+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=IDNEMLX0RW26 tag=MAHJ2DN6OXPU type=write size=1296317 2024-03-09T14:33:25.685 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.685+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=MX3FJ6GSNWHO type=del size=1458152 2024-03-09T14:33:25.686 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.687+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=3AQ7CET2CK4P type=del 2024-03-09T14:33:25.688 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.689+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~GAKEBMUCDCSD.0 size=1048576 2024-03-09T14:33:25.689 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.689+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~GAKEBMUCDCSD.1 size=40503 2024-03-09T14:33:25.689 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.689+0000 7f586ae3d780 1 > prepared multipart upload key=C1UGQOQ6AE1E upload=GAKEBMUCDCSD tag=8524NJ6E78RQ type=write size=2137655 2024-03-09T14:33:25.690 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.691+0000 7f586ae3d780 1 < canceled operation key=G2BIOBESOIK9 tag=LL7MDSKPLC0W type=del size=2739266 2024-03-09T14:33:25.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.693+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~ONSIA5NVSVGW.0 size=398062 2024-03-09T14:33:25.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.693+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=ONSIA5NVSVGW tag=7U3EJS167CJM type=write size=1446638 2024-03-09T14:33:25.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.694+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~R7T5N0BEC23E.0 size=1048576 2024-03-09T14:33:25.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.695+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~R7T5N0BEC23E.1 size=1048576 2024-03-09T14:33:25.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.696+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~R7T5N0BEC23E.2 size=1029853 2024-03-09T14:33:25.698 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.698+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=R7T5N0BEC23E tag=CIIEFZHZF1RK type=write size=4175581 2024-03-09T14:33:25.699 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.699+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=RVMDI58X04Q1 type=del size=2364352 2024-03-09T14:33:25.700 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.700+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=B5YYLV1WRUJ1 type=del 2024-03-09T14:33:25.701 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.702+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=XPB3R5CP60RK type=write size=512087 2024-03-09T14:33:25.702 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.703+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=B7ISIETT01D2 type=del 2024-03-09T14:33:25.705 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.705+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~E3P341V2RBPG.0 size=1048576 2024-03-09T14:33:25.705 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.706+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~E3P341V2RBPG.1 size=509863 2024-03-09T14:33:25.706 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.706+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=E3P341V2RBPG tag=0RKLMOIUFJN8 type=write size=2607015 2024-03-09T14:33:25.708 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.708+0000 7f586ae3d780 1 < suggested update operation key=CZGAXNJ0GKU0 tag=NO3FQSD48Z4J type=write size=689809 2024-03-09T14:33:25.709 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.709+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=AGUG52GP2ZFU type=del size=4051884 2024-03-09T14:33:25.710 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.710+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=TO7V7Q92897D type=del 2024-03-09T14:33:25.711 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.712+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=1PURL6VS4KGT type=del size=2160845 2024-03-09T14:33:25.712 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.713+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=7TODTMD8FMVS type=del 2024-03-09T14:33:25.714 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.715+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~8EW4OXKC35G1.0 size=757943 2024-03-09T14:33:25.714 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.715+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=8EW4OXKC35G1 tag=U2UUTI9BX05P type=write size=1806519 2024-03-09T14:33:25.716 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.716+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=SOJE8PO6ZO6S type=del 2024-03-09T14:33:25.717 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.718+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=LENQIA8JIR92 type=del size=1708247 2024-03-09T14:33:25.718 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.719+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~1WQ10H71CI7K.0 size=1048576 2024-03-09T14:33:25.719 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.720+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~1WQ10H71CI7K.1 size=1048576 2024-03-09T14:33:25.720 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.721+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~1WQ10H71CI7K.2 size=11430 2024-03-09T14:33:25.722 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.723+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=1WQ10H71CI7K tag=H0Q6058T4YI4 type=write size=3157158 2024-03-09T14:33:25.724 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.724+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=7GQR54Y0TO8R type=del size=2196671 2024-03-09T14:33:25.725 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.725+0000 7f586ae3d780 1 < canceled operation key=6YWLPUULN5SY tag=3JO0NUCHCW48 type=del size=2404545 2024-03-09T14:33:25.726 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.726+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=5MF1WKLQOWLJ type=del size=2762561 2024-03-09T14:33:25.728 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.729+0000 7f586ae3d780 1 < suggested remove operation key=39ZIGOC6JZ1R tag=6F9EVICR9QPN type=del 2024-03-09T14:33:25.729 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.730+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=0LTAWXH1CYH0 type=del size=2994265 2024-03-09T14:33:25.731 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.731+0000 7f586ae3d780 1 < completed write operation key=O5L6RC16RS8E tag=7N6PFKVIYVL2 type=write size=768756 2024-03-09T14:33:25.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.732+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=FQ2QAGD2RSYB type=del size=1621834 2024-03-09T14:33:25.733 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.733+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~YGY86JQGK1LG.0 size=351931 2024-03-09T14:33:25.735 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.735+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=YGY86JQGK1LG tag=5EG5VWE3JY6D type=write size=1400507 2024-03-09T14:33:25.736 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.736+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=KL2A6RZMTFBU type=write size=846423 2024-03-09T14:33:25.737 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.737+0000 7f586ae3d780 1 < canceled operation key=W4Q1MWHOQ4Y1 tag=NYEJONAQIWKD type=del size=1031531 2024-03-09T14:33:25.738 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.738+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=5WE16V849YDG type=del size=741615 2024-03-09T14:33:25.739 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.740+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=MX3FJ6GSNWHO type=del 2024-03-09T14:33:25.741 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.742+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~IIC1ZUEA9S5S.0 size=74249 2024-03-09T14:33:25.741 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.742+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=IIC1ZUEA9S5S tag=TY7N70F4LM0W type=write size=1122825 2024-03-09T14:33:25.742 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.743+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~GAKEBMUCDCSD.0 size=1048576 2024-03-09T14:33:25.743 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.744+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~GAKEBMUCDCSD.1 size=40503 2024-03-09T14:33:25.745 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.746+0000 7f586ae3d780 1 < completed multipart upload key=C1UGQOQ6AE1E upload=GAKEBMUCDCSD tag=8524NJ6E78RQ type=write size=2137655 2024-03-09T14:33:25.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.748+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~U31RBGMCXA8X.0 size=410591 2024-03-09T14:33:25.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.748+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=U31RBGMCXA8X tag=H9KKM10VYC18 type=write size=1459167 2024-03-09T14:33:25.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.749+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~ONSIA5NVSVGW.0 size=398062 2024-03-09T14:33:25.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.751+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=ONSIA5NVSVGW tag=7U3EJS167CJM type=write size=1446638 2024-03-09T14:33:25.752 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.752+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=LKSND8EQ0VHA type=del size=920256 2024-03-09T14:33:25.753 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.753+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=RVMDI58X04Q1 type=del 2024-03-09T14:33:25.754 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.754+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=UGH3SGMWWANS type=del size=2771926 2024-03-09T14:33:25.755 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.755+0000 7f586ae3d780 1 < completed write operation key=LRI2GKBGVCWW tag=XPB3R5CP60RK type=write size=512087 2024-03-09T14:33:25.757 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.757+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~TUGE9C8HAWWF.0 size=503803 2024-03-09T14:33:25.757 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.757+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=TUGE9C8HAWWF tag=GB6SLZDCGB6Y type=write size=1552379 2024-03-09T14:33:25.758 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.759+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~E3P341V2RBPG.0 size=1048576 2024-03-09T14:33:25.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.760+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~E3P341V2RBPG.1 size=509863 2024-03-09T14:33:25.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.762+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=E3P341V2RBPG tag=0RKLMOIUFJN8 type=write size=2607015 2024-03-09T14:33:25.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.763+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=0YCUT6G0L5M2 type=del size=574967 2024-03-09T14:33:25.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.764+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=AGUG52GP2ZFU type=del 2024-03-09T14:33:25.765 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.765+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=NUOOZCYFMSVA type=write size=459851 2024-03-09T14:33:25.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.766+0000 7f586ae3d780 1 < canceled operation key=DJH53FNVMLGY tag=1PURL6VS4KGT type=del size=2160845 2024-03-09T14:33:25.767 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.767+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=SH582ZGS81AS type=del size=3591749 2024-03-09T14:33:25.768 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.769+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~8EW4OXKC35G1.0 size=757943 2024-03-09T14:33:25.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.771+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=8EW4OXKC35G1 tag=U2UUTI9BX05P type=write size=1806519 2024-03-09T14:33:25.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.773+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~DSG08J5RMQYX.0 size=86671 2024-03-09T14:33:25.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.773+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=DSG08J5RMQYX tag=CDJ5XKH65LMC type=write size=1135247 2024-03-09T14:33:25.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.775+0000 7f586ae3d780 1 < suggested update operation key=39ZIGOC6JZ1R tag=LENQIA8JIR92 type=del size=1708247 2024-03-09T14:33:25.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.777+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~593O58Y9RQDH.0 size=1048576 2024-03-09T14:33:25.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.778+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~593O58Y9RQDH.1 size=1048576 2024-03-09T14:33:25.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.779+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~593O58Y9RQDH.2 size=883456 2024-03-09T14:33:25.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.779+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=593O58Y9RQDH tag=T9RZD3EUS4GF type=write size=4029184 2024-03-09T14:33:25.780 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.780+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=7GQR54Y0TO8R type=del 2024-03-09T14:33:25.781 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.781+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=0UC9P2ATVDE2 type=del size=3635265 2024-03-09T14:33:25.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.783+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=5MF1WKLQOWLJ type=del 2024-03-09T14:33:25.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.785+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~AFWYKG3542UI.0 size=1048576 2024-03-09T14:33:25.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.786+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~AFWYKG3542UI.1 size=1048576 2024-03-09T14:33:25.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.787+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~AFWYKG3542UI.2 size=65776 2024-03-09T14:33:25.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.787+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=AFWYKG3542UI tag=LAAE09I7TWY4 type=write size=3211504 2024-03-09T14:33:25.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.788+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=0LTAWXH1CYH0 type=del 2024-03-09T14:33:25.790 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.790+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~J5SRD0WVUC4Z.0 size=1048576 2024-03-09T14:33:25.792 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.792+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~J5SRD0WVUC4Z.1 size=125439 2024-03-09T14:33:25.792 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.792+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=J5SRD0WVUC4Z tag=F5G2D5GCYWF8 type=write size=2222591 2024-03-09T14:33:25.793 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.794+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=FQ2QAGD2RSYB type=del 2024-03-09T14:33:25.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.796+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~SASEVNCRE8O4.0 size=64802 2024-03-09T14:33:25.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.796+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=SASEVNCRE8O4 tag=ZR0ND4HWW2IN type=write size=1113378 2024-03-09T14:33:25.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.797+0000 7f586ae3d780 1 < completed write operation key=UAYZ55UT77VE tag=KL2A6RZMTFBU type=write size=846423 2024-03-09T14:33:25.797 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.798+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=71PSYJQPWC8C type=write size=556145 2024-03-09T14:33:25.800 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.800+0000 7f586ae3d780 1 < suggested update operation key=BHSYRD3IEJWW tag=5WE16V849YDG type=del size=741615 2024-03-09T14:33:25.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.802+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~SO5DRYLTLVME.0 size=1048576 2024-03-09T14:33:25.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.803+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~SO5DRYLTLVME.1 size=1048576 2024-03-09T14:33:25.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.804+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~SO5DRYLTLVME.2 size=1018363 2024-03-09T14:33:25.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.804+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=SO5DRYLTLVME tag=ZLYFM1QIUPE7 type=write size=4164091 2024-03-09T14:33:25.805 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.805+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~IIC1ZUEA9S5S.0 size=74249 2024-03-09T14:33:25.807 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.807+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=IIC1ZUEA9S5S tag=TY7N70F4LM0W type=write size=1122825 2024-03-09T14:33:25.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.809+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~P281C7QOP11L.0 size=1048576 2024-03-09T14:33:25.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.810+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~P281C7QOP11L.1 size=415111 2024-03-09T14:33:25.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.810+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=P281C7QOP11L tag=ONW3BS5EI332 type=write size=2512263 2024-03-09T14:33:25.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.812+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~U31RBGMCXA8X.0 size=410591 2024-03-09T14:33:25.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.814+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=U31RBGMCXA8X tag=H9KKM10VYC18 type=write size=1459167 2024-03-09T14:33:25.815 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.816+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~K2NI1YLREBN9.0 size=1048576 2024-03-09T14:33:25.816 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.817+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~K2NI1YLREBN9.1 size=826177 2024-03-09T14:33:25.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.817+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=K2NI1YLREBN9 tag=YZQCJ25EA8CZ type=write size=2923329 2024-03-09T14:33:25.819 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.820+0000 7f586ae3d780 1 < suggested update operation key=57OR9DHRPDCZ tag=LKSND8EQ0VHA type=del size=920256 2024-03-09T14:33:25.820 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.821+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=EWNJILRDDAT1 type=del size=2075176 2024-03-09T14:33:25.822 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.823+0000 7f586ae3d780 1 < suggested update operation key=39ZIGOC6JZ1R tag=UGH3SGMWWANS type=del size=2771926 2024-03-09T14:33:25.824 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.824+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=OYW0S1BUGAO8 type=del size=2481089 2024-03-09T14:33:25.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.825+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~TUGE9C8HAWWF.0 size=503803 2024-03-09T14:33:25.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.828+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=TUGE9C8HAWWF tag=GB6SLZDCGB6Y type=write size=1552379 2024-03-09T14:33:25.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.829+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=3RRE6CWOS40A type=del size=2894044 2024-03-09T14:33:25.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.830+0000 7f586ae3d780 1 < canceled operation key=O5L6RC16RS8E tag=0YCUT6G0L5M2 type=del size=574967 2024-03-09T14:33:25.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.833+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~809G5VO0YN69.0 size=1048576 2024-03-09T14:33:25.833 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.834+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~809G5VO0YN69.1 size=1048576 2024-03-09T14:33:25.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.835+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~809G5VO0YN69.2 size=739451 2024-03-09T14:33:25.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.835+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=809G5VO0YN69 tag=63OYF1UXCWFG type=write size=3885179 2024-03-09T14:33:25.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.836+0000 7f586ae3d780 -1 < failed to complete operation key=BHSYRD3IEJWW tag=NUOOZCYFMSVA type=write size=459851: (22) Invalid argument 2024-03-09T14:33:25.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.837+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=VZW0BY6Y9WHL type=del size=2209992 2024-03-09T14:33:25.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.839+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=SH582ZGS81AS type=del 2024-03-09T14:33:25.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.840+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=61AAHFZDI98A type=del size=288920 2024-03-09T14:33:25.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.841+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~DSG08J5RMQYX.0 size=86671 2024-03-09T14:33:25.843 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.843+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=DSG08J5RMQYX tag=CDJ5XKH65LMC type=write size=1135247 2024-03-09T14:33:25.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.845+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=71NID2IW0375 type=del size=1023197 2024-03-09T14:33:25.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.845+0000 7f586ae3d780 1 < canceled part key=_multipart_BHSYRD3IEJWW.2~593O58Y9RQDH.0 size=1048576 2024-03-09T14:33:25.845 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.846+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~593O58Y9RQDH.1 size=1048576 2024-03-09T14:33:25.846 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.847+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~593O58Y9RQDH.2 size=883456 2024-03-09T14:33:25.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.849+0000 7f586ae3d780 1 < canceled multipart upload key=BHSYRD3IEJWW upload=593O58Y9RQDH tag=T9RZD3EUS4GF type=write size=4029184 2024-03-09T14:33:25.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.851+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~VA78YHZHZUPF.0 size=665868 2024-03-09T14:33:25.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.851+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=VA78YHZHZUPF tag=9E7C9MVOQEA2 type=write size=1714444 2024-03-09T14:33:25.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.852+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=0UC9P2ATVDE2 type=del 2024-03-09T14:33:25.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.855+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~JQYKFY7RZ0EZ.0 size=335171 2024-03-09T14:33:25.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.855+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=JQYKFY7RZ0EZ tag=0KGMU34LHMJW type=write size=1383747 2024-03-09T14:33:25.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.856+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~AFWYKG3542UI.0 size=1048576 2024-03-09T14:33:25.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.857+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~AFWYKG3542UI.1 size=1048576 2024-03-09T14:33:25.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.859+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~AFWYKG3542UI.2 size=65776 2024-03-09T14:33:25.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.861+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=AFWYKG3542UI tag=LAAE09I7TWY4 type=write size=3211504 2024-03-09T14:33:25.862 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.863+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=WJRI82UAC9I6 type=del size=590951 2024-03-09T14:33:25.863 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.864+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~J5SRD0WVUC4Z.0 size=1048576 2024-03-09T14:33:25.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.865+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~J5SRD0WVUC4Z.1 size=125439 2024-03-09T14:33:25.867 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.867+0000 7f586ae3d780 1 < completed multipart upload key=IK528ND96157 upload=J5SRD0WVUC4Z tag=F5G2D5GCYWF8 type=write size=2222591 2024-03-09T14:33:25.869 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.869+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~6YQMN0CXU14K.0 size=1048576 2024-03-09T14:33:25.870 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.871+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~6YQMN0CXU14K.1 size=1048576 2024-03-09T14:33:25.871 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.872+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~6YQMN0CXU14K.2 size=1023868 2024-03-09T14:33:25.871 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.872+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=6YQMN0CXU14K tag=JFLMMHV245RH type=write size=4169596 2024-03-09T14:33:25.872 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.873+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~SASEVNCRE8O4.0 size=64802 2024-03-09T14:33:25.875 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.875+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=SASEVNCRE8O4 tag=ZR0ND4HWW2IN type=write size=1113378 2024-03-09T14:33:25.877 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.878+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~2X5K924BZ15O.0 size=1048576 2024-03-09T14:33:25.878 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.879+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~2X5K924BZ15O.1 size=386400 2024-03-09T14:33:25.878 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.879+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=2X5K924BZ15O tag=6UCQ2ITKQYJ0 type=write size=2483552 2024-03-09T14:33:25.879 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.880+0000 7f586ae3d780 1 < completed write operation key=IK528ND96157 tag=71PSYJQPWC8C type=write size=556145 2024-03-09T14:33:25.881 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.881+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=Y94E5CIXNHAP type=write size=602829 2024-03-09T14:33:25.882 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.883+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~SO5DRYLTLVME.0 size=1048576 2024-03-09T14:33:25.883 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.883+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~SO5DRYLTLVME.1 size=1048576 2024-03-09T14:33:25.884 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.884+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~SO5DRYLTLVME.2 size=1018363 2024-03-09T14:33:25.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.886+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=SO5DRYLTLVME tag=ZLYFM1QIUPE7 type=write size=4164091 2024-03-09T14:33:25.888 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.889+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~O8THK1FTO24P.0 size=454502 2024-03-09T14:33:25.888 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.889+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=O8THK1FTO24P tag=VNQ9LR3NVJ2I type=write size=1503078 2024-03-09T14:33:25.889 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.890+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~P281C7QOP11L.0 size=1048576 2024-03-09T14:33:25.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.891+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~P281C7QOP11L.1 size=415111 2024-03-09T14:33:25.893 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.893+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=P281C7QOP11L tag=ONW3BS5EI332 type=write size=2512263 2024-03-09T14:33:25.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.894+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=N8MQV8VGP5FL type=del size=2962403 2024-03-09T14:33:25.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.896+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~K2NI1YLREBN9.0 size=1048576 2024-03-09T14:33:25.896 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.897+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~K2NI1YLREBN9.1 size=826177 2024-03-09T14:33:25.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.899+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=K2NI1YLREBN9 tag=YZQCJ25EA8CZ type=write size=2923329 2024-03-09T14:33:25.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.901+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~6DA5C5E2ZAVO.0 size=1048576 2024-03-09T14:33:25.901 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.902+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~6DA5C5E2ZAVO.1 size=1048576 2024-03-09T14:33:25.902 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.903+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~6DA5C5E2ZAVO.2 size=623006 2024-03-09T14:33:25.902 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.903+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=6DA5C5E2ZAVO tag=243C9EQP64E8 type=write size=3768734 2024-03-09T14:33:25.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.905+0000 7f586ae3d780 1 < suggested remove operation key=W4Q1MWHOQ4Y1 tag=EWNJILRDDAT1 type=del 2024-03-09T14:33:25.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.909+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~ZKDGAAUU83WZ.0 size=1048576 2024-03-09T14:33:25.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.909+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~ZKDGAAUU83WZ.1 size=856189 2024-03-09T14:33:25.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.909+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=ZKDGAAUU83WZ tag=J34UKY0P35WE type=write size=2953341 2024-03-09T14:33:25.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.912+0000 7f586ae3d780 1 < suggested remove operation key=0JDF7910RACF tag=OYW0S1BUGAO8 type=del 2024-03-09T14:33:25.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.914+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~IXQ8Q51TIHWK.0 size=1048576 2024-03-09T14:33:25.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.915+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~IXQ8Q51TIHWK.1 size=649890 2024-03-09T14:33:25.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.915+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=IXQ8Q51TIHWK tag=MVXB1LZW2VWE type=write size=2747042 2024-03-09T14:33:25.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.917+0000 7f586ae3d780 1 < suggested update operation key=OU9IOY7J572N tag=3RRE6CWOS40A type=del size=2894044 2024-03-09T14:33:25.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.919+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~XDU5ULLCNBBK.0 size=531387 2024-03-09T14:33:25.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.919+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=XDU5ULLCNBBK tag=KWS4BN5FUC9N type=write size=1579963 2024-03-09T14:33:25.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.920+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~809G5VO0YN69.0 size=1048576 2024-03-09T14:33:25.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.921+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~809G5VO0YN69.1 size=1048576 2024-03-09T14:33:25.921 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.922+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~809G5VO0YN69.2 size=739451 2024-03-09T14:33:25.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.924+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=809G5VO0YN69 tag=63OYF1UXCWFG type=write size=3885179 2024-03-09T14:33:25.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.925+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=15S161LH1XLO type=del size=2755616 2024-03-09T14:33:25.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.926+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=VZW0BY6Y9WHL type=del 2024-03-09T14:33:25.927 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.927+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=VWGSMNW34TT5 type=del size=3518654 2024-03-09T14:33:25.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.928+0000 7f586ae3d780 1 < canceled operation key=9ZPCSBP3P58P tag=61AAHFZDI98A type=del size=288920 2024-03-09T14:33:25.929 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.929+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=HDRBL2TU2Z7B type=del size=1303222 2024-03-09T14:33:25.930 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.931+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=71NID2IW0375 type=del 2024-03-09T14:33:25.931 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.932+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=9Y8YMM3RBDZ4 type=write size=8374 2024-03-09T14:33:25.932 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.933+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~VA78YHZHZUPF.0 size=665868 2024-03-09T14:33:25.934 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.935+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=VA78YHZHZUPF tag=9E7C9MVOQEA2 type=write size=1714444 2024-03-09T14:33:25.935 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.936+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=JOELUH4UQDZA type=del size=2800560 2024-03-09T14:33:25.936 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.937+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~JQYKFY7RZ0EZ.0 size=335171 2024-03-09T14:33:25.938 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.939+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=JQYKFY7RZ0EZ tag=0KGMU34LHMJW type=write size=1383747 2024-03-09T14:33:25.939 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.940+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=HKBDYY9C7ZW2 type=write size=826499 2024-03-09T14:33:25.940 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.941+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=WJRI82UAC9I6 type=del 2024-03-09T14:33:25.941 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.942+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=XEKXC9LISPT9 type=del size=3246765 2024-03-09T14:33:25.943 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.943+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~6YQMN0CXU14K.0 size=1048576 2024-03-09T14:33:25.943 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.944+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~6YQMN0CXU14K.1 size=1048576 2024-03-09T14:33:25.944 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.945+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~6YQMN0CXU14K.2 size=1023868 2024-03-09T14:33:25.946 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.947+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=6YQMN0CXU14K tag=JFLMMHV245RH type=write size=4169596 2024-03-09T14:33:25.950 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.949+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~WO2YV21W2JC8.0 size=1048576 2024-03-09T14:33:25.950 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.950+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~WO2YV21W2JC8.1 size=361262 2024-03-09T14:33:25.950 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.950+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=WO2YV21W2JC8 tag=5G78238CUOI3 type=write size=2458414 2024-03-09T14:33:25.951 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.951+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~2X5K924BZ15O.0 size=1048576 2024-03-09T14:33:25.951 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.952+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~2X5K924BZ15O.1 size=386400 2024-03-09T14:33:25.953 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.954+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=2X5K924BZ15O tag=6UCQ2ITKQYJ0 type=write size=2483552 2024-03-09T14:33:25.954 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.955+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=0323E5TDX30S type=del size=2473785 2024-03-09T14:33:25.955 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.956+0000 7f586ae3d780 1 < completed write operation key=C1UGQOQ6AE1E tag=Y94E5CIXNHAP type=write size=602829 2024-03-09T14:33:25.957 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.958+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~6O521T720WJD.0 size=293459 2024-03-09T14:33:25.958 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.958+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=6O521T720WJD tag=NZWQ0UCLY576 type=write size=1342035 2024-03-09T14:33:25.958 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.959+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~O8THK1FTO24P.0 size=454502 2024-03-09T14:33:25.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.961+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=O8THK1FTO24P tag=VNQ9LR3NVJ2I type=write size=1503078 2024-03-09T14:33:25.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.962+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=QTTRLP2H0DGW type=del size=1242222 2024-03-09T14:33:25.963 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.963+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=N8MQV8VGP5FL type=del 2024-03-09T14:33:25.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.964+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=5IRMFNBVYXA6 type=del size=3364666 2024-03-09T14:33:25.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.965+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~6DA5C5E2ZAVO.0 size=1048576 2024-03-09T14:33:25.966 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.966+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~6DA5C5E2ZAVO.1 size=1048576 2024-03-09T14:33:25.966 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.966+0000 7f586ae3d780 1 < canceled part key=_multipart_5PERWGS0GOJU.2~6DA5C5E2ZAVO.2 size=623006 2024-03-09T14:33:25.968 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.968+0000 7f586ae3d780 1 < canceled multipart upload key=5PERWGS0GOJU upload=6DA5C5E2ZAVO tag=243C9EQP64E8 type=write size=3768734 2024-03-09T14:33:25.970 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.970+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~XPZXBY8YZNKA.0 size=1048576 2024-03-09T14:33:25.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.971+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~XPZXBY8YZNKA.1 size=1048576 2024-03-09T14:33:25.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.972+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~XPZXBY8YZNKA.2 size=526081 2024-03-09T14:33:25.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.972+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=XPZXBY8YZNKA tag=PJIGNX9ELG2U type=write size=3671809 2024-03-09T14:33:25.973 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.973+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~ZKDGAAUU83WZ.0 size=1048576 2024-03-09T14:33:25.973 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.974+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~ZKDGAAUU83WZ.1 size=856189 2024-03-09T14:33:25.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.976+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=ZKDGAAUU83WZ tag=J34UKY0P35WE type=write size=2953341 2024-03-09T14:33:25.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.977+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=NI804N6GMDTE type=del size=1383689 2024-03-09T14:33:25.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.978+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~IXQ8Q51TIHWK.0 size=1048576 2024-03-09T14:33:25.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.979+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~IXQ8Q51TIHWK.1 size=649890 2024-03-09T14:33:25.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.981+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=IXQ8Q51TIHWK tag=MVXB1LZW2VWE type=write size=2747042 2024-03-09T14:33:25.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.983+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~TR2PWAVHHG84.0 size=1048576 2024-03-09T14:33:25.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.984+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~TR2PWAVHHG84.1 size=1048576 2024-03-09T14:33:25.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.985+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~TR2PWAVHHG84.2 size=20869 2024-03-09T14:33:25.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.985+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=TR2PWAVHHG84 tag=5TKNC7ZKGP3U type=write size=3166597 2024-03-09T14:33:25.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.985+0000 7f586ae3d780 1 < canceled part key=_multipart_UAYZ55UT77VE.2~XDU5ULLCNBBK.0 size=531387 2024-03-09T14:33:25.986 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.987+0000 7f586ae3d780 1 < canceled multipart upload key=UAYZ55UT77VE upload=XDU5ULLCNBBK tag=KWS4BN5FUC9N type=write size=1579963 2024-03-09T14:33:25.987 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.988+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=4DIFIYY0VRZF type=write size=8579 2024-03-09T14:33:25.989 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.989+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=15S161LH1XLO type=del 2024-03-09T14:33:25.990 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.990+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=XQZBZZJUFJJ0 type=del size=3875483 2024-03-09T14:33:25.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.993+0000 7f586ae3d780 1 < suggested update operation key=9ZPCSBP3P58P tag=VWGSMNW34TT5 type=del size=3518654 2024-03-09T14:33:25.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.995+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~WKR03TKK76UQ.0 size=675204 2024-03-09T14:33:25.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.995+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=WKR03TKK76UQ tag=3F4NRAQTEJ0M type=write size=1723780 2024-03-09T14:33:25.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.996+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=HDRBL2TU2Z7B type=del 2024-03-09T14:33:25.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:25.999+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~QBHSA2UV5NS3.0 size=1048576 2024-03-09T14:33:25.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.000+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~QBHSA2UV5NS3.1 size=1048576 2024-03-09T14:33:26.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.001+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~QBHSA2UV5NS3.2 size=818392 2024-03-09T14:33:26.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.001+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=QBHSA2UV5NS3 tag=0MOR03LSOH7C type=write size=3964120 2024-03-09T14:33:26.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.002+0000 7f586ae3d780 1 < completed write operation key=UKPSUQ6LYWN8 tag=9Y8YMM3RBDZ4 type=write size=8374 2024-03-09T14:33:26.003 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.003+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=E5J0UA9XLPLV type=del size=2785645 2024-03-09T14:33:26.004 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.004+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=JOELUH4UQDZA type=del 2024-03-09T14:33:26.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.006+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~V1VCY8CJUKP9.0 size=111753 2024-03-09T14:33:26.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.006+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=V1VCY8CJUKP9 tag=9XEHI6SDHBP3 type=write size=1160329 2024-03-09T14:33:26.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.008+0000 7f586ae3d780 1 < completed write operation key=04E9KDGUC274 tag=HKBDYY9C7ZW2 type=write size=826499 2024-03-09T14:33:26.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.009+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=VZXU3XKP1V3S type=del size=407544 2024-03-09T14:33:26.009 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.010+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=XEKXC9LISPT9 type=del 2024-03-09T14:33:26.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.013+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~P1A25XQS9G5P.0 size=1048576 2024-03-09T14:33:26.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.014+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~P1A25XQS9G5P.1 size=1048576 2024-03-09T14:33:26.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.015+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~P1A25XQS9G5P.2 size=1010367 2024-03-09T14:33:26.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.015+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=P1A25XQS9G5P tag=N4PBEQRP1R1E type=write size=4156095 2024-03-09T14:33:26.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.016+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~WO2YV21W2JC8.0 size=1048576 2024-03-09T14:33:26.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.017+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~WO2YV21W2JC8.1 size=361262 2024-03-09T14:33:26.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.019+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=WO2YV21W2JC8 tag=5G78238CUOI3 type=write size=2458414 2024-03-09T14:33:26.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.022+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~I3CO2XQZN9OJ.0 size=186214 2024-03-09T14:33:26.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.022+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=I3CO2XQZN9OJ tag=9HUREVHFRDSN type=write size=1234790 2024-03-09T14:33:26.023 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.024+0000 7f586ae3d780 1 < suggested remove operation key=2BUCMVWK7J1V tag=0323E5TDX30S type=del 2024-03-09T14:33:26.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.026+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~ZUS750EVC2GS.0 size=1048576 2024-03-09T14:33:26.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.027+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~ZUS750EVC2GS.1 size=1048576 2024-03-09T14:33:26.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.028+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~ZUS750EVC2GS.2 size=860087 2024-03-09T14:33:26.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.028+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=ZUS750EVC2GS tag=EZW5E9CHRJVA type=write size=4005815 2024-03-09T14:33:26.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.029+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~6O521T720WJD.0 size=293459 2024-03-09T14:33:26.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.031+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=6O521T720WJD tag=NZWQ0UCLY576 type=write size=1342035 2024-03-09T14:33:26.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.032+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=H7BC4Z8WM7FS type=del size=721154 2024-03-09T14:33:26.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.033+0000 7f586ae3d780 1 < canceled operation key=IK528ND96157 tag=QTTRLP2H0DGW type=del size=1242222 2024-03-09T14:33:26.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.035+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=D102E2I04IB5 type=write size=220274 2024-03-09T14:33:26.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.036+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=5IRMFNBVYXA6 type=del 2024-03-09T14:33:26.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.038+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~1FB5PTVOU4YR.0 size=275591 2024-03-09T14:33:26.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.038+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=1FB5PTVOU4YR tag=24M5I3KPVBPP type=write size=1324167 2024-03-09T14:33:26.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.039+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~XPZXBY8YZNKA.0 size=1048576 2024-03-09T14:33:26.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.040+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~XPZXBY8YZNKA.1 size=1048576 2024-03-09T14:33:26.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.041+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~XPZXBY8YZNKA.2 size=526081 2024-03-09T14:33:26.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.043+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=XPZXBY8YZNKA tag=PJIGNX9ELG2U type=write size=3671809 2024-03-09T14:33:26.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.046+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~TYZ7HL914AE2.0 size=717601 2024-03-09T14:33:26.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.046+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=TYZ7HL914AE2 tag=G98N4BPTAQH3 type=write size=1766177 2024-03-09T14:33:26.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.048+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=NI804N6GMDTE type=del 2024-03-09T14:33:26.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.049+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=QQNBQ6YQCU25 type=del size=114238 2024-03-09T14:33:26.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.050+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~TR2PWAVHHG84.0 size=1048576 2024-03-09T14:33:26.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.051+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~TR2PWAVHHG84.1 size=1048576 2024-03-09T14:33:26.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.052+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~TR2PWAVHHG84.2 size=20869 2024-03-09T14:33:26.053 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.054+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=TR2PWAVHHG84 tag=5TKNC7ZKGP3U type=write size=3166597 2024-03-09T14:33:26.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.055+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=AZGCDAN7KQ6F type=write size=151827 2024-03-09T14:33:26.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.057+0000 7f586ae3d780 1 < suggested update operation key=FNZ3BNA7W12E tag=4DIFIYY0VRZF type=write size=8579 2024-03-09T14:33:26.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.059+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~DNBQGGUPJ71J.0 size=461901 2024-03-09T14:33:26.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.059+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=DNBQGGUPJ71J tag=JT3O91AL0X8R type=write size=1510477 2024-03-09T14:33:26.060 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.061+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=XQZBZZJUFJJ0 type=del 2024-03-09T14:33:26.062 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.063+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~CTLPBXKZ08ZH.0 size=1048576 2024-03-09T14:33:26.063 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.063+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~CTLPBXKZ08ZH.1 size=1048576 2024-03-09T14:33:26.064 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.064+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~CTLPBXKZ08ZH.2 size=103281 2024-03-09T14:33:26.064 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.064+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=CTLPBXKZ08ZH tag=P9MVKXE827O6 type=write size=3249009 2024-03-09T14:33:26.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.065+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~WKR03TKK76UQ.0 size=675204 2024-03-09T14:33:26.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.067+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=WKR03TKK76UQ tag=3F4NRAQTEJ0M type=write size=1723780 2024-03-09T14:33:26.068 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.069+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=22RXHYYVKNFZ type=write size=124429 2024-03-09T14:33:26.069 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.070+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~QBHSA2UV5NS3.0 size=1048576 2024-03-09T14:33:26.070 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.071+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~QBHSA2UV5NS3.1 size=1048576 2024-03-09T14:33:26.071 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.072+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~QBHSA2UV5NS3.2 size=818392 2024-03-09T14:33:26.073 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.074+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=QBHSA2UV5NS3 tag=0MOR03LSOH7C type=write size=3964120 2024-03-09T14:33:26.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.075+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=3GWSOTC3CV2D type=del size=2548233 2024-03-09T14:33:26.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.076+0000 7f586ae3d780 1 < canceled operation key=5PERWGS0GOJU tag=E5J0UA9XLPLV type=del size=2785645 2024-03-09T14:33:26.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.077+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=XGK6ILI4C9HO type=write size=423743 2024-03-09T14:33:26.078 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.078+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~V1VCY8CJUKP9.0 size=111753 2024-03-09T14:33:26.080 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.080+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=V1VCY8CJUKP9 tag=9XEHI6SDHBP3 type=write size=1160329 2024-03-09T14:33:26.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.081+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=CWF4VM9ZD8WD type=write size=565766 2024-03-09T14:33:26.082 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.082+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=VZXU3XKP1V3S type=del 2024-03-09T14:33:26.084 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.085+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~OZRVE6PEWMN2.0 size=1048576 2024-03-09T14:33:26.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.085+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~OZRVE6PEWMN2.1 size=792727 2024-03-09T14:33:26.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.085+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=OZRVE6PEWMN2 tag=0UREMU43OJ0N type=write size=2889879 2024-03-09T14:33:26.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.087+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~P1A25XQS9G5P.0 size=1048576 2024-03-09T14:33:26.087 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.088+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~P1A25XQS9G5P.1 size=1048576 2024-03-09T14:33:26.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.089+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~P1A25XQS9G5P.2 size=1010367 2024-03-09T14:33:26.090 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.091+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=P1A25XQS9G5P tag=N4PBEQRP1R1E type=write size=4156095 2024-03-09T14:33:26.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.092+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~0Q0LE15FXKMU.0 size=1035824 2024-03-09T14:33:26.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.092+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=0Q0LE15FXKMU tag=X5TTW39S8LXU type=write size=2084400 2024-03-09T14:33:26.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.093+0000 7f586ae3d780 1 < canceled part key=_multipart_W3HTK2F8ML3V.2~I3CO2XQZN9OJ.0 size=186214 2024-03-09T14:33:26.094 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.095+0000 7f586ae3d780 1 < canceled multipart upload key=W3HTK2F8ML3V upload=I3CO2XQZN9OJ tag=9HUREVHFRDSN type=write size=1234790 2024-03-09T14:33:26.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.096+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=KIVYX7SW2PRA type=del size=705221 2024-03-09T14:33:26.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.097+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~ZUS750EVC2GS.0 size=1048576 2024-03-09T14:33:26.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.098+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~ZUS750EVC2GS.1 size=1048576 2024-03-09T14:33:26.098 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.099+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~ZUS750EVC2GS.2 size=860087 2024-03-09T14:33:26.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.101+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=ZUS750EVC2GS tag=EZW5E9CHRJVA type=write size=4005815 2024-03-09T14:33:26.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.102+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=1PASRYBNQSI5 type=del size=1311986 2024-03-09T14:33:26.103 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.103+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=H7BC4Z8WM7FS type=del 2024-03-09T14:33:26.104 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.104+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=3KSBJHNJ9A9W type=del size=3954596 2024-03-09T14:33:26.105 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.106+0000 7f586ae3d780 1 < completed write operation key=UKPSUQ6LYWN8 tag=D102E2I04IB5 type=write size=220274 2024-03-09T14:33:26.106 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.107+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=O5HOK3T6S4UT type=del size=2425796 2024-03-09T14:33:26.107 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.108+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~1FB5PTVOU4YR.0 size=275591 2024-03-09T14:33:26.109 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.110+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=1FB5PTVOU4YR tag=24M5I3KPVBPP type=write size=1324167 2024-03-09T14:33:26.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.111+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=Z735NWF4TFM7 type=del size=3352135 2024-03-09T14:33:26.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.112+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~TYZ7HL914AE2.0 size=717601 2024-03-09T14:33:26.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.114+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=TYZ7HL914AE2 tag=G98N4BPTAQH3 type=write size=1766177 2024-03-09T14:33:26.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.115+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=Q595I2G9RXUW type=del size=580041 2024-03-09T14:33:26.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.116+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=QQNBQ6YQCU25 type=del 2024-03-09T14:33:26.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.117+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=BE4Y1W9X34ZP type=write size=534802 2024-03-09T14:33:26.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.119+0000 7f586ae3d780 1 < completed write operation key=CZGAXNJ0GKU0 tag=AZGCDAN7KQ6F type=write size=151827 2024-03-09T14:33:26.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.120+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=6N991V6F6VHJ type=del size=1693891 2024-03-09T14:33:26.121 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.122+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~DNBQGGUPJ71J.0 size=461901 2024-03-09T14:33:26.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.124+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=DNBQGGUPJ71J tag=JT3O91AL0X8R type=write size=1510477 2024-03-09T14:33:26.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.126+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~ZILF99EPUN49.0 size=1014051 2024-03-09T14:33:26.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.126+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=ZILF99EPUN49 tag=C40LNOUHKMNT type=write size=2062627 2024-03-09T14:33:26.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.126+0000 7f586ae3d780 1 < canceled part key=_multipart_6YWLPUULN5SY.2~CTLPBXKZ08ZH.0 size=1048576 2024-03-09T14:33:26.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.126+0000 7f586ae3d780 1 < canceled part key=_multipart_6YWLPUULN5SY.2~CTLPBXKZ08ZH.1 size=1048576 2024-03-09T14:33:26.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.126+0000 7f586ae3d780 1 < canceled part key=_multipart_6YWLPUULN5SY.2~CTLPBXKZ08ZH.2 size=103281 2024-03-09T14:33:26.128 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.128+0000 7f586ae3d780 1 < canceled multipart upload key=6YWLPUULN5SY upload=CTLPBXKZ08ZH tag=P9MVKXE827O6 type=write size=3249009 2024-03-09T14:33:26.129 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.129+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=1D0Y50IQ9OOX type=write size=279666 2024-03-09T14:33:26.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.131+0000 7f586ae3d780 1 < completed write operation key=P3OUIQNAK1TC tag=22RXHYYVKNFZ type=write size=124429 2024-03-09T14:33:26.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.132+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=FSRCTOF28SOE type=del size=399828 2024-03-09T14:33:26.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.133+0000 7f586ae3d780 1 < canceled operation key=W3HTK2F8ML3V tag=3GWSOTC3CV2D type=del size=2548233 2024-03-09T14:33:26.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.134+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=PDHOXX3BQYHC type=del size=96868 2024-03-09T14:33:26.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.135+0000 7f586ae3d780 1 < completed write operation key=78Y2ZM3W6EUC tag=XGK6ILI4C9HO type=write size=423743 2024-03-09T14:33:26.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.137+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=IS7RR4BAZ7UZ type=del size=4080006 2024-03-09T14:33:26.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.138+0000 7f586ae3d780 1 < canceled operation key=57OR9DHRPDCZ tag=CWF4VM9ZD8WD type=write size=565766 2024-03-09T14:33:26.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.139+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=EQOASYRYSJWU type=del size=3548165 2024-03-09T14:33:26.139 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.139+0000 7f586ae3d780 1 < canceled part key=_multipart_G2BIOBESOIK9.2~OZRVE6PEWMN2.0 size=1048576 2024-03-09T14:33:26.139 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.140+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~OZRVE6PEWMN2.1 size=792727 2024-03-09T14:33:26.141 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.142+0000 7f586ae3d780 1 < canceled multipart upload key=G2BIOBESOIK9 upload=OZRVE6PEWMN2 tag=0UREMU43OJ0N type=write size=2889879 2024-03-09T14:33:26.143 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.143+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=9N3HJ9V4A5CQ type=del size=1961921 2024-03-09T14:33:26.144 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.144+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~0Q0LE15FXKMU.0 size=1035824 2024-03-09T14:33:26.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.146+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=0Q0LE15FXKMU tag=X5TTW39S8LXU type=write size=2084400 2024-03-09T14:33:26.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.147+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=O8Q7NVP81P09 type=del size=1641476 2024-03-09T14:33:26.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.149+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=KIVYX7SW2PRA type=del 2024-03-09T14:33:26.150 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.151+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~8N21WTC8M2S3.0 size=1048576 2024-03-09T14:33:26.154 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.152+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~8N21WTC8M2S3.1 size=1048576 2024-03-09T14:33:26.154 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.152+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~8N21WTC8M2S3.2 size=888739 2024-03-09T14:33:26.154 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.152+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=8N21WTC8M2S3 tag=2Z49HUFVQIFR type=write size=4034467 2024-03-09T14:33:26.154 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.154+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=1PASRYBNQSI5 type=del 2024-03-09T14:33:26.155 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.155+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=C4JSC052NY2E type=write size=290612 2024-03-09T14:33:26.156 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.157+0000 7f586ae3d780 1 < suggested remove operation key=G2BIOBESOIK9 tag=3KSBJHNJ9A9W type=del 2024-03-09T14:33:26.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.159+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~40KN3R97H8D8.0 size=1048576 2024-03-09T14:33:26.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.160+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~40KN3R97H8D8.1 size=612069 2024-03-09T14:33:26.160 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.160+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=40KN3R97H8D8 tag=437RCGAZNZQ6 type=write size=2709221 2024-03-09T14:33:26.161 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.161+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=O5HOK3T6S4UT type=del 2024-03-09T14:33:26.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.162+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=CO0OI2AFOX75 type=del size=1738146 2024-03-09T14:33:26.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.164+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=Z735NWF4TFM7 type=del 2024-03-09T14:33:26.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.165+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=KUH7ZAIQ4VB3 type=del size=2230877 2024-03-09T14:33:26.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.166+0000 7f586ae3d780 1 < completed delete operation key=NHIOOLNXLZZC tag=Q595I2G9RXUW type=del 2024-03-09T14:33:26.166 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.167+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=WG11JGSICUCF type=write size=375547 2024-03-09T14:33:26.168 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.168+0000 7f586ae3d780 1 < completed write operation key=39ZIGOC6JZ1R tag=BE4Y1W9X34ZP type=write size=534802 2024-03-09T14:33:26.170 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.170+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~FFAE2N3QAVXM.0 size=1048576 2024-03-09T14:33:26.171 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.171+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~FFAE2N3QAVXM.1 size=1048576 2024-03-09T14:33:26.172 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.172+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~FFAE2N3QAVXM.2 size=708418 2024-03-09T14:33:26.172 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.172+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=FFAE2N3QAVXM tag=9XZMMJ8QBFYF type=write size=3854146 2024-03-09T14:33:26.173 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.173+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=6N991V6F6VHJ type=del 2024-03-09T14:33:26.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.175+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~NBNZQZZFDMMG.0 size=1048576 2024-03-09T14:33:26.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.176+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~NBNZQZZFDMMG.1 size=1048576 2024-03-09T14:33:26.176 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.177+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~NBNZQZZFDMMG.2 size=699173 2024-03-09T14:33:26.177 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.177+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=NBNZQZZFDMMG tag=1E32XAI2WAJV type=write size=3844901 2024-03-09T14:33:26.178 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.178+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~ZILF99EPUN49.0 size=1014051 2024-03-09T14:33:26.179 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.180+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=ZILF99EPUN49 tag=C40LNOUHKMNT type=write size=2062627 2024-03-09T14:33:26.181 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.181+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=T70RH05PZ7Y1 type=del size=2301743 2024-03-09T14:33:26.183 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.183+0000 7f586ae3d780 1 < suggested remove operation key=XIYWPXSYCT6I tag=1D0Y50IQ9OOX type=write 2024-03-09T14:33:26.184 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.185+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=YMSKZ1UISE9V type=del size=1478935 2024-03-09T14:33:26.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.186+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=FSRCTOF28SOE type=del 2024-03-09T14:33:26.187 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.188+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~VVKWC3RMMCP9.0 size=1048576 2024-03-09T14:33:26.188 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.189+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~VVKWC3RMMCP9.1 size=587327 2024-03-09T14:33:26.188 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.189+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=VVKWC3RMMCP9 tag=4W745H5KAUKQ type=write size=2684479 2024-03-09T14:33:26.189 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.190+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=PDHOXX3BQYHC type=del 2024-03-09T14:33:26.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.192+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~TP3E2X117YZ6.0 size=1048576 2024-03-09T14:33:26.192 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.193+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~TP3E2X117YZ6.1 size=1048576 2024-03-09T14:33:26.193 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.194+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~TP3E2X117YZ6.2 size=352031 2024-03-09T14:33:26.193 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.194+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=TP3E2X117YZ6 tag=C3YQ7YTZLQQ2 type=write size=3497759 2024-03-09T14:33:26.194 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.195+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=IS7RR4BAZ7UZ type=del 2024-03-09T14:33:26.196 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.196+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=F54OJVP421TJ type=del size=2152617 2024-03-09T14:33:26.197 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.198+0000 7f586ae3d780 -1 < failed to complete operation key=XIYWPXSYCT6I tag=EQOASYRYSJWU type=del size=3548165: (22) Invalid argument 2024-03-09T14:33:26.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.199+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=G60QGMHMEE11 type=del size=4119048 2024-03-09T14:33:26.201 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.201+0000 7f586ae3d780 1 < suggested remove operation key=509F17DT0C4I tag=9N3HJ9V4A5CQ type=del 2024-03-09T14:33:26.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.202+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=N2PLUEMAYEL6 type=del size=2464416 2024-03-09T14:33:26.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.204+0000 7f586ae3d780 -1 < failed to complete operation key=509F17DT0C4I tag=O8Q7NVP81P09 type=del size=1641476: (22) Invalid argument 2024-03-09T14:33:26.207 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.207+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~9BYIT9GUTPU3.0 size=1048576 2024-03-09T14:33:26.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.208+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~9BYIT9GUTPU3.1 size=1048576 2024-03-09T14:33:26.209 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.209+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~9BYIT9GUTPU3.2 size=455715 2024-03-09T14:33:26.209 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.209+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=9BYIT9GUTPU3 tag=9JZPQLSNY6M0 type=write size=3601443 2024-03-09T14:33:26.210 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.211+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~8N21WTC8M2S3.0 size=1048576 2024-03-09T14:33:26.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.212+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~8N21WTC8M2S3.1 size=1048576 2024-03-09T14:33:26.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.213+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~8N21WTC8M2S3.2 size=888739 2024-03-09T14:33:26.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.215+0000 7f586ae3d780 1 < completed multipart upload key=IK528ND96157 upload=8N21WTC8M2S3 tag=2Z49HUFVQIFR type=write size=4034467 2024-03-09T14:33:26.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.217+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~42FSPLIHQ3YK.0 size=416428 2024-03-09T14:33:26.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.217+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=42FSPLIHQ3YK tag=UQPH271T07Z2 type=write size=1465004 2024-03-09T14:33:26.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.218+0000 7f586ae3d780 1 < completed write operation key=DJH53FNVMLGY tag=C4JSC052NY2E type=write size=290612 2024-03-09T14:33:26.219 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.219+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=9FDNBDWL3YFL type=del size=1818780 2024-03-09T14:33:26.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.220+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~40KN3R97H8D8.0 size=1048576 2024-03-09T14:33:26.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.221+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~40KN3R97H8D8.1 size=612069 2024-03-09T14:33:26.223 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.223+0000 7f586ae3d780 1 < completed multipart upload key=UAYZ55UT77VE upload=40KN3R97H8D8 tag=437RCGAZNZQ6 type=write size=2709221 2024-03-09T14:33:26.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.224+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=EHPMDKJ56ZGQ type=del size=1559267 2024-03-09T14:33:26.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.226+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=CO0OI2AFOX75 type=del 2024-03-09T14:33:26.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.228+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~FYEKZOUJVF54.0 size=895219 2024-03-09T14:33:26.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.228+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=FYEKZOUJVF54 tag=AV78146N3KIU type=write size=1943795 2024-03-09T14:33:26.228 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.229+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=KUH7ZAIQ4VB3 type=del 2024-03-09T14:33:26.230 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.230+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=ZT3SM19S2XV5 type=del size=2763995 2024-03-09T14:33:26.231 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.231+0000 7f586ae3d780 1 < completed write operation key=WNVN3EOUUBGR tag=WG11JGSICUCF type=write size=375547 2024-03-09T14:33:26.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.236+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~8NUZQ5BHTD4N.0 size=1048576 2024-03-09T14:33:26.236 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.237+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~8NUZQ5BHTD4N.1 size=1048576 2024-03-09T14:33:26.238 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.238+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~8NUZQ5BHTD4N.2 size=684099 2024-03-09T14:33:26.238 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.238+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=8NUZQ5BHTD4N tag=KURD4P1TH25F type=write size=3829827 2024-03-09T14:33:26.239 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.240+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~FFAE2N3QAVXM.0 size=1048576 2024-03-09T14:33:26.240 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.241+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~FFAE2N3QAVXM.1 size=1048576 2024-03-09T14:33:26.241 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.242+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~FFAE2N3QAVXM.2 size=708418 2024-03-09T14:33:26.244 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.244+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=FFAE2N3QAVXM tag=9XZMMJ8QBFYF type=write size=3854146 2024-03-09T14:33:26.245 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.245+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=TN88LKO3BLLV type=del size=2749980 2024-03-09T14:33:26.246 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.247+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~NBNZQZZFDMMG.0 size=1048576 2024-03-09T14:33:26.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.248+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~NBNZQZZFDMMG.1 size=1048576 2024-03-09T14:33:26.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.249+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~NBNZQZZFDMMG.2 size=699173 2024-03-09T14:33:26.250 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.251+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=NBNZQZZFDMMG tag=1E32XAI2WAJV type=write size=3844901 2024-03-09T14:33:26.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.253+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~OBVNBRSB5QA6.0 size=9561 2024-03-09T14:33:26.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.253+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=OBVNBRSB5QA6 tag=VY0A2ATPAF45 type=write size=1058137 2024-03-09T14:33:26.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.255+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=T70RH05PZ7Y1 type=del 2024-03-09T14:33:26.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.256+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=MVGK1U1UMKN4 type=del size=1914519 2024-03-09T14:33:26.257 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.257+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=YMSKZ1UISE9V type=del 2024-03-09T14:33:26.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.258+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=62JFB7EQ6V55 type=del size=470243 2024-03-09T14:33:26.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.260+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~VVKWC3RMMCP9.0 size=1048576 2024-03-09T14:33:26.260 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.261+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~VVKWC3RMMCP9.1 size=587327 2024-03-09T14:33:26.262 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.263+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=VVKWC3RMMCP9 tag=4W745H5KAUKQ type=write size=2684479 2024-03-09T14:33:26.264 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.264+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=6AZVDPCIJJEA type=del size=1746778 2024-03-09T14:33:26.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.265+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~TP3E2X117YZ6.0 size=1048576 2024-03-09T14:33:26.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.266+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~TP3E2X117YZ6.1 size=1048576 2024-03-09T14:33:26.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.267+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~TP3E2X117YZ6.2 size=352031 2024-03-09T14:33:26.268 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.269+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=TP3E2X117YZ6 tag=C3YQ7YTZLQQ2 type=write size=3497759 2024-03-09T14:33:26.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.270+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=CCO36FXX7ZVI type=del size=2833922 2024-03-09T14:33:26.271 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.271+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=F54OJVP421TJ type=del 2024-03-09T14:33:26.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.273+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=0WRDQQGHCQDJ type=del size=3855984 2024-03-09T14:33:26.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.275+0000 7f586ae3d780 1 < suggested update operation key=C1UGQOQ6AE1E tag=G60QGMHMEE11 type=del size=4119048 2024-03-09T14:33:26.276 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.276+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=QU605VWVR624 type=del size=3567236 2024-03-09T14:33:26.277 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.277+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=N2PLUEMAYEL6 type=del 2024-03-09T14:33:26.278 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.279+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=49HVQF8C4XAZ type=write size=263634 2024-03-09T14:33:26.279 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.280+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~9BYIT9GUTPU3.0 size=1048576 2024-03-09T14:33:26.280 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.281+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~9BYIT9GUTPU3.1 size=1048576 2024-03-09T14:33:26.282 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.282+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~9BYIT9GUTPU3.2 size=455715 2024-03-09T14:33:26.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.284+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=9BYIT9GUTPU3 tag=9JZPQLSNY6M0 type=write size=3601443 2024-03-09T14:33:26.285 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.285+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=HZASAPEXS62V type=del size=3324828 2024-03-09T14:33:26.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.287+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~42FSPLIHQ3YK.0 size=416428 2024-03-09T14:33:26.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.289+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=42FSPLIHQ3YK tag=UQPH271T07Z2 type=write size=1465004 2024-03-09T14:33:26.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.290+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=QXN3ZIDYAM70 type=del size=2562382 2024-03-09T14:33:26.291 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.291+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=9FDNBDWL3YFL type=del 2024-03-09T14:33:26.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.292+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=1WSMVNCMFYSY type=del size=2107204 2024-03-09T14:33:26.294 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.295+0000 7f586ae3d780 1 < suggested remove operation key=CAISZZZSOD34 tag=EHPMDKJ56ZGQ type=del 2024-03-09T14:33:26.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.297+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~0S3IE9BRTIWF.0 size=1048576 2024-03-09T14:33:26.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.298+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~0S3IE9BRTIWF.1 size=1048576 2024-03-09T14:33:26.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.298+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~0S3IE9BRTIWF.2 size=1007662 2024-03-09T14:33:26.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.298+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=0S3IE9BRTIWF tag=M2775EM7GGIM type=write size=4153390 2024-03-09T14:33:26.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.300+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~FYEKZOUJVF54.0 size=895219 2024-03-09T14:33:26.301 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.302+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=FYEKZOUJVF54 tag=AV78146N3KIU type=write size=1943795 2024-03-09T14:33:26.303 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.303+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=2HW3RFUN5EHK type=del size=3344174 2024-03-09T14:33:26.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.305+0000 7f586ae3d780 1 < suggested remove operation key=39ZIGOC6JZ1R tag=ZT3SM19S2XV5 type=del 2024-03-09T14:33:26.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.308+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~4I0HCUMK5WWH.0 size=1048576 2024-03-09T14:33:26.308 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.308+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~4I0HCUMK5WWH.1 size=688245 2024-03-09T14:33:26.308 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.308+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=4I0HCUMK5WWH tag=J5Z03JCWCMYR type=write size=2785397 2024-03-09T14:33:26.309 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.310+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~8NUZQ5BHTD4N.0 size=1048576 2024-03-09T14:33:26.309 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.310+0000 7f586ae3d780 1 < canceled part key=_multipart_UKPSUQ6LYWN8.2~8NUZQ5BHTD4N.1 size=1048576 2024-03-09T14:33:26.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.311+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~8NUZQ5BHTD4N.2 size=684099 2024-03-09T14:33:26.312 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.313+0000 7f586ae3d780 1 < canceled multipart upload key=UKPSUQ6LYWN8 upload=8NUZQ5BHTD4N tag=KURD4P1TH25F type=write size=3829827 2024-03-09T14:33:26.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.315+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~36X0FZHAWHMD.0 size=1048576 2024-03-09T14:33:26.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.316+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~36X0FZHAWHMD.1 size=5617 2024-03-09T14:33:26.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.316+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=36X0FZHAWHMD tag=9URJZD3E94NG type=write size=2102769 2024-03-09T14:33:26.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.317+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=TN88LKO3BLLV type=del 2024-03-09T14:33:26.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.321+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~ZFAG3A5J5APU.0 size=1048576 2024-03-09T14:33:26.321 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.322+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~ZFAG3A5J5APU.1 size=1048576 2024-03-09T14:33:26.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.323+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~ZFAG3A5J5APU.2 size=802809 2024-03-09T14:33:26.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.323+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=ZFAG3A5J5APU tag=YIKUIFG71IVK type=write size=3948537 2024-03-09T14:33:26.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.324+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~OBVNBRSB5QA6.0 size=9561 2024-03-09T14:33:26.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.326+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=OBVNBRSB5QA6 tag=VY0A2ATPAF45 type=write size=1058137 2024-03-09T14:33:26.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.327+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=XAD815V18YXB type=write size=194858 2024-03-09T14:33:26.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.329+0000 7f586ae3d780 1 < suggested remove operation key=6YWLPUULN5SY tag=MVGK1U1UMKN4 type=del 2024-03-09T14:33:26.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.330+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=XBTJEQOPU6SH type=del size=647338 2024-03-09T14:33:26.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.331+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=62JFB7EQ6V55 type=del 2024-03-09T14:33:26.332 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.332+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=YEIP3XYTQ3ZS type=del size=2659428 2024-03-09T14:33:26.333 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.334+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=6AZVDPCIJJEA type=del 2024-03-09T14:33:26.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.335+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=Q8XLD7M29X2Q type=del size=426379 2024-03-09T14:33:26.336 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.337+0000 7f586ae3d780 1 < suggested remove operation key=9ZPCSBP3P58P tag=CCO36FXX7ZVI type=del 2024-03-09T14:33:26.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.338+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=UZ57OUQWVBGO type=del size=300374 2024-03-09T14:33:26.340 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.341+0000 7f586ae3d780 1 < suggested remove operation key=CAISZZZSOD34 tag=0WRDQQGHCQDJ type=del 2024-03-09T14:33:26.345 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.346+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~N0PSV0J1GK4H.0 size=406786 2024-03-09T14:33:26.345 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.346+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=N0PSV0J1GK4H tag=HOCUXO10HXVX type=write size=1455362 2024-03-09T14:33:26.347 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.347+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=QU605VWVR624 type=del 2024-03-09T14:33:26.348 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.348+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=ZR8ODEQATXIX type=del size=2086842 2024-03-09T14:33:26.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.350+0000 7f586ae3d780 1 < completed write operation key=UKPSUQ6LYWN8 tag=49HVQF8C4XAZ type=write size=263634 2024-03-09T14:33:26.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.351+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=42DPGKZA33DI type=del size=779606 2024-03-09T14:33:26.352 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.353+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=HZASAPEXS62V type=del 2024-03-09T14:33:26.353 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.354+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=ADNK9ASW6ZZ4 type=del size=3512043 2024-03-09T14:33:26.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.355+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=QXN3ZIDYAM70 type=del 2024-03-09T14:33:26.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.357+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~BMPLVT91RD2A.0 size=1048576 2024-03-09T14:33:26.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.358+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~BMPLVT91RD2A.1 size=170033 2024-03-09T14:33:26.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.358+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=BMPLVT91RD2A tag=TFQS3ZIDEQ6U type=write size=2267185 2024-03-09T14:33:26.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.359+0000 7f586ae3d780 1 < canceled operation key=57OR9DHRPDCZ tag=1WSMVNCMFYSY type=del size=2107204 2024-03-09T14:33:26.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.361+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~X1DBR0M1UPPC.0 size=829909 2024-03-09T14:33:26.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.361+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=X1DBR0M1UPPC tag=XM57DVYQPFGA type=write size=1878485 2024-03-09T14:33:26.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.362+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~0S3IE9BRTIWF.0 size=1048576 2024-03-09T14:33:26.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.363+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~0S3IE9BRTIWF.1 size=1048576 2024-03-09T14:33:26.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.364+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~0S3IE9BRTIWF.2 size=1007662 2024-03-09T14:33:26.366 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.366+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=0S3IE9BRTIWF tag=M2775EM7GGIM type=write size=4153390 2024-03-09T14:33:26.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.367+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=PICIYL8FSSU2 type=del size=4161438 2024-03-09T14:33:26.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.368+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=2HW3RFUN5EHK type=del 2024-03-09T14:33:26.369 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.370+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=CP9WIWEL6TA5 type=write size=51456 2024-03-09T14:33:26.370 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.371+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~4I0HCUMK5WWH.0 size=1048576 2024-03-09T14:33:26.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.372+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~4I0HCUMK5WWH.1 size=688245 2024-03-09T14:33:26.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.373+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=4I0HCUMK5WWH tag=J5Z03JCWCMYR type=write size=2785397 2024-03-09T14:33:26.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.375+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~NX5XWJGYN4CP.0 size=1048576 2024-03-09T14:33:26.376 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.376+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~NX5XWJGYN4CP.1 size=662629 2024-03-09T14:33:26.376 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.376+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=NX5XWJGYN4CP tag=XC2F9QCW6C1V type=write size=2759781 2024-03-09T14:33:26.377 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.377+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~36X0FZHAWHMD.0 size=1048576 2024-03-09T14:33:26.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.378+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~36X0FZHAWHMD.1 size=5617 2024-03-09T14:33:26.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.380+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=36X0FZHAWHMD tag=9URJZD3E94NG type=write size=2102769 2024-03-09T14:33:26.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.381+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=I3XN26LPFOR4 type=write size=420515 2024-03-09T14:33:26.382 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.382+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~ZFAG3A5J5APU.0 size=1048576 2024-03-09T14:33:26.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.383+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~ZFAG3A5J5APU.1 size=1048576 2024-03-09T14:33:26.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.384+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~ZFAG3A5J5APU.2 size=802809 2024-03-09T14:33:26.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.386+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=ZFAG3A5J5APU tag=YIKUIFG71IVK type=write size=3948537 2024-03-09T14:33:26.387 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.387+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=N8R17M8KU29M type=del size=3321634 2024-03-09T14:33:26.389 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.390+0000 7f586ae3d780 1 < suggested update operation key=CAISZZZSOD34 tag=XAD815V18YXB type=write size=194858 2024-03-09T14:33:26.390 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.391+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=EGC22CYE3N1Z type=write size=854247 2024-03-09T14:33:26.391 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.392+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=XBTJEQOPU6SH type=del 2024-03-09T14:33:26.392 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.393+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=2502713HIBJ8 type=del size=2779481 2024-03-09T14:33:26.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.394+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=YEIP3XYTQ3ZS type=del 2024-03-09T14:33:26.396 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.396+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~QZFZTN3MTJHD.0 size=1048576 2024-03-09T14:33:26.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.397+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~QZFZTN3MTJHD.1 size=1048576 2024-03-09T14:33:26.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.398+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~QZFZTN3MTJHD.2 size=967949 2024-03-09T14:33:26.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.398+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=QZFZTN3MTJHD tag=57Z026IJ7B1T type=write size=4113677 2024-03-09T14:33:26.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.399+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=Q8XLD7M29X2Q type=del 2024-03-09T14:33:26.400 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.400+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=YZ7EO39EP6DF type=del size=275361 2024-03-09T14:33:26.402 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.402+0000 7f586ae3d780 1 < suggested remove operation key=OXBDXIILR3NS tag=UZ57OUQWVBGO type=del 2024-03-09T14:33:26.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.404+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~PQ1DY2KPJGRL.0 size=1048576 2024-03-09T14:33:26.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.405+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~PQ1DY2KPJGRL.1 size=937939 2024-03-09T14:33:26.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.405+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=PQ1DY2KPJGRL tag=5CS4EDTXOPWN type=write size=3035091 2024-03-09T14:33:26.405 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.406+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~N0PSV0J1GK4H.0 size=406786 2024-03-09T14:33:26.407 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.408+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=N0PSV0J1GK4H tag=HOCUXO10HXVX type=write size=1455362 2024-03-09T14:33:26.408 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.409+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=2QNVU7SRNJ5S type=del size=15419 2024-03-09T14:33:26.409 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.410+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=ZR8ODEQATXIX type=del 2024-03-09T14:33:26.411 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.412+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~CIXR1OFLW6YH.0 size=1048576 2024-03-09T14:33:26.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.413+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~CIXR1OFLW6YH.1 size=1048576 2024-03-09T14:33:26.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.413+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~CIXR1OFLW6YH.2 size=1019519 2024-03-09T14:33:26.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.413+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=CIXR1OFLW6YH tag=B680RV7RW90N type=write size=4165247 2024-03-09T14:33:26.414 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.415+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=42DPGKZA33DI type=del 2024-03-09T14:33:26.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.417+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~NLB90M3U50AA.0 size=961734 2024-03-09T14:33:26.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.417+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=NLB90M3U50AA tag=ZICTI35IJFSJ type=write size=2010310 2024-03-09T14:33:26.417 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.418+0000 7f586ae3d780 1 < completed delete operation key=NHIOOLNXLZZC tag=ADNK9ASW6ZZ4 type=del 2024-03-09T14:33:26.419 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.420+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~0ES54REHW9PQ.0 size=1048576 2024-03-09T14:33:26.420 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.421+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~0ES54REHW9PQ.1 size=935688 2024-03-09T14:33:26.420 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.421+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=0ES54REHW9PQ tag=KTC7R5FU9X3Z type=write size=3032840 2024-03-09T14:33:26.421 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.422+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~BMPLVT91RD2A.0 size=1048576 2024-03-09T14:33:26.422 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.423+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~BMPLVT91RD2A.1 size=170033 2024-03-09T14:33:26.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.424+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=BMPLVT91RD2A tag=TFQS3ZIDEQ6U type=write size=2267185 2024-03-09T14:33:26.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.425+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=OYUKHKNH5T2T type=del size=3882318 2024-03-09T14:33:26.426 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.427+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~X1DBR0M1UPPC.0 size=829909 2024-03-09T14:33:26.428 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.429+0000 7f586ae3d780 1 < completed multipart upload key=39ZIGOC6JZ1R upload=X1DBR0M1UPPC tag=XM57DVYQPFGA type=write size=1878485 2024-03-09T14:33:26.429 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.430+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=1XBB2SGO4YNB type=del size=869667 2024-03-09T14:33:26.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.431+0000 7f586ae3d780 -1 < failed to complete operation key=CAISZZZSOD34 tag=PICIYL8FSSU2 type=del size=4161438: (22) Invalid argument 2024-03-09T14:33:26.431 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.432+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=WRN6M3VYEU0N type=write size=33607 2024-03-09T14:33:26.433 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.433+0000 7f586ae3d780 1 < completed write operation key=BHSYRD3IEJWW tag=CP9WIWEL6TA5 type=write size=51456 2024-03-09T14:33:26.434 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.434+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=IK4B8K6BPWPK type=write size=254637 2024-03-09T14:33:26.435 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.435+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~NX5XWJGYN4CP.0 size=1048576 2024-03-09T14:33:26.436 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.436+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~NX5XWJGYN4CP.1 size=662629 2024-03-09T14:33:26.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.438+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=NX5XWJGYN4CP tag=XC2F9QCW6C1V type=write size=2759781 2024-03-09T14:33:26.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.441+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~IO8W56H3UWPX.0 size=1048576 2024-03-09T14:33:26.441 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.441+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~IO8W56H3UWPX.1 size=661564 2024-03-09T14:33:26.441 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.441+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=IO8W56H3UWPX tag=UD8JH0LW58EL type=write size=2758716 2024-03-09T14:33:26.442 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.443+0000 7f586ae3d780 1 < completed write operation key=P3OUIQNAK1TC tag=I3XN26LPFOR4 type=write size=420515 2024-03-09T14:33:26.443 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.444+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=L6B5OEJCC0N0 type=del size=380830 2024-03-09T14:33:26.444 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.445+0000 7f586ae3d780 1 < canceled operation key=5PERWGS0GOJU tag=N8R17M8KU29M type=del size=3321634 2024-03-09T14:33:26.446 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.446+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=X40FL3A982M2 type=del size=2912332 2024-03-09T14:33:26.448 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.448+0000 7f586ae3d780 1 < suggested remove operation key=NHIOOLNXLZZC tag=EGC22CYE3N1Z type=write 2024-03-09T14:33:26.449 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.450+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=GLC427DH1X9F type=del size=1208364 2024-03-09T14:33:26.450 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.451+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=2502713HIBJ8 type=del 2024-03-09T14:33:26.451 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.452+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=X9FZAT2OJRM8 type=del size=3265295 2024-03-09T14:33:26.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.453+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~QZFZTN3MTJHD.0 size=1048576 2024-03-09T14:33:26.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.454+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~QZFZTN3MTJHD.1 size=1048576 2024-03-09T14:33:26.455 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.455+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~QZFZTN3MTJHD.2 size=967949 2024-03-09T14:33:26.458 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.459+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=QZFZTN3MTJHD tag=57Z026IJ7B1T type=write size=4113677 2024-03-09T14:33:26.459 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.460+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=GMA9L5J5KSOR type=del size=3738098 2024-03-09T14:33:26.461 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.461+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=YZ7EO39EP6DF type=del 2024-03-09T14:33:26.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.463+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~UZOORMC4XAUA.0 size=1048576 2024-03-09T14:33:26.464 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.464+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~UZOORMC4XAUA.1 size=1048576 2024-03-09T14:33:26.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.465+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~UZOORMC4XAUA.2 size=424216 2024-03-09T14:33:26.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.465+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=UZOORMC4XAUA tag=U9E8NA7756XQ type=write size=3569944 2024-03-09T14:33:26.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.466+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~PQ1DY2KPJGRL.0 size=1048576 2024-03-09T14:33:26.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.467+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~PQ1DY2KPJGRL.1 size=937939 2024-03-09T14:33:26.468 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.469+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=PQ1DY2KPJGRL tag=5CS4EDTXOPWN type=write size=3035091 2024-03-09T14:33:26.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.471+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~346CR1RHIUHR.0 size=740987 2024-03-09T14:33:26.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.471+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=346CR1RHIUHR tag=2WHUZR63TPHP type=write size=1789563 2024-03-09T14:33:26.472 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.472+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=2QNVU7SRNJ5S type=del 2024-03-09T14:33:26.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.473+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=YWRLSPI4BLNA type=del size=2083439 2024-03-09T14:33:26.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.474+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~CIXR1OFLW6YH.0 size=1048576 2024-03-09T14:33:26.475 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.475+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~CIXR1OFLW6YH.1 size=1048576 2024-03-09T14:33:26.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.476+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~CIXR1OFLW6YH.2 size=1019519 2024-03-09T14:33:26.478 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.478+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=CIXR1OFLW6YH tag=B680RV7RW90N type=write size=4165247 2024-03-09T14:33:26.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.479+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=4U88DD93HFO0 type=del size=1850234 2024-03-09T14:33:26.480 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.481+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~NLB90M3U50AA.0 size=961734 2024-03-09T14:33:26.482 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.482+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=NLB90M3U50AA tag=ZICTI35IJFSJ type=write size=2010310 2024-03-09T14:33:26.483 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.483+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=DMOJFCRIHMZQ type=del size=166355 2024-03-09T14:33:26.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.485+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~0ES54REHW9PQ.0 size=1048576 2024-03-09T14:33:26.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.486+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~0ES54REHW9PQ.1 size=935688 2024-03-09T14:33:26.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.487+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=0ES54REHW9PQ tag=KTC7R5FU9X3Z type=write size=3032840 2024-03-09T14:33:26.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.489+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=TRLB3MVUX7B2 type=del size=1044317 2024-03-09T14:33:26.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.490+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=OYUKHKNH5T2T type=del 2024-03-09T14:33:26.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.491+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=XP8R3OORNV9B type=del size=881060 2024-03-09T14:33:26.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.492+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=1XBB2SGO4YNB type=del 2024-03-09T14:33:26.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.493+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=HU2CAUMQ080C type=del size=1991486 2024-03-09T14:33:26.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.494+0000 7f586ae3d780 1 < completed write operation key=DJH53FNVMLGY tag=WRN6M3VYEU0N type=write size=33607 2024-03-09T14:33:26.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.496+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~XX6H0XBPOKI9.0 size=1048576 2024-03-09T14:33:26.497 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.497+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~XX6H0XBPOKI9.1 size=1048576 2024-03-09T14:33:26.497 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.498+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~XX6H0XBPOKI9.2 size=128189 2024-03-09T14:33:26.497 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.498+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=XX6H0XBPOKI9 tag=FFE3S88RIJ2I type=write size=3273917 2024-03-09T14:33:26.500 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.500+0000 7f586ae3d780 1 < suggested remove operation key=XIYWPXSYCT6I tag=IK4B8K6BPWPK type=write 2024-03-09T14:33:26.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.502+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~7BC73TQGZU2C.0 size=81926 2024-03-09T14:33:26.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.502+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=7BC73TQGZU2C tag=SJXTKYYBGBLX type=write size=1130502 2024-03-09T14:33:26.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.504+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~IO8W56H3UWPX.0 size=1048576 2024-03-09T14:33:26.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.504+0000 7f586ae3d780 1 < canceled part key=_multipart_CAISZZZSOD34.2~IO8W56H3UWPX.1 size=661564 2024-03-09T14:33:26.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.506+0000 7f586ae3d780 1 < canceled multipart upload key=CAISZZZSOD34 upload=IO8W56H3UWPX tag=UD8JH0LW58EL type=write size=2758716 2024-03-09T14:33:26.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.508+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~6TMGZ1URZY4E.0 size=1048576 2024-03-09T14:33:26.508 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.509+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~6TMGZ1URZY4E.1 size=488170 2024-03-09T14:33:26.508 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.509+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=6TMGZ1URZY4E tag=0GXZ6LMYLQZ1 type=write size=2585322 2024-03-09T14:33:26.509 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.510+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=L6B5OEJCC0N0 type=del 2024-03-09T14:33:26.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.512+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~HLUCAOFJHFAG.0 size=197343 2024-03-09T14:33:26.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.512+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=HLUCAOFJHFAG tag=88KT1MXELV14 type=write size=1245919 2024-03-09T14:33:26.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.513+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=X40FL3A982M2 type=del 2024-03-09T14:33:26.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.516+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~U88VOOC39PJW.0 size=238227 2024-03-09T14:33:26.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.516+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=U88VOOC39PJW tag=BPU1SWN8OR4F type=write size=1286803 2024-03-09T14:33:26.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.518+0000 7f586ae3d780 1 < suggested remove operation key=78Y2ZM3W6EUC tag=GLC427DH1X9F type=del 2024-03-09T14:33:26.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.519+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=TO6LUBZHCJGL type=del size=2423571 2024-03-09T14:33:26.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.520+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=X9FZAT2OJRM8 type=del 2024-03-09T14:33:26.521 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.521+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=L42MUJQODT5V type=del size=588093 2024-03-09T14:33:26.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.523+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=GMA9L5J5KSOR type=del 2024-03-09T14:33:26.523 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.524+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=QCH8NH67KW9R type=del size=3589337 2024-03-09T14:33:26.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.525+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~UZOORMC4XAUA.0 size=1048576 2024-03-09T14:33:26.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.526+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~UZOORMC4XAUA.1 size=1048576 2024-03-09T14:33:26.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.527+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~UZOORMC4XAUA.2 size=424216 2024-03-09T14:33:26.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.529+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=UZOORMC4XAUA tag=U9E8NA7756XQ type=write size=3569944 2024-03-09T14:33:26.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.532+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~ODC58J2YH119.0 size=1048576 2024-03-09T14:33:26.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.532+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~ODC58J2YH119.1 size=1048576 2024-03-09T14:33:26.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.533+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~ODC58J2YH119.2 size=520989 2024-03-09T14:33:26.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.533+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=ODC58J2YH119 tag=2NSDUB06Z5XC type=write size=3666717 2024-03-09T14:33:26.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.535+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~346CR1RHIUHR.0 size=740987 2024-03-09T14:33:26.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.537+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=346CR1RHIUHR tag=2WHUZR63TPHP type=write size=1789563 2024-03-09T14:33:26.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.539+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~HSLA9XDA9IVX.0 size=749355 2024-03-09T14:33:26.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.539+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=HSLA9XDA9IVX tag=Q9A950U6HV9V type=write size=1797931 2024-03-09T14:33:26.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.540+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=YWRLSPI4BLNA type=del 2024-03-09T14:33:26.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.543+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~CG2X2HVN8BU5.0 size=887942 2024-03-09T14:33:26.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.543+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=CG2X2HVN8BU5 tag=F6ZI6EXCE0RG type=write size=1936518 2024-03-09T14:33:26.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.544+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=4U88DD93HFO0 type=del 2024-03-09T14:33:26.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.545+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=Q1OXF33VATEE type=del size=2868458 2024-03-09T14:33:26.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.546+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=DMOJFCRIHMZQ type=del 2024-03-09T14:33:26.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.548+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=4SDQ82EHM1OR type=write size=860524 2024-03-09T14:33:26.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.549+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=TRLB3MVUX7B2 type=del 2024-03-09T14:33:26.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.551+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~7JATDP49IKHM.0 size=838606 2024-03-09T14:33:26.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.551+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=7JATDP49IKHM tag=OPBNDCB1QW9C type=write size=1887182 2024-03-09T14:33:26.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.553+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=XP8R3OORNV9B type=del 2024-03-09T14:33:26.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.554+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=I75LTCU53BFQ type=del size=2929577 2024-03-09T14:33:26.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.556+0000 7f586ae3d780 1 < suggested update operation key=CZGAXNJ0GKU0 tag=HU2CAUMQ080C type=del size=1991486 2024-03-09T14:33:26.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.559+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~BPO5CKCTY9KD.0 size=1048576 2024-03-09T14:33:26.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.560+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~BPO5CKCTY9KD.1 size=191942 2024-03-09T14:33:26.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.560+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=BPO5CKCTY9KD tag=ZKEECUTV0FUQ type=write size=2289094 2024-03-09T14:33:26.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.561+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~XX6H0XBPOKI9.0 size=1048576 2024-03-09T14:33:26.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.562+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~XX6H0XBPOKI9.1 size=1048576 2024-03-09T14:33:26.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.563+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~XX6H0XBPOKI9.2 size=128189 2024-03-09T14:33:26.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.565+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=XX6H0XBPOKI9 tag=FFE3S88RIJ2I type=write size=3273917 2024-03-09T14:33:26.568 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.569+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~G4B95012KWBE.0 size=1048576 2024-03-09T14:33:26.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.570+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~G4B95012KWBE.1 size=844081 2024-03-09T14:33:26.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.570+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=G4B95012KWBE tag=MG15ZBL7N1AG type=write size=2941233 2024-03-09T14:33:26.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.571+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~7BC73TQGZU2C.0 size=81926 2024-03-09T14:33:26.573 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.573+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=7BC73TQGZU2C tag=SJXTKYYBGBLX type=write size=1130502 2024-03-09T14:33:26.574 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.574+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=WBZRRXCTY9P3 type=del size=1238026 2024-03-09T14:33:26.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.576+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~6TMGZ1URZY4E.0 size=1048576 2024-03-09T14:33:26.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.576+0000 7f586ae3d780 1 < canceled part key=_multipart_5PERWGS0GOJU.2~6TMGZ1URZY4E.1 size=488170 2024-03-09T14:33:26.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.578+0000 7f586ae3d780 1 < canceled multipart upload key=5PERWGS0GOJU upload=6TMGZ1URZY4E tag=0GXZ6LMYLQZ1 type=write size=2585322 2024-03-09T14:33:26.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.580+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~JTANBWWRKHI5.0 size=1048576 2024-03-09T14:33:26.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.581+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~JTANBWWRKHI5.1 size=1048576 2024-03-09T14:33:26.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.582+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~JTANBWWRKHI5.2 size=211119 2024-03-09T14:33:26.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.582+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=JTANBWWRKHI5 tag=X3JW0GLE72LY type=write size=3356847 2024-03-09T14:33:26.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.584+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~HLUCAOFJHFAG.0 size=197343 2024-03-09T14:33:26.585 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.586+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=HLUCAOFJHFAG tag=88KT1MXELV14 type=write size=1245919 2024-03-09T14:33:26.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.587+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=GYU3Y0LD3EO1 type=del size=2308229 2024-03-09T14:33:26.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.588+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~U88VOOC39PJW.0 size=238227 2024-03-09T14:33:26.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.590+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=U88VOOC39PJW tag=BPU1SWN8OR4F type=write size=1286803 2024-03-09T14:33:26.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.593+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~8CZGKE01Q2HD.0 size=73208 2024-03-09T14:33:26.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.593+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=8CZGKE01Q2HD tag=SDLMMBPYMEOV type=write size=1121784 2024-03-09T14:33:26.593 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.594+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=TO6LUBZHCJGL type=del 2024-03-09T14:33:26.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.596+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~KKR606CQQT3U.0 size=1048576 2024-03-09T14:33:26.597 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.597+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~KKR606CQQT3U.1 size=17152 2024-03-09T14:33:26.597 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.597+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=KKR606CQQT3U tag=ZWUKAX9HZGNU type=write size=2114304 2024-03-09T14:33:26.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.598+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=L42MUJQODT5V type=del 2024-03-09T14:33:26.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.601+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~WIEF8YYE3GFZ.0 size=1048576 2024-03-09T14:33:26.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.602+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~WIEF8YYE3GFZ.1 size=328093 2024-03-09T14:33:26.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.602+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=WIEF8YYE3GFZ tag=L4ESGPF8UJ14 type=write size=2425245 2024-03-09T14:33:26.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.604+0000 7f586ae3d780 1 < suggested remove operation key=CZGAXNJ0GKU0 tag=QCH8NH67KW9R type=del 2024-03-09T14:33:26.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.606+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~XAADRBTKQR15.0 size=390943 2024-03-09T14:33:26.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.606+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=XAADRBTKQR15 tag=K87NXUKBEX09 type=write size=1439519 2024-03-09T14:33:26.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.607+0000 7f586ae3d780 1 < canceled part key=_multipart_39ZIGOC6JZ1R.2~ODC58J2YH119.0 size=1048576 2024-03-09T14:33:26.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.607+0000 7f586ae3d780 1 < canceled part key=_multipart_39ZIGOC6JZ1R.2~ODC58J2YH119.1 size=1048576 2024-03-09T14:33:26.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.608+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~ODC58J2YH119.2 size=520989 2024-03-09T14:33:26.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.610+0000 7f586ae3d780 1 < canceled multipart upload key=39ZIGOC6JZ1R upload=ODC58J2YH119 tag=2NSDUB06Z5XC type=write size=3666717 2024-03-09T14:33:26.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.612+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~VQPLMPDHOKTI.0 size=1048576 2024-03-09T14:33:26.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.613+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~VQPLMPDHOKTI.1 size=186906 2024-03-09T14:33:26.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.613+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=VQPLMPDHOKTI tag=R2PQ1V5Q1JLA type=write size=2284058 2024-03-09T14:33:26.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.614+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~HSLA9XDA9IVX.0 size=749355 2024-03-09T14:33:26.615 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.616+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=HSLA9XDA9IVX tag=Q9A950U6HV9V type=write size=1797931 2024-03-09T14:33:26.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.617+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=FOLCULXKD5US type=del size=1573558 2024-03-09T14:33:26.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.617+0000 7f586ae3d780 1 < canceled part key=_multipart_P3OUIQNAK1TC.2~CG2X2HVN8BU5.0 size=887942 2024-03-09T14:33:26.619 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.620+0000 7f586ae3d780 1 < canceled multipart upload key=P3OUIQNAK1TC upload=CG2X2HVN8BU5 tag=F6ZI6EXCE0RG type=write size=1936518 2024-03-09T14:33:26.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.621+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=SWW0DTOBUI0M type=del size=2402916 2024-03-09T14:33:26.622 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.622+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=Q1OXF33VATEE type=del 2024-03-09T14:33:26.623 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.623+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=5HJ0JJ1ZVK4G type=del size=590637 2024-03-09T14:33:26.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.626+0000 7f586ae3d780 1 < suggested update operation key=LRI2GKBGVCWW tag=4SDQ82EHM1OR type=write size=860524 2024-03-09T14:33:26.628 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.628+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~U4TOWNV4F6S3.0 size=896502 2024-03-09T14:33:26.628 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.628+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=U4TOWNV4F6S3 tag=I3RNJUVJG6SS type=write size=1945078 2024-03-09T14:33:26.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.630+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~7JATDP49IKHM.0 size=838606 2024-03-09T14:33:26.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.632+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=7JATDP49IKHM tag=OPBNDCB1QW9C type=write size=1887182 2024-03-09T14:33:26.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.633+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=39CK7OEUYQYU type=del size=660261 2024-03-09T14:33:26.634 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.634+0000 7f586ae3d780 -1 < failed to complete operation key=CZGAXNJ0GKU0 tag=I75LTCU53BFQ type=del size=2929577: (22) Invalid argument 2024-03-09T14:33:26.635 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.635+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=NRGP0ZBJXWDL type=del size=1286194 2024-03-09T14:33:26.636 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.637+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~BPO5CKCTY9KD.0 size=1048576 2024-03-09T14:33:26.637 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.638+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~BPO5CKCTY9KD.1 size=191942 2024-03-09T14:33:26.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.640+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=BPO5CKCTY9KD tag=ZKEECUTV0FUQ type=write size=2289094 2024-03-09T14:33:26.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.642+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=J0SGVOOS66BD type=del size=1791482 2024-03-09T14:33:26.643 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.643+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~G4B95012KWBE.0 size=1048576 2024-03-09T14:33:26.643 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.644+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~G4B95012KWBE.1 size=844081 2024-03-09T14:33:26.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.646+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=G4B95012KWBE tag=MG15ZBL7N1AG type=write size=2941233 2024-03-09T14:33:26.647 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.648+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~10YI225OKNZ2.0 size=926925 2024-03-09T14:33:26.647 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.648+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=10YI225OKNZ2 tag=H9SBYH5Y2RHF type=write size=1975501 2024-03-09T14:33:26.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.649+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=WBZRRXCTY9P3 type=del 2024-03-09T14:33:26.649 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.650+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=9RD0IY961B7M type=del size=1883840 2024-03-09T14:33:26.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.651+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~JTANBWWRKHI5.0 size=1048576 2024-03-09T14:33:26.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.652+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~JTANBWWRKHI5.1 size=1048576 2024-03-09T14:33:26.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.652+0000 7f586ae3d780 1 < canceled part key=_multipart_LRI2GKBGVCWW.2~JTANBWWRKHI5.2 size=211119 2024-03-09T14:33:26.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.655+0000 7f586ae3d780 1 < canceled multipart upload key=LRI2GKBGVCWW upload=JTANBWWRKHI5 tag=X3JW0GLE72LY type=write size=3356847 2024-03-09T14:33:26.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.657+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~V5TWMZ5MRYE5.0 size=981927 2024-03-09T14:33:26.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.657+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=V5TWMZ5MRYE5 tag=GI354TMASZL2 type=write size=2030503 2024-03-09T14:33:26.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.658+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=GYU3Y0LD3EO1 type=del 2024-03-09T14:33:26.660 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.660+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~L2PGU9A30JSB.0 size=1048576 2024-03-09T14:33:26.661 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.661+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~L2PGU9A30JSB.1 size=439720 2024-03-09T14:33:26.661 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.661+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=L2PGU9A30JSB tag=0HS34W3ZY6NA type=write size=2536872 2024-03-09T14:33:26.662 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.662+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~8CZGKE01Q2HD.0 size=73208 2024-03-09T14:33:26.664 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.664+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=8CZGKE01Q2HD tag=SDLMMBPYMEOV type=write size=1121784 2024-03-09T14:33:26.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.667+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~QMOVV04AE5SP.0 size=1048576 2024-03-09T14:33:26.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.668+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~QMOVV04AE5SP.1 size=808973 2024-03-09T14:33:26.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.668+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=QMOVV04AE5SP tag=WIB2TUEQWQO8 type=write size=2906125 2024-03-09T14:33:26.669 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.669+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~KKR606CQQT3U.0 size=1048576 2024-03-09T14:33:26.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.670+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~KKR606CQQT3U.1 size=17152 2024-03-09T14:33:26.672 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.672+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=KKR606CQQT3U tag=ZWUKAX9HZGNU type=write size=2114304 2024-03-09T14:33:26.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.674+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~AR62100JMKTN.0 size=1048576 2024-03-09T14:33:26.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.675+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~AR62100JMKTN.1 size=595923 2024-03-09T14:33:26.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.676+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=AR62100JMKTN tag=VJ3Y2SA383J2 type=write size=2693075 2024-03-09T14:33:26.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.677+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~WIEF8YYE3GFZ.0 size=1048576 2024-03-09T14:33:26.677 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.678+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~WIEF8YYE3GFZ.1 size=328093 2024-03-09T14:33:26.679 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.680+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=WIEF8YYE3GFZ tag=L4ESGPF8UJ14 type=write size=2425245 2024-03-09T14:33:26.680 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.681+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=QCZNPYQV28HC type=del size=78391 2024-03-09T14:33:26.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.683+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~XAADRBTKQR15.0 size=390943 2024-03-09T14:33:26.685 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.685+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=XAADRBTKQR15 tag=K87NXUKBEX09 type=write size=1439519 2024-03-09T14:33:26.686 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.686+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=6V269NX3KOB7 type=del size=55188 2024-03-09T14:33:26.687 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.687+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~VQPLMPDHOKTI.0 size=1048576 2024-03-09T14:33:26.688 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.688+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~VQPLMPDHOKTI.1 size=186906 2024-03-09T14:33:26.690 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.690+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=VQPLMPDHOKTI tag=R2PQ1V5Q1JLA type=write size=2284058 2024-03-09T14:33:26.691 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.692+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=2JO7NIQ1PJ9N type=del size=1058067 2024-03-09T14:33:26.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.693+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=FOLCULXKD5US type=del 2024-03-09T14:33:26.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.694+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=OG4NC8HYZF0M type=del size=2242790 2024-03-09T14:33:26.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.695+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=SWW0DTOBUI0M type=del 2024-03-09T14:33:26.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.697+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~732XNFU0LBVU.0 size=658631 2024-03-09T14:33:26.697 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.697+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=732XNFU0LBVU tag=FUMS870UQFGO type=write size=1707207 2024-03-09T14:33:26.698 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.698+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=5HJ0JJ1ZVK4G type=del 2024-03-09T14:33:26.699 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.699+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=NOL1712PMM8F type=write size=592328 2024-03-09T14:33:26.700 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.701+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~U4TOWNV4F6S3.0 size=896502 2024-03-09T14:33:26.702 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.702+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=U4TOWNV4F6S3 tag=I3RNJUVJG6SS type=write size=1945078 2024-03-09T14:33:26.704 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.705+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~EV0M64DVC2HR.0 size=511515 2024-03-09T14:33:26.704 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.705+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=EV0M64DVC2HR tag=KG5FB6SDI3KW type=write size=1560091 2024-03-09T14:33:26.706 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.707+0000 7f586ae3d780 1 < suggested remove operation key=2BUCMVWK7J1V tag=39CK7OEUYQYU type=del 2024-03-09T14:33:26.707 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.708+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=PPA14JR57R5R type=del size=3618435 2024-03-09T14:33:26.710 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.710+0000 7f586ae3d780 1 < suggested update operation key=O5L6RC16RS8E tag=NRGP0ZBJXWDL type=del size=1286194 2024-03-09T14:33:26.711 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.712+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=GJ73828YUTDD type=del size=2482400 2024-03-09T14:33:26.712 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.713+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=J0SGVOOS66BD type=del 2024-03-09T14:33:26.713 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.714+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=JPEDKYS0NBJA type=del size=3874816 2024-03-09T14:33:26.714 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.715+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~10YI225OKNZ2.0 size=926925 2024-03-09T14:33:26.716 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.717+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=10YI225OKNZ2 tag=H9SBYH5Y2RHF type=write size=1975501 2024-03-09T14:33:26.718 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.719+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~RC3UJEV259U3.0 size=1048576 2024-03-09T14:33:26.719 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.720+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~RC3UJEV259U3.1 size=1048576 2024-03-09T14:33:26.720 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.721+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~RC3UJEV259U3.2 size=932505 2024-03-09T14:33:26.720 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.721+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=RC3UJEV259U3 tag=LXLPR5CTIGAP type=write size=4078233 2024-03-09T14:33:26.721 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.722+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=9RD0IY961B7M type=del 2024-03-09T14:33:26.723 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.723+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=WG3L3QTO0P2X type=del size=22607 2024-03-09T14:33:26.724 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.724+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~V5TWMZ5MRYE5.0 size=981927 2024-03-09T14:33:26.726 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.726+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=V5TWMZ5MRYE5 tag=GI354TMASZL2 type=write size=2030503 2024-03-09T14:33:26.728 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.729+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~2M0PKKYQBGM0.0 size=1048576 2024-03-09T14:33:26.729 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.729+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~2M0PKKYQBGM0.1 size=1048576 2024-03-09T14:33:26.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.730+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~2M0PKKYQBGM0.2 size=834447 2024-03-09T14:33:26.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.730+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=2M0PKKYQBGM0 tag=UVVFKZXV1MQC type=write size=3980175 2024-03-09T14:33:26.731 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.732+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~L2PGU9A30JSB.0 size=1048576 2024-03-09T14:33:26.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.733+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~L2PGU9A30JSB.1 size=439720 2024-03-09T14:33:26.734 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.735+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=L2PGU9A30JSB tag=0HS34W3ZY6NA type=write size=2536872 2024-03-09T14:33:26.735 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.736+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=DIQ53N7VRF15 type=del size=1468742 2024-03-09T14:33:26.736 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.737+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~QMOVV04AE5SP.0 size=1048576 2024-03-09T14:33:26.737 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.738+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~QMOVV04AE5SP.1 size=808973 2024-03-09T14:33:26.741 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.742+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=QMOVV04AE5SP tag=WIB2TUEQWQO8 type=write size=2906125 2024-03-09T14:33:26.743 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.744+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~UPT8E1C29LWB.0 size=1048576 2024-03-09T14:33:26.744 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.745+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~UPT8E1C29LWB.1 size=932505 2024-03-09T14:33:26.744 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.745+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=UPT8E1C29LWB tag=83UDW6QV87FT type=write size=3029657 2024-03-09T14:33:26.745 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.746+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~AR62100JMKTN.0 size=1048576 2024-03-09T14:33:26.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.747+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~AR62100JMKTN.1 size=595923 2024-03-09T14:33:26.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.749+0000 7f586ae3d780 1 < completed multipart upload key=IK528ND96157 upload=AR62100JMKTN tag=VJ3Y2SA383J2 type=write size=2693075 2024-03-09T14:33:26.751 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.751+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~S2U3WB3UBH15.0 size=879161 2024-03-09T14:33:26.751 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.751+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=S2U3WB3UBH15 tag=0D0L0E30KAYB type=write size=1927737 2024-03-09T14:33:26.752 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.752+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=QCZNPYQV28HC type=del 2024-03-09T14:33:26.753 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.754+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=C5M8Q8MHESPL type=del size=3124842 2024-03-09T14:33:26.754 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.755+0000 7f586ae3d780 1 < canceled operation key=39ZIGOC6JZ1R tag=6V269NX3KOB7 type=del size=55188 2024-03-09T14:33:26.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.757+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~M7ESO7YUGOEX.0 size=1048576 2024-03-09T14:33:26.757 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.758+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~M7ESO7YUGOEX.1 size=758353 2024-03-09T14:33:26.757 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.758+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=M7ESO7YUGOEX tag=8SBCEFS0DAT4 type=write size=2855505 2024-03-09T14:33:26.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.759+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=2JO7NIQ1PJ9N type=del 2024-03-09T14:33:26.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.761+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~2QVDVDXPV16E.0 size=453878 2024-03-09T14:33:26.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.761+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=2QVDVDXPV16E tag=2GT3J0O3EE2B type=write size=1502454 2024-03-09T14:33:26.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.762+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=OG4NC8HYZF0M type=del 2024-03-09T14:33:26.764 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.765+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~M3RRQWMBY104.0 size=1048576 2024-03-09T14:33:26.765 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.766+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~M3RRQWMBY104.1 size=1048576 2024-03-09T14:33:26.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.767+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~M3RRQWMBY104.2 size=740348 2024-03-09T14:33:26.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.767+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=M3RRQWMBY104 tag=ESR4UX86AQ7Y type=write size=3886076 2024-03-09T14:33:26.767 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.768+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~732XNFU0LBVU.0 size=658631 2024-03-09T14:33:26.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.770+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=732XNFU0LBVU tag=FUMS870UQFGO type=write size=1707207 2024-03-09T14:33:26.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.772+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~1X8U6A67GVQ7.0 size=164406 2024-03-09T14:33:26.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.772+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=1X8U6A67GVQ7 tag=JSNQ1KF7P40E type=write size=1212982 2024-03-09T14:33:26.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.773+0000 7f586ae3d780 1 < canceled operation key=DGO3ZT8ST90A tag=NOL1712PMM8F type=write size=592328 2024-03-09T14:33:26.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.774+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=HC4WJ7Z8ZYOC type=del size=2328661 2024-03-09T14:33:26.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.776+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~EV0M64DVC2HR.0 size=511515 2024-03-09T14:33:26.777 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.778+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=EV0M64DVC2HR tag=KG5FB6SDI3KW type=write size=1560091 2024-03-09T14:33:26.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.779+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=RXZ585HMXQM4 type=del size=1486711 2024-03-09T14:33:26.780 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.780+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=PPA14JR57R5R type=del 2024-03-09T14:33:26.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.782+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~3CVP4MI4E2FF.0 size=997755 2024-03-09T14:33:26.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.782+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=3CVP4MI4E2FF tag=UYTW3QLTIN1D type=write size=2046331 2024-03-09T14:33:26.783 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.784+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=GJ73828YUTDD type=del 2024-03-09T14:33:26.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.785+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=CZ7KOROMC8AD type=del size=1675401 2024-03-09T14:33:26.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.786+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=JPEDKYS0NBJA type=del 2024-03-09T14:33:26.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.787+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=DARFRDP7ETKF type=del size=1736520 2024-03-09T14:33:26.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.788+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~RC3UJEV259U3.0 size=1048576 2024-03-09T14:33:26.789 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.789+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~RC3UJEV259U3.1 size=1048576 2024-03-09T14:33:26.790 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.790+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~RC3UJEV259U3.2 size=932505 2024-03-09T14:33:26.792 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.792+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=RC3UJEV259U3 tag=LXLPR5CTIGAP type=write size=4078233 2024-03-09T14:33:26.794 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.795+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=48F95S2IKL2X type=del size=1140154 2024-03-09T14:33:26.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.796+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=WG3L3QTO0P2X type=del 2024-03-09T14:33:26.798 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.799+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=YN9GAHGFYE30 type=del size=2802878 2024-03-09T14:33:26.800 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.800+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~2M0PKKYQBGM0.0 size=1048576 2024-03-09T14:33:26.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.802+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~2M0PKKYQBGM0.1 size=1048576 2024-03-09T14:33:26.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.803+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~2M0PKKYQBGM0.2 size=834447 2024-03-09T14:33:26.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.805+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=2M0PKKYQBGM0 tag=UVVFKZXV1MQC type=write size=3980175 2024-03-09T14:33:26.806 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.807+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~IHV94E38HV5T.0 size=590030 2024-03-09T14:33:26.806 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.807+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=IHV94E38HV5T tag=LFQ98FCXYZ24 type=write size=1638606 2024-03-09T14:33:26.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.809+0000 7f586ae3d780 1 < suggested remove operation key=509F17DT0C4I tag=DIQ53N7VRF15 type=del 2024-03-09T14:33:26.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.810+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=KI7NVO1BB8O2 type=del size=3821878 2024-03-09T14:33:26.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.811+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~UPT8E1C29LWB.0 size=1048576 2024-03-09T14:33:26.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.812+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~UPT8E1C29LWB.1 size=932505 2024-03-09T14:33:26.814 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.814+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=UPT8E1C29LWB tag=83UDW6QV87FT type=write size=3029657 2024-03-09T14:33:26.816 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.816+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~7RCCQ9N40JM5.0 size=821090 2024-03-09T14:33:26.816 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.816+0000 7f586ae3d780 1 > prepared multipart upload key=C1UGQOQ6AE1E upload=7RCCQ9N40JM5 tag=GZ8WKWU3EB6R type=write size=1869666 2024-03-09T14:33:26.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.817+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~S2U3WB3UBH15.0 size=879161 2024-03-09T14:33:26.819 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.819+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=S2U3WB3UBH15 tag=0D0L0E30KAYB type=write size=1927737 2024-03-09T14:33:26.820 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.821+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=OTMGPDL0HQ61 type=del size=1135597 2024-03-09T14:33:26.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.822+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=C5M8Q8MHESPL type=del 2024-03-09T14:33:26.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.823+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=AWZU00IW0XDL type=del size=1648480 2024-03-09T14:33:26.824 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.824+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~M7ESO7YUGOEX.0 size=1048576 2024-03-09T14:33:26.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.825+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~M7ESO7YUGOEX.1 size=758353 2024-03-09T14:33:26.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.827+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=M7ESO7YUGOEX tag=8SBCEFS0DAT4 type=write size=2855505 2024-03-09T14:33:26.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.828+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=RFI6EJNZ5ZCT type=write size=889547 2024-03-09T14:33:26.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.830+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~2QVDVDXPV16E.0 size=453878 2024-03-09T14:33:26.831 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.832+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=2QVDVDXPV16E tag=2GT3J0O3EE2B type=write size=1502454 2024-03-09T14:33:26.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.833+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=524C6D1UXPR0 type=del size=4164648 2024-03-09T14:33:26.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.834+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~M3RRQWMBY104.0 size=1048576 2024-03-09T14:33:26.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.834+0000 7f586ae3d780 1 < canceled part key=_multipart_UAYZ55UT77VE.2~M3RRQWMBY104.1 size=1048576 2024-03-09T14:33:26.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.835+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~M3RRQWMBY104.2 size=740348 2024-03-09T14:33:26.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.837+0000 7f586ae3d780 1 < canceled multipart upload key=UAYZ55UT77VE upload=M3RRQWMBY104 tag=ESR4UX86AQ7Y type=write size=3886076 2024-03-09T14:33:26.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.838+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=UQHZIUH18H96 type=del size=467355 2024-03-09T14:33:26.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.839+0000 7f586ae3d780 1 < canceled part key=_multipart_CAISZZZSOD34.2~1X8U6A67GVQ7.0 size=164406 2024-03-09T14:33:26.840 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.841+0000 7f586ae3d780 1 < canceled multipart upload key=CAISZZZSOD34 upload=1X8U6A67GVQ7 tag=JSNQ1KF7P40E type=write size=1212982 2024-03-09T14:33:26.842 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.843+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~275EP4KW068T.0 size=1048576 2024-03-09T14:33:26.843 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.844+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~275EP4KW068T.1 size=33588 2024-03-09T14:33:26.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.844+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=275EP4KW068T tag=15A3C1OYNBW3 type=write size=2130740 2024-03-09T14:33:26.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.845+0000 7f586ae3d780 -1 < failed to complete operation key=509F17DT0C4I tag=HC4WJ7Z8ZYOC type=del size=2328661: (22) Invalid argument 2024-03-09T14:33:26.846 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.846+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=ADFJLZL0A0EL type=del size=3904732 2024-03-09T14:33:26.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.847+0000 7f586ae3d780 1 < canceled operation key=78Y2ZM3W6EUC tag=RXZ585HMXQM4 type=del size=1486711 2024-03-09T14:33:26.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.849+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~KTWNKMZG98QV.0 size=170057 2024-03-09T14:33:26.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.849+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=KTWNKMZG98QV tag=MFJIBU7SIRBY type=write size=1218633 2024-03-09T14:33:26.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.851+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~3CVP4MI4E2FF.0 size=997755 2024-03-09T14:33:26.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.853+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=3CVP4MI4E2FF tag=UYTW3QLTIN1D type=write size=2046331 2024-03-09T14:33:26.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.855+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~BBDLUK1Q6WEA.0 size=1048576 2024-03-09T14:33:26.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.856+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~BBDLUK1Q6WEA.1 size=354376 2024-03-09T14:33:26.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.856+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=BBDLUK1Q6WEA tag=3KWY58M92B5Q type=write size=2451528 2024-03-09T14:33:26.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.857+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=CZ7KOROMC8AD type=del 2024-03-09T14:33:26.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.858+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=B1WFJ6XIBJAJ type=del size=1295006 2024-03-09T14:33:26.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.859+0000 7f586ae3d780 1 < canceled operation key=5PERWGS0GOJU tag=DARFRDP7ETKF type=del size=1736520 2024-03-09T14:33:26.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.861+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~X3VZA6P0733Z.0 size=1048576 2024-03-09T14:33:26.862 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.862+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~X3VZA6P0733Z.1 size=124385 2024-03-09T14:33:26.862 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.862+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=X3VZA6P0733Z tag=EZBY48KF4XPE type=write size=2221537 2024-03-09T14:33:26.863 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.863+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=48F95S2IKL2X type=del 2024-03-09T14:33:26.865 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.865+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~WAOI5KKQD9B7.0 size=1048576 2024-03-09T14:33:26.866 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.866+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~WAOI5KKQD9B7.1 size=731811 2024-03-09T14:33:26.866 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.866+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=WAOI5KKQD9B7 tag=M9VOZSCE122V type=write size=2828963 2024-03-09T14:33:26.867 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.867+0000 7f586ae3d780 -1 < failed to complete operation key=509F17DT0C4I tag=YN9GAHGFYE30 type=del size=2802878: (22) Invalid argument 2024-03-09T14:33:26.868 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.868+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=WMDQJFMU0Q2T type=del size=3856589 2024-03-09T14:33:26.869 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.869+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~IHV94E38HV5T.0 size=590030 2024-03-09T14:33:26.871 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.871+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=IHV94E38HV5T tag=LFQ98FCXYZ24 type=write size=1638606 2024-03-09T14:33:26.873 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.872+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=Z1DR5QXQSYC1 type=del size=2478948 2024-03-09T14:33:26.873 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.874+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=KI7NVO1BB8O2 type=del 2024-03-09T14:33:26.874 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.875+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=7HIW083CEAZV type=del size=3573049 2024-03-09T14:33:26.875 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.876+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~7RCCQ9N40JM5.0 size=821090 2024-03-09T14:33:26.877 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.878+0000 7f586ae3d780 1 < completed multipart upload key=C1UGQOQ6AE1E upload=7RCCQ9N40JM5 tag=GZ8WKWU3EB6R type=write size=1869666 2024-03-09T14:33:26.878 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.879+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=NGUGAOL3SJCW type=del size=3542026 2024-03-09T14:33:26.880 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.880+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=OTMGPDL0HQ61 type=del 2024-03-09T14:33:26.882 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.882+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~ZUH3SY2AW0LG.0 size=441950 2024-03-09T14:33:26.882 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.882+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=ZUH3SY2AW0LG tag=GFCDR4MB4TR7 type=write size=1490526 2024-03-09T14:33:26.883 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.883+0000 7f586ae3d780 1 < canceled operation key=WNVN3EOUUBGR tag=AWZU00IW0XDL type=del size=1648480 2024-03-09T14:33:26.884 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.884+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=X9Z0K256Q3W6 type=write size=199342 2024-03-09T14:33:26.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.887+0000 7f586ae3d780 1 < suggested remove operation key=C1UGQOQ6AE1E tag=RFI6EJNZ5ZCT type=write 2024-03-09T14:33:26.888 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.889+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~CDDHF8RP86JT.0 size=1048576 2024-03-09T14:33:26.889 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.890+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~CDDHF8RP86JT.1 size=268826 2024-03-09T14:33:26.889 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.890+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=CDDHF8RP86JT tag=2V65X3OOSANL type=write size=2365978 2024-03-09T14:33:26.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.892+0000 7f586ae3d780 1 < suggested update operation key=04E9KDGUC274 tag=524C6D1UXPR0 type=del size=4164648 2024-03-09T14:33:26.893 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.893+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=OBIK3D3HYO45 type=del size=1629236 2024-03-09T14:33:26.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.894+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=UQHZIUH18H96 type=del 2024-03-09T14:33:26.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.896+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=2TK9WOIA0812 type=del size=2629913 2024-03-09T14:33:26.896 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.897+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~275EP4KW068T.0 size=1048576 2024-03-09T14:33:26.897 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.898+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~275EP4KW068T.1 size=33588 2024-03-09T14:33:26.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.900+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=275EP4KW068T tag=15A3C1OYNBW3 type=write size=2130740 2024-03-09T14:33:26.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.901+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=1EV5MZ7RJEWQ type=write size=776289 2024-03-09T14:33:26.902 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.902+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=ADFJLZL0A0EL type=del 2024-03-09T14:33:26.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.903+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=Z809883XNV83 type=del size=1128179 2024-03-09T14:33:26.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.905+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~KTWNKMZG98QV.0 size=170057 2024-03-09T14:33:26.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.908+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=KTWNKMZG98QV tag=MFJIBU7SIRBY type=write size=1218633 2024-03-09T14:33:26.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.909+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=N5OJ9PVIP3VK type=write size=218524 2024-03-09T14:33:26.910 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.911+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~BBDLUK1Q6WEA.0 size=1048576 2024-03-09T14:33:26.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.912+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~BBDLUK1Q6WEA.1 size=354376 2024-03-09T14:33:26.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.914+0000 7f586ae3d780 1 < completed multipart upload key=LRI2GKBGVCWW upload=BBDLUK1Q6WEA tag=3KWY58M92B5Q type=write size=2451528 2024-03-09T14:33:26.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.916+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~5L3N8B40GGA2.0 size=1048576 2024-03-09T14:33:26.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.917+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~5L3N8B40GGA2.1 size=336603 2024-03-09T14:33:26.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.917+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=5L3N8B40GGA2 tag=UVOHI65295AN type=write size=2433755 2024-03-09T14:33:26.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.919+0000 7f586ae3d780 1 < suggested remove operation key=04E9KDGUC274 tag=B1WFJ6XIBJAJ type=del 2024-03-09T14:33:26.921 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.921+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~ZL1OPM4ZFU9T.0 size=1048576 2024-03-09T14:33:26.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.922+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~ZL1OPM4ZFU9T.1 size=1048576 2024-03-09T14:33:26.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.923+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~ZL1OPM4ZFU9T.2 size=889586 2024-03-09T14:33:26.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.923+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=ZL1OPM4ZFU9T tag=AHTWV602FVO2 type=write size=4035314 2024-03-09T14:33:26.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.925+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~X3VZA6P0733Z.0 size=1048576 2024-03-09T14:33:26.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.925+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~X3VZA6P0733Z.1 size=124385 2024-03-09T14:33:26.927 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.928+0000 7f586ae3d780 1 < completed multipart upload key=LRI2GKBGVCWW upload=X3VZA6P0733Z tag=EZBY48KF4XPE type=write size=2221537 2024-03-09T14:33:26.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.929+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=A9JNN3O1OOJ5 type=del size=1072866 2024-03-09T14:33:26.929 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.930+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~WAOI5KKQD9B7.0 size=1048576 2024-03-09T14:33:26.930 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.931+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~WAOI5KKQD9B7.1 size=731811 2024-03-09T14:33:26.932 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.933+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=WAOI5KKQD9B7 tag=M9VOZSCE122V type=write size=2828963 2024-03-09T14:33:26.935 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.935+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~C7GDG6VCFHS9.0 size=91936 2024-03-09T14:33:26.935 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.935+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=C7GDG6VCFHS9 tag=X1O5TSOTXG7N type=write size=1140512 2024-03-09T14:33:26.937 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.937+0000 7f586ae3d780 1 < suggested remove operation key=2BUCMVWK7J1V tag=WMDQJFMU0Q2T type=del 2024-03-09T14:33:26.938 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.939+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=134KKKCO86A7 type=del size=2506425 2024-03-09T14:33:26.940 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.940+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=Z1DR5QXQSYC1 type=del 2024-03-09T14:33:26.941 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.941+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=B1IMBU1GQSW9 type=del size=2044969 2024-03-09T14:33:26.942 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.943+0000 7f586ae3d780 -1 < failed to complete operation key=2BUCMVWK7J1V tag=7HIW083CEAZV type=del size=3573049: (22) Invalid argument 2024-03-09T14:33:26.943 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.944+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=LFBLS3Z8KZV5 type=del size=3647348 2024-03-09T14:33:26.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.945+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=NGUGAOL3SJCW type=del 2024-03-09T14:33:26.946 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.947+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=GJNQAUYM9S50 type=del size=2220982 2024-03-09T14:33:26.947 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.948+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~ZUH3SY2AW0LG.0 size=441950 2024-03-09T14:33:26.949 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.950+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=ZUH3SY2AW0LG tag=GFCDR4MB4TR7 type=write size=1490526 2024-03-09T14:33:26.952 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.952+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~N4VPUBK6HXCH.0 size=1048576 2024-03-09T14:33:26.953 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.953+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~N4VPUBK6HXCH.1 size=389820 2024-03-09T14:33:26.953 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.953+0000 7f586ae3d780 1 > prepared multipart upload key=C1UGQOQ6AE1E upload=N4VPUBK6HXCH tag=QKDN0IFC5QVK type=write size=2486972 2024-03-09T14:33:26.954 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.954+0000 7f586ae3d780 1 < canceled operation key=509F17DT0C4I tag=X9Z0K256Q3W6 type=write size=199342 2024-03-09T14:33:26.955 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.956+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=EYUDV2C57ZUI type=del size=4016469 2024-03-09T14:33:26.956 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.957+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~CDDHF8RP86JT.0 size=1048576 2024-03-09T14:33:26.957 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.958+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~CDDHF8RP86JT.1 size=268826 2024-03-09T14:33:26.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.960+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=CDDHF8RP86JT tag=2V65X3OOSANL type=write size=2365978 2024-03-09T14:33:26.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.961+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=34DHMG0RCUWO type=del size=1562914 2024-03-09T14:33:26.961 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.962+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=OBIK3D3HYO45 type=del 2024-03-09T14:33:26.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.964+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~TGP3LK77ZILA.0 size=874893 2024-03-09T14:33:26.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.964+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=TGP3LK77ZILA tag=7UNTI3LVNNSB type=write size=1923469 2024-03-09T14:33:26.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.965+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=2TK9WOIA0812 type=del 2024-03-09T14:33:26.966 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.967+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=EJ3BOU13LI6C type=del size=2567580 2024-03-09T14:33:26.968 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.968+0000 7f586ae3d780 1 < completed write operation key=W3HTK2F8ML3V tag=1EV5MZ7RJEWQ type=write size=776289 2024-03-09T14:33:26.970 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.971+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~XXAG42L6KBHK.0 size=1048576 2024-03-09T14:33:26.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.972+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~XXAG42L6KBHK.1 size=1048576 2024-03-09T14:33:26.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.973+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~XXAG42L6KBHK.2 size=445095 2024-03-09T14:33:26.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.973+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=XXAG42L6KBHK tag=7QHYPNKPFGVO type=write size=3590823 2024-03-09T14:33:26.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.974+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=Z809883XNV83 type=del 2024-03-09T14:33:26.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.975+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=FO3COYAHZY1T type=del size=2641202 2024-03-09T14:33:26.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.976+0000 7f586ae3d780 1 < completed write operation key=LRI2GKBGVCWW tag=N5OJ9PVIP3VK type=write size=218524 2024-03-09T14:33:26.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.977+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=21JB1I18ACEK type=del size=4080105 2024-03-09T14:33:26.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.979+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~5L3N8B40GGA2.0 size=1048576 2024-03-09T14:33:26.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.980+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~5L3N8B40GGA2.1 size=336603 2024-03-09T14:33:26.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.982+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=5L3N8B40GGA2 tag=UVOHI65295AN type=write size=2433755 2024-03-09T14:33:26.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.983+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=9X1PU383AT2L type=del size=3279587 2024-03-09T14:33:26.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.984+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~ZL1OPM4ZFU9T.0 size=1048576 2024-03-09T14:33:26.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.984+0000 7f586ae3d780 1 < canceled part key=_multipart_BHSYRD3IEJWW.2~ZL1OPM4ZFU9T.1 size=1048576 2024-03-09T14:33:26.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.985+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~ZL1OPM4ZFU9T.2 size=889586 2024-03-09T14:33:26.986 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.987+0000 7f586ae3d780 1 < canceled multipart upload key=BHSYRD3IEJWW upload=ZL1OPM4ZFU9T tag=AHTWV602FVO2 type=write size=4035314 2024-03-09T14:33:26.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.989+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~OGOCV8J8DR8B.0 size=390655 2024-03-09T14:33:26.989 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.989+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=OGOCV8J8DR8B tag=M15NOHP4NYJP type=write size=1439231 2024-03-09T14:33:26.990 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.990+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=A9JNN3O1OOJ5 type=del 2024-03-09T14:33:26.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.992+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~7F1JV8SXJIKM.0 size=1048576 2024-03-09T14:33:26.993 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.993+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~7F1JV8SXJIKM.1 size=1048576 2024-03-09T14:33:26.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.994+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~7F1JV8SXJIKM.2 size=333700 2024-03-09T14:33:26.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.994+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=7F1JV8SXJIKM tag=DSJLO3ZGTUVU type=write size=3479428 2024-03-09T14:33:26.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.995+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~C7GDG6VCFHS9.0 size=91936 2024-03-09T14:33:26.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.997+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=C7GDG6VCFHS9 tag=X1O5TSOTXG7N type=write size=1140512 2024-03-09T14:33:26.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.999+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~Z2PYLTSDK93I.0 size=452613 2024-03-09T14:33:26.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:26.999+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=Z2PYLTSDK93I tag=B9ZJA9LU1EMK type=write size=1501189 2024-03-09T14:33:27.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.001+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=134KKKCO86A7 type=del 2024-03-09T14:33:27.002 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.003+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~N3FJ7WO4WVAH.0 size=1048576 2024-03-09T14:33:27.003 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.004+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~N3FJ7WO4WVAH.1 size=1048576 2024-03-09T14:33:27.004 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.005+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~N3FJ7WO4WVAH.2 size=449010 2024-03-09T14:33:27.004 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.005+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=N3FJ7WO4WVAH tag=5SSRBIDWOZSS type=write size=3594738 2024-03-09T14:33:27.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.006+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=B1IMBU1GQSW9 type=del 2024-03-09T14:33:27.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.007+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=SADXKV6N6HWH type=del size=723854 2024-03-09T14:33:27.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.008+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=LFBLS3Z8KZV5 type=del 2024-03-09T14:33:27.010 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.011+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~Z2MJ9ZVPWO78.0 size=504068 2024-03-09T14:33:27.010 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.011+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=Z2MJ9ZVPWO78 tag=5M4YY15MDJ95 type=write size=1552644 2024-03-09T14:33:27.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.012+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=GJNQAUYM9S50 type=del 2024-03-09T14:33:27.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.014+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~2RRG3Z0M56EE.0 size=1048576 2024-03-09T14:33:27.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.015+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~2RRG3Z0M56EE.1 size=1003864 2024-03-09T14:33:27.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.015+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=2RRG3Z0M56EE tag=906YUX5GQ7HB type=write size=3101016 2024-03-09T14:33:27.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.016+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~N4VPUBK6HXCH.0 size=1048576 2024-03-09T14:33:27.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.016+0000 7f586ae3d780 1 < canceled part key=_multipart_C1UGQOQ6AE1E.2~N4VPUBK6HXCH.1 size=389820 2024-03-09T14:33:27.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.019+0000 7f586ae3d780 1 < canceled multipart upload key=C1UGQOQ6AE1E upload=N4VPUBK6HXCH tag=QKDN0IFC5QVK type=write size=2486972 2024-03-09T14:33:27.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.020+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=4NU3WYTIEPBW type=del size=664240 2024-03-09T14:33:27.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.021+0000 7f586ae3d780 1 < completed delete operation key=IK528ND96157 tag=EYUDV2C57ZUI type=del 2024-03-09T14:33:27.023 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.024+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~QEA11C8MQ10Y.0 size=1048576 2024-03-09T14:33:27.024 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.024+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~QEA11C8MQ10Y.1 size=631282 2024-03-09T14:33:27.024 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.024+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=QEA11C8MQ10Y tag=P2E494A0XEHG type=write size=2728434 2024-03-09T14:33:27.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.026+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=34DHMG0RCUWO type=del 2024-03-09T14:33:27.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.027+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=UCBVLK10HFUU type=write size=351983 2024-03-09T14:33:27.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.028+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~TGP3LK77ZILA.0 size=874893 2024-03-09T14:33:27.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.030+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=TGP3LK77ZILA tag=7UNTI3LVNNSB type=write size=1923469 2024-03-09T14:33:27.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.032+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~7JGSFQNK9RBG.0 size=1048576 2024-03-09T14:33:27.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.033+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~7JGSFQNK9RBG.1 size=1048576 2024-03-09T14:33:27.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.034+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~7JGSFQNK9RBG.2 size=589038 2024-03-09T14:33:27.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.034+0000 7f586ae3d780 1 > prepared multipart upload key=C1UGQOQ6AE1E upload=7JGSFQNK9RBG tag=R5IOC5SND77G type=write size=3734766 2024-03-09T14:33:27.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.035+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=EJ3BOU13LI6C type=del 2024-03-09T14:33:27.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.037+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~JC67W7KVSAJ1.0 size=305219 2024-03-09T14:33:27.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.037+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=JC67W7KVSAJ1 tag=S2CRR2OO51Y0 type=write size=1353795 2024-03-09T14:33:27.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.039+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~XXAG42L6KBHK.0 size=1048576 2024-03-09T14:33:27.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.040+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~XXAG42L6KBHK.1 size=1048576 2024-03-09T14:33:27.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.041+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~XXAG42L6KBHK.2 size=445095 2024-03-09T14:33:27.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.042+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=XXAG42L6KBHK tag=7QHYPNKPFGVO type=write size=3590823 2024-03-09T14:33:27.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.044+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=28V0H9D5C0PE type=del size=3184688 2024-03-09T14:33:27.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.045+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=FO3COYAHZY1T type=del 2024-03-09T14:33:27.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.047+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~PWSOG57ZPFVC.0 size=1048576 2024-03-09T14:33:27.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.048+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~PWSOG57ZPFVC.1 size=1048576 2024-03-09T14:33:27.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.049+0000 7f586ae3d780 1 > prepared part key=_multipart_P3OUIQNAK1TC.2~PWSOG57ZPFVC.2 size=722193 2024-03-09T14:33:27.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.049+0000 7f586ae3d780 1 > prepared multipart upload key=P3OUIQNAK1TC upload=PWSOG57ZPFVC tag=IE6GP4FY52G5 type=write size=3867921 2024-03-09T14:33:27.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.050+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=21JB1I18ACEK type=del 2024-03-09T14:33:27.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.052+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=B58QNAFQYI4P type=del size=717390 2024-03-09T14:33:27.053 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.053+0000 7f586ae3d780 1 < canceled operation key=BHSYRD3IEJWW tag=9X1PU383AT2L type=del size=3279587 2024-03-09T14:33:27.055 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.055+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~L095HJVKX6N6.0 size=680686 2024-03-09T14:33:27.055 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.055+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=L095HJVKX6N6 tag=FOCGFOMML3E1 type=write size=1729262 2024-03-09T14:33:27.056 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.057+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~OGOCV8J8DR8B.0 size=390655 2024-03-09T14:33:27.058 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.059+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=OGOCV8J8DR8B tag=M15NOHP4NYJP type=write size=1439231 2024-03-09T14:33:27.060 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.061+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~00B28K9VHHLF.0 size=1048576 2024-03-09T14:33:27.061 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.062+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~00B28K9VHHLF.1 size=1048576 2024-03-09T14:33:27.062 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.063+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~00B28K9VHHLF.2 size=203356 2024-03-09T14:33:27.062 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.063+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=00B28K9VHHLF tag=LAXDMH895M5Y type=write size=3349084 2024-03-09T14:33:27.063 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.064+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~7F1JV8SXJIKM.0 size=1048576 2024-03-09T14:33:27.064 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.065+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~7F1JV8SXJIKM.1 size=1048576 2024-03-09T14:33:27.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.066+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~7F1JV8SXJIKM.2 size=333700 2024-03-09T14:33:27.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.067+0000 7f586ae3d780 1 < completed multipart upload key=CAISZZZSOD34 upload=7F1JV8SXJIKM tag=DSJLO3ZGTUVU type=write size=3479428 2024-03-09T14:33:27.069 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.070+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~7K3XEC5FUGB1.0 size=1048576 2024-03-09T14:33:27.070 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.071+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~7K3XEC5FUGB1.1 size=1048576 2024-03-09T14:33:27.071 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.071+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~7K3XEC5FUGB1.2 size=687259 2024-03-09T14:33:27.071 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.071+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=7K3XEC5FUGB1 tag=5TLTCO43J5UE type=write size=3832987 2024-03-09T14:33:27.072 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.073+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~Z2PYLTSDK93I.0 size=452613 2024-03-09T14:33:27.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.074+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=Z2PYLTSDK93I tag=B9ZJA9LU1EMK type=write size=1501189 2024-03-09T14:33:27.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.077+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~51KK5CL7LSHE.0 size=1048576 2024-03-09T14:33:27.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.077+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~51KK5CL7LSHE.1 size=1048576 2024-03-09T14:33:27.078 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.078+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~51KK5CL7LSHE.2 size=594903 2024-03-09T14:33:27.078 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.078+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=51KK5CL7LSHE tag=PQZA9EQ6B9ED type=write size=3740631 2024-03-09T14:33:27.079 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.079+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~N3FJ7WO4WVAH.0 size=1048576 2024-03-09T14:33:27.079 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.079+0000 7f586ae3d780 1 < canceled part key=_multipart_509F17DT0C4I.2~N3FJ7WO4WVAH.1 size=1048576 2024-03-09T14:33:27.080 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.080+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~N3FJ7WO4WVAH.2 size=449010 2024-03-09T14:33:27.082 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.082+0000 7f586ae3d780 1 < canceled multipart upload key=509F17DT0C4I upload=N3FJ7WO4WVAH tag=5SSRBIDWOZSS type=write size=3594738 2024-03-09T14:33:27.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.084+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=S5NQZLRBPWJ5 type=del size=1990292 2024-03-09T14:33:27.084 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.085+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=SADXKV6N6HWH type=del 2024-03-09T14:33:27.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.086+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=RNJN6I5TVB7K type=del size=2981691 2024-03-09T14:33:27.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.088+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~Z2MJ9ZVPWO78.0 size=504068 2024-03-09T14:33:27.090 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.090+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=Z2MJ9ZVPWO78 tag=5M4YY15MDJ95 type=write size=1552644 2024-03-09T14:33:27.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.091+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=10I2W2U2FLJK type=del size=3958090 2024-03-09T14:33:27.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.093+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~2RRG3Z0M56EE.0 size=1048576 2024-03-09T14:33:27.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.094+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~2RRG3Z0M56EE.1 size=1003864 2024-03-09T14:33:27.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.096+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=2RRG3Z0M56EE tag=906YUX5GQ7HB type=write size=3101016 2024-03-09T14:33:27.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.097+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=18UEREHPS0F9 type=del size=632133 2024-03-09T14:33:27.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.098+0000 7f586ae3d780 1 < canceled operation key=57OR9DHRPDCZ tag=4NU3WYTIEPBW type=del size=664240 2024-03-09T14:33:27.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.099+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=22WFTGFWP9GS type=del size=297087 2024-03-09T14:33:27.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.100+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~QEA11C8MQ10Y.0 size=1048576 2024-03-09T14:33:27.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.101+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~QEA11C8MQ10Y.1 size=631282 2024-03-09T14:33:27.103 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.103+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=QEA11C8MQ10Y tag=P2E494A0XEHG type=write size=2728434 2024-03-09T14:33:27.105 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.105+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~MQECTHR10ND0.0 size=241390 2024-03-09T14:33:27.105 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.105+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=MQECTHR10ND0 tag=J9L8VK1RNF9A type=write size=1289966 2024-03-09T14:33:27.106 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.107+0000 7f586ae3d780 1 < completed write operation key=C1UGQOQ6AE1E tag=UCBVLK10HFUU type=write size=351983 2024-03-09T14:33:27.107 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.108+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=061Z3NP1S91Q type=del size=3608351 2024-03-09T14:33:27.108 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.109+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~7JGSFQNK9RBG.0 size=1048576 2024-03-09T14:33:27.109 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.110+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~7JGSFQNK9RBG.1 size=1048576 2024-03-09T14:33:27.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.111+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~7JGSFQNK9RBG.2 size=589038 2024-03-09T14:33:27.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.113+0000 7f586ae3d780 1 < completed multipart upload key=C1UGQOQ6AE1E upload=7JGSFQNK9RBG tag=R5IOC5SND77G type=write size=3734766 2024-03-09T14:33:27.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.115+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~TEL3DCXRGRKX.0 size=1048576 2024-03-09T14:33:27.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.116+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~TEL3DCXRGRKX.1 size=1048576 2024-03-09T14:33:27.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.117+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~TEL3DCXRGRKX.2 size=691736 2024-03-09T14:33:27.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.117+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=TEL3DCXRGRKX tag=KJL37BAZVDNY type=write size=3837464 2024-03-09T14:33:27.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.117+0000 7f586ae3d780 1 < canceled part key=_multipart_04E9KDGUC274.2~JC67W7KVSAJ1.0 size=305219 2024-03-09T14:33:27.119 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.119+0000 7f586ae3d780 1 < canceled multipart upload key=04E9KDGUC274 upload=JC67W7KVSAJ1 tag=S2CRR2OO51Y0 type=write size=1353795 2024-03-09T14:33:27.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.120+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=C926OA3FXUIA type=del size=1802944 2024-03-09T14:33:27.121 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.122+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=28V0H9D5C0PE type=del 2024-03-09T14:33:27.122 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.123+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=PAH5HHB5EZSN type=del size=752880 2024-03-09T14:33:27.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.124+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~PWSOG57ZPFVC.0 size=1048576 2024-03-09T14:33:27.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.125+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~PWSOG57ZPFVC.1 size=1048576 2024-03-09T14:33:27.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.126+0000 7f586ae3d780 1 < completed part key=_multipart_P3OUIQNAK1TC.2~PWSOG57ZPFVC.2 size=722193 2024-03-09T14:33:27.128 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.129+0000 7f586ae3d780 1 < completed multipart upload key=P3OUIQNAK1TC upload=PWSOG57ZPFVC tag=IE6GP4FY52G5 type=write size=3867921 2024-03-09T14:33:27.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.131+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~OXGFHBB4HUCV.0 size=1048576 2024-03-09T14:33:27.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.132+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~OXGFHBB4HUCV.1 size=638098 2024-03-09T14:33:27.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.132+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=OXGFHBB4HUCV tag=9NLAJFCEFVFO type=write size=2735250 2024-03-09T14:33:27.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.133+0000 7f586ae3d780 1 < canceled operation key=9ZPCSBP3P58P tag=B58QNAFQYI4P type=del size=717390 2024-03-09T14:33:27.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.135+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~F7JYWVN3S3J8.0 size=77508 2024-03-09T14:33:27.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.135+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=F7JYWVN3S3J8 tag=I4MO75H0KQM8 type=write size=1126084 2024-03-09T14:33:27.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.136+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~L095HJVKX6N6.0 size=680686 2024-03-09T14:33:27.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.138+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=L095HJVKX6N6 tag=FOCGFOMML3E1 type=write size=1729262 2024-03-09T14:33:27.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.140+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~HCXLV9R6T72U.0 size=1048576 2024-03-09T14:33:27.141 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.141+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~HCXLV9R6T72U.1 size=630273 2024-03-09T14:33:27.141 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.141+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=HCXLV9R6T72U tag=RK2TS3FCCZV2 type=write size=2727425 2024-03-09T14:33:27.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.142+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~00B28K9VHHLF.0 size=1048576 2024-03-09T14:33:27.143 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.143+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~00B28K9VHHLF.1 size=1048576 2024-03-09T14:33:27.144 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.144+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~00B28K9VHHLF.2 size=203356 2024-03-09T14:33:27.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.146+0000 7f586ae3d780 1 < completed multipart upload key=LRI2GKBGVCWW upload=00B28K9VHHLF tag=LAXDMH895M5Y type=write size=3349084 2024-03-09T14:33:27.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.147+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=SVMFZH0W311A type=write size=1021409 2024-03-09T14:33:27.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.149+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~7K3XEC5FUGB1.0 size=1048576 2024-03-09T14:33:27.149 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.150+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~7K3XEC5FUGB1.1 size=1048576 2024-03-09T14:33:27.150 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.151+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~7K3XEC5FUGB1.2 size=687259 2024-03-09T14:33:27.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.153+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=7K3XEC5FUGB1 tag=5TLTCO43J5UE type=write size=3832987 2024-03-09T14:33:27.154 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.155+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~2YNSPWVY88B3.0 size=248805 2024-03-09T14:33:27.154 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.155+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=2YNSPWVY88B3 tag=4T70LZQL1RSR type=write size=1297381 2024-03-09T14:33:27.155 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.156+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~51KK5CL7LSHE.0 size=1048576 2024-03-09T14:33:27.156 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.157+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~51KK5CL7LSHE.1 size=1048576 2024-03-09T14:33:27.157 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.158+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~51KK5CL7LSHE.2 size=594903 2024-03-09T14:33:27.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.160+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=51KK5CL7LSHE tag=PQZA9EQ6B9ED type=write size=3740631 2024-03-09T14:33:27.161 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.161+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=O0A072ZF124H type=write size=855137 2024-03-09T14:33:27.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.162+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=S5NQZLRBPWJ5 type=del 2024-03-09T14:33:27.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.164+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=URJ9F4IYI6VG type=del size=3970532 2024-03-09T14:33:27.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.166+0000 7f586ae3d780 1 < suggested remove operation key=UO072H74SHLP tag=RNJN6I5TVB7K type=del 2024-03-09T14:33:27.168 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.168+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~AWI0J616ECMC.0 size=634111 2024-03-09T14:33:27.168 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.168+0000 7f586ae3d780 1 > prepared multipart upload key=C1UGQOQ6AE1E upload=AWI0J616ECMC tag=BTZAM3GEFMK4 type=write size=1682687 2024-03-09T14:33:27.169 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.169+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=10I2W2U2FLJK type=del 2024-03-09T14:33:27.171 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.171+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~O4SOQA0MZPEG.0 size=1048576 2024-03-09T14:33:27.172 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.172+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~O4SOQA0MZPEG.1 size=1048576 2024-03-09T14:33:27.173 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.173+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~O4SOQA0MZPEG.2 size=568615 2024-03-09T14:33:27.173 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.173+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=O4SOQA0MZPEG tag=DI9FFE5LGSBM type=write size=3714343 2024-03-09T14:33:27.174 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.174+0000 7f586ae3d780 -1 < failed to complete operation key=UO072H74SHLP tag=18UEREHPS0F9 type=del size=632133: (22) Invalid argument 2024-03-09T14:33:27.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.175+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=JANZAXXKH4YQ type=del size=3426561 2024-03-09T14:33:27.176 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.177+0000 7f586ae3d780 1 < completed delete operation key=W4Q1MWHOQ4Y1 tag=22WFTGFWP9GS type=del 2024-03-09T14:33:27.177 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.178+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=X7FY0R809NF6 type=del size=2550892 2024-03-09T14:33:27.178 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.179+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~MQECTHR10ND0.0 size=241390 2024-03-09T14:33:27.182 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.181+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=MQECTHR10ND0 tag=J9L8VK1RNF9A type=write size=1289966 2024-03-09T14:33:27.182 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.183+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~PTOVEUAH2ZL3.0 size=798715 2024-03-09T14:33:27.182 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.183+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=PTOVEUAH2ZL3 tag=G87VLT14TEUF type=write size=1847291 2024-03-09T14:33:27.183 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.184+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=061Z3NP1S91Q type=del 2024-03-09T14:33:27.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.185+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=XROVO1JFLOL1 type=del size=2845152 2024-03-09T14:33:27.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.186+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~TEL3DCXRGRKX.0 size=1048576 2024-03-09T14:33:27.187 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.187+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~TEL3DCXRGRKX.1 size=1048576 2024-03-09T14:33:27.188 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.188+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~TEL3DCXRGRKX.2 size=691736 2024-03-09T14:33:27.190 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.190+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=TEL3DCXRGRKX tag=KJL37BAZVDNY type=write size=3837464 2024-03-09T14:33:27.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.191+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=FMEE42KFKRFM type=write size=129211 2024-03-09T14:33:27.192 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.193+0000 7f586ae3d780 1 < completed delete operation key=OU9IOY7J572N tag=C926OA3FXUIA type=del 2024-03-09T14:33:27.194 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.195+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~1BFMSOUA05XG.0 size=1048576 2024-03-09T14:33:27.195 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.195+0000 7f586ae3d780 1 > prepared part key=_multipart_CAISZZZSOD34.2~1BFMSOUA05XG.1 size=795351 2024-03-09T14:33:27.195 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.195+0000 7f586ae3d780 1 > prepared multipart upload key=CAISZZZSOD34 upload=1BFMSOUA05XG tag=LRB0L8KP111B type=write size=2892503 2024-03-09T14:33:27.196 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.197+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=PAH5HHB5EZSN type=del 2024-03-09T14:33:27.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.199+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~P5X8S1BOB5M8.0 size=1048576 2024-03-09T14:33:27.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.200+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~P5X8S1BOB5M8.1 size=1048576 2024-03-09T14:33:27.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.201+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~P5X8S1BOB5M8.2 size=550420 2024-03-09T14:33:27.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.201+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=P5X8S1BOB5M8 tag=UP61B8CWSN0Y type=write size=3696148 2024-03-09T14:33:27.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.202+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~OXGFHBB4HUCV.0 size=1048576 2024-03-09T14:33:27.203 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.203+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~OXGFHBB4HUCV.1 size=638098 2024-03-09T14:33:27.205 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.205+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=OXGFHBB4HUCV tag=9NLAJFCEFVFO type=write size=2735250 2024-03-09T14:33:27.207 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.207+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~J0W246RTKVZH.0 size=832730 2024-03-09T14:33:27.207 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.207+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=J0W246RTKVZH tag=QAX93GTHNPTX type=write size=1881306 2024-03-09T14:33:27.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.209+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~F7JYWVN3S3J8.0 size=77508 2024-03-09T14:33:27.210 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.211+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=F7JYWVN3S3J8 tag=I4MO75H0KQM8 type=write size=1126084 2024-03-09T14:33:27.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.212+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=PI8SAJ7S0KCV type=del size=1514622 2024-03-09T14:33:27.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.213+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~HCXLV9R6T72U.0 size=1048576 2024-03-09T14:33:27.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.214+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~HCXLV9R6T72U.1 size=630273 2024-03-09T14:33:27.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.216+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=HCXLV9R6T72U tag=RK2TS3FCCZV2 type=write size=2727425 2024-03-09T14:33:27.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.218+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~2V1LRXW83UDK.0 size=190527 2024-03-09T14:33:27.218 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.218+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=2V1LRXW83UDK tag=38P6E8ZSL2VR type=write size=1239103 2024-03-09T14:33:27.219 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.219+0000 7f586ae3d780 1 < completed write operation key=W3HTK2F8ML3V tag=SVMFZH0W311A type=write size=1021409 2024-03-09T14:33:27.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.221+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~5AHCV7PCVC1P.0 size=35340 2024-03-09T14:33:27.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.221+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=5AHCV7PCVC1P tag=23XFQURV3M4L type=write size=1083916 2024-03-09T14:33:27.222 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.222+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~2YNSPWVY88B3.0 size=248805 2024-03-09T14:33:27.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.224+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=2YNSPWVY88B3 tag=4T70LZQL1RSR type=write size=1297381 2024-03-09T14:33:27.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.225+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=5PZ59QIQBBIX type=del size=2134618 2024-03-09T14:33:27.226 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.227+0000 7f586ae3d780 1 < completed write operation key=IK528ND96157 tag=O0A072ZF124H type=write size=855137 2024-03-09T14:33:27.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.228+0000 7f586ae3d780 1 > prepared operation key=WNVN3EOUUBGR tag=9BOSJZ96JTQL type=del size=2625168 2024-03-09T14:33:27.228 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.229+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=URJ9F4IYI6VG type=del 2024-03-09T14:33:27.231 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.232+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~A9DNOI16GSI9.0 size=1048576 2024-03-09T14:33:27.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.233+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~A9DNOI16GSI9.1 size=820752 2024-03-09T14:33:27.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.233+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=A9DNOI16GSI9 tag=4NWQMSAQ8I78 type=write size=2917904 2024-03-09T14:33:27.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.234+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~AWI0J616ECMC.0 size=634111 2024-03-09T14:33:27.236 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.237+0000 7f586ae3d780 1 < completed multipart upload key=C1UGQOQ6AE1E upload=AWI0J616ECMC tag=BTZAM3GEFMK4 type=write size=1682687 2024-03-09T14:33:27.238 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.239+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~DI1C04ZOM258.0 size=1048576 2024-03-09T14:33:27.239 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.240+0000 7f586ae3d780 1 > prepared part key=_multipart_C1UGQOQ6AE1E.2~DI1C04ZOM258.1 size=955531 2024-03-09T14:33:27.239 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.240+0000 7f586ae3d780 1 > prepared multipart upload key=C1UGQOQ6AE1E upload=DI1C04ZOM258 tag=60R7QJMZO7NB type=write size=3052683 2024-03-09T14:33:27.240 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.241+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~O4SOQA0MZPEG.0 size=1048576 2024-03-09T14:33:27.241 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.242+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~O4SOQA0MZPEG.1 size=1048576 2024-03-09T14:33:27.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.243+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~O4SOQA0MZPEG.2 size=568615 2024-03-09T14:33:27.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.245+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=O4SOQA0MZPEG tag=DI9FFE5LGSBM type=write size=3714343 2024-03-09T14:33:27.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.246+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=4GFFYJAQTASC type=del size=3636109 2024-03-09T14:33:27.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.247+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=JANZAXXKH4YQ type=del 2024-03-09T14:33:27.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.248+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=32T20MX5F8CM type=del size=1366328 2024-03-09T14:33:27.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.250+0000 7f586ae3d780 1 < completed delete operation key=CZGAXNJ0GKU0 tag=X7FY0R809NF6 type=del 2024-03-09T14:33:27.250 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.251+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=1OXCRWS5ESU9 type=del size=4026811 2024-03-09T14:33:27.251 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.252+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~PTOVEUAH2ZL3.0 size=798715 2024-03-09T14:33:27.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.254+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=PTOVEUAH2ZL3 tag=G87VLT14TEUF type=write size=1847291 2024-03-09T14:33:27.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.255+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=Y164GDU21ALO type=write size=194652 2024-03-09T14:33:27.256 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.256+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=XROVO1JFLOL1 type=del 2024-03-09T14:33:27.257 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.258+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=C5T63UEB0NL8 type=del size=1120398 2024-03-09T14:33:27.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.259+0000 7f586ae3d780 1 < completed write operation key=OU9IOY7J572N tag=FMEE42KFKRFM type=write size=129211 2024-03-09T14:33:27.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.260+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=XXAM22GBKCLT type=del size=685635 2024-03-09T14:33:27.260 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.260+0000 7f586ae3d780 1 < canceled part key=_multipart_CAISZZZSOD34.2~1BFMSOUA05XG.0 size=1048576 2024-03-09T14:33:27.261 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.261+0000 7f586ae3d780 1 < completed part key=_multipart_CAISZZZSOD34.2~1BFMSOUA05XG.1 size=795351 2024-03-09T14:33:27.263 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.263+0000 7f586ae3d780 1 < canceled multipart upload key=CAISZZZSOD34 upload=1BFMSOUA05XG tag=LRB0L8KP111B type=write size=2892503 2024-03-09T14:33:27.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.265+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~EWQNOC2VQICA.0 size=1048576 2024-03-09T14:33:27.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.266+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~EWQNOC2VQICA.1 size=1048576 2024-03-09T14:33:27.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.267+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~EWQNOC2VQICA.2 size=438895 2024-03-09T14:33:27.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.267+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=EWQNOC2VQICA tag=TS9NILJINSWJ type=write size=3584623 2024-03-09T14:33:27.268 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.268+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~P5X8S1BOB5M8.0 size=1048576 2024-03-09T14:33:27.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.269+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~P5X8S1BOB5M8.1 size=1048576 2024-03-09T14:33:27.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.270+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~P5X8S1BOB5M8.2 size=550420 2024-03-09T14:33:27.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.272+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=P5X8S1BOB5M8 tag=UP61B8CWSN0Y type=write size=3696148 2024-03-09T14:33:27.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.273+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=X7KVC5KY2US3 type=del size=2370431 2024-03-09T14:33:27.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.273+0000 7f586ae3d780 1 < canceled part key=_multipart_FNZ3BNA7W12E.2~J0W246RTKVZH.0 size=832730 2024-03-09T14:33:27.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.275+0000 7f586ae3d780 1 < canceled multipart upload key=FNZ3BNA7W12E upload=J0W246RTKVZH tag=QAX93GTHNPTX type=write size=1881306 2024-03-09T14:33:27.276 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.277+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=EZX75T0FE12W type=write size=395623 2024-03-09T14:33:27.278 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.279+0000 7f586ae3d780 1 < suggested remove operation key=O5L6RC16RS8E tag=PI8SAJ7S0KCV type=del 2024-03-09T14:33:27.279 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.280+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=RN0NFUIYO1QT type=del size=618269 2024-03-09T14:33:27.281 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.281+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~2V1LRXW83UDK.0 size=190527 2024-03-09T14:33:27.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.283+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=2V1LRXW83UDK tag=38P6E8ZSL2VR type=write size=1239103 2024-03-09T14:33:27.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.284+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=3AW9YLFPRLLM type=del size=293729 2024-03-09T14:33:27.285 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.286+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~5AHCV7PCVC1P.0 size=35340 2024-03-09T14:33:27.287 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.288+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=5AHCV7PCVC1P tag=23XFQURV3M4L type=write size=1083916 2024-03-09T14:33:27.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.289+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=6D96HABKJTBC type=del size=3108711 2024-03-09T14:33:27.290 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.290+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=5PZ59QIQBBIX type=del 2024-03-09T14:33:27.291 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.291+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=Q6UVYYRSYH00 type=write size=546993 2024-03-09T14:33:27.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.293+0000 7f586ae3d780 1 < completed delete operation key=WNVN3EOUUBGR tag=9BOSJZ96JTQL type=del 2024-03-09T14:33:27.294 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.295+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~LQXA2XEJ9HAM.0 size=1048576 2024-03-09T14:33:27.295 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.296+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~LQXA2XEJ9HAM.1 size=1048576 2024-03-09T14:33:27.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.296+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~LQXA2XEJ9HAM.2 size=82770 2024-03-09T14:33:27.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.296+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=LQXA2XEJ9HAM tag=1LVQMLB83DDI type=write size=3228498 2024-03-09T14:33:27.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.298+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~A9DNOI16GSI9.0 size=1048576 2024-03-09T14:33:27.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.298+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~A9DNOI16GSI9.1 size=820752 2024-03-09T14:33:27.300 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.300+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=A9DNOI16GSI9 tag=4NWQMSAQ8I78 type=write size=2917904 2024-03-09T14:33:27.301 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.302+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=AT7MWLGF2PMW type=del size=2958989 2024-03-09T14:33:27.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.303+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~DI1C04ZOM258.0 size=1048576 2024-03-09T14:33:27.303 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.304+0000 7f586ae3d780 1 < completed part key=_multipart_C1UGQOQ6AE1E.2~DI1C04ZOM258.1 size=955531 2024-03-09T14:33:27.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.306+0000 7f586ae3d780 1 < completed multipart upload key=C1UGQOQ6AE1E upload=DI1C04ZOM258 tag=60R7QJMZO7NB type=write size=3052683 2024-03-09T14:33:27.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.308+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~WTXESRYJHYE0.0 size=225054 2024-03-09T14:33:27.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.308+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=WTXESRYJHYE0 tag=MPR7BE2V0CEE type=write size=1273630 2024-03-09T14:33:27.309 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.309+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=4GFFYJAQTASC type=del 2024-03-09T14:33:27.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.310+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=US2CFY2FE8HF type=del size=3296789 2024-03-09T14:33:27.311 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.311+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=32T20MX5F8CM type=del 2024-03-09T14:33:27.312 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.313+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=HXHAGT9DPB1H type=write size=892919 2024-03-09T14:33:27.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.314+0000 7f586ae3d780 1 < canceled operation key=OXBDXIILR3NS tag=1OXCRWS5ESU9 type=del size=4026811 2024-03-09T14:33:27.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.315+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=0Q55QVZ2TGSL type=del size=3048158 2024-03-09T14:33:27.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.316+0000 7f586ae3d780 1 < completed write operation key=DGO3ZT8ST90A tag=Y164GDU21ALO type=write size=194652 2024-03-09T14:33:27.317 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.318+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~GNJRZ2SY1AT1.0 size=1048576 2024-03-09T14:33:27.318 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.319+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~GNJRZ2SY1AT1.1 size=1048576 2024-03-09T14:33:27.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.320+0000 7f586ae3d780 1 > prepared part key=_multipart_DJH53FNVMLGY.2~GNJRZ2SY1AT1.2 size=751624 2024-03-09T14:33:27.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.320+0000 7f586ae3d780 1 > prepared multipart upload key=DJH53FNVMLGY upload=GNJRZ2SY1AT1 tag=9RL9ROB6AXRL type=write size=3897352 2024-03-09T14:33:27.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.321+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=C5T63UEB0NL8 type=del 2024-03-09T14:33:27.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.323+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~X23ENAQUMQ3K.0 size=1048576 2024-03-09T14:33:27.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.324+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~X23ENAQUMQ3K.1 size=852661 2024-03-09T14:33:27.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.324+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=X23ENAQUMQ3K tag=Z4JOB0M26NSJ type=write size=2949813 2024-03-09T14:33:27.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.326+0000 7f586ae3d780 1 < suggested update operation key=DGO3ZT8ST90A tag=XXAM22GBKCLT type=del size=685635 2024-03-09T14:33:27.327 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.327+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=TNV31LI9GOLB type=write size=886904 2024-03-09T14:33:27.328 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.328+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~EWQNOC2VQICA.0 size=1048576 2024-03-09T14:33:27.329 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.329+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~EWQNOC2VQICA.1 size=1048576 2024-03-09T14:33:27.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.330+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~EWQNOC2VQICA.2 size=438895 2024-03-09T14:33:27.332 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.332+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=EWQNOC2VQICA tag=TS9NILJINSWJ type=write size=3584623 2024-03-09T14:33:27.333 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.333+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=F05Z3SONQVSQ type=del size=1229077 2024-03-09T14:33:27.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.334+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=X7KVC5KY2US3 type=del 2024-03-09T14:33:27.336 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.336+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~6B36VG4JY0K3.0 size=1048576 2024-03-09T14:33:27.337 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.337+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~6B36VG4JY0K3.1 size=904741 2024-03-09T14:33:27.337 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.337+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=6B36VG4JY0K3 tag=Y8Q3AD64HOVU type=write size=3001893 2024-03-09T14:33:27.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.338+0000 7f586ae3d780 1 < completed write operation key=DJH53FNVMLGY tag=EZX75T0FE12W type=write size=395623 2024-03-09T14:33:27.339 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.340+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=UUE5RR03HM6Z type=del size=3852381 2024-03-09T14:33:27.340 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.341+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=RN0NFUIYO1QT type=del 2024-03-09T14:33:27.344 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.344+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~5ZWIZBC1JS43.0 size=755781 2024-03-09T14:33:27.344 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.344+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=5ZWIZBC1JS43 tag=D7J3GUKK0GI9 type=write size=1804357 2024-03-09T14:33:27.346 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.346+0000 7f586ae3d780 1 < suggested update operation key=W4Q1MWHOQ4Y1 tag=3AW9YLFPRLLM type=del size=293729 2024-03-09T14:33:27.347 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.348+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=JWXKWUSCQ8YF type=write size=396472 2024-03-09T14:33:27.348 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.349+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=6D96HABKJTBC type=del 2024-03-09T14:33:27.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.351+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~6FOXIEFUFFR6.0 size=1048576 2024-03-09T14:33:27.351 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.352+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~6FOXIEFUFFR6.1 size=1048576 2024-03-09T14:33:27.352 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.353+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~6FOXIEFUFFR6.2 size=720100 2024-03-09T14:33:27.352 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.353+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=6FOXIEFUFFR6 tag=2BID7Z9169NC type=write size=3865828 2024-03-09T14:33:27.353 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.354+0000 7f586ae3d780 1 < completed write operation key=UKPSUQ6LYWN8 tag=Q6UVYYRSYH00 type=write size=546993 2024-03-09T14:33:27.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.355+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=4EPU834K17F1 type=del size=1889670 2024-03-09T14:33:27.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.356+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~LQXA2XEJ9HAM.0 size=1048576 2024-03-09T14:33:27.357 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.357+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~LQXA2XEJ9HAM.1 size=1048576 2024-03-09T14:33:27.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.358+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~LQXA2XEJ9HAM.2 size=82770 2024-03-09T14:33:27.360 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.360+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=LQXA2XEJ9HAM tag=1LVQMLB83DDI type=write size=3228498 2024-03-09T14:33:27.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.362+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=IOOSEGBYF5P5 type=write size=1046643 2024-03-09T14:33:27.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.363+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=AT7MWLGF2PMW type=del 2024-03-09T14:33:27.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.364+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=33F8X147ME3L type=del size=3558510 2024-03-09T14:33:27.365 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.365+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~WTXESRYJHYE0.0 size=225054 2024-03-09T14:33:27.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.367+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=WTXESRYJHYE0 tag=MPR7BE2V0CEE type=write size=1273630 2024-03-09T14:33:27.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.368+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=M3308R07SGBV type=write size=47797 2024-03-09T14:33:27.370 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.371+0000 7f586ae3d780 1 < suggested update operation key=XIYWPXSYCT6I tag=US2CFY2FE8HF type=del size=3296789 2024-03-09T14:33:27.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.373+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~FRMTIGTUZI6C.0 size=1048576 2024-03-09T14:33:27.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.374+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~FRMTIGTUZI6C.1 size=29480 2024-03-09T14:33:27.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.374+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=FRMTIGTUZI6C tag=HFD9YOJCKV8A type=write size=2126632 2024-03-09T14:33:27.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.375+0000 7f586ae3d780 1 < completed write operation key=UKPSUQ6LYWN8 tag=HXHAGT9DPB1H type=write size=892919 2024-03-09T14:33:27.377 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.377+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~I3427VHU11KS.0 size=1048576 2024-03-09T14:33:27.377 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.378+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~I3427VHU11KS.1 size=307562 2024-03-09T14:33:27.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.378+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=I3427VHU11KS tag=ZOQS0EUHYAG1 type=write size=2404714 2024-03-09T14:33:27.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.380+0000 7f586ae3d780 1 < suggested update operation key=DGO3ZT8ST90A tag=0Q55QVZ2TGSL type=del size=3048158 2024-03-09T14:33:27.382 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.382+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~AV713AVM9Q57.0 size=953195 2024-03-09T14:33:27.382 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.382+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=AV713AVM9Q57 tag=P29OB6T9QA6G type=write size=2001771 2024-03-09T14:33:27.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.384+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~GNJRZ2SY1AT1.0 size=1048576 2024-03-09T14:33:27.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.385+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~GNJRZ2SY1AT1.1 size=1048576 2024-03-09T14:33:27.387 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.387+0000 7f586ae3d780 1 < completed part key=_multipart_DJH53FNVMLGY.2~GNJRZ2SY1AT1.2 size=751624 2024-03-09T14:33:27.389 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.389+0000 7f586ae3d780 1 < completed multipart upload key=DJH53FNVMLGY upload=GNJRZ2SY1AT1 tag=9RL9ROB6AXRL type=write size=3897352 2024-03-09T14:33:27.390 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.390+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=IXEKOBXTLS7P type=del size=3812775 2024-03-09T14:33:27.391 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.392+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~X23ENAQUMQ3K.0 size=1048576 2024-03-09T14:33:27.392 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.393+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~X23ENAQUMQ3K.1 size=852661 2024-03-09T14:33:27.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.394+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=X23ENAQUMQ3K tag=Z4JOB0M26NSJ type=write size=2949813 2024-03-09T14:33:27.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.396+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=OGV1BAH2VAO1 type=del size=730959 2024-03-09T14:33:27.396 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.397+0000 7f586ae3d780 -1 < failed to complete operation key=W4Q1MWHOQ4Y1 tag=TNV31LI9GOLB type=write size=886904: (22) Invalid argument 2024-03-09T14:33:27.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.398+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=82AD47D7HWA7 type=del size=1725409 2024-03-09T14:33:27.399 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.399+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=F05Z3SONQVSQ type=del 2024-03-09T14:33:27.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.401+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~WIC6X13S1O5H.0 size=1048576 2024-03-09T14:33:27.402 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.402+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~WIC6X13S1O5H.1 size=1048576 2024-03-09T14:33:27.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.404+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~WIC6X13S1O5H.2 size=506993 2024-03-09T14:33:27.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.404+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=WIC6X13S1O5H tag=OWPO8GEGFUWO type=write size=3652721 2024-03-09T14:33:27.405 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.405+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~6B36VG4JY0K3.0 size=1048576 2024-03-09T14:33:27.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.406+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~6B36VG4JY0K3.1 size=904741 2024-03-09T14:33:27.408 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.408+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=6B36VG4JY0K3 tag=Y8Q3AD64HOVU type=write size=3001893 2024-03-09T14:33:27.410 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.410+0000 7f586ae3d780 1 > prepared part key=_multipart_BHSYRD3IEJWW.2~ZZH3CO5ROV72.0 size=905446 2024-03-09T14:33:27.410 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.410+0000 7f586ae3d780 1 > prepared multipart upload key=BHSYRD3IEJWW upload=ZZH3CO5ROV72 tag=L3Y7LSUB8KNU type=write size=1954022 2024-03-09T14:33:27.411 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.412+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=UUE5RR03HM6Z type=del 2024-03-09T14:33:27.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.413+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=X4AV5WW0W4B3 type=del size=2364859 2024-03-09T14:33:27.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.414+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~5ZWIZBC1JS43.0 size=755781 2024-03-09T14:33:27.415 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.416+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=5ZWIZBC1JS43 tag=D7J3GUKK0GI9 type=write size=1804357 2024-03-09T14:33:27.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.417+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=WHKDMA3CXHJ0 type=del size=3804316 2024-03-09T14:33:27.417 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.418+0000 7f586ae3d780 1 < completed write operation key=9ZPCSBP3P58P tag=JWXKWUSCQ8YF type=write size=396472 2024-03-09T14:33:27.419 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.419+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=1BV8F4JSUH4E type=del size=3302657 2024-03-09T14:33:27.420 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.420+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~6FOXIEFUFFR6.0 size=1048576 2024-03-09T14:33:27.421 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.421+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~6FOXIEFUFFR6.1 size=1048576 2024-03-09T14:33:27.422 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.422+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~6FOXIEFUFFR6.2 size=720100 2024-03-09T14:33:27.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.424+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=6FOXIEFUFFR6 tag=2BID7Z9169NC type=write size=3865828 2024-03-09T14:33:27.426 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.426+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~GV59RZYJEK23.0 size=1048576 2024-03-09T14:33:27.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.427+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~GV59RZYJEK23.1 size=3027 2024-03-09T14:33:27.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.427+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=GV59RZYJEK23 tag=DSUDQVN3NL2A type=write size=2100179 2024-03-09T14:33:27.429 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.430+0000 7f586ae3d780 1 < suggested update operation key=BHSYRD3IEJWW tag=4EPU834K17F1 type=del size=1889670 2024-03-09T14:33:27.431 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.431+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=60D4WYULXF1U type=write size=97685 2024-03-09T14:33:27.432 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.432+0000 7f586ae3d780 1 < completed write operation key=OXBDXIILR3NS tag=IOOSEGBYF5P5 type=write size=1046643 2024-03-09T14:33:27.434 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.435+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~XDG7TPEBT8IU.0 size=350720 2024-03-09T14:33:27.434 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.435+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=XDG7TPEBT8IU tag=DYHKDI7ITVNL type=write size=1399296 2024-03-09T14:33:27.436 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.437+0000 7f586ae3d780 1 < suggested update operation key=OU9IOY7J572N tag=33F8X147ME3L type=del size=3558510 2024-03-09T14:33:27.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.438+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=91NERL6Q22QR type=del size=2176133 2024-03-09T14:33:27.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.439+0000 7f586ae3d780 -1 < failed to complete operation key=XIYWPXSYCT6I tag=M3308R07SGBV type=write size=47797: (22) Invalid argument 2024-03-09T14:33:27.441 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.441+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~93HK04JYJSVR.0 size=1048576 2024-03-09T14:33:27.442 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.442+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~93HK04JYJSVR.1 size=988790 2024-03-09T14:33:27.442 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.442+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=93HK04JYJSVR tag=M1IR5UFVSHYO type=write size=3085942 2024-03-09T14:33:27.443 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.444+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~FRMTIGTUZI6C.0 size=1048576 2024-03-09T14:33:27.444 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.445+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~FRMTIGTUZI6C.1 size=29480 2024-03-09T14:33:27.446 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.447+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=FRMTIGTUZI6C tag=HFD9YOJCKV8A type=write size=2126632 2024-03-09T14:33:27.447 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.448+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=0I9MDCPPU3GM type=del size=2324189 2024-03-09T14:33:27.448 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.448+0000 7f586ae3d780 1 < canceled part key=_multipart_6YWLPUULN5SY.2~I3427VHU11KS.0 size=1048576 2024-03-09T14:33:27.449 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.449+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~I3427VHU11KS.1 size=307562 2024-03-09T14:33:27.451 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.452+0000 7f586ae3d780 1 < canceled multipart upload key=6YWLPUULN5SY upload=I3427VHU11KS tag=ZOQS0EUHYAG1 type=write size=2404714 2024-03-09T14:33:27.452 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.453+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=YIY6RD6NG1D5 type=del size=2286915 2024-03-09T14:33:27.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.454+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~AV713AVM9Q57.0 size=953195 2024-03-09T14:33:27.457 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.458+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=AV713AVM9Q57 tag=P29OB6T9QA6G type=write size=2001771 2024-03-09T14:33:27.458 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.459+0000 7f586ae3d780 1 > prepared operation key=OXBDXIILR3NS tag=2FWM0Z4TSSEB type=del size=1114725 2024-03-09T14:33:27.459 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.460+0000 7f586ae3d780 1 < canceled operation key=IK528ND96157 tag=IXEKOBXTLS7P type=del size=3812775 2024-03-09T14:33:27.460 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.461+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=XOCZNXB022VL type=del size=3333925 2024-03-09T14:33:27.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.463+0000 7f586ae3d780 1 < suggested remove operation key=6YWLPUULN5SY tag=OGV1BAH2VAO1 type=del 2024-03-09T14:33:27.464 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.464+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=U9FC9CL30GUR type=del size=3428970 2024-03-09T14:33:27.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.466+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=82AD47D7HWA7 type=del 2024-03-09T14:33:27.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.467+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=6SWU96VL8E7N type=del size=2032121 2024-03-09T14:33:27.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.467+0000 7f586ae3d780 1 < canceled part key=_multipart_OXBDXIILR3NS.2~WIC6X13S1O5H.0 size=1048576 2024-03-09T14:33:27.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.467+0000 7f586ae3d780 1 < canceled part key=_multipart_OXBDXIILR3NS.2~WIC6X13S1O5H.1 size=1048576 2024-03-09T14:33:27.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.468+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~WIC6X13S1O5H.2 size=506993 2024-03-09T14:33:27.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.469+0000 7f586ae3d780 1 < canceled multipart upload key=OXBDXIILR3NS upload=WIC6X13S1O5H tag=OWPO8GEGFUWO type=write size=3652721 2024-03-09T14:33:27.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.471+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=5OIZXHDUWK9A type=del size=3272055 2024-03-09T14:33:27.471 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.472+0000 7f586ae3d780 1 < completed part key=_multipart_BHSYRD3IEJWW.2~ZZH3CO5ROV72.0 size=905446 2024-03-09T14:33:27.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.474+0000 7f586ae3d780 1 < completed multipart upload key=BHSYRD3IEJWW upload=ZZH3CO5ROV72 tag=L3Y7LSUB8KNU type=write size=1954022 2024-03-09T14:33:27.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.475+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=QIFEG5DZ5UG3 type=del size=346486 2024-03-09T14:33:27.475 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.476+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=X4AV5WW0W4B3 type=del 2024-03-09T14:33:27.477 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.477+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=VXW7W4TNXR6Y type=del size=187194 2024-03-09T14:33:27.478 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.478+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=WHKDMA3CXHJ0 type=del 2024-03-09T14:33:27.480 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.480+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~RWZ8KOYE3XJ5.0 size=1048576 2024-03-09T14:33:27.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.481+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~RWZ8KOYE3XJ5.1 size=668345 2024-03-09T14:33:27.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.481+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=RWZ8KOYE3XJ5 tag=IN0BDK6KGQ9P type=write size=2765497 2024-03-09T14:33:27.482 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.482+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=1BV8F4JSUH4E type=del 2024-03-09T14:33:27.483 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.483+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=SWF2I7AV4NVC type=del size=2591525 2024-03-09T14:33:27.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.484+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~GV59RZYJEK23.0 size=1048576 2024-03-09T14:33:27.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.485+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~GV59RZYJEK23.1 size=3027 2024-03-09T14:33:27.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.487+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=GV59RZYJEK23 tag=DSUDQVN3NL2A type=write size=2100179 2024-03-09T14:33:27.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.488+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=MZOW18UWLSUN type=del size=95708 2024-03-09T14:33:27.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.489+0000 7f586ae3d780 1 < completed write operation key=W3HTK2F8ML3V tag=60D4WYULXF1U type=write size=97685 2024-03-09T14:33:27.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.492+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~1LA70Z9QZ0IO.0 size=725502 2024-03-09T14:33:27.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.492+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=1LA70Z9QZ0IO tag=HW18MUW5ACHD type=write size=1774078 2024-03-09T14:33:27.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.492+0000 7f586ae3d780 1 < canceled part key=_multipart_W4Q1MWHOQ4Y1.2~XDG7TPEBT8IU.0 size=350720 2024-03-09T14:33:27.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.494+0000 7f586ae3d780 1 < canceled multipart upload key=W4Q1MWHOQ4Y1 upload=XDG7TPEBT8IU tag=DYHKDI7ITVNL type=write size=1399296 2024-03-09T14:33:27.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.496+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~KVYKJFG9FLDP.0 size=1048576 2024-03-09T14:33:27.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.497+0000 7f586ae3d780 1 > prepared part key=_multipart_IK528ND96157.2~KVYKJFG9FLDP.1 size=567116 2024-03-09T14:33:27.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.497+0000 7f586ae3d780 1 > prepared multipart upload key=IK528ND96157 upload=KVYKJFG9FLDP tag=KBH3QKIUACLQ type=write size=2664268 2024-03-09T14:33:27.498 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.499+0000 7f586ae3d780 1 < suggested update operation key=2BUCMVWK7J1V tag=91NERL6Q22QR type=del size=2176133 2024-03-09T14:33:27.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.501+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~92S0TW2Z87YV.0 size=1048576 2024-03-09T14:33:27.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.502+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~92S0TW2Z87YV.1 size=490763 2024-03-09T14:33:27.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.502+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=92S0TW2Z87YV tag=TVTP62CKL9D6 type=write size=2587915 2024-03-09T14:33:27.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.503+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~93HK04JYJSVR.0 size=1048576 2024-03-09T14:33:27.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.504+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~93HK04JYJSVR.1 size=988790 2024-03-09T14:33:27.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.506+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=93HK04JYJSVR tag=M1IR5UFVSHYO type=write size=3085942 2024-03-09T14:33:27.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.507+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=YTI6JUVII6MH type=del size=3351171 2024-03-09T14:33:27.509 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.509+0000 7f586ae3d780 1 < suggested remove operation key=CAISZZZSOD34 tag=0I9MDCPPU3GM type=del 2024-03-09T14:33:27.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.511+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~UPYNFLUB4L2G.0 size=406933 2024-03-09T14:33:27.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.511+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=UPYNFLUB4L2G tag=0A21OUZX4143 type=write size=1455509 2024-03-09T14:33:27.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.512+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=YIY6RD6NG1D5 type=del 2024-03-09T14:33:27.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.514+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~EK6XE0L2WQXO.0 size=1048576 2024-03-09T14:33:27.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.515+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~EK6XE0L2WQXO.1 size=1048576 2024-03-09T14:33:27.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.516+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~EK6XE0L2WQXO.2 size=552678 2024-03-09T14:33:27.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.516+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=EK6XE0L2WQXO tag=KMC5GCS3VA1L type=write size=3698406 2024-03-09T14:33:27.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.518+0000 7f586ae3d780 1 < completed delete operation key=OXBDXIILR3NS tag=2FWM0Z4TSSEB type=del 2024-03-09T14:33:27.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.519+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=R1F7EIR0C9H3 type=del size=2999220 2024-03-09T14:33:27.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.520+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=XOCZNXB022VL type=del 2024-03-09T14:33:27.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.522+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~7IAL18RTRF5W.0 size=729000 2024-03-09T14:33:27.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.522+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=7IAL18RTRF5W tag=SMC57HHUKNWK type=write size=1777576 2024-03-09T14:33:27.523 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.523+0000 7f586ae3d780 1 < canceled operation key=78Y2ZM3W6EUC tag=U9FC9CL30GUR type=del size=3428970 2024-03-09T14:33:27.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.525+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=HWE4VEBBJNVD type=del size=62017 2024-03-09T14:33:27.525 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.526+0000 7f586ae3d780 1 < canceled operation key=UAYZ55UT77VE tag=6SWU96VL8E7N type=del size=2032121 2024-03-09T14:33:27.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.528+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~VJ0IC93DTAS3.0 size=1048576 2024-03-09T14:33:27.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.528+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~VJ0IC93DTAS3.1 size=106059 2024-03-09T14:33:27.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.529+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=VJ0IC93DTAS3 tag=23MOREEPG2PU type=write size=2203211 2024-03-09T14:33:27.530 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.531+0000 7f586ae3d780 1 < suggested remove operation key=C1UGQOQ6AE1E tag=5OIZXHDUWK9A type=del 2024-03-09T14:33:27.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.532+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=4V2A2MKQOPU5 type=del size=3163614 2024-03-09T14:33:27.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.534+0000 7f586ae3d780 1 < suggested update operation key=C1UGQOQ6AE1E tag=QIFEG5DZ5UG3 type=del size=346486 2024-03-09T14:33:27.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.535+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=EO608AYWGEHD type=del size=2612384 2024-03-09T14:33:27.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.536+0000 7f586ae3d780 1 < completed delete operation key=39ZIGOC6JZ1R tag=VXW7W4TNXR6Y type=del 2024-03-09T14:33:27.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.538+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~X0J1GM6GETUQ.0 size=249050 2024-03-09T14:33:27.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.538+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=X0J1GM6GETUQ tag=8MUFMHE35JV4 type=write size=1297626 2024-03-09T14:33:27.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.540+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~RWZ8KOYE3XJ5.0 size=1048576 2024-03-09T14:33:27.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.541+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~RWZ8KOYE3XJ5.1 size=668345 2024-03-09T14:33:27.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.542+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=RWZ8KOYE3XJ5 tag=IN0BDK6KGQ9P type=write size=2765497 2024-03-09T14:33:27.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.544+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~QMQFBXZZV8AO.0 size=1048576 2024-03-09T14:33:27.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.545+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~QMQFBXZZV8AO.1 size=1048576 2024-03-09T14:33:27.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.546+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~QMQFBXZZV8AO.2 size=204007 2024-03-09T14:33:27.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.546+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=QMQFBXZZV8AO tag=11Y3LCEKS1X0 type=write size=3349735 2024-03-09T14:33:27.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.547+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=SWF2I7AV4NVC type=del 2024-03-09T14:33:27.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.548+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=MYDET0SA6G33 type=del size=308797 2024-03-09T14:33:27.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.549+0000 7f586ae3d780 -1 < failed to complete operation key=2BUCMVWK7J1V tag=MZOW18UWLSUN type=del size=95708: (22) Invalid argument 2024-03-09T14:33:27.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.552+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~JP8WRX7RHVQB.0 size=3452 2024-03-09T14:33:27.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.552+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=JP8WRX7RHVQB tag=U1D9W8YXUP2Z type=write size=1052028 2024-03-09T14:33:27.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.553+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~1LA70Z9QZ0IO.0 size=725502 2024-03-09T14:33:27.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.555+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=1LA70Z9QZ0IO tag=HW18MUW5ACHD type=write size=1774078 2024-03-09T14:33:27.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.557+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~IKHB00Y2D4EN.0 size=786434 2024-03-09T14:33:27.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.557+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=IKHB00Y2D4EN tag=R9EALF63QH9O type=write size=1835010 2024-03-09T14:33:27.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.558+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~KVYKJFG9FLDP.0 size=1048576 2024-03-09T14:33:27.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.559+0000 7f586ae3d780 1 < completed part key=_multipart_IK528ND96157.2~KVYKJFG9FLDP.1 size=567116 2024-03-09T14:33:27.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.561+0000 7f586ae3d780 1 < completed multipart upload key=IK528ND96157 upload=KVYKJFG9FLDP tag=KBH3QKIUACLQ type=write size=2664268 2024-03-09T14:33:27.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.564+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~YQ5TOJXCIENN.0 size=157873 2024-03-09T14:33:27.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.564+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=YQ5TOJXCIENN tag=2RHWBD5C4GR5 type=write size=1206449 2024-03-09T14:33:27.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.566+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~92S0TW2Z87YV.0 size=1048576 2024-03-09T14:33:27.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.567+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~92S0TW2Z87YV.1 size=490763 2024-03-09T14:33:27.568 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.569+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=92S0TW2Z87YV tag=TVTP62CKL9D6 type=write size=2587915 2024-03-09T14:33:27.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.571+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~JKI28MDDW62S.0 size=1048576 2024-03-09T14:33:27.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.571+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~JKI28MDDW62S.1 size=746137 2024-03-09T14:33:27.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.571+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=JKI28MDDW62S tag=T4ZXSPR1YHZ8 type=write size=2843289 2024-03-09T14:33:27.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.573+0000 7f586ae3d780 1 < canceled operation key=XIYWPXSYCT6I tag=YTI6JUVII6MH type=del size=3351171 2024-03-09T14:33:27.573 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.574+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=PKG4ELD86HZH type=del size=3885874 2024-03-09T14:33:27.574 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.575+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~UPYNFLUB4L2G.0 size=406933 2024-03-09T14:33:27.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.577+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=UPYNFLUB4L2G tag=0A21OUZX4143 type=write size=1455509 2024-03-09T14:33:27.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.578+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=7WYKYULBB0DG type=del size=3379519 2024-03-09T14:33:27.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.579+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~EK6XE0L2WQXO.0 size=1048576 2024-03-09T14:33:27.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.580+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~EK6XE0L2WQXO.1 size=1048576 2024-03-09T14:33:27.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.581+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~EK6XE0L2WQXO.2 size=552678 2024-03-09T14:33:27.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.583+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=EK6XE0L2WQXO tag=KMC5GCS3VA1L type=write size=3698406 2024-03-09T14:33:27.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.586+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~QUACINLQ341Q.0 size=1048576 2024-03-09T14:33:27.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.587+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~QUACINLQ341Q.1 size=468819 2024-03-09T14:33:27.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.587+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=QUACINLQ341Q tag=I3PHNCR2TSR6 type=write size=2565971 2024-03-09T14:33:27.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.588+0000 7f586ae3d780 1 < canceled operation key=IK528ND96157 tag=R1F7EIR0C9H3 type=del size=2999220 2024-03-09T14:33:27.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.590+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~1JAHDW5AVRZN.0 size=1048576 2024-03-09T14:33:27.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.591+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~1JAHDW5AVRZN.1 size=1048576 2024-03-09T14:33:27.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.592+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~1JAHDW5AVRZN.2 size=144861 2024-03-09T14:33:27.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.592+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=1JAHDW5AVRZN tag=7WKY7JB1YVOS type=write size=3290589 2024-03-09T14:33:27.593 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.593+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~7IAL18RTRF5W.0 size=729000 2024-03-09T14:33:27.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.595+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=7IAL18RTRF5W tag=SMC57HHUKNWK type=write size=1777576 2024-03-09T14:33:27.597 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.597+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~H5EKI34S18KZ.0 size=1048576 2024-03-09T14:33:27.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.598+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~H5EKI34S18KZ.1 size=1048576 2024-03-09T14:33:27.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.599+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~H5EKI34S18KZ.2 size=325671 2024-03-09T14:33:27.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.599+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=H5EKI34S18KZ tag=15YZOEB8UB1Y type=write size=3471399 2024-03-09T14:33:27.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.600+0000 7f586ae3d780 1 < canceled operation key=FNZ3BNA7W12E tag=HWE4VEBBJNVD type=del size=62017 2024-03-09T14:33:27.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.602+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~Y31AC34DT5H6.0 size=1048576 2024-03-09T14:33:27.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.604+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~Y31AC34DT5H6.1 size=1048576 2024-03-09T14:33:27.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.605+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~Y31AC34DT5H6.2 size=117785 2024-03-09T14:33:27.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.605+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=Y31AC34DT5H6 tag=EQSQI5YLBNR3 type=write size=3263513 2024-03-09T14:33:27.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.606+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~VJ0IC93DTAS3.0 size=1048576 2024-03-09T14:33:27.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.607+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~VJ0IC93DTAS3.1 size=106059 2024-03-09T14:33:27.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.609+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=VJ0IC93DTAS3 tag=23MOREEPG2PU type=write size=2203211 2024-03-09T14:33:27.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.610+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=VU6Z98GQGOTB type=del size=3935491 2024-03-09T14:33:27.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.612+0000 7f586ae3d780 1 < suggested update operation key=C1UGQOQ6AE1E tag=4V2A2MKQOPU5 type=del size=3163614 2024-03-09T14:33:27.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.613+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=W0QAK1SWD0OP type=del size=3486917 2024-03-09T14:33:27.615 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.615+0000 7f586ae3d780 1 < suggested update operation key=2BUCMVWK7J1V tag=EO608AYWGEHD type=del size=2612384 2024-03-09T14:33:27.616 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.617+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=JW2BVHO9AW98 type=del size=1192524 2024-03-09T14:33:27.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.618+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~X0J1GM6GETUQ.0 size=249050 2024-03-09T14:33:27.619 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.620+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=X0J1GM6GETUQ tag=8MUFMHE35JV4 type=write size=1297626 2024-03-09T14:33:27.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.622+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~GFU13YXSM670.0 size=1048576 2024-03-09T14:33:27.622 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.623+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~GFU13YXSM670.1 size=962460 2024-03-09T14:33:27.622 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.623+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=GFU13YXSM670 tag=4IXNXKBUZC13 type=write size=3059612 2024-03-09T14:33:27.623 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.624+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~QMQFBXZZV8AO.0 size=1048576 2024-03-09T14:33:27.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.625+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~QMQFBXZZV8AO.1 size=1048576 2024-03-09T14:33:27.625 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.626+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~QMQFBXZZV8AO.2 size=204007 2024-03-09T14:33:27.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.627+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=QMQFBXZZV8AO tag=11Y3LCEKS1X0 type=write size=3349735 2024-03-09T14:33:27.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.629+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~ML3SKO9DELSJ.0 size=1048576 2024-03-09T14:33:27.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.630+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~ML3SKO9DELSJ.1 size=537350 2024-03-09T14:33:27.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.630+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=ML3SKO9DELSJ tag=S13VD14V2I5Z type=write size=2634502 2024-03-09T14:33:27.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.631+0000 7f586ae3d780 1 < canceled operation key=6YWLPUULN5SY tag=MYDET0SA6G33 type=del size=308797 2024-03-09T14:33:27.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.633+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=S6GQFW4ADXGP type=del size=3673061 2024-03-09T14:33:27.633 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.634+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~JP8WRX7RHVQB.0 size=3452 2024-03-09T14:33:27.635 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.636+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=JP8WRX7RHVQB tag=U1D9W8YXUP2Z type=write size=1052028 2024-03-09T14:33:27.637 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.638+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~TT4T1FZZRGOE.0 size=1048576 2024-03-09T14:33:27.638 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.639+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~TT4T1FZZRGOE.1 size=1017267 2024-03-09T14:33:27.638 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.639+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=TT4T1FZZRGOE tag=S4GVZKOF1WZV type=write size=3114419 2024-03-09T14:33:27.639 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.640+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~IKHB00Y2D4EN.0 size=786434 2024-03-09T14:33:27.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.642+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=IKHB00Y2D4EN tag=R9EALF63QH9O type=write size=1835010 2024-03-09T14:33:27.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.643+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=FYHKAS9AD7EV type=del size=350992 2024-03-09T14:33:27.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.644+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~YQ5TOJXCIENN.0 size=157873 2024-03-09T14:33:27.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.646+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=YQ5TOJXCIENN tag=2RHWBD5C4GR5 type=write size=1206449 2024-03-09T14:33:27.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.648+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~TVVFWI03VAUH.0 size=1048576 2024-03-09T14:33:27.649 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.649+0000 7f586ae3d780 1 > prepared part key=_multipart_W3HTK2F8ML3V.2~TVVFWI03VAUH.1 size=383217 2024-03-09T14:33:27.649 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.649+0000 7f586ae3d780 1 > prepared multipart upload key=W3HTK2F8ML3V upload=TVVFWI03VAUH tag=F501306B63EU type=write size=2480369 2024-03-09T14:33:27.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.650+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~JKI28MDDW62S.0 size=1048576 2024-03-09T14:33:27.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.651+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~JKI28MDDW62S.1 size=746137 2024-03-09T14:33:27.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.653+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=JKI28MDDW62S tag=T4ZXSPR1YHZ8 type=write size=2843289 2024-03-09T14:33:27.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.654+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=GZV4KE1NVRPK type=del size=4027013 2024-03-09T14:33:27.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.657+0000 7f586ae3d780 1 < suggested update operation key=9ZPCSBP3P58P tag=PKG4ELD86HZH type=del size=3885874 2024-03-09T14:33:27.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.658+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=GOLBAX7MHDG2 type=del size=43596 2024-03-09T14:33:27.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.659+0000 7f586ae3d780 1 < completed delete operation key=6YWLPUULN5SY tag=7WYKYULBB0DG type=del 2024-03-09T14:33:27.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.660+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=OTY23BHS6E3I type=del size=2611637 2024-03-09T14:33:27.661 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.661+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~QUACINLQ341Q.0 size=1048576 2024-03-09T14:33:27.661 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.662+0000 7f586ae3d780 1 < completed part key=_multipart_NHIOOLNXLZZC.2~QUACINLQ341Q.1 size=468819 2024-03-09T14:33:27.663 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.664+0000 7f586ae3d780 1 < completed multipart upload key=NHIOOLNXLZZC upload=QUACINLQ341Q tag=I3PHNCR2TSR6 type=write size=2565971 2024-03-09T14:33:27.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.666+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~8IEYE1X3G8LC.0 size=1048576 2024-03-09T14:33:27.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.667+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~8IEYE1X3G8LC.1 size=1048576 2024-03-09T14:33:27.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.668+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~8IEYE1X3G8LC.2 size=1018503 2024-03-09T14:33:27.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.668+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=8IEYE1X3G8LC tag=CMEI5JP6T17V type=write size=4164231 2024-03-09T14:33:27.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.670+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~1JAHDW5AVRZN.0 size=1048576 2024-03-09T14:33:27.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.671+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~1JAHDW5AVRZN.1 size=1048576 2024-03-09T14:33:27.671 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.672+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~1JAHDW5AVRZN.2 size=144861 2024-03-09T14:33:27.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.674+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=1JAHDW5AVRZN tag=7WKY7JB1YVOS type=write size=3290589 2024-03-09T14:33:27.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.675+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=K1YUBXN8Y45H type=del size=787451 2024-03-09T14:33:27.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.676+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~H5EKI34S18KZ.0 size=1048576 2024-03-09T14:33:27.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.677+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~H5EKI34S18KZ.1 size=1048576 2024-03-09T14:33:27.677 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.678+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~H5EKI34S18KZ.2 size=325671 2024-03-09T14:33:27.679 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.680+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=H5EKI34S18KZ tag=15YZOEB8UB1Y type=write size=3471399 2024-03-09T14:33:27.680 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.681+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=YUACQIV15E8S type=del size=3662369 2024-03-09T14:33:27.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.682+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~Y31AC34DT5H6.0 size=1048576 2024-03-09T14:33:27.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.683+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~Y31AC34DT5H6.1 size=1048576 2024-03-09T14:33:27.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.684+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~Y31AC34DT5H6.2 size=117785 2024-03-09T14:33:27.686 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.686+0000 7f586ae3d780 1 < completed multipart upload key=UKPSUQ6LYWN8 upload=Y31AC34DT5H6 tag=EQSQI5YLBNR3 type=write size=3263513 2024-03-09T14:33:27.687 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.687+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=DVBO4Z3TBNZZ type=del size=1115052 2024-03-09T14:33:27.688 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.689+0000 7f586ae3d780 1 < completed delete operation key=XIYWPXSYCT6I tag=VU6Z98GQGOTB type=del 2024-03-09T14:33:27.690 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.691+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~8KBMAUOOM1SV.0 size=644602 2024-03-09T14:33:27.690 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.691+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=8KBMAUOOM1SV tag=6LQ0M05QTMBB type=write size=1693178 2024-03-09T14:33:27.691 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.692+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=W0QAK1SWD0OP type=del 2024-03-09T14:33:27.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.693+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=S15OFA0FLRCT type=del size=1674319 2024-03-09T14:33:27.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.694+0000 7f586ae3d780 1 < canceled operation key=DGO3ZT8ST90A tag=JW2BVHO9AW98 type=del size=1192524 2024-03-09T14:33:27.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.696+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~HA2VADQ86YQ0.0 size=66232 2024-03-09T14:33:27.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.697+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=HA2VADQ86YQ0 tag=5BTX6GMP3T5Y type=write size=1114808 2024-03-09T14:33:27.697 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.698+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~GFU13YXSM670.0 size=1048576 2024-03-09T14:33:27.698 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.699+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~GFU13YXSM670.1 size=962460 2024-03-09T14:33:27.700 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.700+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=GFU13YXSM670 tag=4IXNXKBUZC13 type=write size=3059612 2024-03-09T14:33:27.701 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.702+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=T3HB1GVSL243 type=write size=626433 2024-03-09T14:33:27.702 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.703+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~ML3SKO9DELSJ.0 size=1048576 2024-03-09T14:33:27.703 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.704+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~ML3SKO9DELSJ.1 size=537350 2024-03-09T14:33:27.705 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.706+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=ML3SKO9DELSJ tag=S13VD14V2I5Z type=write size=2634502 2024-03-09T14:33:27.707 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.707+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=14UV82W7WEXP type=del size=829434 2024-03-09T14:33:27.709 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.710+0000 7f586ae3d780 1 < suggested update operation key=OU9IOY7J572N tag=S6GQFW4ADXGP type=del size=3673061 2024-03-09T14:33:27.710 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.711+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=DHH58S493X1X type=del size=1262124 2024-03-09T14:33:27.712 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.712+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~TT4T1FZZRGOE.0 size=1048576 2024-03-09T14:33:27.712 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.712+0000 7f586ae3d780 1 < canceled part key=_multipart_W4Q1MWHOQ4Y1.2~TT4T1FZZRGOE.1 size=1017267 2024-03-09T14:33:27.713 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.714+0000 7f586ae3d780 1 < canceled multipart upload key=W4Q1MWHOQ4Y1 upload=TT4T1FZZRGOE tag=S4GVZKOF1WZV type=write size=3114419 2024-03-09T14:33:27.716 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.716+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~OHE61SFL18QO.0 size=1048576 2024-03-09T14:33:27.716 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.717+0000 7f586ae3d780 1 > prepared part key=_multipart_XIYWPXSYCT6I.2~OHE61SFL18QO.1 size=940855 2024-03-09T14:33:27.717 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.717+0000 7f586ae3d780 1 > prepared multipart upload key=XIYWPXSYCT6I upload=OHE61SFL18QO tag=T3UUTMR3MPWL type=write size=3038007 2024-03-09T14:33:27.718 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.718+0000 7f586ae3d780 1 < completed delete operation key=O5L6RC16RS8E tag=FYHKAS9AD7EV type=del 2024-03-09T14:33:27.719 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.720+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=S4GJW8G0JVPD type=del size=1362810 2024-03-09T14:33:27.720 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.721+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~TVVFWI03VAUH.0 size=1048576 2024-03-09T14:33:27.721 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.722+0000 7f586ae3d780 1 < completed part key=_multipart_W3HTK2F8ML3V.2~TVVFWI03VAUH.1 size=383217 2024-03-09T14:33:27.724 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.724+0000 7f586ae3d780 1 < completed multipart upload key=W3HTK2F8ML3V upload=TVVFWI03VAUH tag=F501306B63EU type=write size=2480369 2024-03-09T14:33:27.726 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.726+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~GLILTG8E5CGZ.0 size=1048576 2024-03-09T14:33:27.726 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.727+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~GLILTG8E5CGZ.1 size=301968 2024-03-09T14:33:27.727 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.727+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=GLILTG8E5CGZ tag=M6H7Y3INJTDW type=write size=2399120 2024-03-09T14:33:27.728 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.728+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=GZV4KE1NVRPK type=del 2024-03-09T14:33:27.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.730+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~SWLR1OBFL4X8.0 size=1048576 2024-03-09T14:33:27.731 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.731+0000 7f586ae3d780 1 > prepared part key=_multipart_O5L6RC16RS8E.2~SWLR1OBFL4X8.1 size=649567 2024-03-09T14:33:27.731 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.731+0000 7f586ae3d780 1 > prepared multipart upload key=O5L6RC16RS8E upload=SWLR1OBFL4X8 tag=67ZG3S4NHMEG type=write size=2746719 2024-03-09T14:33:27.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.732+0000 7f586ae3d780 1 < completed delete operation key=G2BIOBESOIK9 tag=GOLBAX7MHDG2 type=del 2024-03-09T14:33:27.734 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.734+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~TY6FGZFXJKGF.0 size=1048576 2024-03-09T14:33:27.735 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.735+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~TY6FGZFXJKGF.1 size=957387 2024-03-09T14:33:27.735 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.735+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=TY6FGZFXJKGF tag=CZX93SDL4JA6 type=write size=3054539 2024-03-09T14:33:27.736 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.736+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=OTY23BHS6E3I type=del 2024-03-09T14:33:27.738 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.739+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~WO30OXRUVDAM.0 size=1048576 2024-03-09T14:33:27.739 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.739+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~WO30OXRUVDAM.1 size=1048576 2024-03-09T14:33:27.740 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.740+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~WO30OXRUVDAM.2 size=104046 2024-03-09T14:33:27.740 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.740+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=WO30OXRUVDAM tag=N5QRVANBBO1R type=write size=3249774 2024-03-09T14:33:27.741 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.741+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~8IEYE1X3G8LC.0 size=1048576 2024-03-09T14:33:27.742 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.742+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~8IEYE1X3G8LC.1 size=1048576 2024-03-09T14:33:27.743 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.743+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~8IEYE1X3G8LC.2 size=1018503 2024-03-09T14:33:27.744 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.745+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=8IEYE1X3G8LC tag=CMEI5JP6T17V type=write size=4164231 2024-03-09T14:33:27.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.747+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~NLWVCD0KU4D1.0 size=1048576 2024-03-09T14:33:27.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.748+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~NLWVCD0KU4D1.1 size=176611 2024-03-09T14:33:27.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.748+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=NLWVCD0KU4D1 tag=1SBUOZYUIANQ type=write size=2273763 2024-03-09T14:33:27.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.749+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=K1YUBXN8Y45H type=del 2024-03-09T14:33:27.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.750+0000 7f586ae3d780 1 > prepared operation key=OU9IOY7J572N tag=RRBZN3QHZCYS type=write size=61818 2024-03-09T14:33:27.752 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.752+0000 7f586ae3d780 1 < suggested remove operation key=W4Q1MWHOQ4Y1 tag=YUACQIV15E8S type=del 2024-03-09T14:33:27.754 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.754+0000 7f586ae3d780 1 > prepared part key=_multipart_FNZ3BNA7W12E.2~N78GFLZ4X1ZZ.0 size=724140 2024-03-09T14:33:27.754 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.754+0000 7f586ae3d780 1 > prepared multipart upload key=FNZ3BNA7W12E upload=N78GFLZ4X1ZZ tag=NUMBJY938J23 type=write size=1772716 2024-03-09T14:33:27.755 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.755+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=DVBO4Z3TBNZZ type=del 2024-03-09T14:33:27.757 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.757+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~8RQAM038QNVT.0 size=1048576 2024-03-09T14:33:27.758 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.758+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~8RQAM038QNVT.1 size=393807 2024-03-09T14:33:27.758 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.758+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=8RQAM038QNVT tag=J1UF45GC071O type=write size=2490959 2024-03-09T14:33:27.758 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.758+0000 7f586ae3d780 1 < canceled part key=_multipart_UKPSUQ6LYWN8.2~8KBMAUOOM1SV.0 size=644602 2024-03-09T14:33:27.760 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.760+0000 7f586ae3d780 1 < canceled multipart upload key=UKPSUQ6LYWN8 upload=8KBMAUOOM1SV tag=6LQ0M05QTMBB type=write size=1693178 2024-03-09T14:33:27.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.762+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~AXK5O86KYWZO.0 size=1048576 2024-03-09T14:33:27.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.763+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~AXK5O86KYWZO.1 size=1048576 2024-03-09T14:33:27.764 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.764+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~AXK5O86KYWZO.2 size=510313 2024-03-09T14:33:27.764 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.764+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=AXK5O86KYWZO tag=Q3EEDPVW2AY8 type=write size=3656041 2024-03-09T14:33:27.765 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.765+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=S15OFA0FLRCT type=del 2024-03-09T14:33:27.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.766+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=BATK82G6ZDVM type=write size=197858 2024-03-09T14:33:27.767 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.768+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~HA2VADQ86YQ0.0 size=66232 2024-03-09T14:33:27.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.770+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=HA2VADQ86YQ0 tag=5BTX6GMP3T5Y type=write size=1114808 2024-03-09T14:33:27.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.771+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=068MOEIQGTOV type=del size=2094049 2024-03-09T14:33:27.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.772+0000 7f586ae3d780 1 < completed write operation key=XIYWPXSYCT6I tag=T3HB1GVSL243 type=write size=626433 2024-03-09T14:33:27.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.774+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~CFQYY4TKK2RN.0 size=1048576 2024-03-09T14:33:27.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.776+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~CFQYY4TKK2RN.1 size=226648 2024-03-09T14:33:27.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.776+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=CFQYY4TKK2RN tag=QEDS4IRWTWHT type=write size=2323800 2024-03-09T14:33:27.778 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.779+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=14UV82W7WEXP type=del 2024-03-09T14:33:27.781 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.782+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~EGU9V0ZKNFI0.0 size=1048576 2024-03-09T14:33:27.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.783+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~EGU9V0ZKNFI0.1 size=1048576 2024-03-09T14:33:27.783 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.784+0000 7f586ae3d780 1 > prepared part key=_multipart_2BUCMVWK7J1V.2~EGU9V0ZKNFI0.2 size=859888 2024-03-09T14:33:27.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.784+0000 7f586ae3d780 1 > prepared multipart upload key=2BUCMVWK7J1V upload=EGU9V0ZKNFI0 tag=GW2IZETGPW9G type=write size=4005616 2024-03-09T14:33:27.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.785+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=DHH58S493X1X type=del 2024-03-09T14:33:27.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.786+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=XQFUSL1QM2S7 type=del size=3546387 2024-03-09T14:33:27.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.787+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~OHE61SFL18QO.0 size=1048576 2024-03-09T14:33:27.790 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.788+0000 7f586ae3d780 1 < completed part key=_multipart_XIYWPXSYCT6I.2~OHE61SFL18QO.1 size=940855 2024-03-09T14:33:27.790 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.790+0000 7f586ae3d780 1 < completed multipart upload key=XIYWPXSYCT6I upload=OHE61SFL18QO tag=T3UUTMR3MPWL type=write size=3038007 2024-03-09T14:33:27.791 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.792+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=9X9LF3TMAWWM type=del size=3313680 2024-03-09T14:33:27.792 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.793+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=S4GJW8G0JVPD type=del 2024-03-09T14:33:27.794 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.795+0000 7f586ae3d780 1 > prepared part key=_multipart_G2BIOBESOIK9.2~Z684YYYM4IVT.0 size=587858 2024-03-09T14:33:27.794 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.795+0000 7f586ae3d780 1 > prepared multipart upload key=G2BIOBESOIK9 upload=Z684YYYM4IVT tag=RCWHZDOFX07L type=write size=1636434 2024-03-09T14:33:27.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.796+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~GLILTG8E5CGZ.0 size=1048576 2024-03-09T14:33:27.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.797+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~GLILTG8E5CGZ.1 size=301968 2024-03-09T14:33:27.798 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.799+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=GLILTG8E5CGZ tag=M6H7Y3INJTDW type=write size=2399120 2024-03-09T14:33:27.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.801+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~BZD8IQ9YP5VW.0 size=1048576 2024-03-09T14:33:27.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.802+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~BZD8IQ9YP5VW.1 size=1048576 2024-03-09T14:33:27.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.803+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~BZD8IQ9YP5VW.2 size=567099 2024-03-09T14:33:27.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.803+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=BZD8IQ9YP5VW tag=R2IMGXERXD6N type=write size=3712827 2024-03-09T14:33:27.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.804+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~SWLR1OBFL4X8.0 size=1048576 2024-03-09T14:33:27.805 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.805+0000 7f586ae3d780 1 < completed part key=_multipart_O5L6RC16RS8E.2~SWLR1OBFL4X8.1 size=649567 2024-03-09T14:33:27.806 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.807+0000 7f586ae3d780 1 < completed multipart upload key=O5L6RC16RS8E upload=SWLR1OBFL4X8 tag=67ZG3S4NHMEG type=write size=2746719 2024-03-09T14:33:27.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.808+0000 7f586ae3d780 1 > prepared operation key=W3HTK2F8ML3V tag=BVJZDETP1Q0R type=del size=2715210 2024-03-09T14:33:27.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.809+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~TY6FGZFXJKGF.0 size=1048576 2024-03-09T14:33:27.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.810+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~TY6FGZFXJKGF.1 size=957387 2024-03-09T14:33:27.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.812+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=TY6FGZFXJKGF tag=CZX93SDL4JA6 type=write size=3054539 2024-03-09T14:33:27.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.813+0000 7f586ae3d780 1 > prepared operation key=DJH53FNVMLGY tag=GQCO3SWJG6NW type=del size=3598641 2024-03-09T14:33:27.814 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.815+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~WO30OXRUVDAM.0 size=1048576 2024-03-09T14:33:27.815 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.816+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~WO30OXRUVDAM.1 size=1048576 2024-03-09T14:33:27.815 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.816+0000 7f586ae3d780 1 < canceled part key=_multipart_W4Q1MWHOQ4Y1.2~WO30OXRUVDAM.2 size=104046 2024-03-09T14:33:27.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.817+0000 7f586ae3d780 1 < canceled multipart upload key=W4Q1MWHOQ4Y1 upload=WO30OXRUVDAM tag=N5QRVANBBO1R type=write size=3249774 2024-03-09T14:33:27.818 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.819+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=43SMJ0CU6WCX type=del size=1108023 2024-03-09T14:33:27.819 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.820+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~NLWVCD0KU4D1.0 size=1048576 2024-03-09T14:33:27.820 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.821+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~NLWVCD0KU4D1.1 size=176611 2024-03-09T14:33:27.822 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.823+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=NLWVCD0KU4D1 tag=1SBUOZYUIANQ type=write size=2273763 2024-03-09T14:33:27.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.824+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=S6NBSY2BYMUW type=del size=2513489 2024-03-09T14:33:27.826 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.826+0000 7f586ae3d780 1 < suggested update operation key=OU9IOY7J572N tag=RRBZN3QHZCYS type=write size=61818 2024-03-09T14:33:27.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.827+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=SW0SSJ1XB8KH type=del size=2568461 2024-03-09T14:33:27.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.829+0000 7f586ae3d780 1 < completed part key=_multipart_FNZ3BNA7W12E.2~N78GFLZ4X1ZZ.0 size=724140 2024-03-09T14:33:27.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.830+0000 7f586ae3d780 1 < completed multipart upload key=FNZ3BNA7W12E upload=N78GFLZ4X1ZZ tag=NUMBJY938J23 type=write size=1772716 2024-03-09T14:33:27.831 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.832+0000 7f586ae3d780 1 > prepared operation key=CZGAXNJ0GKU0 tag=N0DVJJPFJCSY type=write size=163045 2024-03-09T14:33:27.831 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.832+0000 7f586ae3d780 1 < canceled part key=_multipart_5PERWGS0GOJU.2~8RQAM038QNVT.0 size=1048576 2024-03-09T14:33:27.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.833+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~8RQAM038QNVT.1 size=393807 2024-03-09T14:33:27.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.835+0000 7f586ae3d780 1 < canceled multipart upload key=5PERWGS0GOJU upload=8RQAM038QNVT tag=J1UF45GC071O type=write size=2490959 2024-03-09T14:33:27.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.837+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~P1RN4A2KGN4B.0 size=1048576 2024-03-09T14:33:27.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.838+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~P1RN4A2KGN4B.1 size=1048576 2024-03-09T14:33:27.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.839+0000 7f586ae3d780 1 > prepared part key=_multipart_OXBDXIILR3NS.2~P1RN4A2KGN4B.2 size=757794 2024-03-09T14:33:27.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.839+0000 7f586ae3d780 1 > prepared multipart upload key=OXBDXIILR3NS upload=P1RN4A2KGN4B tag=SB9Y2KKR9AY5 type=write size=3903522 2024-03-09T14:33:27.840 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.840+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~AXK5O86KYWZO.0 size=1048576 2024-03-09T14:33:27.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.841+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~AXK5O86KYWZO.1 size=1048576 2024-03-09T14:33:27.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.842+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~AXK5O86KYWZO.2 size=510313 2024-03-09T14:33:27.843 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.844+0000 7f586ae3d780 1 < completed multipart upload key=WNVN3EOUUBGR upload=AXK5O86KYWZO tag=Q3EEDPVW2AY8 type=write size=3656041 2024-03-09T14:33:27.845 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.845+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=0Z55IMMLPCM7 type=del size=1830182 2024-03-09T14:33:27.846 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.846+0000 7f586ae3d780 1 < completed write operation key=57OR9DHRPDCZ tag=BATK82G6ZDVM type=write size=197858 2024-03-09T14:33:27.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.848+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~NRXFKVU86AZ2.0 size=1048576 2024-03-09T14:33:27.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.849+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~NRXFKVU86AZ2.1 size=1048576 2024-03-09T14:33:27.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.850+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~NRXFKVU86AZ2.2 size=658973 2024-03-09T14:33:27.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.850+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=NRXFKVU86AZ2 tag=N803APMFXD55 type=write size=3804701 2024-03-09T14:33:27.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.851+0000 7f586ae3d780 1 < canceled operation key=04E9KDGUC274 tag=068MOEIQGTOV type=del size=2094049 2024-03-09T14:33:27.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.852+0000 7f586ae3d780 1 > prepared operation key=04E9KDGUC274 tag=97HOJS26FEUW type=del size=3078810 2024-03-09T14:33:27.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.853+0000 7f586ae3d780 1 < canceled part key=_multipart_9ZPCSBP3P58P.2~CFQYY4TKK2RN.0 size=1048576 2024-03-09T14:33:27.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.854+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~CFQYY4TKK2RN.1 size=226648 2024-03-09T14:33:27.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.858+0000 7f586ae3d780 1 < canceled multipart upload key=9ZPCSBP3P58P upload=CFQYY4TKK2RN tag=QEDS4IRWTWHT type=write size=2323800 2024-03-09T14:33:27.859 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.860+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~UQUH8P4449GD.0 size=1048576 2024-03-09T14:33:27.860 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.861+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~UQUH8P4449GD.1 size=838542 2024-03-09T14:33:27.861 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.861+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=UQUH8P4449GD tag=BPHJARFZHX60 type=write size=2935694 2024-03-09T14:33:27.862 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.862+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~EGU9V0ZKNFI0.0 size=1048576 2024-03-09T14:33:27.863 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.863+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~EGU9V0ZKNFI0.1 size=1048576 2024-03-09T14:33:27.864 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.864+0000 7f586ae3d780 1 < completed part key=_multipart_2BUCMVWK7J1V.2~EGU9V0ZKNFI0.2 size=859888 2024-03-09T14:33:27.866 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.867+0000 7f586ae3d780 1 < completed multipart upload key=2BUCMVWK7J1V upload=EGU9V0ZKNFI0 tag=GW2IZETGPW9G type=write size=4005616 2024-03-09T14:33:27.867 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.868+0000 7f586ae3d780 1 > prepared operation key=FNZ3BNA7W12E tag=Q47SS6LWGZ0S type=del size=3342180 2024-03-09T14:33:27.870 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.870+0000 7f586ae3d780 1 < suggested remove operation key=UKPSUQ6LYWN8 tag=XQFUSL1QM2S7 type=del 2024-03-09T14:33:27.871 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.871+0000 7f586ae3d780 1 > prepared operation key=UKPSUQ6LYWN8 tag=ZQ7FDCYJZFH0 type=del size=2585129 2024-03-09T14:33:27.872 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.873+0000 7f586ae3d780 1 < completed delete operation key=5PERWGS0GOJU tag=9X9LF3TMAWWM type=del 2024-03-09T14:33:27.873 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.874+0000 7f586ae3d780 1 > prepared operation key=UAYZ55UT77VE tag=Y9C2TJAGWFCN type=del size=199439 2024-03-09T14:33:27.875 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.875+0000 7f586ae3d780 1 < completed part key=_multipart_G2BIOBESOIK9.2~Z684YYYM4IVT.0 size=587858 2024-03-09T14:33:27.877 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.877+0000 7f586ae3d780 1 < completed multipart upload key=G2BIOBESOIK9 upload=Z684YYYM4IVT tag=RCWHZDOFX07L type=write size=1636434 2024-03-09T14:33:27.878 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.878+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=4Z2VJRNEQHUD type=del size=380440 2024-03-09T14:33:27.879 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.880+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~BZD8IQ9YP5VW.0 size=1048576 2024-03-09T14:33:27.880 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.881+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~BZD8IQ9YP5VW.1 size=1048576 2024-03-09T14:33:27.881 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.882+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~BZD8IQ9YP5VW.2 size=567099 2024-03-09T14:33:27.884 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.884+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=BZD8IQ9YP5VW tag=R2IMGXERXD6N type=write size=3712827 2024-03-09T14:33:27.885 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.885+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=5S0PGYA54U5D type=write size=402450 2024-03-09T14:33:27.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.887+0000 7f586ae3d780 1 < completed delete operation key=W3HTK2F8ML3V tag=BVJZDETP1Q0R type=del 2024-03-09T14:33:27.888 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.888+0000 7f586ae3d780 1 > prepared operation key=0JDF7910RACF tag=4PH7N0MYLSO8 type=del size=2861152 2024-03-09T14:33:27.890 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.890+0000 7f586ae3d780 1 < completed delete operation key=DJH53FNVMLGY tag=GQCO3SWJG6NW type=del 2024-03-09T14:33:27.891 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.891+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=TI4GMSVTRZ1L type=del size=4032604 2024-03-09T14:33:27.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.893+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=43SMJ0CU6WCX type=del 2024-03-09T14:33:27.893 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.894+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=8DNKSPO2RAW2 type=del size=2596669 2024-03-09T14:33:27.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.895+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=S6NBSY2BYMUW type=del 2024-03-09T14:33:27.897 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.897+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~CMTBJ78CJ000.0 size=1048576 2024-03-09T14:33:27.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.898+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~CMTBJ78CJ000.1 size=1048576 2024-03-09T14:33:27.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.899+0000 7f586ae3d780 1 > prepared part key=_multipart_UKPSUQ6LYWN8.2~CMTBJ78CJ000.2 size=1004618 2024-03-09T14:33:27.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.899+0000 7f586ae3d780 1 > prepared multipart upload key=UKPSUQ6LYWN8 upload=CMTBJ78CJ000 tag=3KC3GIWUVH4P type=write size=4150346 2024-03-09T14:33:27.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.900+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=SW0SSJ1XB8KH type=del 2024-03-09T14:33:27.901 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.902+0000 7f586ae3d780 1 > prepared operation key=39ZIGOC6JZ1R tag=IYH47X6UNHNC type=del size=2358315 2024-03-09T14:33:27.902 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.903+0000 7f586ae3d780 1 < completed write operation key=CZGAXNJ0GKU0 tag=N0DVJJPFJCSY type=write size=163045 2024-03-09T14:33:27.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.905+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~D5CIJGOF26M7.0 size=431649 2024-03-09T14:33:27.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.905+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=D5CIJGOF26M7 tag=T4XKZ39NSX10 type=write size=1480225 2024-03-09T14:33:27.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.906+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~P1RN4A2KGN4B.0 size=1048576 2024-03-09T14:33:27.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.908+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~P1RN4A2KGN4B.1 size=1048576 2024-03-09T14:33:27.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.909+0000 7f586ae3d780 1 < completed part key=_multipart_OXBDXIILR3NS.2~P1RN4A2KGN4B.2 size=757794 2024-03-09T14:33:27.910 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.910+0000 7f586ae3d780 1 < completed multipart upload key=OXBDXIILR3NS upload=P1RN4A2KGN4B tag=SB9Y2KKR9AY5 type=write size=3903522 2024-03-09T14:33:27.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.912+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~UNWHDH2FRDT5.0 size=1048576 2024-03-09T14:33:27.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.913+0000 7f586ae3d780 1 > prepared part key=_multipart_UO072H74SHLP.2~UNWHDH2FRDT5.1 size=259695 2024-03-09T14:33:27.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.913+0000 7f586ae3d780 1 > prepared multipart upload key=UO072H74SHLP upload=UNWHDH2FRDT5 tag=IM0PMZZN2VLC type=write size=2356847 2024-03-09T14:33:27.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.915+0000 7f586ae3d780 1 < completed delete operation key=57OR9DHRPDCZ tag=0Z55IMMLPCM7 type=del 2024-03-09T14:33:27.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.916+0000 7f586ae3d780 1 > prepared operation key=XIYWPXSYCT6I tag=U3M7CNWF2AV5 type=del size=2183008 2024-03-09T14:33:27.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.917+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~NRXFKVU86AZ2.0 size=1048576 2024-03-09T14:33:27.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.917+0000 7f586ae3d780 1 < canceled part key=_multipart_0JDF7910RACF.2~NRXFKVU86AZ2.1 size=1048576 2024-03-09T14:33:27.917 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.918+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~NRXFKVU86AZ2.2 size=658973 2024-03-09T14:33:27.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.920+0000 7f586ae3d780 1 < canceled multipart upload key=0JDF7910RACF upload=NRXFKVU86AZ2 tag=N803APMFXD55 type=write size=3804701 2024-03-09T14:33:27.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.921+0000 7f586ae3d780 1 > prepared operation key=2BUCMVWK7J1V tag=K5G7AD9GNLO5 type=del size=3084514 2024-03-09T14:33:27.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.922+0000 7f586ae3d780 1 < completed delete operation key=04E9KDGUC274 tag=97HOJS26FEUW type=del 2024-03-09T14:33:27.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.925+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=DEJWXMQ0XN8R type=del size=450804 2024-03-09T14:33:27.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.926+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~UQUH8P4449GD.0 size=1048576 2024-03-09T14:33:27.926 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.927+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~UQUH8P4449GD.1 size=838542 2024-03-09T14:33:27.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.929+0000 7f586ae3d780 1 < completed multipart upload key=CZGAXNJ0GKU0 upload=UQUH8P4449GD tag=BPHJARFZHX60 type=write size=2935694 2024-03-09T14:33:27.930 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.930+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=FWRHUNW0TKO0 type=del size=3824165 2024-03-09T14:33:27.931 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.931+0000 7f586ae3d780 1 < completed delete operation key=FNZ3BNA7W12E tag=Q47SS6LWGZ0S type=del 2024-03-09T14:33:27.933 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.933+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~G0KMKDID5A2B.0 size=588592 2024-03-09T14:33:27.933 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.933+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=G0KMKDID5A2B tag=FAY3KMDDNOBV type=write size=1637168 2024-03-09T14:33:27.934 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.935+0000 7f586ae3d780 1 < completed delete operation key=UKPSUQ6LYWN8 tag=ZQ7FDCYJZFH0 type=del 2024-03-09T14:33:27.936 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.937+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~77M64MA02U3G.0 size=1048576 2024-03-09T14:33:27.937 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.938+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~77M64MA02U3G.1 size=634060 2024-03-09T14:33:27.937 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.938+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=77M64MA02U3G tag=GF5KRMONTJRD type=write size=2731212 2024-03-09T14:33:27.938 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.939+0000 7f586ae3d780 1 < completed delete operation key=UAYZ55UT77VE tag=Y9C2TJAGWFCN type=del 2024-03-09T14:33:27.940 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.940+0000 7f586ae3d780 1 > prepared operation key=O5L6RC16RS8E tag=HO1TNDAXLOXB type=write size=909684 2024-03-09T14:33:27.941 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.941+0000 7f586ae3d780 1 < canceled operation key=XIYWPXSYCT6I tag=4Z2VJRNEQHUD type=del size=380440 2024-03-09T14:33:27.943 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.943+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~EXVXKUEML3QI.0 size=1048576 2024-03-09T14:33:27.944 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.944+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~EXVXKUEML3QI.1 size=1048576 2024-03-09T14:33:27.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.945+0000 7f586ae3d780 1 > prepared part key=_multipart_CZGAXNJ0GKU0.2~EXVXKUEML3QI.2 size=511958 2024-03-09T14:33:27.945 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.945+0000 7f586ae3d780 1 > prepared multipart upload key=CZGAXNJ0GKU0 upload=EXVXKUEML3QI tag=0160TQ24P5EY type=write size=3657686 2024-03-09T14:33:27.946 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.947+0000 7f586ae3d780 1 < canceled operation key=39ZIGOC6JZ1R tag=5S0PGYA54U5D type=write size=402450 2024-03-09T14:33:27.947 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.948+0000 7f586ae3d780 1 > prepared operation key=NHIOOLNXLZZC tag=K1CN9S2H03RN type=del size=258005 2024-03-09T14:33:27.948 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.949+0000 7f586ae3d780 1 < completed delete operation key=0JDF7910RACF tag=4PH7N0MYLSO8 type=del 2024-03-09T14:33:27.950 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.951+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~QX1IFICMPZ4A.0 size=1048576 2024-03-09T14:33:27.952 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.952+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~QX1IFICMPZ4A.1 size=2841 2024-03-09T14:33:27.952 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.952+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=QX1IFICMPZ4A tag=R15HC62TJUZ5 type=write size=2099993 2024-03-09T14:33:27.953 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.953+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=TI4GMSVTRZ1L type=del 2024-03-09T14:33:27.955 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.955+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~4OHNKSWVDS7C.0 size=1048576 2024-03-09T14:33:27.956 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.956+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~4OHNKSWVDS7C.1 size=674285 2024-03-09T14:33:27.956 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.956+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=4OHNKSWVDS7C tag=DCRM2FQEDGNC type=write size=2771437 2024-03-09T14:33:27.957 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.957+0000 7f586ae3d780 1 < completed delete operation key=C1UGQOQ6AE1E tag=8DNKSPO2RAW2 type=del 2024-03-09T14:33:27.958 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.958+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=Y32VF9GDBPLH type=del size=419065 2024-03-09T14:33:27.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.960+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~CMTBJ78CJ000.0 size=1048576 2024-03-09T14:33:27.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.961+0000 7f586ae3d780 1 < completed part key=_multipart_UKPSUQ6LYWN8.2~CMTBJ78CJ000.1 size=1048576 2024-03-09T14:33:27.961 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.961+0000 7f586ae3d780 1 < canceled part key=_multipart_UKPSUQ6LYWN8.2~CMTBJ78CJ000.2 size=1004618 2024-03-09T14:33:27.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.963+0000 7f586ae3d780 1 < canceled multipart upload key=UKPSUQ6LYWN8 upload=CMTBJ78CJ000 tag=3KC3GIWUVH4P type=write size=4150346 2024-03-09T14:33:27.963 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.964+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=9D6PVS3DX2ZB type=del size=2019421 2024-03-09T14:33:27.966 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.966+0000 7f586ae3d780 1 < suggested remove operation key=39ZIGOC6JZ1R tag=IYH47X6UNHNC type=del 2024-03-09T14:33:27.967 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.967+0000 7f586ae3d780 1 > prepared operation key=DGO3ZT8ST90A tag=L5NX52KFVD7H type=del size=2076083 2024-03-09T14:33:27.968 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.968+0000 7f586ae3d780 1 < completed part key=_multipart_DGO3ZT8ST90A.2~D5CIJGOF26M7.0 size=431649 2024-03-09T14:33:27.970 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.970+0000 7f586ae3d780 1 < completed multipart upload key=DGO3ZT8ST90A upload=D5CIJGOF26M7 tag=T4XKZ39NSX10 type=write size=1480225 2024-03-09T14:33:27.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.972+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=EMV25SAG6TOU type=del size=699960 2024-03-09T14:33:27.972 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.973+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~UNWHDH2FRDT5.0 size=1048576 2024-03-09T14:33:27.973 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.974+0000 7f586ae3d780 1 < completed part key=_multipart_UO072H74SHLP.2~UNWHDH2FRDT5.1 size=259695 2024-03-09T14:33:27.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.976+0000 7f586ae3d780 1 < completed multipart upload key=UO072H74SHLP upload=UNWHDH2FRDT5 tag=IM0PMZZN2VLC type=write size=2356847 2024-03-09T14:33:27.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.977+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=RK50BATV3VOV type=del size=975933 2024-03-09T14:33:27.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.978+0000 7f586ae3d780 1 < canceled operation key=XIYWPXSYCT6I tag=U3M7CNWF2AV5 type=del size=2183008 2024-03-09T14:33:27.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.979+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=O0W2A6WY3BEP type=del size=3724004 2024-03-09T14:33:27.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.981+0000 7f586ae3d780 1 < completed delete operation key=2BUCMVWK7J1V tag=K5G7AD9GNLO5 type=del 2024-03-09T14:33:27.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.983+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~CG0N78N2WLD9.0 size=1048576 2024-03-09T14:33:27.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.984+0000 7f586ae3d780 1 > prepared part key=_multipart_W4Q1MWHOQ4Y1.2~CG0N78N2WLD9.1 size=867059 2024-03-09T14:33:27.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.984+0000 7f586ae3d780 1 > prepared multipart upload key=W4Q1MWHOQ4Y1 upload=CG0N78N2WLD9 tag=II2QNLSRD75Z type=write size=2964211 2024-03-09T14:33:27.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.985+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=DEJWXMQ0XN8R type=del 2024-03-09T14:33:27.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.986+0000 7f586ae3d780 1 > prepared operation key=CAISZZZSOD34 tag=KFMB4D2N4BBN type=del size=697529 2024-03-09T14:33:27.987 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.987+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=FWRHUNW0TKO0 type=del 2024-03-09T14:33:27.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.988+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=6O4CVRPXB2YY type=del size=1980049 2024-03-09T14:33:27.989 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.990+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~G0KMKDID5A2B.0 size=588592 2024-03-09T14:33:27.991 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.992+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=G0KMKDID5A2B tag=FAY3KMDDNOBV type=write size=1637168 2024-03-09T14:33:27.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.993+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=64WN5U5OU46K type=write size=5240 2024-03-09T14:33:27.993 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.994+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~77M64MA02U3G.0 size=1048576 2024-03-09T14:33:27.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.995+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~77M64MA02U3G.1 size=634060 2024-03-09T14:33:27.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.997+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=77M64MA02U3G tag=GF5KRMONTJRD type=write size=2731212 2024-03-09T14:33:27.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.999+0000 7f586ae3d780 1 > prepared part key=_multipart_509F17DT0C4I.2~O1M0E2EL9YJB.0 size=609963 2024-03-09T14:33:27.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:27.999+0000 7f586ae3d780 1 > prepared multipart upload key=509F17DT0C4I upload=O1M0E2EL9YJB tag=49C4DKYXCKTF type=write size=1658539 2024-03-09T14:33:28.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.000+0000 7f586ae3d780 1 < completed write operation key=O5L6RC16RS8E tag=HO1TNDAXLOXB type=write size=909684 2024-03-09T14:33:28.002 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.003+0000 7f586ae3d780 1 > prepared operation key=9ZPCSBP3P58P tag=6L3YVTY8XDGE type=del size=1464760 2024-03-09T14:33:28.003 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.004+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~EXVXKUEML3QI.0 size=1048576 2024-03-09T14:33:28.003 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.004+0000 7f586ae3d780 1 < canceled part key=_multipart_CZGAXNJ0GKU0.2~EXVXKUEML3QI.1 size=1048576 2024-03-09T14:33:28.004 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.005+0000 7f586ae3d780 1 < completed part key=_multipart_CZGAXNJ0GKU0.2~EXVXKUEML3QI.2 size=511958 2024-03-09T14:33:28.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.007+0000 7f586ae3d780 1 < canceled multipart upload key=CZGAXNJ0GKU0 upload=EXVXKUEML3QI tag=0160TQ24P5EY type=write size=3657686 2024-03-09T14:33:28.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.009+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=6NNY5M9QLWST type=del size=3459541 2024-03-09T14:33:28.009 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.010+0000 7f586ae3d780 1 < completed delete operation key=NHIOOLNXLZZC tag=K1CN9S2H03RN type=del 2024-03-09T14:33:28.012 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.012+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~5I7AHFI9JE8U.0 size=1048576 2024-03-09T14:33:28.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.013+0000 7f586ae3d780 1 > prepared part key=_multipart_57OR9DHRPDCZ.2~5I7AHFI9JE8U.1 size=694657 2024-03-09T14:33:28.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.013+0000 7f586ae3d780 1 > prepared multipart upload key=57OR9DHRPDCZ upload=5I7AHFI9JE8U tag=5SIHHPYZNP48 type=write size=2791809 2024-03-09T14:33:28.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.014+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~QX1IFICMPZ4A.0 size=1048576 2024-03-09T14:33:28.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.015+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~QX1IFICMPZ4A.1 size=2841 2024-03-09T14:33:28.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.018+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=QX1IFICMPZ4A tag=R15HC62TJUZ5 type=write size=2099993 2024-03-09T14:33:28.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.020+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~GPAJQYCYX4XF.0 size=1048576 2024-03-09T14:33:28.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.021+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~GPAJQYCYX4XF.1 size=1048576 2024-03-09T14:33:28.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.022+0000 7f586ae3d780 1 > prepared part key=_multipart_0JDF7910RACF.2~GPAJQYCYX4XF.2 size=368506 2024-03-09T14:33:28.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.022+0000 7f586ae3d780 1 > prepared multipart upload key=0JDF7910RACF upload=GPAJQYCYX4XF tag=8WR6REYN06Y6 type=write size=3514234 2024-03-09T14:33:28.023 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.023+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~4OHNKSWVDS7C.0 size=1048576 2024-03-09T14:33:28.023 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.024+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~4OHNKSWVDS7C.1 size=674285 2024-03-09T14:33:28.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.026+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=4OHNKSWVDS7C tag=DCRM2FQEDGNC type=write size=2771437 2024-03-09T14:33:28.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.028+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~LMDXJSZMV48D.0 size=1048576 2024-03-09T14:33:28.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.029+0000 7f586ae3d780 1 > prepared part key=_multipart_LRI2GKBGVCWW.2~LMDXJSZMV48D.1 size=718637 2024-03-09T14:33:28.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.029+0000 7f586ae3d780 1 > prepared multipart upload key=LRI2GKBGVCWW upload=LMDXJSZMV48D tag=8NA5TU425E9K type=write size=2815789 2024-03-09T14:33:28.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.031+0000 7f586ae3d780 1 < suggested update operation key=509F17DT0C4I tag=Y32VF9GDBPLH type=del size=419065 2024-03-09T14:33:28.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.033+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~9B7K0GDO32VS.0 size=1048576 2024-03-09T14:33:28.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.034+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~9B7K0GDO32VS.1 size=1048576 2024-03-09T14:33:28.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.035+0000 7f586ae3d780 1 > prepared part key=_multipart_5PERWGS0GOJU.2~9B7K0GDO32VS.2 size=193893 2024-03-09T14:33:28.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.035+0000 7f586ae3d780 1 > prepared multipart upload key=5PERWGS0GOJU upload=9B7K0GDO32VS tag=5Z3KQMKJCV1U type=write size=3339621 2024-03-09T14:33:28.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.036+0000 7f586ae3d780 1 < canceled operation key=5PERWGS0GOJU tag=9D6PVS3DX2ZB type=del size=2019421 2024-03-09T14:33:28.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.037+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=NVCE7NQOUNEQ type=write size=392200 2024-03-09T14:33:28.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.038+0000 7f586ae3d780 1 < completed delete operation key=DGO3ZT8ST90A tag=L5NX52KFVD7H type=del 2024-03-09T14:33:28.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.040+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~7ADI2FNGL272.0 size=1048576 2024-03-09T14:33:28.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.041+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~7ADI2FNGL272.1 size=1048576 2024-03-09T14:33:28.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.042+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~7ADI2FNGL272.2 size=538922 2024-03-09T14:33:28.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.042+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=7ADI2FNGL272 tag=QCTE6VPOY8EM type=write size=3684650 2024-03-09T14:33:28.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.044+0000 7f586ae3d780 1 < completed delete operation key=9ZPCSBP3P58P tag=EMV25SAG6TOU type=del 2024-03-09T14:33:28.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.045+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=TF84TLJ19V29 type=del size=2732760 2024-03-09T14:33:28.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.046+0000 7f586ae3d780 1 < canceled operation key=6YWLPUULN5SY tag=RK50BATV3VOV type=del size=975933 2024-03-09T14:33:28.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.048+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~0TO8CH8726M1.0 size=1048576 2024-03-09T14:33:28.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.049+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~0TO8CH8726M1.1 size=1048576 2024-03-09T14:33:28.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.050+0000 7f586ae3d780 1 > prepared part key=_multipart_39ZIGOC6JZ1R.2~0TO8CH8726M1.2 size=794271 2024-03-09T14:33:28.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.050+0000 7f586ae3d780 1 > prepared multipart upload key=39ZIGOC6JZ1R upload=0TO8CH8726M1 tag=8LJP3171R1B3 type=write size=3939999 2024-03-09T14:33:28.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.052+0000 7f586ae3d780 1 < suggested update operation key=509F17DT0C4I tag=O0W2A6WY3BEP type=del size=3724004 2024-03-09T14:33:28.053 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.053+0000 7f586ae3d780 1 > prepared operation key=78Y2ZM3W6EUC tag=RMV8RXC9GQLE type=del size=512812 2024-03-09T14:33:28.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.055+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~CG0N78N2WLD9.0 size=1048576 2024-03-09T14:33:28.055 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.056+0000 7f586ae3d780 1 < completed part key=_multipart_W4Q1MWHOQ4Y1.2~CG0N78N2WLD9.1 size=867059 2024-03-09T14:33:28.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.058+0000 7f586ae3d780 1 < completed multipart upload key=W4Q1MWHOQ4Y1 upload=CG0N78N2WLD9 tag=II2QNLSRD75Z type=write size=2964211 2024-03-09T14:33:28.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.060+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~PW5PN2A4GIRL.0 size=1048576 2024-03-09T14:33:28.060 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.061+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~PW5PN2A4GIRL.1 size=901313 2024-03-09T14:33:28.060 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.061+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=PW5PN2A4GIRL tag=N94BOGPVJUWK type=write size=2998465 2024-03-09T14:33:28.061 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.062+0000 7f586ae3d780 1 < completed delete operation key=CAISZZZSOD34 tag=KFMB4D2N4BBN type=del 2024-03-09T14:33:28.063 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.064+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~GKMH9J0UFZWZ.0 size=1048576 2024-03-09T14:33:28.064 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.065+0000 7f586ae3d780 1 > prepared part key=_multipart_04E9KDGUC274.2~GKMH9J0UFZWZ.1 size=645671 2024-03-09T14:33:28.064 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.065+0000 7f586ae3d780 1 > prepared multipart upload key=04E9KDGUC274 upload=GKMH9J0UFZWZ tag=HSKMV4TC4M82 type=write size=2742823 2024-03-09T14:33:28.066 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.067+0000 7f586ae3d780 1 < suggested remove operation key=UO072H74SHLP tag=6O4CVRPXB2YY type=del 2024-03-09T14:33:28.068 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.068+0000 7f586ae3d780 1 > prepared operation key=BHSYRD3IEJWW tag=WYPJ5V5Q7MII type=write size=437454 2024-03-09T14:33:28.069 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.069+0000 7f586ae3d780 1 < completed write operation key=5PERWGS0GOJU tag=64WN5U5OU46K type=write size=5240 2024-03-09T14:33:28.071 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.071+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~VY1P6FZ35HF4.0 size=1048576 2024-03-09T14:33:28.072 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.072+0000 7f586ae3d780 1 > prepared part key=_multipart_78Y2ZM3W6EUC.2~VY1P6FZ35HF4.1 size=672147 2024-03-09T14:33:28.072 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.072+0000 7f586ae3d780 1 > prepared multipart upload key=78Y2ZM3W6EUC upload=VY1P6FZ35HF4 tag=S1RBZDXMFGM5 type=write size=2769299 2024-03-09T14:33:28.073 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.074+0000 7f586ae3d780 1 < completed part key=_multipart_509F17DT0C4I.2~O1M0E2EL9YJB.0 size=609963 2024-03-09T14:33:28.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.076+0000 7f586ae3d780 1 < completed multipart upload key=509F17DT0C4I upload=O1M0E2EL9YJB tag=49C4DKYXCKTF type=write size=1658539 2024-03-09T14:33:28.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.078+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~FCDB7ALGCKM7.0 size=1048576 2024-03-09T14:33:28.078 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.079+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~FCDB7ALGCKM7.1 size=1048576 2024-03-09T14:33:28.079 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.080+0000 7f586ae3d780 1 > prepared part key=_multipart_OU9IOY7J572N.2~FCDB7ALGCKM7.2 size=153128 2024-03-09T14:33:28.079 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.080+0000 7f586ae3d780 1 > prepared multipart upload key=OU9IOY7J572N upload=FCDB7ALGCKM7 tag=KLH2IB1S0YSA type=write size=3298856 2024-03-09T14:33:28.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.081+0000 7f586ae3d780 1 < canceled operation key=9ZPCSBP3P58P tag=6L3YVTY8XDGE type=del size=1464760 2024-03-09T14:33:28.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.083+0000 7f586ae3d780 1 > prepared part key=_multipart_9ZPCSBP3P58P.2~O8E1GPN0SCGQ.0 size=880380 2024-03-09T14:33:28.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.083+0000 7f586ae3d780 1 > prepared multipart upload key=9ZPCSBP3P58P upload=O8E1GPN0SCGQ tag=BADF7WW252X0 type=write size=1928956 2024-03-09T14:33:28.084 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.084+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=6NNY5M9QLWST type=del 2024-03-09T14:33:28.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.086+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=NVXMPDYTZRRY type=del size=3198174 2024-03-09T14:33:28.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.087+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~5I7AHFI9JE8U.0 size=1048576 2024-03-09T14:33:28.087 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.088+0000 7f586ae3d780 1 < completed part key=_multipart_57OR9DHRPDCZ.2~5I7AHFI9JE8U.1 size=694657 2024-03-09T14:33:28.089 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.090+0000 7f586ae3d780 1 < completed multipart upload key=57OR9DHRPDCZ upload=5I7AHFI9JE8U tag=5SIHHPYZNP48 type=write size=2791809 2024-03-09T14:33:28.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.092+0000 7f586ae3d780 1 > prepared part key=_multipart_6YWLPUULN5SY.2~GXC7HFB0JMQD.0 size=419388 2024-03-09T14:33:28.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.092+0000 7f586ae3d780 1 > prepared multipart upload key=6YWLPUULN5SY upload=GXC7HFB0JMQD tag=0QR18YVF3GHI type=write size=1467964 2024-03-09T14:33:28.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.093+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~GPAJQYCYX4XF.0 size=1048576 2024-03-09T14:33:28.094 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.094+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~GPAJQYCYX4XF.1 size=1048576 2024-03-09T14:33:28.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.095+0000 7f586ae3d780 1 < completed part key=_multipart_0JDF7910RACF.2~GPAJQYCYX4XF.2 size=368506 2024-03-09T14:33:28.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.097+0000 7f586ae3d780 1 < completed multipart upload key=0JDF7910RACF upload=GPAJQYCYX4XF tag=8WR6REYN06Y6 type=write size=3514234 2024-03-09T14:33:28.098 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.098+0000 7f586ae3d780 1 > prepared operation key=509F17DT0C4I tag=1GHZLO0BNT2N type=del size=1837626 2024-03-09T14:33:28.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.100+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~LMDXJSZMV48D.0 size=1048576 2024-03-09T14:33:28.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.101+0000 7f586ae3d780 1 < completed part key=_multipart_LRI2GKBGVCWW.2~LMDXJSZMV48D.1 size=718637 2024-03-09T14:33:28.102 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.102+0000 7f586ae3d780 1 < completed multipart upload key=LRI2GKBGVCWW upload=LMDXJSZMV48D tag=8NA5TU425E9K type=write size=2815789 2024-03-09T14:33:28.104 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.105+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~40JSIKIWMENI.0 size=1048576 2024-03-09T14:33:28.105 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.106+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~40JSIKIWMENI.1 size=778194 2024-03-09T14:33:28.105 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.106+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=40JSIKIWMENI tag=T3DYYJ8VNUFL type=write size=2875346 2024-03-09T14:33:28.106 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.107+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~9B7K0GDO32VS.0 size=1048576 2024-03-09T14:33:28.107 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.108+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~9B7K0GDO32VS.1 size=1048576 2024-03-09T14:33:28.108 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.109+0000 7f586ae3d780 1 < completed part key=_multipart_5PERWGS0GOJU.2~9B7K0GDO32VS.2 size=193893 2024-03-09T14:33:28.111 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.111+0000 7f586ae3d780 1 < completed multipart upload key=5PERWGS0GOJU upload=9B7K0GDO32VS tag=5Z3KQMKJCV1U type=write size=3339621 2024-03-09T14:33:28.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.113+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=9E1ZZ0X2CYUJ type=del size=3086488 2024-03-09T14:33:28.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.114+0000 7f586ae3d780 1 < completed write operation key=W4Q1MWHOQ4Y1 tag=NVCE7NQOUNEQ type=write size=392200 2024-03-09T14:33:28.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.115+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=B3HEPTO9PFZC type=del size=2179500 2024-03-09T14:33:28.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.116+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~7ADI2FNGL272.0 size=1048576 2024-03-09T14:33:28.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.117+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~7ADI2FNGL272.1 size=1048576 2024-03-09T14:33:28.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.118+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~7ADI2FNGL272.2 size=538922 2024-03-09T14:33:28.119 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.120+0000 7f586ae3d780 1 < completed multipart upload key=UAYZ55UT77VE upload=7ADI2FNGL272 tag=QCTE6VPOY8EM type=write size=3684650 2024-03-09T14:33:28.121 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.121+0000 7f586ae3d780 1 > prepared operation key=IK528ND96157 tag=8LJL9RBCNEY5 type=write size=930667 2024-03-09T14:33:28.122 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.122+0000 7f586ae3d780 1 < completed delete operation key=BHSYRD3IEJWW tag=TF84TLJ19V29 type=del 2024-03-09T14:33:28.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.124+0000 7f586ae3d780 1 > prepared part key=_multipart_DGO3ZT8ST90A.2~J64H90CUOYFG.0 size=879785 2024-03-09T14:33:28.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.124+0000 7f586ae3d780 1 > prepared multipart upload key=DGO3ZT8ST90A upload=J64H90CUOYFG tag=S2LJU3DET9OG type=write size=1928361 2024-03-09T14:33:28.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.125+0000 7f586ae3d780 1 < canceled part key=_multipart_39ZIGOC6JZ1R.2~0TO8CH8726M1.0 size=1048576 2024-03-09T14:33:28.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.126+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~0TO8CH8726M1.1 size=1048576 2024-03-09T14:33:28.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.126+0000 7f586ae3d780 1 < completed part key=_multipart_39ZIGOC6JZ1R.2~0TO8CH8726M1.2 size=794271 2024-03-09T14:33:28.128 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.128+0000 7f586ae3d780 1 < canceled multipart upload key=39ZIGOC6JZ1R upload=0TO8CH8726M1 tag=8LJP3171R1B3 type=write size=3939999 2024-03-09T14:33:28.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.130+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~WNLFJ5JLR3PS.0 size=1048576 2024-03-09T14:33:28.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.131+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~WNLFJ5JLR3PS.1 size=1048576 2024-03-09T14:33:28.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.132+0000 7f586ae3d780 1 > prepared part key=_multipart_NHIOOLNXLZZC.2~WNLFJ5JLR3PS.2 size=25823 2024-03-09T14:33:28.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.132+0000 7f586ae3d780 1 > prepared multipart upload key=NHIOOLNXLZZC upload=WNLFJ5JLR3PS tag=4UIGGTZ7LWPJ type=write size=3171551 2024-03-09T14:33:28.133 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.133+0000 7f586ae3d780 1 < completed delete operation key=78Y2ZM3W6EUC tag=RMV8RXC9GQLE type=del 2024-03-09T14:33:28.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.134+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=DG1BLLPVNIJB type=write size=284271 2024-03-09T14:33:28.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.136+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~PW5PN2A4GIRL.0 size=1048576 2024-03-09T14:33:28.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.137+0000 7f586ae3d780 1 < completed part key=_multipart_UAYZ55UT77VE.2~PW5PN2A4GIRL.1 size=901313 2024-03-09T14:33:28.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.139+0000 7f586ae3d780 1 < completed multipart upload key=UAYZ55UT77VE upload=PW5PN2A4GIRL tag=N94BOGPVJUWK type=write size=2998465 2024-03-09T14:33:28.139 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.140+0000 7f586ae3d780 1 > prepared operation key=UO072H74SHLP tag=AN56L0Q388U0 type=del size=3750813 2024-03-09T14:33:28.141 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.141+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~GKMH9J0UFZWZ.0 size=1048576 2024-03-09T14:33:28.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.142+0000 7f586ae3d780 1 < completed part key=_multipart_04E9KDGUC274.2~GKMH9J0UFZWZ.1 size=645671 2024-03-09T14:33:28.144 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.144+0000 7f586ae3d780 1 < completed multipart upload key=04E9KDGUC274 upload=GKMH9J0UFZWZ tag=HSKMV4TC4M82 type=write size=2742823 2024-03-09T14:33:28.145 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.146+0000 7f586ae3d780 1 > prepared operation key=W4Q1MWHOQ4Y1 tag=365B6W90NMXA type=del size=2662111 2024-03-09T14:33:28.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.147+0000 7f586ae3d780 1 < completed write operation key=BHSYRD3IEJWW tag=WYPJ5V5Q7MII type=write size=437454 2024-03-09T14:33:28.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.148+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=BP1LS0ITWQK0 type=del size=238880 2024-03-09T14:33:28.149 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.149+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~VY1P6FZ35HF4.0 size=1048576 2024-03-09T14:33:28.150 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.150+0000 7f586ae3d780 1 < completed part key=_multipart_78Y2ZM3W6EUC.2~VY1P6FZ35HF4.1 size=672147 2024-03-09T14:33:28.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.152+0000 7f586ae3d780 1 < completed multipart upload key=78Y2ZM3W6EUC upload=VY1P6FZ35HF4 tag=S1RBZDXMFGM5 type=write size=2769299 2024-03-09T14:33:28.153 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.153+0000 7f586ae3d780 1 > prepared operation key=G2BIOBESOIK9 tag=85LOYTXR874M type=del size=4025607 2024-03-09T14:33:28.154 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.155+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~FCDB7ALGCKM7.0 size=1048576 2024-03-09T14:33:28.155 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.155+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~FCDB7ALGCKM7.1 size=1048576 2024-03-09T14:33:28.156 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.156+0000 7f586ae3d780 1 < completed part key=_multipart_OU9IOY7J572N.2~FCDB7ALGCKM7.2 size=153128 2024-03-09T14:33:28.158 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.158+0000 7f586ae3d780 1 < completed multipart upload key=OU9IOY7J572N upload=FCDB7ALGCKM7 tag=KLH2IB1S0YSA type=write size=3298856 2024-03-09T14:33:28.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.160+0000 7f586ae3d780 1 > prepared operation key=LRI2GKBGVCWW tag=F8F3KKK8WGLH type=del size=1649380 2024-03-09T14:33:28.160 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.161+0000 7f586ae3d780 1 < completed part key=_multipart_9ZPCSBP3P58P.2~O8E1GPN0SCGQ.0 size=880380 2024-03-09T14:33:28.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.163+0000 7f586ae3d780 1 < completed multipart upload key=9ZPCSBP3P58P upload=O8E1GPN0SCGQ tag=BADF7WW252X0 type=write size=1928956 2024-03-09T14:33:28.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.164+0000 7f586ae3d780 1 > prepared operation key=5PERWGS0GOJU tag=S5151NWHY1P8 type=del size=2751145 2024-03-09T14:33:28.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.165+0000 7f586ae3d780 1 < completed delete operation key=LRI2GKBGVCWW tag=NVXMPDYTZRRY type=del 2024-03-09T14:33:28.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.167+0000 7f586ae3d780 1 > prepared part key=_multipart_UAYZ55UT77VE.2~HP0SU0DXHJ9C.0 size=1043361 2024-03-09T14:33:28.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.167+0000 7f586ae3d780 1 > prepared multipart upload key=UAYZ55UT77VE upload=HP0SU0DXHJ9C tag=1ZCH0TON8EVO type=write size=2091937 2024-03-09T14:33:28.168 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.169+0000 7f586ae3d780 1 < completed part key=_multipart_6YWLPUULN5SY.2~GXC7HFB0JMQD.0 size=419388 2024-03-09T14:33:28.170 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.171+0000 7f586ae3d780 1 < completed multipart upload key=6YWLPUULN5SY upload=GXC7HFB0JMQD tag=0QR18YVF3GHI type=write size=1467964 2024-03-09T14:33:28.171 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.172+0000 7f586ae3d780 1 > prepared operation key=57OR9DHRPDCZ tag=9SH0C18X4FZK type=del size=214901 2024-03-09T14:33:28.172 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.173+0000 7f586ae3d780 1 < completed delete operation key=509F17DT0C4I tag=1GHZLO0BNT2N type=del 2024-03-09T14:33:28.174 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.174+0000 7f586ae3d780 1 > prepared operation key=6YWLPUULN5SY tag=0ROXFOGX1YFA type=del size=1995624 2024-03-09T14:33:28.174 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.174+0000 7f586ae3d780 1 < canceled part key=_multipart_WNVN3EOUUBGR.2~40JSIKIWMENI.0 size=1048576 2024-03-09T14:33:28.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.175+0000 7f586ae3d780 1 < completed part key=_multipart_WNVN3EOUUBGR.2~40JSIKIWMENI.1 size=778194 2024-03-09T14:33:28.177 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.177+0000 7f586ae3d780 1 < canceled multipart upload key=WNVN3EOUUBGR upload=40JSIKIWMENI tag=T3DYYJ8VNUFL type=write size=2875346 2024-03-09T14:33:28.180 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.180+0000 7f586ae3d780 1 > prepared operation key=P3OUIQNAK1TC tag=8IF3YS89EAU2 type=del size=1468877 2024-03-09T14:33:28.181 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.181+0000 7f586ae3d780 1 < completed delete operation key=P3OUIQNAK1TC tag=9E1ZZ0X2CYUJ type=del 2024-03-09T14:33:28.182 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.183+0000 7f586ae3d780 1 > prepared operation key=C1UGQOQ6AE1E tag=IX9ZTPSV4VZZ type=del size=1866012 2024-03-09T14:33:28.183 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.184+0000 7f586ae3d780 1 < completed delete operation key=UO072H74SHLP tag=B3HEPTO9PFZC type=del 2024-03-09T14:33:28.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.186+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~H1YISTN8W75B.0 size=1048576 2024-03-09T14:33:28.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.187+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~H1YISTN8W75B.1 size=1048576 2024-03-09T14:33:28.187 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.188+0000 7f586ae3d780 1 > prepared part key=_multipart_WNVN3EOUUBGR.2~H1YISTN8W75B.2 size=639695 2024-03-09T14:33:28.187 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:33:28.188+0000 7f586ae3d780 1 > prepared multipart upload key=WNVN3EOUUBGR upload=H1YISTN8W75B tag=6Q3EFZ3CJ227 type=write size=3785423 2024-03-09T14:33:28.188 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] cls_rgw_stats.simulate (8909 ms) 2024-03-09T14:33:28.188 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 1 test from cls_rgw_stats (8909 ms total) 2024-03-09T14:33:28.188 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:33:28.188 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:33:28.353 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 1 test from 1 test suite ran. (10948 ms total) 2024-03-09T14:33:28.353 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 1 test. 2024-03-09T14:33:28.357 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:33:28.357 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:33:28.437 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-03-09T14:33:28.438 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-03-09T14:33:28.438 DEBUG:teuthology.orchestra.run.smithi088:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-03-09T14:33:28.518 INFO:tasks.workunit.client.0.smithi088.stdout:Running main() from gmock_main.cc 2024-03-09T14:33:28.518 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 31 tests from 1 test suite. 2024-03-09T14:33:28.518 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:33:30.365 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 31 tests from CmpOmap 2024-03-09T14:33:30.365 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-03-09T14:33:30.382 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (17 ms) 2024-03-09T14:33:30.382 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-03-09T14:33:30.385 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (3 ms) 2024-03-09T14:33:30.386 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-03-09T14:33:30.389 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (4 ms) 2024-03-09T14:33:30.389 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-03-09T14:33:30.392 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-03-09T14:33:30.392 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-03-09T14:33:30.398 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-03-09T14:33:30.398 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-03-09T14:33:30.405 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_vals_u64 (7 ms) 2024-03-09T14:33:30.405 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-03-09T14:33:30.408 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-03-09T14:33:30.408 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-03-09T14:33:30.412 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-03-09T14:33:30.412 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-03-09T14:33:30.416 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (3 ms) 2024-03-09T14:33:30.416 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-03-09T14:33:30.420 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (5 ms) 2024-03-09T14:33:30.420 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-03-09T14:33:30.421 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (0 ms) 2024-03-09T14:33:30.421 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-03-09T14:33:30.421 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-03-09T14:33:30.421 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-03-09T14:33:30.429 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (8 ms) 2024-03-09T14:33:30.429 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-03-09T14:33:30.435 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (6 ms) 2024-03-09T14:33:30.435 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-03-09T14:33:30.441 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2024-03-09T14:33:30.441 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-03-09T14:33:30.446 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (5 ms) 2024-03-09T14:33:30.447 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-03-09T14:33:30.454 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2024-03-09T14:33:30.454 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-03-09T14:33:30.462 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-03-09T14:33:30.462 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-03-09T14:33:30.465 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-03-09T14:33:30.465 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-03-09T14:33:30.467 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (2 ms) 2024-03-09T14:33:30.467 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-03-09T14:33:30.468 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-03-09T14:33:30.468 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-03-09T14:33:30.469 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-03-09T14:33:30.469 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-03-09T14:33:30.476 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-03-09T14:33:30.476 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-03-09T14:33:30.482 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2024-03-09T14:33:30.482 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-03-09T14:33:30.489 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-03-09T14:33:30.489 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-03-09T14:33:30.497 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (7 ms) 2024-03-09T14:33:30.497 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-03-09T14:33:30.499 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-03-09T14:33:30.499 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-03-09T14:33:30.501 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-03-09T14:33:30.502 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-03-09T14:33:30.503 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-03-09T14:33:30.503 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-03-09T14:33:30.503 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-03-09T14:33:30.503 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-03-09T14:33:30.510 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-03-09T14:33:30.510 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 31 tests from CmpOmap (145 ms total) 2024-03-09T14:33:30.510 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:33:30.510 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:33:31.381 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 31 tests from 1 test suite ran. (2864 ms total) 2024-03-09T14:33:31.381 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 31 tests. 2024-03-09T14:33:31.384 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:33:31.384 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:33:31.471 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-03-09T14:33:31.472 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-03-09T14:33:31.472 DEBUG:teuthology.orchestra.run.smithi088:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-03-09T14:33:31.516 INFO:tasks.workunit.client.0.smithi088.stdout:Running main() from gmock_main.cc 2024-03-09T14:33:31.516 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-09T14:33:31.516 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:33:31.517 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 24 tests from TestCls2PCQueue 2024-03-09T14:33:31.517 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-03-09T14:33:34.407 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2890 ms) 2024-03-09T14:33:34.407 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-03-09T14:33:37.427 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3020 ms) 2024-03-09T14:33:37.427 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-03-09T14:33:40.446 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.Reserve (3018 ms) 2024-03-09T14:33:40.446 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-03-09T14:33:43.475 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3029 ms) 2024-03-09T14:33:43.475 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-03-09T14:33:47.499 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.Commit (4025 ms) 2024-03-09T14:33:47.500 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-03-09T14:33:50.509 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.Stats (3008 ms) 2024-03-09T14:33:50.509 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-03-09T14:33:54.554 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4047 ms) 2024-03-09T14:33:54.554 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-03-09T14:33:57.569 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.Abort (3014 ms) 2024-03-09T14:33:57.570 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-03-09T14:34:00.603 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.ReserveError (3034 ms) 2024-03-09T14:34:00.603 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-03-09T14:34:03.616 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.CommitError (3013 ms) 2024-03-09T14:34:03.616 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-03-09T14:34:06.640 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.AbortError (3025 ms) 2024-03-09T14:34:06.640 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-03-09T14:34:09.644 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3003 ms) 2024-03-09T14:34:09.644 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-03-09T14:34:12.678 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3035 ms) 2024-03-09T14:34:12.679 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-03-09T14:34:15.686 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3007 ms) 2024-03-09T14:34:15.686 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-03-09T14:34:18.715 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3030 ms) 2024-03-09T14:34:18.716 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-03-09T14:34:21.729 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3013 ms) 2024-03-09T14:34:21.729 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-03-09T14:34:24.745 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3017 ms) 2024-03-09T14:34:24.746 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-03-09T14:34:27.762 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.Cleanup (3015 ms) 2024-03-09T14:34:27.762 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-03-09T14:34:37.789 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10028 ms) 2024-03-09T14:34:37.789 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-03-09T14:34:40.801 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3012 ms) 2024-03-09T14:34:40.801 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-03-09T14:34:52.908 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (12107 ms) 2024-03-09T14:34:52.908 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-03-09T14:34:56.938 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4030 ms) 2024-03-09T14:34:56.938 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-03-09T14:35:02.959 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6022 ms) 2024-03-09T14:35:02.960 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-03-09T14:35:09.048 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (6088 ms) 2024-03-09T14:35:09.048 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 24 tests from TestCls2PCQueue (97531 ms total) 2024-03-09T14:35:09.048 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:09.048 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:35:09.048 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 24 tests from 1 test suite ran. (97531 ms total) 2024-03-09T14:35:09.048 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 24 tests. 2024-03-09T14:35:09.051 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:35:09.052 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:35:09.094 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-03-09T14:35:09.096 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-03-09T14:35:09.096 DEBUG:teuthology.orchestra.run.smithi088:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-03-09T14:35:09.186 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:09.186 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:09.186 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 4 tests from 1 test suite. 2024-03-09T14:35:09.186 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:35:11.050 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 4 tests from ClsAccount 2024-03-09T14:35:11.050 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] ClsAccount.add 2024-03-09T14:35:11.074 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] ClsAccount.add (22 ms) 2024-03-09T14:35:11.075 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] ClsAccount.get 2024-03-09T14:35:11.076 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] ClsAccount.get (4 ms) 2024-03-09T14:35:11.076 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] ClsAccount.rm 2024-03-09T14:35:11.082 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] ClsAccount.rm (7 ms) 2024-03-09T14:35:11.082 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] ClsAccount.list 2024-03-09T14:35:11.101 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] ClsAccount.list (18 ms) 2024-03-09T14:35:11.101 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 4 tests from ClsAccount (51 ms total) 2024-03-09T14:35:11.101 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:11.101 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:35:12.057 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 4 tests from 1 test suite ran. (2870 ms total) 2024-03-09T14:35:12.057 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 4 tests. 2024-03-09T14:35:12.061 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:35:12.061 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:35:12.105 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-03-09T14:35:12.107 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-03-09T14:35:12.107 DEBUG:teuthology.orchestra.run.smithi088:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-03-09T14:35:12.197 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:12.197 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:12.198 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 6 tests from 1 test suite. 2024-03-09T14:35:12.198 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:35:14.076 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 6 tests from rgw_gc_log 2024-03-09T14:35:14.076 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-03-09T14:35:14.092 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] rgw_gc_log.init_existing_queue (17 ms) 2024-03-09T14:35:14.092 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-03-09T14:35:14.095 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-03-09T14:35:14.095 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-03-09T14:35:14.099 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-03-09T14:35:14.099 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-03-09T14:35:14.100 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2024-03-09T14:35:14.100 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-03-09T14:35:14.103 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-03-09T14:35:14.103 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-03-09T14:35:14.105 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-03-09T14:35:14.105 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 6 tests from rgw_gc_log (30 ms total) 2024-03-09T14:35:14.105 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:14.105 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:35:15.083 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 6 tests from 1 test suite ran. (2885 ms total) 2024-03-09T14:35:15.083 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 6 tests. 2024-03-09T14:35:15.087 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:35:15.087 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:35:15.131 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-03-09T14:35:15.132 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-03-09T14:35:15.132 DEBUG:teuthology.orchestra.run.smithi088:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-03-09T14:35:15.229 INFO:tasks.workunit.client.0.smithi088.stdout:Running main() from gmock_main.cc 2024-03-09T14:35:15.229 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 4 tests from 1 test suite. 2024-03-09T14:35:15.229 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:35:15.230 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 4 tests from TestRGWObj 2024-03-09T14:35:15.230 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestRGWObj.underscore 2024-03-09T14:35:15.230 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj 2024-03-09T14:35:15.230 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj 2024-03-09T14:35:15.230 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: _obj ns= i= 2024-03-09T14:35:15.230 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj 2024-03-09T14:35:15.231 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj 2024-03-09T14:35:15.231 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: _obj ns= i= 2024-03-09T14:35:15.231 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj 2024-03-09T14:35:15.231 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj 2024-03-09T14:35:15.231 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: _obj ns= i= 2024-03-09T14:35:15.231 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.232 INFO:tasks.workunit.client.0.smithi088.stdout: "obj1": { 2024-03-09T14:35:15.232 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.232 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.232 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.232 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.232 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.233 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.233 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.233 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.233 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.233 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.233 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.234 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.234 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.234 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.234 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.234 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.234 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.235 INFO:tasks.workunit.client.0.smithi088.stdout: "obj2": { 2024-03-09T14:35:15.235 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.235 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.235 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.235 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.235 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.235 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.236 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.236 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.236 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.236 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.236 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.236 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.237 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.237 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.237 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.237 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.237 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.237 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3": { 2024-03-09T14:35:15.237 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.238 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.238 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.238 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.239 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.239 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.239 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.239 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.239 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.239 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.239 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.240 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.240 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.240 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.240 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.240 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.240 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.241 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3-2": { 2024-03-09T14:35:15.241 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.241 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.241 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.241 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.241 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.242 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.242 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.242 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.242 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.242 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.242 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.243 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.243 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.243 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.243 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.243 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.243 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.244 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.244 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj 2024-03-09T14:35:15.244 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj 2024-03-09T14:35:15.244 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: _obj ns=ns i= 2024-03-09T14:35:15.244 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj 2024-03-09T14:35:15.245 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj 2024-03-09T14:35:15.245 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: _obj ns=ns i= 2024-03-09T14:35:15.245 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj 2024-03-09T14:35:15.245 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj 2024-03-09T14:35:15.246 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: _obj ns=ns i= 2024-03-09T14:35:15.246 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.246 INFO:tasks.workunit.client.0.smithi088.stdout: "obj1": { 2024-03-09T14:35:15.246 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.247 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.247 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.247 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.247 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.247 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.247 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.247 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.248 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.248 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.248 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.248 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.248 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.248 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.248 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.248 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.248 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.248 INFO:tasks.workunit.client.0.smithi088.stdout: "obj2": { 2024-03-09T14:35:15.248 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.248 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.248 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.248 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.249 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.249 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.249 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.249 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.249 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.249 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.249 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.249 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.250 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.250 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.250 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.250 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.250 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.250 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3": { 2024-03-09T14:35:15.250 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.250 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.250 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.250 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.250 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.250 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.250 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.250 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3-2": { 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.251 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.252 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.252 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.252 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.252 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.252 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.252 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.252 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.252 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.252 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.252 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.252 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.252 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.252 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj[v1] 2024-03-09T14:35:15.252 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj[v1] 2024-03-09T14:35:15.252 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: _obj ns= i=v1 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj[v1] 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj[v1] 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: _obj ns= i=v1 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj[v1] 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj[v1] 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: _obj ns= i=v1 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout: "obj1": { 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.253 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "v1", 2024-03-09T14:35:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: "obj2": { 2024-03-09T14:35:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.254 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.255 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.255 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.255 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.255 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.255 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.255 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.255 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.255 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.255 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "v1", 2024-03-09T14:35:15.255 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.255 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.255 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.255 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3": { 2024-03-09T14:35:15.255 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.255 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.256 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3-2": { 2024-03-09T14:35:15.257 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.257 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.257 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.257 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.257 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.257 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.257 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.257 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.257 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.257 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.257 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.257 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.257 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.258 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "v1", 2024-03-09T14:35:15.258 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.258 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.258 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.258 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.258 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj[v1] 2024-03-09T14:35:15.258 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj[v1] 2024-03-09T14:35:15.258 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: _obj ns=ns i=v1 2024-03-09T14:35:15.258 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj[v1] 2024-03-09T14:35:15.258 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj[v1] 2024-03-09T14:35:15.258 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: _obj ns=ns i=v1 2024-03-09T14:35:15.258 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj[v1] 2024-03-09T14:35:15.259 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: _obj[v1] 2024-03-09T14:35:15.259 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: _obj ns=ns i=v1 2024-03-09T14:35:15.259 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.259 INFO:tasks.workunit.client.0.smithi088.stdout: "obj1": { 2024-03-09T14:35:15.259 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.259 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.259 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.259 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.259 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.259 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.259 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.259 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.259 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.259 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.259 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "v1", 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: "obj2": { 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.260 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.261 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.261 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.261 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.261 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.261 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "v1", 2024-03-09T14:35:15.261 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.261 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.261 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.261 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3": { 2024-03-09T14:35:15.261 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.261 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.261 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.261 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.261 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.261 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3-2": { 2024-03-09T14:35:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.262 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.263 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.263 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.263 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.263 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.263 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.263 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.263 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.263 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.263 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.263 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_obj", 2024-03-09T14:35:15.263 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "v1", 2024-03-09T14:35:15.263 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.263 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.263 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.263 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.264 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-03-09T14:35:15.264 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestRGWObj.no_underscore 2024-03-09T14:35:15.264 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj 2024-03-09T14:35:15.264 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj 2024-03-09T14:35:15.264 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: obj ns= i= 2024-03-09T14:35:15.264 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj 2024-03-09T14:35:15.264 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj 2024-03-09T14:35:15.264 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: obj ns= i= 2024-03-09T14:35:15.264 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj 2024-03-09T14:35:15.264 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj 2024-03-09T14:35:15.264 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: obj ns= i= 2024-03-09T14:35:15.264 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.264 INFO:tasks.workunit.client.0.smithi088.stdout: "obj1": { 2024-03-09T14:35:15.264 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.264 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.265 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.265 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.265 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.265 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.265 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.265 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.265 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.265 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.265 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.265 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.265 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.265 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.265 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.265 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: "obj2": { 2024-03-09T14:35:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.266 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3": { 2024-03-09T14:35:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.267 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.268 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.268 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.268 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.268 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.268 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.268 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.268 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.268 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3-2": { 2024-03-09T14:35:15.268 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.268 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.268 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.268 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.268 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.268 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.268 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: obj ns=ns i= 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj 2024-03-09T14:35:15.269 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj 2024-03-09T14:35:15.270 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: obj ns=ns i= 2024-03-09T14:35:15.270 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj 2024-03-09T14:35:15.270 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj 2024-03-09T14:35:15.270 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: obj ns=ns i= 2024-03-09T14:35:15.270 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.270 INFO:tasks.workunit.client.0.smithi088.stdout: "obj1": { 2024-03-09T14:35:15.270 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.270 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.270 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.270 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.270 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.270 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.270 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.270 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.271 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.271 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.271 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.271 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.271 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.271 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.271 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.271 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.271 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.271 INFO:tasks.workunit.client.0.smithi088.stdout: "obj2": { 2024-03-09T14:35:15.271 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.271 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.271 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.271 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.271 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.272 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.272 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.272 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.272 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.272 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.272 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.272 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.272 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.272 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.272 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.272 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.272 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.272 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3": { 2024-03-09T14:35:15.272 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.272 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.273 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.273 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.273 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.273 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.273 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.273 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.273 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.273 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.273 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.273 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.273 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.273 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.273 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.273 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.273 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.274 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3-2": { 2024-03-09T14:35:15.274 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.274 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.274 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.274 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.274 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.274 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.274 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.274 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.274 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.274 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.274 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.274 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.274 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.274 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj[v1] 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj[v1] 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: obj ns= i=v1 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj[v1] 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj[v1] 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: obj ns= i=v1 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj[v1] 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj[v1] 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: obj ns= i=v1 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout: "obj1": { 2024-03-09T14:35:15.275 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.276 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.276 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.276 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.276 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.276 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.276 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.276 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.276 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.276 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.276 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.276 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.276 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.276 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "v1", 2024-03-09T14:35:15.276 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.276 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: "obj2": { 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.277 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "v1", 2024-03-09T14:35:15.278 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.278 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.278 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.278 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3": { 2024-03-09T14:35:15.278 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.278 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.278 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.278 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.278 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.278 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.278 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.278 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.278 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.278 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.278 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.279 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.279 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.279 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.279 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.279 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.279 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.279 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3-2": { 2024-03-09T14:35:15.279 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.279 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.279 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.279 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.279 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.279 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.279 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.279 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "v1", 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj[v1] 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj[v1] 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: obj ns=ns i=v1 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj[v1] 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj[v1] 2024-03-09T14:35:15.280 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: obj ns=ns i=v1 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj[v1] 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout:parsed: obj[v1] 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout:stripped: obj ns=ns i=v1 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout: "obj1": { 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.281 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.282 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.282 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.282 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "v1", 2024-03-09T14:35:15.282 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.282 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.282 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.282 INFO:tasks.workunit.client.0.smithi088.stdout: "obj2": { 2024-03-09T14:35:15.282 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.282 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.282 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.282 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.282 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.282 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.282 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "v1", 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3": { 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.283 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.284 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.284 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.284 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.284 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.284 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.284 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.284 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.284 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.284 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.284 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.284 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.284 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.284 INFO:tasks.workunit.client.0.smithi088.stdout: "obj3-2": { 2024-03-09T14:35:15.284 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.284 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "obj", 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "v1", 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.285 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.286 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-03-09T14:35:15.286 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-03-09T14:35:15.286 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.286 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.286 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.286 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.286 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.286 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.286 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.286 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.286 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.286 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.286 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.286 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.287 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.288 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.288 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.288 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.288 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.288 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.288 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.288 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.288 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": "default-placement.data", 2024-03-09T14:35:15.288 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker_myobj", 2024-03-09T14:35:15.288 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.288 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.288 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.288 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.288 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.289 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.290 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.290 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.290 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.290 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.290 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.290 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.290 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.290 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.290 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.290 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.290 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.290 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.290 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.290 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.290 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.291 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.291 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.291 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.291 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.291 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.291 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.291 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.291 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.291 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.291 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.291 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.291 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.291 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.291 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.291 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.292 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.292 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.292 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.292 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.292 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.292 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.292 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.292 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.292 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker_myobj", 2024-03-09T14:35:15.292 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.292 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.292 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.292 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.292 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.292 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.293 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.294 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.294 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.294 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.294 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.294 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.294 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.294 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.294 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.294 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.294 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.294 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.294 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.294 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.294 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.294 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.295 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.295 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.295 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.295 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.295 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.295 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.295 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.295 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.295 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.295 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.295 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.295 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.295 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.295 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.295 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.296 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.296 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.296 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.296 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.296 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.296 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.296 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": "default-placement.data", 2024-03-09T14:35:15.296 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns_myobj", 2024-03-09T14:35:15.296 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.296 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.296 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.296 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.296 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.296 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.296 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.297 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.297 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.297 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.297 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.297 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.297 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.297 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.297 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.297 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.297 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.297 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.297 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.297 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.297 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.297 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.298 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.298 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.298 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.298 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.298 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.298 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.298 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.298 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.298 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.298 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.298 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.298 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.298 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.298 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.298 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.299 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.299 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.299 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.299 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.299 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.299 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.299 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.299 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.299 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.299 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.299 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.299 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.299 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.299 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.299 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns_myobj", 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.300 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.301 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.301 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.301 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.301 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.301 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.301 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.301 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.301 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.301 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.301 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.301 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.301 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.301 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.301 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.301 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.302 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.302 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.302 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.302 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.302 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.302 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.302 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.302 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.302 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.302 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.302 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.302 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.302 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.302 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.302 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.303 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.304 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.304 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.304 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.304 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.304 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": "default-placement.data", 2024-03-09T14:35:15.304 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__:inst_myobj", 2024-03-09T14:35:15.304 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.304 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.304 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.304 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.304 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.304 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.304 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.304 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.304 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.305 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.306 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.306 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.306 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.306 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.306 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.306 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.306 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.306 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.306 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.306 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.306 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.306 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.306 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.306 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.306 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.307 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.307 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.307 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.307 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.307 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.307 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.307 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.307 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.307 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.307 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.307 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.307 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.307 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.307 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.307 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.308 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.308 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.308 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.308 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.308 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__:inst_myobj", 2024-03-09T14:35:15.308 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.308 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.308 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.308 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.308 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.308 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.308 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.308 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.308 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.309 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.310 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.310 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.310 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.310 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.310 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.310 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.310 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.310 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.310 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.310 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.310 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.310 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.310 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.310 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.310 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.311 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.311 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.311 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.311 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.311 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.311 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.311 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.311 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.311 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.311 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.311 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.311 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.311 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.311 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.311 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": "default-placement.data", 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns:inst_myobj", 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.312 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.313 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.313 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.313 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.313 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.313 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.313 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.313 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.313 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.313 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.313 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.313 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.313 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.313 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.313 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.314 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.314 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.314 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.314 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.314 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.314 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.314 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.314 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.314 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.314 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.314 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.314 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.314 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.314 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.315 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.316 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.316 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.316 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.316 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.316 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns:inst_myobj", 2024-03-09T14:35:15.316 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.316 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.316 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.316 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.316 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.316 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.316 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.316 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.316 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.316 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.317 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.317 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.317 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.317 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.317 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.317 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.317 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.317 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.317 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.317 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.317 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.317 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.317 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.317 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.317 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.318 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.318 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.318 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.318 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.318 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.318 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.318 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.318 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.318 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.318 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.318 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.318 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.318 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.319 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.319 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.319 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.319 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.319 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.319 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.319 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.319 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.319 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.319 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.319 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.319 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.319 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.319 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.319 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.320 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.320 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.320 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.320 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.320 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.320 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": "default-placement.data", 2024-03-09T14:35:15.320 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker___myobj", 2024-03-09T14:35:15.320 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj" 2024-03-09T14:35:15.320 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.320 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.320 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.320 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.320 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.320 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.320 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.321 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.321 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.321 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.321 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.321 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.321 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.321 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.321 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.321 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.321 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.321 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.321 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.321 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.321 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.321 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.322 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.322 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.322 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.322 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.322 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.322 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.322 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.322 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.322 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.322 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.322 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.322 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.322 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.322 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.322 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.323 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.323 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.323 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.323 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.323 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.323 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.323 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.323 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.323 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.323 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.323 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.323 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.323 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.323 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.323 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker___myobj", 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj" 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.324 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.325 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.326 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.326 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.326 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.326 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.326 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.326 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.326 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.326 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.326 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.326 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.326 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.326 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.326 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.326 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.326 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.327 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.327 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.327 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.327 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.327 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.327 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.327 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.327 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.327 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.327 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.327 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.327 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.327 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.327 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.327 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": "default-placement.data", 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns__myobj", 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.328 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.329 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.329 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.329 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.329 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.329 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.329 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.329 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.329 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.329 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.329 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.329 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.329 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.329 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.329 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.329 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.330 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.331 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.331 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.331 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.331 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.331 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.331 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.331 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.331 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.331 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.331 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.331 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.331 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.331 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.331 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.331 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns__myobj", 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.332 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.333 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.333 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.333 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.333 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.333 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.333 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.333 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.333 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.333 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.333 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.333 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.333 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.333 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.333 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.333 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.334 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.334 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.334 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.334 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.334 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.334 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.334 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.334 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.334 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.334 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.334 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.334 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.334 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.334 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.334 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.335 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": "default-placement.data", 2024-03-09T14:35:15.336 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__:inst__myobj", 2024-03-09T14:35:15.336 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj" 2024-03-09T14:35:15.336 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.336 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.336 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.336 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.336 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.336 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.336 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.336 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.336 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.336 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.336 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.336 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.336 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.337 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.338 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.338 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.338 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.338 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.338 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.338 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.338 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.338 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.338 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.338 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.338 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.338 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.338 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.338 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.339 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.339 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.339 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.339 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.339 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.339 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.339 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.339 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.339 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.339 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.339 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.339 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.339 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.339 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.339 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.340 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__:inst__myobj", 2024-03-09T14:35:15.340 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj" 2024-03-09T14:35:15.340 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.340 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.340 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.340 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.340 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.340 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.340 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.340 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.340 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.340 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.340 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.340 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.340 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.341 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.341 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.341 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.341 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.341 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.341 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.341 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.341 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.341 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.341 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.341 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.341 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.341 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.341 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.341 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.342 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.342 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.342 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.342 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.342 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.342 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.342 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.342 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.342 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.342 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.342 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.342 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.342 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.342 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.342 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.343 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.343 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.343 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.343 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.343 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.343 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.343 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.343 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.343 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.343 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.343 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.343 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.343 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.343 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.343 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": "default-placement.data", 2024-03-09T14:35:15.344 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns:inst__myobj", 2024-03-09T14:35:15.344 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.344 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.344 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.344 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.344 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.344 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.344 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.344 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.344 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.344 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.344 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.344 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.344 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.345 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.345 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.345 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.345 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.345 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.345 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.345 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.345 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.345 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.345 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.345 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.345 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.345 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.345 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.346 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.346 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.346 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.346 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.346 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.346 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.346 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.346 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.346 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.346 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.346 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.346 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.346 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.346 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.347 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.347 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.347 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.347 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.347 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.347 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.347 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.347 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.347 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.347 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.347 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.347 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.347 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.347 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.348 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.348 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.348 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.348 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.348 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns:inst__myobj", 2024-03-09T14:35:15.348 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.348 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.348 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.348 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.348 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.348 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.348 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.348 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.348 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.348 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.349 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.349 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.349 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.349 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.349 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.349 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.349 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.349 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.349 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.349 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.349 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.349 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.349 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.349 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.349 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.350 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.350 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.350 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.350 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.350 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.350 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.350 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.350 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.350 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.350 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.350 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.350 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.350 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.350 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.351 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.351 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.351 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.351 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.351 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.351 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.351 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.351 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.351 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.351 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.351 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.351 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.351 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.351 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": "default-placement.data", 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker___myobj_", 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj_" 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.352 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.353 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.353 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.353 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.353 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.353 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.353 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.353 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.353 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.353 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.353 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.353 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.353 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.353 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.354 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.354 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.354 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.354 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.354 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.354 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.354 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.354 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.354 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.354 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.354 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.354 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.354 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.354 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.355 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.355 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.355 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.355 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.355 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.355 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.355 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.355 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.355 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.355 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.355 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.355 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.355 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.355 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.355 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.356 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.356 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.356 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.356 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.356 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.356 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.356 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.356 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.356 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker___myobj_", 2024-03-09T14:35:15.356 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj_" 2024-03-09T14:35:15.356 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.356 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.356 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.356 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.357 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.358 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.358 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.358 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.358 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.358 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.358 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.358 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.358 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.358 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.358 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.358 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.358 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.358 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.358 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.359 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.359 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.359 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.359 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.359 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.359 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.359 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.359 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.359 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.359 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.359 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.359 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.359 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.359 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.359 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.360 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.360 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.360 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.360 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.360 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.360 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.360 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.360 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.360 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.360 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": "default-placement.data", 2024-03-09T14:35:15.360 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns__myobj_", 2024-03-09T14:35:15.360 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.360 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.360 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.360 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.361 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.362 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.362 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.362 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.362 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.362 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.362 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.362 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.362 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.362 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.362 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.362 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.362 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.362 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.362 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.363 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.363 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.363 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.363 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.363 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.363 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.363 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.363 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.363 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.363 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.363 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.363 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.363 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.363 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.363 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.364 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.364 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.364 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.364 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.364 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.364 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.364 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.364 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.364 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.364 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.364 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns__myobj_", 2024-03-09T14:35:15.364 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.364 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.364 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.364 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.365 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.365 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.365 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.365 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.365 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.365 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.365 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.365 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.365 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.365 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.365 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.365 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.365 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.365 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.365 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.366 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.366 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.366 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.366 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.366 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.366 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.366 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.366 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.366 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.366 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.366 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.366 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.366 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.366 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.366 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.367 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.368 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.368 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.368 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.368 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.368 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.368 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.368 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.368 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.368 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": "default-placement.data", 2024-03-09T14:35:15.368 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__:inst__myobj_", 2024-03-09T14:35:15.368 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj_" 2024-03-09T14:35:15.368 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.368 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.368 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.368 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.369 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.369 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.369 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.369 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.369 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.369 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.369 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.369 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.369 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.369 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.369 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.369 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.369 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.369 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.369 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.370 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.370 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.370 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.370 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.370 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.370 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.370 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.370 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.370 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.370 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.370 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.370 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.370 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.370 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.370 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.371 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.371 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.371 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.371 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.371 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.371 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.371 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.371 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.371 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.371 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.373 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.373 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.373 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.373 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.373 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.373 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.373 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.373 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.373 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.374 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.374 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.374 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.374 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.374 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.374 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__:inst__myobj_", 2024-03-09T14:35:15.374 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj_" 2024-03-09T14:35:15.374 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.374 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.374 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.374 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.374 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.374 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.374 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.375 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.376 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.376 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.376 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.376 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.376 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.376 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.376 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.376 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.376 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.376 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.376 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.376 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.376 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.376 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.376 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.377 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.377 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.377 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.377 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.377 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.377 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.377 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.377 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.377 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.377 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.377 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.377 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.377 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.377 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.377 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.378 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.378 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.378 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.378 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.378 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": "default-placement.data", 2024-03-09T14:35:15.378 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-09T14:35:15.378 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.378 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.378 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.378 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.378 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.378 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.378 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "test", 2024-03-09T14:35:15.378 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.379 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.379 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.379 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.379 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": "", 2024-03-09T14:35:15.379 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.379 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": "" 2024-03-09T14:35:15.379 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.379 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.379 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.379 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.379 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.379 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.379 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.379 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.379 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.380 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.380 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.380 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.380 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.380 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.380 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.380 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.380 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.380 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.380 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.380 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.380 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.380 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.380 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.380 INFO:tasks.workunit.client.0.smithi088.stdout: "obj": { 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.381 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.382 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.382 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.382 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.382 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.382 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.382 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-09T14:35:15.382 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.382 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.382 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.382 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.382 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.382 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.382 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.382 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.383 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.383 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.383 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.383 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.383 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.383 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.383 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.383 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.383 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.383 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.383 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.383 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.383 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.383 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.383 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.384 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-03-09T14:35:15.384 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-03-09T14:35:15.384 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.384 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.384 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.384 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker_myobj", 2024-03-09T14:35:15.384 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.384 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.384 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.384 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.384 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.384 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.384 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.384 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.384 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.385 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.385 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.385 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.385 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.385 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.385 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.385 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.385 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.385 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.385 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.385 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.385 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.385 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.385 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.385 INFO:tasks.workunit.client.0.smithi088.stdout:raw=.data-pool:marker_myobj 2024-03-09T14:35:15.386 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.386 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj2": { 2024-03-09T14:35:15.386 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.386 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker_myobj", 2024-03-09T14:35:15.386 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.386 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.386 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.386 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.386 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj2": { 2024-03-09T14:35:15.386 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.386 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.386 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.386 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.386 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.386 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.387 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.387 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.387 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.387 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.387 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.387 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.387 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.387 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.387 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.387 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.387 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.387 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.387 INFO:tasks.workunit.client.0.smithi088.stdout:raw2=.data-pool:marker_myobj 2024-03-09T14:35:15.388 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.388 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.388 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.388 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns_myobj", 2024-03-09T14:35:15.388 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.388 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.388 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.388 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.388 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.388 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.388 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.388 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.388 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.388 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.388 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.389 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.389 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.389 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.389 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.389 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.389 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.389 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.389 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.389 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.389 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.389 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.389 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.389 INFO:tasks.workunit.client.0.smithi088.stdout:raw=.data-pool:marker__ns_myobj 2024-03-09T14:35:15.389 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.390 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj2": { 2024-03-09T14:35:15.390 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.390 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns_myobj", 2024-03-09T14:35:15.390 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.390 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.390 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.390 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.390 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj2": { 2024-03-09T14:35:15.390 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.390 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.390 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.390 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.390 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.390 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.391 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.391 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.391 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.391 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.391 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.391 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.391 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.391 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.391 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.391 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.391 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.391 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.391 INFO:tasks.workunit.client.0.smithi088.stdout:raw2=.data-pool:marker__ns_myobj 2024-03-09T14:35:15.392 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.392 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.392 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.392 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__:inst_myobj", 2024-03-09T14:35:15.392 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.392 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.392 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.392 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.392 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.392 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.392 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.392 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.392 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.392 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.392 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.393 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.393 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.393 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.393 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.393 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.393 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.393 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.393 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.393 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.393 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.393 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.393 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.393 INFO:tasks.workunit.client.0.smithi088.stdout:raw=.data-pool:marker__:inst_myobj 2024-03-09T14:35:15.393 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.393 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj2": { 2024-03-09T14:35:15.394 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.394 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__:inst_myobj", 2024-03-09T14:35:15.394 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.394 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.394 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.394 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.394 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj2": { 2024-03-09T14:35:15.394 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.394 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.394 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.394 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.394 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.394 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.394 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout:raw2=.data-pool:marker__:inst_myobj 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.395 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns:inst_myobj", 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.396 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.397 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.397 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.397 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.397 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.397 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.397 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.397 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.397 INFO:tasks.workunit.client.0.smithi088.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-03-09T14:35:15.397 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.397 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj2": { 2024-03-09T14:35:15.397 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.397 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns:inst_myobj", 2024-03-09T14:35:15.397 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.397 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.398 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.398 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.398 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj2": { 2024-03-09T14:35:15.398 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.398 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.398 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.398 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.398 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.398 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.398 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.398 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.398 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.398 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.398 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.398 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.399 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "myobj", 2024-03-09T14:35:15.399 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.399 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.399 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.399 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.399 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.399 INFO:tasks.workunit.client.0.smithi088.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-03-09T14:35:15.399 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.399 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.399 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.399 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker___myobj", 2024-03-09T14:35:15.399 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj" 2024-03-09T14:35:15.399 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.399 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.399 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.400 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.401 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.401 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.401 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.401 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.401 INFO:tasks.workunit.client.0.smithi088.stdout:raw=.data-pool:marker___myobj 2024-03-09T14:35:15.401 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.401 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj2": { 2024-03-09T14:35:15.401 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.401 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker___myobj", 2024-03-09T14:35:15.401 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj" 2024-03-09T14:35:15.401 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.401 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.401 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.401 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj2": { 2024-03-09T14:35:15.401 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.402 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.402 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.402 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.402 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.402 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.402 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.402 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.402 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.402 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.402 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.402 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.402 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.402 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.402 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout:raw2=.data-pool:marker___myobj 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns__myobj", 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.403 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.404 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.404 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.404 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.404 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.404 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.404 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.404 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.404 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.404 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.404 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.404 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.404 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.404 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.404 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.404 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout:raw=.data-pool:marker__ns__myobj 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj2": { 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns__myobj", 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj2": { 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.405 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.406 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.406 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.406 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.406 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.406 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.406 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.406 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.406 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.406 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.406 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.406 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.406 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.406 INFO:tasks.workunit.client.0.smithi088.stdout:raw2=.data-pool:marker__ns__myobj 2024-03-09T14:35:15.406 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.407 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.407 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.407 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__:inst__myobj", 2024-03-09T14:35:15.407 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj" 2024-03-09T14:35:15.407 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.407 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.407 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.407 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.407 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.407 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.407 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.407 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.407 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.407 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.407 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.408 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.408 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.408 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.408 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.408 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.408 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.408 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.408 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.408 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.408 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.408 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.408 INFO:tasks.workunit.client.0.smithi088.stdout:raw=.data-pool:marker__:inst__myobj 2024-03-09T14:35:15.408 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.408 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj2": { 2024-03-09T14:35:15.408 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__:inst__myobj", 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj" 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj2": { 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.409 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.410 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.410 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.410 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.410 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.410 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.410 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.410 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.410 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.410 INFO:tasks.workunit.client.0.smithi088.stdout:raw2=.data-pool:marker__:inst__myobj 2024-03-09T14:35:15.410 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.410 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.410 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.411 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns:inst__myobj", 2024-03-09T14:35:15.411 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.411 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.411 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.411 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.411 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.411 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.411 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.411 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.411 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.412 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.412 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.412 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.412 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.412 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.412 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.412 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.412 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.412 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.412 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.412 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.412 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.412 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.412 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.412 INFO:tasks.workunit.client.0.smithi088.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-03-09T14:35:15.413 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.413 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj2": { 2024-03-09T14:35:15.413 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.413 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns:inst__myobj", 2024-03-09T14:35:15.413 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.413 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.413 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.413 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.413 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj2": { 2024-03-09T14:35:15.413 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.413 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.413 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.413 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.413 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.414 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.414 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.414 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.414 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.414 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.414 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.414 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.414 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj", 2024-03-09T14:35:15.414 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.414 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.414 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.414 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.414 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.414 INFO:tasks.workunit.client.0.smithi088.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-03-09T14:35:15.415 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.415 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.415 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.415 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker___myobj_", 2024-03-09T14:35:15.415 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj_" 2024-03-09T14:35:15.415 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.415 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.415 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.415 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.415 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.415 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.415 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.415 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.415 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.415 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.416 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.416 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.416 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.416 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.416 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.416 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.416 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.416 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.416 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.416 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.416 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.416 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.416 INFO:tasks.workunit.client.0.smithi088.stdout:raw=.data-pool:marker___myobj_ 2024-03-09T14:35:15.416 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.416 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj2": { 2024-03-09T14:35:15.417 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.417 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker___myobj_", 2024-03-09T14:35:15.417 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj_" 2024-03-09T14:35:15.417 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.417 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.417 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.417 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj2": { 2024-03-09T14:35:15.417 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.417 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.417 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.417 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.417 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.417 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.417 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.417 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.418 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.418 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.418 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.418 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.418 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.418 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.418 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.418 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.418 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.418 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.418 INFO:tasks.workunit.client.0.smithi088.stdout:raw2=.data-pool:marker___myobj_ 2024-03-09T14:35:15.418 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.418 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.418 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.419 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns__myobj_", 2024-03-09T14:35:15.419 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.419 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.419 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.419 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.419 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.419 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.419 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.419 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.419 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.419 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.419 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.419 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.419 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.419 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.420 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.420 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.420 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.420 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.420 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.420 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.420 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.420 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.420 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.420 INFO:tasks.workunit.client.0.smithi088.stdout:raw=.data-pool:marker__ns__myobj_ 2024-03-09T14:35:15.420 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.420 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj2": { 2024-03-09T14:35:15.420 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.420 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns__myobj_", 2024-03-09T14:35:15.420 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.421 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.421 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.421 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.421 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj2": { 2024-03-09T14:35:15.421 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.421 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.421 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.421 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.421 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.421 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.421 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.421 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.421 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.421 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.421 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.422 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.422 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.422 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "", 2024-03-09T14:35:15.422 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.422 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.422 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.422 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.422 INFO:tasks.workunit.client.0.smithi088.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-03-09T14:35:15.422 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.422 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.422 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.422 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__:inst__myobj_", 2024-03-09T14:35:15.422 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj_" 2024-03-09T14:35:15.422 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.422 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.423 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.424 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.424 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.424 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.424 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.424 INFO:tasks.workunit.client.0.smithi088.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-03-09T14:35:15.424 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.424 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj2": { 2024-03-09T14:35:15.424 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.424 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__:inst__myobj_", 2024-03-09T14:35:15.424 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "marker__myobj_" 2024-03-09T14:35:15.424 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.424 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.424 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.424 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj2": { 2024-03-09T14:35:15.424 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "" 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.425 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.426 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.426 INFO:tasks.workunit.client.0.smithi088.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-03-09T14:35:15.426 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.426 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj": { 2024-03-09T14:35:15.426 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.426 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-09T14:35:15.426 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.426 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.426 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.426 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.426 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj": { 2024-03-09T14:35:15.426 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.426 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.426 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.426 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-03-09T14:35:15.427 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout: "raw_obj2": { 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout: "pool": ".data-pool", 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout: "loc": "" 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout: "new_obj2": { 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket": { 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "ebtest", 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout: "marker": "marker", 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_id": "bucket-id", 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout: "tenant": "", 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout: "explicit_placement": { 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout: "data_pool": ".data-pool", 2024-03-09T14:35:15.428 INFO:tasks.workunit.client.0.smithi088.stdout: "data_extra_pool": "", 2024-03-09T14:35:15.429 INFO:tasks.workunit.client.0.smithi088.stdout: "index_pool": ".index-pool" 2024-03-09T14:35:15.429 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.429 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:15.429 INFO:tasks.workunit.client.0.smithi088.stdout: "key": { 2024-03-09T14:35:15.429 INFO:tasks.workunit.client.0.smithi088.stdout: "name": "_myobj_", 2024-03-09T14:35:15.429 INFO:tasks.workunit.client.0.smithi088.stdout: "instance": "inst", 2024-03-09T14:35:15.429 INFO:tasks.workunit.client.0.smithi088.stdout: "ns": "ns" 2024-03-09T14:35:15.429 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.429 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:15.429 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:15.429 INFO:tasks.workunit.client.0.smithi088.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-03-09T14:35:15.429 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] TestRGWObj.old_to_raw (1 ms) 2024-03-09T14:35:15.429 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-03-09T14:35:15.429 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:15.429 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:35:15.430 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-03-09T14:35:15.430 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 4 tests. 2024-03-09T14:35:15.430 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:35:15.430 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:35:15.470 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-03-09T14:35:15.471 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-03-09T14:35:15.472 DEBUG:teuthology.orchestra.run.smithi088:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-03-09T14:35:15.766 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:15.766 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:15.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:15.799+0000 7fa6b8c9d800 20 rados->read ofs=0 len=0 2024-03-09T14:35:15.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:15.800+0000 7fa6b8c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:15.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:15.800+0000 7fa6b8c9d800 20 realm 2024-03-09T14:35:15.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:15.800+0000 7fa6b8c9d800 20 rados->read ofs=0 len=0 2024-03-09T14:35:15.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:15.800+0000 7fa6b8c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:15.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:15.800+0000 7fa6b8c9d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:35:15.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:15.800+0000 7fa6b8c9d800 20 rados->read ofs=0 len=0 2024-03-09T14:35:15.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:15.801+0000 7fa6b8c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:15.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:15.801+0000 7fa6b8c9d800 20 rados->read ofs=0 len=0 2024-03-09T14:35:15.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:15.802+0000 7fa6b8c9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:35:15.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:15.802+0000 7fa6b8c9d800 20 rados->read ofs=0 len=0 2024-03-09T14:35:15.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:15.802+0000 7fa6b8c9d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:35:15.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:15.802+0000 7fa6b8c9d800 20 searching for the correct realm 2024-03-09T14:35:15.805 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:15.805+0000 7fa6b6f9a640 0 -- 172.21.15.88:0/1606797438 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fa6b003dbe0 msgr2=0x7fa6b0033920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:35:15.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:15.810+0000 7fa6b5f98640 0 -- 172.21.15.88:0/1606797438 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fa6b004d930 msgr2=0x7fa6b0026400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:35:16.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.017+0000 7fa6b8c9d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:35:16.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.017+0000 7fa6b8c9d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:35:16.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.017+0000 7fa6b8c9d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:35:16.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.017+0000 7fa6b8c9d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:35:16.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.017+0000 7fa6b8c9d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:35:16.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.017+0000 7fa6b8c9d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:35:16.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.017+0000 7fa6b8c9d800 20 rados->read ofs=0 len=0 2024-03-09T14:35:16.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.017+0000 7fa6b8c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:16.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.017+0000 7fa6b8c9d800 20 rados->read ofs=0 len=0 2024-03-09T14:35:16.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.018+0000 7fa6b8c9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:35:16.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.018+0000 7fa6b8c9d800 20 rados->read ofs=0 len=0 2024-03-09T14:35:16.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.018+0000 7fa6b8c9d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:35:16.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.018+0000 7fa6b8c9d800 20 zone default found 2024-03-09T14:35:16.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.018+0000 7fa6b8c9d800 4 Realm: () 2024-03-09T14:35:16.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.018+0000 7fa6b8c9d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:35:16.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.018+0000 7fa6b8c9d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:35:16.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.018+0000 7fa6b8c9d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:35:16.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.018+0000 7fa6b8c9d800 20 zonegroup default 2024-03-09T14:35:16.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.018+0000 7fa6b8c9d800 20 rados->read ofs=0 len=0 2024-03-09T14:35:16.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.018+0000 7fa6b8c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:16.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.018+0000 7fa6b8c9d800 20 rados->read ofs=0 len=0 2024-03-09T14:35:16.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.019+0000 7fa6b8c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:16.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.019+0000 7fa6b8c9d800 20 rados->read ofs=0 len=0 2024-03-09T14:35:16.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.019+0000 7fa6b8c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:16.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.019+0000 7fa6b8c9d800 20 started sync module instance, tier type = 2024-03-09T14:35:16.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.019+0000 7fa6b8c9d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:35:16.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.030+0000 7fa6b8c9d800 20 add_watcher() i=0 2024-03-09T14:35:16.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.030+0000 7fa6b8c9d800 20 add_watcher() i=1 2024-03-09T14:35:16.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.030+0000 7fa6b8c9d800 20 add_watcher() i=2 2024-03-09T14:35:16.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.030+0000 7fa6b8c9d800 20 add_watcher() i=3 2024-03-09T14:35:16.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.030+0000 7fa6b8c9d800 20 add_watcher() i=4 2024-03-09T14:35:16.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.030+0000 7fa6b8c9d800 20 add_watcher() i=5 2024-03-09T14:35:16.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.030+0000 7fa6b8c9d800 20 add_watcher() i=6 2024-03-09T14:35:16.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.031+0000 7fa6b8c9d800 20 add_watcher() i=7 2024-03-09T14:35:16.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.031+0000 7fa6b8c9d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:35:16.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.033+0000 7fa56cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:35:16.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.033+0000 7fa6b8c9d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:35:16.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.033+0000 7fa6b8c9d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:35:16.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.033+0000 7fa6b8c9d800 5 note: GC not initialized 2024-03-09T14:35:16.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.033+0000 7fa4e77fe640 20 reqs_thread_entry: start 2024-03-09T14:35:16.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.033+0000 7fa6b8c9d800 20 init_complete bucket index max shards: 11 2024-03-09T14:35:16.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.034+0000 7fa6b8c9d800 20 Filter name: none 2024-03-09T14:35:16.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.034+0000 7fa4e57fa640 20 reqs_thread_entry: start 2024-03-09T14:35:16.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.034+0000 7fa6b8c9d800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-03-09T14:35:16.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.034+0000 7fa6b8c9d800 20 rados->read ofs=0 len=0 2024-03-09T14:35:16.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.034+0000 7fa6b8c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:16.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.034+0000 7fa6b8c9d800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-03-09T14:35:16.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.034+0000 7fa6b8c9d800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-03-09T14:35:16.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.034+0000 7fa6b8c9d800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-03-09T14:35:16.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.034+0000 7fa6b8c9d800 20 rados->read ofs=0 len=0 2024-03-09T14:35:16.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.034+0000 7fa6b8c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:16.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.034+0000 7fa6b8c9d800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-03-09T14:35:16.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.034+0000 7fa6b8c9d800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-03-09T14:35:16.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.034+0000 7fa6b8c9d800 10 cache get: name=default.rgw.meta+users.keys+HB5E9n8kiqT4K11qtf2qkkqiGN0= : miss 2024-03-09T14:35:16.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.034+0000 7fa6b8c9d800 20 rados->read ofs=0 len=0 2024-03-09T14:35:16.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.035+0000 7fa6b8c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:16.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.035+0000 7fa6b8c9d800 10 cache put: name=default.rgw.meta+users.keys+HB5E9n8kiqT4K11qtf2qkkqiGN0= info.flags=0x0 2024-03-09T14:35:16.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.035+0000 7fa6b8c9d800 10 adding default.rgw.meta+users.keys+HB5E9n8kiqT4K11qtf2qkkqiGN0= to cache LRU end 2024-03-09T14:35:16.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.035+0000 7fa6b8c9d800 10 cache get: name=default.rgw.meta+users.keys+HB5E9n8kiqT4K11qtf2qkkqiGN0= : hit (negative entry) 2024-03-09T14:35:16.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.035+0000 7fa6b8c9d800 10 cache get: name=default.rgw.meta+users.keys+HB5E9n8kiqT4K11qtf2qkkqiGN0= : hit (negative entry) 2024-03-09T14:35:16.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.036+0000 7fa6b8c9d800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-03-09T14:35:16.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.036+0000 7fa6b8c9d800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-03-09T14:35:16.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.036+0000 7fa6b8c9d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-03-09T14:35:16.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.037+0000 7fa599ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824001 cookie 94766041832256 notifier 5517 bl.length()=697 2024-03-09T14:35:16.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.037+0000 7fa599ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-03-09T14:35:16.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.037+0000 7fa599ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-03-09T14:35:16.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.040+0000 7fa6b8c9d800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-03-09T14:35:16.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.040+0000 7fa6b8c9d800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-03-09T14:35:16.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.040+0000 7fa6b8c9d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-03-09T14:35:16.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.040+0000 7fa599ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824000 cookie 94766041823424 notifier 5517 bl.length()=194 2024-03-09T14:35:16.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.040+0000 7fa599ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-03-09T14:35:16.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.040+0000 7fa599ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-03-09T14:35:16.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.044+0000 7fa6b8c9d800 10 cache put: name=default.rgw.meta+users.keys+HB5E9n8kiqT4K11qtf2qkkqiGN0= info.flags=0x7 2024-03-09T14:35:16.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.044+0000 7fa6b8c9d800 10 moving default.rgw.meta+users.keys+HB5E9n8kiqT4K11qtf2qkkqiGN0= to cache LRU end 2024-03-09T14:35:16.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.044+0000 7fa6b8c9d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:HB5E9n8kiqT4K11qtf2qkkqiGN0=, ofs0, ns] 2024-03-09T14:35:16.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.044+0000 7fa599ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824002 cookie 94766041832256 notifier 5517 bl.length()=203 2024-03-09T14:35:16.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.044+0000 7fa599ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+HB5E9n8kiqT4K11qtf2qkkqiGN0= info.flags=0x7 2024-03-09T14:35:16.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.044+0000 7fa599ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+HB5E9n8kiqT4K11qtf2qkkqiGN0= to cache LRU end 2024-03-09T14:35:16.046 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:16.046 INFO:tasks.workunit.client.0.smithi088.stdout: "user_id": "ceph-test-librgw-file", 2024-03-09T14:35:16.046 INFO:tasks.workunit.client.0.smithi088.stdout: "display_name": "librgw test user", 2024-03-09T14:35:16.046 INFO:tasks.workunit.client.0.smithi088.stdout: "email": "librgw@example.com", 2024-03-09T14:35:16.047 INFO:tasks.workunit.client.0.smithi088.stdout: "suspended": 0, 2024-03-09T14:35:16.047 INFO:tasks.workunit.client.0.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:35:16.047 INFO:tasks.workunit.client.0.smithi088.stdout: "subusers": [], 2024-03-09T14:35:16.047 INFO:tasks.workunit.client.0.smithi088.stdout: "keys": [ 2024-03-09T14:35:16.047 INFO:tasks.workunit.client.0.smithi088.stdout: { 2024-03-09T14:35:16.047 INFO:tasks.workunit.client.0.smithi088.stdout: "user": "ceph-test-librgw-file", 2024-03-09T14:35:16.047 INFO:tasks.workunit.client.0.smithi088.stdout: "access_key": "HB5E9n8kiqT4K11qtf2qkkqiGN0=", 2024-03-09T14:35:16.047 INFO:tasks.workunit.client.0.smithi088.stdout: "secret_key": "wSSb+UaHSTY7WLQvIkgUo0XuGthRlPVeBtisI0jb3gMY/i6AdVGfUA==", 2024-03-09T14:35:16.047 INFO:tasks.workunit.client.0.smithi088.stdout: "active": true, 2024-03-09T14:35:16.047 INFO:tasks.workunit.client.0.smithi088.stdout: "create_date": "2024-03-09T14:35:16.036600Z" 2024-03-09T14:35:16.047 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:16.047 INFO:tasks.workunit.client.0.smithi088.stdout: ], 2024-03-09T14:35:16.047 INFO:tasks.workunit.client.0.smithi088.stdout: "swift_keys": [], 2024-03-09T14:35:16.047 INFO:tasks.workunit.client.0.smithi088.stdout: "caps": [], 2024-03-09T14:35:16.048 INFO:tasks.workunit.client.0.smithi088.stdout: "op_mask": "read, write, delete", 2024-03-09T14:35:16.048 INFO:tasks.workunit.client.0.smithi088.stdout: "default_placement": "", 2024-03-09T14:35:16.048 INFO:tasks.workunit.client.0.smithi088.stdout: "default_storage_class": "", 2024-03-09T14:35:16.048 INFO:tasks.workunit.client.0.smithi088.stdout: "placement_tags": [], 2024-03-09T14:35:16.048 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_quota": { 2024-03-09T14:35:16.048 INFO:tasks.workunit.client.0.smithi088.stdout: "enabled": false, 2024-03-09T14:35:16.048 INFO:tasks.workunit.client.0.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:35:16.048 INFO:tasks.workunit.client.0.smithi088.stdout: "max_size": -1, 2024-03-09T14:35:16.048 INFO:tasks.workunit.client.0.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:35:16.048 INFO:tasks.workunit.client.0.smithi088.stdout: "max_objects": -1 2024-03-09T14:35:16.048 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:16.048 INFO:tasks.workunit.client.0.smithi088.stdout: "user_quota": { 2024-03-09T14:35:16.048 INFO:tasks.workunit.client.0.smithi088.stdout: "enabled": false, 2024-03-09T14:35:16.049 INFO:tasks.workunit.client.0.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:35:16.049 INFO:tasks.workunit.client.0.smithi088.stdout: "max_size": -1, 2024-03-09T14:35:16.049 INFO:tasks.workunit.client.0.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:35:16.049 INFO:tasks.workunit.client.0.smithi088.stdout: "max_objects": -1 2024-03-09T14:35:16.049 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:16.049 INFO:tasks.workunit.client.0.smithi088.stdout: "temp_url_keys": [], 2024-03-09T14:35:16.049 INFO:tasks.workunit.client.0.smithi088.stdout: "type": "rgw", 2024-03-09T14:35:16.049 INFO:tasks.workunit.client.0.smithi088.stdout: "mfa_ids": [], 2024-03-09T14:35:16.049 INFO:tasks.workunit.client.0.smithi088.stdout: "account_id": "", 2024-03-09T14:35:16.049 INFO:tasks.workunit.client.0.smithi088.stdout: "path": "/", 2024-03-09T14:35:16.049 INFO:tasks.workunit.client.0.smithi088.stdout: "create_date": "2024-03-09T14:35:16.036584Z", 2024-03-09T14:35:16.049 INFO:tasks.workunit.client.0.smithi088.stdout: "tags": [], 2024-03-09T14:35:16.049 INFO:tasks.workunit.client.0.smithi088.stdout: "group_ids": [] 2024-03-09T14:35:16.050 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:16.050 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:16.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.046+0000 7fa56cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:35:16.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.049+0000 7fa6b8c9d800 20 remove_watcher() i=0 2024-03-09T14:35:16.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.049+0000 7fa6b8c9d800 2 removed watcher, disabling cache 2024-03-09T14:35:16.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.050+0000 7fa6b8c9d800 20 remove_watcher() i=1 2024-03-09T14:35:16.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.051+0000 7fa6b8c9d800 20 remove_watcher() i=2 2024-03-09T14:35:16.053 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.052+0000 7fa6b8c9d800 20 remove_watcher() i=3 2024-03-09T14:35:16.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.053+0000 7fa6b8c9d800 20 remove_watcher() i=4 2024-03-09T14:35:16.055 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.054+0000 7fa6b8c9d800 20 remove_watcher() i=5 2024-03-09T14:35:16.056 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.055+0000 7fa6b8c9d800 20 remove_watcher() i=6 2024-03-09T14:35:16.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:16.056+0000 7fa6b8c9d800 20 remove_watcher() i=7 2024-03-09T14:35:16.067 INFO:tasks.workunit.client.0.smithi088.stdout:phase 1.1 2024-03-09T14:35:16.087 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-09T14:35:16.087 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:35:16.087 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 24 tests from LibRGW 2024-03-09T14:35:16.087 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:35:16.098 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:16.098 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:16.682 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.INIT (595 ms) 2024-03-09T14:35:16.683 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-03-09T14:35:16.683 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-03-09T14:35:16.683 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:35:16.684 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-09T14:35:16.684 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-03-09T14:35:16.695 INFO:tasks.workunit.client.0.smithi088.stdout:creating: nfsroot:foo/bar/baz/quux 2024-03-09T14:35:16.698 INFO:tasks.workunit.client.0.smithi088.stdout:creating: nfsroot:foo/f1 2024-03-09T14:35:16.702 INFO:tasks.workunit.client.0.smithi088.stdout:creating: nfsroot:foo/f2 2024-03-09T14:35:16.704 INFO:tasks.workunit.client.0.smithi088.stdout:creating: nfsroot:foo/bar/f1 2024-03-09T14:35:16.708 INFO:tasks.workunit.client.0.smithi088.stdout:creating: nfsroot:foo/bar/d1/ 2024-03-09T14:35:16.711 INFO:tasks.workunit.client.0.smithi088.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-03-09T14:35:16.714 INFO:tasks.workunit.client.0.smithi088.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-03-09T14:35:16.717 INFO:tasks.workunit.client.0.smithi088.stdout:creating: nfsroot:foo/bar/baz/momma 2024-03-09T14:35:16.719 INFO:tasks.workunit.client.0.smithi088.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-03-09T14:35:16.722 INFO:tasks.workunit.client.0.smithi088.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-03-09T14:35:16.725 INFO:tasks.workunit.client.0.smithi088.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-03-09T14:35:16.728 INFO:tasks.workunit.client.0.smithi088.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-03-09T14:35:16.731 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SETUP_HIER1 (48 ms) 2024-03-09T14:35:16.731 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-03-09T14:35:16.831 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SETUP_DIRS1 (100 ms) 2024-03-09T14:35:16.832 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SETATTR 2024-03-09T14:35:16.832 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-03-09T14:35:16.832 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-03-09T14:35:16.849 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (17 ms) 2024-03-09T14:35:16.849 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-03-09T14:35:16.893 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (44 ms) 2024-03-09T14:35:16.893 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-03-09T14:35:16.893 INFO:tasks.workunit.client.0.smithi088.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-03-09T14:35:16.899 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (6 ms) 2024-03-09T14:35:16.899 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-03-09T14:35:16.899 INFO:tasks.workunit.client.0.smithi088.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-03-09T14:35:16.906 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (8 ms) 2024-03-09T14:35:16.907 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-03-09T14:35:16.907 INFO:tasks.workunit.client.0.smithi088.stdout:scanning objects in /bdirs1/dir_0 2024-03-09T14:35:16.907 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:35:16.907 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:35:16.907 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:35:16.907 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:35:16.907 INFO:tasks.workunit.client.0.smithi088.stdout:scanning objects in /bdirs1/dir_1 2024-03-09T14:35:16.907 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:35:16.907 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:35:16.907 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:35:16.907 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:35:16.907 INFO:tasks.workunit.client.0.smithi088.stdout:scanning objects in /bdirs1/dir_2 2024-03-09T14:35:16.907 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:35:16.908 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:35:16.908 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:35:16.908 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:35:16.908 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-03-09T14:35:16.908 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-03-09T14:35:16.908 INFO:tasks.workunit.client.0.smithi088.stdout:read back objects in /bdirs1/dir_0 2024-03-09T14:35:16.908 INFO:tasks.workunit.client.0.smithi088.stdout:reading 0,256 dir_0/sfile_0 2024-03-09T14:35:16.908 INFO:tasks.workunit.client.0.smithi088.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:35:16.909 INFO:tasks.workunit.client.0.smithi088.stdout:reading 0,256 dir_0/sfile_1 2024-03-09T14:35:16.910 INFO:tasks.workunit.client.0.smithi088.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:35:16.910 INFO:tasks.workunit.client.0.smithi088.stdout:read back objects in /bdirs1/dir_1 2024-03-09T14:35:16.910 INFO:tasks.workunit.client.0.smithi088.stdout:reading 0,256 dir_1/sfile_0 2024-03-09T14:35:16.911 INFO:tasks.workunit.client.0.smithi088.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:35:16.911 INFO:tasks.workunit.client.0.smithi088.stdout:reading 0,256 dir_1/sfile_1 2024-03-09T14:35:16.913 INFO:tasks.workunit.client.0.smithi088.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:35:16.913 INFO:tasks.workunit.client.0.smithi088.stdout:read back objects in /bdirs1/dir_2 2024-03-09T14:35:16.913 INFO:tasks.workunit.client.0.smithi088.stdout:reading 0,256 dir_2/sfile_0 2024-03-09T14:35:16.914 INFO:tasks.workunit.client.0.smithi088.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:35:16.914 INFO:tasks.workunit.client.0.smithi088.stdout:reading 0,256 dir_2/sfile_1 2024-03-09T14:35:16.915 INFO:tasks.workunit.client.0.smithi088.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:35:16.915 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-03-09T14:35:16.915 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-03-09T14:35:17.087 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.READF_SETUP1 (172 ms) 2024-03-09T14:35:17.088 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-03-09T14:35:17.088 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-03-09T14:35:17.088 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-03-09T14:35:17.088 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-03-09T14:35:17.088 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-03-09T14:35:17.088 INFO:tasks.workunit.client.0.smithi088.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:35:17.088 INFO:tasks.workunit.client.0.smithi088.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:35:17.088 INFO:tasks.workunit.client.0.smithi088.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:35:17.088 INFO:tasks.workunit.client.0.smithi088.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:35:17.088 INFO:tasks.workunit.client.0.smithi088.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:35:17.088 INFO:tasks.workunit.client.0.smithi088.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:35:17.088 INFO:tasks.workunit.client.0.smithi088.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:35:17.088 INFO:tasks.workunit.client.0.smithi088.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:35:17.089 INFO:tasks.workunit.client.0.smithi088.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:35:17.089 INFO:tasks.workunit.client.0.smithi088.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:35:17.089 INFO:tasks.workunit.client.0.smithi088.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:35:17.089 INFO:tasks.workunit.client.0.smithi088.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:35:17.089 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-03-09T14:35:17.089 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.HIER1 2024-03-09T14:35:17.096 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/f2 (f2): FILE 2024-03-09T14:35:17.096 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/f1 (f1): FILE 2024-03-09T14:35:17.099 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-03-09T14:35:17.101 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-03-09T14:35:17.103 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-09T14:35:17.104 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-09T14:35:17.104 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-03-09T14:35:17.105 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-03-09T14:35:17.105 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-09T14:35:17.105 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-09T14:35:17.106 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-03-09T14:35:17.108 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-03-09T14:35:17.108 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-03-09T14:35:17.108 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar (bar): DIR 2024-03-09T14:35:17.108 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo (foo): DIR 2024-03-09T14:35:17.108 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot (nfsroot): DIR 2024-03-09T14:35:17.109 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-03-09T14:35:17.109 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-09T14:35:17.109 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-03-09T14:35:17.109 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-09T14:35:17.109 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-09T14:35:17.109 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-09T14:35:17.109 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-09T14:35:17.109 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-09T14:35:17.109 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-09T14:35:17.109 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:35:17.109 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:35:17.109 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:35:17.109 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:35:17.109 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:35:17.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:17.107+0000 7fc194b228c0 -1 shutting down 2024-03-09T14:35:17.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:17.109+0000 7fc06e93a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64030, si_uid : 1000, si_addr0x3e80000fa1e, si_status0 2024-03-09T14:35:17.236 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SHUTDOWN (128 ms) 2024-03-09T14:35:17.236 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 24 tests from LibRGW (1149 ms total) 2024-03-09T14:35:17.236 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:17.236 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:35:17.236 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 24 tests from 1 test suite ran. (1149 ms total) 2024-03-09T14:35:17.236 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 24 tests. 2024-03-09T14:35:17.242 INFO:tasks.workunit.client.0.smithi088.stdout:phase 1.2 2024-03-09T14:35:17.262 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-09T14:35:17.262 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:35:17.262 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 24 tests from LibRGW 2024-03-09T14:35:17.262 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:35:17.270 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:17.270 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:17.643 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.INIT (382 ms) 2024-03-09T14:35:17.643 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-03-09T14:35:17.645 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-03-09T14:35:17.645 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:35:17.645 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-09T14:35:17.645 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-03-09T14:35:17.645 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-03-09T14:35:17.645 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-03-09T14:35:17.645 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-03-09T14:35:17.645 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SETATTR 2024-03-09T14:35:17.646 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-03-09T14:35:17.646 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-03-09T14:35:17.646 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-03-09T14:35:17.646 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-03-09T14:35:17.646 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-03-09T14:35:17.646 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-03-09T14:35:17.646 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-03-09T14:35:17.646 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-03-09T14:35:17.646 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-03-09T14:35:17.646 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-03-09T14:35:17.646 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-03-09T14:35:17.646 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-03-09T14:35:17.647 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-03-09T14:35:17.647 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-03-09T14:35:17.647 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-03-09T14:35:17.647 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-03-09T14:35:17.647 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-03-09T14:35:17.647 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-03-09T14:35:17.647 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-03-09T14:35:17.647 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-03-09T14:35:17.647 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-03-09T14:35:17.647 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.HIER1 2024-03-09T14:35:17.647 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-03-09T14:35:17.647 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-09T14:35:17.647 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-03-09T14:35:17.647 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-09T14:35:17.648 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-09T14:35:17.648 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-09T14:35:17.648 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-09T14:35:17.648 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-09T14:35:17.648 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-09T14:35:17.648 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:35:17.648 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:35:17.649 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:35:17.649 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:35:17.649 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:35:17.649 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:17.643+0000 7fa53dd3d8c0 -1 shutting down 2024-03-09T14:35:17.649 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:17.645+0000 7fa417bf0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64647, si_uid : 1000, si_addr0x3e80000fc87, si_status0 2024-03-09T14:35:17.720 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SHUTDOWN (75 ms) 2024-03-09T14:35:17.720 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 24 tests from LibRGW (458 ms total) 2024-03-09T14:35:17.720 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:17.720 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:35:17.721 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 24 tests from 1 test suite ran. (458 ms total) 2024-03-09T14:35:17.721 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 24 tests. 2024-03-09T14:35:17.725 INFO:tasks.workunit.client.0.smithi088.stdout:phase 1.3 2024-03-09T14:35:17.744 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-09T14:35:17.744 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:35:17.745 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 24 tests from LibRGW 2024-03-09T14:35:17.745 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:35:17.754 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:17.754 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:18.323 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.INIT (579 ms) 2024-03-09T14:35:18.323 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-03-09T14:35:18.324 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-03-09T14:35:18.324 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:35:18.324 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-09T14:35:18.324 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-03-09T14:35:18.330 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-03-09T14:35:18.330 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-03-09T14:35:18.391 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SETUP_DIRS1 (61 ms) 2024-03-09T14:35:18.392 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SETATTR 2024-03-09T14:35:18.392 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-03-09T14:35:18.392 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-03-09T14:35:18.392 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-03-09T14:35:18.392 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-03-09T14:35:18.392 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-03-09T14:35:18.392 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-03-09T14:35:18.392 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-03-09T14:35:18.392 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-03-09T14:35:18.392 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-03-09T14:35:18.392 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-03-09T14:35:18.392 INFO:tasks.workunit.client.0.smithi088.stdout:scanning objects in /bdirs1/dir_0 2024-03-09T14:35:18.393 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:35:18.393 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:35:18.393 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:35:18.393 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:35:18.393 INFO:tasks.workunit.client.0.smithi088.stdout:scanning objects in /bdirs1/dir_1 2024-03-09T14:35:18.393 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:35:18.393 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:35:18.393 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:35:18.393 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:35:18.393 INFO:tasks.workunit.client.0.smithi088.stdout:scanning objects in /bdirs1/dir_2 2024-03-09T14:35:18.393 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:35:18.393 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:35:18.393 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:35:18.393 INFO:tasks.workunit.client.0.smithi088.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:35:18.394 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-03-09T14:35:18.394 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-03-09T14:35:18.394 INFO:tasks.workunit.client.0.smithi088.stdout:read back objects in /bdirs1/dir_0 2024-03-09T14:35:18.394 INFO:tasks.workunit.client.0.smithi088.stdout:reading 0,256 dir_0/sfile_0 2024-03-09T14:35:18.394 INFO:tasks.workunit.client.0.smithi088.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:35:18.394 INFO:tasks.workunit.client.0.smithi088.stdout:reading 0,256 dir_0/sfile_1 2024-03-09T14:35:18.394 INFO:tasks.workunit.client.0.smithi088.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:35:18.395 INFO:tasks.workunit.client.0.smithi088.stdout:read back objects in /bdirs1/dir_1 2024-03-09T14:35:18.395 INFO:tasks.workunit.client.0.smithi088.stdout:reading 0,256 dir_1/sfile_0 2024-03-09T14:35:18.396 INFO:tasks.workunit.client.0.smithi088.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:35:18.396 INFO:tasks.workunit.client.0.smithi088.stdout:reading 0,256 dir_1/sfile_1 2024-03-09T14:35:18.397 INFO:tasks.workunit.client.0.smithi088.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:35:18.397 INFO:tasks.workunit.client.0.smithi088.stdout:read back objects in /bdirs1/dir_2 2024-03-09T14:35:18.397 INFO:tasks.workunit.client.0.smithi088.stdout:reading 0,256 dir_2/sfile_0 2024-03-09T14:35:18.398 INFO:tasks.workunit.client.0.smithi088.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:35:18.398 INFO:tasks.workunit.client.0.smithi088.stdout:reading 0,256 dir_2/sfile_1 2024-03-09T14:35:18.400 INFO:tasks.workunit.client.0.smithi088.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:35:18.400 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.READ_DIRS1 (8 ms) 2024-03-09T14:35:18.400 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-03-09T14:35:18.400 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-03-09T14:35:18.400 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-03-09T14:35:18.400 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-03-09T14:35:18.401 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-03-09T14:35:18.401 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-03-09T14:35:18.401 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-03-09T14:35:18.401 INFO:tasks.workunit.client.0.smithi088.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:35:18.401 INFO:tasks.workunit.client.0.smithi088.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:35:18.401 INFO:tasks.workunit.client.0.smithi088.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:35:18.401 INFO:tasks.workunit.client.0.smithi088.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:35:18.401 INFO:tasks.workunit.client.0.smithi088.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:35:18.401 INFO:tasks.workunit.client.0.smithi088.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:35:18.401 INFO:tasks.workunit.client.0.smithi088.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:35:18.401 INFO:tasks.workunit.client.0.smithi088.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:35:18.401 INFO:tasks.workunit.client.0.smithi088.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:35:18.401 INFO:tasks.workunit.client.0.smithi088.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:35:18.402 INFO:tasks.workunit.client.0.smithi088.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:35:18.402 INFO:tasks.workunit.client.0.smithi088.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:35:18.402 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-03-09T14:35:18.402 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.HIER1 2024-03-09T14:35:18.409 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/f2 (f2): FILE 2024-03-09T14:35:18.409 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/f1 (f1): FILE 2024-03-09T14:35:18.412 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-03-09T14:35:18.414 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-03-09T14:35:18.417 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-09T14:35:18.417 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-09T14:35:18.418 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-03-09T14:35:18.418 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-03-09T14:35:18.418 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-09T14:35:18.419 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-09T14:35:18.420 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-03-09T14:35:18.422 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-03-09T14:35:18.423 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-03-09T14:35:18.423 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo/bar (bar): DIR 2024-03-09T14:35:18.423 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot/foo (foo): DIR 2024-03-09T14:35:18.423 INFO:tasks.workunit.client.0.smithi088.stdout:/nfsroot (nfsroot): DIR 2024-03-09T14:35:18.423 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.HIER1 (23 ms) 2024-03-09T14:35:18.423 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-09T14:35:18.423 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-03-09T14:35:18.423 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-09T14:35:18.423 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-09T14:35:18.423 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-09T14:35:18.423 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-09T14:35:18.423 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-09T14:35:18.424 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-09T14:35:18.424 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:35:18.424 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:35:18.424 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:35:18.424 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:35:18.424 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:35:18.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:18.421+0000 7f28ce4128c0 -1 shutting down 2024-03-09T14:35:18.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:18.422+0000 7f27a5fea640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65264, si_uid : 1000, si_addr0x3e80000fef0, si_status0 2024-03-09T14:35:18.488 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SHUTDOWN (65 ms) 2024-03-09T14:35:18.488 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 24 tests from LibRGW (743 ms total) 2024-03-09T14:35:18.488 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:18.488 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:35:18.488 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 24 tests from 1 test suite ran. (743 ms total) 2024-03-09T14:35:18.488 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 24 tests. 2024-03-09T14:35:18.493 INFO:tasks.workunit.client.0.smithi088.stdout:phase 2.1 2024-03-09T14:35:18.514 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 9 tests from 1 test suite. 2024-03-09T14:35:18.514 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:35:18.515 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 9 tests from LibRGW 2024-03-09T14:35:18.515 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:35:18.523 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:18.524 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:18.897 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.INIT (383 ms) 2024-03-09T14:35:18.898 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:35:18.898 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:35:18.898 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:35:18.908 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-03-09T14:35:18.908 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:35:18.908 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-03-09T14:35:18.908 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-03-09T14:35:18.919 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave0 2024-03-09T14:35:18.929 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave1 2024-03-09T14:35:18.940 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave2 2024-03-09T14:35:18.954 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave3 2024-03-09T14:35:18.969 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave4 2024-03-09T14:35:18.979 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave5 2024-03-09T14:35:18.989 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave6 2024-03-09T14:35:18.998 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave7 2024-03-09T14:35:19.010 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave8 2024-03-09T14:35:19.021 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave9 2024-03-09T14:35:19.022 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (113 ms) 2024-03-09T14:35:19.022 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-03-09T14:35:19.313 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (292 ms) 2024-03-09T14:35:19.313 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:35:19.313 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:35:19.314 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:35:19.314 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:35:19.314 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:35:19.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:19.313+0000 7fb3453308c0 -1 shutting down 2024-03-09T14:35:19.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:19.314+0000 7fb21f269640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65881, si_uid : 1000, si_addr0x3e800010159, si_status0 2024-03-09T14:35:19.364 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SHUTDOWN (51 ms) 2024-03-09T14:35:19.364 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 9 tests from LibRGW (850 ms total) 2024-03-09T14:35:19.364 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:19.364 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:35:19.365 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 9 tests from 1 test suite ran. (850 ms total) 2024-03-09T14:35:19.365 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 9 tests. 2024-03-09T14:35:19.369 INFO:tasks.workunit.client.0.smithi088.stdout:phase 2.2 2024-03-09T14:35:19.390 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 9 tests from 1 test suite. 2024-03-09T14:35:19.390 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:35:19.390 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 9 tests from LibRGW 2024-03-09T14:35:19.390 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:35:19.399 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:19.399 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:19.977 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.INIT (587 ms) 2024-03-09T14:35:19.978 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:35:19.978 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:35:19.978 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:35:19.978 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-03-09T14:35:19.978 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:35:20.009 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.DELETE_BUCKET (30 ms) 2024-03-09T14:35:20.009 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-03-09T14:35:20.019 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave0 2024-03-09T14:35:20.029 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave1 2024-03-09T14:35:20.043 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave2 2024-03-09T14:35:20.055 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave3 2024-03-09T14:35:20.067 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave4 2024-03-09T14:35:20.077 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave5 2024-03-09T14:35:20.089 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave6 2024-03-09T14:35:20.101 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave7 2024-03-09T14:35:20.111 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave8 2024-03-09T14:35:20.120 INFO:tasks.workunit.client.0.smithi088.stdout:created: sorrydave9 2024-03-09T14:35:20.120 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (112 ms) 2024-03-09T14:35:20.120 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-03-09T14:35:20.411 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (291 ms) 2024-03-09T14:35:20.412 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:35:20.412 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:35:20.412 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:35:20.412 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:35:20.412 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:35:20.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:20.411+0000 7fda391328c0 -1 shutting down 2024-03-09T14:35:20.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:20.412+0000 7fd912fd8640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66498, si_uid : 1000, si_addr0x3e8000103c2, si_status0 2024-03-09T14:35:20.534 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SHUTDOWN (123 ms) 2024-03-09T14:35:20.535 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 9 tests from LibRGW (1144 ms total) 2024-03-09T14:35:20.535 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:20.535 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:35:20.535 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 9 tests from 1 test suite ran. (1144 ms total) 2024-03-09T14:35:20.535 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 9 tests. 2024-03-09T14:35:20.540 INFO:tasks.workunit.client.0.smithi088.stdout:phase 3.1 2024-03-09T14:35:20.855 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 13 tests from 1 test suite. 2024-03-09T14:35:20.855 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:35:20.855 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 13 tests from LibRGW 2024-03-09T14:35:20.856 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:35:20.864 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:20.864 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:21.446 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.INIT (591 ms) 2024-03-09T14:35:21.446 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:35:21.447 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:35:21.447 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:35:21.458 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-03-09T14:35:21.458 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-09T14:35:21.462 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-03-09T14:35:21.462 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-09T14:35:21.464 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-03-09T14:35:21.464 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.LARGE1 2024-03-09T14:35:21.530 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.LARGE1 (66 ms) 2024-03-09T14:35:21.530 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.LARGE2 2024-03-09T14:35:21.580 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.LARGE2 (50 ms) 2024-03-09T14:35:21.581 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-09T14:35:21.581 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-09T14:35:21.581 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-09T14:35:21.581 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-03-09T14:35:21.581 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:35:21.581 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-03-09T14:35:21.581 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:35:21.581 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:35:21.581 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:35:21.581 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:35:21.581 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:35:21.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:21.580+0000 7fb8f17618c0 -1 shutting down 2024-03-09T14:35:21.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:21.581+0000 7fb7cb700640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67115, si_uid : 1000, si_addr0x3e80001062b, si_status0 2024-03-09T14:35:21.702 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SHUTDOWN (121 ms) 2024-03-09T14:35:21.702 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 13 tests from LibRGW (846 ms total) 2024-03-09T14:35:21.702 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:21.703 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:35:21.703 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 13 tests from 1 test suite ran. (846 ms total) 2024-03-09T14:35:21.703 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 13 tests. 2024-03-09T14:35:21.709 INFO:tasks.workunit.client.0.smithi088.stdout:phase 3.2 2024-03-09T14:35:22.018 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 13 tests from 1 test suite. 2024-03-09T14:35:22.018 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:35:22.018 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 13 tests from LibRGW 2024-03-09T14:35:22.018 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:35:22.026 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:22.026 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:22.605 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.INIT (586 ms) 2024-03-09T14:35:22.605 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:35:22.605 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:35:22.606 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:35:22.606 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-03-09T14:35:22.606 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-09T14:35:22.611 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-03-09T14:35:22.612 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-09T14:35:22.615 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-03-09T14:35:22.615 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.LARGE1 2024-03-09T14:35:22.687 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.LARGE1 (72 ms) 2024-03-09T14:35:22.687 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.LARGE2 2024-03-09T14:35:22.687 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-03-09T14:35:22.687 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-09T14:35:22.687 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-09T14:35:22.688 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-09T14:35:22.693 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-03-09T14:35:22.693 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:35:22.724 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.DELETE_BUCKET (32 ms) 2024-03-09T14:35:22.725 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:35:22.725 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:35:22.725 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:35:22.725 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:35:22.725 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:35:22.725 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:22.724+0000 7fe87bd298c0 -1 shutting down 2024-03-09T14:35:22.726 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:22.725+0000 7fe755c3f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67732, si_uid : 1000, si_addr0x3e800010894, si_status0 2024-03-09T14:35:22.770 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SHUTDOWN (45 ms) 2024-03-09T14:35:22.770 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 13 tests from LibRGW (751 ms total) 2024-03-09T14:35:22.770 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:22.770 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:35:22.770 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 13 tests from 1 test suite ran. (751 ms total) 2024-03-09T14:35:22.770 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 13 tests. 2024-03-09T14:35:22.776 INFO:tasks.workunit.client.0.smithi088.stdout:phase 4.1 2024-03-09T14:35:22.797 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 11 tests from 1 test suite. 2024-03-09T14:35:22.797 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:35:22.797 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 11 tests from LibRGW 2024-03-09T14:35:22.797 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.TVAR 2024-03-09T14:35:22.797 INFO:tasks.workunit.client.0.smithi088.stdout:read i1: 64001 2024-03-09T14:35:22.797 INFO:tasks.workunit.client.0.smithi088.stdout:read s1: blunderbuss 2024-03-09T14:35:22.797 INFO:tasks.workunit.client.0.smithi088.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-03-09T14:35:22.797 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:35:22.807 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:22.807 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:23.390 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.INIT (593 ms) 2024-03-09T14:35:23.390 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:35:23.390 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:35:23.390 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-09T14:35:23.407 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (17 ms) 2024-03-09T14:35:23.408 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-09T14:35:23.855 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_0 2024-03-09T14:35:23.856 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_1 2024-03-09T14:35:23.856 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_2 2024-03-09T14:35:23.856 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_3 2024-03-09T14:35:23.856 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_4 2024-03-09T14:35:23.856 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_5 2024-03-09T14:35:23.856 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_6 2024-03-09T14:35:23.856 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_7 2024-03-09T14:35:23.856 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_8 2024-03-09T14:35:23.856 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_9 2024-03-09T14:35:23.856 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_10 2024-03-09T14:35:23.856 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_11 2024-03-09T14:35:23.856 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_12 2024-03-09T14:35:23.856 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_13 2024-03-09T14:35:23.857 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_14 2024-03-09T14:35:23.857 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_15 2024-03-09T14:35:23.857 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_16 2024-03-09T14:35:23.857 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_17 2024-03-09T14:35:23.857 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_18 2024-03-09T14:35:23.857 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_19 2024-03-09T14:35:23.857 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_20 2024-03-09T14:35:23.857 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_21 2024-03-09T14:35:23.857 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_22 2024-03-09T14:35:23.857 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_23 2024-03-09T14:35:23.857 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_24 2024-03-09T14:35:23.857 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_25 2024-03-09T14:35:23.857 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_26 2024-03-09T14:35:23.857 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_27 2024-03-09T14:35:23.857 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_28 2024-03-09T14:35:23.858 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_29 2024-03-09T14:35:23.858 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_30 2024-03-09T14:35:23.858 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_31 2024-03-09T14:35:23.858 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_32 2024-03-09T14:35:23.858 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_33 2024-03-09T14:35:23.858 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_34 2024-03-09T14:35:23.858 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_35 2024-03-09T14:35:23.858 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_36 2024-03-09T14:35:23.858 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_37 2024-03-09T14:35:23.858 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_38 2024-03-09T14:35:23.858 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_39 2024-03-09T14:35:23.858 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_40 2024-03-09T14:35:23.858 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_41 2024-03-09T14:35:23.858 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_42 2024-03-09T14:35:23.858 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_43 2024-03-09T14:35:23.859 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_44 2024-03-09T14:35:23.859 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_45 2024-03-09T14:35:23.859 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_46 2024-03-09T14:35:23.859 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_47 2024-03-09T14:35:23.859 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_48 2024-03-09T14:35:23.859 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_49 2024-03-09T14:35:23.859 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_50 2024-03-09T14:35:23.859 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_51 2024-03-09T14:35:23.859 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_52 2024-03-09T14:35:23.859 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_53 2024-03-09T14:35:23.859 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_54 2024-03-09T14:35:23.859 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_55 2024-03-09T14:35:23.859 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_56 2024-03-09T14:35:23.859 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_57 2024-03-09T14:35:23.859 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_58 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_59 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_60 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_61 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_62 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_63 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_64 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_65 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_66 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_67 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_68 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_69 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_70 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_71 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_72 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_73 2024-03-09T14:35:23.860 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_74 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_75 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_76 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_77 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_78 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_79 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_80 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_81 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_82 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_83 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_84 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_85 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_86 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_87 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_88 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_89 2024-03-09T14:35:23.861 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_90 2024-03-09T14:35:23.862 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_91 2024-03-09T14:35:23.862 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_92 2024-03-09T14:35:23.862 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_93 2024-03-09T14:35:23.862 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_94 2024-03-09T14:35:23.862 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_95 2024-03-09T14:35:23.862 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_96 2024-03-09T14:35:23.862 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_97 2024-03-09T14:35:23.862 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_98 2024-03-09T14:35:23.862 INFO:tasks.workunit.client.0.smithi088.stdout:created: dmarker:f_99 2024-03-09T14:35:23.862 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (448 ms) 2024-03-09T14:35:23.862 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-09T14:35:23.864 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-03-09T14:35:23.864 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-03-09T14:35:23.864 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-03-09T14:35:23.864 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-03-09T14:35:23.864 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-03-09T14:35:23.864 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-03-09T14:35:23.864 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-03-09T14:35:23.864 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-03-09T14:35:23.864 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-03-09T14:35:23.864 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-03-09T14:35:23.864 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-03-09T14:35:23.864 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-03-09T14:35:23.864 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-03-09T14:35:23.864 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-03-09T14:35:23.865 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-03-09T14:35:23.865 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-03-09T14:35:23.865 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-03-09T14:35:23.865 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-03-09T14:35:23.865 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-03-09T14:35:23.865 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-03-09T14:35:23.865 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-03-09T14:35:23.865 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-03-09T14:35:23.865 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-03-09T14:35:23.865 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-03-09T14:35:23.865 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-03-09T14:35:23.865 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-03-09T14:35:23.865 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-03-09T14:35:23.865 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-03-09T14:35:23.865 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-03-09T14:35:23.866 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-03-09T14:35:23.866 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-03-09T14:35:23.866 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-03-09T14:35:23.866 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-03-09T14:35:23.866 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-03-09T14:35:23.866 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-03-09T14:35:23.866 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-03-09T14:35:23.866 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-03-09T14:35:23.866 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-03-09T14:35:23.866 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-03-09T14:35:23.866 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-03-09T14:35:23.867 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-03-09T14:35:23.867 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-03-09T14:35:23.867 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-03-09T14:35:23.867 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-03-09T14:35:23.867 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-03-09T14:35:23.867 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-03-09T14:35:23.867 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-03-09T14:35:23.867 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-03-09T14:35:23.867 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-03-09T14:35:23.867 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-03-09T14:35:23.867 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-03-09T14:35:23.867 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-03-09T14:35:23.868 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-03-09T14:35:23.868 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-03-09T14:35:23.868 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-03-09T14:35:23.868 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-03-09T14:35:23.868 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-03-09T14:35:23.868 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-03-09T14:35:23.868 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-03-09T14:35:23.868 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-03-09T14:35:23.868 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-03-09T14:35:23.868 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-03-09T14:35:23.868 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-03-09T14:35:23.868 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-03-09T14:35:23.868 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-03-09T14:35:23.868 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-03-09T14:35:23.868 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-03-09T14:35:23.869 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-03-09T14:35:23.870 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-03-09T14:35:23.870 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-03-09T14:35:23.870 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-03-09T14:35:23.870 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-03-09T14:35:23.870 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-03-09T14:35:23.870 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-03-09T14:35:23.870 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-03-09T14:35:23.870 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-03-09T14:35:23.870 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-03-09T14:35:23.870 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-03-09T14:35:23.870 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-03-09T14:35:23.870 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-03-09T14:35:23.870 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-03-09T14:35:23.870 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-03-09T14:35:23.870 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-03-09T14:35:23.871 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-03-09T14:35:23.871 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-03-09T14:35:23.871 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-03-09T14:35:23.871 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-03-09T14:35:23.871 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_READDIR (3 ms) 2024-03-09T14:35:23.871 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-03-09T14:35:23.871 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-03-09T14:35:23.871 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-03-09T14:35:23.871 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-03-09T14:35:23.871 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-03-09T14:35:23.871 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-03-09T14:35:23.871 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-03-09T14:35:23.871 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-03-09T14:35:23.871 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-03-09T14:35:23.871 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-03-09T14:35:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-03-09T14:35:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-03-09T14:35:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-03-09T14:35:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-03-09T14:35:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-03-09T14:35:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-03-09T14:35:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-03-09T14:35:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-03-09T14:35:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-03-09T14:35:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-03-09T14:35:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-03-09T14:35:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-03-09T14:35:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-03-09T14:35:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-03-09T14:35:23.872 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-03-09T14:35:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-03-09T14:35:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-03-09T14:35:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-03-09T14:35:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-03-09T14:35:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-03-09T14:35:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-03-09T14:35:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-03-09T14:35:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-03-09T14:35:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-03-09T14:35:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-03-09T14:35:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-03-09T14:35:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-03-09T14:35:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-03-09T14:35:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-03-09T14:35:23.873 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-03-09T14:35:23.874 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-03-09T14:35:23.874 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-03-09T14:35:23.874 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-03-09T14:35:23.874 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-03-09T14:35:23.874 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-03-09T14:35:23.874 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-03-09T14:35:23.874 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-03-09T14:35:23.874 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-03-09T14:35:23.874 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-03-09T14:35:23.874 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-03-09T14:35:23.874 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-03-09T14:35:23.874 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-03-09T14:35:23.874 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-03-09T14:35:23.874 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-03-09T14:35:23.874 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-03-09T14:35:23.875 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-03-09T14:35:23.876 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-03-09T14:35:23.877 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-03-09T14:35:23.877 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-03-09T14:35:23.877 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-03-09T14:35:23.877 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-03-09T14:35:23.877 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-03-09T14:35:23.877 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-03-09T14:35:23.877 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-03-09T14:35:23.877 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-03-09T14:35:23.877 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-03-09T14:35:23.877 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-03-09T14:35:23.877 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-03-09T14:35:23.877 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-03-09T14:35:23.877 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-03-09T14:35:23.877 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-03-09T14:35:23.877 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER2_READDIR (1 ms) 2024-03-09T14:35:23.878 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-09T14:35:23.878 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-09T14:35:23.878 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:35:23.878 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:35:23.878 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:35:23.878 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:35:23.878 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:35:23.878 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:23.859+0000 7f7be774c8c0 -1 shutting down 2024-03-09T14:35:23.878 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:23.860+0000 7f7ac16e7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68349, si_uid : 1000, si_addr0x3e800010afd, si_status0 2024-03-09T14:35:23.946 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SHUTDOWN (87 ms) 2024-03-09T14:35:23.946 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 11 tests from LibRGW (1150 ms total) 2024-03-09T14:35:23.946 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:23.946 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:35:23.946 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 11 tests from 1 test suite ran. (1150 ms total) 2024-03-09T14:35:23.946 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 11 tests. 2024-03-09T14:35:23.952 INFO:tasks.workunit.client.0.smithi088.stdout:phase 4.2 2024-03-09T14:35:23.973 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 11 tests from 1 test suite. 2024-03-09T14:35:23.973 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:35:23.973 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 11 tests from LibRGW 2024-03-09T14:35:23.973 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.TVAR 2024-03-09T14:35:23.973 INFO:tasks.workunit.client.0.smithi088.stdout:read i1: 64001 2024-03-09T14:35:23.973 INFO:tasks.workunit.client.0.smithi088.stdout:read s1: blunderbuss 2024-03-09T14:35:23.973 INFO:tasks.workunit.client.0.smithi088.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-03-09T14:35:23.973 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:35:23.981 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:23.981 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:24.556 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.INIT (584 ms) 2024-03-09T14:35:24.556 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:35:24.557 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:35:24.557 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-09T14:35:24.568 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (10 ms) 2024-03-09T14:35:24.568 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-09T14:35:24.568 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-09T14:35:24.568 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-09T14:35:24.568 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-09T14:35:24.568 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-03-09T14:35:24.571 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-03-09T14:35:24.572 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-03-09T14:35:24.572 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-03-09T14:35:24.572 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-03-09T14:35:24.572 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-03-09T14:35:24.572 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-03-09T14:35:24.572 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-03-09T14:35:24.572 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-03-09T14:35:24.572 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-03-09T14:35:24.572 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-03-09T14:35:24.572 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-03-09T14:35:24.572 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-03-09T14:35:24.572 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-03-09T14:35:24.572 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-03-09T14:35:24.573 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-03-09T14:35:24.573 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-03-09T14:35:24.573 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-03-09T14:35:24.573 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-03-09T14:35:24.573 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-03-09T14:35:24.573 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-03-09T14:35:24.573 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-03-09T14:35:24.573 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-03-09T14:35:24.573 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-03-09T14:35:24.573 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-03-09T14:35:24.573 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-03-09T14:35:24.573 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-03-09T14:35:24.573 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-03-09T14:35:24.573 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-03-09T14:35:24.574 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-03-09T14:35:24.574 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-03-09T14:35:24.574 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-03-09T14:35:24.574 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-03-09T14:35:24.574 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-03-09T14:35:24.574 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-03-09T14:35:24.574 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-03-09T14:35:24.574 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-03-09T14:35:24.574 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-03-09T14:35:24.574 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-03-09T14:35:24.574 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-03-09T14:35:24.574 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-03-09T14:35:24.574 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-03-09T14:35:24.574 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-03-09T14:35:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-03-09T14:35:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-03-09T14:35:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-03-09T14:35:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-03-09T14:35:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-03-09T14:35:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-03-09T14:35:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-03-09T14:35:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-03-09T14:35:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-03-09T14:35:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-03-09T14:35:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-03-09T14:35:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-03-09T14:35:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-03-09T14:35:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-03-09T14:35:24.575 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-03-09T14:35:24.576 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-03-09T14:35:24.576 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-03-09T14:35:24.576 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-03-09T14:35:24.576 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-03-09T14:35:24.576 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-03-09T14:35:24.576 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-03-09T14:35:24.576 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-03-09T14:35:24.576 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-03-09T14:35:24.576 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-03-09T14:35:24.576 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-03-09T14:35:24.576 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-03-09T14:35:24.576 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-03-09T14:35:24.576 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-03-09T14:35:24.576 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-03-09T14:35:24.577 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-03-09T14:35:24.577 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-03-09T14:35:24.577 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-03-09T14:35:24.577 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-03-09T14:35:24.577 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-03-09T14:35:24.577 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-03-09T14:35:24.577 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-03-09T14:35:24.577 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-03-09T14:35:24.577 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-03-09T14:35:24.577 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-03-09T14:35:24.577 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-03-09T14:35:24.577 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-03-09T14:35:24.577 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-03-09T14:35:24.577 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-03-09T14:35:24.577 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-03-09T14:35:24.578 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-03-09T14:35:24.578 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-03-09T14:35:24.578 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-03-09T14:35:24.578 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-03-09T14:35:24.578 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-03-09T14:35:24.578 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-03-09T14:35:24.578 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-03-09T14:35:24.578 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-03-09T14:35:24.578 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-03-09T14:35:24.578 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-03-09T14:35:24.578 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-03-09T14:35:24.578 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-03-09T14:35:24.578 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-03-09T14:35:24.578 INFO:tasks.workunit.client.0.smithi088.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-03-09T14:35:24.578 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-03-09T14:35:24.579 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-09T14:35:24.579 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-09T14:35:24.579 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:35:24.579 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:35:24.579 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:35:24.579 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:35:24.579 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:35:24.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:24.571+0000 7f1376b3d8c0 -1 shutting down 2024-03-09T14:35:24.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:24.572+0000 7f1250a7a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68966, si_uid : 1000, si_addr0x3e800010d66, si_status0 2024-03-09T14:35:24.632 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SHUTDOWN (61 ms) 2024-03-09T14:35:24.633 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 11 tests from LibRGW (660 ms total) 2024-03-09T14:35:24.633 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:24.633 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:35:24.633 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 11 tests from 1 test suite ran. (660 ms total) 2024-03-09T14:35:24.633 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 11 tests. 2024-03-09T14:35:24.637 INFO:tasks.workunit.client.0.smithi088.stdout:phase 5.1 2024-03-09T14:35:24.667 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 19 tests from 1 test suite. 2024-03-09T14:35:24.667 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:35:24.667 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 19 tests from LibRGW 2024-03-09T14:35:24.667 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:35:24.677 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:24.677 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:24.848 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.INIT (181 ms) 2024-03-09T14:35:24.848 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:35:24.848 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:35:24.848 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:35:24.859 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-03-09T14:35:24.860 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-09T14:35:24.863 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-03-09T14:35:24.863 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-03-09T14:35:24.863 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-03-09T14:35:24.863 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-09T14:35:24.865 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-03-09T14:35:24.865 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-03-09T14:35:24.865 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-03-09T14:35:24.865 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-03-09T14:35:24.868 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.PUT_OBJECT (3 ms) 2024-03-09T14:35:24.868 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-03-09T14:35:24.871 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.GET_OBJECT (3 ms) 2024-03-09T14:35:24.871 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-09T14:35:24.872 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-09T14:35:24.872 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-03-09T14:35:24.872 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-03-09T14:35:24.872 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.WRITEV 2024-03-09T14:35:24.872 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-03-09T14:35:24.872 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.READV 2024-03-09T14:35:24.872 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.READV (0 ms) 2024-03-09T14:35:24.872 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-03-09T14:35:24.872 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-03-09T14:35:24.872 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-09T14:35:24.872 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-03-09T14:35:24.872 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:35:24.872 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-03-09T14:35:24.873 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:35:24.873 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:35:24.873 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:35:24.873 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:35:24.873 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:35:24.873 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:24.871+0000 7f78556b08c0 -1 shutting down 2024-03-09T14:35:24.873 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:24.872+0000 7f7731394640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69583, si_uid : 1000, si_addr0x3e800010fcf, si_status0 2024-03-09T14:35:24.922 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SHUTDOWN (51 ms) 2024-03-09T14:35:24.923 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 19 tests from LibRGW (256 ms total) 2024-03-09T14:35:24.923 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:24.923 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:35:24.923 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 19 tests from 1 test suite ran. (256 ms total) 2024-03-09T14:35:24.923 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 19 tests. 2024-03-09T14:35:24.928 INFO:tasks.workunit.client.0.smithi088.stdout:phase 5.2 2024-03-09T14:35:24.957 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] Running 19 tests from 1 test suite. 2024-03-09T14:35:24.957 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment set-up. 2024-03-09T14:35:24.957 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 19 tests from LibRGW 2024-03-09T14:35:24.957 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:35:24.964 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:24.964 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:25.561 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.INIT (605 ms) 2024-03-09T14:35:25.561 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:35:25.562 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:35:25.562 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:35:25.562 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-03-09T14:35:25.562 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-09T14:35:25.568 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-03-09T14:35:25.568 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-03-09T14:35:25.568 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-03-09T14:35:25.568 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-09T14:35:25.568 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-03-09T14:35:25.568 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-03-09T14:35:25.568 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-03-09T14:35:25.569 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-03-09T14:35:25.569 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-03-09T14:35:25.569 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-03-09T14:35:25.569 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-03-09T14:35:25.569 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-09T14:35:25.569 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-09T14:35:25.569 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-03-09T14:35:25.569 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-03-09T14:35:25.569 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.WRITEV 2024-03-09T14:35:25.569 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-03-09T14:35:25.569 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.READV 2024-03-09T14:35:25.570 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.READV (0 ms) 2024-03-09T14:35:25.570 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-03-09T14:35:25.570 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-03-09T14:35:25.570 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-09T14:35:25.571 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.DELETE_OBJECT (3 ms) 2024-03-09T14:35:25.572 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:35:25.602 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.DELETE_BUCKET (30 ms) 2024-03-09T14:35:25.602 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:35:25.602 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:35:25.602 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:35:25.602 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:35:25.602 INFO:tasks.workunit.client.0.smithi088.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:35:25.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.601+0000 7f4811cb08c0 -1 shutting down 2024-03-09T14:35:25.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.602+0000 7f46ed994640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70200, si_uid : 1000, si_addr0x3e800011238, si_status0 2024-03-09T14:35:25.707 INFO:tasks.workunit.client.0.smithi088.stdout:[ OK ] LibRGW.SHUTDOWN (105 ms) 2024-03-09T14:35:25.707 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] 19 tests from LibRGW (750 ms total) 2024-03-09T14:35:25.707 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:25.707 INFO:tasks.workunit.client.0.smithi088.stdout:[----------] Global test environment tear-down 2024-03-09T14:35:25.707 INFO:tasks.workunit.client.0.smithi088.stdout:[==========] 19 tests from 1 test suite ran. (750 ms total) 2024-03-09T14:35:25.707 INFO:tasks.workunit.client.0.smithi088.stdout:[ PASSED ] 19 tests. 2024-03-09T14:35:25.714 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:35:25.714 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:35:25.754 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-03-09T14:35:25.755 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-03-09T14:35:25.755 DEBUG:teuthology.orchestra.run.smithi088:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-03-09T14:35:25.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' -z ']' 2024-03-09T14:35:25.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-03-09T14:35:25.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-03-09T14:35:25.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-03-09T14:35:25.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-03-09T14:35:25.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-03-09T14:35:25.861 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:25.861 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:25.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.893+0000 7ff020c18800 20 rados->read ofs=0 len=0 2024-03-09T14:35:25.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.894+0000 7ff020c18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:25.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.894+0000 7ff020c18800 20 realm 2024-03-09T14:35:25.896 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.894+0000 7ff020c18800 20 rados->read ofs=0 len=0 2024-03-09T14:35:25.896 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.895+0000 7ff020c18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:25.896 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.895+0000 7ff020c18800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:35:25.896 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.895+0000 7ff020c18800 20 rados->read ofs=0 len=0 2024-03-09T14:35:25.896 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.895+0000 7ff020c18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:25.896 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.895+0000 7ff020c18800 20 rados->read ofs=0 len=0 2024-03-09T14:35:25.897 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.896+0000 7ff020c18800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:35:25.897 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.896+0000 7ff020c18800 20 rados->read ofs=0 len=0 2024-03-09T14:35:25.897 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.896+0000 7ff020c18800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:35:25.897 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.896+0000 7ff020c18800 20 searching for the correct realm 2024-03-09T14:35:25.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.898+0000 7ff01ca1e640 0 -- 172.21.15.88:0/2436763858 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7ff00c066040 msgr2=0x7ff00c05e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:35:25.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:25.902+0000 7ff01ba1c640 0 -- 172.21.15.88:0/2436763858 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7ff00c017020 msgr2=0x7ff00c071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:35:26.109 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.108+0000 7ff020c18800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:35:26.109 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.108+0000 7ff020c18800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:35:26.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.108+0000 7ff020c18800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:35:26.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.108+0000 7ff020c18800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:35:26.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.108+0000 7ff020c18800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:35:26.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.108+0000 7ff020c18800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:35:26.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.108+0000 7ff020c18800 20 rados->read ofs=0 len=0 2024-03-09T14:35:26.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.108+0000 7ff020c18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:26.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.108+0000 7ff020c18800 20 rados->read ofs=0 len=0 2024-03-09T14:35:26.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.109+0000 7ff020c18800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:35:26.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.109+0000 7ff020c18800 20 rados->read ofs=0 len=0 2024-03-09T14:35:26.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.109+0000 7ff020c18800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:35:26.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.109+0000 7ff020c18800 20 zone default found 2024-03-09T14:35:26.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.109+0000 7ff020c18800 4 Realm: () 2024-03-09T14:35:26.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.109+0000 7ff020c18800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:35:26.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.109+0000 7ff020c18800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:35:26.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.109+0000 7ff020c18800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:35:26.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.109+0000 7ff020c18800 20 zonegroup default 2024-03-09T14:35:26.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.109+0000 7ff020c18800 20 rados->read ofs=0 len=0 2024-03-09T14:35:26.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.110+0000 7ff020c18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:26.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.110+0000 7ff020c18800 20 rados->read ofs=0 len=0 2024-03-09T14:35:26.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.110+0000 7ff020c18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:26.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.110+0000 7ff020c18800 20 rados->read ofs=0 len=0 2024-03-09T14:35:26.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.110+0000 7ff020c18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:26.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.110+0000 7ff020c18800 20 started sync module instance, tier type = 2024-03-09T14:35:26.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.110+0000 7ff020c18800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:35:26.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.119+0000 7ff020c18800 20 add_watcher() i=0 2024-03-09T14:35:26.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.119+0000 7ff020c18800 20 add_watcher() i=1 2024-03-09T14:35:26.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.119+0000 7ff020c18800 20 add_watcher() i=2 2024-03-09T14:35:26.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.119+0000 7ff020c18800 20 add_watcher() i=3 2024-03-09T14:35:26.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.119+0000 7ff020c18800 20 add_watcher() i=4 2024-03-09T14:35:26.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.119+0000 7ff020c18800 20 add_watcher() i=5 2024-03-09T14:35:26.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.119+0000 7ff020c18800 20 add_watcher() i=6 2024-03-09T14:35:26.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.120+0000 7ff020c18800 20 add_watcher() i=7 2024-03-09T14:35:26.120 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.120+0000 7ff020c18800 2 all 8 watchers are set, enabling cache 2024-03-09T14:35:26.122 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.121+0000 7feed2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:35:26.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.122+0000 7ff020c18800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:35:26.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.122+0000 7ff020c18800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:35:26.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.122+0000 7ff020c18800 5 note: GC not initialized 2024-03-09T14:35:26.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.122+0000 7feed1fdb640 20 reqs_thread_entry: start 2024-03-09T14:35:26.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.122+0000 7ff020c18800 20 init_complete bucket index max shards: 11 2024-03-09T14:35:26.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.122+0000 7ff020c18800 20 Filter name: none 2024-03-09T14:35:26.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.122+0000 7fee437fe640 20 reqs_thread_entry: start 2024-03-09T14:35:26.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.122+0000 7ff020c18800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-03-09T14:35:26.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.122+0000 7ff020c18800 20 rados->read ofs=0 len=0 2024-03-09T14:35:26.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.122+0000 7ff020c18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:26.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.122+0000 7ff020c18800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-03-09T14:35:26.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.122+0000 7ff020c18800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-03-09T14:35:26.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.122+0000 7ff020c18800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-03-09T14:35:26.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.122+0000 7ff020c18800 20 rados->read ofs=0 len=0 2024-03-09T14:35:26.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.123+0000 7ff020c18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:26.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.123+0000 7ff020c18800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-03-09T14:35:26.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.123+0000 7ff020c18800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-03-09T14:35:26.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.123+0000 7ff020c18800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-03-09T14:35:26.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.123+0000 7ff020c18800 20 rados->read ofs=0 len=0 2024-03-09T14:35:26.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.123+0000 7ff020c18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:26.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.123+0000 7ff020c18800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-03-09T14:35:26.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.123+0000 7ff020c18800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-03-09T14:35:26.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.123+0000 7ff020c18800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-03-09T14:35:26.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.123+0000 7ff020c18800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-03-09T14:35:26.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.124+0000 7ff020c18800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-03-09T14:35:26.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.124+0000 7ff020c18800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-03-09T14:35:26.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.124+0000 7ff020c18800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-03-09T14:35:26.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.124+0000 7feef37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824002 cookie 93848931600976 notifier 5727 bl.length()=677 2024-03-09T14:35:26.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.124+0000 7feef37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-03-09T14:35:26.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.124+0000 7feef37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-03-09T14:35:26.128 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.127+0000 7ff020c18800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-03-09T14:35:26.128 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.127+0000 7ff020c18800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-03-09T14:35:26.128 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.127+0000 7ff020c18800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-03-09T14:35:26.128 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.127+0000 7feef2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824003 cookie 93848931586528 notifier 5727 bl.length()=187 2024-03-09T14:35:26.128 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.127+0000 7feef2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-03-09T14:35:26.128 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.127+0000 7feef2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-03-09T14:35:26.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.130+0000 7ff020c18800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-03-09T14:35:26.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.130+0000 7ff020c18800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-03-09T14:35:26.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.130+0000 7ff020c18800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-03-09T14:35:26.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.130+0000 7feef2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824004 cookie 93848931586528 notifier 5727 bl.length()=197 2024-03-09T14:35:26.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.130+0000 7feef2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-03-09T14:35:26.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.130+0000 7feef2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-03-09T14:35:26.132 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:35:26.132 INFO:tasks.workunit.client.0.smithi088.stdout: "user_id": "ceph-test-maven", 2024-03-09T14:35:26.132 INFO:tasks.workunit.client.0.smithi088.stdout: "display_name": "maven test user", 2024-03-09T14:35:26.132 INFO:tasks.workunit.client.0.smithi088.stdout: "email": "sigv4@example.com", 2024-03-09T14:35:26.132 INFO:tasks.workunit.client.0.smithi088.stdout: "suspended": 0, 2024-03-09T14:35:26.132 INFO:tasks.workunit.client.0.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:35:26.132 INFO:tasks.workunit.client.0.smithi088.stdout: "subusers": [], 2024-03-09T14:35:26.133 INFO:tasks.workunit.client.0.smithi088.stdout: "keys": [ 2024-03-09T14:35:26.133 INFO:tasks.workunit.client.0.smithi088.stdout: { 2024-03-09T14:35:26.133 INFO:tasks.workunit.client.0.smithi088.stdout: "user": "ceph-test-maven", 2024-03-09T14:35:26.133 INFO:tasks.workunit.client.0.smithi088.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-03-09T14:35:26.133 INFO:tasks.workunit.client.0.smithi088.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-03-09T14:35:26.133 INFO:tasks.workunit.client.0.smithi088.stdout: "active": true, 2024-03-09T14:35:26.133 INFO:tasks.workunit.client.0.smithi088.stdout: "create_date": "2024-03-09T14:35:26.124731Z" 2024-03-09T14:35:26.133 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:35:26.133 INFO:tasks.workunit.client.0.smithi088.stdout: ], 2024-03-09T14:35:26.133 INFO:tasks.workunit.client.0.smithi088.stdout: "swift_keys": [], 2024-03-09T14:35:26.133 INFO:tasks.workunit.client.0.smithi088.stdout: "caps": [], 2024-03-09T14:35:26.133 INFO:tasks.workunit.client.0.smithi088.stdout: "op_mask": "read, write, delete", 2024-03-09T14:35:26.133 INFO:tasks.workunit.client.0.smithi088.stdout: "default_placement": "", 2024-03-09T14:35:26.134 INFO:tasks.workunit.client.0.smithi088.stdout: "default_storage_class": "", 2024-03-09T14:35:26.134 INFO:tasks.workunit.client.0.smithi088.stdout: "placement_tags": [], 2024-03-09T14:35:26.134 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_quota": { 2024-03-09T14:35:26.134 INFO:tasks.workunit.client.0.smithi088.stdout: "enabled": false, 2024-03-09T14:35:26.134 INFO:tasks.workunit.client.0.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:35:26.134 INFO:tasks.workunit.client.0.smithi088.stdout: "max_size": -1, 2024-03-09T14:35:26.134 INFO:tasks.workunit.client.0.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:35:26.134 INFO:tasks.workunit.client.0.smithi088.stdout: "max_objects": -1 2024-03-09T14:35:26.134 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:26.134 INFO:tasks.workunit.client.0.smithi088.stdout: "user_quota": { 2024-03-09T14:35:26.134 INFO:tasks.workunit.client.0.smithi088.stdout: "enabled": false, 2024-03-09T14:35:26.134 INFO:tasks.workunit.client.0.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:35:26.134 INFO:tasks.workunit.client.0.smithi088.stdout: "max_size": -1, 2024-03-09T14:35:26.134 INFO:tasks.workunit.client.0.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:35:26.135 INFO:tasks.workunit.client.0.smithi088.stdout: "max_objects": -1 2024-03-09T14:35:26.135 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:35:26.135 INFO:tasks.workunit.client.0.smithi088.stdout: "temp_url_keys": [], 2024-03-09T14:35:26.135 INFO:tasks.workunit.client.0.smithi088.stdout: "type": "rgw", 2024-03-09T14:35:26.135 INFO:tasks.workunit.client.0.smithi088.stdout: "mfa_ids": [], 2024-03-09T14:35:26.135 INFO:tasks.workunit.client.0.smithi088.stdout: "account_id": "", 2024-03-09T14:35:26.135 INFO:tasks.workunit.client.0.smithi088.stdout: "path": "/", 2024-03-09T14:35:26.135 INFO:tasks.workunit.client.0.smithi088.stdout: "create_date": "2024-03-09T14:35:26.124722Z", 2024-03-09T14:35:26.135 INFO:tasks.workunit.client.0.smithi088.stdout: "tags": [], 2024-03-09T14:35:26.135 INFO:tasks.workunit.client.0.smithi088.stdout: "group_ids": [] 2024-03-09T14:35:26.135 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:35:26.135 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:35:26.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.132+0000 7feed2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:35:26.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.134+0000 7ff020c18800 20 remove_watcher() i=0 2024-03-09T14:35:26.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.134+0000 7ff020c18800 2 removed watcher, disabling cache 2024-03-09T14:35:26.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.135+0000 7ff020c18800 20 remove_watcher() i=1 2024-03-09T14:35:26.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.136+0000 7ff020c18800 20 remove_watcher() i=2 2024-03-09T14:35:26.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.137+0000 7ff020c18800 20 remove_watcher() i=3 2024-03-09T14:35:26.139 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.138+0000 7ff020c18800 20 remove_watcher() i=4 2024-03-09T14:35:26.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.139+0000 7ff020c18800 20 remove_watcher() i=5 2024-03-09T14:35:26.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.140+0000 7ff020c18800 20 remove_watcher() i=6 2024-03-09T14:35:26.141 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:35:26.141+0000 7ff020c18800 20 remove_watcher() i=7 2024-03-09T14:35:26.151 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' -z ']' 2024-03-09T14:35:26.151 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-03-09T14:35:26.152 INFO:tasks.workunit.client.0.smithi088.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-03-09T14:35:26.152 INFO:tasks.workunit.client.0.smithi088.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi088.front.sepia.ceph.com:80 2024-03-09T14:35:26.153 INFO:tasks.workunit.client.0.smithi088.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi088.front.sepia.ceph.com:80 2024-03-09T14:35:26.153 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-03-09T14:35:26.153 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-03-09T14:35:26.153 INFO:tasks.workunit.client.0.smithi088.stderr:+ ./mvnw clean package 2024-03-09T14:35:26.161 INFO:tasks.workunit.client.0.smithi088.stdout:Warning: JAVA_HOME environment variable is not set. 2024-03-09T14:35:27.761 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Scanning for projects... 2024-03-09T14:35:27.872 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-03-09T14:35:27.961 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 61 kB/s) 2024-03-09T14:35:27.971 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-03-09T14:35:28.021 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 32/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.6 MB/s) 2024-03-09T14:35:28.029 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-03-09T14:35:28.053 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/77 kB Progress (1): 32/77 kB Progress (1): 49/77 kB Progress (1): 65/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.2 MB/s) 2024-03-09T14:35:28.074 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:35:28.075 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-03-09T14:35:28.075 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Building jcksum 1.0 2024-03-09T14:35:28.075 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] from pom.xml 2024-03-09T14:35:28.075 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-03-09T14:35:28.077 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-03-09T14:35:28.099 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 279 kB/s) 2024-03-09T14:35:28.103 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-03-09T14:35:28.121 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 521 kB/s) 2024-03-09T14:35:28.124 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-03-09T14:35:28.144 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.4 MB/s) 2024-03-09T14:35:28.148 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-03-09T14:35:28.167 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.1 MB/s) 2024-03-09T14:35:28.178 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-03-09T14:35:28.197 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 1.9 MB/s) 2024-03-09T14:35:28.204 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-03-09T14:35:28.222 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 453 kB/s) 2024-03-09T14:35:28.225 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-03-09T14:35:28.243 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 450 kB/s) 2024-03-09T14:35:28.245 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-03-09T14:35:28.264 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.4 MB/s) 2024-03-09T14:35:28.268 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-03-09T14:35:28.286 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.2 MB/s) 2024-03-09T14:35:28.291 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-03-09T14:35:28.310 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.7 MB/s) 2024-03-09T14:35:28.315 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-03-09T14:35:28.333 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 517 kB/s) 2024-03-09T14:35:28.339 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-03-09T14:35:28.359 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.3 MB/s) 2024-03-09T14:35:28.365 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-03-09T14:35:28.383 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 296 kB/s) 2024-03-09T14:35:28.386 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-03-09T14:35:28.411 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 877 kB/s) 2024-03-09T14:35:28.414 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-03-09T14:35:28.434 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.4 MB/s) 2024-03-09T14:35:28.439 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-03-09T14:35:28.458 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.2 MB/s) 2024-03-09T14:35:28.466 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-03-09T14:35:28.486 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 296 kB/s) 2024-03-09T14:35:28.489 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-03-09T14:35:28.514 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 1.8 MB/s) 2024-03-09T14:35:28.522 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-03-09T14:35:28.540 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 376 kB/s) 2024-03-09T14:35:28.542 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-03-09T14:35:28.560 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 582 kB/s) 2024-03-09T14:35:28.562 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-03-09T14:35:28.582 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.3 MB/s) 2024-03-09T14:35:28.586 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-03-09T14:35:28.605 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.1 MB/s) 2024-03-09T14:35:28.609 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-03-09T14:35:28.629 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.4 MB/s) 2024-03-09T14:35:28.643 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-03-09T14:35:28.661 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 320 kB/s) 2024-03-09T14:35:28.663 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-03-09T14:35:28.682 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.1 MB/s) 2024-03-09T14:35:28.687 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-03-09T14:35:28.705 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-03-09T14:35:28.712 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-03-09T14:35:28.730 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 211 kB/s) 2024-03-09T14:35:28.732 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-03-09T14:35:28.750 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 86 kB/s) 2024-03-09T14:35:28.752 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-03-09T14:35:28.771 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 117 kB/s) 2024-03-09T14:35:28.775 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-03-09T14:35:28.793 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 202 kB/s) 2024-03-09T14:35:28.798 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-03-09T14:35:28.816 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 170 kB/s) 2024-03-09T14:35:28.820 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-03-09T14:35:28.839 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 577 kB/s) 2024-03-09T14:35:28.843 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-03-09T14:35:28.870 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 62 kB/s) 2024-03-09T14:35:28.874 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-03-09T14:35:28.891 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 225 kB/s) 2024-03-09T14:35:28.895 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-03-09T14:35:28.914 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 273 kB/s) 2024-03-09T14:35:28.915 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-03-09T14:35:28.933 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 68 kB/s) 2024-03-09T14:35:28.935 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-03-09T14:35:28.952 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 226 kB/s) 2024-03-09T14:35:28.953 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-03-09T14:35:28.971 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 812 kB/s) 2024-03-09T14:35:28.973 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-03-09T14:35:28.992 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 193 kB/s) 2024-03-09T14:35:28.996 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-03-09T14:35:29.014 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 136 kB/s) 2024-03-09T14:35:29.017 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-03-09T14:35:29.035 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 162 kB/s) 2024-03-09T14:35:29.039 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-03-09T14:35:29.057 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 390 kB/s) 2024-03-09T14:35:29.060 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-03-09T14:35:29.078 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 321 kB/s) 2024-03-09T14:35:29.081 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-03-09T14:35:29.100 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 194 kB/s) 2024-03-09T14:35:29.103 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-03-09T14:35:29.122 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 244 kB/s) 2024-03-09T14:35:29.124 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-03-09T14:35:29.141 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 134 kB/s) 2024-03-09T14:35:29.144 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-03-09T14:35:29.164 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 322 kB/s) 2024-03-09T14:35:29.168 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-03-09T14:35:29.187 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 337 kB/s) 2024-03-09T14:35:29.190 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-03-09T14:35:29.208 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 175 kB/s) 2024-03-09T14:35:29.212 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-03-09T14:35:29.230 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 193 kB/s) 2024-03-09T14:35:29.234 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-03-09T14:35:29.265 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 132 kB/s) 2024-03-09T14:35:29.267 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-03-09T14:35:29.285 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-03-09T14:35:29.288 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-03-09T14:35:29.305 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 389 kB/s) 2024-03-09T14:35:29.307 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-03-09T14:35:29.326 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 964 kB/s) 2024-03-09T14:35:29.327 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-03-09T14:35:29.350 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.4 MB/s) 2024-03-09T14:35:29.353 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-03-09T14:35:29.371 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.0 MB/s) 2024-03-09T14:35:29.374 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-03-09T14:35:29.393 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 276 kB/s) 2024-03-09T14:35:29.394 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-03-09T14:35:29.412 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 732 kB/s) 2024-03-09T14:35:29.416 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-03-09T14:35:29.436 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 735 kB/s) 2024-03-09T14:35:29.438 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-03-09T14:35:29.459 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.2 MB/s) 2024-03-09T14:35:29.465 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-03-09T14:35:29.484 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 870 kB/s) 2024-03-09T14:35:29.487 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-03-09T14:35:29.505 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 858 kB/s) 2024-03-09T14:35:29.507 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-03-09T14:35:29.527 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 3.8 MB/s) 2024-03-09T14:35:29.531 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-03-09T14:35:29.549 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.0 MB/s) 2024-03-09T14:35:29.553 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-03-09T14:35:29.571 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-03-09T14:35:29.574 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-03-09T14:35:29.595 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.7 MB/s) 2024-03-09T14:35:29.600 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-03-09T14:35:29.622 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 183 kB/s) 2024-03-09T14:35:29.624 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-03-09T14:35:29.643 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 727 kB/s) 2024-03-09T14:35:29.645 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-03-09T14:35:29.663 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 189 kB/s) 2024-03-09T14:35:29.665 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-03-09T14:35:29.682 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 187 kB/s) 2024-03-09T14:35:29.684 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-03-09T14:35:29.704 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 97 kB/s) 2024-03-09T14:35:29.706 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-03-09T14:35:29.723 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 157 kB/s) 2024-03-09T14:35:29.725 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-03-09T14:35:29.742 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 90 kB/s) 2024-03-09T14:35:29.744 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-03-09T14:35:29.761 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 177 kB/s) 2024-03-09T14:35:29.763 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-03-09T14:35:29.783 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 160 kB/s) 2024-03-09T14:35:29.785 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-03-09T14:35:29.803 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 189 kB/s) 2024-03-09T14:35:29.805 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-03-09T14:35:29.822 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 60 kB/s) 2024-03-09T14:35:29.826 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-03-09T14:35:29.847 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 44 kB/s) 2024-03-09T14:35:29.850 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-03-09T14:35:29.871 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 139 kB/s) 2024-03-09T14:35:29.873 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-03-09T14:35:29.891 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 178 kB/s) 2024-03-09T14:35:29.892 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-03-09T14:35:29.920 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 123 kB/s) 2024-03-09T14:35:29.922 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-03-09T14:35:29.942 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 181 kB/s) 2024-03-09T14:35:29.943 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-03-09T14:35:29.960 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 178 kB/s) 2024-03-09T14:35:29.976 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-03-09T14:35:30.075 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 33 MB/s) 2024-03-09T14:35:30.076 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-03-09T14:35:30.077 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-03-09T14:35:30.077 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-03-09T14:35:30.077 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-03-09T14:35:30.077 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-03-09T14:35:30.098 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/71 kB Progress (1): 33/71 kB Progress (1): 49/71 kB Progress (1): 66/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 3.4 MB/s) 2024-03-09T14:35:30.098 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-03-09T14:35:30.116 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 422 kB/s) 2024-03-09T14:35:30.116 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-03-09T14:35:30.137 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.4/16 kB Progress (2): 1.4/16 kB | 1.4/49 kB Progress (2): 2.8/16 kB | 1.4/49 kB Progress (2): 2.8/16 kB | 2.8/49 kB Progress (2): 4.1/16 kB | 2.8/49 kB Progress (2): 4.1/16 kB | 4.1/49 kB Progress (2): 5.5/16 kB | 4.1/49 kB Progress (2): 5.5/16 kB | 5.5/49 kB Progress (2): 6.9/16 kB | 5.5/49 kB Progress (2): 6.9/16 kB | 6.9/49 kB Progress (2): 8.3/16 kB | 6.9/49 kB Progress (2): 8.3/16 kB | 8.3/49 kB Progress (2): 9.7/16 kB | 8.3/49 kB Progress (3): 9.7/16 kB | 8.3/49 kB | 1.4/35 kB Progress (3): 11/16 kB | 8.3/49 kB | 1.4/35 kB Progress (3): 11/16 kB | 9.7/49 kB | 1.4/35 kB Progress (3): 12/16 kB | 9.7/49 kB | 1.4/35 kB Progress (3): 12/16 kB | 11/49 kB | 1.4/35 kB Progress (3): 14/16 kB | 11/49 kB | 1.4/35 kB Progress (3): 14/16 kB | 11/49 kB | 2.8/35 kB Progress (3): 15/16 kB | 11/49 kB | 2.8/35 kB Progress (3): 15/16 kB | 12/49 kB | 2.8/35 kB Progress (3): 15/16 kB | 12/49 kB | 4.1/35 kB Progress (3): 16 kB | 12/49 kB | 4.1/35 kB Progress (3): 16 kB | 12/49 kB | 5.5/35 kB Progress (3): 16 kB | 14/49 kB | 5.5/35 kB Progress (3): 16 kB | 14/49 kB | 6.9/35 kB Progress (3): 16 kB | 15/49 kB | 6.9/35 kB Progress (4): 16 kB | 15/49 kB | 6.9/35 kB | 1.4/98 kB Progress (4): 16 kB | 15/49 kB | 8.3/35 kB | 1.4/98 kB Progress (4): 16 kB | 15/49 kB | 8.3/35 kB | 2.8/98 kB Progress (4): 16 kB | 15/49 kB | 9.7/35 kB | 2.8/98 kB Progress (4): 16 kB | 15/49 kB | 9.7/35 kB | 4.1/98 kB Progress (4): 16 kB | 17/49 kB | 9.7/35 kB | 4.1/98 kB Progress (4): 16 kB | 17/49 kB | 9.7/35 kB | 5.5/98 kB Progress (4): 16 kB | 17/49 kB | 11/35 kB | 5.5/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 282 kB/s) 2024-03-09T14:35:30.137 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (3): 17/49 kB | 11/35 kB | 6.9/98 kB Progress (3): 18/49 kB | 11/35 kB | 6.9/98 kB Progress (3): 18/49 kB | 11/35 kB | 8.3/98 kB Progress (3): 18/49 kB | 12/35 kB | 8.3/98 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-03-09T14:35:30.148 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (3): 18/49 kB | 12/35 kB | 9.7/98 kB Progress (3): 19/49 kB | 12/35 kB | 9.7/98 kB Progress (3): 19/49 kB | 12/35 kB | 11/98 kB Progress (3): 19/49 kB | 14/35 kB | 11/98 kB Progress (3): 21/49 kB | 14/35 kB | 11/98 kB Progress (3): 21/49 kB | 15/35 kB | 11/98 kB Progress (3): 21/49 kB | 15/35 kB | 12/98 kB Progress (3): 21/49 kB | 17/35 kB | 12/98 kB Progress (3): 21/49 kB | 17/35 kB | 14/98 kB Progress (3): 22/49 kB | 17/35 kB | 14/98 kB Progress (3): 22/49 kB | 17/35 kB | 15/98 kB Progress (3): 22/49 kB | 18/35 kB | 15/98 kB Progress (3): 23/49 kB | 18/35 kB | 15/98 kB Progress (3): 23/49 kB | 18/35 kB | 16/98 kB Progress (3): 23/49 kB | 19/35 kB | 16/98 kB Progress (3): 23/49 kB | 21/35 kB | 16/98 kB Progress (3): 25/49 kB | 21/35 kB | 16/98 kB Progress (3): 25/49 kB | 22/35 kB | 16/98 kB Progress (3): 26/49 kB | 22/35 kB | 16/98 kB Progress (3): 26/49 kB | 23/35 kB | 16/98 kB Progress (3): 26/49 kB | 25/35 kB | 16/98 kB Progress (3): 28/49 kB | 25/35 kB | 16/98 kB Progress (3): 28/49 kB | 26/35 kB | 16/98 kB Progress (3): 29/49 kB | 26/35 kB | 16/98 kB Progress (3): 29/49 kB | 28/35 kB | 16/98 kB Progress (3): 30/49 kB | 28/35 kB | 16/98 kB Progress (4): 30/49 kB | 28/35 kB | 16/98 kB | 16/782 kB Progress (4): 30/49 kB | 29/35 kB | 16/98 kB | 16/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 16/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 33/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 49/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 66/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 82/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 98/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 115/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 131/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 147/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 164/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 180/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 197/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 213/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 229/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 246/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 256/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 272/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 289/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 305/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 321/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 338/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 354/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 370/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 387/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 403/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 420/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 436/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 452/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 469/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 485/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 502/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 518/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 534/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 551/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 567/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 583/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 600/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 616/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/98 kB | 633/782 kB Progress (4): 32/49 kB | 30/35 kB | 16/98 kB | 633/782 kB Progress (4): 32/49 kB | 30/35 kB | 16/98 kB | 649/782 kB Progress (4): 33/49 kB | 30/35 kB | 16/98 kB | 649/782 kB Progress (4): 34/49 kB | 30/35 kB | 16/98 kB | 649/782 kB Progress (4): 34/49 kB | 30/35 kB | 16/98 kB | 665/782 kB Progress (4): 36/49 kB | 30/35 kB | 16/98 kB | 665/782 kB Progress (4): 36/49 kB | 32/35 kB | 16/98 kB | 665/782 kB Progress (4): 37/49 kB | 32/35 kB | 16/98 kB | 665/782 kB Progress (4): 37/49 kB | 33/35 kB | 16/98 kB | 665/782 kB Progress (4): 37/49 kB | 33/35 kB | 16/98 kB | 682/782 kB Progress (4): 37/49 kB | 34/35 kB | 16/98 kB | 682/782 kB Progress (4): 39/49 kB | 34/35 kB | 16/98 kB | 682/782 kB Progress (4): 39/49 kB | 35 kB | 16/98 kB | 682/782 kB Progress (4): 40/49 kB | 35 kB | 16/98 kB | 682/782 kB Progress (4): 40/49 kB | 35 kB | 16/98 kB | 698/782 kB Progress (4): 41/49 kB | 35 kB | 16/98 kB | 698/782 kB Progress (4): 41/49 kB | 35 kB | 32/98 kB | 698/782 kB Progress (4): 41/49 kB | 35 kB | 32/98 kB | 715/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 502 kB/s) 2024-03-09T14:35:30.148 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (3): 41/49 kB | 32/98 kB | 731/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-03-09T14:35:30.148 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (3): 41/49 kB | 32/98 kB | 747/782 kB Progress (3): 41/49 kB | 32/98 kB | 764/782 kB Progress (3): 41/49 kB | 32/98 kB | 780/782 kB Progress (3): 41/49 kB | 32/98 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 11 MB/s) 2024-03-09T14:35:30.149 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-03-09T14:35:30.156 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 43/49 kB | 32/98 kB Progress (2): 44/49 kB | 32/98 kB Progress (2): 44/49 kB | 49/98 kB Progress (2): 46/49 kB | 49/98 kB Progress (2): 47/49 kB | 49/98 kB Progress (2): 48/49 kB | 49/98 kB Progress (3): 48/49 kB | 49/98 kB | 1.4/11 kB Progress (3): 49 kB | 49/98 kB | 1.4/11 kB Progress (3): 49 kB | 49/98 kB | 2.8/11 kB Progress (3): 49 kB | 49/98 kB | 4.1/11 kB Progress (3): 49 kB | 49/98 kB | 5.5/11 kB Progress (3): 49 kB | 49/98 kB | 6.9/11 kB Progress (3): 49 kB | 49/98 kB | 8.3/11 kB Progress (3): 49 kB | 49/98 kB | 9.7/11 kB Progress (3): 49 kB | 49/98 kB | 11/11 kB Progress (3): 49 kB | 49/98 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 631 kB/s) 2024-03-09T14:35:30.156 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-03-09T14:35:30.156 INFO:tasks.workunit.client.0.smithi088.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 146 kB/s) 2024-03-09T14:35:30.156 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-03-09T14:35:30.166 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 65/98 kB Progress (2): 65/98 kB | 16/30 kB Progress (2): 65/98 kB | 30 kB Progress (3): 65/98 kB | 30 kB | 16/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 343 kB/s) 2024-03-09T14:35:30.167 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-03-09T14:35:30.171 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 65/98 kB | 33/205 kB Progress (2): 81/98 kB | 33/205 kB Progress (2): 98/98 kB | 33/205 kB Progress (2): 98 kB | 33/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.0 MB/s) 2024-03-09T14:35:30.171 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-03-09T14:35:30.184 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 33/205 kB | 16/81 kB Progress (3): 33/205 kB | 16/81 kB | 16/798 kB Progress (3): 49/205 kB | 16/81 kB | 16/798 kB Progress (3): 49/205 kB | 16/81 kB | 33/798 kB Progress (3): 66/205 kB | 16/81 kB | 33/798 kB Progress (3): 82/205 kB | 16/81 kB | 33/798 kB Progress (3): 82/205 kB | 16/81 kB | 49/798 kB Progress (4): 82/205 kB | 16/81 kB | 49/798 kB | 13 kB Progress (4): 98/205 kB | 16/81 kB | 49/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 125 kB/s) 2024-03-09T14:35:30.184 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-03-09T14:35:30.195 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (3): 115/205 kB | 16/81 kB | 49/798 kB Progress (3): 115/205 kB | 33/81 kB | 49/798 kB Progress (3): 131/205 kB | 33/81 kB | 49/798 kB Progress (4): 131/205 kB | 33/81 kB | 49/798 kB | 16/182 kB Progress (4): 131/205 kB | 33/81 kB | 49/798 kB | 33/182 kB Progress (4): 131/205 kB | 49/81 kB | 49/798 kB | 33/182 kB Progress (4): 131/205 kB | 49/81 kB | 49/798 kB | 49/182 kB Progress (4): 131/205 kB | 49/81 kB | 66/798 kB | 49/182 kB Progress (4): 131/205 kB | 49/81 kB | 66/798 kB | 64/182 kB Progress (4): 131/205 kB | 66/81 kB | 66/798 kB | 64/182 kB Progress (4): 131/205 kB | 66/81 kB | 66/798 kB | 80/182 kB Progress (4): 131/205 kB | 66/81 kB | 82/798 kB | 80/182 kB Progress (4): 131/205 kB | 66/81 kB | 82/798 kB | 97/182 kB Progress (4): 147/205 kB | 66/81 kB | 82/798 kB | 97/182 kB Progress (4): 147/205 kB | 81 kB | 82/798 kB | 97/182 kB Progress (4): 147/205 kB | 81 kB | 98/798 kB | 97/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 695 kB/s) 2024-03-09T14:35:30.195 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-03-09T14:35:30.197 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (3): 164/205 kB | 98/798 kB | 97/182 kB Progress (3): 164/205 kB | 115/798 kB | 97/182 kB Progress (3): 180/205 kB | 115/798 kB | 97/182 kB Progress (3): 180/205 kB | 131/798 kB | 97/182 kB Progress (3): 197/205 kB | 131/798 kB | 97/182 kB Progress (3): 205 kB | 131/798 kB | 97/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.7 MB/s) 2024-03-09T14:35:30.197 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-03-09T14:35:30.207 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 147/798 kB | 97/182 kB Progress (2): 164/798 kB | 97/182 kB Progress (2): 180/798 kB | 97/182 kB Progress (2): 180/798 kB | 113/182 kB Progress (2): 180/798 kB | 129/182 kB Progress (3): 180/798 kB | 129/182 kB | 16/151 kB Progress (3): 180/798 kB | 129/182 kB | 33/151 kB Progress (3): 180/798 kB | 146/182 kB | 33/151 kB Progress (3): 180/798 kB | 146/182 kB | 49/151 kB Progress (3): 180/798 kB | 162/182 kB | 49/151 kB Progress (3): 180/798 kB | 162/182 kB | 66/151 kB Progress (3): 180/798 kB | 162/182 kB | 82/151 kB Progress (3): 180/798 kB | 178/182 kB | 82/151 kB Progress (3): 180/798 kB | 178/182 kB | 98/151 kB Progress (3): 180/798 kB | 178/182 kB | 115/151 kB Progress (3): 180/798 kB | 182 kB | 115/151 kB Progress (3): 197/798 kB | 182 kB | 115/151 kB Progress (3): 197/798 kB | 182 kB | 131/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.4 MB/s) 2024-03-09T14:35:30.207 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-03-09T14:35:30.208 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 213/798 kB | 131/151 kB Progress (2): 213/798 kB | 147/151 kB Progress (2): 213/798 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-03-09T14:35:30.208 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-03-09T14:35:30.213 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 229/798 kB Progress (1): 246/798 kB Progress (1): 262/798 kB Progress (1): 279/798 kB Progress (1): 295/798 kB Progress (1): 311/798 kB Progress (2): 311/798 kB | 16/27 kB Progress (2): 311/798 kB | 27 kB Progress (2): 328/798 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 202 kB/s) 2024-03-09T14:35:30.213 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-03-09T14:35:30.215 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 344/798 kB Progress (1): 360/798 kB Progress (1): 377/798 kB Progress (2): 377/798 kB | 16/30 kB Progress (2): 377/798 kB | 30 kB Progress (2): 393/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 219 kB/s) 2024-03-09T14:35:30.215 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-03-09T14:35:30.226 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 410/798 kB Progress (1): 426/798 kB Progress (1): 442/798 kB Progress (1): 459/798 kB Progress (1): 475/798 kB Progress (1): 492/798 kB Progress (1): 508/798 kB Progress (1): 524/798 kB Progress (1): 541/798 kB Progress (1): 557/798 kB Progress (1): 573/798 kB Progress (2): 573/798 kB | 16/385 kB Progress (2): 585/798 kB | 16/385 kB Progress (3): 585/798 kB | 16/385 kB | 13 kB Progress (3): 585/798 kB | 32/385 kB | 13 kB Progress (3): 601/798 kB | 32/385 kB | 13 kB Progress (3): 601/798 kB | 49/385 kB | 13 kB Progress (3): 617/798 kB | 49/385 kB | 13 kB Progress (3): 617/798 kB | 65/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 89 kB/s) 2024-03-09T14:35:30.226 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-03-09T14:35:30.230 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 617/798 kB | 81/385 kB Progress (2): 634/798 kB | 81/385 kB Progress (2): 634/798 kB | 98/385 kB Progress (2): 634/798 kB | 114/385 kB Progress (2): 650/798 kB | 114/385 kB Progress (2): 667/798 kB | 114/385 kB Progress (2): 683/798 kB | 114/385 kB Progress (2): 683/798 kB | 130/385 kB Progress (2): 699/798 kB | 130/385 kB Progress (2): 699/798 kB | 147/385 kB Progress (2): 716/798 kB | 147/385 kB Progress (2): 732/798 kB | 147/385 kB Progress (2): 749/798 kB | 147/385 kB Progress (2): 749/798 kB | 163/385 kB Progress (2): 749/798 kB | 180/385 kB Progress (2): 765/798 kB | 180/385 kB Progress (2): 781/798 kB | 180/385 kB Progress (2): 781/798 kB | 196/385 kB Progress (2): 798/798 kB | 196/385 kB Progress (2): 798 kB | 196/385 kB Progress (2): 798 kB | 212/385 kB Progress (2): 798 kB | 229/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 5.3 MB/s) 2024-03-09T14:35:30.230 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-03-09T14:35:30.235 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 245/385 kB Progress (1): 262/385 kB Progress (1): 278/385 kB Progress (2): 278/385 kB | 16/75 kB Progress (2): 278/385 kB | 33/75 kB Progress (2): 278/385 kB | 49/75 kB Progress (2): 278/385 kB | 66/75 kB Progress (2): 278/385 kB | 75 kB Progress (3): 278/385 kB | 75 kB | 16/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 475 kB/s) 2024-03-09T14:35:30.235 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 278/385 kB | 32/780 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-03-09T14:35:30.242 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 278/385 kB | 49/780 kB Progress (2): 278/385 kB | 65/780 kB Progress (2): 278/385 kB | 81/780 kB Progress (2): 278/385 kB | 98/780 kB Progress (2): 278/385 kB | 114/780 kB Progress (2): 278/385 kB | 130/780 kB Progress (2): 278/385 kB | 147/780 kB Progress (2): 278/385 kB | 163/780 kB Progress (2): 278/385 kB | 180/780 kB Progress (2): 294/385 kB | 180/780 kB Progress (2): 294/385 kB | 196/780 kB Progress (2): 294/385 kB | 212/780 kB Progress (2): 311/385 kB | 212/780 kB Progress (2): 327/385 kB | 212/780 kB Progress (2): 343/385 kB | 212/780 kB Progress (2): 343/385 kB | 229/780 kB Progress (2): 360/385 kB | 229/780 kB Progress (2): 360/385 kB | 245/780 kB Progress (2): 376/385 kB | 245/780 kB Progress (2): 376/385 kB | 262/780 kB Progress (2): 385 kB | 262/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.3 MB/s) 2024-03-09T14:35:30.242 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-03-09T14:35:30.252 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 262/780 kB | 16/329 kB Progress (2): 262/780 kB | 33/329 kB Progress (2): 262/780 kB | 49/329 kB Progress (2): 262/780 kB | 66/329 kB Progress (2): 262/780 kB | 82/329 kB Progress (2): 262/780 kB | 98/329 kB Progress (2): 262/780 kB | 115/329 kB Progress (2): 262/780 kB | 131/329 kB Progress (2): 262/780 kB | 147/329 kB Progress (2): 262/780 kB | 164/329 kB Progress (2): 262/780 kB | 180/329 kB Progress (2): 262/780 kB | 197/329 kB Progress (2): 262/780 kB | 213/329 kB Progress (3): 262/780 kB | 213/329 kB | 16/501 kB Progress (3): 262/780 kB | 229/329 kB | 16/501 kB Progress (3): 262/780 kB | 229/329 kB | 32/501 kB Progress (3): 262/780 kB | 229/329 kB | 49/501 kB Progress (3): 262/780 kB | 246/329 kB | 49/501 kB Progress (3): 262/780 kB | 246/329 kB | 65/501 kB Progress (3): 262/780 kB | 256/329 kB | 65/501 kB Progress (3): 262/780 kB | 256/329 kB | 81/501 kB Progress (3): 278/780 kB | 256/329 kB | 81/501 kB Progress (3): 278/780 kB | 272/329 kB | 81/501 kB Progress (3): 278/780 kB | 272/329 kB | 98/501 kB Progress (3): 278/780 kB | 272/329 kB | 114/501 kB Progress (3): 278/780 kB | 289/329 kB | 114/501 kB Progress (3): 278/780 kB | 289/329 kB | 130/501 kB Progress (3): 294/780 kB | 289/329 kB | 130/501 kB Progress (3): 294/780 kB | 289/329 kB | 147/501 kB Progress (3): 294/780 kB | 305/329 kB | 147/501 kB Progress (3): 311/780 kB | 305/329 kB | 147/501 kB Progress (3): 311/780 kB | 305/329 kB | 163/501 kB Progress (3): 311/780 kB | 321/329 kB | 163/501 kB Progress (3): 311/780 kB | 321/329 kB | 180/501 kB Progress (3): 311/780 kB | 329 kB | 180/501 kB Progress (3): 311/780 kB | 329 kB | 196/501 kB Progress (3): 327/780 kB | 329 kB | 196/501 kB Progress (3): 327/780 kB | 329 kB | 212/501 kB Progress (3): 343/780 kB | 329 kB | 212/501 kB Progress (3): 343/780 kB | 329 kB | 229/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.9 MB/s) 2024-03-09T14:35:30.252 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-03-09T14:35:30.260 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 343/780 kB | 245/501 kB Progress (2): 360/780 kB | 245/501 kB Progress (2): 360/780 kB | 262/501 kB Progress (2): 376/780 kB | 262/501 kB Progress (2): 376/780 kB | 278/501 kB Progress (2): 393/780 kB | 278/501 kB Progress (2): 393/780 kB | 294/501 kB Progress (2): 402/780 kB | 294/501 kB Progress (2): 402/780 kB | 311/501 kB Progress (2): 418/780 kB | 311/501 kB Progress (2): 418/780 kB | 327/501 kB Progress (2): 435/780 kB | 327/501 kB Progress (3): 435/780 kB | 327/501 kB | 16/354 kB Progress (3): 451/780 kB | 327/501 kB | 16/354 kB Progress (3): 451/780 kB | 343/501 kB | 16/354 kB Progress (3): 451/780 kB | 343/501 kB | 33/354 kB Progress (3): 451/780 kB | 360/501 kB | 33/354 kB Progress (3): 468/780 kB | 360/501 kB | 33/354 kB Progress (3): 468/780 kB | 376/501 kB | 33/354 kB Progress (3): 484/780 kB | 376/501 kB | 33/354 kB Progress (3): 484/780 kB | 376/501 kB | 49/354 kB Progress (3): 484/780 kB | 393/501 kB | 49/354 kB Progress (3): 500/780 kB | 393/501 kB | 49/354 kB Progress (3): 500/780 kB | 402/501 kB | 49/354 kB Progress (3): 517/780 kB | 402/501 kB | 49/354 kB Progress (3): 517/780 kB | 418/501 kB | 49/354 kB Progress (3): 517/780 kB | 418/501 kB | 66/354 kB Progress (3): 533/780 kB | 418/501 kB | 66/354 kB Progress (3): 533/780 kB | 435/501 kB | 66/354 kB Progress (3): 549/780 kB | 435/501 kB | 66/354 kB Progress (3): 549/780 kB | 451/501 kB | 66/354 kB Progress (3): 566/780 kB | 451/501 kB | 66/354 kB Progress (3): 566/780 kB | 451/501 kB | 82/354 kB Progress (3): 566/780 kB | 468/501 kB | 82/354 kB Progress (3): 582/780 kB | 468/501 kB | 82/354 kB Progress (3): 582/780 kB | 468/501 kB | 98/354 kB Progress (3): 582/780 kB | 484/501 kB | 98/354 kB Progress (3): 599/780 kB | 484/501 kB | 98/354 kB Progress (3): 599/780 kB | 484/501 kB | 115/354 kB Progress (3): 599/780 kB | 500/501 kB | 115/354 kB Progress (3): 615/780 kB | 500/501 kB | 115/354 kB Progress (3): 615/780 kB | 500/501 kB | 131/354 kB Progress (3): 615/780 kB | 501 kB | 131/354 kB Progress (3): 631/780 kB | 501 kB | 131/354 kB Progress (4): 631/780 kB | 501 kB | 131/354 kB | 16/41 kB Progress (4): 631/780 kB | 501 kB | 147/354 kB | 16/41 kB Progress (4): 648/780 kB | 501 kB | 147/354 kB | 16/41 kB Progress (4): 648/780 kB | 501 kB | 147/354 kB | 33/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.8 MB/s) 2024-03-09T14:35:30.260 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (3): 648/780 kB | 147/354 kB | 41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-03-09T14:35:30.260 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (3): 664/780 kB | 147/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 226 kB/s) 2024-03-09T14:35:30.260 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-03-09T14:35:30.262 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 681/780 kB | 147/354 kB Progress (2): 697/780 kB | 147/354 kB Progress (2): 713/780 kB | 147/354 kB Progress (2): 730/780 kB | 147/354 kB Progress (2): 746/780 kB | 147/354 kB Progress (2): 762/780 kB | 147/354 kB Progress (2): 779/780 kB | 147/354 kB Progress (2): 780 kB | 147/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.2 MB/s) 2024-03-09T14:35:30.262 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-03-09T14:35:30.272 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 164/354 kB Progress (1): 180/354 kB Progress (1): 197/354 kB Progress (1): 213/354 kB Progress (2): 213/354 kB | 6.4 kB Progress (2): 229/354 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 33 kB/s) 2024-03-09T14:35:30.272 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-03-09T14:35:30.276 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 246/354 kB Progress (1): 256/354 kB Progress (1): 272/354 kB Progress (1): 289/354 kB Progress (1): 305/354 kB Progress (1): 321/354 kB Progress (1): 338/354 kB Progress (1): 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.8 MB/s) 2024-03-09T14:35:30.276 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-03-09T14:35:30.280 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/586 kB Progress (1): 33/586 kB Progress (1): 49/586 kB Progress (1): 66/586 kB Progress (1): 82/586 kB Progress (1): 98/586 kB Progress (1): 115/586 kB Progress (1): 131/586 kB Progress (1): 147/586 kB Progress (2): 147/586 kB | 14 kB Progress (2): 164/586 kB | 14 kB Progress (2): 180/586 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 72 kB/s) 2024-03-09T14:35:30.280 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-03-09T14:35:30.286 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 197/586 kB Progress (1): 213/586 kB Progress (1): 229/586 kB Progress (1): 246/586 kB Progress (1): 262/586 kB Progress (1): 279/586 kB Progress (1): 295/586 kB Progress (1): 311/586 kB Progress (1): 328/586 kB Progress (1): 344/586 kB Progress (1): 360/586 kB Progress (1): 377/586 kB Progress (1): 393/586 kB Progress (1): 410/586 kB Progress (1): 426/586 kB Progress (1): 442/586 kB Progress (1): 459/586 kB Progress (1): 475/586 kB Progress (1): 492/586 kB Progress (1): 508/586 kB Progress (1): 524/586 kB Progress (1): 541/586 kB Progress (1): 557/586 kB Progress (1): 573/586 kB Progress (1): 585/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.8 MB/s) 2024-03-09T14:35:30.286 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-03-09T14:35:30.292 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/106 kB Progress (1): 33/106 kB Progress (1): 49/106 kB Progress (1): 66/106 kB Progress (2): 66/106 kB | 16/211 kB Progress (2): 82/106 kB | 16/211 kB Progress (2): 82/106 kB | 33/211 kB Progress (2): 82/106 kB | 49/211 kB Progress (2): 98/106 kB | 49/211 kB Progress (2): 98/106 kB | 66/211 kB Progress (2): 106 kB | 66/211 kB Progress (2): 106 kB | 82/211 kB Progress (2): 106 kB | 98/211 kB Progress (2): 106 kB | 115/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 499 kB/s) 2024-03-09T14:35:30.292 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-03-09T14:35:30.293 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 131/211 kB Progress (1): 147/211 kB Progress (1): 164/211 kB Progress (1): 180/211 kB Progress (2): 180/211 kB | 6.8 kB Progress (2): 197/211 kB | 6.8 kB Progress (2): 211 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 32 kB/s) 2024-03-09T14:35:30.293 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-03-09T14:35:30.294 INFO:tasks.workunit.client.0.smithi088.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 986 kB/s) 2024-03-09T14:35:30.294 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-03-09T14:35:30.301 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (1): 98/245 kB Progress (1): 115/245 kB Progress (1): 131/245 kB Progress (1): 147/245 kB Progress (1): 164/245 kB Progress (1): 180/245 kB Progress (1): 197/245 kB Progress (1): 213/245 kB Progress (1): 229/245 kB Progress (1): 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.1 MB/s) 2024-03-09T14:35:30.301 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-03-09T14:35:30.317 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/205 kB Progress (1): 33/205 kB Progress (1): 49/205 kB Progress (1): 66/205 kB Progress (2): 66/205 kB | 6.4 kB Progress (3): 66/205 kB | 6.4 kB | 15 kB Progress (3): 82/205 kB | 6.4 kB | 15 kB Progress (4): 82/205 kB | 6.4 kB | 15 kB | 16/16 kB Progress (4): 82/205 kB | 6.4 kB | 15 kB | 16 kB Progress (4): 98/205 kB | 6.4 kB | 15 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 64 kB/s) 2024-03-09T14:35:30.318 INFO:tasks.workunit.client.0.smithi088.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 27 kB/s) 2024-03-09T14:35:30.318 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-03-09T14:35:30.318 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-03-09T14:35:30.318 INFO:tasks.workunit.client.0.smithi088.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 69 kB/s) 2024-03-09T14:35:30.318 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 115/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-03-09T14:35:30.319 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 131/205 kB Progress (1): 147/205 kB Progress (1): 164/205 kB Progress (1): 180/205 kB Progress (2): 180/205 kB | 16/23 kB Progress (2): 180/205 kB | 23 kB Progress (2): 197/205 kB | 23 kB Progress (2): 205 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 94 kB/s) 2024-03-09T14:35:30.319 INFO:tasks.workunit.client.0.smithi088.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 853 kB/s) 2024-03-09T14:35:30.334 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Progress (2): 24 kB | 16/184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 95 kB/s) 2024-03-09T14:35:30.335 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (2): 49/184 kB | 16/17 kB Progress (2): 49/184 kB | 17 kB Progress (2): 66/184 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 68 kB/s) 2024-03-09T14:35:30.338 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 115/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 710 kB/s) 2024-03-09T14:35:30.362 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:35:30.363 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-03-09T14:35:30.369 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-03-09T14:35:30.386 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 343 kB/s) 2024-03-09T14:35:30.388 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-03-09T14:35:30.405 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 300 kB/s) 2024-03-09T14:35:30.406 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-03-09T14:35:30.424 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.5 MB/s) 2024-03-09T14:35:30.427 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-03-09T14:35:30.444 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 839 kB/s) 2024-03-09T14:35:30.449 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-03-09T14:35:30.469 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 7.7 MB/s) 2024-03-09T14:35:30.469 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-03-09T14:35:30.489 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 64/215 kB Progress (1): 81/215 kB Progress (1): 97/215 kB Progress (1): 113/215 kB Progress (1): 130/215 kB Progress (1): 146/215 kB Progress (1): 163/215 kB Progress (1): 179/215 kB Progress (1): 195/215 kB Progress (1): 212/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 11 MB/s) 2024-03-09T14:35:30.524 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:35:30.524 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-03-09T14:35:30.527 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-03-09T14:35:30.547 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 140 kB/s) 2024-03-09T14:35:30.548 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-03-09T14:35:30.582 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 682 kB/s) 2024-03-09T14:35:30.584 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-03-09T14:35:30.601 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 516 kB/s) 2024-03-09T14:35:30.603 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-03-09T14:35:30.620 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.5 MB/s) 2024-03-09T14:35:30.622 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-03-09T14:35:30.639 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 377 kB/s) 2024-03-09T14:35:30.640 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-03-09T14:35:30.657 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 189 kB/s) 2024-03-09T14:35:30.660 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-03-09T14:35:30.683 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 27 kB/s) 2024-03-09T14:35:30.685 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-03-09T14:35:30.702 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 161 kB/s) 2024-03-09T14:35:30.703 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-03-09T14:35:30.720 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 829 kB/s) 2024-03-09T14:35:30.722 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-03-09T14:35:30.739 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 188 kB/s) 2024-03-09T14:35:30.740 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-03-09T14:35:30.758 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 522 kB/s) 2024-03-09T14:35:30.758 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-03-09T14:35:30.775 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 523 kB/s) 2024-03-09T14:35:30.777 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-03-09T14:35:30.793 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 501 kB/s) 2024-03-09T14:35:30.796 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-03-09T14:35:30.814 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.1 MB/s) 2024-03-09T14:35:30.818 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-03-09T14:35:30.835 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 300 kB/s) 2024-03-09T14:35:30.837 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-03-09T14:35:30.854 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.8 MB/s) 2024-03-09T14:35:30.858 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-03-09T14:35:30.875 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 319 kB/s) 2024-03-09T14:35:30.878 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-03-09T14:35:30.897 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/85 kB Progress (1): 32/85 kB Progress (1): 49/85 kB Progress (1): 65/85 kB Progress (1): 81/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.7 MB/s) 2024-03-09T14:35:30.897 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-03-09T14:35:30.897 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-03-09T14:35:30.897 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-03-09T14:35:30.897 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-03-09T14:35:30.898 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-03-09T14:35:30.916 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/55 kB Progress (2): 2.5 kB | 33/55 kB Progress (3): 2.5 kB | 33/55 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 139 kB/s) 2024-03-09T14:35:30.916 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-03-09T14:35:30.916 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 49/55 kB | 16/269 kB Progress (3): 49/55 kB | 16/269 kB | 16/41 kB Progress (3): 49/55 kB | 32/269 kB | 16/41 kB Progress (3): 55 kB | 32/269 kB | 16/41 kB Progress (3): 55 kB | 49/269 kB | 16/41 kB Progress (3): 55 kB | 65/269 kB | 16/41 kB Progress (3): 55 kB | 65/269 kB | 32/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.9 MB/s) 2024-03-09T14:35:30.916 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-03-09T14:35:30.916 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 65/269 kB | 41 kB Progress (2): 81/269 kB | 41 kB Progress (3): 81/269 kB | 41 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.3 MB/s) 2024-03-09T14:35:30.917 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 98/269 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 471 kB/s) 2024-03-09T14:35:30.918 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 114/269 kB Progress (1): 130/269 kB Progress (1): 147/269 kB Progress (1): 163/269 kB Progress (1): 180/269 kB Progress (1): 196/269 kB Progress (1): 212/269 kB Progress (1): 229/269 kB Progress (1): 245/269 kB Progress (1): 262/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-03-09T14:35:30.941 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/327 kB Progress (1): 32/327 kB Progress (2): 32/327 kB | 16/587 kB Progress (2): 49/327 kB | 16/587 kB Progress (2): 49/327 kB | 33/587 kB Progress (2): 49/327 kB | 49/587 kB Progress (2): 65/327 kB | 49/587 kB Progress (2): 65/327 kB | 66/587 kB Progress (2): 81/327 kB | 66/587 kB Progress (2): 81/327 kB | 82/587 kB Progress (2): 98/327 kB | 82/587 kB Progress (2): 98/327 kB | 98/587 kB Progress (2): 98/327 kB | 115/587 kB Progress (2): 114/327 kB | 115/587 kB Progress (2): 130/327 kB | 115/587 kB Progress (2): 130/327 kB | 131/587 kB Progress (2): 130/327 kB | 147/587 kB Progress (2): 147/327 kB | 147/587 kB Progress (2): 147/327 kB | 164/587 kB Progress (2): 163/327 kB | 164/587 kB Progress (2): 163/327 kB | 180/587 kB Progress (2): 163/327 kB | 197/587 kB Progress (2): 180/327 kB | 197/587 kB Progress (2): 180/327 kB | 213/587 kB Progress (2): 180/327 kB | 229/587 kB Progress (2): 196/327 kB | 229/587 kB Progress (2): 196/327 kB | 246/587 kB Progress (2): 212/327 kB | 246/587 kB Progress (2): 212/327 kB | 262/587 kB Progress (2): 212/327 kB | 279/587 kB Progress (2): 229/327 kB | 279/587 kB Progress (2): 229/327 kB | 295/587 kB Progress (2): 245/327 kB | 295/587 kB Progress (2): 245/327 kB | 311/587 kB Progress (2): 245/327 kB | 328/587 kB Progress (2): 262/327 kB | 328/587 kB Progress (2): 262/327 kB | 344/587 kB Progress (2): 278/327 kB | 344/587 kB Progress (2): 278/327 kB | 360/587 kB Progress (2): 278/327 kB | 377/587 kB Progress (2): 294/327 kB | 377/587 kB Progress (2): 294/327 kB | 393/587 kB Progress (2): 311/327 kB | 393/587 kB Progress (2): 311/327 kB | 410/587 kB Progress (2): 311/327 kB | 426/587 kB Progress (2): 327/327 kB | 426/587 kB Progress (2): 327 kB | 426/587 kB Progress (2): 327 kB | 442/587 kB Progress (2): 327 kB | 459/587 kB Progress (2): 327 kB | 475/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 7.6 MB/s) 2024-03-09T14:35:30.943 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 492/587 kB Progress (1): 508/587 kB Progress (1): 524/587 kB Progress (1): 541/587 kB Progress (1): 557/587 kB Progress (1): 573/587 kB Progress (1): 585/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 13 MB/s) 2024-03-09T14:35:30.972 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-03-09T14:35:30.972 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:35:30.972 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-03-09T14:35:30.976 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-03-09T14:35:30.994 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 279 kB/s) 2024-03-09T14:35:30.995 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-03-09T14:35:31.012 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 374 kB/s) 2024-03-09T14:35:31.014 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-03-09T14:35:31.031 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 1.9 MB/s) 2024-03-09T14:35:31.033 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-03-09T14:35:31.051 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 822 kB/s) 2024-03-09T14:35:31.053 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-03-09T14:35:31.071 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 48 kB/s) 2024-03-09T14:35:31.072 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-03-09T14:35:31.090 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 249 kB/s) 2024-03-09T14:35:31.093 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-03-09T14:35:31.109 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.0 MB/s) 2024-03-09T14:35:31.112 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-03-09T14:35:31.129 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 292 kB/s) 2024-03-09T14:35:31.131 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-03-09T14:35:31.148 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 244 kB/s) 2024-03-09T14:35:31.151 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-03-09T14:35:31.168 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 139 kB/s) 2024-03-09T14:35:31.169 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-03-09T14:35:31.187 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 627 kB/s) 2024-03-09T14:35:31.189 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-03-09T14:35:31.207 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 958 kB/s) 2024-03-09T14:35:31.209 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-03-09T14:35:31.227 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 365 kB/s) 2024-03-09T14:35:31.229 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-03-09T14:35:31.246 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 62 kB/s) 2024-03-09T14:35:31.248 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-03-09T14:35:31.265 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 493 kB/s) 2024-03-09T14:35:31.267 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-03-09T14:35:31.284 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 149 kB/s) 2024-03-09T14:35:31.286 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-03-09T14:35:31.303 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 331 kB/s) 2024-03-09T14:35:31.305 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-03-09T14:35:31.323 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 67 kB/s) 2024-03-09T14:35:31.325 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-03-09T14:35:31.343 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 45 kB/s) 2024-03-09T14:35:31.344 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-03-09T14:35:31.361 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 355 kB/s) 2024-03-09T14:35:31.362 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-03-09T14:35:31.380 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.5 MB/s) 2024-03-09T14:35:31.382 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-03-09T14:35:31.399 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 71 kB/s) 2024-03-09T14:35:31.401 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-03-09T14:35:31.418 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 78 kB/s) 2024-03-09T14:35:31.423 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-03-09T14:35:31.441 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 796 kB/s) 2024-03-09T14:35:31.441 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-03-09T14:35:31.441 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-03-09T14:35:31.441 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-03-09T14:35:31.441 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-03-09T14:35:31.441 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-03-09T14:35:31.457 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 248 kB/s) 2024-03-09T14:35:31.458 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-03-09T14:35:31.465 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Progress (2): 27 kB | 16/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.5 MB/s) 2024-03-09T14:35:31.466 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-03-09T14:35:31.466 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 16/55 kB | 16/122 kB Progress (2): 32/55 kB | 16/122 kB Progress (2): 32/55 kB | 32/122 kB Progress (2): 49/55 kB | 32/122 kB Progress (2): 49/55 kB | 49/122 kB Progress (2): 55 kB | 49/122 kB Progress (3): 55 kB | 49/122 kB | 16/334 kB Progress (3): 55 kB | 65/122 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 2.9 MB/s) 2024-03-09T14:35:31.466 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 81/122 kB | 16/334 kB Progress (2): 81/122 kB | 33/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-03-09T14:35:31.466 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 98/122 kB | 33/334 kB Progress (2): 98/122 kB | 49/334 kB Progress (2): 114/122 kB | 49/334 kB Progress (2): 122 kB | 49/334 kB Progress (2): 122 kB | 66/334 kB Progress (2): 122 kB | 82/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.1 MB/s) 2024-03-09T14:35:31.466 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 98/334 kB Progress (1): 115/334 kB Progress (1): 131/334 kB Progress (1): 147/334 kB Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (1): 197/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 246/334 kB Progress (1): 256/334 kB Progress (1): 272/334 kB Progress (1): 289/334 kB Progress (1): 305/334 kB Progress (1): 321/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 14 MB/s) 2024-03-09T14:35:31.475 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.7 kB Progress (2): 4.7 kB | 16/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 137 kB/s) 2024-03-09T14:35:31.477 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 32/267 kB Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (2): 130/267 kB | 16/23 kB Progress (2): 130/267 kB | 23 kB Progress (2): 147/267 kB | 23 kB Progress (2): 163/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 651 kB/s) 2024-03-09T14:35:31.478 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 229/267 kB Progress (1): 245/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.2 MB/s) 2024-03-09T14:35:31.525 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Changes detected - recompiling the module! :source 2024-03-09T14:35:31.526 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-03-09T14:35:32.231 INFO:tasks.workunit.client.0.smithi088.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-03-09T14:35:32.231 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:35:32.232 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-03-09T14:35:32.235 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-03-09T14:35:32.236 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:35:32.236 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-03-09T14:35:32.242 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-03-09T14:35:32.242 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-03-09T14:35:32.435 INFO:tasks.workunit.client.0.smithi088.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-03-09T14:35:32.435 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:35:32.435 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-03-09T14:35:32.439 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-03-09T14:35:32.456 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 347 kB/s) 2024-03-09T14:35:32.460 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-03-09T14:35:32.477 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 196 kB/s) 2024-03-09T14:35:32.480 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-03-09T14:35:32.498 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 181 kB/s) 2024-03-09T14:35:32.501 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-03-09T14:35:32.519 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 239 kB/s) 2024-03-09T14:35:32.522 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-03-09T14:35:32.539 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 194 kB/s) 2024-03-09T14:35:32.543 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-03-09T14:35:32.560 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 262 kB/s) 2024-03-09T14:35:32.564 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-03-09T14:35:32.581 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 98 kB/s) 2024-03-09T14:35:32.584 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-03-09T14:35:32.601 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 129 kB/s) 2024-03-09T14:35:32.605 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-03-09T14:35:32.621 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.7 MB/s) 2024-03-09T14:35:32.623 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-03-09T14:35:32.642 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 112 kB/s) 2024-03-09T14:35:32.644 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-03-09T14:35:32.661 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 341 kB/s) 2024-03-09T14:35:32.664 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-03-09T14:35:32.681 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 130 kB/s) 2024-03-09T14:35:32.682 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-03-09T14:35:32.700 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.2 MB/s) 2024-03-09T14:35:32.702 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-03-09T14:35:32.720 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.1 MB/s) 2024-03-09T14:35:32.722 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-03-09T14:35:32.741 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 802 kB/s) 2024-03-09T14:35:32.744 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-03-09T14:35:32.761 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 509 kB/s) 2024-03-09T14:35:32.763 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-03-09T14:35:32.781 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.5 MB/s) 2024-03-09T14:35:32.784 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-03-09T14:35:32.803 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 448 kB/s) 2024-03-09T14:35:32.806 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-03-09T14:35:32.823 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 128 kB/s) 2024-03-09T14:35:32.826 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-03-09T14:35:32.843 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 153 kB/s) 2024-03-09T14:35:32.845 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-03-09T14:35:32.863 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 91 kB/s) 2024-03-09T14:35:32.864 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-03-09T14:35:32.881 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 192 kB/s) 2024-03-09T14:35:32.882 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-03-09T14:35:32.900 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.1 MB/s) 2024-03-09T14:35:32.902 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-03-09T14:35:32.919 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 398 kB/s) 2024-03-09T14:35:32.921 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-03-09T14:35:32.938 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 753 kB/s) 2024-03-09T14:35:32.941 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-03-09T14:35:32.958 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 164 kB/s) 2024-03-09T14:35:32.959 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-03-09T14:35:32.977 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 378 kB/s) 2024-03-09T14:35:32.978 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-03-09T14:35:32.996 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 466 kB/s) 2024-03-09T14:35:32.998 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-03-09T14:35:33.015 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 121 kB/s) 2024-03-09T14:35:33.017 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-03-09T14:35:33.035 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 131 kB/s) 2024-03-09T14:35:33.038 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-03-09T14:35:33.055 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 178 kB/s) 2024-03-09T14:35:33.058 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-03-09T14:35:33.076 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 831 kB/s) 2024-03-09T14:35:33.078 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-03-09T14:35:33.095 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 853 kB/s) 2024-03-09T14:35:33.098 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-03-09T14:35:33.115 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 790 kB/s) 2024-03-09T14:35:33.117 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-03-09T14:35:33.134 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 282 kB/s) 2024-03-09T14:35:33.136 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-03-09T14:35:33.153 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 392 kB/s) 2024-03-09T14:35:33.154 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-03-09T14:35:33.172 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/32 kB Progress (1): 32/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.8 MB/s) 2024-03-09T14:35:33.175 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-03-09T14:35:33.195 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 867 kB/s) 2024-03-09T14:35:33.196 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-03-09T14:35:33.214 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 822 kB/s) 2024-03-09T14:35:33.217 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-03-09T14:35:33.233 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 47 kB/s) 2024-03-09T14:35:33.234 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-03-09T14:35:33.250 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 300 kB/s) 2024-03-09T14:35:33.252 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-03-09T14:35:33.269 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 465 kB/s) 2024-03-09T14:35:33.272 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-03-09T14:35:33.289 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 176 kB/s) 2024-03-09T14:35:33.291 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-03-09T14:35:33.307 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 266 kB/s) 2024-03-09T14:35:33.310 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-03-09T14:35:33.327 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 121 kB/s) 2024-03-09T14:35:33.330 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-03-09T14:35:33.348 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 193 kB/s) 2024-03-09T14:35:33.350 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-03-09T14:35:33.368 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 608 kB/s) 2024-03-09T14:35:33.370 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-03-09T14:35:33.387 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 748 kB/s) 2024-03-09T14:35:33.389 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-03-09T14:35:33.428 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 481 kB/s) 2024-03-09T14:35:33.430 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-03-09T14:35:33.448 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 21 kB/s) 2024-03-09T14:35:33.449 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-03-09T14:35:33.466 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 359 kB/s) 2024-03-09T14:35:33.467 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-03-09T14:35:33.484 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 432 kB/s) 2024-03-09T14:35:33.485 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-03-09T14:35:33.502 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 284 kB/s) 2024-03-09T14:35:33.505 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-03-09T14:35:33.521 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 430 kB/s) 2024-03-09T14:35:33.523 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-03-09T14:35:33.540 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.3 MB/s) 2024-03-09T14:35:33.542 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-03-09T14:35:33.561 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.1 MB/s) 2024-03-09T14:35:33.564 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-03-09T14:35:33.581 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.4 MB/s) 2024-03-09T14:35:33.584 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-03-09T14:35:33.601 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 332 kB/s) 2024-03-09T14:35:33.603 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-03-09T14:35:33.621 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 237 kB/s) 2024-03-09T14:35:33.622 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-03-09T14:35:33.639 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 188 kB/s) 2024-03-09T14:35:33.641 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-03-09T14:35:33.658 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.5 MB/s) 2024-03-09T14:35:33.660 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-03-09T14:35:33.679 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 132 kB/s) 2024-03-09T14:35:33.683 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-03-09T14:35:33.707 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/308 kB Progress (1): 32/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 81/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 130/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 212/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 14 MB/s) 2024-03-09T14:35:33.707 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-03-09T14:35:33.707 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-03-09T14:35:33.708 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-03-09T14:35:33.708 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-03-09T14:35:33.708 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-03-09T14:35:33.729 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 14 kB Progress (2): 14 kB | 16/26 kB Progress (2): 14 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 755 kB/s) 2024-03-09T14:35:33.729 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-03-09T14:35:33.730 INFO:tasks.workunit.client.0.smithi088.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.5 MB/s) 2024-03-09T14:35:33.730 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-03-09T14:35:33.730 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 454 kB/s) 2024-03-09T14:35:33.730 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/171 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-03-09T14:35:33.730 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (2): 49/171 kB | 16/118 kB Progress (2): 49/171 kB | 33/118 kB Progress (2): 66/171 kB | 33/118 kB Progress (2): 66/171 kB | 49/118 kB Progress (2): 82/171 kB | 49/118 kB Progress (2): 98/171 kB | 49/118 kB Progress (2): 115/171 kB | 49/118 kB Progress (2): 131/171 kB | 49/118 kB Progress (2): 147/171 kB | 49/118 kB Progress (2): 164/171 kB | 49/118 kB Progress (2): 164/171 kB | 66/118 kB Progress (2): 171 kB | 66/118 kB Progress (2): 171 kB | 82/118 kB Progress (2): 171 kB | 98/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 7.4 MB/s) 2024-03-09T14:35:33.730 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-03-09T14:35:33.730 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 115/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.3 MB/s) 2024-03-09T14:35:33.731 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-03-09T14:35:33.751 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/136 kB Progress (1): 33/136 kB Progress (1): 49/136 kB Progress (2): 49/136 kB | 16/146 kB Progress (2): 49/136 kB | 33/146 kB Progress (2): 66/136 kB | 33/146 kB Progress (2): 82/136 kB | 33/146 kB Progress (2): 82/136 kB | 49/146 kB Progress (2): 98/136 kB | 49/146 kB Progress (2): 98/136 kB | 66/146 kB Progress (2): 115/136 kB | 66/146 kB Progress (2): 115/136 kB | 82/146 kB Progress (2): 115/136 kB | 98/146 kB Progress (2): 131/136 kB | 98/146 kB Progress (2): 136 kB | 98/146 kB Progress (2): 136 kB | 115/146 kB Progress (3): 136 kB | 115/146 kB | 16/61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.7 MB/s) 2024-03-09T14:35:33.751 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-03-09T14:35:33.751 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 115/146 kB | 33/61 kB Progress (2): 131/146 kB | 33/61 kB Progress (2): 131/146 kB | 49/61 kB Progress (2): 146 kB | 49/61 kB Progress (2): 146 kB | 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.8 MB/s) 2024-03-09T14:35:33.751 INFO:tasks.workunit.client.0.smithi088.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.6 MB/s) 2024-03-09T14:35:33.751 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-03-09T14:35:33.751 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/58 kB Progress (1): 33/58 kB Progress (1): 49/58 kB Progress (2): 49/58 kB | 16/501 kB Progress (2): 58 kB | 16/501 kB Progress (2): 58 kB | 33/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.4 MB/s) 2024-03-09T14:35:33.753 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 49/501 kB Progress (1): 66/501 kB Progress (1): 82/501 kB Progress (1): 98/501 kB Progress (1): 115/501 kB Progress (1): 131/501 kB Progress (1): 147/501 kB Progress (1): 164/501 kB Progress (1): 180/501 kB Progress (1): 197/501 kB Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 256/501 kB Progress (1): 272/501 kB Progress (1): 289/501 kB Progress (1): 305/501 kB Progress (1): 321/501 kB Progress (1): 338/501 kB Progress (1): 354/501 kB Progress (1): 370/501 kB Progress (1): 387/501 kB Progress (1): 403/501 kB Progress (1): 420/501 kB Progress (1): 436/501 kB Progress (1): 452/501 kB Progress (1): 469/501 kB Progress (1): 485/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 11 MB/s) 2024-03-09T14:35:33.763 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.2 MB/s) 2024-03-09T14:35:33.798 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 26 MB/s) 2024-03-09T14:35:33.871 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:35:33.871 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-03-09T14:35:33.874 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-03-09T14:35:33.893 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 249 kB/s) 2024-03-09T14:35:33.895 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-03-09T14:35:33.912 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 288 kB/s) 2024-03-09T14:35:33.913 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-03-09T14:35:33.931 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.5 MB/s) 2024-03-09T14:35:33.933 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-03-09T14:35:33.955 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 934 kB/s) 2024-03-09T14:35:33.958 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-03-09T14:35:33.976 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 288 kB/s) 2024-03-09T14:35:33.978 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-03-09T14:35:33.995 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 218 kB/s) 2024-03-09T14:35:33.997 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-03-09T14:35:34.015 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 354 kB/s) 2024-03-09T14:35:34.018 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-03-09T14:35:34.036 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 368 kB/s) 2024-03-09T14:35:34.038 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-03-09T14:35:34.056 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.1 MB/s) 2024-03-09T14:35:34.060 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-03-09T14:35:34.078 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 808 kB/s) 2024-03-09T14:35:34.081 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-03-09T14:35:34.098 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 114 kB/s) 2024-03-09T14:35:34.100 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-03-09T14:35:34.118 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 456 kB/s) 2024-03-09T14:35:34.120 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-03-09T14:35:34.139 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.4 MB/s) 2024-03-09T14:35:34.146 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-03-09T14:35:34.164 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 1.9 MB/s) 2024-03-09T14:35:34.165 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-03-09T14:35:34.165 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-03-09T14:35:34.166 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-03-09T14:35:34.166 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-03-09T14:35:34.166 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-03-09T14:35:34.184 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 16/26 kB Progress (2): 16/79 kB | 26 kB Progress (2): 33/79 kB | 26 kB Progress (2): 49/79 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-03-09T14:35:34.184 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 66/79 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-03-09T14:35:34.184 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 66/79 kB | 16/58 kB Progress (2): 79 kB | 16/58 kB Progress (2): 79 kB | 33/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.4 MB/s) 2024-03-09T14:35:34.184 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-03-09T14:35:34.188 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 33/58 kB | 16/211 kB Progress (2): 49/58 kB | 16/211 kB Progress (2): 49/58 kB | 32/211 kB Progress (2): 58 kB | 32/211 kB Progress (2): 58 kB | 49/211 kB Progress (2): 58 kB | 65/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.1 MB/s) 2024-03-09T14:35:34.188 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 81/211 kB Progress (1): 98/211 kB Progress (2): 98/211 kB | 0/1.0 MB Progress (2): 114/211 kB | 0/1.0 MB Progress (2): 114/211 kB | 0/1.0 MB Progress (2): 130/211 kB | 0/1.0 MB Progress (2): 130/211 kB | 0/1.0 MB Progress (2): 147/211 kB | 0/1.0 MB Progress (2): 147/211 kB | 0.1/1.0 MB Progress (2): 163/211 kB | 0.1/1.0 MB Progress (2): 163/211 kB | 0.1/1.0 MB Progress (2): 180/211 kB | 0.1/1.0 MB Progress (2): 180/211 kB | 0.1/1.0 MB Progress (2): 196/211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 9.6 MB/s) 2024-03-09T14:35:34.200 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 30 MB/s) 2024-03-09T14:35:34.202 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/116 kB Progress (1): 33/116 kB Progress (1): 49/116 kB Progress (1): 66/116 kB Progress (1): 82/116 kB Progress (2): 82/116 kB | 16/267 kB Progress (2): 98/116 kB | 16/267 kB Progress (2): 98/116 kB | 33/267 kB Progress (2): 115/116 kB | 33/267 kB Progress (2): 116 kB | 33/267 kB Progress (2): 116 kB | 49/267 kB Progress (2): 116 kB | 66/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.2 MB/s) 2024-03-09T14:35:34.204 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 256/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 6.9 MB/s) 2024-03-09T14:35:34.333 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-03-09T14:35:34.357 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:35:34.357 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] BUILD SUCCESS 2024-03-09T14:35:34.357 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:35:34.357 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Total time: 6.628 s 2024-03-09T14:35:34.358 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Finished at: 2024-03-09T14:35:34Z 2024-03-09T14:35:34.358 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:35:34.382 INFO:tasks.workunit.client.0.smithi088.stderr:+ ./mvnw test -Dtest=PutObjects 2024-03-09T14:35:34.391 INFO:tasks.workunit.client.0.smithi088.stdout:Warning: JAVA_HOME environment variable is not set. 2024-03-09T14:35:35.398 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Scanning for projects... 2024-03-09T14:35:35.474 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:35:35.474 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-03-09T14:35:35.474 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Building jcksum 1.0 2024-03-09T14:35:35.474 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] from pom.xml 2024-03-09T14:35:35.474 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-03-09T14:35:35.712 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:35:35.712 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-03-09T14:35:35.799 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-03-09T14:35:35.800 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:35:35.800 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-03-09T14:35:35.888 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Nothing to compile - all classes are up to date 2024-03-09T14:35:35.888 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:35:35.888 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-03-09T14:35:35.890 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-03-09T14:35:35.890 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:35:35.890 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-03-09T14:35:35.895 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Nothing to compile - all classes are up to date 2024-03-09T14:35:35.895 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:35:35.895 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-03-09T14:35:36.060 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-03-09T14:35:36.253 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-03-09T14:35:36.458 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-03-09T14:35:36.466 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-03-09T14:35:36.487 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 131 kB/s) 2024-03-09T14:35:36.492 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-03-09T14:35:36.512 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 148 kB/s) 2024-03-09T14:35:36.516 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-03-09T14:35:36.535 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 159 kB/s) 2024-03-09T14:35:36.538 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-03-09T14:35:36.557 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 169 kB/s) 2024-03-09T14:35:36.560 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-03-09T14:35:36.578 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 89 kB/s) 2024-03-09T14:35:36.580 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-03-09T14:35:36.599 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 157 kB/s) 2024-03-09T14:35:36.604 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-03-09T14:35:36.631 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.0 MB/s) 2024-03-09T14:35:36.633 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-03-09T14:35:36.633 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-03-09T14:35:36.633 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-03-09T14:35:36.634 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-03-09T14:35:36.634 INFO:tasks.workunit.client.0.smithi088.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-03-09T14:35:36.657 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 675 kB/s) 2024-03-09T14:35:36.699 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/189 kB Progress (2): 2.8/7.7 kB | 1.4/189 kB Progress (3): 2.8/7.7 kB | 1.4/189 kB | 1.4/103 kB Progress (4): 2.8/7.7 kB | 1.4/189 kB | 1.4/103 kB | 16/169 kB Progress (4): 2.8/7.7 kB | 2.8/189 kB | 1.4/103 kB | 16/169 kB Progress (4): 2.8/7.7 kB | 2.8/189 kB | 2.8/103 kB | 16/169 kB Progress (4): 4.1/7.7 kB | 2.8/189 kB | 2.8/103 kB | 16/169 kB Progress (4): 4.1/7.7 kB | 4.1/189 kB | 2.8/103 kB | 16/169 kB Progress (4): 5.5/7.7 kB | 4.1/189 kB | 2.8/103 kB | 16/169 kB Progress (4): 5.5/7.7 kB | 4.1/189 kB | 4.1/103 kB | 16/169 kB Progress (4): 6.9/7.7 kB | 4.1/189 kB | 4.1/103 kB | 16/169 kB Progress (4): 6.9/7.7 kB | 5.5/189 kB | 4.1/103 kB | 16/169 kB Progress (4): 7.7 kB | 5.5/189 kB | 4.1/103 kB | 16/169 kB Progress (4): 7.7 kB | 5.5/189 kB | 5.5/103 kB | 16/169 kB Progress (4): 7.7 kB | 6.9/189 kB | 5.5/103 kB | 16/169 kB Progress (4): 7.7 kB | 6.9/189 kB | 6.9/103 kB | 16/169 kB Progress (4): 7.7 kB | 8.3/189 kB | 6.9/103 kB | 16/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 118 kB/s) 2024-03-09T14:35:36.729 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (3): 8.3/189 kB | 8.3/103 kB | 16/169 kB Progress (3): 9.7/189 kB | 8.3/103 kB | 16/169 kB Progress (3): 9.7/189 kB | 9.7/103 kB | 16/169 kB Progress (3): 11/189 kB | 9.7/103 kB | 16/169 kB Progress (3): 11/189 kB | 11/103 kB | 16/169 kB Progress (3): 12/189 kB | 11/103 kB | 16/169 kB Progress (3): 12/189 kB | 12/103 kB | 16/169 kB Progress (3): 14/189 kB | 12/103 kB | 16/169 kB Progress (3): 14/189 kB | 14/103 kB | 16/169 kB Progress (3): 15/189 kB | 14/103 kB | 16/169 kB Progress (3): 15/189 kB | 15/103 kB | 16/169 kB Progress (3): 17/189 kB | 15/103 kB | 16/169 kB Progress (3): 17/189 kB | 17/103 kB | 16/169 kB Progress (3): 18/189 kB | 17/103 kB | 16/169 kB Progress (3): 18/189 kB | 18/103 kB | 16/169 kB Progress (3): 19/189 kB | 18/103 kB | 16/169 kB Progress (3): 19/189 kB | 19/103 kB | 16/169 kB Progress (3): 21/189 kB | 19/103 kB | 16/169 kB Progress (3): 21/189 kB | 21/103 kB | 16/169 kB Progress (3): 22/189 kB | 21/103 kB | 16/169 kB Progress (3): 22/189 kB | 22/103 kB | 16/169 kB Progress (3): 23/189 kB | 22/103 kB | 16/169 kB Progress (3): 23/189 kB | 23/103 kB | 16/169 kB Progress (3): 25/189 kB | 23/103 kB | 16/169 kB Progress (3): 25/189 kB | 25/103 kB | 16/169 kB Progress (3): 26/189 kB | 25/103 kB | 16/169 kB Progress (3): 26/189 kB | 26/103 kB | 16/169 kB Progress (3): 28/189 kB | 26/103 kB | 16/169 kB Progress (3): 28/189 kB | 28/103 kB | 16/169 kB Progress (3): 29/189 kB | 28/103 kB | 16/169 kB Progress (3): 29/189 kB | 29/103 kB | 16/169 kB Progress (3): 30/189 kB | 29/103 kB | 16/169 kB Progress (3): 30/189 kB | 30/103 kB | 16/169 kB Progress (3): 32/189 kB | 30/103 kB | 16/169 kB Progress (3): 32/189 kB | 32/103 kB | 16/169 kB Progress (3): 33/189 kB | 32/103 kB | 16/169 kB Progress (3): 33/189 kB | 33/103 kB | 16/169 kB Progress (3): 34/189 kB | 33/103 kB | 16/169 kB Progress (3): 34/189 kB | 33/103 kB | 33/169 kB Progress (3): 34/189 kB | 34/103 kB | 33/169 kB Progress (3): 36/189 kB | 34/103 kB | 33/169 kB Progress (3): 36/189 kB | 36/103 kB | 33/169 kB Progress (3): 37/189 kB | 36/103 kB | 33/169 kB Progress (3): 37/189 kB | 37/103 kB | 33/169 kB Progress (3): 39/189 kB | 37/103 kB | 33/169 kB Progress (3): 39/189 kB | 37/103 kB | 49/169 kB Progress (3): 40/189 kB | 37/103 kB | 49/169 kB Progress (3): 40/189 kB | 39/103 kB | 49/169 kB Progress (3): 41/189 kB | 39/103 kB | 49/169 kB Progress (3): 41/189 kB | 40/103 kB | 49/169 kB Progress (3): 43/189 kB | 40/103 kB | 49/169 kB Progress (3): 43/189 kB | 41/103 kB | 49/169 kB Progress (3): 44/189 kB | 41/103 kB | 49/169 kB Progress (3): 44/189 kB | 43/103 kB | 49/169 kB Progress (3): 46/189 kB | 43/103 kB | 49/169 kB Progress (3): 46/189 kB | 44/103 kB | 49/169 kB Progress (3): 47/189 kB | 44/103 kB | 49/169 kB Progress (3): 47/189 kB | 46/103 kB | 49/169 kB Progress (3): 48/189 kB | 46/103 kB | 49/169 kB Progress (3): 48/189 kB | 47/103 kB | 49/169 kB Progress (3): 50/189 kB | 47/103 kB | 49/169 kB Progress (3): 50/189 kB | 48/103 kB | 49/169 kB Progress (3): 51/189 kB | 48/103 kB | 49/169 kB Progress (3): 51/189 kB | 50/103 kB | 49/169 kB Progress (3): 52/189 kB | 50/103 kB | 49/169 kB Progress (3): 52/189 kB | 51/103 kB | 49/169 kB Progress (3): 54/189 kB | 51/103 kB | 49/169 kB Progress (3): 54/189 kB | 52/103 kB | 49/169 kB Progress (3): 55/189 kB | 52/103 kB | 49/169 kB Progress (3): 55/189 kB | 54/103 kB | 49/169 kB Progress (3): 57/189 kB | 54/103 kB | 49/169 kB Progress (3): 57/189 kB | 55/103 kB | 49/169 kB Progress (3): 58/189 kB | 55/103 kB | 49/169 kB Progress (3): 58/189 kB | 57/103 kB | 49/169 kB Progress (3): 59/189 kB | 57/103 kB | 49/169 kB Progress (3): 59/189 kB | 58/103 kB | 49/169 kB Progress (3): 61/189 kB | 58/103 kB | 49/169 kB Progress (3): 61/189 kB | 59/103 kB | 49/169 kB Progress (3): 61/189 kB | 61/103 kB | 49/169 kB Progress (3): 61/189 kB | 62/103 kB | 49/169 kB Progress (3): 61/189 kB | 63/103 kB | 49/169 kB Progress (3): 61/189 kB | 64/103 kB | 49/169 kB Progress (3): 62/189 kB | 64/103 kB | 49/169 kB Progress (3): 62/189 kB | 64/103 kB | 66/169 kB Progress (3): 62/189 kB | 80/103 kB | 66/169 kB Progress (3): 78/189 kB | 80/103 kB | 66/169 kB Progress (3): 78/189 kB | 80/103 kB | 82/169 kB Progress (3): 78/189 kB | 96/103 kB | 82/169 kB Progress (3): 78/189 kB | 96/103 kB | 98/169 kB Progress (3): 78/189 kB | 103 kB | 98/169 kB Progress (3): 95/189 kB | 103 kB | 98/169 kB Progress (3): 95/189 kB | 103 kB | 115/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.1 MB/s) 2024-03-09T14:35:36.739 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (2): 95/189 kB | 131/169 kB Progress (2): 111/189 kB | 131/169 kB Progress (2): 111/189 kB | 147/169 kB Progress (2): 127/189 kB | 147/169 kB Progress (2): 144/189 kB | 147/169 kB Progress (2): 160/189 kB | 147/169 kB Progress (2): 160/189 kB | 164/169 kB Progress (2): 160/189 kB | 169 kB Progress (2): 176/189 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.6 MB/s) 2024-03-09T14:35:36.740 INFO:tasks.workunit.client.0.smithi088.stdout:Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.8 MB/s) 2024-03-09T14:35:36.754 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:35:36.754 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] ------------------------------------------------------- 2024-03-09T14:35:36.754 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] T E S T S 2024-03-09T14:35:36.754 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] ------------------------------------------------------- 2024-03-09T14:35:37.205 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-03-09T14:35:37.332 INFO:tasks.workunit.client.0.smithi088.stdout:PutObjects.java: starting test run: 2024-03-09T14:35:37.332 INFO:tasks.workunit.client.0.smithi088.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-03-09T14:35:37.332 INFO:tasks.workunit.client.0.smithi088.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-03-09T14:35:37.332 INFO:tasks.workunit.client.0.smithi088.stdout: EndpointUrl=http://smithi088.front.sepia.ceph.com:80 2024-03-09T14:35:37.333 INFO:tasks.workunit.client.0.smithi088.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-03-09T14:35:37.429 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: Environment Variables Read 2024-03-09T14:35:37.732 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: S3 Client Initialized 2024-03-09T14:35:37.732 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: Generating File 2024-03-09T14:35:37.732 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: File Generated 2024-03-09T14:35:37.732 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: Generating File 2024-03-09T14:35:37.732 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: File Generated 2024-03-09T14:35:37.732 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: Generating File 2024-03-09T14:35:37.732 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: File Generated 2024-03-09T14:35:37.733 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: Generating File 2024-03-09T14:35:37.733 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: File Generated 2024-03-09T14:35:37.733 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: Generating File 2024-03-09T14:35:37.733 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: File Generated 2024-03-09T14:35:37.733 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: Generating File 2024-03-09T14:35:37.733 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: File Generated 2024-03-09T14:35:37.733 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: Generated Big Files 2024-03-09T14:35:38.034 INFO:tasks.workunit.client.0.smithi088.stdout:HeadBucketResponse() 2024-03-09T14:35:38.034 INFO:tasks.workunit.client.0.smithi088.stdout:sheik is ready 2024-03-09T14:35:38.035 INFO:tasks.workunit.client.0.smithi088.stdout:DEBUG: Test Bucket Created 2024-03-09T14:35:38.134 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileNoCksum called with file-0b 2024-03-09T14:35:38.334 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileNoCksum called with file-8b 2024-03-09T14:35:38.435 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileNoCksum called with file-200b 2024-03-09T14:35:38.535 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileNoCksum called with file-21983b 2024-03-09T14:35:38.635 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileNoCksum called with file-5519b 2024-03-09T14:35:38.835 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileNoCksum called with file-204329b 2024-03-09T14:35:39.036 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileNoCksum called with file-256k 2024-03-09T14:35:39.236 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileNoCksum called with file-1m 2024-03-09T14:35:39.536 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-03-09T14:35:39.736 INFO:tasks.workunit.client.0.smithi088.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-03-09T14:35:42.941 INFO:tasks.workunit.client.0.smithi088.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-03-09T14:35:45.145 INFO:tasks.workunit.client.0.smithi088.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-03-09T14:36:06.833 INFO:tasks.workunit.client.0.smithi088.stdout:arg: file-0b 2024-03-09T14:36:06.834 INFO:tasks.workunit.client.0.smithi088.stdout:arg: file-8b 2024-03-09T14:36:06.834 INFO:tasks.workunit.client.0.smithi088.stdout:arg: file-200b 2024-03-09T14:36:06.835 INFO:tasks.workunit.client.0.smithi088.stdout:arg: file-21983b 2024-03-09T14:36:06.836 INFO:tasks.workunit.client.0.smithi088.stdout:arg: file-5519b 2024-03-09T14:36:06.837 INFO:tasks.workunit.client.0.smithi088.stdout:arg: file-204329b 2024-03-09T14:36:06.838 INFO:tasks.workunit.client.0.smithi088.stdout:arg: file-256k 2024-03-09T14:36:06.839 INFO:tasks.workunit.client.0.smithi088.stdout:arg: file-1m 2024-03-09T14:36:06.840 INFO:tasks.workunit.client.0.smithi088.stdout:arg: file-1038757b 2024-03-09T14:36:06.873 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileCksum called with file-0b 2024-03-09T14:36:06.957 INFO:tasks.workunit.client.0.smithi088.stdout:PutObjectResponse 2024-03-09T14:36:06.973 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileCksum called with file-8b 2024-03-09T14:36:07.069 INFO:tasks.workunit.client.0.smithi088.stdout:PutObjectResponse 2024-03-09T14:36:07.073 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileCksum called with file-200b 2024-03-09T14:36:07.173 INFO:tasks.workunit.client.0.smithi088.stdout:PutObjectResponse 2024-03-09T14:36:07.274 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileCksum called with file-21983b 2024-03-09T14:36:07.274 INFO:tasks.workunit.client.0.smithi088.stdout:PutObjectResponse 2024-03-09T14:36:07.374 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileCksum called with file-5519b 2024-03-09T14:36:07.461 INFO:tasks.workunit.client.0.smithi088.stdout:PutObjectResponse 2024-03-09T14:36:07.473 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileCksum called with file-204329b 2024-03-09T14:36:07.574 INFO:tasks.workunit.client.0.smithi088.stdout:PutObjectResponse 2024-03-09T14:36:07.674 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileCksum called with file-256k 2024-03-09T14:36:07.769 INFO:tasks.workunit.client.0.smithi088.stdout:PutObjectResponse 2024-03-09T14:36:07.774 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileCksum called with file-1m 2024-03-09T14:36:07.974 INFO:tasks.workunit.client.0.smithi088.stdout:PutObjectResponse 2024-03-09T14:36:08.074 INFO:tasks.workunit.client.0.smithi088.stdout:putObjectFromFileCksum called with file-1038757b 2024-03-09T14:36:08.274 INFO:tasks.workunit.client.0.smithi088.stdout:PutObjectResponse 2024-03-09T14:36:08.375 INFO:tasks.workunit.client.0.smithi088.stdout:mpuObjectFromFileCksum called with file-5m 2024-03-09T14:36:09.777 INFO:tasks.workunit.client.0.smithi088.stdout:mpuObjectFromFileCksum called with file-10m 2024-03-09T14:36:11.979 INFO:tasks.workunit.client.0.smithi088.stdout:mpuObjectFromFileCksum called with file-100m 2024-03-09T14:36:33.576 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.37 s -- in io.ceph.jcksum.PutObjects 2024-03-09T14:36:33.587 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:36:33.587 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Results: 2024-03-09T14:36:33.587 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:36:33.587 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-03-09T14:36:33.587 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] 2024-03-09T14:36:33.588 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:36:33.588 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] BUILD SUCCESS 2024-03-09T14:36:33.588 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:36:33.590 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Total time: 58.210 s 2024-03-09T14:36:33.590 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] Finished at: 2024-03-09T14:36:33Z 2024-03-09T14:36:33.590 INFO:tasks.workunit.client.0.smithi088.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:36:33.603 INFO:tasks.workunit.client.0.smithi088.stderr:+ exit 2024-03-09T14:36:33.603 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:36:33.604 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:36:33.683 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-03-09T14:36:33.684 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-09T14:36:34.029 DEBUG:teuthology.parallel:result is None 2024-03-09T14:36:34.030 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:36:34.070 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:36:34.070 DEBUG:teuthology.orchestra.run.smithi088:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:36:34.137 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:36:34.138 INFO:teuthology.run_tasks:Running task workunit... 2024-03-09T14:36:34.147 INFO:tasks.workunit:Pulling workunits from ref c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:36:34.148 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-09T14:36:34.148 DEBUG:teuthology.orchestra.run.smithi088:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:36:34.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:36:34.206 INFO:teuthology.orchestra.run.smithi088.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-09T14:36:34.206 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:36:34.274 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-09T14:36:34.274 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-09T14:36:34.341 INFO:tasks.workunit:timeout=3h 2024-03-09T14:36:34.341 INFO:tasks.workunit:cleanup=True 2024-03-09T14:36:34.342 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:36:34.409 INFO:tasks.workunit.client.0.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-09T14:37:48.554 INFO:tasks.workunit.client.0.smithi088.stderr:Note: switching to 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'. 2024-03-09T14:37:48.555 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:37:48.555 INFO:tasks.workunit.client.0.smithi088.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-09T14:37:48.555 INFO:tasks.workunit.client.0.smithi088.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-09T14:37:48.555 INFO:tasks.workunit.client.0.smithi088.stderr:state without impacting any branches by switching back to a branch. 2024-03-09T14:37:48.555 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:37:48.555 INFO:tasks.workunit.client.0.smithi088.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-09T14:37:48.555 INFO:tasks.workunit.client.0.smithi088.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-09T14:37:48.555 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:37:48.556 INFO:tasks.workunit.client.0.smithi088.stderr: git switch -c 2024-03-09T14:37:48.556 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:37:48.556 INFO:tasks.workunit.client.0.smithi088.stderr:Or undo this operation with: 2024-03-09T14:37:48.556 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:37:48.556 INFO:tasks.workunit.client.0.smithi088.stderr: git switch - 2024-03-09T14:37:48.556 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:37:48.556 INFO:tasks.workunit.client.0.smithi088.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-09T14:37:48.556 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:37:48.556 INFO:tasks.workunit.client.0.smithi088.stderr:HEAD is now at c00d9c609fb DNM: point s3tests at branch cbodley:wip-iam-user-apis 2024-03-09T14:37:48.559 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-09T14:37:48.626 INFO:tasks.workunit.client.0.smithi088.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-09T14:37:48.628 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:37:48.628 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-09T14:37:48.829 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-09T14:37:48.947 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-09T14:37:48.986 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:37:48.987 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:37:48.987 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-09T14:37:49.026 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:37:49.029 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:37:49.029 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-09T14:37:49.098 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-03-09T14:37:49.100 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-03-09T14:37:49.101 DEBUG:teuthology.orchestra.run.smithi088:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-03-09T14:37:49.171 INFO:tasks.workunit.client.0.smithi088.stdout:INFO: fully qualified domain name: smithi088.front.sepia.ceph.com 2024-03-09T14:37:49.171 INFO:tasks.workunit.client.0.smithi088.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-03-09T14:37:49.172 INFO:tasks.workunit.client.0.smithi088.stdout:== TESTING NON-VERSIONED BUCKET == 2024-03-09T14:37:51.719 INFO:tasks.workunit.client.0.smithi088.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-03-09T14:37:51.923 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting pip 2024-03-09T14:37:51.929 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-09T14:37:51.975 INFO:tasks.workunit.client.0.smithi088.stdout:Installing collected packages: pip 2024-03-09T14:37:51.975 INFO:tasks.workunit.client.0.smithi088.stdout: Attempting uninstall: pip 2024-03-09T14:37:51.976 INFO:tasks.workunit.client.0.smithi088.stdout: Found existing installation: pip 21.2.3 2024-03-09T14:37:52.121 INFO:tasks.workunit.client.0.smithi088.stdout: Uninstalling pip-21.2.3: 2024-03-09T14:37:52.126 INFO:tasks.workunit.client.0.smithi088.stdout: Successfully uninstalled pip-21.2.3 2024-03-09T14:37:53.097 INFO:tasks.workunit.client.0.smithi088.stdout:Successfully installed pip-24.0 2024-03-09T14:37:53.963 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting boto3 2024-03-09T14:37:53.964 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached boto3-1.34.59-py3-none-any.whl.metadata (6.6 kB) 2024-03-09T14:37:54.524 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting botocore<1.35.0,>=1.34.59 (from boto3) 2024-03-09T14:37:54.525 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached botocore-1.34.59-py3-none-any.whl.metadata (5.7 kB) 2024-03-09T14:37:54.580 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-03-09T14:37:54.581 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-03-09T14:37:54.626 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-03-09T14:37:54.628 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-03-09T14:37:54.686 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:37:54.687 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-03-09T14:37:54.760 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:37:54.761 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-03-09T14:37:54.974 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:37:54.975 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-09T14:37:54.998 INFO:tasks.workunit.client.0.smithi088.stdout:Using cached boto3-1.34.59-py3-none-any.whl (139 kB) 2024-03-09T14:37:54.999 INFO:tasks.workunit.client.0.smithi088.stdout:Using cached botocore-1.34.59-py3-none-any.whl (12.0 MB) 2024-03-09T14:37:55.019 INFO:tasks.workunit.client.0.smithi088.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-03-09T14:37:55.020 INFO:tasks.workunit.client.0.smithi088.stdout:Using cached s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-03-09T14:37:55.021 INFO:tasks.workunit.client.0.smithi088.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-03-09T14:37:55.023 INFO:tasks.workunit.client.0.smithi088.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-03-09T14:37:55.025 INFO:tasks.workunit.client.0.smithi088.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-09T14:37:55.128 INFO:tasks.workunit.client.0.smithi088.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-03-09T14:37:56.115 INFO:tasks.workunit.client.0.smithi088.stdout:Successfully installed boto3-1.34.59 botocore-1.34.59 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.0 six-1.16.0 urllib3-1.26.18 2024-03-09T14:37:56.769 INFO:tasks.workunit.client.0.smithi088.stdout:INFO: creating user 2024-03-09T14:37:57.281 INFO:tasks.workunit.client.0.smithi088.stdout:{ 2024-03-09T14:37:57.281 INFO:tasks.workunit.client.0.smithi088.stdout: "user_id": "testid", 2024-03-09T14:37:57.281 INFO:tasks.workunit.client.0.smithi088.stdout: "display_name": "M. Tester", 2024-03-09T14:37:57.281 INFO:tasks.workunit.client.0.smithi088.stdout: "email": "tester@ceph.com", 2024-03-09T14:37:57.281 INFO:tasks.workunit.client.0.smithi088.stdout: "suspended": 0, 2024-03-09T14:37:57.281 INFO:tasks.workunit.client.0.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:37:57.281 INFO:tasks.workunit.client.0.smithi088.stdout: "subusers": [], 2024-03-09T14:37:57.281 INFO:tasks.workunit.client.0.smithi088.stdout: "keys": [ 2024-03-09T14:37:57.282 INFO:tasks.workunit.client.0.smithi088.stdout: { 2024-03-09T14:37:57.282 INFO:tasks.workunit.client.0.smithi088.stdout: "user": "testid", 2024-03-09T14:37:57.282 INFO:tasks.workunit.client.0.smithi088.stdout: "access_key": "0555b35654ad1656d804", 2024-03-09T14:37:57.282 INFO:tasks.workunit.client.0.smithi088.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-03-09T14:37:57.282 INFO:tasks.workunit.client.0.smithi088.stdout: "active": true, 2024-03-09T14:37:57.282 INFO:tasks.workunit.client.0.smithi088.stdout: "create_date": "2024-03-09T14:37:57.272539Z" 2024-03-09T14:37:57.282 INFO:tasks.workunit.client.0.smithi088.stdout: } 2024-03-09T14:37:57.282 INFO:tasks.workunit.client.0.smithi088.stdout: ], 2024-03-09T14:37:57.282 INFO:tasks.workunit.client.0.smithi088.stdout: "swift_keys": [], 2024-03-09T14:37:57.282 INFO:tasks.workunit.client.0.smithi088.stdout: "caps": [], 2024-03-09T14:37:57.282 INFO:tasks.workunit.client.0.smithi088.stdout: "op_mask": "read, write, delete", 2024-03-09T14:37:57.282 INFO:tasks.workunit.client.0.smithi088.stdout: "default_placement": "", 2024-03-09T14:37:57.282 INFO:tasks.workunit.client.0.smithi088.stdout: "default_storage_class": "", 2024-03-09T14:37:57.283 INFO:tasks.workunit.client.0.smithi088.stdout: "placement_tags": [], 2024-03-09T14:37:57.283 INFO:tasks.workunit.client.0.smithi088.stdout: "bucket_quota": { 2024-03-09T14:37:57.283 INFO:tasks.workunit.client.0.smithi088.stdout: "enabled": false, 2024-03-09T14:37:57.283 INFO:tasks.workunit.client.0.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:37:57.283 INFO:tasks.workunit.client.0.smithi088.stdout: "max_size": -1, 2024-03-09T14:37:57.283 INFO:tasks.workunit.client.0.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:37:57.283 INFO:tasks.workunit.client.0.smithi088.stdout: "max_objects": -1 2024-03-09T14:37:57.283 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:37:57.283 INFO:tasks.workunit.client.0.smithi088.stdout: "user_quota": { 2024-03-09T14:37:57.283 INFO:tasks.workunit.client.0.smithi088.stdout: "enabled": false, 2024-03-09T14:37:57.283 INFO:tasks.workunit.client.0.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:37:57.283 INFO:tasks.workunit.client.0.smithi088.stdout: "max_size": -1, 2024-03-09T14:37:57.284 INFO:tasks.workunit.client.0.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:37:57.284 INFO:tasks.workunit.client.0.smithi088.stdout: "max_objects": -1 2024-03-09T14:37:57.284 INFO:tasks.workunit.client.0.smithi088.stdout: }, 2024-03-09T14:37:57.284 INFO:tasks.workunit.client.0.smithi088.stdout: "temp_url_keys": [], 2024-03-09T14:37:57.284 INFO:tasks.workunit.client.0.smithi088.stdout: "type": "rgw", 2024-03-09T14:37:57.284 INFO:tasks.workunit.client.0.smithi088.stdout: "mfa_ids": [], 2024-03-09T14:37:57.284 INFO:tasks.workunit.client.0.smithi088.stdout: "account_id": "", 2024-03-09T14:37:57.284 INFO:tasks.workunit.client.0.smithi088.stdout: "path": "/", 2024-03-09T14:37:57.284 INFO:tasks.workunit.client.0.smithi088.stdout: "create_date": "2024-03-09T14:37:57.272529Z", 2024-03-09T14:37:57.284 INFO:tasks.workunit.client.0.smithi088.stdout: "tags": [], 2024-03-09T14:37:57.284 INFO:tasks.workunit.client.0.smithi088.stdout: "group_ids": [] 2024-03-09T14:37:57.284 INFO:tasks.workunit.client.0.smithi088.stdout:} 2024-03-09T14:37:57.284 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-03-09T14:37:57.570 INFO:tasks.workunit.client.0.smithi088.stderr:5+0 records in 2024-03-09T14:37:57.570 INFO:tasks.workunit.client.0.smithi088.stderr:5+0 records out 2024-03-09T14:37:57.570 INFO:tasks.workunit.client.0.smithi088.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0146536 s, 358 MB/s 2024-03-09T14:38:06.804 INFO:tasks.workunit.client.0.smithi088.stdout:bucket nams is reupload-bkt-108041 2024-03-09T14:38:06.804 INFO:tasks.workunit.client.0.smithi088.stdout:endpoint is http://smithi088.front.sepia.ceph.com:80 2024-03-09T14:38:06.804 INFO:tasks.workunit.client.0.smithi088.stdout:start UploadId=2~nJtRIgQv09vXCiCQ2Kr1cTWw1m7ODns 2024-03-09T14:38:06.804 INFO:tasks.workunit.client.0.smithi088.stdout:phase 1 uploaded part {'ETag': '"ac2c42cc92315554a78c47278e336092"', 'PartNumber': 1} 2024-03-09T14:38:06.804 INFO:tasks.workunit.client.0.smithi088.stdout:phase 1 uploaded part {'ETag': '"ac2c42cc92315554a78c47278e336092"', 'PartNumber': 2} 2024-03-09T14:38:06.805 INFO:tasks.workunit.client.0.smithi088.stdout:phase 2 uploaded part {'ETag': '"ac2c42cc92315554a78c47278e336092"', 'PartNumber': 1} 2024-03-09T14:38:06.805 INFO:tasks.workunit.client.0.smithi088.stdout:phase 2 uploaded part {'ETag': '"ac2c42cc92315554a78c47278e336092"', 'PartNumber': 1} 2024-03-09T14:38:06.805 INFO:tasks.workunit.client.0.smithi088.stdout:phase 2 uploaded part {'ETag': '"ac2c42cc92315554a78c47278e336092"', 'PartNumber': 1} 2024-03-09T14:38:06.805 INFO:tasks.workunit.client.0.smithi088.stdout:phase 2 uploaded part {'ETag': '"ac2c42cc92315554a78c47278e336092"', 'PartNumber': 1} 2024-03-09T14:38:06.805 INFO:tasks.workunit.client.0.smithi088.stdout:phase 2 uploaded part {'ETag': '"ac2c42cc92315554a78c47278e336092"', 'PartNumber': 1} 2024-03-09T14:38:06.805 INFO:tasks.workunit.client.0.smithi088.stdout:phase 2 uploaded part {'ETag': '"ac2c42cc92315554a78c47278e336092"', 'PartNumber': 1} 2024-03-09T14:38:06.805 INFO:tasks.workunit.client.0.smithi088.stdout:phase 2 uploaded part {'ETag': '"ac2c42cc92315554a78c47278e336092"', 'PartNumber': 1} 2024-03-09T14:38:06.805 INFO:tasks.workunit.client.0.smithi088.stdout:phase 2 uploaded part {'ETag': '"ac2c42cc92315554a78c47278e336092"', 'PartNumber': 1} 2024-03-09T14:38:06.805 INFO:tasks.workunit.client.0.smithi088.stdout:phase 2 uploaded part {'ETag': '"ac2c42cc92315554a78c47278e336092"', 'PartNumber': 1} 2024-03-09T14:38:06.805 INFO:tasks.workunit.client.0.smithi088.stdout:phase 2 uploaded part {'ETag': '"ac2c42cc92315554a78c47278e336092"', 'PartNumber': 1} 2024-03-09T14:38:06.805 INFO:tasks.workunit.client.0.smithi088.stdout:phase 2 uploaded part {'ETag': '"ac2c42cc92315554a78c47278e336092"', 'PartNumber': 1} 2024-03-09T14:38:06.805 INFO:tasks.workunit.client.0.smithi088.stdout:aborting multipart upload, parts=[{'ETag': '"ac2c42cc92315554a78c47278e336092"', 'PartNumber': 1}, {'ETag': '"ac2c42cc92315554a78c47278e336092"', 'PartNumber': 2}] 2024-03-09T14:38:08.368 INFO:tasks.workunit.client.0.smithi088.stdout:radosgw-admin bucket radoslist: 2024-03-09T14:38:08.426 INFO:tasks.workunit.client.0.smithi088.stdout:rados ls: 2024-03-09T14:38:08.511 INFO:tasks.workunit.client.0.smithi088.stdout:== PASSED == 2024-03-09T14:38:08.512 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:38:08.512 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:38:08.592 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-03-09T14:38:08.592 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-09T14:38:08.943 DEBUG:teuthology.parallel:result is None 2024-03-09T14:38:08.944 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:38:08.983 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:38:08.983 DEBUG:teuthology.orchestra.run.smithi088:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:38:09.050 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:38:09.050 INFO:teuthology.run_tasks:Running task ragweed... 2024-03-09T14:38:09.065 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-03-09T14:38:09.065 INFO:tasks.ragweed:Downloading ragweed... 2024-03-09T14:38:09.065 INFO:tasks.ragweed:Using branch 'wip-rgw-account-v3' for ragweed 2024-03-09T14:38:09.065 DEBUG:teuthology.orchestra.run.smithi088:> git clone -b wip-rgw-account-v3 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-03-09T14:38:09.118 INFO:teuthology.orchestra.run.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-03-09T14:38:09.163 INFO:teuthology.orchestra.run.smithi088.stderr:fatal: Remote branch wip-rgw-account-v3 not found in upstream origin 2024-03-09T14:38:09.163 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-03-09T14:38:09.165 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-03-09T14:38:09.165 DEBUG:teuthology.orchestra.run.smithi088:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-03-09T14:38:09.233 INFO:teuthology.orchestra.run.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-03-09T14:38:09.398 INFO:tasks.ragweed:Creating rgw users... 2024-03-09T14:38:09.399 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-03-09T14:38:09.399 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key AZKTSZCHMQUXJDTQZHBS --secret SwBwE98JMJA0TUYWlm3MoALNHjyqeOMEjCEHZie/wqEckJQugHCFRQ== --email ragweed.client.0+test@test.test --system false 2024-03-09T14:38:09.503 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:09.504 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:09.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.734+0000 7fd52de16800 20 rados->read ofs=0 len=0 2024-03-09T14:38:09.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.736+0000 7fd52de16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:09.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.736+0000 7fd52de16800 20 realm 2024-03-09T14:38:09.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.736+0000 7fd52de16800 20 rados->read ofs=0 len=0 2024-03-09T14:38:09.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.736+0000 7fd52de16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:09.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.736+0000 7fd52de16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:09.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.736+0000 7fd52de16800 20 rados->read ofs=0 len=0 2024-03-09T14:38:09.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.736+0000 7fd52de16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:09.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.736+0000 7fd52de16800 20 rados->read ofs=0 len=0 2024-03-09T14:38:09.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.737+0000 7fd52de16800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:09.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.737+0000 7fd52de16800 20 rados->read ofs=0 len=0 2024-03-09T14:38:09.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.738+0000 7fd52de16800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:09.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.738+0000 7fd52de16800 20 searching for the correct realm 2024-03-09T14:38:09.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.738+0000 7fd52955e640 0 -- 172.21.15.88:0/2607026352 >> [v2:172.21.15.88:6800/4216886240,v1:172.21.15.88:6802/4216886240] conn(0x562163815aa0 msgr2=0x562163817f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:38:09.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.742+0000 7fd52955e640 0 -- 172.21.15.88:0/2607026352 >> [v2:172.21.15.132:6824/731564406,v1:172.21.15.132:6825/731564406] conn(0x7fd52403c990 msgr2=0x7fd52404f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.952+0000 7fd52de16800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:38:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.952+0000 7fd52de16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.952+0000 7fd52de16800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:38:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.952+0000 7fd52de16800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.952+0000 7fd52de16800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.952+0000 7fd52de16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.952+0000 7fd52de16800 20 rados->read ofs=0 len=0 2024-03-09T14:38:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.952+0000 7fd52de16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.952+0000 7fd52de16800 20 rados->read ofs=0 len=0 2024-03-09T14:38:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.952+0000 7fd52de16800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.952+0000 7fd52de16800 20 rados->read ofs=0 len=0 2024-03-09T14:38:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.953+0000 7fd52de16800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.953+0000 7fd52de16800 20 zone default found 2024-03-09T14:38:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.953+0000 7fd52de16800 4 Realm: () 2024-03-09T14:38:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.953+0000 7fd52de16800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:38:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.953+0000 7fd52de16800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:38:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.953+0000 7fd52de16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.953+0000 7fd52de16800 20 zonegroup default 2024-03-09T14:38:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.953+0000 7fd52de16800 20 rados->read ofs=0 len=0 2024-03-09T14:38:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.953+0000 7fd52de16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:09.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.953+0000 7fd52de16800 20 rados->read ofs=0 len=0 2024-03-09T14:38:09.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.953+0000 7fd52de16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:09.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.953+0000 7fd52de16800 20 rados->read ofs=0 len=0 2024-03-09T14:38:09.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.953+0000 7fd52de16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:09.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.953+0000 7fd52de16800 20 started sync module instance, tier type = 2024-03-09T14:38:09.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.953+0000 7fd52de16800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:38:09.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.963+0000 7fd52de16800 20 add_watcher() i=0 2024-03-09T14:38:09.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.963+0000 7fd52de16800 20 add_watcher() i=1 2024-03-09T14:38:09.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.963+0000 7fd52de16800 20 add_watcher() i=2 2024-03-09T14:38:09.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.963+0000 7fd52de16800 20 add_watcher() i=3 2024-03-09T14:38:09.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.963+0000 7fd52de16800 20 add_watcher() i=4 2024-03-09T14:38:09.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.963+0000 7fd52de16800 20 add_watcher() i=5 2024-03-09T14:38:09.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.963+0000 7fd52de16800 20 add_watcher() i=6 2024-03-09T14:38:09.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.964+0000 7fd52de16800 20 add_watcher() i=7 2024-03-09T14:38:09.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.964+0000 7fd52de16800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:09.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.966+0000 7fd3df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:09.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.966+0000 7fd52de16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:09.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.966+0000 7fd52de16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:09.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.966+0000 7fd52de16800 5 note: GC not initialized 2024-03-09T14:38:09.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.966+0000 7fd3de7e4640 20 reqs_thread_entry: start 2024-03-09T14:38:09.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.967+0000 7fd52de16800 20 init_complete bucket index max shards: 11 2024-03-09T14:38:09.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.967+0000 7fd52de16800 20 Filter name: none 2024-03-09T14:38:09.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.967+0000 7fd34ffff640 20 reqs_thread_entry: start 2024-03-09T14:38:09.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.967+0000 7fd52de16800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-03-09T14:38:09.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.967+0000 7fd52de16800 20 rados->read ofs=0 len=0 2024-03-09T14:38:09.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.967+0000 7fd52de16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:09.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.967+0000 7fd52de16800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-03-09T14:38:09.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.967+0000 7fd52de16800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-09T14:38:09.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.967+0000 7fd52de16800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-03-09T14:38:09.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.967+0000 7fd52de16800 20 rados->read ofs=0 len=0 2024-03-09T14:38:09.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.968+0000 7fd52de16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:09.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.968+0000 7fd52de16800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-03-09T14:38:09.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.968+0000 7fd52de16800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-03-09T14:38:09.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.968+0000 7fd52de16800 10 cache get: name=default.rgw.meta+users.keys+AZKTSZCHMQUXJDTQZHBS : miss 2024-03-09T14:38:09.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.968+0000 7fd52de16800 20 rados->read ofs=0 len=0 2024-03-09T14:38:09.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.968+0000 7fd52de16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:09.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.968+0000 7fd52de16800 10 cache put: name=default.rgw.meta+users.keys+AZKTSZCHMQUXJDTQZHBS info.flags=0x0 2024-03-09T14:38:09.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.968+0000 7fd52de16800 10 adding default.rgw.meta+users.keys+AZKTSZCHMQUXJDTQZHBS to cache LRU end 2024-03-09T14:38:09.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.968+0000 7fd52de16800 10 cache get: name=default.rgw.meta+users.keys+AZKTSZCHMQUXJDTQZHBS : hit (negative entry) 2024-03-09T14:38:09.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.968+0000 7fd52de16800 10 cache get: name=default.rgw.meta+users.keys+AZKTSZCHMQUXJDTQZHBS : hit (negative entry) 2024-03-09T14:38:09.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.969+0000 7fd52de16800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-03-09T14:38:09.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.970+0000 7fd52de16800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-09T14:38:09.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.970+0000 7fd52de16800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-03-09T14:38:09.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.970+0000 7fd40cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725953 cookie 94701403352528 notifier 5841 bl.length()=675 2024-03-09T14:38:09.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.970+0000 7fd40cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-03-09T14:38:09.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.970+0000 7fd40cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-09T14:38:09.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.973+0000 7fd52de16800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-03-09T14:38:09.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.973+0000 7fd52de16800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-03-09T14:38:09.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.973+0000 7fd52de16800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-03-09T14:38:09.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.974+0000 7fd40cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725893 cookie 94701403345888 notifier 5841 bl.length()=202 2024-03-09T14:38:09.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.974+0000 7fd40cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-03-09T14:38:09.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.974+0000 7fd40cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-03-09T14:38:09.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.977+0000 7fd52de16800 10 cache put: name=default.rgw.meta+users.keys+AZKTSZCHMQUXJDTQZHBS info.flags=0x7 2024-03-09T14:38:09.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.977+0000 7fd52de16800 10 moving default.rgw.meta+users.keys+AZKTSZCHMQUXJDTQZHBS to cache LRU end 2024-03-09T14:38:09.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.977+0000 7fd52de16800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:AZKTSZCHMQUXJDTQZHBS, ofs0, ns] 2024-03-09T14:38:09.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.977+0000 7fd40cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725916 cookie 94701403359264 notifier 5841 bl.length()=190 2024-03-09T14:38:09.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.977+0000 7fd40cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+AZKTSZCHMQUXJDTQZHBS info.flags=0x7 2024-03-09T14:38:09.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.977+0000 7fd40cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+AZKTSZCHMQUXJDTQZHBS to cache LRU end 2024-03-09T14:38:09.979 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T14:38:09.979 INFO:teuthology.orchestra.run.smithi088.stdout: "user_id": "ragweed.client.0", 2024-03-09T14:38:09.979 INFO:teuthology.orchestra.run.smithi088.stdout: "display_name": "Mr. ragweed.client.0", 2024-03-09T14:38:09.979 INFO:teuthology.orchestra.run.smithi088.stdout: "email": "ragweed.client.0+test@test.test", 2024-03-09T14:38:09.979 INFO:teuthology.orchestra.run.smithi088.stdout: "suspended": 0, 2024-03-09T14:38:09.979 INFO:teuthology.orchestra.run.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:38:09.979 INFO:teuthology.orchestra.run.smithi088.stdout: "subusers": [], 2024-03-09T14:38:09.979 INFO:teuthology.orchestra.run.smithi088.stdout: "keys": [ 2024-03-09T14:38:09.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-03-09T14:38:09.979 INFO:teuthology.orchestra.run.smithi088.stdout: "user": "ragweed.client.0", 2024-03-09T14:38:09.979 INFO:teuthology.orchestra.run.smithi088.stdout: "access_key": "AZKTSZCHMQUXJDTQZHBS", 2024-03-09T14:38:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: "secret_key": "SwBwE98JMJA0TUYWlm3MoALNHjyqeOMEjCEHZie/wqEckJQugHCFRQ==", 2024-03-09T14:38:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: "active": true, 2024-03-09T14:38:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:38:09.969661Z" 2024-03-09T14:38:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-03-09T14:38:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T14:38:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: "swift_keys": [], 2024-03-09T14:38:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": [], 2024-03-09T14:38:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: "op_mask": "read, write, delete", 2024-03-09T14:38:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: "default_placement": "", 2024-03-09T14:38:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: "default_storage_class": "", 2024-03-09T14:38:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: "placement_tags": [], 2024-03-09T14:38:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: "bucket_quota": { 2024-03-09T14:38:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:38:09.980 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:38:09.981 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:38:09.981 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:38:09.981 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:38:09.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:38:09.981 INFO:teuthology.orchestra.run.smithi088.stdout: "user_quota": { 2024-03-09T14:38:09.981 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:38:09.981 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:38:09.981 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:38:09.981 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:38:09.981 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:38:09.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:38:09.981 INFO:teuthology.orchestra.run.smithi088.stdout: "temp_url_keys": [], 2024-03-09T14:38:09.982 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "rgw", 2024-03-09T14:38:09.982 INFO:teuthology.orchestra.run.smithi088.stdout: "mfa_ids": [], 2024-03-09T14:38:09.982 INFO:teuthology.orchestra.run.smithi088.stdout: "account_id": "", 2024-03-09T14:38:09.982 INFO:teuthology.orchestra.run.smithi088.stdout: "path": "/", 2024-03-09T14:38:09.982 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:38:09.969646Z", 2024-03-09T14:38:09.982 INFO:teuthology.orchestra.run.smithi088.stdout: "tags": [], 2024-03-09T14:38:09.982 INFO:teuthology.orchestra.run.smithi088.stdout: "group_ids": [] 2024-03-09T14:38:09.982 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T14:38:09.982 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:38:09.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.979+0000 7fd3df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:09.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.981+0000 7fd52de16800 20 remove_watcher() i=0 2024-03-09T14:38:09.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.981+0000 7fd52de16800 2 removed watcher, disabling cache 2024-03-09T14:38:09.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.983+0000 7fd52de16800 20 remove_watcher() i=1 2024-03-09T14:38:09.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.984+0000 7fd52de16800 20 remove_watcher() i=2 2024-03-09T14:38:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.985+0000 7fd52de16800 20 remove_watcher() i=3 2024-03-09T14:38:09.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.986+0000 7fd52de16800 20 remove_watcher() i=4 2024-03-09T14:38:09.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.987+0000 7fd52de16800 20 remove_watcher() i=5 2024-03-09T14:38:09.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.988+0000 7fd52de16800 20 remove_watcher() i=6 2024-03-09T14:38:09.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:09.989+0000 7fd52de16800 20 remove_watcher() i=7 2024-03-09T14:38:10.000 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-03-09T14:38:10.000 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key RCDYTBAFPRZMXXVGBJDB --secret 2mx8ztv9Ct7r6hMJa3s8lHIlPRjbZBpbQmnZUYXS3tyaPSxABwLkmA== --email sysuser.client.0+test@test.test --system true 2024-03-09T14:38:10.063 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:10.063 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:10.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.092+0000 7fbf9fe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:10.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.093+0000 7fbf9fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:10.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.093+0000 7fbf9fe0f800 20 realm 2024-03-09T14:38:10.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.093+0000 7fbf9fe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:10.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.093+0000 7fbf9fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:10.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.093+0000 7fbf9fe0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:10.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.093+0000 7fbf9fe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.094+0000 7fbf9fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.094+0000 7fbf9fe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.094+0000 7fbf9fe0f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.094+0000 7fbf9fe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.095+0000 7fbf9fe0f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.095+0000 7fbf9fe0f800 20 searching for the correct realm 2024-03-09T14:38:10.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.097+0000 7fbf9bc82640 0 -- 172.21.15.88:0/3761474147 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fbf9402b040 msgr2=0x7fbf94041940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:10.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.303+0000 7fbf9ac80640 0 -- 172.21.15.88:0/3761474147 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fbf940403c0 msgr2=0x7fbf94040840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:38:10.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.510+0000 7fbf9fe0f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:38:10.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.510+0000 7fbf9fe0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:10.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.510+0000 7fbf9fe0f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:38:10.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.510+0000 7fbf9fe0f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:10.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.510+0000 7fbf9fe0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:10.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.510+0000 7fbf9fe0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:10.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.510+0000 7fbf9fe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:10.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.510+0000 7fbf9fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:10.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.510+0000 7fbf9fe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:10.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.511+0000 7fbf9fe0f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:10.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.511+0000 7fbf9fe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:10.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.511+0000 7fbf9fe0f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:10.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.511+0000 7fbf9fe0f800 20 zone default found 2024-03-09T14:38:10.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.511+0000 7fbf9fe0f800 4 Realm: () 2024-03-09T14:38:10.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.511+0000 7fbf9fe0f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:38:10.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.511+0000 7fbf9fe0f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:38:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.511+0000 7fbf9fe0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.511+0000 7fbf9fe0f800 20 zonegroup default 2024-03-09T14:38:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.511+0000 7fbf9fe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.511+0000 7fbf9fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.511+0000 7fbf9fe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.512+0000 7fbf9fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.512+0000 7fbf9fe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.512+0000 7fbf9fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.512+0000 7fbf9fe0f800 20 started sync module instance, tier type = 2024-03-09T14:38:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.512+0000 7fbf9fe0f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:38:10.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.522+0000 7fbf9fe0f800 20 add_watcher() i=0 2024-03-09T14:38:10.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.522+0000 7fbf9fe0f800 20 add_watcher() i=1 2024-03-09T14:38:10.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.522+0000 7fbf9fe0f800 20 add_watcher() i=2 2024-03-09T14:38:10.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.522+0000 7fbf9fe0f800 20 add_watcher() i=3 2024-03-09T14:38:10.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.522+0000 7fbf9fe0f800 20 add_watcher() i=4 2024-03-09T14:38:10.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.522+0000 7fbf9fe0f800 20 add_watcher() i=5 2024-03-09T14:38:10.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.522+0000 7fbf9fe0f800 20 add_watcher() i=6 2024-03-09T14:38:10.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.523+0000 7fbf9fe0f800 20 add_watcher() i=7 2024-03-09T14:38:10.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.523+0000 7fbf9fe0f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:10.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.525+0000 7fbe51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:10.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.525+0000 7fbf9fe0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:10.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.525+0000 7fbf9fe0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:10.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.525+0000 7fbf9fe0f800 5 note: GC not initialized 2024-03-09T14:38:10.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.526+0000 7fbe50fe1640 20 reqs_thread_entry: start 2024-03-09T14:38:10.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.526+0000 7fbf9fe0f800 20 init_complete bucket index max shards: 11 2024-03-09T14:38:10.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.526+0000 7fbf9fe0f800 20 Filter name: none 2024-03-09T14:38:10.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.526+0000 7fbdca7fc640 20 reqs_thread_entry: start 2024-03-09T14:38:10.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.526+0000 7fbf9fe0f800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-03-09T14:38:10.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.526+0000 7fbf9fe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:10.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.526+0000 7fbf9fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.526+0000 7fbf9fe0f800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-03-09T14:38:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.526+0000 7fbf9fe0f800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-09T14:38:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.526+0000 7fbf9fe0f800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-03-09T14:38:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.526+0000 7fbf9fe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.527+0000 7fbf9fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.527+0000 7fbf9fe0f800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-03-09T14:38:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.527+0000 7fbf9fe0f800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-03-09T14:38:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.527+0000 7fbf9fe0f800 10 cache get: name=default.rgw.meta+users.keys+RCDYTBAFPRZMXXVGBJDB : miss 2024-03-09T14:38:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.527+0000 7fbf9fe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.527+0000 7fbf9fe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.527+0000 7fbf9fe0f800 10 cache put: name=default.rgw.meta+users.keys+RCDYTBAFPRZMXXVGBJDB info.flags=0x0 2024-03-09T14:38:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.527+0000 7fbf9fe0f800 10 adding default.rgw.meta+users.keys+RCDYTBAFPRZMXXVGBJDB to cache LRU end 2024-03-09T14:38:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.527+0000 7fbf9fe0f800 10 cache get: name=default.rgw.meta+users.keys+RCDYTBAFPRZMXXVGBJDB : hit (negative entry) 2024-03-09T14:38:10.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.527+0000 7fbf9fe0f800 10 cache get: name=default.rgw.meta+users.keys+RCDYTBAFPRZMXXVGBJDB : hit (negative entry) 2024-03-09T14:38:10.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.529+0000 7fbf9fe0f800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-03-09T14:38:10.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.529+0000 7fbf9fe0f800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-09T14:38:10.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.529+0000 7fbf9fe0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-03-09T14:38:10.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.529+0000 7fbe7effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725894 cookie 94344953714864 notifier 5639 bl.length()=675 2024-03-09T14:38:10.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.529+0000 7fbe7effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-03-09T14:38:10.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.529+0000 7fbe7effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-09T14:38:10.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.532+0000 7fbf9fe0f800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-03-09T14:38:10.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.532+0000 7fbf9fe0f800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-03-09T14:38:10.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.532+0000 7fbf9fe0f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-03-09T14:38:10.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.533+0000 7fbe7effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725954 cookie 94344953722544 notifier 5639 bl.length()=202 2024-03-09T14:38:10.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.533+0000 7fbe7effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-03-09T14:38:10.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.533+0000 7fbe7effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-03-09T14:38:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.535+0000 7fbf9fe0f800 10 cache put: name=default.rgw.meta+users.keys+RCDYTBAFPRZMXXVGBJDB info.flags=0x7 2024-03-09T14:38:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.535+0000 7fbf9fe0f800 10 moving default.rgw.meta+users.keys+RCDYTBAFPRZMXXVGBJDB to cache LRU end 2024-03-09T14:38:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.535+0000 7fbf9fe0f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:RCDYTBAFPRZMXXVGBJDB, ofs0, ns] 2024-03-09T14:38:10.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.536+0000 7fbe7effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725955 cookie 94344953722544 notifier 5639 bl.length()=190 2024-03-09T14:38:10.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.536+0000 7fbe7effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RCDYTBAFPRZMXXVGBJDB info.flags=0x7 2024-03-09T14:38:10.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.536+0000 7fbe7effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RCDYTBAFPRZMXXVGBJDB to cache LRU end 2024-03-09T14:38:10.537 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T14:38:10.537 INFO:teuthology.orchestra.run.smithi088.stdout: "user_id": "sysuser.client.0", 2024-03-09T14:38:10.538 INFO:teuthology.orchestra.run.smithi088.stdout: "display_name": "Mr. sysuser.client.0", 2024-03-09T14:38:10.538 INFO:teuthology.orchestra.run.smithi088.stdout: "email": "sysuser.client.0+test@test.test", 2024-03-09T14:38:10.538 INFO:teuthology.orchestra.run.smithi088.stdout: "suspended": 0, 2024-03-09T14:38:10.538 INFO:teuthology.orchestra.run.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:38:10.538 INFO:teuthology.orchestra.run.smithi088.stdout: "subusers": [], 2024-03-09T14:38:10.538 INFO:teuthology.orchestra.run.smithi088.stdout: "keys": [ 2024-03-09T14:38:10.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-03-09T14:38:10.538 INFO:teuthology.orchestra.run.smithi088.stdout: "user": "sysuser.client.0", 2024-03-09T14:38:10.538 INFO:teuthology.orchestra.run.smithi088.stdout: "access_key": "RCDYTBAFPRZMXXVGBJDB", 2024-03-09T14:38:10.538 INFO:teuthology.orchestra.run.smithi088.stdout: "secret_key": "2mx8ztv9Ct7r6hMJa3s8lHIlPRjbZBpbQmnZUYXS3tyaPSxABwLkmA==", 2024-03-09T14:38:10.538 INFO:teuthology.orchestra.run.smithi088.stdout: "active": true, 2024-03-09T14:38:10.538 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:38:10.528934Z" 2024-03-09T14:38:10.538 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-03-09T14:38:10.538 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T14:38:10.539 INFO:teuthology.orchestra.run.smithi088.stdout: "swift_keys": [], 2024-03-09T14:38:10.539 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": [], 2024-03-09T14:38:10.539 INFO:teuthology.orchestra.run.smithi088.stdout: "op_mask": "read, write, delete", 2024-03-09T14:38:10.539 INFO:teuthology.orchestra.run.smithi088.stdout: "system": true, 2024-03-09T14:38:10.539 INFO:teuthology.orchestra.run.smithi088.stdout: "default_placement": "", 2024-03-09T14:38:10.539 INFO:teuthology.orchestra.run.smithi088.stdout: "default_storage_class": "", 2024-03-09T14:38:10.539 INFO:teuthology.orchestra.run.smithi088.stdout: "placement_tags": [], 2024-03-09T14:38:10.539 INFO:teuthology.orchestra.run.smithi088.stdout: "bucket_quota": { 2024-03-09T14:38:10.539 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:38:10.539 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:38:10.539 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:38:10.540 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:38:10.540 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:38:10.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:38:10.540 INFO:teuthology.orchestra.run.smithi088.stdout: "user_quota": { 2024-03-09T14:38:10.540 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:38:10.540 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:38:10.540 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:38:10.540 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:38:10.540 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:38:10.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:38:10.540 INFO:teuthology.orchestra.run.smithi088.stdout: "temp_url_keys": [], 2024-03-09T14:38:10.540 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "rgw", 2024-03-09T14:38:10.540 INFO:teuthology.orchestra.run.smithi088.stdout: "mfa_ids": [], 2024-03-09T14:38:10.540 INFO:teuthology.orchestra.run.smithi088.stdout: "account_id": "", 2024-03-09T14:38:10.541 INFO:teuthology.orchestra.run.smithi088.stdout: "path": "/", 2024-03-09T14:38:10.541 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:38:10.528921Z", 2024-03-09T14:38:10.541 INFO:teuthology.orchestra.run.smithi088.stdout: "tags": [], 2024-03-09T14:38:10.541 INFO:teuthology.orchestra.run.smithi088.stdout: "group_ids": [] 2024-03-09T14:38:10.541 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T14:38:10.541 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:38:10.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.538+0000 7fbe51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:10.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.540+0000 7fbf9fe0f800 20 remove_watcher() i=0 2024-03-09T14:38:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.540+0000 7fbf9fe0f800 2 removed watcher, disabling cache 2024-03-09T14:38:10.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.541+0000 7fbf9fe0f800 20 remove_watcher() i=1 2024-03-09T14:38:10.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.542+0000 7fbf9fe0f800 20 remove_watcher() i=2 2024-03-09T14:38:10.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.544+0000 7fbf9fe0f800 20 remove_watcher() i=3 2024-03-09T14:38:10.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.545+0000 7fbf9fe0f800 20 remove_watcher() i=4 2024-03-09T14:38:10.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.546+0000 7fbf9fe0f800 20 remove_watcher() i=5 2024-03-09T14:38:10.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.547+0000 7fbf9fe0f800 20 remove_watcher() i=6 2024-03-09T14:38:10.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:10.548+0000 7fbf9fe0f800 20 remove_watcher() i=7 2024-03-09T14:38:10.559 INFO:tasks.ragweed:Configuring ragweed... 2024-03-09T14:38:10.560 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:38:10.560 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-03-09T14:38:10.588 INFO:tasks.ragweed:Configuring boto... 2024-03-09T14:38:10.588 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:38:10.588 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-03-09T14:38:10.658 DEBUG:teuthology.orchestra.run.smithi088:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-03-09T14:38:10.957 INFO:teuthology.orchestra.run.smithi088.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-03-09T14:38:11.134 INFO:teuthology.orchestra.run.smithi088.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-03-09T14:38:11.637 INFO:teuthology.orchestra.run.smithi088.stdout:py installdeps: -rrequirements.txt 2024-03-09T14:38:19.084 INFO:teuthology.orchestra.run.smithi088.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-03-09T14:38:21.187 INFO:teuthology.orchestra.run.smithi088.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2021.10.8,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-299/tmp/wheel/cockpit-299-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.0,execnet==2.0.2,file-magic==0.4.0,gevent==24.2.1,google-auth==2.28.0,gpg==1.15.1,greenlet==3.0.3,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.4.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.1.1,python-dateutil==2.8.1,python-linux-procfs==0.7.0,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=46861d1326a5644887b555ae0ac6cc956611be244ba58e1ea9cefbe608590b46,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.5,sepolicy==3.5,setools==4.4.3,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,sos==4.3,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.4.0,urllib3==1.26.5,WebOb==1.8.7,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==6.2 2024-03-09T14:38:21.188 INFO:teuthology.orchestra.run.smithi088.stdout:py run-test-pre: PYTHONHASHSEED='2744840014' 2024-03-09T14:38:21.188 INFO:teuthology.orchestra.run.smithi088.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-03-09T14:38:21.407 INFO:teuthology.orchestra.run.smithi088.stdout:============================= test session starts ============================== 2024-03-09T14:38:21.408 INFO:teuthology.orchestra.run.smithi088.stdout:platform linux -- Python 3.9.17, pytest-8.1.1, pluggy-1.4.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-03-09T14:38:21.408 INFO:teuthology.orchestra.run.smithi088.stdout:cachedir: .tox/py/.pytest_cache 2024-03-09T14:38:21.408 INFO:teuthology.orchestra.run.smithi088.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-03-09T14:38:21.408 INFO:teuthology.orchestra.run.smithi088.stdout:configfile: pytest.ini 2024-03-09T14:38:21.506 INFO:teuthology.orchestra.run.smithi088.stdout:collecting ... collected 9 items 2024-03-09T14:38:21.506 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:38:23.549 INFO:teuthology.orchestra.run.smithi088.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-03-09T14:38:25.850 INFO:teuthology.orchestra.run.smithi088.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-03-09T14:38:27.686 INFO:teuthology.orchestra.run.smithi088.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-03-09T14:38:30.005 INFO:teuthology.orchestra.run.smithi088.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-03-09T14:38:32.444 INFO:teuthology.orchestra.run.smithi088.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-03-09T14:38:40.763 INFO:teuthology.orchestra.run.smithi088.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-03-09T14:38:45.340 INFO:teuthology.orchestra.run.smithi088.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-03-09T14:38:49.332 INFO:teuthology.orchestra.run.smithi088.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-03-09T14:38:57.338 INFO:teuthology.orchestra.run.smithi088.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-03-09T14:38:57.338 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:38:57.338 INFO:teuthology.orchestra.run.smithi088.stdout:=============================== warnings summary =============================== 2024-03-09T14:38:57.338 INFO:teuthology.orchestra.run.smithi088.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-03-09T14:38:57.338 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-03-09T14:38:57.338 INFO:teuthology.orchestra.run.smithi088.stdout: import imp 2024-03-09T14:38:57.338 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:38:57.338 INFO:teuthology.orchestra.run.smithi088.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-03-09T14:38:57.339 INFO:teuthology.orchestra.run.smithi088.stdout:======================== 9 passed, 1 warning in 35.93s ========================= 2024-03-09T14:38:57.369 INFO:teuthology.orchestra.run.smithi088.stdout:___________________________________ summary ____________________________________ 2024-03-09T14:38:57.369 INFO:teuthology.orchestra.run.smithi088.stdout: py: commands succeeded 2024-03-09T14:38:57.369 INFO:teuthology.orchestra.run.smithi088.stdout: congratulations :) 2024-03-09T14:38:57.383 INFO:tasks.ragweed:Cleaning up boto... 2024-03-09T14:38:57.383 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-03-09T14:38:57.411 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-03-09T14:38:57.505 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:57.505 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:57.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:57.535+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:57.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:57.536+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:57.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:57.536+0000 7f4a6e71f800 20 realm 2024-03-09T14:38:57.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:57.536+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:57.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:57.536+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:57.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:57.536+0000 7f4a6e71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:57.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:57.536+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:57.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:57.536+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:57.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:57.536+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:57.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:57.537+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:57.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:57.537+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:57.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:57.538+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:57.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:57.538+0000 7f4a6e71f800 20 searching for the correct realm 2024-03-09T14:38:57.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:57.739+0000 7f4a6a481640 0 -- 172.21.15.88:0/1150185829 >> [v2:172.21.15.88:6800/4216886240,v1:172.21.15.88:6802/4216886240] conn(0x55de8133bb60 msgr2=0x55de8133e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:58.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.144+0000 7f4a69c80640 0 -- 172.21.15.88:0/1150185829 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f4a5c033070 msgr2=0x7f4a5c02a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:58.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.154+0000 7f4a6e71f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:38:58.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.154+0000 7f4a6e71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:58.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.154+0000 7f4a6e71f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:38:58.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.154+0000 7f4a6e71f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:58.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.154+0000 7f4a6e71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:58.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.154+0000 7f4a6e71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:58.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.154+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.154+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.154+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.154+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:58.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.154+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.155+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:58.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.155+0000 7f4a6e71f800 20 zone default found 2024-03-09T14:38:58.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.155+0000 7f4a6e71f800 4 Realm: () 2024-03-09T14:38:58.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.155+0000 7f4a6e71f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:38:58.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.155+0000 7f4a6e71f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:38:58.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.155+0000 7f4a6e71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:58.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.155+0000 7f4a6e71f800 20 zonegroup default 2024-03-09T14:38:58.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.155+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.155+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.155+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.155+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.155+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.156+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.156+0000 7f4a6e71f800 20 started sync module instance, tier type = 2024-03-09T14:38:58.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.156+0000 7f4a6e71f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:38:58.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.167+0000 7f4a6e71f800 20 add_watcher() i=0 2024-03-09T14:38:58.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.167+0000 7f4a6e71f800 20 add_watcher() i=1 2024-03-09T14:38:58.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.167+0000 7f4a6e71f800 20 add_watcher() i=2 2024-03-09T14:38:58.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.167+0000 7f4a6e71f800 20 add_watcher() i=3 2024-03-09T14:38:58.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.167+0000 7f4a6e71f800 20 add_watcher() i=4 2024-03-09T14:38:58.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.167+0000 7f4a6e71f800 20 add_watcher() i=5 2024-03-09T14:38:58.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.167+0000 7f4a6e71f800 20 add_watcher() i=6 2024-03-09T14:38:58.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.168+0000 7f4a6e71f800 20 add_watcher() i=7 2024-03-09T14:38:58.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.168+0000 7f4a6e71f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:58.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.170+0000 7f4920fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:58.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.170+0000 7f4a6e71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:58.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.170+0000 7f4a6e71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:58.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.209+0000 7f489b7fe640 20 reqs_thread_entry: start 2024-03-09T14:38:58.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.209+0000 7f4a6e71f800 20 init_complete bucket index max shards: 11 2024-03-09T14:38:58.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.209+0000 7f4a6e71f800 20 Filter name: none 2024-03-09T14:38:58.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.209+0000 7f48997fa640 20 reqs_thread_entry: start 2024-03-09T14:38:58.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.209+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-03-09T14:38:58.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.209+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.210+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=486 2024-03-09T14:38:58.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.210+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-03-09T14:38:58.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.210+0000 7f4a6e71f800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-09T14:38:58.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.210+0000 7f4a6e71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:58.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.211+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:5d93e872-363b-498b-b665-658644296b85.4535.4 : miss 2024-03-09T14:38:58.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.211+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.211+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=418 2024-03-09T14:38:58.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.211+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:5d93e872-363b-498b-b665-658644296b85.4535.4 info.flags=0x17 2024-03-09T14:38:58.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.211+0000 7f4a6e71f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:5d93e872-363b-498b-b665-658644296b85.4535.4 to cache LRU end 2024-03-09T14:38:58.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.211+0000 7f4a6e71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:58.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.211+0000 7f4a6e71f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:38:58.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.211+0000 7f4a6e71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:5d93e872-363b-498b-b665-658644296b85.4535.4 2024-03-09T14:38:58.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.212+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-03-09T14:38:58.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.212+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-03-09T14:38:58.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.212+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-03-09T14:38:58.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.213+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-03-09T14:38:58.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.213+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-03-09T14:38:58.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.213+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-03-09T14:38:58.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.214+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-03-09T14:38:58.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.214+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-03-09T14:38:58.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.215+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-03-09T14:38:58.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.216+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c9a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55de813fadd8 s->prefetch_data=0 2024-03-09T14:38:58.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.216+0000 7f4a6e71f800 10 manifest: total_size = 7739 2024-03-09T14:38:58.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.216+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.4124711975886401672 2024-03-09T14:38:58.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.216+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c9a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55de813fadd8 s->prefetch_data=0 2024-03-09T14:38:58.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.216+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813fadd8 2024-03-09T14:38:58.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.216+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.4.1 2024-03-09T14:38:58.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.219+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c9a0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.219+0000 7f4a6e71f800 10 manifest: total_size = 7488 2024-03-09T14:38:58.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.219+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.2472990413791272742 2024-03-09T14:38:58.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.219+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c9a0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.219+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813fad98 2024-03-09T14:38:58.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.219+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.4.2 2024-03-09T14:38:58.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.220+0000 7f494dffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-03-09T14:38:58.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.222+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c9a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.222+0000 7f4a6e71f800 10 manifest: total_size = 7729 2024-03-09T14:38:58.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.222+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.16282339706053977016 2024-03-09T14:38:58.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.222+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c9a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.222+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813fad98 2024-03-09T14:38:58.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.222+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.4.2 2024-03-09T14:38:58.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.223+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-03-09T14:38:58.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.225+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c9a0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.225+0000 7f4a6e71f800 10 manifest: total_size = 7545 2024-03-09T14:38:58.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.225+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.17617288243758687482 2024-03-09T14:38:58.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.225+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c9a0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.225+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813fad98 2024-03-09T14:38:58.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.225+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.4.3 2024-03-09T14:38:58.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.226+0000 7f494dffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-03-09T14:38:58.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.228+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fcac0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.228+0000 7f4a6e71f800 10 manifest: total_size = 7639 2024-03-09T14:38:58.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.228+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.659519854158940457 2024-03-09T14:38:58.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.228+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fcac0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.228+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813fad98 2024-03-09T14:38:58.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.228+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.4.4 2024-03-09T14:38:58.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.229+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-03-09T14:38:58.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.231+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fc4a0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.232+0000 7f4a6e71f800 10 manifest: total_size = 4929 2024-03-09T14:38:58.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.232+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.4610612178005868877 2024-03-09T14:38:58.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.232+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fc4a0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.232+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813fad98 2024-03-09T14:38:58.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.232+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.4.4 2024-03-09T14:38:58.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.233+0000 7f494dffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-03-09T14:38:58.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.234+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fc4a0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.235+0000 7f4a6e71f800 10 manifest: total_size = 7504 2024-03-09T14:38:58.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.235+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.8063239238074546316 2024-03-09T14:38:58.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.235+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fc4a0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.235+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813fad98 2024-03-09T14:38:58.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.235+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.4.5 2024-03-09T14:38:58.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.235+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-03-09T14:38:58.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.237+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fc4a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.238+0000 7f4a6e71f800 10 manifest: total_size = 14119 2024-03-09T14:38:58.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.238+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.11333114907236937119 2024-03-09T14:38:58.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.238+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fc4a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.238+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813fad98 2024-03-09T14:38:58.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.238+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.4.7 2024-03-09T14:38:58.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.238+0000 7f494dffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-03-09T14:38:58.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.240+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.241+0000 7f4a6e71f800 10 manifest: total_size = 5356 2024-03-09T14:38:58.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.241+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.12079688025919474232 2024-03-09T14:38:58.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.241+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55de813fad98 s->prefetch_data=0 2024-03-09T14:38:58.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.241+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813fad98 2024-03-09T14:38:58.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.241+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.4.8 2024-03-09T14:38:58.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.242+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-03-09T14:38:58.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.244+0000 7f4a6e71f800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:38:58.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.244+0000 7f4a6e71f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:38:58.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.246+0000 7f494dffb640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-03-09T14:38:58.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.246+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:38:58.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.246+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:38:58.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.246+0000 7f4a6e71f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:38:58.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.246+0000 7f4a6e71f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:38:58.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.246+0000 7f4a6e71f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[5d93e872-363b-498b-b665-658644296b85.4535.4])"; uploads.size()=0; is_truncated=0 2024-03-09T14:38:58.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.248+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-03-09T14:38:58.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.248+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.248+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=204 2024-03-09T14:38:58.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.248+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-03-09T14:38:58.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.248+0000 7f4a6e71f800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-03-09T14:38:58.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.249+0000 7f4a6e71f800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-03-09T14:38:58.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.249+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-03-09T14:38:58.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.250+0000 7f494dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529736 cookie 94414138758848 notifier 5663 bl.length()=162 2024-03-09T14:38:58.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.252+0000 7f4a6e71f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:5d93e872-363b-498b-b665-658644296b85.4535.4 from cache 2024-03-09T14:38:58.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.252+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:5d93e872-363b-498b-b665-658644296b85.4535.4, ofs0, ns] 2024-03-09T14:38:58.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.253+0000 7f494d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529674 cookie 94414138769120 notifier 5663 bl.length()=219 2024-03-09T14:38:58.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.256+0000 7f4a6e71f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/5d93e872-363b-498b-b665-658644296b85.4535.4 : miss 2024-03-09T14:38:58.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.256+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.256+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.256+0000 7f4a6e71f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/5d93e872-363b-498b-b665-658644296b85.4535.4 info.flags=0x0 2024-03-09T14:38:58.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.256+0000 7f4a6e71f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/5d93e872-363b-498b-b665-658644296b85.4535.4 to cache LRU end 2024-03-09T14:38:58.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.259+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5d93e872-363b-498b-b665-658644296b85.4535.11 : miss 2024-03-09T14:38:58.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.259+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.259+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=449 2024-03-09T14:38:58.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.259+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5d93e872-363b-498b-b665-658644296b85.4535.11 info.flags=0x17 2024-03-09T14:38:58.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.259+0000 7f4a6e71f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5d93e872-363b-498b-b665-658644296b85.4535.11 to cache LRU end 2024-03-09T14:38:58.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.259+0000 7f4a6e71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:58.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.259+0000 7f4a6e71f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:38:58.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.259+0000 7f4a6e71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5d93e872-363b-498b-b665-658644296b85.4535.11 2024-03-09T14:38:58.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.263+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo 2024-03-09T14:38:58.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.263+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fcd10 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55de8139f348 s->prefetch_data=0 2024-03-09T14:38:58.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.263+0000 7f4a6e71f800 10 manifest: total_size = 18874368 2024-03-09T14:38:58.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.263+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.499911422795892007 2024-03-09T14:38:58.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.263+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fcd10 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55de8139f348 s->prefetch_data=0 2024-03-09T14:38:58.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.263+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de8139f348 2024-03-09T14:38:58.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.263+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.11.10 2024-03-09T14:38:58.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-03-09T14:38:58.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-03-09T14:38:58.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-03-09T14:38:58.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2024-03-09T14:38:58.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-03-09T14:38:58.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-03-09T14:38:58.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2024-03-09T14:38:58.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-03-09T14:38:58.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.499911422795892007 2024-03-09T14:38:58.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.11__multipart_foo.2~EufE9xLS4ez1NslZT-CgGPKdROx24TO.1 2024-03-09T14:38:58.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-03-09T14:38:58.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.11__shadow_foo.2~EufE9xLS4ez1NslZT-CgGPKdROx24TO.1_1 2024-03-09T14:38:58.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2024-03-09T14:38:58.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.11__multipart_foo.2~EufE9xLS4ez1NslZT-CgGPKdROx24TO.2 2024-03-09T14:38:58.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 835 2024-03-09T14:38:58.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.11__shadow_foo.2~EufE9xLS4ez1NslZT-CgGPKdROx24TO.2_1 2024-03-09T14:38:58.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1079 2024-03-09T14:38:58.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.11__multipart_foo.2~EufE9xLS4ez1NslZT-CgGPKdROx24TO.3 2024-03-09T14:38:58.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1325 2024-03-09T14:38:58.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.11__shadow_foo.2~EufE9xLS4ez1NslZT-CgGPKdROx24TO.3_1 2024-03-09T14:38:58.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1569 2024-03-09T14:38:58.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.11__multipart_foo.2~EufE9xLS4ez1NslZT-CgGPKdROx24TO.4 2024-03-09T14:38:58.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1815 2024-03-09T14:38:58.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.266+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 5d93e872-363b-498b-b665-658644296b85.4535.499911422795892007 2024-03-09T14:38:58.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.267+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo 2024-03-09T14:38:58.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.267+0000 7f4a6e71f800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:38:58.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.267+0000 7f4a6e71f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:38:58.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.268+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:38:58.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.268+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:38:58.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.268+0000 7f4a6e71f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:38:58.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.268+0000 7f4a6e71f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:38:58.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.268+0000 7f4a6e71f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[5d93e872-363b-498b-b665-658644296b85.4535.11])"; uploads.size()=0; is_truncated=0 2024-03-09T14:38:58.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.270+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-03-09T14:38:58.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.270+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.270+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=235 2024-03-09T14:38:58.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.270+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-03-09T14:38:58.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.270+0000 7f4a6e71f800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-03-09T14:38:58.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.271+0000 7f4a6e71f800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-03-09T14:38:58.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.271+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-03-09T14:38:58.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.272+0000 7f494d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529718 cookie 94414138756640 notifier 5663 bl.length()=191 2024-03-09T14:38:58.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.274+0000 7f4a6e71f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5d93e872-363b-498b-b665-658644296b85.4535.11 from cache 2024-03-09T14:38:58.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.274+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5d93e872-363b-498b-b665-658644296b85.4535.11, ofs0, ns] 2024-03-09T14:38:58.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.274+0000 7f494d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529675 cookie 94414138769120 notifier 5663 bl.length()=249 2024-03-09T14:38:58.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.280+0000 7f4a6e71f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/5d93e872-363b-498b-b665-658644296b85.4535.11 : miss 2024-03-09T14:38:58.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.280+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.280+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.280+0000 7f4a6e71f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/5d93e872-363b-498b-b665-658644296b85.4535.11 info.flags=0x0 2024-03-09T14:38:58.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.280+0000 7f4a6e71f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/5d93e872-363b-498b-b665-658644296b85.4535.11 to cache LRU end 2024-03-09T14:38:58.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.282+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5d93e872-363b-498b-b665-658644296b85.4535.12 : miss 2024-03-09T14:38:58.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.282+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.283+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=456 2024-03-09T14:38:58.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.283+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5d93e872-363b-498b-b665-658644296b85.4535.12 info.flags=0x17 2024-03-09T14:38:58.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.283+0000 7f4a6e71f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5d93e872-363b-498b-b665-658644296b85.4535.12 to cache LRU end 2024-03-09T14:38:58.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.283+0000 7f4a6e71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:58.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.283+0000 7f4a6e71f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:38:58.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.283+0000 7f4a6e71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5d93e872-363b-498b-b665-658644296b85.4535.12 2024-03-09T14:38:58.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.286+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo 2024-03-09T14:38:58.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.286+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6006f220 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55de8139f308 s->prefetch_data=0 2024-03-09T14:38:58.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.287+0000 7f4a6e71f800 10 manifest: total_size = 886297 2024-03-09T14:38:58.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.287+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.2660220837802682174 2024-03-09T14:38:58.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.287+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6006f220 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55de8139f308 s->prefetch_data=0 2024-03-09T14:38:58.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.287+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de8139f308 2024-03-09T14:38:58.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.287+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.12.10 2024-03-09T14:38:58.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-09T14:38:58.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-03-09T14:38:58.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-03-09T14:38:58.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-09T14:38:58.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-03-09T14:38:58.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-03-09T14:38:58.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-09T14:38:58.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-03-09T14:38:58.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-03-09T14:38:58.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-03-09T14:38:58.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-03-09T14:38:58.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-03-09T14:38:58.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.2660220837802682174 2024-03-09T14:38:58.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.12__multipart_foo.2~8MS8pGFK7fS6GSn_ehGHEzPX1ye_UcG.1 2024-03-09T14:38:58.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-03-09T14:38:58.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.12__multipart_foo.2~8MS8pGFK7fS6GSn_ehGHEzPX1ye_UcG.2 2024-03-09T14:38:58.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-03-09T14:38:58.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.12__multipart_foo.2~8MS8pGFK7fS6GSn_ehGHEzPX1ye_UcG.3 2024-03-09T14:38:58.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-03-09T14:38:58.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.12__multipart_foo.2~8MS8pGFK7fS6GSn_ehGHEzPX1ye_UcG.4 2024-03-09T14:38:58.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-03-09T14:38:58.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.289+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 5d93e872-363b-498b-b665-658644296b85.4535.2660220837802682174 2024-03-09T14:38:58.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.290+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo 2024-03-09T14:38:58.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.291+0000 7f4a6e71f800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:38:58.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.291+0000 7f4a6e71f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:38:58.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.292+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:38:58.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.292+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:38:58.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.292+0000 7f4a6e71f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:38:58.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.292+0000 7f4a6e71f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:38:58.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.292+0000 7f4a6e71f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[5d93e872-363b-498b-b665-658644296b85.4535.12])"; uploads.size()=0; is_truncated=0 2024-03-09T14:38:58.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.293+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-03-09T14:38:58.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.293+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.294+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=242 2024-03-09T14:38:58.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.294+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-03-09T14:38:58.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.294+0000 7f4a6e71f800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-03-09T14:38:58.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.295+0000 7f4a6e71f800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-03-09T14:38:58.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.295+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-03-09T14:38:58.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.295+0000 7f494dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529676 cookie 94414138768064 notifier 5663 bl.length()=198 2024-03-09T14:38:58.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.298+0000 7f4a6e71f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5d93e872-363b-498b-b665-658644296b85.4535.12 from cache 2024-03-09T14:38:58.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.298+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5d93e872-363b-498b-b665-658644296b85.4535.12, ofs0, ns] 2024-03-09T14:38:58.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.298+0000 7f494d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529737 cookie 94414138758848 notifier 5663 bl.length()=256 2024-03-09T14:38:58.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.304+0000 7f4a6e71f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/5d93e872-363b-498b-b665-658644296b85.4535.12 : miss 2024-03-09T14:38:58.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.304+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.305+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.305+0000 7f4a6e71f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/5d93e872-363b-498b-b665-658644296b85.4535.12 info.flags=0x0 2024-03-09T14:38:58.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.305+0000 7f4a6e71f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/5d93e872-363b-498b-b665-658644296b85.4535.12 to cache LRU end 2024-03-09T14:38:58.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.307+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5d93e872-363b-498b-b665-658644296b85.4535.10 : miss 2024-03-09T14:38:58.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.307+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.307+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=451 2024-03-09T14:38:58.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.307+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5d93e872-363b-498b-b665-658644296b85.4535.10 info.flags=0x17 2024-03-09T14:38:58.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.307+0000 7f4a6e71f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5d93e872-363b-498b-b665-658644296b85.4535.10 to cache LRU end 2024-03-09T14:38:58.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.307+0000 7f4a6e71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:58.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.307+0000 7f4a6e71f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:38:58.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.308+0000 7f4a6e71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5d93e872-363b-498b-b665-658644296b85.4535.10 2024-03-09T14:38:58.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.311+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo[VViiOkhhunL0raxPu9Nj.lybwrTy56q] 2024-03-09T14:38:58.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.311+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.10.10 2024-03-09T14:38:58.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.312+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6000fff0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55de81338108 s->prefetch_data=0 2024-03-09T14:38:58.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.312+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 0otvdmna7cx5q4y19etiacv46agh70ky 2024-03-09T14:38:58.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.312+0000 7f4a6e71f800 20 get_obj_state_impl: setting s->olh_tag to iop001aod0dd87r068bqpkpqigyjkdd5 2024-03-09T14:38:58.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.312+0000 7f4a6e71f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=iop001aod0dd87r068bqpkpqigyjkdd5 2024-03-09T14:38:58.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.313+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.10.10 2024-03-09T14:38:58.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.314+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.10.10 2024-03-09T14:38:58.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.315+0000 7f4a6e71f800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-03-09T14:38:58.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.315+0000 7f4a6e71f800 20 olh_log_entry: epoch=3 op=3 key=foo[VViiOkhhunL0raxPu9Nj.lybwrTy56q] 2024-03-09T14:38:58.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.315+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6000fff0 obj=test-client.0-r-test-multipart-index-versioning.1:_:VViiOkhhunL0raxPu9Nj.lybwrTy56q_foo state=0x55de81337288 s->prefetch_data=0 2024-03-09T14:38:58.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.315+0000 7f4a6e71f800 10 manifest: total_size = 74198 2024-03-09T14:38:58.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.315+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.12962140939360709960 2024-03-09T14:38:58.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.315+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6000fff0 obj=test-client.0-r-test-multipart-index-versioning.1:_:VViiOkhhunL0raxPu9Nj.lybwrTy56q_foo state=0x55de81337288 s->prefetch_data=0 2024-03-09T14:38:58.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.315+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81337288 2024-03-09T14:38:58.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.315+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.10.10 2024-03-09T14:38:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-03-09T14:38:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-03-09T14:38:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-03-09T14:38:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-03-09T14:38:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-03-09T14:38:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-03-09T14:38:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-03-09T14:38:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-03-09T14:38:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-03-09T14:38:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-03-09T14:38:58.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-03-09T14:38:58.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-03-09T14:38:58.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.12962140939360709960 2024-03-09T14:38:58.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.10__multipart_foo.2~SCv3RcY2iKUR_zepid1qU8MifKpmeTL.1 2024-03-09T14:38:58.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-03-09T14:38:58.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.10__multipart_foo.2~SCv3RcY2iKUR_zepid1qU8MifKpmeTL.2 2024-03-09T14:38:58.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-03-09T14:38:58.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.10__multipart_foo.2~SCv3RcY2iKUR_zepid1qU8MifKpmeTL.3 2024-03-09T14:38:58.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-03-09T14:38:58.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.10__multipart_foo.2~SCv3RcY2iKUR_zepid1qU8MifKpmeTL.4 2024-03-09T14:38:58.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-03-09T14:38:58.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.317+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 5d93e872-363b-498b-b665-658644296b85.4535.12962140939360709960 2024-03-09T14:38:58.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.318+0000 7f494dffb640 20 handle_completion(): completion ok for obj=foo[VViiOkhhunL0raxPu9Nj.lybwrTy56q] 2024-03-09T14:38:58.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.320+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6000fff0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55de81338108 s->prefetch_data=0 2024-03-09T14:38:58.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.321+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.10.10 2024-03-09T14:38:58.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.322+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.10.10 2024-03-09T14:38:58.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.322+0000 7f4a6e71f800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:38:58.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.322+0000 7f4a6e71f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:38:58.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.323+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:38:58.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.323+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:38:58.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.323+0000 7f4a6e71f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:38:58.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.323+0000 7f4a6e71f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:38:58.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.323+0000 7f4a6e71f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[5d93e872-363b-498b-b665-658644296b85.4535.10])"; uploads.size()=0; is_truncated=0 2024-03-09T14:38:58.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.324+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-03-09T14:38:58.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.324+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.325+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=237 2024-03-09T14:38:58.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.325+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-03-09T14:38:58.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.325+0000 7f4a6e71f800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-03-09T14:38:58.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.325+0000 7f4a6e71f800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-03-09T14:38:58.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.325+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-03-09T14:38:58.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.326+0000 7f494d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529677 cookie 94414138768064 notifier 5663 bl.length()=193 2024-03-09T14:38:58.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.329+0000 7f4a6e71f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5d93e872-363b-498b-b665-658644296b85.4535.10 from cache 2024-03-09T14:38:58.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.329+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5d93e872-363b-498b-b665-658644296b85.4535.10, ofs0, ns] 2024-03-09T14:38:58.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.329+0000 7f494dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529700 cookie 94414138773744 notifier 5663 bl.length()=251 2024-03-09T14:38:58.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.334+0000 7f4a6e71f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/5d93e872-363b-498b-b665-658644296b85.4535.10 : miss 2024-03-09T14:38:58.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.334+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.334+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.334+0000 7f4a6e71f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/5d93e872-363b-498b-b665-658644296b85.4535.10 info.flags=0x0 2024-03-09T14:38:58.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.334+0000 7f4a6e71f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/5d93e872-363b-498b-b665-658644296b85.4535.10 to cache LRU end 2024-03-09T14:38:58.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.336+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5d93e872-363b-498b-b665-658644296b85.4535.9 : miss 2024-03-09T14:38:58.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.336+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.337+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=439 2024-03-09T14:38:58.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.337+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5d93e872-363b-498b-b665-658644296b85.4535.9 info.flags=0x17 2024-03-09T14:38:58.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.337+0000 7f4a6e71f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5d93e872-363b-498b-b665-658644296b85.4535.9 to cache LRU end 2024-03-09T14:38:58.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.337+0000 7f4a6e71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:58.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.337+0000 7f4a6e71f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:38:58.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.337+0000 7f4a6e71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5d93e872-363b-498b-b665-658644296b85.4535.9 2024-03-09T14:38:58.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.340+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo 2024-03-09T14:38:58.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.340+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de81383200 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55de81337288 s->prefetch_data=0 2024-03-09T14:38:58.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.341+0000 7f4a6e71f800 10 manifest: total_size = 886297 2024-03-09T14:38:58.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.341+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.5585965323241947299 2024-03-09T14:38:58.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.341+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de81383200 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55de81337288 s->prefetch_data=0 2024-03-09T14:38:58.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.341+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81337288 2024-03-09T14:38:58.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.341+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.9.10 2024-03-09T14:38:58.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-09T14:38:58.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-03-09T14:38:58.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-03-09T14:38:58.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-09T14:38:58.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-03-09T14:38:58.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-03-09T14:38:58.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-09T14:38:58.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-03-09T14:38:58.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-03-09T14:38:58.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-03-09T14:38:58.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-03-09T14:38:58.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-03-09T14:38:58.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.5585965323241947299 2024-03-09T14:38:58.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.9__multipart_foo.2~gUW_pyiJrHWCBVi4kJe1ca8GpI5EKV2.1 2024-03-09T14:38:58.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2024-03-09T14:38:58.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.9__multipart_foo.2~gUW_pyiJrHWCBVi4kJe1ca8GpI5EKV2.2 2024-03-09T14:38:58.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 588 2024-03-09T14:38:58.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.9__multipart_foo.2~gUW_pyiJrHWCBVi4kJe1ca8GpI5EKV2.3 2024-03-09T14:38:58.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 832 2024-03-09T14:38:58.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.9__multipart_foo.2~gUW_pyiJrHWCBVi4kJe1ca8GpI5EKV2.4 2024-03-09T14:38:58.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1076 2024-03-09T14:38:58.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.343+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 5d93e872-363b-498b-b665-658644296b85.4535.5585965323241947299 2024-03-09T14:38:58.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.344+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo 2024-03-09T14:38:58.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.344+0000 7f4a6e71f800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:38:58.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.344+0000 7f4a6e71f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:38:58.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.345+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:38:58.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.345+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:38:58.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.345+0000 7f4a6e71f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:38:58.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.345+0000 7f4a6e71f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:38:58.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.345+0000 7f4a6e71f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[5d93e872-363b-498b-b665-658644296b85.4535.9])"; uploads.size()=0; is_truncated=0 2024-03-09T14:38:58.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.347+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-03-09T14:38:58.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.347+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.347+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=225 2024-03-09T14:38:58.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.347+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-03-09T14:38:58.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.347+0000 7f4a6e71f800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-03-09T14:38:58.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.348+0000 7f4a6e71f800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-03-09T14:38:58.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.348+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-03-09T14:38:58.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.349+0000 7f494dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529738 cookie 94414138775792 notifier 5663 bl.length()=183 2024-03-09T14:38:58.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.351+0000 7f4a6e71f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5d93e872-363b-498b-b665-658644296b85.4535.9 from cache 2024-03-09T14:38:58.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.351+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:5d93e872-363b-498b-b665-658644296b85.4535.9, ofs0, ns] 2024-03-09T14:38:58.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.351+0000 7f494d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529719 cookie 94414138756640 notifier 5663 bl.length()=240 2024-03-09T14:38:58.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.355+0000 7f4a6e71f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/5d93e872-363b-498b-b665-658644296b85.4535.9 : miss 2024-03-09T14:38:58.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.355+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.355+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.355+0000 7f4a6e71f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/5d93e872-363b-498b-b665-658644296b85.4535.9 info.flags=0x0 2024-03-09T14:38:58.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.355+0000 7f4a6e71f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/5d93e872-363b-498b-b665-658644296b85.4535.9 to cache LRU end 2024-03-09T14:38:58.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.357+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5d93e872-363b-498b-b665-658644296b85.4535.15 : miss 2024-03-09T14:38:58.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.357+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.358+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=447 2024-03-09T14:38:58.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.358+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5d93e872-363b-498b-b665-658644296b85.4535.15 info.flags=0x17 2024-03-09T14:38:58.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.358+0000 7f4a6e71f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5d93e872-363b-498b-b665-658644296b85.4535.15 to cache LRU end 2024-03-09T14:38:58.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.358+0000 7f4a6e71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:58.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.358+0000 7f4a6e71f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:38:58.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.358+0000 7f4a6e71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5d93e872-363b-498b-b665-658644296b85.4535.15 2024-03-09T14:38:58.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.358+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-03-09T14:38:58.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.359+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-03-09T14:38:58.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.359+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-09T14:38:58.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.360+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-03-09T14:38:58.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.360+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-03-09T14:38:58.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.360+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-09T14:38:58.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.361+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-03-09T14:38:58.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.361+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-09T14:38:58.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.361+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-03-09T14:38:58.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.361+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-03-09T14:38:58.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.361+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-03-09T14:38:58.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.361+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-03-09T14:38:58.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.362+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de8137cd40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.362+0000 7f4a6e71f800 10 manifest: total_size = 22651 2024-03-09T14:38:58.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.362+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to _NXS0qq8_ijFIZt_-sRFJIQ7jg6MqI-C 2024-03-09T14:38:58.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.362+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de8137cd40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.362+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.362+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.15.0 2024-03-09T14:38:58.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.364+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.364+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.364+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: _NXS0qq8_ijFIZt_-sRFJIQ7jg6MqI-C 2024-03-09T14:38:58.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.364+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.364+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.AEz6QF8TQDvQAVeLbX1oxUSGqrIWrb7_0 2024-03-09T14:38:58.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.364+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-09T14:38:58.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.364+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.364+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _NXS0qq8_ijFIZt_-sRFJIQ7jg6MqI-C 2024-03-09T14:38:58.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.365+0000 7f494dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-03-09T14:38:58.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.365+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de8137cd40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.366+0000 7f4a6e71f800 10 manifest: total_size = 5242880 2024-03-09T14:38:58.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.366+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to _ToFkVamBo-wzMmTXbuCwfMNuSp7pbii 2024-03-09T14:38:58.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.366+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de8137cd40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.366+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.366+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.15.2 2024-03-09T14:38:58.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.368+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.368+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.368+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: _ToFkVamBo-wzMmTXbuCwfMNuSp7pbii 2024-03-09T14:38:58.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.368+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.368+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.B5E0LEDV-HAy3fYIzXh6DNoNUT7MkKI_1 2024-03-09T14:38:58.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.368+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-09T14:38:58.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.368+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.368+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _ToFkVamBo-wzMmTXbuCwfMNuSp7pbii 2024-03-09T14:38:58.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.369+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-03-09T14:38:58.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.369+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.370+0000 7f4a6e71f800 10 manifest: total_size = 5242880 2024-03-09T14:38:58.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.370+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.5900966760691061218 2024-03-09T14:38:58.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.370+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.370+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.370+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.15.3 2024-03-09T14:38:58.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.372+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.372+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.372+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.372+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.372+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.5900966760691061218 2024-03-09T14:38:58.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.372+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.372+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.jtWI45HiMo7lXBzZFFlXiRJNXKwNyZ6_0 2024-03-09T14:38:58.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.372+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-03-09T14:38:58.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.372+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.jtWI45HiMo7lXBzZFFlXiRJNXKwNyZ6_1 2024-03-09T14:38:58.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.372+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-03-09T14:38:58.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.372+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.372+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 5d93e872-363b-498b-b665-658644296b85.4535.5900966760691061218 2024-03-09T14:38:58.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.373+0000 7f494dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-09T14:38:58.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.373+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c880 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.374+0000 7f4a6e71f800 10 manifest: total_size = 5242880 2024-03-09T14:38:58.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.374+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to _kOA6h9WCN3wrn1hVR4pSdBx12PqsELS 2024-03-09T14:38:58.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.374+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c880 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.374+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.374+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.15.5 2024-03-09T14:38:58.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.377+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.377+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.377+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.377+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.377+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: _kOA6h9WCN3wrn1hVR4pSdBx12PqsELS 2024-03-09T14:38:58.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.377+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.377+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.8xJbHkn8SxR-qQauhBu32d53BIBK2g7_0 2024-03-09T14:38:58.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.377+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-09T14:38:58.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.377+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.8xJbHkn8SxR-qQauhBu32d53BIBK2g7_1 2024-03-09T14:38:58.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.377+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-03-09T14:38:58.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.377+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.377+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _kOA6h9WCN3wrn1hVR4pSdBx12PqsELS 2024-03-09T14:38:58.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.378+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c880 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.378+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-03-09T14:38:58.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.378+0000 7f4a6e71f800 10 manifest: total_size = 5242880 2024-03-09T14:38:58.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.378+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to _i0TpZXnGlLlChfMoCDrTZ0sRIYJqlGL 2024-03-09T14:38:58.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.378+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c880 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.378+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.378+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.15.5 2024-03-09T14:38:58.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.381+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.381+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.381+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.381+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.381+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: _i0TpZXnGlLlChfMoCDrTZ0sRIYJqlGL 2024-03-09T14:38:58.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.381+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.381+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.dA_zXQLvmZScSd00gj3wC96QMkEXPxB_0 2024-03-09T14:38:58.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.381+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-09T14:38:58.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.381+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.dA_zXQLvmZScSd00gj3wC96QMkEXPxB_1 2024-03-09T14:38:58.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.381+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-03-09T14:38:58.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.381+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.381+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _i0TpZXnGlLlChfMoCDrTZ0sRIYJqlGL 2024-03-09T14:38:58.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.382+0000 7f494dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-03-09T14:38:58.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.382+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c880 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.382+0000 7f4a6e71f800 10 manifest: total_size = 22651 2024-03-09T14:38:58.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.382+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.7343066411917593979 2024-03-09T14:38:58.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.382+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c880 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.382+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.382+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.15.5 2024-03-09T14:38:58.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.385+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.385+0000 7f4a6e71f800 10 manifest: total_size = 5242880 2024-03-09T14:38:58.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.385+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to _-Avkg243ljd_p-KnIRp9onCMgernPWP 2024-03-09T14:38:58.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.385+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.385+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.385+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.15.7 2024-03-09T14:38:58.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.386+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-09T14:38:58.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.388+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.388+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.388+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: _-Avkg243ljd_p-KnIRp9onCMgernPWP 2024-03-09T14:38:58.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.388+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.388+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.6kYG1TJini1PsCBHGQaKxSJ-7ZsTSYu_1 2024-03-09T14:38:58.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.388+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-09T14:38:58.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.388+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.388+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _-Avkg243ljd_p-KnIRp9onCMgernPWP 2024-03-09T14:38:58.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.389+0000 7f494dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-03-09T14:38:58.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.389+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.390+0000 7f4a6e71f800 10 manifest: total_size = 5242880 2024-03-09T14:38:58.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.390+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.1207189700594557683 2024-03-09T14:38:58.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.390+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.390+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.390+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.15.7 2024-03-09T14:38:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.392+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.392+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.392+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.392+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.392+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.1207189700594557683 2024-03-09T14:38:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.392+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.392+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.bRGqiXmEiruuv0SsyijSOyVt66G4K9D_0 2024-03-09T14:38:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.392+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-03-09T14:38:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.392+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.bRGqiXmEiruuv0SsyijSOyVt66G4K9D_1 2024-03-09T14:38:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.392+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-03-09T14:38:58.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.392+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.392+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 5d93e872-363b-498b-b665-658644296b85.4535.1207189700594557683 2024-03-09T14:38:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.393+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.393+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-09T14:38:58.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.393+0000 7f4a6e71f800 10 manifest: total_size = 22651 2024-03-09T14:38:58.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.393+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to _LD_IMfLIW45vbrz_6IBf1BidD4PIjY6 2024-03-09T14:38:58.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.393+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.393+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.393+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.15.7 2024-03-09T14:38:58.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.396+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.396+0000 7f4a6e71f800 10 manifest: total_size = 5242880 2024-03-09T14:38:58.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.396+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.396+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.396+0000 7f4a6e71f800 10 generate_fake_tag new tag=5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.bRGqiXmEiruuv0SsyijSOyVt66G4K9D_1_79dbdc839ee4f65f864eef0f937b3fb9 2024-03-09T14:38:58.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.396+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.bRGqiXmEiruuv0SsyijSOyVt66G4K9D_1_79dbdc839ee4f65f864eef0f937b3fb9 2024-03-09T14:38:58.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.396+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.396+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.396+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.15.8 2024-03-09T14:38:58.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.397+0000 7f494dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-03-09T14:38:58.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.398+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.398+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.398+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.398+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.398+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.bRGqiXmEiruuv0SsyijSOyVt66G4K9D_1_79dbdc839ee4f65f864eef0f937b3fb9 2024-03-09T14:38:58.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.398+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.398+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.bRGqiXmEiruuv0SsyijSOyVt66G4K9D_0 2024-03-09T14:38:58.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.398+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 398 2024-03-09T14:38:58.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.398+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.bRGqiXmEiruuv0SsyijSOyVt66G4K9D_1 2024-03-09T14:38:58.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.398+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 637 2024-03-09T14:38:58.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.398+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.398+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.bRGqiXmEiruuv0SsyijSOyVt66G4K9D_1_79dbdc839ee4f65f864eef0f937b3fb9 2024-03-09T14:38:58.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.400+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-03-09T14:38:58.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.400+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.400+0000 7f4a6e71f800 10 manifest: total_size = 22651 2024-03-09T14:38:58.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.400+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to _XmUW5owa_8MwFWsEf08KrMRjhpUXWYX 2024-03-09T14:38:58.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.400+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.400+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.400+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.15.8 2024-03-09T14:38:58.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.402+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.402+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.402+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: _XmUW5owa_8MwFWsEf08KrMRjhpUXWYX 2024-03-09T14:38:58.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.402+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.402+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.9wYyLMElR3ZuKlECbJS8zCnG96DfrKD_0 2024-03-09T14:38:58.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.402+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-09T14:38:58.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.402+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.402+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _XmUW5owa_8MwFWsEf08KrMRjhpUXWYX 2024-03-09T14:38:58.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.404+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c880 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.404+0000 7f494dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-03-09T14:38:58.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.404+0000 7f4a6e71f800 10 manifest: total_size = 5242880 2024-03-09T14:38:58.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.404+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.404+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.404+0000 7f4a6e71f800 10 generate_fake_tag new tag=5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.jtWI45HiMo7lXBzZFFlXiRJNXKwNyZ6_1_c8a14ad8555acce6468ff6f7f897b947 2024-03-09T14:38:58.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.404+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.jtWI45HiMo7lXBzZFFlXiRJNXKwNyZ6_1_c8a14ad8555acce6468ff6f7f897b947 2024-03-09T14:38:58.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.404+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c880 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.404+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.404+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.15.9 2024-03-09T14:38:58.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.406+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.406+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.406+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.406+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.406+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.jtWI45HiMo7lXBzZFFlXiRJNXKwNyZ6_1_c8a14ad8555acce6468ff6f7f897b947 2024-03-09T14:38:58.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.406+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.406+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.jtWI45HiMo7lXBzZFFlXiRJNXKwNyZ6_0 2024-03-09T14:38:58.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.406+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 396 2024-03-09T14:38:58.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.406+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.jtWI45HiMo7lXBzZFFlXiRJNXKwNyZ6_1 2024-03-09T14:38:58.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.406+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-03-09T14:38:58.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.406+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.406+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.jtWI45HiMo7lXBzZFFlXiRJNXKwNyZ6_1_c8a14ad8555acce6468ff6f7f897b947 2024-03-09T14:38:58.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.407+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-03-09T14:38:58.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.407+0000 7f4a6e71f800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:38:58.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.407+0000 7f4a6e71f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:38:58.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.408+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:38:58.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.408+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:38:58.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.408+0000 7f4a6e71f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:38:58.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.408+0000 7f4a6e71f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:38:58.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.408+0000 7f4a6e71f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[5d93e872-363b-498b-b665-658644296b85.4535.15])"; uploads.size()=0; is_truncated=0 2024-03-09T14:38:58.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.410+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-03-09T14:38:58.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.410+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.410+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=233 2024-03-09T14:38:58.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.410+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-03-09T14:38:58.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.410+0000 7f4a6e71f800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-03-09T14:38:58.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.411+0000 7f4a6e71f800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-03-09T14:38:58.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.411+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-03-09T14:38:58.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.411+0000 7f494dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529678 cookie 94414138768064 notifier 5663 bl.length()=189 2024-03-09T14:38:58.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.414+0000 7f4a6e71f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5d93e872-363b-498b-b665-658644296b85.4535.15 from cache 2024-03-09T14:38:58.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.414+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5d93e872-363b-498b-b665-658644296b85.4535.15, ofs0, ns] 2024-03-09T14:38:58.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.414+0000 7f494d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529701 cookie 94414138773744 notifier 5663 bl.length()=247 2024-03-09T14:38:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.417+0000 7f4a6e71f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/5d93e872-363b-498b-b665-658644296b85.4535.15 : miss 2024-03-09T14:38:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.417+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.418+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.418+0000 7f4a6e71f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/5d93e872-363b-498b-b665-658644296b85.4535.15 info.flags=0x0 2024-03-09T14:38:58.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.418+0000 7f4a6e71f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/5d93e872-363b-498b-b665-658644296b85.4535.15 to cache LRU end 2024-03-09T14:38:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.420+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5d93e872-363b-498b-b665-658644296b85.4535.16 : miss 2024-03-09T14:38:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.420+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.420+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=457 2024-03-09T14:38:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.420+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5d93e872-363b-498b-b665-658644296b85.4535.16 info.flags=0x17 2024-03-09T14:38:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.420+0000 7f4a6e71f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5d93e872-363b-498b-b665-658644296b85.4535.16 to cache LRU end 2024-03-09T14:38:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.420+0000 7f4a6e71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.420+0000 7f4a6e71f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:38:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.420+0000 7f4a6e71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5d93e872-363b-498b-b665-658644296b85.4535.16 2024-03-09T14:38:58.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.421+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-03-09T14:38:58.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.422+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-03-09T14:38:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.422+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-09T14:38:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.423+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-03-09T14:38:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.423+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-03-09T14:38:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.423+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-09T14:38:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.424+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-03-09T14:38:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.424+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-09T14:38:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.424+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-03-09T14:38:58.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.424+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-03-09T14:38:58.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.424+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-03-09T14:38:58.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.424+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-03-09T14:38:58.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.425+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de81383200 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.425+0000 7f4a6e71f800 10 manifest: total_size = 1087 2024-03-09T14:38:58.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.425+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to _KcrFsIgr7SaND15OeRYdTlPAi9r-sM9 2024-03-09T14:38:58.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.425+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de81383200 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.425+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.425+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.16.0 2024-03-09T14:38:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.427+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.427+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.427+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: _KcrFsIgr7SaND15OeRYdTlPAi9r-sM9 2024-03-09T14:38:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.427+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.427+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.F4KfXIuWZqxsfemaROlaLqa55ODa3Kv_0 2024-03-09T14:38:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.427+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-09T14:38:58.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.427+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.427+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _KcrFsIgr7SaND15OeRYdTlPAi9r-sM9 2024-03-09T14:38:58.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.429+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6000c030 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.429+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-03-09T14:38:58.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.429+0000 7f4a6e71f800 10 manifest: total_size = 11534336 2024-03-09T14:38:58.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.429+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to _6qxzxfSE2zqFM3iZQoLYAI21-lghLFP 2024-03-09T14:38:58.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.429+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6000c030 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.429+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.429+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.16.2 2024-03-09T14:38:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.432+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.432+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.432+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.432+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.432+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: _6qxzxfSE2zqFM3iZQoLYAI21-lghLFP 2024-03-09T14:38:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.432+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.432+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.maRkvruhOmaP4WnLgb6lK_hQGvYArDD_1 2024-03-09T14:38:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.432+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-09T14:38:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.432+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.maRkvruhOmaP4WnLgb6lK_hQGvYArDD_2 2024-03-09T14:38:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.432+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-03-09T14:38:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.432+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.432+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _6qxzxfSE2zqFM3iZQoLYAI21-lghLFP 2024-03-09T14:38:58.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.433+0000 7f494dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-03-09T14:38:58.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.433+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c09b4c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.434+0000 7f4a6e71f800 10 manifest: total_size = 11534336 2024-03-09T14:38:58.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.434+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.14008001577541680239 2024-03-09T14:38:58.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.434+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c09b4c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.434+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.434+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.16.3 2024-03-09T14:38:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:38:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:38:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:38:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:38:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.14008001577541680239 2024-03-09T14:38:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.1 2024-03-09T14:38:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-03-09T14:38:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.1_1 2024-03-09T14:38:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-03-09T14:38:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.2 2024-03-09T14:38:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-03-09T14:38:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.2_1 2024-03-09T14:38:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-03-09T14:38:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.3 2024-03-09T14:38:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-03-09T14:38:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.436+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 5d93e872-363b-498b-b665-658644296b85.4535.14008001577541680239 2024-03-09T14:38:58.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.437+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-09T14:38:58.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.437+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de8139fd40 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.438+0000 7f4a6e71f800 10 manifest: total_size = 11534336 2024-03-09T14:38:58.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.438+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to _h1eJbveyQBh3m5574UmZJ6Vb3_5g57C 2024-03-09T14:38:58.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.438+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de8139fd40 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.438+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.438+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.16.5 2024-03-09T14:38:58.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: _h1eJbveyQBh3m5574UmZJ6Vb3_5g57C 2024-03-09T14:38:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.jAPjlIeTembttvTmA6tJ9Zk8X48Nk7n_0 2024-03-09T14:38:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-09T14:38:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.jAPjlIeTembttvTmA6tJ9Zk8X48Nk7n_1 2024-03-09T14:38:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-03-09T14:38:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.jAPjlIeTembttvTmA6tJ9Zk8X48Nk7n_2 2024-03-09T14:38:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-03-09T14:38:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.440+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _h1eJbveyQBh3m5574UmZJ6Vb3_5g57C 2024-03-09T14:38:58.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.441+0000 7f494dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-03-09T14:38:58.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.442+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c09b4c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.442+0000 7f4a6e71f800 10 manifest: total_size = 11534336 2024-03-09T14:38:58.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.442+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to _s-44dG5yqeVyUV2q27NP-6VbDGQUSux 2024-03-09T14:38:58.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.442+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c09b4c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.442+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.442+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.16.5 2024-03-09T14:38:58.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: _s-44dG5yqeVyUV2q27NP-6VbDGQUSux 2024-03-09T14:38:58.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.T5u9FIkU6_KYdljQL81Pmhjgz964BRZ_0 2024-03-09T14:38:58.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-09T14:38:58.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.T5u9FIkU6_KYdljQL81Pmhjgz964BRZ_1 2024-03-09T14:38:58.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-03-09T14:38:58.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.T5u9FIkU6_KYdljQL81Pmhjgz964BRZ_2 2024-03-09T14:38:58.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-03-09T14:38:58.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.444+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _s-44dG5yqeVyUV2q27NP-6VbDGQUSux 2024-03-09T14:38:58.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.445+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-03-09T14:38:58.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.446+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c9a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.446+0000 7f4a6e71f800 10 manifest: total_size = 1087 2024-03-09T14:38:58.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.446+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.4807286568122487429 2024-03-09T14:38:58.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.446+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c9a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.446+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.446+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.16.5 2024-03-09T14:38:58.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:38:58.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-03-09T14:38:58.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-03-09T14:38:58.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:38:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-03-09T14:38:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-03-09T14:38:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-03-09T14:38:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=55 2024-03-09T14:38:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-03-09T14:38:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.4807286568122487429 2024-03-09T14:38:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.1 2024-03-09T14:38:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-03-09T14:38:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.2 2024-03-09T14:38:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-03-09T14:38:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.3 2024-03-09T14:38:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-03-09T14:38:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.448+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 5d93e872-363b-498b-b665-658644296b85.4535.4807286568122487429 2024-03-09T14:38:58.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.450+0000 7f494dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-09T14:38:58.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.450+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c001810 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.450+0000 7f4a6e71f800 10 manifest: total_size = 11534336 2024-03-09T14:38:58.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.450+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to _HlXaIHoAT2Nk50weNyt7PD8JA16hfDl 2024-03-09T14:38:58.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.450+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c001810 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.450+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.450+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.16.7 2024-03-09T14:38:58.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.452+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.452+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.452+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.452+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.452+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: _HlXaIHoAT2Nk50weNyt7PD8JA16hfDl 2024-03-09T14:38:58.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.452+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.452+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.qN3TIL_-AQ2gW95li3KjdcpN-5gqquQ_1 2024-03-09T14:38:58.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.452+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-09T14:38:58.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.452+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.qN3TIL_-AQ2gW95li3KjdcpN-5gqquQ_2 2024-03-09T14:38:58.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.452+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-03-09T14:38:58.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.452+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.452+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _HlXaIHoAT2Nk50weNyt7PD8JA16hfDl 2024-03-09T14:38:58.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.453+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-03-09T14:38:58.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.454+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c001810 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.454+0000 7f4a6e71f800 10 manifest: total_size = 11534336 2024-03-09T14:38:58.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.454+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.3463609096063432335 2024-03-09T14:38:58.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.454+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c001810 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.454+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.454+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.16.7 2024-03-09T14:38:58.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:38:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:38:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:38:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:38:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.3463609096063432335 2024-03-09T14:38:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.1 2024-03-09T14:38:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-03-09T14:38:58.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.1_1 2024-03-09T14:38:58.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-03-09T14:38:58.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.2 2024-03-09T14:38:58.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-03-09T14:38:58.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.2_1 2024-03-09T14:38:58.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-03-09T14:38:58.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.3 2024-03-09T14:38:58.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-03-09T14:38:58.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.456+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 5d93e872-363b-498b-b665-658644296b85.4535.3463609096063432335 2024-03-09T14:38:58.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.457+0000 7f494dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-09T14:38:58.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.457+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c9a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.458+0000 7f4a6e71f800 10 manifest: total_size = 1087 2024-03-09T14:38:58.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.458+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:38:58.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.458+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-03-09T14:38:58.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.458+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-03-09T14:38:58.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.458+0000 7f4a6e71f800 10 generate_fake_tag new tag=5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.2_d11d09c0760f96b2ef3154947dd73449 2024-03-09T14:38:58.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.458+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.2_d11d09c0760f96b2ef3154947dd73449 2024-03-09T14:38:58.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.458+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6407c9a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.458+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.458+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.16.7 2024-03-09T14:38:58.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:38:58.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-03-09T14:38:58.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-03-09T14:38:58.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:38:58.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-03-09T14:38:58.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-03-09T14:38:58.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-03-09T14:38:58.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=55 2024-03-09T14:38:58.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-03-09T14:38:58.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.2_d11d09c0760f96b2ef3154947dd73449 2024-03-09T14:38:58.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.1 2024-03-09T14:38:58.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2024-03-09T14:38:58.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.2 2024-03-09T14:38:58.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 704 2024-03-09T14:38:58.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.3 2024-03-09T14:38:58.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 968 2024-03-09T14:38:58.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.460+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.2_d11d09c0760f96b2ef3154947dd73449 2024-03-09T14:38:58.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.461+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-03-09T14:38:58.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.461+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813380a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.462+0000 7f4a6e71f800 10 manifest: total_size = 11534336 2024-03-09T14:38:58.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.462+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.462+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.462+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.462+0000 7f4a6e71f800 10 generate_fake_tag new tag=5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.1_1_233607a54e92919d7d9a8e02002add61 2024-03-09T14:38:58.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.462+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.1_1_233607a54e92919d7d9a8e02002add61 2024-03-09T14:38:58.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.462+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813380a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.462+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.462+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.16.8 2024-03-09T14:38:58.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:38:58.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:38:58.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:38:58.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:38:58.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.1_1_233607a54e92919d7d9a8e02002add61 2024-03-09T14:38:58.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.1 2024-03-09T14:38:58.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 448 2024-03-09T14:38:58.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.1_1 2024-03-09T14:38:58.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 719 2024-03-09T14:38:58.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.2 2024-03-09T14:38:58.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 992 2024-03-09T14:38:58.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.2_1 2024-03-09T14:38:58.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1263 2024-03-09T14:38:58.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.3 2024-03-09T14:38:58.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1536 2024-03-09T14:38:58.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.464+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.1_1_233607a54e92919d7d9a8e02002add61 2024-03-09T14:38:58.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.465+0000 7f494dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-03-09T14:38:58.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.465+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.466+0000 7f4a6e71f800 10 manifest: total_size = 1087 2024-03-09T14:38:58.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.466+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to _aKbgNUMMe0Ry89v1DsTMd00u2J5w6Z2 2024-03-09T14:38:58.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.466+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.466+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.466+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.16.8 2024-03-09T14:38:58.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.468+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.468+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.468+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: _aKbgNUMMe0Ry89v1DsTMd00u2J5w6Z2 2024-03-09T14:38:58.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.468+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.468+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.vC8U2_S69GWmGtCB-y-P1wuNPbTCvV4_0 2024-03-09T14:38:58.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.468+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-09T14:38:58.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.468+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.468+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _aKbgNUMMe0Ry89v1DsTMd00u2J5w6Z2 2024-03-09T14:38:58.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.469+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.469+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-03-09T14:38:58.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.470+0000 7f4a6e71f800 10 manifest: total_size = 11534336 2024-03-09T14:38:58.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.470+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.470+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.470+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.470+0000 7f4a6e71f800 10 generate_fake_tag new tag=5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.1_1_5f3857a75db6caf06c290bbc31919872 2024-03-09T14:38:58.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.470+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.1_1_5f3857a75db6caf06c290bbc31919872 2024-03-09T14:38:58.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.470+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55de81396568 s->prefetch_data=0 2024-03-09T14:38:58.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.470+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81396568 2024-03-09T14:38:58.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.470+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.16.9 2024-03-09T14:38:58.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:38:58.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:38:58.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:38:58.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:38:58.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.1_1_5f3857a75db6caf06c290bbc31919872 2024-03-09T14:38:58.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.1 2024-03-09T14:38:58.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2024-03-09T14:38:58.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.1_1 2024-03-09T14:38:58.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 705 2024-03-09T14:38:58.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.2 2024-03-09T14:38:58.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 972 2024-03-09T14:38:58.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.2_1 2024-03-09T14:38:58.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1237 2024-03-09T14:38:58.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.3 2024-03-09T14:38:58.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1504 2024-03-09T14:38:58.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.472+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.1_1_5f3857a75db6caf06c290bbc31919872 2024-03-09T14:38:58.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.473+0000 7f494dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-03-09T14:38:58.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.474+0000 7f4a6e71f800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:38:58.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.474+0000 7f4a6e71f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:38:58.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.474+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:38:58.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.474+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:38:58.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.474+0000 7f4a6e71f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:38:58.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.474+0000 7f4a6e71f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:38:58.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.474+0000 7f4a6e71f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[5d93e872-363b-498b-b665-658644296b85.4535.16])"; uploads.size()=0; is_truncated=0 2024-03-09T14:38:58.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.476+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-03-09T14:38:58.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.476+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.477+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=243 2024-03-09T14:38:58.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.477+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-03-09T14:38:58.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.477+0000 7f4a6e71f800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-03-09T14:38:58.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.478+0000 7f4a6e71f800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-03-09T14:38:58.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.478+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-03-09T14:38:58.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.478+0000 7f494dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529676 cookie 94414138769120 notifier 5663 bl.length()=199 2024-03-09T14:38:58.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.480+0000 7f4a6e71f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5d93e872-363b-498b-b665-658644296b85.4535.16 from cache 2024-03-09T14:38:58.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.480+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5d93e872-363b-498b-b665-658644296b85.4535.16, ofs0, ns] 2024-03-09T14:38:58.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.481+0000 7f494d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529720 cookie 94414138756640 notifier 5663 bl.length()=257 2024-03-09T14:38:58.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.484+0000 7f4a6e71f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/5d93e872-363b-498b-b665-658644296b85.4535.16 : miss 2024-03-09T14:38:58.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.484+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.485+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.485+0000 7f4a6e71f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/5d93e872-363b-498b-b665-658644296b85.4535.16 info.flags=0x0 2024-03-09T14:38:58.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.485+0000 7f4a6e71f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/5d93e872-363b-498b-b665-658644296b85.4535.16 to cache LRU end 2024-03-09T14:38:58.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.487+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5d93e872-363b-498b-b665-658644296b85.4535.14 : miss 2024-03-09T14:38:58.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.487+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.487+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=452 2024-03-09T14:38:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.487+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5d93e872-363b-498b-b665-658644296b85.4535.14 info.flags=0x17 2024-03-09T14:38:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.487+0000 7f4a6e71f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5d93e872-363b-498b-b665-658644296b85.4535.14 to cache LRU end 2024-03-09T14:38:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.487+0000 7f4a6e71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.487+0000 7f4a6e71f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:38:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.487+0000 7f4a6e71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5d93e872-363b-498b-b665-658644296b85.4535.14 2024-03-09T14:38:58.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.489+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-09T14:38:58.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.489+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-09T14:38:58.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.491+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-09T14:38:58.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.492+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fccc0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55de8139b3e8 s->prefetch_data=0 2024-03-09T14:38:58.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.492+0000 7f4a6e71f800 10 manifest: total_size = 11534336 2024-03-09T14:38:58.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.492+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.6007763366985585920 2024-03-09T14:38:58.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.492+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fccc0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55de8139b3e8 s->prefetch_data=0 2024-03-09T14:38:58.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.492+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de8139b3e8 2024-03-09T14:38:58.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.492+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.14.3 2024-03-09T14:38:58.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:38:58.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:38:58.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:38:58.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:38:58.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.6007763366985585920 2024-03-09T14:38:58.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-FROZEN.2~DTk8hRuSzK_UfTkEk4laHlrW1P0Ew56.1 2024-03-09T14:38:58.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-03-09T14:38:58.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.14__shadow_foo-FROZEN.2~DTk8hRuSzK_UfTkEk4laHlrW1P0Ew56.1_1 2024-03-09T14:38:58.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-03-09T14:38:58.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-FROZEN.2~DTk8hRuSzK_UfTkEk4laHlrW1P0Ew56.2 2024-03-09T14:38:58.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-03-09T14:38:58.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.14__shadow_foo-FROZEN.2~DTk8hRuSzK_UfTkEk4laHlrW1P0Ew56.2_1 2024-03-09T14:38:58.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-03-09T14:38:58.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-FROZEN.2~DTk8hRuSzK_UfTkEk4laHlrW1P0Ew56.3 2024-03-09T14:38:58.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-03-09T14:38:58.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.494+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 5d93e872-363b-498b-b665-658644296b85.4535.6007763366985585920 2024-03-09T14:38:58.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.496+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-09T14:38:58.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.496+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fca20 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55de8139b3e8 s->prefetch_data=0 2024-03-09T14:38:58.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.496+0000 7f4a6e71f800 10 manifest: total_size = 11534336 2024-03-09T14:38:58.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.496+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.3502696965148644538 2024-03-09T14:38:58.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.496+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fca20 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55de8139b3e8 s->prefetch_data=0 2024-03-09T14:38:58.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.496+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de8139b3e8 2024-03-09T14:38:58.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.496+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.14.5 2024-03-09T14:38:58.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:38:58.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:38:58.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:38:58.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:38:58.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.3502696965148644538 2024-03-09T14:38:58.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-STANDARD.2~R-eNn3OKzO6qalVZ_HqEbwoXWozSboB.1 2024-03-09T14:38:58.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-03-09T14:38:58.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.14__shadow_foo-STANDARD.2~R-eNn3OKzO6qalVZ_HqEbwoXWozSboB.1_1 2024-03-09T14:38:58.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 626 2024-03-09T14:38:58.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-STANDARD.2~R-eNn3OKzO6qalVZ_HqEbwoXWozSboB.2 2024-03-09T14:38:58.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 890 2024-03-09T14:38:58.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.14__shadow_foo-STANDARD.2~R-eNn3OKzO6qalVZ_HqEbwoXWozSboB.2_1 2024-03-09T14:38:58.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1152 2024-03-09T14:38:58.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-STANDARD.2~R-eNn3OKzO6qalVZ_HqEbwoXWozSboB.3 2024-03-09T14:38:58.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1416 2024-03-09T14:38:58.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.499+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 5d93e872-363b-498b-b665-658644296b85.4535.3502696965148644538 2024-03-09T14:38:58.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.500+0000 7f494dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-09T14:38:58.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.500+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55de8139b3e8 s->prefetch_data=0 2024-03-09T14:38:58.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.500+0000 7f4a6e71f800 10 manifest: total_size = 11534336 2024-03-09T14:38:58.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.500+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.12576964596656894812 2024-03-09T14:38:58.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.500+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55de8139b3e8 s->prefetch_data=0 2024-03-09T14:38:58.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.500+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de8139b3e8 2024-03-09T14:38:58.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.500+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.14.7 2024-03-09T14:38:58.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-03-09T14:38:58.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:38:58.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:38:58.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:38:58.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:38:58.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:38:58.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:38:58.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.12576964596656894812 2024-03-09T14:38:58.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-LUKEWARM.2~So04ybmlWiaOlXP-lrgAhmdS5OWZTBj.1 2024-03-09T14:38:58.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-03-09T14:38:58.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.14__shadow_foo-LUKEWARM.2~So04ybmlWiaOlXP-lrgAhmdS5OWZTBj.1_1 2024-03-09T14:38:58.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-03-09T14:38:58.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-LUKEWARM.2~So04ybmlWiaOlXP-lrgAhmdS5OWZTBj.2 2024-03-09T14:38:58.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-03-09T14:38:58.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.14__shadow_foo-LUKEWARM.2~So04ybmlWiaOlXP-lrgAhmdS5OWZTBj.2_1 2024-03-09T14:38:58.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-03-09T14:38:58.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-LUKEWARM.2~So04ybmlWiaOlXP-lrgAhmdS5OWZTBj.3 2024-03-09T14:38:58.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-03-09T14:38:58.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.502+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 5d93e872-363b-498b-b665-658644296b85.4535.12576964596656894812 2024-03-09T14:38:58.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.503+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-09T14:38:58.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.504+0000 7f4a6e71f800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:38:58.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.504+0000 7f4a6e71f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:38:58.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.504+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:38:58.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.504+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:38:58.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.505+0000 7f4a6e71f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:38:58.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.505+0000 7f4a6e71f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:38:58.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.505+0000 7f4a6e71f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[5d93e872-363b-498b-b665-658644296b85.4535.14])"; uploads.size()=0; is_truncated=0 2024-03-09T14:38:58.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.506+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-03-09T14:38:58.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.506+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.507+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=238 2024-03-09T14:38:58.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.507+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-03-09T14:38:58.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.507+0000 7f4a6e71f800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-03-09T14:38:58.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.508+0000 7f4a6e71f800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-03-09T14:38:58.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.508+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-03-09T14:38:58.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.508+0000 7f494dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529702 cookie 94414138779984 notifier 5663 bl.length()=194 2024-03-09T14:38:58.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.510+0000 7f4a6e71f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5d93e872-363b-498b-b665-658644296b85.4535.14 from cache 2024-03-09T14:38:58.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.510+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5d93e872-363b-498b-b665-658644296b85.4535.14, ofs0, ns] 2024-03-09T14:38:58.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.511+0000 7f494dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529721 cookie 94414138756640 notifier 5663 bl.length()=252 2024-03-09T14:38:58.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.514+0000 7f4a6e71f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/5d93e872-363b-498b-b665-658644296b85.4535.14 : miss 2024-03-09T14:38:58.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.514+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.514+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.514+0000 7f4a6e71f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/5d93e872-363b-498b-b665-658644296b85.4535.14 info.flags=0x0 2024-03-09T14:38:58.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.514+0000 7f4a6e71f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/5d93e872-363b-498b-b665-658644296b85.4535.14 to cache LRU end 2024-03-09T14:38:58.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.516+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5d93e872-363b-498b-b665-658644296b85.4535.13 : miss 2024-03-09T14:38:58.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.516+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.517+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=442 2024-03-09T14:38:58.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.517+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5d93e872-363b-498b-b665-658644296b85.4535.13 info.flags=0x17 2024-03-09T14:38:58.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.517+0000 7f4a6e71f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5d93e872-363b-498b-b665-658644296b85.4535.13 to cache LRU end 2024-03-09T14:38:58.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.517+0000 7f4a6e71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:58.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.517+0000 7f4a6e71f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:38:58.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.517+0000 7f4a6e71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5d93e872-363b-498b-b665-658644296b85.4535.13 2024-03-09T14:38:58.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.518+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-09T14:38:58.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.519+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-09T14:38:58.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.520+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-09T14:38:58.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.521+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de8139a670 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55de81398748 s->prefetch_data=0 2024-03-09T14:38:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.521+0000 7f4a6e71f800 10 manifest: total_size = 10485760 2024-03-09T14:38:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.521+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.16062835292307631892 2024-03-09T14:38:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.521+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de8139a670 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55de81398748 s->prefetch_data=0 2024-03-09T14:38:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.521+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81398748 2024-03-09T14:38:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.521+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.13.3 2024-03-09T14:38:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.16062835292307631892 2024-03-09T14:38:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.nTpmeLXLygr9527KvbIUCpoVARisJWg_0 2024-03-09T14:38:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-03-09T14:38:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.nTpmeLXLygr9527KvbIUCpoVARisJWg_1 2024-03-09T14:38:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-03-09T14:38:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.nTpmeLXLygr9527KvbIUCpoVARisJWg_2 2024-03-09T14:38:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-03-09T14:38:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.524+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 5d93e872-363b-498b-b665-658644296b85.4535.16062835292307631892 2024-03-09T14:38:58.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.525+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-09T14:38:58.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.525+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55de81398748 s->prefetch_data=0 2024-03-09T14:38:58.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.525+0000 7f4a6e71f800 10 manifest: total_size = 10485760 2024-03-09T14:38:58.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.525+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.5153703377380384062 2024-03-09T14:38:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.525+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55de81398748 s->prefetch_data=0 2024-03-09T14:38:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.525+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81398748 2024-03-09T14:38:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.525+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.13.5 2024-03-09T14:38:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.528+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.528+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.528+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.528+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.528+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.5153703377380384062 2024-03-09T14:38:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.528+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.528+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.TNZT6MuDSE3tapn7hMctqorwckuGqRj_1 2024-03-09T14:38:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.528+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-03-09T14:38:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.528+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.TNZT6MuDSE3tapn7hMctqorwckuGqRj_2 2024-03-09T14:38:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.528+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 560 2024-03-09T14:38:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.528+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.528+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 5d93e872-363b-498b-b665-658644296b85.4535.5153703377380384062 2024-03-09T14:38:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.529+0000 7f494dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-09T14:38:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.529+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c001810 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55de81398748 s->prefetch_data=0 2024-03-09T14:38:58.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.529+0000 7f4a6e71f800 10 manifest: total_size = 10485760 2024-03-09T14:38:58.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.529+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.15123367768708589405 2024-03-09T14:38:58.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.529+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c001810 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55de81398748 s->prefetch_data=0 2024-03-09T14:38:58.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.529+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81398748 2024-03-09T14:38:58.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.529+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.13.7 2024-03-09T14:38:58.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.531+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.531+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.531+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.531+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.531+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:38:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.531+0000 7f4a6e71f800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-09T14:38:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.532+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - tag is: 5d93e872-363b-498b-b665-658644296b85.4535.15123367768708589405 2024-03-09T14:38:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.532+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:38:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.532+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.a9aMjPetOmC0gK8oi7P6SHZF8maJ56x_0 2024-03-09T14:38:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.532+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-03-09T14:38:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.532+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.a9aMjPetOmC0gK8oi7P6SHZF8maJ56x_1 2024-03-09T14:38:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.532+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-03-09T14:38:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.532+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.a9aMjPetOmC0gK8oi7P6SHZF8maJ56x_2 2024-03-09T14:38:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.532+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 818 2024-03-09T14:38:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.532+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:38:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.532+0000 7f4a6e71f800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 5d93e872-363b-498b-b665-658644296b85.4535.15123367768708589405 2024-03-09T14:38:58.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.533+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-09T14:38:58.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.533+0000 7f4a6e71f800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:38:58.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.533+0000 7f4a6e71f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:38:58.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.533+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:38:58.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.533+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:38:58.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.533+0000 7f4a6e71f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:38:58.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.533+0000 7f4a6e71f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:38:58.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.533+0000 7f4a6e71f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[5d93e872-363b-498b-b665-658644296b85.4535.13])"; uploads.size()=0; is_truncated=0 2024-03-09T14:38:58.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.535+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-03-09T14:38:58.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.535+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.535+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=228 2024-03-09T14:38:58.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.535+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-03-09T14:38:58.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.535+0000 7f4a6e71f800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-03-09T14:38:58.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.536+0000 7f4a6e71f800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-03-09T14:38:58.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.536+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-03-09T14:38:58.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.537+0000 7f494d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529679 cookie 94414138768064 notifier 5663 bl.length()=184 2024-03-09T14:38:58.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.539+0000 7f4a6e71f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5d93e872-363b-498b-b665-658644296b85.4535.13 from cache 2024-03-09T14:38:58.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.539+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:5d93e872-363b-498b-b665-658644296b85.4535.13, ofs0, ns] 2024-03-09T14:38:58.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.540+0000 7f494dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529739 cookie 94414138758848 notifier 5663 bl.length()=242 2024-03-09T14:38:58.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.544+0000 7f4a6e71f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/5d93e872-363b-498b-b665-658644296b85.4535.13 : miss 2024-03-09T14:38:58.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.544+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.544+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.544+0000 7f4a6e71f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/5d93e872-363b-498b-b665-658644296b85.4535.13 info.flags=0x0 2024-03-09T14:38:58.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.544+0000 7f4a6e71f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/5d93e872-363b-498b-b665-658644296b85.4535.13 to cache LRU end 2024-03-09T14:38:58.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.546+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5d93e872-363b-498b-b665-658644296b85.4535.6 : miss 2024-03-09T14:38:58.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.546+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.547+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=437 2024-03-09T14:38:58.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.547+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5d93e872-363b-498b-b665-658644296b85.4535.6 info.flags=0x17 2024-03-09T14:38:58.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.547+0000 7f4a6e71f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5d93e872-363b-498b-b665-658644296b85.4535.6 to cache LRU end 2024-03-09T14:38:58.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.547+0000 7f4a6e71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:58.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.547+0000 7f4a6e71f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:38:58.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.547+0000 7f4a6e71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5d93e872-363b-498b-b665-658644296b85.4535.6 2024-03-09T14:38:58.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.548+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got ___ 2024-03-09T14:38:58.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.548+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got __ _ 2024-03-09T14:38:58.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.549+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got __ 2024-03-09T14:38:58.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.550+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got obj 2024-03-09T14:38:58.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.551+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fb7b0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55de813aea78 s->prefetch_data=0 2024-03-09T14:38:58.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.551+0000 7f4a6e71f800 10 manifest: total_size = 0 2024-03-09T14:38:58.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.551+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.12477967696975650313 2024-03-09T14:38:58.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.551+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fb7b0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55de813aea78 s->prefetch_data=0 2024-03-09T14:38:58.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.551+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813aea78 2024-03-09T14:38:58.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.551+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.6.2 2024-03-09T14:38:58.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.554+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fb7b0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55de813aea78 s->prefetch_data=0 2024-03-09T14:38:58.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.554+0000 7f4a6e71f800 10 manifest: total_size = 0 2024-03-09T14:38:58.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.554+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.17069653212600414292 2024-03-09T14:38:58.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.554+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fb7b0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55de813aea78 s->prefetch_data=0 2024-03-09T14:38:58.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.554+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813aea78 2024-03-09T14:38:58.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.554+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.6.3 2024-03-09T14:38:58.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.555+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=___ 2024-03-09T14:38:58.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.556+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fb7b0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55de813aea78 s->prefetch_data=0 2024-03-09T14:38:58.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.557+0000 7f4a6e71f800 10 manifest: total_size = 0 2024-03-09T14:38:58.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.557+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.9069532124571542946 2024-03-09T14:38:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.557+0000 7f4a6e71f800 20 get_obj_state: octx=0x55de813fb7b0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55de813aea78 s->prefetch_data=0 2024-03-09T14:38:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.557+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813aea78 2024-03-09T14:38:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.557+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.6.6 2024-03-09T14:38:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.558+0000 7f494dffb640 20 handle_completion(): completion ok for obj=__ _ 2024-03-09T14:38:58.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.559+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6000d300 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55de813ae968 s->prefetch_data=0 2024-03-09T14:38:58.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.559+0000 7f4a6e71f800 10 manifest: total_size = 0 2024-03-09T14:38:58.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.560+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.5438505905389903412 2024-03-09T14:38:58.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.560+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6000d300 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55de813ae968 s->prefetch_data=0 2024-03-09T14:38:58.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.560+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813ae968 2024-03-09T14:38:58.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.560+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.6.8 2024-03-09T14:38:58.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.560+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=__ 2024-03-09T14:38:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.563+0000 7f4a6e71f800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:38:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.563+0000 7f4a6e71f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:38:58.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.565+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=obj 2024-03-09T14:38:58.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.565+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:38:58.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.565+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:38:58.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.565+0000 7f4a6e71f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:38:58.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.565+0000 7f4a6e71f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:38:58.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.565+0000 7f4a6e71f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[5d93e872-363b-498b-b665-658644296b85.4535.6])"; uploads.size()=0; is_truncated=0 2024-03-09T14:38:58.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.567+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-03-09T14:38:58.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.567+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.567+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=223 2024-03-09T14:38:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.567+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-03-09T14:38:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.567+0000 7f4a6e71f800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-03-09T14:38:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.568+0000 7f4a6e71f800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-03-09T14:38:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.568+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-03-09T14:38:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.568+0000 7f494dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529722 cookie 94414138756640 notifier 5663 bl.length()=181 2024-03-09T14:38:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.571+0000 7f4a6e71f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5d93e872-363b-498b-b665-658644296b85.4535.6 from cache 2024-03-09T14:38:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.571+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:5d93e872-363b-498b-b665-658644296b85.4535.6, ofs0, ns] 2024-03-09T14:38:58.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.571+0000 7f494d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529703 cookie 94414138773744 notifier 5663 bl.length()=238 2024-03-09T14:38:58.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.574+0000 7f4a6e71f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/5d93e872-363b-498b-b665-658644296b85.4535.6 : miss 2024-03-09T14:38:58.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.574+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.575+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.575+0000 7f4a6e71f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/5d93e872-363b-498b-b665-658644296b85.4535.6 info.flags=0x0 2024-03-09T14:38:58.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.575+0000 7f4a6e71f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/5d93e872-363b-498b-b665-658644296b85.4535.6 to cache LRU end 2024-03-09T14:38:58.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.576+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5d93e872-363b-498b-b665-658644296b85.4535.7 : miss 2024-03-09T14:38:58.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.576+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.577+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=437 2024-03-09T14:38:58.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.577+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5d93e872-363b-498b-b665-658644296b85.4535.7 info.flags=0x17 2024-03-09T14:38:58.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.577+0000 7f4a6e71f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5d93e872-363b-498b-b665-658644296b85.4535.7 to cache LRU end 2024-03-09T14:38:58.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.577+0000 7f4a6e71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:58.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.577+0000 7f4a6e71f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:38:58.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.577+0000 7f4a6e71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5d93e872-363b-498b-b665-658644296b85.4535.7 2024-03-09T14:38:58.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.578+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got ___ 2024-03-09T14:38:58.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.579+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got __ _ 2024-03-09T14:38:58.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.579+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got __ 2024-03-09T14:38:58.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.580+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got obj 2024-03-09T14:38:58.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.581+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55de813ae968 s->prefetch_data=0 2024-03-09T14:38:58.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.581+0000 7f4a6e71f800 10 manifest: total_size = 527 2024-03-09T14:38:58.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.581+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.3985258916468729725 2024-03-09T14:38:58.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.581+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55de813ae968 s->prefetch_data=0 2024-03-09T14:38:58.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.581+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813ae968 2024-03-09T14:38:58.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.581+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.7.2 2024-03-09T14:38:58.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.584+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55de813ae968 s->prefetch_data=0 2024-03-09T14:38:58.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.584+0000 7f4a6e71f800 10 manifest: total_size = 38 2024-03-09T14:38:58.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.584+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.2586433963488343194 2024-03-09T14:38:58.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.584+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55de813ae968 s->prefetch_data=0 2024-03-09T14:38:58.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.584+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813ae968 2024-03-09T14:38:58.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.584+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.7.3 2024-03-09T14:38:58.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.585+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=___ 2024-03-09T14:38:58.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.588+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55de813ae968 s->prefetch_data=0 2024-03-09T14:38:58.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.588+0000 7f4a6e71f800 10 manifest: total_size = 24595 2024-03-09T14:38:58.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.588+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.10033536552405500821 2024-03-09T14:38:58.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.588+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55de813ae968 s->prefetch_data=0 2024-03-09T14:38:58.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.588+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813ae968 2024-03-09T14:38:58.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.588+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.7.6 2024-03-09T14:38:58.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.589+0000 7f494dffb640 20 handle_completion(): completion ok for obj=__ _ 2024-03-09T14:38:58.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.590+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55de813ae968 s->prefetch_data=0 2024-03-09T14:38:58.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.591+0000 7f4a6e71f800 10 manifest: total_size = 24595 2024-03-09T14:38:58.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.591+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.17331328449229966932 2024-03-09T14:38:58.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.591+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a5c0095b0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55de813ae968 s->prefetch_data=0 2024-03-09T14:38:58.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.591+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813ae968 2024-03-09T14:38:58.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.591+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.7.8 2024-03-09T14:38:58.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.591+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=__ 2024-03-09T14:38:58.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.593+0000 7f4a6e71f800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:38:58.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.593+0000 7f4a6e71f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:38:58.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.594+0000 7f494dffb640 20 handle_completion(): completion ok for obj=obj 2024-03-09T14:38:58.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.594+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:38:58.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.594+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:38:58.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.594+0000 7f4a6e71f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:38:58.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.594+0000 7f4a6e71f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:38:58.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.594+0000 7f4a6e71f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[5d93e872-363b-498b-b665-658644296b85.4535.7])"; uploads.size()=0; is_truncated=0 2024-03-09T14:38:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.596+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-03-09T14:38:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.596+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.597+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=223 2024-03-09T14:38:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.597+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-03-09T14:38:58.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.597+0000 7f4a6e71f800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-03-09T14:38:58.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.597+0000 7f4a6e71f800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-03-09T14:38:58.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.597+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-03-09T14:38:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.598+0000 7f494d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529723 cookie 94414138756640 notifier 5663 bl.length()=181 2024-03-09T14:38:58.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.600+0000 7f4a6e71f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5d93e872-363b-498b-b665-658644296b85.4535.7 from cache 2024-03-09T14:38:58.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.600+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:5d93e872-363b-498b-b665-658644296b85.4535.7, ofs0, ns] 2024-03-09T14:38:58.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.601+0000 7f494d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529704 cookie 94414138773744 notifier 5663 bl.length()=238 2024-03-09T14:38:58.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.605+0000 7f4a6e71f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/5d93e872-363b-498b-b665-658644296b85.4535.7 : miss 2024-03-09T14:38:58.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.605+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.605+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.605+0000 7f4a6e71f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/5d93e872-363b-498b-b665-658644296b85.4535.7 info.flags=0x0 2024-03-09T14:38:58.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.605+0000 7f4a6e71f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/5d93e872-363b-498b-b665-658644296b85.4535.7 to cache LRU end 2024-03-09T14:38:58.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.607+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5d93e872-363b-498b-b665-658644296b85.4535.8 : miss 2024-03-09T14:38:58.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.607+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.607+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=437 2024-03-09T14:38:58.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.607+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5d93e872-363b-498b-b665-658644296b85.4535.8 info.flags=0x17 2024-03-09T14:38:58.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.607+0000 7f4a6e71f800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5d93e872-363b-498b-b665-658644296b85.4535.8 to cache LRU end 2024-03-09T14:38:58.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.607+0000 7f4a6e71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:58.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.607+0000 7f4a6e71f800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:38:58.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.607+0000 7f4a6e71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5d93e872-363b-498b-b665-658644296b85.4535.8 2024-03-09T14:38:58.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.609+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got ___ 2024-03-09T14:38:58.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.609+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got __ _ 2024-03-09T14:38:58.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.610+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got __ 2024-03-09T14:38:58.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.610+0000 7f4a6e71f800 10 cls_bucket_list_unordered: got obj 2024-03-09T14:38:58.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.611+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6007f9d0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55de813ae8b8 s->prefetch_data=0 2024-03-09T14:38:58.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.612+0000 7f4a6e71f800 10 manifest: total_size = 55 2024-03-09T14:38:58.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.612+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.11074766836009428111 2024-03-09T14:38:58.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.612+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6007f9d0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55de813ae8b8 s->prefetch_data=0 2024-03-09T14:38:58.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.612+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813ae8b8 2024-03-09T14:38:58.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.612+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.8.2 2024-03-09T14:38:58.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.614+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6007f9d0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55de813b5228 s->prefetch_data=0 2024-03-09T14:38:58.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.615+0000 7f4a6e71f800 10 manifest: total_size = 4134 2024-03-09T14:38:58.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.615+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.3344351517457097572 2024-03-09T14:38:58.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.615+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6007f9d0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55de813b5228 s->prefetch_data=0 2024-03-09T14:38:58.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.615+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de813b5228 2024-03-09T14:38:58.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.615+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.8.3 2024-03-09T14:38:58.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.615+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=___ 2024-03-09T14:38:58.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.617+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a64052f80 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55de81381e28 s->prefetch_data=0 2024-03-09T14:38:58.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.618+0000 7f4a6e71f800 10 manifest: total_size = 49187 2024-03-09T14:38:58.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.618+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.4952422989636877255 2024-03-09T14:38:58.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.618+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a64052f80 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55de81381e28 s->prefetch_data=0 2024-03-09T14:38:58.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.618+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81381e28 2024-03-09T14:38:58.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.618+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.8.6 2024-03-09T14:38:58.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.618+0000 7f494dffb640 20 handle_completion(): completion ok for obj=__ _ 2024-03-09T14:38:58.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.620+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6007f9d0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55de81381e28 s->prefetch_data=0 2024-03-09T14:38:58.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.620+0000 7f4a6e71f800 10 manifest: total_size = 1048576 2024-03-09T14:38:58.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.620+0000 7f4a6e71f800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.15801831892604832102 2024-03-09T14:38:58.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.620+0000 7f4a6e71f800 20 get_obj_state: octx=0x7f4a6007f9d0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55de81381e28 s->prefetch_data=0 2024-03-09T14:38:58.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.620+0000 7f4a6e71f800 20 prepare_atomic_modification: state is not atomic. state=0x55de81381e28 2024-03-09T14:38:58.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.620+0000 7f4a6e71f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.8.8 2024-03-09T14:38:58.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.621+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=__ 2024-03-09T14:38:58.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.623+0000 7f4a6e71f800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:38:58.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.623+0000 7f4a6e71f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:38:58.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.624+0000 7f494d7fa640 20 handle_completion(): completion ok for obj=obj 2024-03-09T14:38:58.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.624+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:38:58.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.624+0000 7f4a6e71f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:38:58.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.624+0000 7f4a6e71f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:38:58.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.624+0000 7f4a6e71f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:38:58.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.624+0000 7f4a6e71f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[5d93e872-363b-498b-b665-658644296b85.4535.8])"; uploads.size()=0; is_truncated=0 2024-03-09T14:38:58.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.626+0000 7f4a6e71f800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-03-09T14:38:58.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.626+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.627+0000 7f4a6e71f800 20 rados_obj.operate() r=0 bl.length=223 2024-03-09T14:38:58.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.627+0000 7f4a6e71f800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-03-09T14:38:58.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.627+0000 7f4a6e71f800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-03-09T14:38:58.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.627+0000 7f4a6e71f800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-03-09T14:38:58.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.627+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-03-09T14:38:58.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.628+0000 7f494dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529724 cookie 94414138756640 notifier 5663 bl.length()=181 2024-03-09T14:38:58.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.631+0000 7f4a6e71f800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5d93e872-363b-498b-b665-658644296b85.4535.8 from cache 2024-03-09T14:38:58.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.631+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:5d93e872-363b-498b-b665-658644296b85.4535.8, ofs0, ns] 2024-03-09T14:38:58.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.631+0000 7f494d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529705 cookie 94414138773744 notifier 5663 bl.length()=238 2024-03-09T14:38:58.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.635+0000 7f4a6e71f800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/5d93e872-363b-498b-b665-658644296b85.4535.8 : miss 2024-03-09T14:38:58.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.635+0000 7f4a6e71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.635+0000 7f4a6e71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.635+0000 7f4a6e71f800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/5d93e872-363b-498b-b665-658644296b85.4535.8 info.flags=0x0 2024-03-09T14:38:58.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.635+0000 7f4a6e71f800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/5d93e872-363b-498b-b665-658644296b85.4535.8 to cache LRU end 2024-03-09T14:38:58.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.638+0000 7f4a6e71f800 10 removing key index: AZKTSZCHMQUXJDTQZHBS 2024-03-09T14:38:58.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.639+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:AZKTSZCHMQUXJDTQZHBS, ofs0, ns] 2024-03-09T14:38:58.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.639+0000 7f494dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529706 cookie 94414138773744 notifier 5663 bl.length()=170 2024-03-09T14:38:58.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.640+0000 7f4a6e71f800 10 removing email index: ragweed.client.0+test@test.test 2024-03-09T14:38:58.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.641+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-03-09T14:38:58.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.642+0000 7f494d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529680 cookie 94414138768064 notifier 5663 bl.length()=182 2024-03-09T14:38:58.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.643+0000 7f4a6e71f800 10 removing user buckets index 2024-03-09T14:38:58.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.644+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-03-09T14:38:58.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.644+0000 7f494dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529707 cookie 94414138779984 notifier 5663 bl.length()=173 2024-03-09T14:38:58.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.645+0000 7f4a6e71f800 10 removing user index: ragweed.client.0 2024-03-09T14:38:58.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.646+0000 7f4a6e71f800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-03-09T14:38:58.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.647+0000 7f4a6e71f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-03-09T14:38:58.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.647+0000 7f494d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529740 cookie 94414138775792 notifier 5663 bl.length()=165 2024-03-09T14:38:58.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.651+0000 7f4920fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:58.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.653+0000 7f4a6e71f800 20 remove_watcher() i=0 2024-03-09T14:38:58.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.653+0000 7f4a6e71f800 2 removed watcher, disabling cache 2024-03-09T14:38:58.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.654+0000 7f4a6e71f800 20 remove_watcher() i=1 2024-03-09T14:38:58.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.655+0000 7f4a6e71f800 20 remove_watcher() i=2 2024-03-09T14:38:58.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.656+0000 7f4a6e71f800 20 remove_watcher() i=3 2024-03-09T14:38:58.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.657+0000 7f4a6e71f800 20 remove_watcher() i=4 2024-03-09T14:38:58.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.658+0000 7f4a6e71f800 20 remove_watcher() i=5 2024-03-09T14:38:58.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.659+0000 7f4a6e71f800 20 remove_watcher() i=6 2024-03-09T14:38:58.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.660+0000 7f4a6e71f800 20 remove_watcher() i=7 2024-03-09T14:38:58.671 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-03-09T14:38:58.725 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:58.725 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:58.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.754+0000 7f56d4614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.755+0000 7f56d4614800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.755+0000 7f56d4614800 20 realm 2024-03-09T14:38:58.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.755+0000 7f56d4614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.755+0000 7f56d4614800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.755+0000 7f56d4614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:58.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.755+0000 7f56d4614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.755+0000 7f56d4614800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.755+0000 7f56d4614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.756+0000 7f56d4614800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:58.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.756+0000 7f56d4614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.757+0000 7f56d4614800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:58.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.757+0000 7f56d4614800 20 searching for the correct realm 2024-03-09T14:38:58.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.758+0000 7f56d05aa640 0 -- 172.21.15.88:0/2104137618 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x5598234cbce0 msgr2=0x5598234ce0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:38:58.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.762+0000 7f56c75a8640 0 -- 172.21.15.88:0/2104137618 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f56c0066070 msgr2=0x7f56c009a180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:58.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.768+0000 7f56d4614800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:38:58.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.768+0000 7f56d4614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:58.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.768+0000 7f56d4614800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:38:58.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.768+0000 7f56d4614800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:58.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.768+0000 7f56d4614800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:58.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.768+0000 7f56d4614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:58.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.768+0000 7f56d4614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.768+0000 7f56d4614800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.768+0000 7f56d4614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.768+0000 7f56d4614800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:58.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.768+0000 7f56d4614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.768+0000 7f56d4614800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:58.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.769+0000 7f56d4614800 20 zone default found 2024-03-09T14:38:58.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.769+0000 7f56d4614800 4 Realm: () 2024-03-09T14:38:58.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.769+0000 7f56d4614800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:38:58.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.769+0000 7f56d4614800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:38:58.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.769+0000 7f56d4614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:58.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.769+0000 7f56d4614800 20 zonegroup default 2024-03-09T14:38:58.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.769+0000 7f56d4614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.769+0000 7f56d4614800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.769+0000 7f56d4614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.769+0000 7f56d4614800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.769+0000 7f56d4614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.769+0000 7f56d4614800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:58.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.769+0000 7f56d4614800 20 started sync module instance, tier type = 2024-03-09T14:38:58.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.769+0000 7f56d4614800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:38:58.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.778+0000 7f56d4614800 20 add_watcher() i=0 2024-03-09T14:38:58.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.778+0000 7f56d4614800 20 add_watcher() i=1 2024-03-09T14:38:58.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.778+0000 7f56d4614800 20 add_watcher() i=2 2024-03-09T14:38:58.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.778+0000 7f56d4614800 20 add_watcher() i=3 2024-03-09T14:38:58.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.778+0000 7f56d4614800 20 add_watcher() i=4 2024-03-09T14:38:58.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.778+0000 7f56d4614800 20 add_watcher() i=5 2024-03-09T14:38:58.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.778+0000 7f56d4614800 20 add_watcher() i=6 2024-03-09T14:38:58.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.779+0000 7f56d4614800 20 add_watcher() i=7 2024-03-09T14:38:58.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.779+0000 7f56d4614800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:58.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.781+0000 7f5585fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:58.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.781+0000 7f56d4614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:58.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.781+0000 7f56d4614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:58.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.816+0000 7f5584fe1640 20 reqs_thread_entry: start 2024-03-09T14:38:58.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.816+0000 7f56d4614800 20 init_complete bucket index max shards: 11 2024-03-09T14:38:58.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.816+0000 7f56d4614800 20 Filter name: none 2024-03-09T14:38:58.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.816+0000 7f54fe7fc640 20 reqs_thread_entry: start 2024-03-09T14:38:58.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.816+0000 7f56d4614800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-03-09T14:38:58.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.816+0000 7f56d4614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:58.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.817+0000 7f56d4614800 20 rados_obj.operate() r=0 bl.length=486 2024-03-09T14:38:58.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.817+0000 7f56d4614800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-03-09T14:38:58.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.817+0000 7f56d4614800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-09T14:38:58.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.817+0000 7f56d4614800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:58.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.817+0000 7f56d4614800 10 removing key index: RCDYTBAFPRZMXXVGBJDB 2024-03-09T14:38:58.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.818+0000 7f56d4614800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:RCDYTBAFPRZMXXVGBJDB, ofs0, ns] 2024-03-09T14:38:58.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.819+0000 7f55aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529741 cookie 94111915665824 notifier 5910 bl.length()=170 2024-03-09T14:38:58.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.820+0000 7f56d4614800 10 removing email index: sysuser.client.0+test@test.test 2024-03-09T14:38:58.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.822+0000 7f56d4614800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-03-09T14:38:58.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.822+0000 7f55aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529742 cookie 94111915665824 notifier 5910 bl.length()=182 2024-03-09T14:38:58.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.823+0000 7f56d4614800 10 removing user buckets index 2024-03-09T14:38:58.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.824+0000 7f56d4614800 10 removing user index: sysuser.client.0 2024-03-09T14:38:58.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.825+0000 7f56d4614800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-03-09T14:38:58.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.825+0000 7f56d4614800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-03-09T14:38:58.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.826+0000 7f55aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529681 cookie 94111915654896 notifier 5910 bl.length()=165 2024-03-09T14:38:58.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.827+0000 7f5585fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:58.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.830+0000 7f56d4614800 20 remove_watcher() i=0 2024-03-09T14:38:58.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.830+0000 7f56d4614800 2 removed watcher, disabling cache 2024-03-09T14:38:58.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.830+0000 7f56d4614800 20 remove_watcher() i=1 2024-03-09T14:38:58.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.831+0000 7f56d4614800 20 remove_watcher() i=2 2024-03-09T14:38:58.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.833+0000 7f56d4614800 20 remove_watcher() i=3 2024-03-09T14:38:58.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.834+0000 7f56d4614800 20 remove_watcher() i=4 2024-03-09T14:38:58.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.835+0000 7f56d4614800 20 remove_watcher() i=5 2024-03-09T14:38:58.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.836+0000 7f56d4614800 20 remove_watcher() i=6 2024-03-09T14:38:58.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:38:58.837+0000 7f56d4614800 20 remove_watcher() i=7 2024-03-09T14:38:58.847 INFO:tasks.ragweed:Removing ragweed... 2024-03-09T14:38:58.848 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-03-09T14:38:58.928 INFO:teuthology.run_tasks:Running task workunit... 2024-03-09T14:38:58.938 INFO:tasks.workunit:Pulling workunits from ref c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:38:58.938 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-09T14:38:58.939 DEBUG:teuthology.orchestra.run.smithi088:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:38:58.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:38:58.966 INFO:teuthology.orchestra.run.smithi088.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-09T14:38:58.966 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:38:59.033 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-09T14:38:59.034 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-09T14:38:59.101 INFO:tasks.workunit:timeout=3h 2024-03-09T14:38:59.101 INFO:tasks.workunit:cleanup=True 2024-03-09T14:38:59.101 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:38:59.168 INFO:tasks.workunit.client.0.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-09T14:40:15.226 INFO:tasks.workunit.client.0.smithi088.stderr:Note: switching to 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'. 2024-03-09T14:40:15.227 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:15.227 INFO:tasks.workunit.client.0.smithi088.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-09T14:40:15.227 INFO:tasks.workunit.client.0.smithi088.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-09T14:40:15.227 INFO:tasks.workunit.client.0.smithi088.stderr:state without impacting any branches by switching back to a branch. 2024-03-09T14:40:15.227 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:15.227 INFO:tasks.workunit.client.0.smithi088.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-09T14:40:15.227 INFO:tasks.workunit.client.0.smithi088.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-09T14:40:15.227 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:15.227 INFO:tasks.workunit.client.0.smithi088.stderr: git switch -c 2024-03-09T14:40:15.227 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:15.228 INFO:tasks.workunit.client.0.smithi088.stderr:Or undo this operation with: 2024-03-09T14:40:15.228 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:15.228 INFO:tasks.workunit.client.0.smithi088.stderr: git switch - 2024-03-09T14:40:15.228 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:15.228 INFO:tasks.workunit.client.0.smithi088.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-09T14:40:15.228 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:15.228 INFO:tasks.workunit.client.0.smithi088.stderr:HEAD is now at c00d9c609fb DNM: point s3tests at branch cbodley:wip-iam-user-apis 2024-03-09T14:40:15.230 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-09T14:40:15.299 INFO:tasks.workunit.client.0.smithi088.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-09T14:40:15.301 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:40:15.301 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-09T14:40:15.349 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-09T14:40:15.398 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-09T14:40:15.437 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:40:15.439 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:40:15.439 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-09T14:40:15.477 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:40:15.480 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:40:15.480 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-09T14:40:15.548 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-03-09T14:40:15.549 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-03-09T14:40:15.549 DEBUG:teuthology.orchestra.run.smithi088:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-03-09T14:40:15.619 INFO:tasks.workunit.client.0.smithi088.stderr:+ ulimit -c 0 2024-03-09T14:40:15.619 INFO:tasks.workunit.client.0.smithi088.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-03-09T14:40:15.619 INFO:tasks.workunit.client.0.smithi088.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:40:15.619 INFO:tasks.workunit.client.0.smithi088.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:40:17.946 INFO:tasks.workunit.client.0.smithi088.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-03-09T14:40:17.946 INFO:tasks.workunit.client.0.smithi088.stderr:++ deactivate nondestructive 2024-03-09T14:40:17.946 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' -n '' ']' 2024-03-09T14:40:17.946 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' -n '' ']' 2024-03-09T14:40:17.946 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:40:17.946 INFO:tasks.workunit.client.0.smithi088.stderr:++ hash -r 2024-03-09T14:40:17.946 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' -n '' ']' 2024-03-09T14:40:17.946 INFO:tasks.workunit.client.0.smithi088.stderr:++ unset VIRTUAL_ENV 2024-03-09T14:40:17.946 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-03-09T14:40:17.946 INFO:tasks.workunit.client.0.smithi088.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:40:17.946 INFO:tasks.workunit.client.0.smithi088.stderr:++ export VIRTUAL_ENV 2024-03-09T14:40:17.946 INFO:tasks.workunit.client.0.smithi088.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-09T14:40:17.947 INFO:tasks.workunit.client.0.smithi088.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-09T14:40:17.947 INFO:tasks.workunit.client.0.smithi088.stderr:++ export PATH 2024-03-09T14:40:17.948 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' -n '' ']' 2024-03-09T14:40:17.948 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' -z '' ']' 2024-03-09T14:40:17.948 INFO:tasks.workunit.client.0.smithi088.stderr:++ _OLD_VIRTUAL_PS1= 2024-03-09T14:40:17.948 INFO:tasks.workunit.client.0.smithi088.stderr:++ PS1='(rgw) ' 2024-03-09T14:40:17.948 INFO:tasks.workunit.client.0.smithi088.stderr:++ export PS1 2024-03-09T14:40:17.948 INFO:tasks.workunit.client.0.smithi088.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:40:17.948 INFO:tasks.workunit.client.0.smithi088.stderr:++ hash -r 2024-03-09T14:40:17.948 INFO:tasks.workunit.client.0.smithi088.stderr:+ pip install pip --upgrade 2024-03-09T14:40:18.176 INFO:tasks.workunit.client.0.smithi088.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-03-09T14:40:18.446 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting pip 2024-03-09T14:40:18.452 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-09T14:40:18.500 INFO:tasks.workunit.client.0.smithi088.stdout:Installing collected packages: pip 2024-03-09T14:40:18.500 INFO:tasks.workunit.client.0.smithi088.stdout: Attempting uninstall: pip 2024-03-09T14:40:18.500 INFO:tasks.workunit.client.0.smithi088.stdout: Found existing installation: pip 21.2.3 2024-03-09T14:40:18.649 INFO:tasks.workunit.client.0.smithi088.stdout: Uninstalling pip-21.2.3: 2024-03-09T14:40:18.655 INFO:tasks.workunit.client.0.smithi088.stdout: Successfully uninstalled pip-21.2.3 2024-03-09T14:40:19.612 INFO:tasks.workunit.client.0.smithi088.stdout:Successfully installed pip-24.0 2024-03-09T14:40:19.659 INFO:tasks.workunit.client.0.smithi088.stderr:+ pip install boto3 2024-03-09T14:40:20.515 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting boto3 2024-03-09T14:40:20.516 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached boto3-1.34.59-py3-none-any.whl.metadata (6.6 kB) 2024-03-09T14:40:21.061 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting botocore<1.35.0,>=1.34.59 (from boto3) 2024-03-09T14:40:21.063 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached botocore-1.34.59-py3-none-any.whl.metadata (5.7 kB) 2024-03-09T14:40:21.128 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-03-09T14:40:21.129 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-03-09T14:40:21.190 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-03-09T14:40:21.191 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-03-09T14:40:21.250 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:40:21.251 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-03-09T14:40:21.342 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:40:21.343 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-03-09T14:40:21.497 INFO:tasks.workunit.client.0.smithi088.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:40:21.498 INFO:tasks.workunit.client.0.smithi088.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-09T14:40:21.520 INFO:tasks.workunit.client.0.smithi088.stdout:Using cached boto3-1.34.59-py3-none-any.whl (139 kB) 2024-03-09T14:40:21.522 INFO:tasks.workunit.client.0.smithi088.stdout:Using cached botocore-1.34.59-py3-none-any.whl (12.0 MB) 2024-03-09T14:40:21.543 INFO:tasks.workunit.client.0.smithi088.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-03-09T14:40:21.543 INFO:tasks.workunit.client.0.smithi088.stdout:Using cached s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-03-09T14:40:21.545 INFO:tasks.workunit.client.0.smithi088.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-03-09T14:40:21.546 INFO:tasks.workunit.client.0.smithi088.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-03-09T14:40:21.548 INFO:tasks.workunit.client.0.smithi088.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-09T14:40:21.653 INFO:tasks.workunit.client.0.smithi088.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-03-09T14:40:22.805 INFO:tasks.workunit.client.0.smithi088.stdout:Successfully installed boto3-1.34.59 botocore-1.34.59 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.0 six-1.16.0 urllib3-1.26.18 2024-03-09T14:40:22.947 INFO:tasks.workunit.client.0.smithi088.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-03-09T14:40:23.073 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-03-09T14:40:23.106 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:23.106 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:23.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.139+0000 7f5e3749d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:23.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.141+0000 7f5e3749d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:23.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.141+0000 7f5e3749d800 20 realm 2024-03-09T14:40:23.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.141+0000 7f5e3749d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:23.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.141+0000 7f5e3749d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:23.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.141+0000 7f5e3749d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:23.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.141+0000 7f5e3749d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:23.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.141+0000 7f5e3749d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:23.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.141+0000 7f5e3749d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:23.143 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.142+0000 7f5e3749d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:23.143 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.142+0000 7f5e3749d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:23.143 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.142+0000 7f5e3749d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:23.144 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.142+0000 7f5e3749d800 20 searching for the correct realm 2024-03-09T14:40:23.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.145+0000 7f5e2ffff640 0 -- 172.21.15.88:0/3774204612 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f5e2801f060 msgr2=0x7f5e28056be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:23.351 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.351+0000 7f5e2ffff640 0 -- 172.21.15.88:0/3774204612 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f5e300ca240 msgr2=0x7f5e300ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:23.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.558+0000 7f5e3749d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:23.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.558+0000 7f5e3749d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:23.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.558+0000 7f5e3749d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:23.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.558+0000 7f5e3749d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:23.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.558+0000 7f5e3749d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:23.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.558+0000 7f5e3749d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:23.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.558+0000 7f5e3749d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:23.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.558+0000 7f5e3749d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:23.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.558+0000 7f5e3749d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:23.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.559+0000 7f5e3749d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:23.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.559+0000 7f5e3749d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:23.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.559+0000 7f5e3749d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:23.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.559+0000 7f5e3749d800 20 zone default found 2024-03-09T14:40:23.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.559+0000 7f5e3749d800 4 Realm: () 2024-03-09T14:40:23.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.559+0000 7f5e3749d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:23.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.559+0000 7f5e3749d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:23.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.559+0000 7f5e3749d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:23.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.559+0000 7f5e3749d800 20 zonegroup default 2024-03-09T14:40:23.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.559+0000 7f5e3749d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:23.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.559+0000 7f5e3749d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:23.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.559+0000 7f5e3749d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:23.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.560+0000 7f5e3749d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:23.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.560+0000 7f5e3749d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:23.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.560+0000 7f5e3749d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:23.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.560+0000 7f5e3749d800 20 started sync module instance, tier type = 2024-03-09T14:40:23.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.560+0000 7f5e3749d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:23.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.570+0000 7f5e3749d800 20 add_watcher() i=0 2024-03-09T14:40:23.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.570+0000 7f5e3749d800 20 add_watcher() i=1 2024-03-09T14:40:23.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.570+0000 7f5e3749d800 20 add_watcher() i=2 2024-03-09T14:40:23.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.570+0000 7f5e3749d800 20 add_watcher() i=3 2024-03-09T14:40:23.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.570+0000 7f5e3749d800 20 add_watcher() i=4 2024-03-09T14:40:23.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.570+0000 7f5e3749d800 20 add_watcher() i=5 2024-03-09T14:40:23.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.570+0000 7f5e3749d800 20 add_watcher() i=6 2024-03-09T14:40:23.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.570+0000 7f5e3749d800 20 add_watcher() i=7 2024-03-09T14:40:23.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.570+0000 7f5e3749d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:23.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.572+0000 7f5ceafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:23.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.573+0000 7f5e3749d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:23.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.573+0000 7f5e3749d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:23.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.573+0000 7f5e3749d800 5 note: GC not initialized 2024-03-09T14:40:23.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.573+0000 7f5ce9fe3640 20 reqs_thread_entry: start 2024-03-09T14:40:23.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.573+0000 7f5e3749d800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:23.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.573+0000 7f5e3749d800 20 Filter name: none 2024-03-09T14:40:23.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.573+0000 7f5c5b7fe640 20 reqs_thread_entry: start 2024-03-09T14:40:23.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.573+0000 7f5e3749d800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-03-09T14:40:23.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.573+0000 7f5e3749d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:23.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.573+0000 7f5e3749d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:23.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.573+0000 7f5e3749d800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-03-09T14:40:23.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.573+0000 7f5e3749d800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-03-09T14:40:23.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.573+0000 7f5e3749d800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-03-09T14:40:23.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.573+0000 7f5e3749d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:23.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.574+0000 7f5e3749d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:23.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.574+0000 7f5e3749d800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-03-09T14:40:23.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.574+0000 7f5e3749d800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-09T14:40:23.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.574+0000 7f5e3749d800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-03-09T14:40:23.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.574+0000 7f5e3749d800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-03-09T14:40:23.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.575+0000 7f5e3749d800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-03-09T14:40:23.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.575+0000 7f5e3749d800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-03-09T14:40:23.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.575+0000 7f5e3749d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-03-09T14:40:23.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.575+0000 7f5d0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464300 cookie 94021262360064 notifier 5928 bl.length()=569 2024-03-09T14:40:23.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.575+0000 7f5d0bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-03-09T14:40:23.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.575+0000 7f5d0bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-03-09T14:40:23.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.578+0000 7f5e3749d800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-03-09T14:40:23.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.578+0000 7f5e3749d800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-09T14:40:23.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.578+0000 7f5e3749d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-03-09T14:40:23.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.578+0000 7f5d0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464301 cookie 94021262356336 notifier 5928 bl.length()=180 2024-03-09T14:40:23.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.578+0000 7f5d0bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-03-09T14:40:23.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.578+0000 7f5d0bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-09T14:40:23.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.580+0000 7f5ceafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:23.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.583+0000 7f5e3749d800 20 remove_watcher() i=0 2024-03-09T14:40:23.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.583+0000 7f5e3749d800 2 removed watcher, disabling cache 2024-03-09T14:40:23.585 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.584+0000 7f5e3749d800 20 remove_watcher() i=1 2024-03-09T14:40:23.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.585+0000 7f5e3749d800 20 remove_watcher() i=2 2024-03-09T14:40:23.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.586+0000 7f5e3749d800 20 remove_watcher() i=3 2024-03-09T14:40:23.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.588+0000 7f5e3749d800 20 remove_watcher() i=4 2024-03-09T14:40:23.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.588+0000 7f5e3749d800 20 remove_watcher() i=5 2024-03-09T14:40:23.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.589+0000 7f5e3749d800 20 remove_watcher() i=6 2024-03-09T14:40:23.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:23.590+0000 7f5e3749d800 20 remove_watcher() i=7 2024-03-09T14:40:23.956 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: reshard add 2024-03-09T14:40:23.956 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:23.957 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-09T14:40:23.986 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:23.986 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:24.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.018+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.020+0000 7f2f3520f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:24.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.020+0000 7f2f3520f800 20 realm 2024-03-09T14:40:24.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.020+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.020+0000 7f2f3520f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:24.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.020+0000 7f2f3520f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:24.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.020+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.020+0000 7f2f3520f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:24.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.020+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.021+0000 7f2f3520f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:24.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.021+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.022+0000 7f2f3520f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:24.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.022+0000 7f2f3520f800 20 searching for the correct realm 2024-03-09T14:40:24.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.024+0000 7f2f3116d640 0 -- 172.21.15.88:0/1183653598 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f2f2c076070 msgr2=0x7f2f2c091960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:24.230 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.230+0000 7f2f2bfff640 0 -- 172.21.15.88:0/1183653598 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f2f2c0903e0 msgr2=0x7f2f2c090860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:24.437 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.436+0000 7f2f3520f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:24.437 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.436+0000 7f2f3520f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:24.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.436+0000 7f2f3520f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:24.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.436+0000 7f2f3520f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:24.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.436+0000 7f2f3520f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:24.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.436+0000 7f2f3520f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:24.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.436+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.437+0000 7f2f3520f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:24.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.437+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.437+0000 7f2f3520f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:24.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.437+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.437+0000 7f2f3520f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:24.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.437+0000 7f2f3520f800 20 zone default found 2024-03-09T14:40:24.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.437+0000 7f2f3520f800 4 Realm: () 2024-03-09T14:40:24.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.437+0000 7f2f3520f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:24.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.437+0000 7f2f3520f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:24.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.437+0000 7f2f3520f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:24.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.437+0000 7f2f3520f800 20 zonegroup default 2024-03-09T14:40:24.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.438+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.438+0000 7f2f3520f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:24.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.438+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.438+0000 7f2f3520f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:24.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.438+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.438+0000 7f2f3520f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:24.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.438+0000 7f2f3520f800 20 started sync module instance, tier type = 2024-03-09T14:40:24.440 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.438+0000 7f2f3520f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:24.449 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.448+0000 7f2f3520f800 20 add_watcher() i=0 2024-03-09T14:40:24.449 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.448+0000 7f2f3520f800 20 add_watcher() i=1 2024-03-09T14:40:24.449 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.448+0000 7f2f3520f800 20 add_watcher() i=2 2024-03-09T14:40:24.449 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.448+0000 7f2f3520f800 20 add_watcher() i=3 2024-03-09T14:40:24.449 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.448+0000 7f2f3520f800 20 add_watcher() i=4 2024-03-09T14:40:24.449 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.448+0000 7f2f3520f800 20 add_watcher() i=5 2024-03-09T14:40:24.450 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.448+0000 7f2f3520f800 20 add_watcher() i=6 2024-03-09T14:40:24.450 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.449+0000 7f2f3520f800 20 add_watcher() i=7 2024-03-09T14:40:24.450 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.449+0000 7f2f3520f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:24.452 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.452+0000 7f2de6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:24.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.452+0000 7f2f3520f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:24.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.452+0000 7f2f3520f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:24.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.452+0000 7f2f3520f800 5 note: GC not initialized 2024-03-09T14:40:24.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.452+0000 7f2de5fe3640 20 reqs_thread_entry: start 2024-03-09T14:40:24.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.452+0000 7f2f3520f800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:24.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.452+0000 7f2f3520f800 20 Filter name: none 2024-03-09T14:40:24.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.452+0000 7f2d577fe640 20 reqs_thread_entry: start 2024-03-09T14:40:24.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.452+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.453+0000 7f2f3520f800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:40:24.454 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.453+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.455 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.454+0000 7f2f3520f800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:40:24.455 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.454+0000 7f2f3520f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:24.455 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.454+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.455 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.454+0000 7f2f3520f800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:40:24.455 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.454+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.456 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.455+0000 7f2f3520f800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:40:24.456 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.455+0000 7f2f3520f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:24.457 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.456+0000 7f2f3520f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.457 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.456+0000 7f2f3520f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:24.457 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.457+0000 7f2de6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:24.461 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.459+0000 7f2f3520f800 20 remove_watcher() i=0 2024-03-09T14:40:24.461 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.459+0000 7f2f3520f800 2 removed watcher, disabling cache 2024-03-09T14:40:24.461 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.461+0000 7f2f3520f800 20 remove_watcher() i=1 2024-03-09T14:40:24.462 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.462+0000 7f2f3520f800 20 remove_watcher() i=2 2024-03-09T14:40:24.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.463+0000 7f2f3520f800 20 remove_watcher() i=3 2024-03-09T14:40:24.464 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.464+0000 7f2f3520f800 20 remove_watcher() i=4 2024-03-09T14:40:24.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.465+0000 7f2f3520f800 20 remove_watcher() i=5 2024-03-09T14:40:24.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.466+0000 7f2f3520f800 20 remove_watcher() i=6 2024-03-09T14:40:24.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.467+0000 7f2f3520f800 20 remove_watcher() i=7 2024-03-09T14:40:24.477 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:24.477 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:40:24.477 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: a-bucket id: 5d93e872-363b-498b-b665-658644296b85.4535.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-03-09T14:40:24.477 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:24.479 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-03-09T14:40:24.507 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:24.508 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:24.541 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.540+0000 7f0afa72e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.541+0000 7f0afa72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:24.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.541+0000 7f0afa72e800 20 realm 2024-03-09T14:40:24.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.541+0000 7f0afa72e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.541+0000 7f0afa72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:24.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.541+0000 7f0afa72e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:24.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.541+0000 7f0afa72e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.542+0000 7f0afa72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:24.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.542+0000 7f0afa72e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.543+0000 7f0afa72e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:24.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.543+0000 7f0afa72e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.543+0000 7f0afa72e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:24.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.543+0000 7f0afa72e800 20 searching for the correct realm 2024-03-09T14:40:24.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.545+0000 7f0af6cf0640 0 -- 172.21.15.88:0/2462113064 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f0af007f020 msgr2=0x7f0af005fa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:24.751 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.751+0000 7f0af5cee640 0 -- 172.21.15.88:0/2462113064 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f0af008bbc0 msgr2=0x7f0af0060780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:24.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.957+0000 7f0afa72e800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:24.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.957+0000 7f0afa72e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:24.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.957+0000 7f0afa72e800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:24.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.957+0000 7f0afa72e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:24.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.957+0000 7f0afa72e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:24.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.957+0000 7f0afa72e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:24.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.957+0000 7f0afa72e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.957+0000 7f0afa72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:24.959 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.957+0000 7f0afa72e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.958+0000 7f0afa72e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:24.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.958+0000 7f0afa72e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.958+0000 7f0afa72e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:24.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.958+0000 7f0afa72e800 20 zone default found 2024-03-09T14:40:24.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.958+0000 7f0afa72e800 4 Realm: () 2024-03-09T14:40:24.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.958+0000 7f0afa72e800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:24.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.958+0000 7f0afa72e800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:24.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.958+0000 7f0afa72e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:24.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.958+0000 7f0afa72e800 20 zonegroup default 2024-03-09T14:40:24.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.958+0000 7f0afa72e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.958+0000 7f0afa72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:24.960 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.958+0000 7f0afa72e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.961 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.959+0000 7f0afa72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:24.961 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.959+0000 7f0afa72e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.961 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.959+0000 7f0afa72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:24.961 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.959+0000 7f0afa72e800 20 started sync module instance, tier type = 2024-03-09T14:40:24.961 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.959+0000 7f0afa72e800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:24.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.968+0000 7f0afa72e800 20 add_watcher() i=0 2024-03-09T14:40:24.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.968+0000 7f0afa72e800 20 add_watcher() i=1 2024-03-09T14:40:24.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.968+0000 7f0afa72e800 20 add_watcher() i=2 2024-03-09T14:40:24.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.968+0000 7f0afa72e800 20 add_watcher() i=3 2024-03-09T14:40:24.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.968+0000 7f0afa72e800 20 add_watcher() i=4 2024-03-09T14:40:24.969 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.968+0000 7f0afa72e800 20 add_watcher() i=5 2024-03-09T14:40:24.970 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.968+0000 7f0afa72e800 20 add_watcher() i=6 2024-03-09T14:40:24.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.969+0000 7f0afa72e800 20 add_watcher() i=7 2024-03-09T14:40:24.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.969+0000 7f0afa72e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:24.971 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.971+0000 7f09acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:24.973 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.971+0000 7f0afa72e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:24.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.971+0000 7f0afa72e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:24.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.971+0000 7f0afa72e800 5 note: GC not initialized 2024-03-09T14:40:24.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.971+0000 7f09277fe640 20 reqs_thread_entry: start 2024-03-09T14:40:24.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.971+0000 7f0afa72e800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:24.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.971+0000 7f0afa72e800 20 Filter name: none 2024-03-09T14:40:24.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.971+0000 7f09257fa640 20 reqs_thread_entry: start 2024-03-09T14:40:24.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.971+0000 7f0afa72e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-09T14:40:24.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.971+0000 7f0afa72e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.972+0000 7f0afa72e800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:40:24.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.972+0000 7f0afa72e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-03-09T14:40:24.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.972+0000 7f0afa72e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-09T14:40:24.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.972+0000 7f0afa72e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 : miss 2024-03-09T14:40:24.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.972+0000 7f0afa72e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:24.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.972+0000 7f0afa72e800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:40:24.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.972+0000 7f0afa72e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:40:24.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.972+0000 7f0afa72e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:40:24.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.972+0000 7f0afa72e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:24.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.972+0000 7f0afa72e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:40:24.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.972+0000 7f0afa72e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 2024-03-09T14:40:24.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.974+0000 7f09acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:24.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.977+0000 7f0afa72e800 20 remove_watcher() i=0 2024-03-09T14:40:24.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.977+0000 7f0afa72e800 2 removed watcher, disabling cache 2024-03-09T14:40:24.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.978+0000 7f0afa72e800 20 remove_watcher() i=1 2024-03-09T14:40:24.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.979+0000 7f0afa72e800 20 remove_watcher() i=2 2024-03-09T14:40:24.981 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.981+0000 7f0afa72e800 20 remove_watcher() i=3 2024-03-09T14:40:24.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.982+0000 7f0afa72e800 20 remove_watcher() i=4 2024-03-09T14:40:24.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.983+0000 7f0afa72e800 20 remove_watcher() i=5 2024-03-09T14:40:24.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.983+0000 7f0afa72e800 20 remove_watcher() i=6 2024-03-09T14:40:24.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:24.984+0000 7f0afa72e800 20 remove_watcher() i=7 2024-03-09T14:40:24.996 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin reshard list 2024-03-09T14:40:25.021 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:25.021 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:25.256 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.255+0000 7f50ef4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.257+0000 7f50ef4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:25.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.257+0000 7f50ef4c0800 20 realm 2024-03-09T14:40:25.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.257+0000 7f50ef4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.257+0000 7f50ef4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:25.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.257+0000 7f50ef4c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:25.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.257+0000 7f50ef4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.257+0000 7f50ef4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:25.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.257+0000 7f50ef4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.258+0000 7f50ef4c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:25.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.258+0000 7f50ef4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.259+0000 7f50ef4c0800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:25.260 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.259+0000 7f50ef4c0800 20 searching for the correct realm 2024-03-09T14:40:25.261 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.260+0000 7f50ed7c4640 0 -- 172.21.15.88:0/3300377571 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x562745a61de0 msgr2=0x562745a641d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:25.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.264+0000 7f50ed7c4640 0 -- 172.21.15.88:0/3300377571 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x7f4fb807ad10 msgr2=0x7f4fb807d140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:25.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:25.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:25.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:25.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:25.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:25.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:25.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:25.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:25.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:25.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 20 zone default found 2024-03-09T14:40:25.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 4 Realm: () 2024-03-09T14:40:25.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:25.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:25.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:25.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 20 zonegroup default 2024-03-09T14:40:25.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.270+0000 7f50ef4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.271+0000 7f50ef4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:25.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.271+0000 7f50ef4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.271+0000 7f50ef4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:25.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.271+0000 7f50ef4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.271+0000 7f50ef4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:25.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.271+0000 7f50ef4c0800 20 started sync module instance, tier type = 2024-03-09T14:40:25.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.271+0000 7f50ef4c0800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:25.281 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.280+0000 7f50ef4c0800 20 add_watcher() i=0 2024-03-09T14:40:25.281 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.280+0000 7f50ef4c0800 20 add_watcher() i=1 2024-03-09T14:40:25.281 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.280+0000 7f50ef4c0800 20 add_watcher() i=2 2024-03-09T14:40:25.281 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.280+0000 7f50ef4c0800 20 add_watcher() i=3 2024-03-09T14:40:25.281 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.280+0000 7f50ef4c0800 20 add_watcher() i=4 2024-03-09T14:40:25.282 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.280+0000 7f50ef4c0800 20 add_watcher() i=5 2024-03-09T14:40:25.282 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.280+0000 7f50ef4c0800 20 add_watcher() i=6 2024-03-09T14:40:25.282 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.281+0000 7f50ef4c0800 20 add_watcher() i=7 2024-03-09T14:40:25.282 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.281+0000 7f50ef4c0800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:25.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.283+0000 7f4fa2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:25.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.283+0000 7f50ef4c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:25.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.283+0000 7f50ef4c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:25.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.283+0000 7f50ef4c0800 5 note: GC not initialized 2024-03-09T14:40:25.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.284+0000 7f4fa1fe3640 20 reqs_thread_entry: start 2024-03-09T14:40:25.286 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.284+0000 7f50ef4c0800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:25.287 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.284+0000 7f50ef4c0800 20 Filter name: none 2024-03-09T14:40:25.287 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.284+0000 7f4f137fe640 20 reqs_thread_entry: start 2024-03-09T14:40:25.290 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.290+0000 7f4fa2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:25.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.292+0000 7f50ef4c0800 20 remove_watcher() i=0 2024-03-09T14:40:25.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.292+0000 7f50ef4c0800 2 removed watcher, disabling cache 2024-03-09T14:40:25.294 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.293+0000 7f50ef4c0800 20 remove_watcher() i=1 2024-03-09T14:40:25.295 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.294+0000 7f50ef4c0800 20 remove_watcher() i=2 2024-03-09T14:40:25.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.295+0000 7f50ef4c0800 20 remove_watcher() i=3 2024-03-09T14:40:25.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.296+0000 7f50ef4c0800 20 remove_watcher() i=4 2024-03-09T14:40:25.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.297+0000 7f50ef4c0800 20 remove_watcher() i=5 2024-03-09T14:40:25.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.298+0000 7f50ef4c0800 20 remove_watcher() i=6 2024-03-09T14:40:25.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.299+0000 7f50ef4c0800 20 remove_watcher() i=7 2024-03-09T14:40:25.310 INFO:tasks.workunit.client.0.smithi088.stderr:bucket name a-bucket 2024-03-09T14:40:25.310 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: reshard process 2024-03-09T14:40:25.310 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:25.311 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin reshard process 2024-03-09T14:40:25.336 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:25.336 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:25.370 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.369+0000 7f881a217800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.370+0000 7f881a217800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:25.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.370+0000 7f881a217800 20 realm 2024-03-09T14:40:25.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.370+0000 7f881a217800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.370+0000 7f881a217800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:25.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.370+0000 7f881a217800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:25.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.370+0000 7f881a217800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.370+0000 7f881a217800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:25.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.370+0000 7f881a217800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.371+0000 7f881a217800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:25.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.371+0000 7f881a217800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.372+0000 7f881a217800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:25.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.372+0000 7f881a217800 20 searching for the correct realm 2024-03-09T14:40:25.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.373+0000 7f881501c640 0 -- 172.21.15.88:0/1564055978 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f8808065830 msgr2=0x7f8808056f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:25.377 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.377+0000 7f881501c640 0 -- 172.21.15.88:0/1564055978 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f86e007ace0 msgr2=0x7f86e007d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:25.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.382+0000 7f881a217800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:25.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.382+0000 7f881a217800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:25.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.382+0000 7f881a217800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:25.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.382+0000 7f881a217800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:25.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.382+0000 7f881a217800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:25.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.382+0000 7f881a217800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:25.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.382+0000 7f881a217800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.383+0000 7f881a217800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:25.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.383+0000 7f881a217800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.383+0000 7f881a217800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:25.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.383+0000 7f881a217800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.385 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.383+0000 7f881a217800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:25.385 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.383+0000 7f881a217800 20 zone default found 2024-03-09T14:40:25.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.383+0000 7f881a217800 4 Realm: () 2024-03-09T14:40:25.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.383+0000 7f881a217800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:25.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.383+0000 7f881a217800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:25.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.383+0000 7f881a217800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:25.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.383+0000 7f881a217800 20 zonegroup default 2024-03-09T14:40:25.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.383+0000 7f881a217800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.383+0000 7f881a217800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:25.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.383+0000 7f881a217800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.384+0000 7f881a217800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:25.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.384+0000 7f881a217800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.384+0000 7f881a217800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:25.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.384+0000 7f881a217800 20 started sync module instance, tier type = 2024-03-09T14:40:25.387 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.384+0000 7f881a217800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:25.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.393+0000 7f881a217800 20 add_watcher() i=0 2024-03-09T14:40:25.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.393+0000 7f881a217800 20 add_watcher() i=1 2024-03-09T14:40:25.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.393+0000 7f881a217800 20 add_watcher() i=2 2024-03-09T14:40:25.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.393+0000 7f881a217800 20 add_watcher() i=3 2024-03-09T14:40:25.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.393+0000 7f881a217800 20 add_watcher() i=4 2024-03-09T14:40:25.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.393+0000 7f881a217800 20 add_watcher() i=5 2024-03-09T14:40:25.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.393+0000 7f881a217800 20 add_watcher() i=6 2024-03-09T14:40:25.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.394+0000 7f881a217800 20 add_watcher() i=7 2024-03-09T14:40:25.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.394+0000 7f881a217800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:25.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.395+0000 7f86c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:25.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.396+0000 7f881a217800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:25.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.396+0000 7f881a217800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:25.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.396+0000 7f881a217800 5 note: GC not initialized 2024-03-09T14:40:25.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.396+0000 7f86c67fc640 20 reqs_thread_entry: start 2024-03-09T14:40:25.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.396+0000 7f881a217800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:25.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.396+0000 7f881a217800 20 Filter name: none 2024-03-09T14:40:25.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.396+0000 7f8637fff640 20 reqs_thread_entry: start 2024-03-09T14:40:25.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.396+0000 7f881a217800 20 processing logshard = reshard.0000000000 2024-03-09T14:40:25.399 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.399+0000 7f881a217800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-03-09T14:40:25.399 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.399+0000 7f881a217800 20 processing logshard = reshard.0000000001 2024-03-09T14:40:25.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.401+0000 7f881a217800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-03-09T14:40:25.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.401+0000 7f881a217800 20 processing logshard = reshard.0000000002 2024-03-09T14:40:25.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.403+0000 7f881a217800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-03-09T14:40:25.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.403+0000 7f881a217800 20 processing logshard = reshard.0000000003 2024-03-09T14:40:25.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.406+0000 7f881a217800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-03-09T14:40:25.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.406+0000 7f881a217800 20 processing logshard = reshard.0000000004 2024-03-09T14:40:25.409 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.408+0000 7f881a217800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-03-09T14:40:25.409 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.408+0000 7f881a217800 20 processing logshard = reshard.0000000005 2024-03-09T14:40:25.411 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.410+0000 7f881a217800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-03-09T14:40:25.411 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.410+0000 7f881a217800 20 processing logshard = reshard.0000000006 2024-03-09T14:40:25.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.412+0000 7f881a217800 20 process_entry resharding a-bucket 2024-03-09T14:40:25.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.412+0000 7f881a217800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-09T14:40:25.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.412+0000 7f881a217800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.412+0000 7f881a217800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:40:25.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.412+0000 7f881a217800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-03-09T14:40:25.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.412+0000 7f881a217800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-09T14:40:25.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.412+0000 7f881a217800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 : miss 2024-03-09T14:40:25.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.412+0000 7f881a217800 20 rados->read ofs=0 len=0 2024-03-09T14:40:25.414 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.413+0000 7f881a217800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:40:25.414 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.413+0000 7f881a217800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:40:25.414 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.413+0000 7f881a217800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:40:25.414 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.413+0000 7f881a217800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:25.414 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.413+0000 7f881a217800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:40:25.414 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.413+0000 7f881a217800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 2024-03-09T14:40:25.419 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.419+0000 7f881a217800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:40:25.419 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.419+0000 7f881a217800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:40:25.420 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.419+0000 7f881a217800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:40:25.420 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.419+0000 7f881a217800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17, ofs0, ns] 2024-03-09T14:40:25.420 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.419+0000 7f86f97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464271 cookie 94256044367488 notifier 6003 bl.length()=819 2024-03-09T14:40:25.420 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.419+0000 7f86f97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:40:25.420 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.419+0000 7f86f97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:40:25.420 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.419+0000 7f86f97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:40:25.421 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.421+0000 7f881a217800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): orig_sources= new_sources= 2024-03-09T14:40:25.421 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.421+0000 7f881a217800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): potential sources added=[] removed=[] 2024-03-09T14:40:25.421 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.421+0000 7f881a217800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): orig_dests= new_dests= 2024-03-09T14:40:25.421 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.421+0000 7f881a217800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): potential dests added=[] removed=[] 2024-03-09T14:40:25.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.0 2024-03-09T14:40:25.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.0 2024-03-09T14:40:25.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.1 2024-03-09T14:40:25.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.1 2024-03-09T14:40:25.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.2 2024-03-09T14:40:25.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.2 2024-03-09T14:40:25.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.3 2024-03-09T14:40:25.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.3 2024-03-09T14:40:25.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.4 2024-03-09T14:40:25.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.4 2024-03-09T14:40:25.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.5 2024-03-09T14:40:25.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.5 2024-03-09T14:40:25.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.6 2024-03-09T14:40:25.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.6 2024-03-09T14:40:25.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.7 2024-03-09T14:40:25.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.7 2024-03-09T14:40:25.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.8 2024-03-09T14:40:25.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.8 2024-03-09T14:40:25.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.9 2024-03-09T14:40:25.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.9 2024-03-09T14:40:25.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.10 2024-03-09T14:40:25.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.10 2024-03-09T14:40:25.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.11 2024-03-09T14:40:25.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.11 2024-03-09T14:40:25.426 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.0 2024-03-09T14:40:25.426 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.423+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1 2024-03-09T14:40:25.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.424+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2 2024-03-09T14:40:25.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.424+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.3 2024-03-09T14:40:25.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.424+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.4 2024-03-09T14:40:25.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.425+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.5 2024-03-09T14:40:25.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.425+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.6 2024-03-09T14:40:25.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.426+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.7 2024-03-09T14:40:25.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.426+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.8 2024-03-09T14:40:25.428 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.426+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.9 2024-03-09T14:40:25.428 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.427+0000 7f881a217800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.10 2024-03-09T14:40:25.428 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.427+0000 7f881a217800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 : hit (requested=0x17, cached=0x17) 2024-03-09T14:40:25.428 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.428+0000 7f881a217800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 2024-03-09T14:40:25.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.429+0000 7f881a217800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:40:25.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.429+0000 7f881a217800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:40:25.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.429+0000 7f881a217800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:40:25.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.429+0000 7f881a217800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17, ofs0, ns] 2024-03-09T14:40:25.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.429+0000 7f86f8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464272 cookie 94256044367488 notifier 6003 bl.length()=787 2024-03-09T14:40:25.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.429+0000 7f86f8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:40:25.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.429+0000 7f86f8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:40:25.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.429+0000 7f86f8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:40:25.431 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.430+0000 7f881a217800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): orig_sources= new_sources= 2024-03-09T14:40:25.431 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.430+0000 7f881a217800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): potential sources added=[] removed=[] 2024-03-09T14:40:25.431 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.430+0000 7f881a217800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): orig_dests= new_dests= 2024-03-09T14:40:25.431 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.430+0000 7f881a217800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): potential dests added=[] removed=[] 2024-03-09T14:40:25.433 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.433+0000 7f881a217800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-03-09T14:40:25.434 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.434+0000 7f881a217800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-03-09T14:40:25.436 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.435+0000 7f881a217800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-03-09T14:40:25.436 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.435+0000 7f881a217800 20 processing logshard = reshard.0000000007 2024-03-09T14:40:25.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.437+0000 7f881a217800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-03-09T14:40:25.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.437+0000 7f881a217800 20 processing logshard = reshard.0000000008 2024-03-09T14:40:25.441 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.440+0000 7f881a217800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-03-09T14:40:25.441 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.440+0000 7f881a217800 20 processing logshard = reshard.0000000009 2024-03-09T14:40:25.443 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.442+0000 7f881a217800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-03-09T14:40:25.443 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.442+0000 7f881a217800 20 processing logshard = reshard.0000000010 2024-03-09T14:40:25.445 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.445+0000 7f881a217800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-03-09T14:40:25.445 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.445+0000 7f881a217800 20 processing logshard = reshard.0000000011 2024-03-09T14:40:25.447 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.447+0000 7f881a217800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-03-09T14:40:25.447 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.447+0000 7f881a217800 20 processing logshard = reshard.0000000012 2024-03-09T14:40:25.450 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.449+0000 7f881a217800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-03-09T14:40:25.450 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.449+0000 7f881a217800 20 processing logshard = reshard.0000000013 2024-03-09T14:40:25.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.452+0000 7f881a217800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-03-09T14:40:25.453 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.452+0000 7f881a217800 20 processing logshard = reshard.0000000014 2024-03-09T14:40:25.455 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.454+0000 7f881a217800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-03-09T14:40:25.455 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.454+0000 7f881a217800 20 processing logshard = reshard.0000000015 2024-03-09T14:40:25.457 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.457+0000 7f881a217800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-03-09T14:40:25.458 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.457+0000 7f86c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:25.460 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.460+0000 7f881a217800 20 remove_watcher() i=0 2024-03-09T14:40:25.460 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.460+0000 7f881a217800 2 removed watcher, disabling cache 2024-03-09T14:40:25.461 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.460+0000 7f881a217800 20 remove_watcher() i=1 2024-03-09T14:40:25.462 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.461+0000 7f881a217800 20 remove_watcher() i=2 2024-03-09T14:40:25.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.463+0000 7f881a217800 20 remove_watcher() i=3 2024-03-09T14:40:25.464 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.464+0000 7f881a217800 20 remove_watcher() i=4 2024-03-09T14:40:25.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.464+0000 7f881a217800 20 remove_watcher() i=5 2024-03-09T14:40:25.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.465+0000 7f881a217800 20 remove_watcher() i=6 2024-03-09T14:40:25.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:25.466+0000 7f881a217800 20 remove_watcher() i=7 2024-03-09T14:40:30.484 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-09T14:40:30.515 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:30.515 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:30.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.553+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.555+0000 7f18b772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:30.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.555+0000 7f18b772e800 20 realm 2024-03-09T14:40:30.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.555+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.555+0000 7f18b772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:30.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.555+0000 7f18b772e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:30.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.555+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.555+0000 7f18b772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:30.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.555+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.556+0000 7f18b772e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:30.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.556+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.557+0000 7f18b772e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:30.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.557+0000 7f18b772e800 20 searching for the correct realm 2024-03-09T14:40:30.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.557+0000 7f18b34ef640 0 -- 172.21.15.88:0/676375776 >> [v2:172.21.15.88:6800/4216886240,v1:172.21.15.88:6802/4216886240] conn(0x5640871171d0 msgr2=0x564087119690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:30.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.763+0000 7f18b34ef640 0 -- 172.21.15.88:0/676375776 >> [v2:172.21.15.132:6824/731564406,v1:172.21.15.132:6825/731564406] conn(0x564086ec58d0 msgr2=0x7f18ac079950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:30.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.974+0000 7f18b772e800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:30.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.974+0000 7f18b772e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:30.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.974+0000 7f18b772e800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:30.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.974+0000 7f18b772e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:30.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.974+0000 7f18b772e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:30.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.974+0000 7f18b772e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:30.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.974+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.974+0000 7f18b772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:30.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.974+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.974+0000 7f18b772e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:30.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.974+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.975+0000 7f18b772e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:30.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.975+0000 7f18b772e800 20 zone default found 2024-03-09T14:40:30.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.975+0000 7f18b772e800 4 Realm: () 2024-03-09T14:40:30.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.975+0000 7f18b772e800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:30.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.975+0000 7f18b772e800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:30.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.975+0000 7f18b772e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:30.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.975+0000 7f18b772e800 20 zonegroup default 2024-03-09T14:40:30.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.975+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.975+0000 7f18b772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:30.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.975+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.975+0000 7f18b772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:30.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.975+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.976+0000 7f18b772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:30.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.976+0000 7f18b772e800 20 started sync module instance, tier type = 2024-03-09T14:40:30.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.976+0000 7f18b772e800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:30.987 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.987+0000 7f18b772e800 20 add_watcher() i=0 2024-03-09T14:40:30.987 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.987+0000 7f18b772e800 20 add_watcher() i=1 2024-03-09T14:40:30.987 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.987+0000 7f18b772e800 20 add_watcher() i=2 2024-03-09T14:40:30.987 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.987+0000 7f18b772e800 20 add_watcher() i=3 2024-03-09T14:40:30.987 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.987+0000 7f18b772e800 20 add_watcher() i=4 2024-03-09T14:40:30.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.987+0000 7f18b772e800 20 add_watcher() i=5 2024-03-09T14:40:30.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.987+0000 7f18b772e800 20 add_watcher() i=6 2024-03-09T14:40:30.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.988+0000 7f18b772e800 20 add_watcher() i=7 2024-03-09T14:40:30.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.988+0000 7f18b772e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:30.990 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.990+0000 7f1769fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:30.991 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.990+0000 7f18b772e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:30.991 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.990+0000 7f18b772e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:30.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.990+0000 7f18b772e800 5 note: GC not initialized 2024-03-09T14:40:30.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.990+0000 7f1768fe1640 20 reqs_thread_entry: start 2024-03-09T14:40:30.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.990+0000 7f18b772e800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:30.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.991+0000 7f18b772e800 20 Filter name: none 2024-03-09T14:40:30.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.991+0000 7f16e27fc640 20 reqs_thread_entry: start 2024-03-09T14:40:30.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.991+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.991+0000 7f18b772e800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:40:30.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.991+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.992+0000 7f18b772e800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:40:30.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.992+0000 7f18b772e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:30.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.992+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.993+0000 7f18b772e800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:40:30.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.993+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.993+0000 7f18b772e800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:40:30.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.993+0000 7f18b772e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:30.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.995+0000 7f18b772e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:30.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.995+0000 7f18b772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:30.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.996+0000 7f1769fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:30.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.998+0000 7f18b772e800 20 remove_watcher() i=0 2024-03-09T14:40:30.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.998+0000 7f18b772e800 2 removed watcher, disabling cache 2024-03-09T14:40:31.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:30.999+0000 7f18b772e800 20 remove_watcher() i=1 2024-03-09T14:40:31.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.001+0000 7f18b772e800 20 remove_watcher() i=2 2024-03-09T14:40:31.002 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.002+0000 7f18b772e800 20 remove_watcher() i=3 2024-03-09T14:40:31.003 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.003+0000 7f18b772e800 20 remove_watcher() i=4 2024-03-09T14:40:31.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.004+0000 7f18b772e800 20 remove_watcher() i=5 2024-03-09T14:40:31.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.005+0000 7f18b772e800 20 remove_watcher() i=6 2024-03-09T14:40:31.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.006+0000 7f18b772e800 20 remove_watcher() i=7 2024-03-09T14:40:31.018 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:31.018 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:40:31.019 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: a-bucket id: 5d93e872-363b-498b-b665-658644296b85.4535.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-03-09T14:40:31.019 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:31.019 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: reshard add non empty bucket 2024-03-09T14:40:31.019 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:31.292 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-09T14:40:31.319 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:31.319 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:31.352 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.351+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.353+0000 7fce8e00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:31.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.353+0000 7fce8e00f800 20 realm 2024-03-09T14:40:31.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.353+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.353+0000 7fce8e00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:31.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.353+0000 7fce8e00f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:31.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.353+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.353+0000 7fce8e00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:31.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.353+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.354+0000 7fce8e00f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:31.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.354+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.355+0000 7fce8e00f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:31.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.355+0000 7fce8e00f800 20 searching for the correct realm 2024-03-09T14:40:31.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.357+0000 7fce89fcd640 0 -- 172.21.15.88:0/244982485 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fce84057750 msgr2=0x7fce84003930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:31.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.563+0000 7fce80fcb640 0 -- 172.21.15.88:0/244982485 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fce84081ca0 msgr2=0x7fce8405d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:31.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.769+0000 7fce8e00f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:31.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.769+0000 7fce8e00f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:31.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.769+0000 7fce8e00f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:31.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.769+0000 7fce8e00f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:31.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.769+0000 7fce8e00f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:31.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.769+0000 7fce8e00f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:31.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.769+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.770+0000 7fce8e00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:31.771 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.770+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.770+0000 7fce8e00f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:31.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.770+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.770+0000 7fce8e00f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:31.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.770+0000 7fce8e00f800 20 zone default found 2024-03-09T14:40:31.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.770+0000 7fce8e00f800 4 Realm: () 2024-03-09T14:40:31.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.770+0000 7fce8e00f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:31.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.770+0000 7fce8e00f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:31.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.770+0000 7fce8e00f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:31.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.770+0000 7fce8e00f800 20 zonegroup default 2024-03-09T14:40:31.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.770+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.771+0000 7fce8e00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:31.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.771+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.771+0000 7fce8e00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:31.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.771+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.771+0000 7fce8e00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:31.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.771+0000 7fce8e00f800 20 started sync module instance, tier type = 2024-03-09T14:40:31.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.771+0000 7fce8e00f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:31.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.781+0000 7fce8e00f800 20 add_watcher() i=0 2024-03-09T14:40:31.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.781+0000 7fce8e00f800 20 add_watcher() i=1 2024-03-09T14:40:31.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.781+0000 7fce8e00f800 20 add_watcher() i=2 2024-03-09T14:40:31.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.781+0000 7fce8e00f800 20 add_watcher() i=3 2024-03-09T14:40:31.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.781+0000 7fce8e00f800 20 add_watcher() i=4 2024-03-09T14:40:31.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.781+0000 7fce8e00f800 20 add_watcher() i=5 2024-03-09T14:40:31.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.781+0000 7fce8e00f800 20 add_watcher() i=6 2024-03-09T14:40:31.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.782+0000 7fce8e00f800 20 add_watcher() i=7 2024-03-09T14:40:31.783 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.782+0000 7fce8e00f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:31.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.784+0000 7fcd3f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:31.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.784+0000 7fce8e00f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:31.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.784+0000 7fce8e00f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:31.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.784+0000 7fce8e00f800 5 note: GC not initialized 2024-03-09T14:40:31.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.784+0000 7fcd3e7e4640 20 reqs_thread_entry: start 2024-03-09T14:40:31.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.784+0000 7fce8e00f800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:31.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.784+0000 7fce8e00f800 20 Filter name: none 2024-03-09T14:40:31.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.784+0000 7fccaffff640 20 reqs_thread_entry: start 2024-03-09T14:40:31.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.784+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.785+0000 7fce8e00f800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:40:31.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.785+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.785+0000 7fce8e00f800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:40:31.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.785+0000 7fce8e00f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:31.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.785+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.786+0000 7fce8e00f800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:40:31.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.786+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.786+0000 7fce8e00f800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:40:31.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.786+0000 7fce8e00f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:31.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.787+0000 7fce8e00f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.787+0000 7fce8e00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:31.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.788+0000 7fcd3f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:31.791 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.790+0000 7fce8e00f800 20 remove_watcher() i=0 2024-03-09T14:40:31.791 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.790+0000 7fce8e00f800 2 removed watcher, disabling cache 2024-03-09T14:40:31.792 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.791+0000 7fce8e00f800 20 remove_watcher() i=1 2024-03-09T14:40:31.793 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.792+0000 7fce8e00f800 20 remove_watcher() i=2 2024-03-09T14:40:31.794 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.793+0000 7fce8e00f800 20 remove_watcher() i=3 2024-03-09T14:40:31.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.794+0000 7fce8e00f800 20 remove_watcher() i=4 2024-03-09T14:40:31.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.795+0000 7fce8e00f800 20 remove_watcher() i=5 2024-03-09T14:40:31.797 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.796+0000 7fce8e00f800 20 remove_watcher() i=6 2024-03-09T14:40:31.798 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.797+0000 7fce8e00f800 20 remove_watcher() i=7 2024-03-09T14:40:31.807 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:31.808 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:40:31.808 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: a-bucket id: 5d93e872-363b-498b-b665-658644296b85.4535.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-03-09T14:40:31.808 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:31.809 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-03-09T14:40:31.838 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:31.838 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:31.872 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.871+0000 7f58cbe2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.873 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.872+0000 7f58cbe2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:31.873 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.872+0000 7f58cbe2d800 20 realm 2024-03-09T14:40:31.873 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.872+0000 7f58cbe2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.874 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.873+0000 7f58cbe2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:31.874 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.873+0000 7f58cbe2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:31.874 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.873+0000 7f58cbe2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.874 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.873+0000 7f58cbe2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:31.874 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.873+0000 7f58cbe2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.874 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.873+0000 7f58cbe2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:31.874 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.874+0000 7f58cbe2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:31.875 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.874+0000 7f58cbe2d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:31.875 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.874+0000 7f58cbe2d800 20 searching for the correct realm 2024-03-09T14:40:31.877 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:31.877+0000 7f58c783d640 0 -- 172.21.15.88:0/3954894718 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f58c0072870 msgr2=0x7f58c0074a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:32.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.083+0000 7f58bffff640 0 -- 172.21.15.88:0/3954894718 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f58c002d100 msgr2=0x7f58c0065120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:32.290 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.289+0000 7f58cbe2d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:32.290 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.289+0000 7f58cbe2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:32.290 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.289+0000 7f58cbe2d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:32.290 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.289+0000 7f58cbe2d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:32.290 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.289+0000 7f58cbe2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:32.291 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.289+0000 7f58cbe2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:32.291 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.289+0000 7f58cbe2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.291 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.289+0000 7f58cbe2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:32.291 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.289+0000 7f58cbe2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.290+0000 7f58cbe2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:32.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.290+0000 7f58cbe2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.290+0000 7f58cbe2d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:32.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.290+0000 7f58cbe2d800 20 zone default found 2024-03-09T14:40:32.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.290+0000 7f58cbe2d800 4 Realm: () 2024-03-09T14:40:32.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.290+0000 7f58cbe2d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:32.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.290+0000 7f58cbe2d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:32.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.290+0000 7f58cbe2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:32.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.290+0000 7f58cbe2d800 20 zonegroup default 2024-03-09T14:40:32.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.290+0000 7f58cbe2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.290+0000 7f58cbe2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:32.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.290+0000 7f58cbe2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.291+0000 7f58cbe2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:32.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.291+0000 7f58cbe2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.291+0000 7f58cbe2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:32.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.291+0000 7f58cbe2d800 20 started sync module instance, tier type = 2024-03-09T14:40:32.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.291+0000 7f58cbe2d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:32.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.301+0000 7f58cbe2d800 20 add_watcher() i=0 2024-03-09T14:40:32.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.301+0000 7f58cbe2d800 20 add_watcher() i=1 2024-03-09T14:40:32.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.301+0000 7f58cbe2d800 20 add_watcher() i=2 2024-03-09T14:40:32.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.301+0000 7f58cbe2d800 20 add_watcher() i=3 2024-03-09T14:40:32.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.301+0000 7f58cbe2d800 20 add_watcher() i=4 2024-03-09T14:40:32.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.301+0000 7f58cbe2d800 20 add_watcher() i=5 2024-03-09T14:40:32.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.301+0000 7f58cbe2d800 20 add_watcher() i=6 2024-03-09T14:40:32.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.301+0000 7f58cbe2d800 20 add_watcher() i=7 2024-03-09T14:40:32.303 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.301+0000 7f58cbe2d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:32.304 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.303+0000 7f577dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:32.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.303+0000 7f58cbe2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:32.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.303+0000 7f58cbe2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:32.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.303+0000 7f58cbe2d800 5 note: GC not initialized 2024-03-09T14:40:32.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.304+0000 7f577cfe1640 20 reqs_thread_entry: start 2024-03-09T14:40:32.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.304+0000 7f58cbe2d800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:32.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.304+0000 7f58cbe2d800 20 Filter name: none 2024-03-09T14:40:32.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.304+0000 7f56f67fc640 20 reqs_thread_entry: start 2024-03-09T14:40:32.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.304+0000 7f58cbe2d800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-09T14:40:32.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.304+0000 7f58cbe2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.304+0000 7f58cbe2d800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:40:32.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.304+0000 7f58cbe2d800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-03-09T14:40:32.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.304+0000 7f58cbe2d800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-09T14:40:32.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.304+0000 7f58cbe2d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 : miss 2024-03-09T14:40:32.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.304+0000 7f58cbe2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.305+0000 7f58cbe2d800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:40:32.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.305+0000 7f58cbe2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:40:32.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.305+0000 7f58cbe2d800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:40:32.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.305+0000 7f58cbe2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:32.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.305+0000 7f58cbe2d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:40:32.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.305+0000 7f58cbe2d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 2024-03-09T14:40:32.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.307+0000 7f577dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:32.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.310+0000 7f58cbe2d800 20 remove_watcher() i=0 2024-03-09T14:40:32.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.310+0000 7f58cbe2d800 2 removed watcher, disabling cache 2024-03-09T14:40:32.312 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.311+0000 7f58cbe2d800 20 remove_watcher() i=1 2024-03-09T14:40:32.312 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.312+0000 7f58cbe2d800 20 remove_watcher() i=2 2024-03-09T14:40:32.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.313+0000 7f58cbe2d800 20 remove_watcher() i=3 2024-03-09T14:40:32.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.314+0000 7f58cbe2d800 20 remove_watcher() i=4 2024-03-09T14:40:32.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.315+0000 7f58cbe2d800 20 remove_watcher() i=5 2024-03-09T14:40:32.317 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.316+0000 7f58cbe2d800 20 remove_watcher() i=6 2024-03-09T14:40:32.318 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.317+0000 7f58cbe2d800 20 remove_watcher() i=7 2024-03-09T14:40:32.329 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin reshard list 2024-03-09T14:40:32.354 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:32.354 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:32.585 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.584+0000 7fd48e1bb640 0 --2- 172.21.15.88:0/943410271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558a7be7a180 0x558a7be78e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-09T14:40:32.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.588+0000 7fd498ec0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.589+0000 7fd498ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:32.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.589+0000 7fd498ec0800 20 realm 2024-03-09T14:40:32.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.589+0000 7fd498ec0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.590+0000 7fd498ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:32.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.590+0000 7fd498ec0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:32.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.590+0000 7fd498ec0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.590+0000 7fd498ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:32.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.590+0000 7fd498ec0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.591+0000 7fd498ec0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:32.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.591+0000 7fd498ec0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.591+0000 7fd498ec0800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:32.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.591+0000 7fd498ec0800 20 searching for the correct realm 2024-03-09T14:40:32.593 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.593+0000 7fd48e1bb640 0 -- 172.21.15.88:0/435046054 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7fd3600071f0 msgr2=0x7fd48803e990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:32.800 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.799+0000 7fd4971bd640 0 -- 172.21.15.88:0/435046054 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x558a7be9fe50 msgr2=0x558a7bea2240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:32.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.805+0000 7fd498ec0800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:32.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.805+0000 7fd498ec0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:32.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.805+0000 7fd498ec0800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:32.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.805+0000 7fd498ec0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:32.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.805+0000 7fd498ec0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:32.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.805+0000 7fd498ec0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:32.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.805+0000 7fd498ec0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.806+0000 7fd498ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:32.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.806+0000 7fd498ec0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.806+0000 7fd498ec0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:32.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.806+0000 7fd498ec0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.806+0000 7fd498ec0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:32.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.806+0000 7fd498ec0800 20 zone default found 2024-03-09T14:40:32.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.806+0000 7fd498ec0800 4 Realm: () 2024-03-09T14:40:32.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.806+0000 7fd498ec0800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:32.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.806+0000 7fd498ec0800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:32.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.806+0000 7fd498ec0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:32.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.806+0000 7fd498ec0800 20 zonegroup default 2024-03-09T14:40:32.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.806+0000 7fd498ec0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.806+0000 7fd498ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:32.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.806+0000 7fd498ec0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.807+0000 7fd498ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:32.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.807+0000 7fd498ec0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.807+0000 7fd498ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:32.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.807+0000 7fd498ec0800 20 started sync module instance, tier type = 2024-03-09T14:40:32.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.807+0000 7fd498ec0800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:32.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.816+0000 7fd498ec0800 20 add_watcher() i=0 2024-03-09T14:40:32.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.816+0000 7fd498ec0800 20 add_watcher() i=1 2024-03-09T14:40:32.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.816+0000 7fd498ec0800 20 add_watcher() i=2 2024-03-09T14:40:32.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.816+0000 7fd498ec0800 20 add_watcher() i=3 2024-03-09T14:40:32.818 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.816+0000 7fd498ec0800 20 add_watcher() i=4 2024-03-09T14:40:32.818 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.816+0000 7fd498ec0800 20 add_watcher() i=5 2024-03-09T14:40:32.818 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.816+0000 7fd498ec0800 20 add_watcher() i=6 2024-03-09T14:40:32.818 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.817+0000 7fd498ec0800 20 add_watcher() i=7 2024-03-09T14:40:32.819 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.817+0000 7fd498ec0800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:32.820 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.819+0000 7fd34d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:32.820 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.819+0000 7fd498ec0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:32.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.819+0000 7fd498ec0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:32.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.819+0000 7fd498ec0800 5 note: GC not initialized 2024-03-09T14:40:32.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.819+0000 7fd2c7fff640 20 reqs_thread_entry: start 2024-03-09T14:40:32.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.819+0000 7fd498ec0800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:32.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.819+0000 7fd498ec0800 20 Filter name: none 2024-03-09T14:40:32.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.819+0000 7fd2c5ffb640 20 reqs_thread_entry: start 2024-03-09T14:40:32.826 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.825+0000 7fd34d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:32.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.827+0000 7fd498ec0800 20 remove_watcher() i=0 2024-03-09T14:40:32.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.827+0000 7fd498ec0800 2 removed watcher, disabling cache 2024-03-09T14:40:32.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.828+0000 7fd498ec0800 20 remove_watcher() i=1 2024-03-09T14:40:32.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.830+0000 7fd498ec0800 20 remove_watcher() i=2 2024-03-09T14:40:32.831 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.831+0000 7fd498ec0800 20 remove_watcher() i=3 2024-03-09T14:40:32.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.832+0000 7fd498ec0800 20 remove_watcher() i=4 2024-03-09T14:40:32.833 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.833+0000 7fd498ec0800 20 remove_watcher() i=5 2024-03-09T14:40:32.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.833+0000 7fd498ec0800 20 remove_watcher() i=6 2024-03-09T14:40:32.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.834+0000 7fd498ec0800 20 remove_watcher() i=7 2024-03-09T14:40:32.845 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: reshard process non empty bucket 2024-03-09T14:40:32.845 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:32.849 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin reshard process 2024-03-09T14:40:32.872 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:32.873 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:32.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.905+0000 7f4c1e024800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.906+0000 7f4c1e024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:32.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.906+0000 7f4c1e024800 20 realm 2024-03-09T14:40:32.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.906+0000 7f4c1e024800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.907+0000 7f4c1e024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:32.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.907+0000 7f4c1e024800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:32.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.907+0000 7f4c1e024800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.907+0000 7f4c1e024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:32.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.907+0000 7f4c1e024800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.908+0000 7f4c1e024800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:32.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.908+0000 7f4c1e024800 20 rados->read ofs=0 len=0 2024-03-09T14:40:32.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.908+0000 7f4c1e024800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:32.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.908+0000 7f4c1e024800 20 searching for the correct realm 2024-03-09T14:40:32.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:32.910+0000 7f4c1c328640 0 -- 172.21.15.88:0/3572744407 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f4c14018070 msgr2=0x7f4c14038e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:33.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.116+0000 7f4c1b326640 0 -- 172.21.15.88:0/3572744407 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f4c14071c00 msgr2=0x7f4c1406f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:33.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.322+0000 7f4c1e024800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:33.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.322+0000 7f4c1e024800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:33.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.322+0000 7f4c1e024800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:33.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.322+0000 7f4c1e024800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:33.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.322+0000 7f4c1e024800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:33.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.322+0000 7f4c1e024800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:33.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.322+0000 7f4c1e024800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.322+0000 7f4c1e024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:33.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.322+0000 7f4c1e024800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.323+0000 7f4c1e024800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:33.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.323+0000 7f4c1e024800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.323+0000 7f4c1e024800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:33.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.323+0000 7f4c1e024800 20 zone default found 2024-03-09T14:40:33.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.323+0000 7f4c1e024800 4 Realm: () 2024-03-09T14:40:33.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.323+0000 7f4c1e024800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:33.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.323+0000 7f4c1e024800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:33.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.323+0000 7f4c1e024800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:33.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.323+0000 7f4c1e024800 20 zonegroup default 2024-03-09T14:40:33.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.323+0000 7f4c1e024800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.323+0000 7f4c1e024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:33.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.323+0000 7f4c1e024800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.324+0000 7f4c1e024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:33.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.324+0000 7f4c1e024800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.324+0000 7f4c1e024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:33.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.324+0000 7f4c1e024800 20 started sync module instance, tier type = 2024-03-09T14:40:33.326 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.324+0000 7f4c1e024800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:33.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.334+0000 7f4c1e024800 20 add_watcher() i=0 2024-03-09T14:40:33.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.334+0000 7f4c1e024800 20 add_watcher() i=1 2024-03-09T14:40:33.335 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.334+0000 7f4c1e024800 20 add_watcher() i=2 2024-03-09T14:40:33.335 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.334+0000 7f4c1e024800 20 add_watcher() i=3 2024-03-09T14:40:33.335 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.334+0000 7f4c1e024800 20 add_watcher() i=4 2024-03-09T14:40:33.335 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.334+0000 7f4c1e024800 20 add_watcher() i=5 2024-03-09T14:40:33.335 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.334+0000 7f4c1e024800 20 add_watcher() i=6 2024-03-09T14:40:33.335 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.335+0000 7f4c1e024800 20 add_watcher() i=7 2024-03-09T14:40:33.335 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.335+0000 7f4c1e024800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:33.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.336+0000 7f4ad1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:33.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.337+0000 7f4c1e024800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:33.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.337+0000 7f4c1e024800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:33.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.337+0000 7f4c1e024800 5 note: GC not initialized 2024-03-09T14:40:33.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.337+0000 7f4ad0fe1640 20 reqs_thread_entry: start 2024-03-09T14:40:33.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.337+0000 7f4c1e024800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:33.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.337+0000 7f4c1e024800 20 Filter name: none 2024-03-09T14:40:33.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.337+0000 7f4a4a7fc640 20 reqs_thread_entry: start 2024-03-09T14:40:33.338 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.337+0000 7f4c1e024800 20 processing logshard = reshard.0000000000 2024-03-09T14:40:33.341 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.340+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-03-09T14:40:33.341 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.340+0000 7f4c1e024800 20 processing logshard = reshard.0000000001 2024-03-09T14:40:33.344 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.343+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-03-09T14:40:33.344 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.343+0000 7f4c1e024800 20 processing logshard = reshard.0000000002 2024-03-09T14:40:33.346 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.346+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-03-09T14:40:33.346 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.346+0000 7f4c1e024800 20 processing logshard = reshard.0000000003 2024-03-09T14:40:33.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.348+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-03-09T14:40:33.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.348+0000 7f4c1e024800 20 processing logshard = reshard.0000000004 2024-03-09T14:40:33.352 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.352+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-03-09T14:40:33.352 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.352+0000 7f4c1e024800 20 processing logshard = reshard.0000000005 2024-03-09T14:40:33.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.355+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-03-09T14:40:33.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.355+0000 7f4c1e024800 20 processing logshard = reshard.0000000006 2024-03-09T14:40:33.357 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.357+0000 7f4c1e024800 20 process_entry resharding a-bucket 2024-03-09T14:40:33.357 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.357+0000 7f4c1e024800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-09T14:40:33.357 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.357+0000 7f4c1e024800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.357+0000 7f4c1e024800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:40:33.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.357+0000 7f4c1e024800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-03-09T14:40:33.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.357+0000 7f4c1e024800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-09T14:40:33.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.357+0000 7f4c1e024800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 : miss 2024-03-09T14:40:33.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.357+0000 7f4c1e024800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.358+0000 7f4c1e024800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:40:33.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.358+0000 7f4c1e024800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:40:33.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.358+0000 7f4c1e024800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:40:33.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.358+0000 7f4c1e024800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:33.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.358+0000 7f4c1e024800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:40:33.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.358+0000 7f4c1e024800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 2024-03-09T14:40:33.366 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.365+0000 7f4c1e024800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:40:33.366 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.365+0000 7f4c1e024800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:40:33.366 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.365+0000 7f4c1e024800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:40:33.366 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.365+0000 7f4c1e024800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17, ofs0, ns] 2024-03-09T14:40:33.366 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.365+0000 7f4afa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464273 cookie 94771033125056 notifier 6093 bl.length()=819 2024-03-09T14:40:33.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.365+0000 7f4afa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:40:33.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.365+0000 7f4afa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:40:33.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.365+0000 7f4afa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:40:33.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.367+0000 7f4c1e024800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): orig_sources= new_sources= 2024-03-09T14:40:33.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.367+0000 7f4c1e024800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): potential sources added=[] removed=[] 2024-03-09T14:40:33.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.367+0000 7f4c1e024800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): orig_dests= new_dests= 2024-03-09T14:40:33.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.367+0000 7f4c1e024800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): potential dests added=[] removed=[] 2024-03-09T14:40:33.370 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.0 2024-03-09T14:40:33.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.0 2024-03-09T14:40:33.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.1 2024-03-09T14:40:33.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.1 2024-03-09T14:40:33.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.2 2024-03-09T14:40:33.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.2 2024-03-09T14:40:33.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.3 2024-03-09T14:40:33.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.3 2024-03-09T14:40:33.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.4 2024-03-09T14:40:33.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.4 2024-03-09T14:40:33.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.5 2024-03-09T14:40:33.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.5 2024-03-09T14:40:33.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.6 2024-03-09T14:40:33.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.6 2024-03-09T14:40:33.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.7 2024-03-09T14:40:33.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.7 2024-03-09T14:40:33.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.8 2024-03-09T14:40:33.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.8 2024-03-09T14:40:33.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.9 2024-03-09T14:40:33.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.9 2024-03-09T14:40:33.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.10 2024-03-09T14:40:33.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.10 2024-03-09T14:40:33.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.11 2024-03-09T14:40:33.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.11 2024-03-09T14:40:33.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.12 2024-03-09T14:40:33.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.12 2024-03-09T14:40:33.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.0 2024-03-09T14:40:33.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.0 2024-03-09T14:40:33.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.1 2024-03-09T14:40:33.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.370+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.1 2024-03-09T14:40:33.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.371+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.2 2024-03-09T14:40:33.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.371+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.2 2024-03-09T14:40:33.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.371+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.3 2024-03-09T14:40:33.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.371+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.3 2024-03-09T14:40:33.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.372+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.4 2024-03-09T14:40:33.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.372+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.4 2024-03-09T14:40:33.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.372+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.5 2024-03-09T14:40:33.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.372+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.5 2024-03-09T14:40:33.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.373+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.6 2024-03-09T14:40:33.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.373+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.6 2024-03-09T14:40:33.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.373+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.7 2024-03-09T14:40:33.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.373+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.7 2024-03-09T14:40:33.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.374+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.8 2024-03-09T14:40:33.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.374+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.8 2024-03-09T14:40:33.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.374+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.9 2024-03-09T14:40:33.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.374+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.9 2024-03-09T14:40:33.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.375+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.10 2024-03-09T14:40:33.376 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.375+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.10 2024-03-09T14:40:33.376 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.375+0000 7f4c1e024800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.11 2024-03-09T14:40:33.376 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.375+0000 7f4c1e024800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.1.11 2024-03-09T14:40:33.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.377+0000 7f4c1e024800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 : hit (requested=0x17, cached=0x17) 2024-03-09T14:40:33.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.377+0000 7f4c1e024800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 2024-03-09T14:40:33.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.379+0000 7f4c1e024800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:40:33.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.379+0000 7f4c1e024800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:40:33.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.379+0000 7f4c1e024800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:40:33.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.379+0000 7f4c1e024800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17, ofs0, ns] 2024-03-09T14:40:33.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.379+0000 7f4afa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464274 cookie 94771033125056 notifier 6093 bl.length()=787 2024-03-09T14:40:33.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.379+0000 7f4afa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:40:33.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.379+0000 7f4afa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:40:33.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.379+0000 7f4afa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:40:33.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.381+0000 7f4c1e024800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): orig_sources= new_sources= 2024-03-09T14:40:33.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.381+0000 7f4c1e024800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): potential sources added=[] removed=[] 2024-03-09T14:40:33.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.381+0000 7f4c1e024800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): orig_dests= new_dests= 2024-03-09T14:40:33.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.381+0000 7f4c1e024800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): potential dests added=[] removed=[] 2024-03-09T14:40:33.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.383+0000 7f4c1e024800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-03-09T14:40:33.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.384+0000 7f4c1e024800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-03-09T14:40:33.387 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.386+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-03-09T14:40:33.387 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.386+0000 7f4c1e024800 20 processing logshard = reshard.0000000007 2024-03-09T14:40:33.389 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.388+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-03-09T14:40:33.389 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.388+0000 7f4c1e024800 20 processing logshard = reshard.0000000008 2024-03-09T14:40:33.391 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.391+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-03-09T14:40:33.391 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.391+0000 7f4c1e024800 20 processing logshard = reshard.0000000009 2024-03-09T14:40:33.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.393+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-03-09T14:40:33.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.393+0000 7f4c1e024800 20 processing logshard = reshard.0000000010 2024-03-09T14:40:33.396 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.395+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-03-09T14:40:33.396 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.395+0000 7f4c1e024800 20 processing logshard = reshard.0000000011 2024-03-09T14:40:33.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.398+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-03-09T14:40:33.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.398+0000 7f4c1e024800 20 processing logshard = reshard.0000000012 2024-03-09T14:40:33.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.400+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-03-09T14:40:33.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.400+0000 7f4c1e024800 20 processing logshard = reshard.0000000013 2024-03-09T14:40:33.403 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.403+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-03-09T14:40:33.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.403+0000 7f4c1e024800 20 processing logshard = reshard.0000000014 2024-03-09T14:40:33.405 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.405+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-03-09T14:40:33.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.405+0000 7f4c1e024800 20 processing logshard = reshard.0000000015 2024-03-09T14:40:33.408 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.408+0000 7f4c1e024800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-03-09T14:40:33.409 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.408+0000 7f4ad1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:33.411 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.411+0000 7f4c1e024800 20 remove_watcher() i=0 2024-03-09T14:40:33.411 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.411+0000 7f4c1e024800 2 removed watcher, disabling cache 2024-03-09T14:40:33.412 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.412+0000 7f4c1e024800 20 remove_watcher() i=1 2024-03-09T14:40:33.413 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.413+0000 7f4c1e024800 20 remove_watcher() i=2 2024-03-09T14:40:33.414 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.414+0000 7f4c1e024800 20 remove_watcher() i=3 2024-03-09T14:40:33.415 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.415+0000 7f4c1e024800 20 remove_watcher() i=4 2024-03-09T14:40:33.416 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.416+0000 7f4c1e024800 20 remove_watcher() i=5 2024-03-09T14:40:33.417 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.417+0000 7f4c1e024800 20 remove_watcher() i=6 2024-03-09T14:40:33.418 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.418+0000 7f4c1e024800 20 remove_watcher() i=7 2024-03-09T14:40:33.430 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-09T14:40:33.456 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:33.456 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:33.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.489+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.490+0000 7efcc3e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:33.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.490+0000 7efcc3e11800 20 realm 2024-03-09T14:40:33.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.490+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.491+0000 7efcc3e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:33.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.491+0000 7efcc3e11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:33.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.491+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.491+0000 7efcc3e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:33.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.491+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.492+0000 7efcc3e11800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:33.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.492+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.492+0000 7efcc3e11800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:33.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.492+0000 7efcc3e11800 20 searching for the correct realm 2024-03-09T14:40:33.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.494+0000 7efcc210e640 0 -- 172.21.15.88:0/1999462614 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7efcbc00e040 msgr2=0x7efcbc056b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:33.700 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.700+0000 7efcc110c640 0 -- 172.21.15.88:0/1999462614 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7efcbc0570c0 msgr2=0x7efcbc0816e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:33.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.905+0000 7efcc3e11800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:33.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.905+0000 7efcc3e11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:33.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.905+0000 7efcc3e11800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:33.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.905+0000 7efcc3e11800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:33.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.905+0000 7efcc3e11800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:33.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.905+0000 7efcc3e11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:33.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.905+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.906+0000 7efcc3e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:33.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.906+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.906+0000 7efcc3e11800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:33.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.906+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.907+0000 7efcc3e11800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:33.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.907+0000 7efcc3e11800 20 zone default found 2024-03-09T14:40:33.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.907+0000 7efcc3e11800 4 Realm: () 2024-03-09T14:40:33.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.907+0000 7efcc3e11800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:33.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.907+0000 7efcc3e11800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:33.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.907+0000 7efcc3e11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:33.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.907+0000 7efcc3e11800 20 zonegroup default 2024-03-09T14:40:33.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.907+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.907+0000 7efcc3e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:33.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.907+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.907+0000 7efcc3e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:33.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.907+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.908+0000 7efcc3e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:33.910 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.908+0000 7efcc3e11800 20 started sync module instance, tier type = 2024-03-09T14:40:33.910 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.908+0000 7efcc3e11800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:33.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.917+0000 7efcc3e11800 20 add_watcher() i=0 2024-03-09T14:40:33.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.917+0000 7efcc3e11800 20 add_watcher() i=1 2024-03-09T14:40:33.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.917+0000 7efcc3e11800 20 add_watcher() i=2 2024-03-09T14:40:33.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.917+0000 7efcc3e11800 20 add_watcher() i=3 2024-03-09T14:40:33.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.917+0000 7efcc3e11800 20 add_watcher() i=4 2024-03-09T14:40:33.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.917+0000 7efcc3e11800 20 add_watcher() i=5 2024-03-09T14:40:33.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.917+0000 7efcc3e11800 20 add_watcher() i=6 2024-03-09T14:40:33.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.918+0000 7efcc3e11800 20 add_watcher() i=7 2024-03-09T14:40:33.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.918+0000 7efcc3e11800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:33.921 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.920+0000 7efb737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:33.921 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.920+0000 7efcc3e11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:33.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.920+0000 7efcc3e11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:33.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.920+0000 7efcc3e11800 5 note: GC not initialized 2024-03-09T14:40:33.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.921+0000 7efb727fc640 20 reqs_thread_entry: start 2024-03-09T14:40:33.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.921+0000 7efcc3e11800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:33.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.921+0000 7efcc3e11800 20 Filter name: none 2024-03-09T14:40:33.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.921+0000 7efae3fff640 20 reqs_thread_entry: start 2024-03-09T14:40:33.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.921+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.921+0000 7efcc3e11800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:40:33.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.921+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.922+0000 7efcc3e11800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:40:33.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.922+0000 7efcc3e11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:33.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.922+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.923+0000 7efcc3e11800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:40:33.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.923+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.923+0000 7efcc3e11800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:40:33.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.923+0000 7efcc3e11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:33.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.924+0000 7efcc3e11800 20 rados->read ofs=0 len=0 2024-03-09T14:40:33.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.925+0000 7efcc3e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:33.926 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.925+0000 7efb737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:33.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.928+0000 7efcc3e11800 20 remove_watcher() i=0 2024-03-09T14:40:33.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.928+0000 7efcc3e11800 2 removed watcher, disabling cache 2024-03-09T14:40:33.929 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.929+0000 7efcc3e11800 20 remove_watcher() i=1 2024-03-09T14:40:33.930 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.930+0000 7efcc3e11800 20 remove_watcher() i=2 2024-03-09T14:40:33.932 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.931+0000 7efcc3e11800 20 remove_watcher() i=3 2024-03-09T14:40:33.933 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.932+0000 7efcc3e11800 20 remove_watcher() i=4 2024-03-09T14:40:33.934 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.933+0000 7efcc3e11800 20 remove_watcher() i=5 2024-03-09T14:40:33.935 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.934+0000 7efcc3e11800 20 remove_watcher() i=6 2024-03-09T14:40:33.936 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:33.935+0000 7efcc3e11800 20 remove_watcher() i=7 2024-03-09T14:40:33.947 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:33.947 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:40:33.947 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: a-bucket id: 5d93e872-363b-498b-b665-658644296b85.4535.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-03-09T14:40:33.947 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:33.947 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-03-09T14:40:33.947 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:34.704 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-09T14:40:34.731 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:34.731 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:34.765 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.764+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:34.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.765+0000 7f24595af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:34.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.765+0000 7f24595af800 20 realm 2024-03-09T14:40:34.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.765+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:34.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.765+0000 7f24595af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:34.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.765+0000 7f24595af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:34.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.766+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:34.767 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.766+0000 7f24595af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:34.767 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.766+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:34.767 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.767+0000 7f24595af800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:34.767 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.767+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:34.768 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.767+0000 7f24595af800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:34.768 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.767+0000 7f24595af800 20 searching for the correct realm 2024-03-09T14:40:34.768 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.768+0000 7f24570ab640 0 -- 172.21.15.88:0/3334025522 >> [v2:172.21.15.88:6800/4216886240,v1:172.21.15.88:6802/4216886240] conn(0x55bd5426cdf0 msgr2=0x55bd5426f2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:34.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.772+0000 7f24570ab640 0 -- 172.21.15.88:0/3334025522 >> [v2:172.21.15.132:6824/731564406,v1:172.21.15.132:6825/731564406] conn(0x55bd5401a8d0 msgr2=0x7f2450004340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:34.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.981+0000 7f24595af800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:34.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.981+0000 7f24595af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:34.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.981+0000 7f24595af800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:34.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.981+0000 7f24595af800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:34.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.981+0000 7f24595af800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:34.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.981+0000 7f24595af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:34.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.981+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:34.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.981+0000 7f24595af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:34.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.981+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:34.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.982+0000 7f24595af800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:34.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.982+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:34.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.982+0000 7f24595af800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:34.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.982+0000 7f24595af800 20 zone default found 2024-03-09T14:40:34.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.982+0000 7f24595af800 4 Realm: () 2024-03-09T14:40:34.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.982+0000 7f24595af800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:34.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.982+0000 7f24595af800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:34.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.982+0000 7f24595af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:34.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.982+0000 7f24595af800 20 zonegroup default 2024-03-09T14:40:34.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.982+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:34.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.982+0000 7f24595af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:34.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.982+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:34.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.983+0000 7f24595af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:34.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.983+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:34.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.983+0000 7f24595af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:34.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.983+0000 7f24595af800 20 started sync module instance, tier type = 2024-03-09T14:40:34.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.983+0000 7f24595af800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:34.993 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.992+0000 7f24595af800 20 add_watcher() i=0 2024-03-09T14:40:34.993 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.992+0000 7f24595af800 20 add_watcher() i=1 2024-03-09T14:40:34.993 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.992+0000 7f24595af800 20 add_watcher() i=2 2024-03-09T14:40:34.993 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.992+0000 7f24595af800 20 add_watcher() i=3 2024-03-09T14:40:34.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.992+0000 7f24595af800 20 add_watcher() i=4 2024-03-09T14:40:34.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.992+0000 7f24595af800 20 add_watcher() i=5 2024-03-09T14:40:34.994 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.992+0000 7f24595af800 20 add_watcher() i=6 2024-03-09T14:40:34.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.993+0000 7f24595af800 20 add_watcher() i=7 2024-03-09T14:40:34.995 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.993+0000 7f24595af800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:34.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.995+0000 7f230dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:34.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.995+0000 7f24595af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:34.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.995+0000 7f24595af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:34.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.995+0000 7f24595af800 5 note: GC not initialized 2024-03-09T14:40:34.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.995+0000 7f230cfe1640 20 reqs_thread_entry: start 2024-03-09T14:40:34.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.995+0000 7f24595af800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:34.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.995+0000 7f24595af800 20 Filter name: none 2024-03-09T14:40:34.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.995+0000 7f22867fc640 20 reqs_thread_entry: start 2024-03-09T14:40:34.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.995+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:34.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.996+0000 7f24595af800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:34.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.996+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:34.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.996+0000 7f24595af800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:34.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.996+0000 7f24595af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:34.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.996+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:34.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.997+0000 7f24595af800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:34.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.997+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:34.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.997+0000 7f24595af800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:35.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.997+0000 7f24595af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:35.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.998+0000 7f24595af800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.998+0000 7f24595af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:34.999+0000 7f230dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:35.002 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.001+0000 7f24595af800 20 remove_watcher() i=0 2024-03-09T14:40:35.002 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.001+0000 7f24595af800 2 removed watcher, disabling cache 2024-03-09T14:40:35.003 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.002+0000 7f24595af800 20 remove_watcher() i=1 2024-03-09T14:40:35.004 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.003+0000 7f24595af800 20 remove_watcher() i=2 2024-03-09T14:40:35.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.004+0000 7f24595af800 20 remove_watcher() i=3 2024-03-09T14:40:35.006 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.005+0000 7f24595af800 20 remove_watcher() i=4 2024-03-09T14:40:35.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.006+0000 7f24595af800 20 remove_watcher() i=5 2024-03-09T14:40:35.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.007+0000 7f24595af800 20 remove_watcher() i=6 2024-03-09T14:40:35.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.008+0000 7f24595af800 20 remove_watcher() i=7 2024-03-09T14:40:35.018 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:35.018 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:40:35.018 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-set-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:40:35.018 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:35.020 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-03-09T14:40:35.052 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:35.053 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:35.087 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.086+0000 7f1339414800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.087+0000 7f1339414800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.087+0000 7f1339414800 20 realm 2024-03-09T14:40:35.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.087+0000 7f1339414800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.087+0000 7f1339414800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.087+0000 7f1339414800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:35.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.087+0000 7f1339414800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.087+0000 7f1339414800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.087+0000 7f1339414800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.089 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.088+0000 7f1339414800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:35.089 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.088+0000 7f1339414800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.089 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.089+0000 7f1339414800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:35.090 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.089+0000 7f1339414800 20 searching for the correct realm 2024-03-09T14:40:35.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.091+0000 7f1335282640 0 -- 172.21.15.88:0/3176099910 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f133003ac10 msgr2=0x7f1330045420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:35.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.297+0000 7f132c280640 0 -- 172.21.15.88:0/3176099910 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f133002f970 msgr2=0x7f1330043460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:35.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.503+0000 7f1339414800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:35.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.503+0000 7f1339414800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:35.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.503+0000 7f1339414800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:35.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.503+0000 7f1339414800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:35.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.503+0000 7f1339414800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:35.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.503+0000 7f1339414800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:35.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.503+0000 7f1339414800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.503+0000 7f1339414800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.503+0000 7f1339414800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.504+0000 7f1339414800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:35.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.504+0000 7f1339414800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.504+0000 7f1339414800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:35.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.504+0000 7f1339414800 20 zone default found 2024-03-09T14:40:35.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.504+0000 7f1339414800 4 Realm: () 2024-03-09T14:40:35.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.504+0000 7f1339414800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:35.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.504+0000 7f1339414800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:35.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.504+0000 7f1339414800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:35.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.504+0000 7f1339414800 20 zonegroup default 2024-03-09T14:40:35.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.504+0000 7f1339414800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.504+0000 7f1339414800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.504+0000 7f1339414800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.505+0000 7f1339414800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.505+0000 7f1339414800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.505+0000 7f1339414800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.505+0000 7f1339414800 20 started sync module instance, tier type = 2024-03-09T14:40:35.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.505+0000 7f1339414800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:35.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.514+0000 7f1339414800 20 add_watcher() i=0 2024-03-09T14:40:35.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.514+0000 7f1339414800 20 add_watcher() i=1 2024-03-09T14:40:35.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.514+0000 7f1339414800 20 add_watcher() i=2 2024-03-09T14:40:35.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.514+0000 7f1339414800 20 add_watcher() i=3 2024-03-09T14:40:35.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.514+0000 7f1339414800 20 add_watcher() i=4 2024-03-09T14:40:35.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.514+0000 7f1339414800 20 add_watcher() i=5 2024-03-09T14:40:35.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.514+0000 7f1339414800 20 add_watcher() i=6 2024-03-09T14:40:35.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.515+0000 7f1339414800 20 add_watcher() i=7 2024-03-09T14:40:35.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.515+0000 7f1339414800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:35.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.517+0000 7f11eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:35.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.517+0000 7f1339414800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:35.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.517+0000 7f1339414800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:35.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.518+0000 7f1339414800 5 note: GC not initialized 2024-03-09T14:40:35.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.518+0000 7f11ea7e4640 20 reqs_thread_entry: start 2024-03-09T14:40:35.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.518+0000 7f1339414800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:35.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.518+0000 7f1339414800 20 Filter name: none 2024-03-09T14:40:35.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.518+0000 7f11e37fe640 20 reqs_thread_entry: start 2024-03-09T14:40:35.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.518+0000 7f1339414800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-03-09T14:40:35.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.518+0000 7f1339414800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.518+0000 7f1339414800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:35.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.518+0000 7f1339414800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-03-09T14:40:35.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.518+0000 7f1339414800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-03-09T14:40:35.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.518+0000 7f1339414800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 : miss 2024-03-09T14:40:35.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.518+0000 7f1339414800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.519+0000 7f1339414800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:35.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.519+0000 7f1339414800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 info.flags=0x17 2024-03-09T14:40:35.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.519+0000 7f1339414800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 to cache LRU end 2024-03-09T14:40:35.521 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.519+0000 7f1339414800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:35.521 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.519+0000 7f1339414800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:35.521 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.519+0000 7f1339414800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 2024-03-09T14:40:35.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.523+0000 7f1339414800 -1 Injecting error=-5 at location=set_target_layout 2024-03-09T14:40:35.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.523+0000 7f1339414800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-03-09T14:40:35.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.528+0000 7f11eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:35.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.530+0000 7f1339414800 20 remove_watcher() i=0 2024-03-09T14:40:35.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.530+0000 7f1339414800 2 removed watcher, disabling cache 2024-03-09T14:40:35.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.531+0000 7f1339414800 20 remove_watcher() i=1 2024-03-09T14:40:35.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.532+0000 7f1339414800 20 remove_watcher() i=2 2024-03-09T14:40:35.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.534+0000 7f1339414800 20 remove_watcher() i=3 2024-03-09T14:40:35.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.535+0000 7f1339414800 20 remove_watcher() i=4 2024-03-09T14:40:35.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.536+0000 7f1339414800 20 remove_watcher() i=5 2024-03-09T14:40:35.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.536+0000 7f1339414800 20 remove_watcher() i=6 2024-03-09T14:40:35.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.537+0000 7f1339414800 20 remove_watcher() i=7 2024-03-09T14:40:35.549 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-09T14:40:35.576 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:35.576 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:35.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.609+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.611+0000 7f8e54111800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.611+0000 7f8e54111800 20 realm 2024-03-09T14:40:35.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.611+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.612+0000 7f8e54111800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.612+0000 7f8e54111800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:35.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.612+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.612+0000 7f8e54111800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.612+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.613+0000 7f8e54111800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:35.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.613+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.613+0000 7f8e54111800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:35.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.613+0000 7f8e54111800 20 searching for the correct realm 2024-03-09T14:40:35.615 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.614+0000 7f8e4bfff640 0 -- 172.21.15.88:0/2231658589 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f8e440bc040 msgr2=0x7f8e44096f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:35.820 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.819+0000 7f8e5240e640 0 -- 172.21.15.88:0/2231658589 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x559706c1c370 msgr2=0x559706c1e760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:35.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.826+0000 7f8e54111800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:35.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.826+0000 7f8e54111800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:35.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.826+0000 7f8e54111800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:35.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.826+0000 7f8e54111800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:35.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.826+0000 7f8e54111800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:35.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.826+0000 7f8e54111800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:35.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.826+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.826+0000 7f8e54111800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.826+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.826+0000 7f8e54111800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:35.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.826+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.827+0000 7f8e54111800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:35.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.827+0000 7f8e54111800 20 zone default found 2024-03-09T14:40:35.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.827+0000 7f8e54111800 4 Realm: () 2024-03-09T14:40:35.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.827+0000 7f8e54111800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:35.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.827+0000 7f8e54111800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:35.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.827+0000 7f8e54111800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:35.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.827+0000 7f8e54111800 20 zonegroup default 2024-03-09T14:40:35.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.827+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.827+0000 7f8e54111800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.827+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.827+0000 7f8e54111800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.827+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.827+0000 7f8e54111800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.827+0000 7f8e54111800 20 started sync module instance, tier type = 2024-03-09T14:40:35.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.827+0000 7f8e54111800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:35.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.837+0000 7f8e54111800 20 add_watcher() i=0 2024-03-09T14:40:35.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.837+0000 7f8e54111800 20 add_watcher() i=1 2024-03-09T14:40:35.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.837+0000 7f8e54111800 20 add_watcher() i=2 2024-03-09T14:40:35.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.837+0000 7f8e54111800 20 add_watcher() i=3 2024-03-09T14:40:35.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.837+0000 7f8e54111800 20 add_watcher() i=4 2024-03-09T14:40:35.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.837+0000 7f8e54111800 20 add_watcher() i=5 2024-03-09T14:40:35.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.837+0000 7f8e54111800 20 add_watcher() i=6 2024-03-09T14:40:35.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.838+0000 7f8e54111800 20 add_watcher() i=7 2024-03-09T14:40:35.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.838+0000 7f8e54111800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:35.840 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.840+0000 7f8cff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:35.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.840+0000 7f8e54111800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:35.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.840+0000 7f8e54111800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:35.842 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.840+0000 7f8e54111800 5 note: GC not initialized 2024-03-09T14:40:35.842 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.841+0000 7f8cfe7fc640 20 reqs_thread_entry: start 2024-03-09T14:40:35.842 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.841+0000 7f8e54111800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:35.842 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.841+0000 7f8e54111800 20 Filter name: none 2024-03-09T14:40:35.842 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.841+0000 7f8c6ffff640 20 reqs_thread_entry: start 2024-03-09T14:40:35.842 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.841+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.843 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.841+0000 7f8e54111800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:35.843 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.841+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.843 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.842+0000 7f8e54111800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:35.843 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.842+0000 7f8e54111800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:35.843 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.842+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.842+0000 7f8e54111800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:35.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.842+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.842+0000 7f8e54111800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:35.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.842+0000 7f8e54111800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:35.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.843+0000 7f8e54111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:35.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.843+0000 7f8e54111800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:35.845 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.844+0000 7f8cff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:35.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.846+0000 7f8e54111800 20 remove_watcher() i=0 2024-03-09T14:40:35.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.846+0000 7f8e54111800 2 removed watcher, disabling cache 2024-03-09T14:40:35.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.847+0000 7f8e54111800 20 remove_watcher() i=1 2024-03-09T14:40:35.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.849+0000 7f8e54111800 20 remove_watcher() i=2 2024-03-09T14:40:35.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.850+0000 7f8e54111800 20 remove_watcher() i=3 2024-03-09T14:40:35.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.851+0000 7f8e54111800 20 remove_watcher() i=4 2024-03-09T14:40:35.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.852+0000 7f8e54111800 20 remove_watcher() i=5 2024-03-09T14:40:35.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.853+0000 7f8e54111800 20 remove_watcher() i=6 2024-03-09T14:40:35.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:35.854+0000 7f8e54111800 20 remove_watcher() i=7 2024-03-09T14:40:35.864 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:35.864 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:40:35.864 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-set-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:40:35.864 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:35.952 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:40:35.981 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:35.981 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:36.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.014+0000 7f6a9492f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.016+0000 7f6a9492f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:36.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.016+0000 7f6a9492f800 20 realm 2024-03-09T14:40:36.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.016+0000 7f6a9492f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.016+0000 7f6a9492f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:36.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.016+0000 7f6a9492f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:36.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.016+0000 7f6a9492f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.016+0000 7f6a9492f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:36.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.016+0000 7f6a9492f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.017+0000 7f6a9492f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:36.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.017+0000 7f6a9492f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.017+0000 7f6a9492f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:36.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.017+0000 7f6a9492f800 20 searching for the correct realm 2024-03-09T14:40:36.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.018+0000 7f6a905b0640 0 -- 172.21.15.88:0/1521856276 >> [v2:172.21.15.88:6800/4216886240,v1:172.21.15.88:6802/4216886240] conn(0x55d5c0b11c50 msgr2=0x55d5c0b14110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:36.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.022+0000 7f6a905b0640 0 -- 172.21.15.88:0/1521856276 >> [v2:172.21.15.132:6824/731564406,v1:172.21.15.132:6825/731564406] conn(0x55d5c08c2c10 msgr2=0x7f6a8803b950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:36.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.231+0000 7f6a9492f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:36.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.231+0000 7f6a9492f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:36.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.231+0000 7f6a9492f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:36.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.231+0000 7f6a9492f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:36.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.231+0000 7f6a9492f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:36.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.231+0000 7f6a9492f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:36.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.231+0000 7f6a9492f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.231+0000 7f6a9492f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:36.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.231+0000 7f6a9492f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.232+0000 7f6a9492f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:36.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.232+0000 7f6a9492f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.232+0000 7f6a9492f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:36.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.232+0000 7f6a9492f800 20 zone default found 2024-03-09T14:40:36.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.232+0000 7f6a9492f800 4 Realm: () 2024-03-09T14:40:36.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.232+0000 7f6a9492f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:36.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.232+0000 7f6a9492f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:36.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.232+0000 7f6a9492f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:36.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.232+0000 7f6a9492f800 20 zonegroup default 2024-03-09T14:40:36.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.232+0000 7f6a9492f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.232+0000 7f6a9492f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:36.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.232+0000 7f6a9492f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.233+0000 7f6a9492f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:36.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.233+0000 7f6a9492f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.233+0000 7f6a9492f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:36.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.233+0000 7f6a9492f800 20 started sync module instance, tier type = 2024-03-09T14:40:36.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.233+0000 7f6a9492f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:36.243 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.243+0000 7f6a9492f800 20 add_watcher() i=0 2024-03-09T14:40:36.244 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.243+0000 7f6a9492f800 20 add_watcher() i=1 2024-03-09T14:40:36.244 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.243+0000 7f6a9492f800 20 add_watcher() i=2 2024-03-09T14:40:36.244 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.243+0000 7f6a9492f800 20 add_watcher() i=3 2024-03-09T14:40:36.244 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.243+0000 7f6a9492f800 20 add_watcher() i=4 2024-03-09T14:40:36.244 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.243+0000 7f6a9492f800 20 add_watcher() i=5 2024-03-09T14:40:36.244 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.243+0000 7f6a9492f800 20 add_watcher() i=6 2024-03-09T14:40:36.244 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.244+0000 7f6a9492f800 20 add_watcher() i=7 2024-03-09T14:40:36.244 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.244+0000 7f6a9492f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:36.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.245+0000 7f6946fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:36.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.246+0000 7f6a9492f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:36.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.246+0000 7f6a9492f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:36.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.246+0000 7f6a9492f800 5 note: GC not initialized 2024-03-09T14:40:36.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.246+0000 7f6945fdb640 20 reqs_thread_entry: start 2024-03-09T14:40:36.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.246+0000 7f6a9492f800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:36.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.246+0000 7f6a9492f800 20 Filter name: none 2024-03-09T14:40:36.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.246+0000 7f68b77fe640 20 reqs_thread_entry: start 2024-03-09T14:40:36.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.246+0000 7f6a9492f800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-03-09T14:40:36.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.246+0000 7f6a9492f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.246+0000 7f6a9492f800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:36.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.246+0000 7f6a9492f800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-03-09T14:40:36.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.247+0000 7f6a9492f800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-03-09T14:40:36.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.247+0000 7f6a9492f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 : miss 2024-03-09T14:40:36.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.247+0000 7f6a9492f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.247+0000 7f6a9492f800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:36.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.247+0000 7f6a9492f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 info.flags=0x17 2024-03-09T14:40:36.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.247+0000 7f6a9492f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 to cache LRU end 2024-03-09T14:40:36.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.247+0000 7f6a9492f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:36.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.247+0000 7f6a9492f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:36.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.247+0000 7f6a9492f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 2024-03-09T14:40:36.252 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.252+0000 7f6a9492f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 info.flags=0x17 2024-03-09T14:40:36.252 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.252+0000 7f6a9492f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 to cache LRU end 2024-03-09T14:40:36.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.252+0000 7f6a9492f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:36.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.252+0000 7f6a9492f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19, ofs0, ns] 2024-03-09T14:40:36.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.252+0000 7f69677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 94376549253856 notifier 5933 bl.length()=917 2024-03-09T14:40:36.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.252+0000 7f69677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 info.flags=0x17 2024-03-09T14:40:36.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.252+0000 7f69677fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 to cache LRU end 2024-03-09T14:40:36.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.252+0000 7f69677fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:36.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.254+0000 7f6a9492f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.19]): orig_sources= new_sources= 2024-03-09T14:40:36.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.254+0000 7f6a9492f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.19]): potential sources added=[] removed=[] 2024-03-09T14:40:36.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.254+0000 7f6a9492f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.19]): orig_dests= new_dests= 2024-03-09T14:40:36.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.254+0000 7f6a9492f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.19]): potential dests added=[] removed=[] 2024-03-09T14:40:36.257 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.0 2024-03-09T14:40:36.257 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.0 2024-03-09T14:40:36.257 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.1 2024-03-09T14:40:36.257 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.1 2024-03-09T14:40:36.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.2 2024-03-09T14:40:36.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.2 2024-03-09T14:40:36.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.3 2024-03-09T14:40:36.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.3 2024-03-09T14:40:36.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.4 2024-03-09T14:40:36.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.4 2024-03-09T14:40:36.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.5 2024-03-09T14:40:36.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.5 2024-03-09T14:40:36.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.6 2024-03-09T14:40:36.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.6 2024-03-09T14:40:36.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.7 2024-03-09T14:40:36.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.7 2024-03-09T14:40:36.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.8 2024-03-09T14:40:36.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.8 2024-03-09T14:40:36.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.9 2024-03-09T14:40:36.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.9 2024-03-09T14:40:36.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.10 2024-03-09T14:40:36.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.10 2024-03-09T14:40:36.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.11 2024-03-09T14:40:36.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1.11 2024-03-09T14:40:36.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.256+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.0 2024-03-09T14:40:36.259 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.257+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.1 2024-03-09T14:40:36.260 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.257+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.2 2024-03-09T14:40:36.260 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.258+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.3 2024-03-09T14:40:36.260 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.258+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.4 2024-03-09T14:40:36.260 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.259+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.5 2024-03-09T14:40:36.260 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.259+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.6 2024-03-09T14:40:36.260 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.260+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.7 2024-03-09T14:40:36.261 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.260+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.8 2024-03-09T14:40:36.262 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.261+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.9 2024-03-09T14:40:36.262 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.261+0000 7f6a9492f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.19.10 2024-03-09T14:40:36.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.264+0000 7f6a9492f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 : hit (requested=0x17, cached=0x17) 2024-03-09T14:40:36.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.264+0000 7f6a9492f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 2024-03-09T14:40:36.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.266+0000 7f6a9492f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 info.flags=0x17 2024-03-09T14:40:36.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.266+0000 7f6a9492f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 to cache LRU end 2024-03-09T14:40:36.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.266+0000 7f6a9492f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:36.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.266+0000 7f6a9492f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19, ofs0, ns] 2024-03-09T14:40:36.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.266+0000 7f6966ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464278 cookie 94376549253856 notifier 5933 bl.length()=885 2024-03-09T14:40:36.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.266+0000 7f6966ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 info.flags=0x17 2024-03-09T14:40:36.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.266+0000 7f6966ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.19 to cache LRU end 2024-03-09T14:40:36.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.266+0000 7f6966ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:36.268 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.267+0000 7f6a9492f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.19]): orig_sources= new_sources= 2024-03-09T14:40:36.268 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.267+0000 7f6a9492f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.19]): potential sources added=[] removed=[] 2024-03-09T14:40:36.268 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.267+0000 7f6a9492f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.19]): orig_dests= new_dests= 2024-03-09T14:40:36.268 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.267+0000 7f6a9492f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.19]): potential dests added=[] removed=[] 2024-03-09T14:40:36.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.269+0000 7f6a9492f800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-03-09T14:40:36.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.271+0000 7f6946fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:36.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.273+0000 7f6a9492f800 20 remove_watcher() i=0 2024-03-09T14:40:36.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.273+0000 7f6a9492f800 2 removed watcher, disabling cache 2024-03-09T14:40:36.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.274+0000 7f6a9492f800 20 remove_watcher() i=1 2024-03-09T14:40:36.276 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.275+0000 7f6a9492f800 20 remove_watcher() i=2 2024-03-09T14:40:36.277 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.277+0000 7f6a9492f800 20 remove_watcher() i=3 2024-03-09T14:40:36.278 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.278+0000 7f6a9492f800 20 remove_watcher() i=4 2024-03-09T14:40:36.279 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.278+0000 7f6a9492f800 20 remove_watcher() i=5 2024-03-09T14:40:36.280 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.279+0000 7f6a9492f800 20 remove_watcher() i=6 2024-03-09T14:40:36.281 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.280+0000 7f6a9492f800 20 remove_watcher() i=7 2024-03-09T14:40:36.292 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-09T14:40:36.319 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:36.319 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:36.352 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.352+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.353+0000 7fe035e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:36.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.353+0000 7fe035e3a800 20 realm 2024-03-09T14:40:36.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.353+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.354+0000 7fe035e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:36.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.354+0000 7fe035e3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:36.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.354+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.354+0000 7fe035e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:36.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.354+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.355+0000 7fe035e3a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:36.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.355+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.355+0000 7fe035e3a800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:36.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.355+0000 7fe035e3a800 20 searching for the correct realm 2024-03-09T14:40:36.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.356+0000 7fe0310e4640 0 -- 172.21.15.88:0/1230904228 >> [v2:172.21.15.88:6800/4216886240,v1:172.21.15.88:6802/4216886240] conn(0x55aeb4688820 msgr2=0x55aeb468ace0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:36.360 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.359+0000 7fe0310e4640 0 -- 172.21.15.88:0/1230904228 >> [v2:172.21.15.132:6824/731564406,v1:172.21.15.132:6825/731564406] conn(0x55aeb44145d0 msgr2=0x7fe02c07ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:36.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.568+0000 7fe035e3a800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:36.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.568+0000 7fe035e3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:36.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.568+0000 7fe035e3a800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:36.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.568+0000 7fe035e3a800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:36.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.568+0000 7fe035e3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:36.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.568+0000 7fe035e3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:36.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.568+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.569+0000 7fe035e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:36.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.569+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.569+0000 7fe035e3a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:36.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.569+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.569+0000 7fe035e3a800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:36.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.569+0000 7fe035e3a800 20 zone default found 2024-03-09T14:40:36.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.569+0000 7fe035e3a800 4 Realm: () 2024-03-09T14:40:36.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.569+0000 7fe035e3a800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:36.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.569+0000 7fe035e3a800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:36.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.569+0000 7fe035e3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:36.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.569+0000 7fe035e3a800 20 zonegroup default 2024-03-09T14:40:36.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.569+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.570+0000 7fe035e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:36.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.570+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.570+0000 7fe035e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:36.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.570+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.570+0000 7fe035e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:36.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.570+0000 7fe035e3a800 20 started sync module instance, tier type = 2024-03-09T14:40:36.573 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.570+0000 7fe035e3a800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:36.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.580+0000 7fe035e3a800 20 add_watcher() i=0 2024-03-09T14:40:36.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.580+0000 7fe035e3a800 20 add_watcher() i=1 2024-03-09T14:40:36.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.580+0000 7fe035e3a800 20 add_watcher() i=2 2024-03-09T14:40:36.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.580+0000 7fe035e3a800 20 add_watcher() i=3 2024-03-09T14:40:36.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.580+0000 7fe035e3a800 20 add_watcher() i=4 2024-03-09T14:40:36.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.580+0000 7fe035e3a800 20 add_watcher() i=5 2024-03-09T14:40:36.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.580+0000 7fe035e3a800 20 add_watcher() i=6 2024-03-09T14:40:36.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.581+0000 7fe035e3a800 20 add_watcher() i=7 2024-03-09T14:40:36.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.581+0000 7fe035e3a800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:36.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.583+0000 7fdee77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:36.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.583+0000 7fe035e3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:36.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.583+0000 7fe035e3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:36.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.583+0000 7fe035e3a800 5 note: GC not initialized 2024-03-09T14:40:36.585 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.583+0000 7fdee67e4640 20 reqs_thread_entry: start 2024-03-09T14:40:36.585 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.584+0000 7fe035e3a800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:36.585 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.584+0000 7fe035e3a800 20 Filter name: none 2024-03-09T14:40:36.585 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.584+0000 7fde57fff640 20 reqs_thread_entry: start 2024-03-09T14:40:36.585 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.584+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.584+0000 7fe035e3a800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:36.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.584+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.585+0000 7fe035e3a800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:36.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.585+0000 7fe035e3a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:36.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.585+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.585+0000 7fe035e3a800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:36.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.585+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.586+0000 7fe035e3a800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:36.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.586+0000 7fe035e3a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:36.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.587+0000 7fe035e3a800 20 rados->read ofs=0 len=0 2024-03-09T14:40:36.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.587+0000 7fe035e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:36.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.588+0000 7fdee77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:36.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.590+0000 7fe035e3a800 20 remove_watcher() i=0 2024-03-09T14:40:36.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.590+0000 7fe035e3a800 2 removed watcher, disabling cache 2024-03-09T14:40:36.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.591+0000 7fe035e3a800 20 remove_watcher() i=1 2024-03-09T14:40:36.593 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.592+0000 7fe035e3a800 20 remove_watcher() i=2 2024-03-09T14:40:36.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.594+0000 7fe035e3a800 20 remove_watcher() i=3 2024-03-09T14:40:36.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.595+0000 7fe035e3a800 20 remove_watcher() i=4 2024-03-09T14:40:36.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.596+0000 7fe035e3a800 20 remove_watcher() i=5 2024-03-09T14:40:36.597 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.596+0000 7fe035e3a800 20 remove_watcher() i=6 2024-03-09T14:40:36.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:36.597+0000 7fe035e3a800 20 remove_watcher() i=7 2024-03-09T14:40:36.608 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:36.608 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:40:36.608 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-set-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:40:36.608 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:36.946 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-03-09T14:40:36.946 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:37.684 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-09T14:40:37.711 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:37.712 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:37.745 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.744+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.746+0000 7f300a92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:37.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.746+0000 7f300a92d800 20 realm 2024-03-09T14:40:37.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.746+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.746+0000 7f300a92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:37.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.746+0000 7f300a92d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:37.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.746+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.746+0000 7f300a92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:37.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.746+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.747+0000 7f300a92d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:37.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.747+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.748+0000 7f300a92d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:37.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.748+0000 7f300a92d800 20 searching for the correct realm 2024-03-09T14:40:37.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.749+0000 7f2ffffff640 0 -- 172.21.15.88:0/3982290011 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f2ff8075020 msgr2=0x7f2ff8059100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:37.955 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.955+0000 7f3006e65640 0 -- 172.21.15.88:0/3982290011 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x55f1fee9eca0 msgr2=0x55f1feea1090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:37.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.961+0000 7f300a92d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:37.962 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.961+0000 7f300a92d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:37.963 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.961+0000 7f300a92d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:37.963 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.961+0000 7f300a92d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:37.963 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.961+0000 7f300a92d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:37.963 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.961+0000 7f300a92d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:37.963 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.961+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.963 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.962+0000 7f300a92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:37.963 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.962+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.962+0000 7f300a92d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:37.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.962+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.962+0000 7f300a92d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:37.964 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.962+0000 7f300a92d800 20 zone default found 2024-03-09T14:40:37.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.962+0000 7f300a92d800 4 Realm: () 2024-03-09T14:40:37.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.962+0000 7f300a92d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:37.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.962+0000 7f300a92d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:37.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.962+0000 7f300a92d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:37.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.962+0000 7f300a92d800 20 zonegroup default 2024-03-09T14:40:37.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.962+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.963+0000 7f300a92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:37.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.963+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.963+0000 7f300a92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:37.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.963+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.963+0000 7f300a92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:37.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.963+0000 7f300a92d800 20 started sync module instance, tier type = 2024-03-09T14:40:37.965 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.963+0000 7f300a92d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:37.973 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.972+0000 7f300a92d800 20 add_watcher() i=0 2024-03-09T14:40:37.973 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.972+0000 7f300a92d800 20 add_watcher() i=1 2024-03-09T14:40:37.973 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.972+0000 7f300a92d800 20 add_watcher() i=2 2024-03-09T14:40:37.973 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.972+0000 7f300a92d800 20 add_watcher() i=3 2024-03-09T14:40:37.973 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.972+0000 7f300a92d800 20 add_watcher() i=4 2024-03-09T14:40:37.973 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.972+0000 7f300a92d800 20 add_watcher() i=5 2024-03-09T14:40:37.973 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.972+0000 7f300a92d800 20 add_watcher() i=6 2024-03-09T14:40:37.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.973+0000 7f300a92d800 20 add_watcher() i=7 2024-03-09T14:40:37.974 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.973+0000 7f300a92d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:37.975 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.975+0000 7f2ebcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:37.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.975+0000 7f300a92d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:37.976 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.975+0000 7f300a92d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:37.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.975+0000 7f300a92d800 5 note: GC not initialized 2024-03-09T14:40:37.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.975+0000 7f2e377fe640 20 reqs_thread_entry: start 2024-03-09T14:40:37.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.975+0000 7f300a92d800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:37.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.975+0000 7f300a92d800 20 Filter name: none 2024-03-09T14:40:37.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.975+0000 7f2e357fa640 20 reqs_thread_entry: start 2024-03-09T14:40:37.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.975+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.976+0000 7f300a92d800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:37.977 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.976+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.977+0000 7f300a92d800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:37.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.977+0000 7f300a92d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:37.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.977+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.977+0000 7f300a92d800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:37.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.977+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.977+0000 7f300a92d800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:37.978 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.977+0000 7f300a92d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:37.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.978+0000 7f300a92d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:37.979 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.978+0000 7f300a92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:37.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.979+0000 7f2ebcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:37.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.981+0000 7f300a92d800 20 remove_watcher() i=0 2024-03-09T14:40:37.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.981+0000 7f300a92d800 2 removed watcher, disabling cache 2024-03-09T14:40:37.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.983+0000 7f300a92d800 20 remove_watcher() i=1 2024-03-09T14:40:37.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.984+0000 7f300a92d800 20 remove_watcher() i=2 2024-03-09T14:40:37.985 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.985+0000 7f300a92d800 20 remove_watcher() i=3 2024-03-09T14:40:37.986 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.986+0000 7f300a92d800 20 remove_watcher() i=4 2024-03-09T14:40:37.987 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.987+0000 7f300a92d800 20 remove_watcher() i=5 2024-03-09T14:40:37.988 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.988+0000 7f300a92d800 20 remove_watcher() i=6 2024-03-09T14:40:37.989 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:37.989+0000 7f300a92d800 20 remove_watcher() i=7 2024-03-09T14:40:37.999 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:37.999 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:40:37.999 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-set-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:40:37.999 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:38.000 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-03-09T14:40:38.034 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:38.035 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:38.068 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.067+0000 7f8e8a52b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.069 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.068+0000 7f8e8a52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:38.069 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.068+0000 7f8e8a52b800 20 realm 2024-03-09T14:40:38.069 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.068+0000 7f8e8a52b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.070 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.068+0000 7f8e8a52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:38.070 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.068+0000 7f8e8a52b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:38.070 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.068+0000 7f8e8a52b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.070 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.069+0000 7f8e8a52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:38.070 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.069+0000 7f8e8a52b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.070 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.070+0000 7f8e8a52b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:38.070 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.070+0000 7f8e8a52b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.071 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.070+0000 7f8e8a52b800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:38.071 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.070+0000 7f8e8a52b800 20 searching for the correct realm 2024-03-09T14:40:38.073 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.072+0000 7f8e86978640 0 -- 172.21.15.88:0/3393413327 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f8e7805a760 msgr2=0x7f8e78061530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:38.278 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.278+0000 7f8e85976640 0 -- 172.21.15.88:0/3393413327 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f8e7809a040 msgr2=0x7f8e78075820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:38.486 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.484+0000 7f8e8a52b800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:38.486 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.484+0000 7f8e8a52b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:38.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.484+0000 7f8e8a52b800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:38.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.484+0000 7f8e8a52b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:38.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.484+0000 7f8e8a52b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:38.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.484+0000 7f8e8a52b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:38.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.484+0000 7f8e8a52b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.484+0000 7f8e8a52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:38.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.484+0000 7f8e8a52b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.484+0000 7f8e8a52b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:38.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.484+0000 7f8e8a52b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.485+0000 7f8e8a52b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:38.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.485+0000 7f8e8a52b800 20 zone default found 2024-03-09T14:40:38.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.485+0000 7f8e8a52b800 4 Realm: () 2024-03-09T14:40:38.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.485+0000 7f8e8a52b800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:38.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.485+0000 7f8e8a52b800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:38.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.485+0000 7f8e8a52b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:38.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.485+0000 7f8e8a52b800 20 zonegroup default 2024-03-09T14:40:38.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.485+0000 7f8e8a52b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.485+0000 7f8e8a52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:38.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.485+0000 7f8e8a52b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.485+0000 7f8e8a52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:38.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.485+0000 7f8e8a52b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.486+0000 7f8e8a52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:38.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.486+0000 7f8e8a52b800 20 started sync module instance, tier type = 2024-03-09T14:40:38.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.486+0000 7f8e8a52b800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:38.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.495+0000 7f8e8a52b800 20 add_watcher() i=0 2024-03-09T14:40:38.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.495+0000 7f8e8a52b800 20 add_watcher() i=1 2024-03-09T14:40:38.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.495+0000 7f8e8a52b800 20 add_watcher() i=2 2024-03-09T14:40:38.497 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.495+0000 7f8e8a52b800 20 add_watcher() i=3 2024-03-09T14:40:38.497 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.495+0000 7f8e8a52b800 20 add_watcher() i=4 2024-03-09T14:40:38.497 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.495+0000 7f8e8a52b800 20 add_watcher() i=5 2024-03-09T14:40:38.497 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.495+0000 7f8e8a52b800 20 add_watcher() i=6 2024-03-09T14:40:38.497 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.496+0000 7f8e8a52b800 20 add_watcher() i=7 2024-03-09T14:40:38.497 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.496+0000 7f8e8a52b800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:38.498 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.498+0000 7f8d3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:38.500 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.498+0000 7f8e8a52b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:38.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.498+0000 7f8e8a52b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:38.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.498+0000 7f8e8a52b800 5 note: GC not initialized 2024-03-09T14:40:38.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.498+0000 7f8cb77fe640 20 reqs_thread_entry: start 2024-03-09T14:40:38.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.498+0000 7f8e8a52b800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:38.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.498+0000 7f8e8a52b800 20 Filter name: none 2024-03-09T14:40:38.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.499+0000 7f8cb57fa640 20 reqs_thread_entry: start 2024-03-09T14:40:38.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.499+0000 7f8e8a52b800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-03-09T14:40:38.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.499+0000 7f8e8a52b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.499+0000 7f8e8a52b800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:38.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.499+0000 7f8e8a52b800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-03-09T14:40:38.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.499+0000 7f8e8a52b800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-03-09T14:40:38.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.499+0000 7f8e8a52b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20 : miss 2024-03-09T14:40:38.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.499+0000 7f8e8a52b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.499+0000 7f8e8a52b800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:38.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.499+0000 7f8e8a52b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20 info.flags=0x17 2024-03-09T14:40:38.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.499+0000 7f8e8a52b800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20 to cache LRU end 2024-03-09T14:40:38.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.499+0000 7f8e8a52b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:38.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.499+0000 7f8e8a52b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:38.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.499+0000 7f8e8a52b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20 2024-03-09T14:40:38.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.504+0000 7f8e8a52b800 -1 Injecting error=-125 at location=set_target_layout 2024-03-09T14:40:38.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.505+0000 7f8e8a52b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20 info.flags=0x17 2024-03-09T14:40:38.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.505+0000 7f8e8a52b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20 to cache LRU end 2024-03-09T14:40:38.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.505+0000 7f8e8a52b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:38.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.505+0000 7f8e8a52b800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20, ofs0, ns] 2024-03-09T14:40:38.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.505+0000 7f8d697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94632908324096 notifier 5978 bl.length()=917 2024-03-09T14:40:38.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.505+0000 7f8d697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20 info.flags=0x17 2024-03-09T14:40:38.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.505+0000 7f8d697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20 to cache LRU end 2024-03-09T14:40:38.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.505+0000 7f8d697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:38.508 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.507+0000 7f8e8a52b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.20]): orig_sources= new_sources= 2024-03-09T14:40:38.508 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.507+0000 7f8e8a52b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.20]): potential sources added=[] removed=[] 2024-03-09T14:40:38.508 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.507+0000 7f8e8a52b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.20]): orig_dests= new_dests= 2024-03-09T14:40:38.508 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.507+0000 7f8e8a52b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.20]): potential dests added=[] removed=[] 2024-03-09T14:40:38.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.0 2024-03-09T14:40:38.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.0 2024-03-09T14:40:38.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.1 2024-03-09T14:40:38.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.1 2024-03-09T14:40:38.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.2 2024-03-09T14:40:38.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.2 2024-03-09T14:40:38.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.3 2024-03-09T14:40:38.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.3 2024-03-09T14:40:38.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.4 2024-03-09T14:40:38.511 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.4 2024-03-09T14:40:38.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.5 2024-03-09T14:40:38.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.5 2024-03-09T14:40:38.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.6 2024-03-09T14:40:38.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.6 2024-03-09T14:40:38.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.7 2024-03-09T14:40:38.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.7 2024-03-09T14:40:38.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.8 2024-03-09T14:40:38.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.8 2024-03-09T14:40:38.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.9 2024-03-09T14:40:38.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.9 2024-03-09T14:40:38.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.10 2024-03-09T14:40:38.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.10 2024-03-09T14:40:38.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.11 2024-03-09T14:40:38.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1.11 2024-03-09T14:40:38.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.0 2024-03-09T14:40:38.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.510+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.1 2024-03-09T14:40:38.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.511+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.2 2024-03-09T14:40:38.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.511+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.3 2024-03-09T14:40:38.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.512+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.4 2024-03-09T14:40:38.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.512+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.5 2024-03-09T14:40:38.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.513+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.6 2024-03-09T14:40:38.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.513+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.7 2024-03-09T14:40:38.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.513+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.8 2024-03-09T14:40:38.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.514+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.9 2024-03-09T14:40:38.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.515+0000 7f8e8a52b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.20.10 2024-03-09T14:40:38.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.518+0000 7f8e8a52b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20 : hit (requested=0x17, cached=0x17) 2024-03-09T14:40:38.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.518+0000 7f8e8a52b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20 2024-03-09T14:40:38.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.519+0000 7f8e8a52b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20 info.flags=0x17 2024-03-09T14:40:38.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.519+0000 7f8e8a52b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20 to cache LRU end 2024-03-09T14:40:38.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.519+0000 7f8e8a52b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:38.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.519+0000 7f8e8a52b800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20, ofs0, ns] 2024-03-09T14:40:38.520 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.520+0000 7f8d697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 94632908324096 notifier 5978 bl.length()=885 2024-03-09T14:40:38.521 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.520+0000 7f8d697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20 info.flags=0x17 2024-03-09T14:40:38.521 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.520+0000 7f8d697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.20 to cache LRU end 2024-03-09T14:40:38.521 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.520+0000 7f8d697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:38.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.521+0000 7f8e8a52b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.20]): orig_sources= new_sources= 2024-03-09T14:40:38.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.521+0000 7f8e8a52b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.20]): potential sources added=[] removed=[] 2024-03-09T14:40:38.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.521+0000 7f8e8a52b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.20]): orig_dests= new_dests= 2024-03-09T14:40:38.522 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.521+0000 7f8e8a52b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.20]): potential dests added=[] removed=[] 2024-03-09T14:40:38.524 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.524+0000 7f8e8a52b800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-03-09T14:40:38.526 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.526+0000 7f8d3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:38.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.528+0000 7f8e8a52b800 20 remove_watcher() i=0 2024-03-09T14:40:38.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.528+0000 7f8e8a52b800 2 removed watcher, disabling cache 2024-03-09T14:40:38.530 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.529+0000 7f8e8a52b800 20 remove_watcher() i=1 2024-03-09T14:40:38.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.530+0000 7f8e8a52b800 20 remove_watcher() i=2 2024-03-09T14:40:38.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.532+0000 7f8e8a52b800 20 remove_watcher() i=3 2024-03-09T14:40:38.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.533+0000 7f8e8a52b800 20 remove_watcher() i=4 2024-03-09T14:40:38.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.534+0000 7f8e8a52b800 20 remove_watcher() i=5 2024-03-09T14:40:38.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.534+0000 7f8e8a52b800 20 remove_watcher() i=6 2024-03-09T14:40:38.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.535+0000 7f8e8a52b800 20 remove_watcher() i=7 2024-03-09T14:40:38.547 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-09T14:40:38.574 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:38.574 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:38.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.606+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.608+0000 7faf9ae8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:38.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.608+0000 7faf9ae8c800 20 realm 2024-03-09T14:40:38.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.608+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.608+0000 7faf9ae8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:38.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.608+0000 7faf9ae8c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:38.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.608+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.608+0000 7faf9ae8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:38.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.608+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.609+0000 7faf9ae8c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:38.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.609+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.610+0000 7faf9ae8c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:38.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.610+0000 7faf9ae8c800 20 searching for the correct realm 2024-03-09T14:40:38.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.613+0000 7faf90187640 0 -- 172.21.15.88:0/1772719715 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7faf88026040 msgr2=0x7faf88024910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:38.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.616+0000 7faf90187640 0 -- 172.21.15.88:0/1772719715 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7faf9404ba00 msgr2=0x7faf94089030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:38.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.822+0000 7faf9ae8c800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:38.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.822+0000 7faf9ae8c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:38.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.822+0000 7faf9ae8c800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:38.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.822+0000 7faf9ae8c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:38.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.822+0000 7faf9ae8c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:38.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.822+0000 7faf9ae8c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:38.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.822+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.822+0000 7faf9ae8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:38.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.822+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.823+0000 7faf9ae8c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:38.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.823+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.823+0000 7faf9ae8c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:38.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.823+0000 7faf9ae8c800 20 zone default found 2024-03-09T14:40:38.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.823+0000 7faf9ae8c800 4 Realm: () 2024-03-09T14:40:38.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.823+0000 7faf9ae8c800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:38.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.823+0000 7faf9ae8c800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:38.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.823+0000 7faf9ae8c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:38.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.823+0000 7faf9ae8c800 20 zonegroup default 2024-03-09T14:40:38.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.823+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.823+0000 7faf9ae8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:38.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.823+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.823+0000 7faf9ae8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:38.826 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.824+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.826 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.824+0000 7faf9ae8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:38.826 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.824+0000 7faf9ae8c800 20 started sync module instance, tier type = 2024-03-09T14:40:38.826 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.824+0000 7faf9ae8c800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:38.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.834+0000 7faf9ae8c800 20 add_watcher() i=0 2024-03-09T14:40:38.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.834+0000 7faf9ae8c800 20 add_watcher() i=1 2024-03-09T14:40:38.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.834+0000 7faf9ae8c800 20 add_watcher() i=2 2024-03-09T14:40:38.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.834+0000 7faf9ae8c800 20 add_watcher() i=3 2024-03-09T14:40:38.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.834+0000 7faf9ae8c800 20 add_watcher() i=4 2024-03-09T14:40:38.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.834+0000 7faf9ae8c800 20 add_watcher() i=5 2024-03-09T14:40:38.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.834+0000 7faf9ae8c800 20 add_watcher() i=6 2024-03-09T14:40:38.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.835+0000 7faf9ae8c800 20 add_watcher() i=7 2024-03-09T14:40:38.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.835+0000 7faf9ae8c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:38.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.837+0000 7fae4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:38.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.837+0000 7faf9ae8c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:38.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.837+0000 7faf9ae8c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:38.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.837+0000 7faf9ae8c800 5 note: GC not initialized 2024-03-09T14:40:38.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.837+0000 7fae4dfe3640 20 reqs_thread_entry: start 2024-03-09T14:40:38.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.837+0000 7faf9ae8c800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:38.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.838+0000 7faf9ae8c800 20 Filter name: none 2024-03-09T14:40:38.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.838+0000 7fadbf7fe640 20 reqs_thread_entry: start 2024-03-09T14:40:38.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.838+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.838+0000 7faf9ae8c800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:38.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.838+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.840 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.839+0000 7faf9ae8c800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:38.840 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.839+0000 7faf9ae8c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:38.840 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.839+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.840 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.839+0000 7faf9ae8c800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:38.840 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.839+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.840 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.839+0000 7faf9ae8c800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:38.840 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.839+0000 7faf9ae8c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:38.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.840+0000 7faf9ae8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:38.841 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.840+0000 7faf9ae8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:38.842 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.841+0000 7fae4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:38.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.843+0000 7faf9ae8c800 20 remove_watcher() i=0 2024-03-09T14:40:38.844 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.843+0000 7faf9ae8c800 2 removed watcher, disabling cache 2024-03-09T14:40:38.846 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.845+0000 7faf9ae8c800 20 remove_watcher() i=1 2024-03-09T14:40:38.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.847+0000 7faf9ae8c800 20 remove_watcher() i=2 2024-03-09T14:40:38.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.849+0000 7faf9ae8c800 20 remove_watcher() i=3 2024-03-09T14:40:38.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.850+0000 7faf9ae8c800 20 remove_watcher() i=4 2024-03-09T14:40:38.852 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.851+0000 7faf9ae8c800 20 remove_watcher() i=5 2024-03-09T14:40:38.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.853+0000 7faf9ae8c800 20 remove_watcher() i=6 2024-03-09T14:40:38.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:38.854+0000 7faf9ae8c800 20 remove_watcher() i=7 2024-03-09T14:40:38.864 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:38.864 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:40:38.864 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-set-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-03-09T14:40:38.864 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:39.198 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: reshard bucket with abort at set_target_layout 2024-03-09T14:40:39.199 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:39.938 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-03-09T14:40:39.965 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:39.965 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:39.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:39.998+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:39.999+0000 7f108994b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:39.999+0000 7f108994b800 20 realm 2024-03-09T14:40:40.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:39.999+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:39.999+0000 7f108994b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.000 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:39.999+0000 7f108994b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:40.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:39.999+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:39.999+0000 7f108994b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:39.999+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.000+0000 7f108994b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:40.002 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.000+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.002 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.001+0000 7f108994b800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:40.002 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.001+0000 7f108994b800 20 searching for the correct realm 2024-03-09T14:40:40.003 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.003+0000 7f107ec46640 0 -- 172.21.15.88:0/1771341245 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f0f5007ad10 msgr2=0x7f0f5007d140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:40.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.006+0000 7f107ec46640 0 -- 172.21.15.88:0/1771341245 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f1078087b60 msgr2=0x7f0f5007fe90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:40.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:40.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:40.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:40.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:40.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:40.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:40.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:40.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:40.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 20 zone default found 2024-03-09T14:40:40.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 4 Realm: () 2024-03-09T14:40:40.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:40.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:40.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:40.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 20 zonegroup default 2024-03-09T14:40:40.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.012+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.013+0000 7f108994b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.013+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.013+0000 7f108994b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.013+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.013+0000 7f108994b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.013+0000 7f108994b800 20 started sync module instance, tier type = 2024-03-09T14:40:40.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.013+0000 7f108994b800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:40.024 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.024+0000 7f108994b800 20 add_watcher() i=0 2024-03-09T14:40:40.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.024+0000 7f108994b800 20 add_watcher() i=1 2024-03-09T14:40:40.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.024+0000 7f108994b800 20 add_watcher() i=2 2024-03-09T14:40:40.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.024+0000 7f108994b800 20 add_watcher() i=3 2024-03-09T14:40:40.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.024+0000 7f108994b800 20 add_watcher() i=4 2024-03-09T14:40:40.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.024+0000 7f108994b800 20 add_watcher() i=5 2024-03-09T14:40:40.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.024+0000 7f108994b800 20 add_watcher() i=6 2024-03-09T14:40:40.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.025+0000 7f108994b800 20 add_watcher() i=7 2024-03-09T14:40:40.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.025+0000 7f108994b800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:40.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.026+0000 7f0f3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:40.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.026+0000 7f108994b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:40.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.026+0000 7f108994b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:40.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.026+0000 7f108994b800 5 note: GC not initialized 2024-03-09T14:40:40.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.027+0000 7f0f3cfe1640 20 reqs_thread_entry: start 2024-03-09T14:40:40.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.027+0000 7f108994b800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:40.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.027+0000 7f108994b800 20 Filter name: none 2024-03-09T14:40:40.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.027+0000 7f0eb67fc640 20 reqs_thread_entry: start 2024-03-09T14:40:40.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.027+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.027+0000 7f108994b800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:40.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.027+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.028+0000 7f108994b800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:40.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.028+0000 7f108994b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:40.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.028+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.028+0000 7f108994b800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:40.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.028+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.029+0000 7f108994b800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:40.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.029+0000 7f108994b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:40.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.029+0000 7f108994b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.030+0000 7f108994b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.030+0000 7f0f3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:40.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.032+0000 7f108994b800 20 remove_watcher() i=0 2024-03-09T14:40:40.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.032+0000 7f108994b800 2 removed watcher, disabling cache 2024-03-09T14:40:40.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.033+0000 7f108994b800 20 remove_watcher() i=1 2024-03-09T14:40:40.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.034+0000 7f108994b800 20 remove_watcher() i=2 2024-03-09T14:40:40.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.036+0000 7f108994b800 20 remove_watcher() i=3 2024-03-09T14:40:40.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.037+0000 7f108994b800 20 remove_watcher() i=4 2024-03-09T14:40:40.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.038+0000 7f108994b800 20 remove_watcher() i=5 2024-03-09T14:40:40.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.039+0000 7f108994b800 20 remove_watcher() i=6 2024-03-09T14:40:40.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.040+0000 7f108994b800 20 remove_watcher() i=7 2024-03-09T14:40:40.050 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.050 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:40:40.050 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: abort-at-set-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:40:40.050 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.052 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-03-09T14:40:40.083 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:40.084 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:40.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.310+0000 7f798c20d640 0 --2- 172.21.15.88:0/1655327022 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55bf750cbc30 0x55bf750b6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-09T14:40:40.318 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.317+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.319+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.319+0000 7f798e711800 20 realm 2024-03-09T14:40:40.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.319+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.319+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.319+0000 7f798e711800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:40.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.319+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.319+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.319+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.320+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:40.321 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.320+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.321 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.321+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:40.321 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.321+0000 7f798e711800 20 searching for the correct realm 2024-03-09T14:40:40.322 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.321+0000 7f798ba0c640 0 -- 172.21.15.88:0/2314801468 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f797c0666a0 msgr2=0x7f797c009b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:40.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.527+0000 7f798ca0e640 0 -- 172.21.15.88:0/2314801468 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x55bf75126120 msgr2=0x55bf75128530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:40.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:40.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:40.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:40.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:40.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:40.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:40.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.533+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.533+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.534 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.533+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.533+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:40.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.533+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.534+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:40.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.534+0000 7f798e711800 20 zone default found 2024-03-09T14:40:40.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.534+0000 7f798e711800 4 Realm: () 2024-03-09T14:40:40.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.534+0000 7f798e711800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:40.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.534+0000 7f798e711800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:40.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.534+0000 7f798e711800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:40.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.534+0000 7f798e711800 20 zonegroup default 2024-03-09T14:40:40.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.534+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.534+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.534+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.534+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.534+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.535+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.535+0000 7f798e711800 20 started sync module instance, tier type = 2024-03-09T14:40:40.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.535+0000 7f798e711800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:40.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=0 2024-03-09T14:40:40.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=1 2024-03-09T14:40:40.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=2 2024-03-09T14:40:40.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=3 2024-03-09T14:40:40.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=4 2024-03-09T14:40:40.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=5 2024-03-09T14:40:40.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=6 2024-03-09T14:40:40.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.544+0000 7f798e711800 20 add_watcher() i=7 2024-03-09T14:40:40.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.544+0000 7f798e711800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:40.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.546+0000 7f7842fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:40.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.546+0000 7f798e711800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:40.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.546+0000 7f798e711800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:40.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.546+0000 7f798e711800 5 note: GC not initialized 2024-03-09T14:40:40.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.546+0000 7f7841fdb640 20 reqs_thread_entry: start 2024-03-09T14:40:40.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.546+0000 7f798e711800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:40.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.547+0000 7f798e711800 20 Filter name: none 2024-03-09T14:40:40.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.547+0000 7f77b37fe640 20 reqs_thread_entry: start 2024-03-09T14:40:40.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.547+0000 7f798e711800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-09T14:40:40.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.547+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.547+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:40.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.547+0000 7f798e711800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-09T14:40:40.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.547+0000 7f798e711800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-09T14:40:40.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.547+0000 7f798e711800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 : miss 2024-03-09T14:40:40.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.547+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.548+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:40.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.548+0000 7f798e711800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 info.flags=0x17 2024-03-09T14:40:40.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.548+0000 7f798e711800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 to cache LRU end 2024-03-09T14:40:40.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.548+0000 7f798e711800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:40.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.548+0000 7f798e711800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:40.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.548+0000 7f798e711800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 2024-03-09T14:40:40.552 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f798e711800 time 2024-03-09T14:40:40.552937+0000 2024-03-09T14:40:40.552 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:40:40.553 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:40.553 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7991b80e86] 2024-03-09T14:40:40.553 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f7991b81044] 2024-03-09T14:40:40.553 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf7290bf91] 2024-03-09T14:40:40.553 INFO:tasks.workunit.client.0.smithi088.stderr: 4: radosgw-admin(+0x802a32) [0x55bf7291ba32] 2024-03-09T14:40:40.553 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55bf72926e0b] 2024-03-09T14:40:40.553 INFO:tasks.workunit.client.0.smithi088.stderr: 6: main() 2024-03-09T14:40:40.553 INFO:tasks.workunit.client.0.smithi088.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f7990a3feb0] 2024-03-09T14:40:40.553 INFO:tasks.workunit.client.0.smithi088.stderr: 8: __libc_start_main() 2024-03-09T14:40:40.553 INFO:tasks.workunit.client.0.smithi088.stderr: 9: _start() 2024-03-09T14:40:40.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.552+0000 7f798e711800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f798e711800 time 2024-03-09T14:40:40.552937+0000 2024-03-09T14:40:40.553 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:40:40.553 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.554 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:40.554 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7991b80e86] 2024-03-09T14:40:40.554 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f7991b81044] 2024-03-09T14:40:40.554 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf7290bf91] 2024-03-09T14:40:40.554 INFO:tasks.workunit.client.0.smithi088.stderr: 4: radosgw-admin(+0x802a32) [0x55bf7291ba32] 2024-03-09T14:40:40.554 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55bf72926e0b] 2024-03-09T14:40:40.554 INFO:tasks.workunit.client.0.smithi088.stderr: 6: main() 2024-03-09T14:40:40.554 INFO:tasks.workunit.client.0.smithi088.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f7990a3feb0] 2024-03-09T14:40:40.554 INFO:tasks.workunit.client.0.smithi088.stderr: 8: __libc_start_main() 2024-03-09T14:40:40.554 INFO:tasks.workunit.client.0.smithi088.stderr: 9: _start() 2024-03-09T14:40:40.554 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.554 INFO:tasks.workunit.client.0.smithi088.stderr:*** Caught signal (Aborted) ** 2024-03-09T14:40:40.554 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7f798e711800 thread_name:radosgw-admin 2024-03-09T14:40:40.573 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:40.573 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7990a54db0] 2024-03-09T14:40:40.573 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7990aa154c] 2024-03-09T14:40:40.573 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:40:40.573 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:40:40.573 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7991b80ee0] 2024-03-09T14:40:40.573 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f7991b81044] 2024-03-09T14:40:40.573 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf7290bf91] 2024-03-09T14:40:40.573 INFO:tasks.workunit.client.0.smithi088.stderr: 8: radosgw-admin(+0x802a32) [0x55bf7291ba32] 2024-03-09T14:40:40.573 INFO:tasks.workunit.client.0.smithi088.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55bf72926e0b] 2024-03-09T14:40:40.573 INFO:tasks.workunit.client.0.smithi088.stderr: 10: main() 2024-03-09T14:40:40.573 INFO:tasks.workunit.client.0.smithi088.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f7990a3feb0] 2024-03-09T14:40:40.574 INFO:tasks.workunit.client.0.smithi088.stderr: 12: __libc_start_main() 2024-03-09T14:40:40.574 INFO:tasks.workunit.client.0.smithi088.stderr: 13: _start() 2024-03-09T14:40:40.574 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.553+0000 7f798e711800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:40:40.574 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7f798e711800 thread_name:radosgw-admin 2024-03-09T14:40:40.574 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.574 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:40.574 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7990a54db0] 2024-03-09T14:40:40.574 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7990aa154c] 2024-03-09T14:40:40.574 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:40:40.574 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:40:40.574 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7991b80ee0] 2024-03-09T14:40:40.574 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f7991b81044] 2024-03-09T14:40:40.574 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf7290bf91] 2024-03-09T14:40:40.575 INFO:tasks.workunit.client.0.smithi088.stderr: 8: radosgw-admin(+0x802a32) [0x55bf7291ba32] 2024-03-09T14:40:40.575 INFO:tasks.workunit.client.0.smithi088.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55bf72926e0b] 2024-03-09T14:40:40.575 INFO:tasks.workunit.client.0.smithi088.stderr: 10: main() 2024-03-09T14:40:40.575 INFO:tasks.workunit.client.0.smithi088.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f7990a3feb0] 2024-03-09T14:40:40.575 INFO:tasks.workunit.client.0.smithi088.stderr: 12: __libc_start_main() 2024-03-09T14:40:40.575 INFO:tasks.workunit.client.0.smithi088.stderr: 13: _start() 2024-03-09T14:40:40.575 INFO:tasks.workunit.client.0.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:40:40.575 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.575 INFO:tasks.workunit.client.0.smithi088.stderr:--- begin dump of recent events --- 2024-03-09T14:40:40.575 INFO:tasks.workunit.client.0.smithi088.stderr: -499> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf7503dbc0) adding con mode: secure 2024-03-09T14:40:40.575 INFO:tasks.workunit.client.0.smithi088.stderr: -498> 2024-03-09T14:40:40.101+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.575 INFO:tasks.workunit.client.0.smithi088.stderr: -497> 2024-03-09T14:40:40.101+0000 7f798e711800 1 librados: starting msgr at 2024-03-09T14:40:40.575 INFO:tasks.workunit.client.0.smithi088.stderr: -496> 2024-03-09T14:40:40.101+0000 7f798e711800 1 librados: starting objecter 2024-03-09T14:40:40.575 INFO:tasks.workunit.client.0.smithi088.stderr: -495> 2024-03-09T14:40:40.101+0000 7f798e711800 5 asok(0x55bf74e18780) register_command objecter_requests hook 0x55bf7503a440 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi088.stderr: -494> 2024-03-09T14:40:40.101+0000 7f798e711800 1 librados: setting wanted keys 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi088.stderr: -493> 2024-03-09T14:40:40.101+0000 7f798e711800 1 librados: calling monclient init 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi088.stderr: -492> 2024-03-09T14:40:40.101+0000 7f798e711800 10 monclient: init 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi088.stderr: -491> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding auth protocol: cephx 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi088.stderr: -490> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding auth protocol: cephx 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi088.stderr: -489> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding auth protocol: cephx 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi088.stderr: -488> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: secure 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi088.stderr: -487> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: crc 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi088.stderr: -486> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: secure 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi088.stderr: -485> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: crc 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi088.stderr: -484> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: secure 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi088.stderr: -483> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: crc 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi088.stderr: -482> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: crc 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi088.stderr: -481> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: secure 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi088.stderr: -480> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: crc 2024-03-09T14:40:40.577 INFO:tasks.workunit.client.0.smithi088.stderr: -479> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: secure 2024-03-09T14:40:40.577 INFO:tasks.workunit.client.0.smithi088.stderr: -478> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: crc 2024-03-09T14:40:40.577 INFO:tasks.workunit.client.0.smithi088.stderr: -477> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: secure 2024-03-09T14:40:40.577 INFO:tasks.workunit.client.0.smithi088.stderr: -476> 2024-03-09T14:40:40.101+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.577 INFO:tasks.workunit.client.0.smithi088.stderr: -475> 2024-03-09T14:40:40.102+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.577 INFO:tasks.workunit.client.0.smithi088.stderr: -474> 2024-03-09T14:40:40.102+0000 7f798e711800 5 asok(0x55bf74e18780) register_command rotate-key hook 0x55bf75036a38 2024-03-09T14:40:40.577 INFO:tasks.workunit.client.0.smithi088.stderr: -473> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:40.577 INFO:tasks.workunit.client.0.smithi088.stderr: -472> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:40:40.577 INFO:tasks.workunit.client.0.smithi088.stderr: -471> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): picked mon.noname-c con 0x55bf74eed380 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:40:40.577 INFO:tasks.workunit.client.0.smithi088.stderr: -470> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): picked mon.noname-b con 0x55bf74f78680 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:40:40.577 INFO:tasks.workunit.client.0.smithi088.stderr: -469> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): picked mon.noname-a con 0x55bf74f7b5d0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:40:40.577 INFO:tasks.workunit.client.0.smithi088.stderr: -468> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.577 INFO:tasks.workunit.client.0.smithi088.stderr: -467> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.577 INFO:tasks.workunit.client.0.smithi088.stderr: -466> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.578 INFO:tasks.workunit.client.0.smithi088.stderr: -465> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:40.578 INFO:tasks.workunit.client.0.smithi088.stderr: -464> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): authenticate will time out at 1655.440542s 2024-03-09T14:40:40.578 INFO:tasks.workunit.client.0.smithi088.stderr: -463> 2024-03-09T14:40:40.102+0000 7f798ca0e640 10 monclient(hunting): get_auth_request con 0x55bf74f7b5d0 auth_method 0 2024-03-09T14:40:40.578 INFO:tasks.workunit.client.0.smithi088.stderr: -462> 2024-03-09T14:40:40.102+0000 7f798ca0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.578 INFO:tasks.workunit.client.0.smithi088.stderr: -461> 2024-03-09T14:40:40.102+0000 7f798ca0e640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.578 INFO:tasks.workunit.client.0.smithi088.stderr: -460> 2024-03-09T14:40:40.102+0000 7f798ca0e640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.578 INFO:tasks.workunit.client.0.smithi088.stderr: -459> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): get_auth_request con 0x55bf74eed380 auth_method 0 2024-03-09T14:40:40.578 INFO:tasks.workunit.client.0.smithi088.stderr: -458> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.578 INFO:tasks.workunit.client.0.smithi088.stderr: -457> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.578 INFO:tasks.workunit.client.0.smithi088.stderr: -456> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.578 INFO:tasks.workunit.client.0.smithi088.stderr: -455> 2024-03-09T14:40:40.102+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.578 INFO:tasks.workunit.client.0.smithi088.stderr: -454> 2024-03-09T14:40:40.102+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.578 INFO:tasks.workunit.client.0.smithi088.stderr: -453> 2024-03-09T14:40:40.102+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.578 INFO:tasks.workunit.client.0.smithi088.stderr: -452> 2024-03-09T14:40:40.102+0000 7f798ba0c640 10 monclient(hunting): get_auth_request con 0x55bf74f78680 auth_method 0 2024-03-09T14:40:40.579 INFO:tasks.workunit.client.0.smithi088.stderr: -451> 2024-03-09T14:40:40.102+0000 7f798ba0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.579 INFO:tasks.workunit.client.0.smithi088.stderr: -450> 2024-03-09T14:40:40.102+0000 7f798ba0c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.579 INFO:tasks.workunit.client.0.smithi088.stderr: -449> 2024-03-09T14:40:40.102+0000 7f798ba0c640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.579 INFO:tasks.workunit.client.0.smithi088.stderr: -448> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.579 INFO:tasks.workunit.client.0.smithi088.stderr: -447> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.579 INFO:tasks.workunit.client.0.smithi088.stderr: -446> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.579 INFO:tasks.workunit.client.0.smithi088.stderr: -445> 2024-03-09T14:40:40.102+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.579 INFO:tasks.workunit.client.0.smithi088.stderr: -444> 2024-03-09T14:40:40.102+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.579 INFO:tasks.workunit.client.0.smithi088.stderr: -443> 2024-03-09T14:40:40.102+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.579 INFO:tasks.workunit.client.0.smithi088.stderr: -442> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): handle_auth_done global_id 6023 payload 824 2024-03-09T14:40:40.579 INFO:tasks.workunit.client.0.smithi088.stderr: -441> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient: _finish_hunting 0 2024-03-09T14:40:40.579 INFO:tasks.workunit.client.0.smithi088.stderr: -440> 2024-03-09T14:40:40.102+0000 7f798c20d640 1 monclient: found mon.noname-c 2024-03-09T14:40:40.579 INFO:tasks.workunit.client.0.smithi088.stderr: -439> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.579 INFO:tasks.workunit.client.0.smithi088.stderr: -438> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.579 INFO:tasks.workunit.client.0.smithi088.stderr: -437> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:40.580 INFO:tasks.workunit.client.0.smithi088.stderr: -436> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: dump: 2024-03-09T14:40:40.580 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.580 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.580 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.580 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.580 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.580 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.580 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.580 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.580 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.580 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.580 INFO:tasks.workunit.client.0.smithi088.stderr: -435> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: _finish_auth 0 2024-03-09T14:40:40.580 INFO:tasks.workunit.client.0.smithi088.stderr: -434> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: _check_auth_tickets 2024-03-09T14:40:40.580 INFO:tasks.workunit.client.0.smithi088.stderr: -433> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:40.581 INFO:tasks.workunit.client.0.smithi088.stderr: -432> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.581 INFO:tasks.workunit.client.0.smithi088.stderr: -431> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:40.581 INFO:tasks.workunit.client.0.smithi088.stderr: -430> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: dump: 2024-03-09T14:40:40.581 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.581 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.581 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.581 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.581 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.581 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.581 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.581 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.581 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.581 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.581 INFO:tasks.workunit.client.0.smithi088.stderr: -429> 2024-03-09T14:40:40.102+0000 7f798e711800 5 monclient: authenticate success, global_id 6023 2024-03-09T14:40:40.581 INFO:tasks.workunit.client.0.smithi088.stderr: -428> 2024-03-09T14:40:40.102+0000 7f787a60c640 4 set_mon_vals no callback set 2024-03-09T14:40:40.582 INFO:tasks.workunit.client.0.smithi088.stderr: -427> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient: _renew_subs 2024-03-09T14:40:40.582 INFO:tasks.workunit.client.0.smithi088.stderr: -426> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.582 INFO:tasks.workunit.client.0.smithi088.stderr: -425> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient: _renew_subs 2024-03-09T14:40:40.582 INFO:tasks.workunit.client.0.smithi088.stderr: -424> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.582 INFO:tasks.workunit.client.0.smithi088.stderr: -423> 2024-03-09T14:40:40.102+0000 7f798e711800 1 librados: init done 2024-03-09T14:40:40.582 INFO:tasks.workunit.client.0.smithi088.stderr: -422> 2024-03-09T14:40:40.104+0000 7f7878e09640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:40:40.582 INFO:tasks.workunit.client.0.smithi088.stderr: -421> 2024-03-09T14:40:40.104+0000 7f7878e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:40:40.582 INFO:tasks.workunit.client.0.smithi088.stderr: -420> 2024-03-09T14:40:40.104+0000 7f7878e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:40:40.582 INFO:tasks.workunit.client.0.smithi088.stderr: -419> 2024-03-09T14:40:40.104+0000 7f798ba0c640 10 monclient: get_auth_request con 0x7f787406a5b0 auth_method 0 2024-03-09T14:40:40.582 INFO:tasks.workunit.client.0.smithi088.stderr: -418> 2024-03-09T14:40:40.104+0000 7f798ca0e640 10 monclient: get_auth_request con 0x55bf7505dd80 auth_method 0 2024-03-09T14:40:40.582 INFO:tasks.workunit.client.0.smithi088.stderr: -417> 2024-03-09T14:40:40.105+0000 7f798c20d640 10 monclient: get_auth_request con 0x55bf750827f0 auth_method 0 2024-03-09T14:40:40.582 INFO:tasks.workunit.client.0.smithi088.stderr: -416> 2024-03-09T14:40:40.106+0000 7f798ba0c640 10 monclient: get_auth_request con 0x55bf75086b50 auth_method 0 2024-03-09T14:40:40.582 INFO:tasks.workunit.client.0.smithi088.stderr: -415> 2024-03-09T14:40:40.107+0000 7f798ca0e640 10 monclient: get_auth_request con 0x55bf75086020 auth_method 0 2024-03-09T14:40:40.583 INFO:tasks.workunit.client.0.smithi088.stderr: -414> 2024-03-09T14:40:40.107+0000 7f798e711800 10 monclient: build_initial_monmap 2024-03-09T14:40:40.583 INFO:tasks.workunit.client.0.smithi088.stderr: -413> 2024-03-09T14:40:40.107+0000 7f798e711800 1 build_initial for_mkfs: 0 2024-03-09T14:40:40.583 INFO:tasks.workunit.client.0.smithi088.stderr: -412> 2024-03-09T14:40:40.107+0000 7f798e711800 10 monclient: monmap: 2024-03-09T14:40:40.583 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:40:40.583 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:40.583 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:40:40.583 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:40:40.583 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:40.583 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.583 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:40:40.583 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:40:40.583 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:40:40.583 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.583 INFO:tasks.workunit.client.0.smithi088.stderr: -411> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding auth protocol: cephx 2024-03-09T14:40:40.583 INFO:tasks.workunit.client.0.smithi088.stderr: -410> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding auth protocol: cephx 2024-03-09T14:40:40.584 INFO:tasks.workunit.client.0.smithi088.stderr: -409> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding auth protocol: cephx 2024-03-09T14:40:40.584 INFO:tasks.workunit.client.0.smithi088.stderr: -408> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: secure 2024-03-09T14:40:40.584 INFO:tasks.workunit.client.0.smithi088.stderr: -407> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: crc 2024-03-09T14:40:40.584 INFO:tasks.workunit.client.0.smithi088.stderr: -406> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: secure 2024-03-09T14:40:40.584 INFO:tasks.workunit.client.0.smithi088.stderr: -405> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: crc 2024-03-09T14:40:40.584 INFO:tasks.workunit.client.0.smithi088.stderr: -404> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: secure 2024-03-09T14:40:40.584 INFO:tasks.workunit.client.0.smithi088.stderr: -403> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: crc 2024-03-09T14:40:40.584 INFO:tasks.workunit.client.0.smithi088.stderr: -402> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: crc 2024-03-09T14:40:40.584 INFO:tasks.workunit.client.0.smithi088.stderr: -401> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: secure 2024-03-09T14:40:40.584 INFO:tasks.workunit.client.0.smithi088.stderr: -400> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: crc 2024-03-09T14:40:40.584 INFO:tasks.workunit.client.0.smithi088.stderr: -399> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: secure 2024-03-09T14:40:40.584 INFO:tasks.workunit.client.0.smithi088.stderr: -398> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: crc 2024-03-09T14:40:40.584 INFO:tasks.workunit.client.0.smithi088.stderr: -397> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: secure 2024-03-09T14:40:40.584 INFO:tasks.workunit.client.0.smithi088.stderr: -396> 2024-03-09T14:40:40.108+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.584 INFO:tasks.workunit.client.0.smithi088.stderr: -395> 2024-03-09T14:40:40.108+0000 7f798e711800 5 asok(0x55bf74e18780) register_command objecter_requests cmddesc objecter_requests hook 0x55bf7508fc40 EEXIST 2024-03-09T14:40:40.585 INFO:tasks.workunit.client.0.smithi088.stderr: -394> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient: init 2024-03-09T14:40:40.585 INFO:tasks.workunit.client.0.smithi088.stderr: -393> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding auth protocol: cephx 2024-03-09T14:40:40.585 INFO:tasks.workunit.client.0.smithi088.stderr: -392> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding auth protocol: cephx 2024-03-09T14:40:40.585 INFO:tasks.workunit.client.0.smithi088.stderr: -391> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding auth protocol: cephx 2024-03-09T14:40:40.585 INFO:tasks.workunit.client.0.smithi088.stderr: -390> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: secure 2024-03-09T14:40:40.585 INFO:tasks.workunit.client.0.smithi088.stderr: -389> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: crc 2024-03-09T14:40:40.585 INFO:tasks.workunit.client.0.smithi088.stderr: -388> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: secure 2024-03-09T14:40:40.585 INFO:tasks.workunit.client.0.smithi088.stderr: -387> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: crc 2024-03-09T14:40:40.585 INFO:tasks.workunit.client.0.smithi088.stderr: -386> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: secure 2024-03-09T14:40:40.585 INFO:tasks.workunit.client.0.smithi088.stderr: -385> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: crc 2024-03-09T14:40:40.585 INFO:tasks.workunit.client.0.smithi088.stderr: -384> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: crc 2024-03-09T14:40:40.585 INFO:tasks.workunit.client.0.smithi088.stderr: -383> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: secure 2024-03-09T14:40:40.585 INFO:tasks.workunit.client.0.smithi088.stderr: -382> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: crc 2024-03-09T14:40:40.585 INFO:tasks.workunit.client.0.smithi088.stderr: -381> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: secure 2024-03-09T14:40:40.586 INFO:tasks.workunit.client.0.smithi088.stderr: -380> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: crc 2024-03-09T14:40:40.586 INFO:tasks.workunit.client.0.smithi088.stderr: -379> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: secure 2024-03-09T14:40:40.586 INFO:tasks.workunit.client.0.smithi088.stderr: -378> 2024-03-09T14:40:40.108+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.586 INFO:tasks.workunit.client.0.smithi088.stderr: -377> 2024-03-09T14:40:40.108+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.586 INFO:tasks.workunit.client.0.smithi088.stderr: -376> 2024-03-09T14:40:40.108+0000 7f798e711800 5 asok(0x55bf74e18780) register_command rotate-key cmddesc rotate-key hook 0x55bf7508db10 EEXIST 2024-03-09T14:40:40.586 INFO:tasks.workunit.client.0.smithi088.stderr: -375> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:40.586 INFO:tasks.workunit.client.0.smithi088.stderr: -374> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:40:40.586 INFO:tasks.workunit.client.0.smithi088.stderr: -373> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): picked mon.noname-a con 0x55bf750b8ea0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:40:40.586 INFO:tasks.workunit.client.0.smithi088.stderr: -372> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): picked mon.noname-b con 0x55bf750b9280 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:40:40.586 INFO:tasks.workunit.client.0.smithi088.stderr: -371> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): picked mon.noname-c con 0x55bf750cbc30 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:40:40.586 INFO:tasks.workunit.client.0.smithi088.stderr: -370> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.586 INFO:tasks.workunit.client.0.smithi088.stderr: -369> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.586 INFO:tasks.workunit.client.0.smithi088.stderr: -368> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.586 INFO:tasks.workunit.client.0.smithi088.stderr: -367> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:40.587 INFO:tasks.workunit.client.0.smithi088.stderr: -366> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): authenticate will time out at 1655.447199s 2024-03-09T14:40:40.587 INFO:tasks.workunit.client.0.smithi088.stderr: -365> 2024-03-09T14:40:40.109+0000 7f798ba0c640 10 monclient(hunting): get_auth_request con 0x55bf750b8ea0 auth_method 0 2024-03-09T14:40:40.587 INFO:tasks.workunit.client.0.smithi088.stderr: -364> 2024-03-09T14:40:40.109+0000 7f798ba0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.587 INFO:tasks.workunit.client.0.smithi088.stderr: -363> 2024-03-09T14:40:40.109+0000 7f798ba0c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.587 INFO:tasks.workunit.client.0.smithi088.stderr: -362> 2024-03-09T14:40:40.109+0000 7f798ba0c640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.587 INFO:tasks.workunit.client.0.smithi088.stderr: -361> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): get_auth_request con 0x55bf750cbc30 auth_method 0 2024-03-09T14:40:40.587 INFO:tasks.workunit.client.0.smithi088.stderr: -360> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.587 INFO:tasks.workunit.client.0.smithi088.stderr: -359> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.587 INFO:tasks.workunit.client.0.smithi088.stderr: -358> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.587 INFO:tasks.workunit.client.0.smithi088.stderr: -357> 2024-03-09T14:40:40.109+0000 7f798ca0e640 10 monclient(hunting): get_auth_request con 0x55bf750b9280 auth_method 0 2024-03-09T14:40:40.587 INFO:tasks.workunit.client.0.smithi088.stderr: -356> 2024-03-09T14:40:40.109+0000 7f798ca0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.587 INFO:tasks.workunit.client.0.smithi088.stderr: -355> 2024-03-09T14:40:40.109+0000 7f798ca0e640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.587 INFO:tasks.workunit.client.0.smithi088.stderr: -354> 2024-03-09T14:40:40.109+0000 7f798ca0e640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.587 INFO:tasks.workunit.client.0.smithi088.stderr: -353> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.587 INFO:tasks.workunit.client.0.smithi088.stderr: -352> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.588 INFO:tasks.workunit.client.0.smithi088.stderr: -351> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.588 INFO:tasks.workunit.client.0.smithi088.stderr: -350> 2024-03-09T14:40:40.109+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.588 INFO:tasks.workunit.client.0.smithi088.stderr: -349> 2024-03-09T14:40:40.109+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.588 INFO:tasks.workunit.client.0.smithi088.stderr: -348> 2024-03-09T14:40:40.109+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.588 INFO:tasks.workunit.client.0.smithi088.stderr: -347> 2024-03-09T14:40:40.109+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.588 INFO:tasks.workunit.client.0.smithi088.stderr: -346> 2024-03-09T14:40:40.109+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.588 INFO:tasks.workunit.client.0.smithi088.stderr: -345> 2024-03-09T14:40:40.109+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.588 INFO:tasks.workunit.client.0.smithi088.stderr: -344> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): handle_auth_done global_id 6026 payload 824 2024-03-09T14:40:40.588 INFO:tasks.workunit.client.0.smithi088.stderr: -343> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient: _finish_hunting 0 2024-03-09T14:40:40.588 INFO:tasks.workunit.client.0.smithi088.stderr: -342> 2024-03-09T14:40:40.109+0000 7f798c20d640 1 monclient: found mon.noname-c 2024-03-09T14:40:40.588 INFO:tasks.workunit.client.0.smithi088.stderr: -341> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.588 INFO:tasks.workunit.client.0.smithi088.stderr: -340> 2024-03-09T14:40:40.310+0000 7f798c20d640 10 monclient: get_auth_request con 0x55bf750cbc30 auth_method 0 2024-03-09T14:40:40.588 INFO:tasks.workunit.client.0.smithi088.stderr: -339> 2024-03-09T14:40:40.310+0000 7f798c20d640 0 --2- 172.21.15.88:0/1655327022 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55bf750cbc30 0x55bf750b6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-09T14:40:40.588 INFO:tasks.workunit.client.0.smithi088.stderr: -338> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: ms_handle_reset current mon [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:40:40.589 INFO:tasks.workunit.client.0.smithi088.stderr: -337> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: _reopen_session rank -1 2024-03-09T14:40:40.589 INFO:tasks.workunit.client.0.smithi088.stderr: -336> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: _add_conns ranks=[0,2,1] 2024-03-09T14:40:40.589 INFO:tasks.workunit.client.0.smithi088.stderr: -335> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient(hunting): picked mon.noname-a con 0x55bf750b8ea0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:40:40.589 INFO:tasks.workunit.client.0.smithi088.stderr: -334> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f7864004810 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:40:40.589 INFO:tasks.workunit.client.0.smithi088.stderr: -333> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient(hunting): picked mon.noname-b con 0x55bf750b9280 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:40:40.589 INFO:tasks.workunit.client.0.smithi088.stderr: -332> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.589 INFO:tasks.workunit.client.0.smithi088.stderr: -331> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.589 INFO:tasks.workunit.client.0.smithi088.stderr: -330> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.589 INFO:tasks.workunit.client.0.smithi088.stderr: -329> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient(hunting): _renew_subs 2024-03-09T14:40:40.589 INFO:tasks.workunit.client.0.smithi088.stderr: -328> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): get_auth_request con 0x55bf750b8ea0 auth_method 0 2024-03-09T14:40:40.589 INFO:tasks.workunit.client.0.smithi088.stderr: -327> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.589 INFO:tasks.workunit.client.0.smithi088.stderr: -326> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.589 INFO:tasks.workunit.client.0.smithi088.stderr: -325> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-09T14:40:40.589 INFO:tasks.workunit.client.0.smithi088.stderr: -324> 2024-03-09T14:40:40.310+0000 7f798ca0e640 10 monclient(hunting): get_auth_request con 0x7f7864004810 auth_method 0 2024-03-09T14:40:40.590 INFO:tasks.workunit.client.0.smithi088.stderr: -323> 2024-03-09T14:40:40.310+0000 7f798ca0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.590 INFO:tasks.workunit.client.0.smithi088.stderr: -322> 2024-03-09T14:40:40.310+0000 7f798ca0e640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.590 INFO:tasks.workunit.client.0.smithi088.stderr: -321> 2024-03-09T14:40:40.310+0000 7f798ca0e640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-09T14:40:40.590 INFO:tasks.workunit.client.0.smithi088.stderr: -320> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.590 INFO:tasks.workunit.client.0.smithi088.stderr: -319> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.590 INFO:tasks.workunit.client.0.smithi088.stderr: -318> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-09T14:40:40.590 INFO:tasks.workunit.client.0.smithi088.stderr: -317> 2024-03-09T14:40:40.310+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.590 INFO:tasks.workunit.client.0.smithi088.stderr: -316> 2024-03-09T14:40:40.310+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.590 INFO:tasks.workunit.client.0.smithi088.stderr: -315> 2024-03-09T14:40:40.310+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-09T14:40:40.590 INFO:tasks.workunit.client.0.smithi088.stderr: -314> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): handle_auth_done global_id 6026 payload 293 2024-03-09T14:40:40.590 INFO:tasks.workunit.client.0.smithi088.stderr: -313> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient: _finish_hunting 0 2024-03-09T14:40:40.590 INFO:tasks.workunit.client.0.smithi088.stderr: -312> 2024-03-09T14:40:40.310+0000 7f798ba0c640 1 monclient: found mon.noname-a 2024-03-09T14:40:40.590 INFO:tasks.workunit.client.0.smithi088.stderr: -311> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.88:3300/0 2024-03-09T14:40:40.590 INFO:tasks.workunit.client.0.smithi088.stderr: -310> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.591 INFO:tasks.workunit.client.0.smithi088.stderr: -309> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:40:40.591 INFO:tasks.workunit.client.0.smithi088.stderr: -308> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: dump: 2024-03-09T14:40:40.591 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.591 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.591 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.591 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.591 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.591 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.591 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.591 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.591 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.591 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.591 INFO:tasks.workunit.client.0.smithi088.stderr: -307> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: _finish_auth 0 2024-03-09T14:40:40.591 INFO:tasks.workunit.client.0.smithi088.stderr: -306> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: _check_auth_tickets 2024-03-09T14:40:40.592 INFO:tasks.workunit.client.0.smithi088.stderr: -305> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:40.592 INFO:tasks.workunit.client.0.smithi088.stderr: -304> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.592 INFO:tasks.workunit.client.0.smithi088.stderr: -303> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:40:40.592 INFO:tasks.workunit.client.0.smithi088.stderr: -302> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: dump: 2024-03-09T14:40:40.592 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.592 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.592 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.592 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.592 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.592 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.592 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.592 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.592 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.592 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.592 INFO:tasks.workunit.client.0.smithi088.stderr: -301> 2024-03-09T14:40:40.310+0000 7f798e711800 5 monclient: authenticate success, global_id 6026 2024-03-09T14:40:40.593 INFO:tasks.workunit.client.0.smithi088.stderr: -300> 2024-03-09T14:40:40.310+0000 7f798d20f640 4 set_mon_vals no callback set 2024-03-09T14:40:40.593 INFO:tasks.workunit.client.0.smithi088.stderr: -299> 2024-03-09T14:40:40.310+0000 7f798e711800 10 monclient: _renew_subs 2024-03-09T14:40:40.593 INFO:tasks.workunit.client.0.smithi088.stderr: -298> 2024-03-09T14:40:40.310+0000 7f798e711800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:40:40.593 INFO:tasks.workunit.client.0.smithi088.stderr: -297> 2024-03-09T14:40:40.310+0000 7f798e711800 10 monclient: _renew_subs 2024-03-09T14:40:40.593 INFO:tasks.workunit.client.0.smithi088.stderr: -296> 2024-03-09T14:40:40.310+0000 7f798e711800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:40:40.593 INFO:tasks.workunit.client.0.smithi088.stderr: -295> 2024-03-09T14:40:40.312+0000 7f7871ffb640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:40:40.593 INFO:tasks.workunit.client.0.smithi088.stderr: -294> 2024-03-09T14:40:40.312+0000 7f7871ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:40:40.593 INFO:tasks.workunit.client.0.smithi088.stderr: -293> 2024-03-09T14:40:40.312+0000 7f7871ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:40:40.593 INFO:tasks.workunit.client.0.smithi088.stderr: -292> 2024-03-09T14:40:40.312+0000 7f798ca0e640 10 monclient: get_auth_request con 0x55bf750cbc30 auth_method 0 2024-03-09T14:40:40.593 INFO:tasks.workunit.client.0.smithi088.stderr: -291> 2024-03-09T14:40:40.312+0000 7f798e711800 10 monclient: get_monmap_and_config 2024-03-09T14:40:40.593 INFO:tasks.workunit.client.0.smithi088.stderr: -290> 2024-03-09T14:40:40.312+0000 7f798e711800 10 monclient: build_initial_monmap 2024-03-09T14:40:40.593 INFO:tasks.workunit.client.0.smithi088.stderr: -289> 2024-03-09T14:40:40.312+0000 7f798e711800 1 build_initial for_mkfs: 0 2024-03-09T14:40:40.593 INFO:tasks.workunit.client.0.smithi088.stderr: -288> 2024-03-09T14:40:40.312+0000 7f798e711800 10 monclient: monmap: 2024-03-09T14:40:40.593 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:40:40.593 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:40.594 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:40:40.594 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:40:40.594 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:40.594 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.594 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:40:40.594 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:40:40.594 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:40:40.594 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.594 INFO:tasks.workunit.client.0.smithi088.stderr: -287> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding auth protocol: cephx 2024-03-09T14:40:40.594 INFO:tasks.workunit.client.0.smithi088.stderr: -286> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding auth protocol: cephx 2024-03-09T14:40:40.594 INFO:tasks.workunit.client.0.smithi088.stderr: -285> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding auth protocol: cephx 2024-03-09T14:40:40.594 INFO:tasks.workunit.client.0.smithi088.stderr: -284> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.594 INFO:tasks.workunit.client.0.smithi088.stderr: -283> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.594 INFO:tasks.workunit.client.0.smithi088.stderr: -282> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.594 INFO:tasks.workunit.client.0.smithi088.stderr: -281> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.595 INFO:tasks.workunit.client.0.smithi088.stderr: -280> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.595 INFO:tasks.workunit.client.0.smithi088.stderr: -279> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.595 INFO:tasks.workunit.client.0.smithi088.stderr: -278> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.595 INFO:tasks.workunit.client.0.smithi088.stderr: -277> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.595 INFO:tasks.workunit.client.0.smithi088.stderr: -276> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.595 INFO:tasks.workunit.client.0.smithi088.stderr: -275> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.595 INFO:tasks.workunit.client.0.smithi088.stderr: -274> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.595 INFO:tasks.workunit.client.0.smithi088.stderr: -273> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.595 INFO:tasks.workunit.client.0.smithi088.stderr: -272> 2024-03-09T14:40:40.312+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.595 INFO:tasks.workunit.client.0.smithi088.stderr: -271> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient: init 2024-03-09T14:40:40.595 INFO:tasks.workunit.client.0.smithi088.stderr: -270> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding auth protocol: cephx 2024-03-09T14:40:40.595 INFO:tasks.workunit.client.0.smithi088.stderr: -269> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding auth protocol: cephx 2024-03-09T14:40:40.595 INFO:tasks.workunit.client.0.smithi088.stderr: -268> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding auth protocol: cephx 2024-03-09T14:40:40.595 INFO:tasks.workunit.client.0.smithi088.stderr: -267> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: secure 2024-03-09T14:40:40.595 INFO:tasks.workunit.client.0.smithi088.stderr: -266> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: crc 2024-03-09T14:40:40.596 INFO:tasks.workunit.client.0.smithi088.stderr: -265> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: secure 2024-03-09T14:40:40.596 INFO:tasks.workunit.client.0.smithi088.stderr: -264> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: crc 2024-03-09T14:40:40.596 INFO:tasks.workunit.client.0.smithi088.stderr: -263> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: secure 2024-03-09T14:40:40.596 INFO:tasks.workunit.client.0.smithi088.stderr: -262> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: crc 2024-03-09T14:40:40.596 INFO:tasks.workunit.client.0.smithi088.stderr: -261> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: crc 2024-03-09T14:40:40.596 INFO:tasks.workunit.client.0.smithi088.stderr: -260> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: secure 2024-03-09T14:40:40.596 INFO:tasks.workunit.client.0.smithi088.stderr: -259> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: crc 2024-03-09T14:40:40.596 INFO:tasks.workunit.client.0.smithi088.stderr: -258> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: secure 2024-03-09T14:40:40.596 INFO:tasks.workunit.client.0.smithi088.stderr: -257> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: crc 2024-03-09T14:40:40.596 INFO:tasks.workunit.client.0.smithi088.stderr: -256> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: secure 2024-03-09T14:40:40.596 INFO:tasks.workunit.client.0.smithi088.stderr: -255> 2024-03-09T14:40:40.313+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.596 INFO:tasks.workunit.client.0.smithi088.stderr: -254> 2024-03-09T14:40:40.313+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.596 INFO:tasks.workunit.client.0.smithi088.stderr: -253> 2024-03-09T14:40:40.313+0000 7f798e711800 5 asok(0x55bf74e18780) register_command rotate-key cmddesc rotate-key hook 0x7fff28e05228 EEXIST 2024-03-09T14:40:40.596 INFO:tasks.workunit.client.0.smithi088.stderr: -252> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:40.597 INFO:tasks.workunit.client.0.smithi088.stderr: -251> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:40:40.597 INFO:tasks.workunit.client.0.smithi088.stderr: -250> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): picked mon.noname-a con 0x55bf75104190 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:40:40.597 INFO:tasks.workunit.client.0.smithi088.stderr: -249> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): picked mon.noname-b con 0x55bf75104570 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:40:40.597 INFO:tasks.workunit.client.0.smithi088.stderr: -248> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): picked mon.noname-c con 0x55bf75100040 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:40:40.597 INFO:tasks.workunit.client.0.smithi088.stderr: -247> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.597 INFO:tasks.workunit.client.0.smithi088.stderr: -246> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.597 INFO:tasks.workunit.client.0.smithi088.stderr: -245> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.597 INFO:tasks.workunit.client.0.smithi088.stderr: -244> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:40.597 INFO:tasks.workunit.client.0.smithi088.stderr: -243> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): authenticate will time out at 1655.651871s 2024-03-09T14:40:40.597 INFO:tasks.workunit.client.0.smithi088.stderr: -242> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): get_auth_request con 0x55bf75104190 auth_method 0 2024-03-09T14:40:40.597 INFO:tasks.workunit.client.0.smithi088.stderr: -241> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.597 INFO:tasks.workunit.client.0.smithi088.stderr: -240> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.597 INFO:tasks.workunit.client.0.smithi088.stderr: -239> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.597 INFO:tasks.workunit.client.0.smithi088.stderr: -238> 2024-03-09T14:40:40.313+0000 7f798c20d640 10 monclient(hunting): get_auth_request con 0x55bf75100040 auth_method 0 2024-03-09T14:40:40.598 INFO:tasks.workunit.client.0.smithi088.stderr: -237> 2024-03-09T14:40:40.313+0000 7f798c20d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.598 INFO:tasks.workunit.client.0.smithi088.stderr: -236> 2024-03-09T14:40:40.313+0000 7f798c20d640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.598 INFO:tasks.workunit.client.0.smithi088.stderr: -235> 2024-03-09T14:40:40.313+0000 7f798c20d640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.598 INFO:tasks.workunit.client.0.smithi088.stderr: -234> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.598 INFO:tasks.workunit.client.0.smithi088.stderr: -233> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.598 INFO:tasks.workunit.client.0.smithi088.stderr: -232> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.598 INFO:tasks.workunit.client.0.smithi088.stderr: -231> 2024-03-09T14:40:40.313+0000 7f798ca0e640 10 monclient(hunting): get_auth_request con 0x55bf75104570 auth_method 0 2024-03-09T14:40:40.598 INFO:tasks.workunit.client.0.smithi088.stderr: -230> 2024-03-09T14:40:40.313+0000 7f798ca0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.598 INFO:tasks.workunit.client.0.smithi088.stderr: -229> 2024-03-09T14:40:40.313+0000 7f798ca0e640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.598 INFO:tasks.workunit.client.0.smithi088.stderr: -228> 2024-03-09T14:40:40.313+0000 7f798ca0e640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.598 INFO:tasks.workunit.client.0.smithi088.stderr: -227> 2024-03-09T14:40:40.313+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.598 INFO:tasks.workunit.client.0.smithi088.stderr: -226> 2024-03-09T14:40:40.313+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.598 INFO:tasks.workunit.client.0.smithi088.stderr: -225> 2024-03-09T14:40:40.313+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.598 INFO:tasks.workunit.client.0.smithi088.stderr: -224> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): handle_auth_done global_id 6285 payload 274 2024-03-09T14:40:40.599 INFO:tasks.workunit.client.0.smithi088.stderr: -223> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient: _finish_hunting 0 2024-03-09T14:40:40.599 INFO:tasks.workunit.client.0.smithi088.stderr: -222> 2024-03-09T14:40:40.313+0000 7f798ba0c640 1 monclient: found mon.noname-a 2024-03-09T14:40:40.599 INFO:tasks.workunit.client.0.smithi088.stderr: -221> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.88:3300/0 2024-03-09T14:40:40.599 INFO:tasks.workunit.client.0.smithi088.stderr: -220> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.599 INFO:tasks.workunit.client.0.smithi088.stderr: -219> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:40:40.599 INFO:tasks.workunit.client.0.smithi088.stderr: -218> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: dump: 2024-03-09T14:40:40.599 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.599 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.599 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.599 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.599 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.599 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.599 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.599 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.599 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.600 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.600 INFO:tasks.workunit.client.0.smithi088.stderr: -217> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: _finish_auth 0 2024-03-09T14:40:40.600 INFO:tasks.workunit.client.0.smithi088.stderr: -216> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: _check_auth_tickets 2024-03-09T14:40:40.600 INFO:tasks.workunit.client.0.smithi088.stderr: -215> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:40.600 INFO:tasks.workunit.client.0.smithi088.stderr: -214> 2024-03-09T14:40:40.314+0000 7f798e711800 5 monclient: authenticate success, global_id 6285 2024-03-09T14:40:40.600 INFO:tasks.workunit.client.0.smithi088.stderr: -213> 2024-03-09T14:40:40.314+0000 7f798e711800 10 monclient: get_monmap_and_config success 2024-03-09T14:40:40.600 INFO:tasks.workunit.client.0.smithi088.stderr: -212> 2024-03-09T14:40:40.314+0000 7f798e711800 4 set_mon_vals no callback set 2024-03-09T14:40:40.600 INFO:tasks.workunit.client.0.smithi088.stderr: -211> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.600 INFO:tasks.workunit.client.0.smithi088.stderr: -210> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:40:40.600 INFO:tasks.workunit.client.0.smithi088.stderr: -209> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: dump: 2024-03-09T14:40:40.600 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.600 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.600 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.600 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.600 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.601 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.601 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.601 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.601 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.601 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.601 INFO:tasks.workunit.client.0.smithi088.stderr: -208> 2024-03-09T14:40:40.314+0000 7f798e711800 10 monclient: shutdown 2024-03-09T14:40:40.601 INFO:tasks.workunit.client.0.smithi088.stderr: -207> 2024-03-09T14:40:40.314+0000 7f798e711800 10 monclient: build_initial_monmap 2024-03-09T14:40:40.601 INFO:tasks.workunit.client.0.smithi088.stderr: -206> 2024-03-09T14:40:40.314+0000 7f798e711800 1 build_initial for_mkfs: 0 2024-03-09T14:40:40.601 INFO:tasks.workunit.client.0.smithi088.stderr: -205> 2024-03-09T14:40:40.314+0000 7f798e711800 10 monclient: monmap: 2024-03-09T14:40:40.601 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:40:40.601 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:40.601 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:40:40.601 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:40:40.601 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:40.601 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.602 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:40:40.602 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:40:40.602 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:40:40.602 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.602 INFO:tasks.workunit.client.0.smithi088.stderr: -204> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding auth protocol: cephx 2024-03-09T14:40:40.602 INFO:tasks.workunit.client.0.smithi088.stderr: -203> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding auth protocol: cephx 2024-03-09T14:40:40.602 INFO:tasks.workunit.client.0.smithi088.stderr: -202> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding auth protocol: cephx 2024-03-09T14:40:40.602 INFO:tasks.workunit.client.0.smithi088.stderr: -201> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.602 INFO:tasks.workunit.client.0.smithi088.stderr: -200> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.602 INFO:tasks.workunit.client.0.smithi088.stderr: -199> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.602 INFO:tasks.workunit.client.0.smithi088.stderr: -198> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.602 INFO:tasks.workunit.client.0.smithi088.stderr: -197> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.602 INFO:tasks.workunit.client.0.smithi088.stderr: -196> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.602 INFO:tasks.workunit.client.0.smithi088.stderr: -195> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.603 INFO:tasks.workunit.client.0.smithi088.stderr: -194> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.603 INFO:tasks.workunit.client.0.smithi088.stderr: -193> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.603 INFO:tasks.workunit.client.0.smithi088.stderr: -192> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.603 INFO:tasks.workunit.client.0.smithi088.stderr: -191> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.603 INFO:tasks.workunit.client.0.smithi088.stderr: -190> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.603 INFO:tasks.workunit.client.0.smithi088.stderr: -189> 2024-03-09T14:40:40.315+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.603 INFO:tasks.workunit.client.0.smithi088.stderr: -188> 2024-03-09T14:40:40.315+0000 7f798e711800 1 librados: starting msgr at 2024-03-09T14:40:40.603 INFO:tasks.workunit.client.0.smithi088.stderr: -187> 2024-03-09T14:40:40.315+0000 7f798e711800 1 librados: starting objecter 2024-03-09T14:40:40.603 INFO:tasks.workunit.client.0.smithi088.stderr: -186> 2024-03-09T14:40:40.315+0000 7f798e711800 5 asok(0x55bf74e18780) register_command objecter_requests cmddesc objecter_requests hook 0x55bf750bb5b0 EEXIST 2024-03-09T14:40:40.603 INFO:tasks.workunit.client.0.smithi088.stderr: -185> 2024-03-09T14:40:40.315+0000 7f798e711800 1 librados: setting wanted keys 2024-03-09T14:40:40.603 INFO:tasks.workunit.client.0.smithi088.stderr: -184> 2024-03-09T14:40:40.315+0000 7f798e711800 1 librados: calling monclient init 2024-03-09T14:40:40.603 INFO:tasks.workunit.client.0.smithi088.stderr: -183> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient: init 2024-03-09T14:40:40.603 INFO:tasks.workunit.client.0.smithi088.stderr: -182> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding auth protocol: cephx 2024-03-09T14:40:40.603 INFO:tasks.workunit.client.0.smithi088.stderr: -181> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding auth protocol: cephx 2024-03-09T14:40:40.603 INFO:tasks.workunit.client.0.smithi088.stderr: -180> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding auth protocol: cephx 2024-03-09T14:40:40.604 INFO:tasks.workunit.client.0.smithi088.stderr: -179> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: secure 2024-03-09T14:40:40.604 INFO:tasks.workunit.client.0.smithi088.stderr: -178> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: crc 2024-03-09T14:40:40.604 INFO:tasks.workunit.client.0.smithi088.stderr: -177> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: secure 2024-03-09T14:40:40.604 INFO:tasks.workunit.client.0.smithi088.stderr: -176> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: crc 2024-03-09T14:40:40.604 INFO:tasks.workunit.client.0.smithi088.stderr: -175> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: secure 2024-03-09T14:40:40.604 INFO:tasks.workunit.client.0.smithi088.stderr: -174> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: crc 2024-03-09T14:40:40.604 INFO:tasks.workunit.client.0.smithi088.stderr: -173> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: crc 2024-03-09T14:40:40.604 INFO:tasks.workunit.client.0.smithi088.stderr: -172> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: secure 2024-03-09T14:40:40.604 INFO:tasks.workunit.client.0.smithi088.stderr: -171> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: crc 2024-03-09T14:40:40.604 INFO:tasks.workunit.client.0.smithi088.stderr: -170> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: secure 2024-03-09T14:40:40.604 INFO:tasks.workunit.client.0.smithi088.stderr: -169> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: crc 2024-03-09T14:40:40.604 INFO:tasks.workunit.client.0.smithi088.stderr: -168> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: secure 2024-03-09T14:40:40.604 INFO:tasks.workunit.client.0.smithi088.stderr: -167> 2024-03-09T14:40:40.315+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.605 INFO:tasks.workunit.client.0.smithi088.stderr: -166> 2024-03-09T14:40:40.315+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.605 INFO:tasks.workunit.client.0.smithi088.stderr: -165> 2024-03-09T14:40:40.315+0000 7f798e711800 5 asok(0x55bf74e18780) register_command rotate-key cmddesc rotate-key hook 0x55bf750ce988 EEXIST 2024-03-09T14:40:40.605 INFO:tasks.workunit.client.0.smithi088.stderr: -164> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:40.605 INFO:tasks.workunit.client.0.smithi088.stderr: -163> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:40:40.605 INFO:tasks.workunit.client.0.smithi088.stderr: -162> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): picked mon.noname-b con 0x55bf75100040 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:40:40.605 INFO:tasks.workunit.client.0.smithi088.stderr: -161> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): picked mon.noname-a con 0x55bf75104190 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:40:40.605 INFO:tasks.workunit.client.0.smithi088.stderr: -160> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): picked mon.noname-c con 0x55bf751116c0 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:40:40.605 INFO:tasks.workunit.client.0.smithi088.stderr: -159> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.605 INFO:tasks.workunit.client.0.smithi088.stderr: -158> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.605 INFO:tasks.workunit.client.0.smithi088.stderr: -157> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.605 INFO:tasks.workunit.client.0.smithi088.stderr: -156> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:40.605 INFO:tasks.workunit.client.0.smithi088.stderr: -155> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): authenticate will time out at 1655.654157s 2024-03-09T14:40:40.605 INFO:tasks.workunit.client.0.smithi088.stderr: -154> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): get_auth_request con 0x55bf751116c0 auth_method 0 2024-03-09T14:40:40.605 INFO:tasks.workunit.client.0.smithi088.stderr: -153> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.605 INFO:tasks.workunit.client.0.smithi088.stderr: -152> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.606 INFO:tasks.workunit.client.0.smithi088.stderr: -151> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.606 INFO:tasks.workunit.client.0.smithi088.stderr: -150> 2024-03-09T14:40:40.316+0000 7f798ca0e640 10 monclient(hunting): get_auth_request con 0x55bf75104190 auth_method 0 2024-03-09T14:40:40.606 INFO:tasks.workunit.client.0.smithi088.stderr: -149> 2024-03-09T14:40:40.316+0000 7f798ca0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.606 INFO:tasks.workunit.client.0.smithi088.stderr: -148> 2024-03-09T14:40:40.316+0000 7f798ca0e640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.606 INFO:tasks.workunit.client.0.smithi088.stderr: -147> 2024-03-09T14:40:40.316+0000 7f798ca0e640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.606 INFO:tasks.workunit.client.0.smithi088.stderr: -146> 2024-03-09T14:40:40.316+0000 7f798ba0c640 10 monclient(hunting): get_auth_request con 0x55bf75100040 auth_method 0 2024-03-09T14:40:40.606 INFO:tasks.workunit.client.0.smithi088.stderr: -145> 2024-03-09T14:40:40.316+0000 7f798ba0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.606 INFO:tasks.workunit.client.0.smithi088.stderr: -144> 2024-03-09T14:40:40.316+0000 7f798ba0c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.606 INFO:tasks.workunit.client.0.smithi088.stderr: -143> 2024-03-09T14:40:40.316+0000 7f798ba0c640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.606 INFO:tasks.workunit.client.0.smithi088.stderr: -142> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.606 INFO:tasks.workunit.client.0.smithi088.stderr: -141> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.606 INFO:tasks.workunit.client.0.smithi088.stderr: -140> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.606 INFO:tasks.workunit.client.0.smithi088.stderr: -139> 2024-03-09T14:40:40.316+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.606 INFO:tasks.workunit.client.0.smithi088.stderr: -138> 2024-03-09T14:40:40.316+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.607 INFO:tasks.workunit.client.0.smithi088.stderr: -137> 2024-03-09T14:40:40.316+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.607 INFO:tasks.workunit.client.0.smithi088.stderr: -136> 2024-03-09T14:40:40.316+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.607 INFO:tasks.workunit.client.0.smithi088.stderr: -135> 2024-03-09T14:40:40.316+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.607 INFO:tasks.workunit.client.0.smithi088.stderr: -134> 2024-03-09T14:40:40.316+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.607 INFO:tasks.workunit.client.0.smithi088.stderr: -133> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): handle_auth_done global_id 6032 payload 824 2024-03-09T14:40:40.607 INFO:tasks.workunit.client.0.smithi088.stderr: -132> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient: _finish_hunting 0 2024-03-09T14:40:40.607 INFO:tasks.workunit.client.0.smithi088.stderr: -131> 2024-03-09T14:40:40.316+0000 7f798c20d640 1 monclient: found mon.noname-c 2024-03-09T14:40:40.607 INFO:tasks.workunit.client.0.smithi088.stderr: -130> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.607 INFO:tasks.workunit.client.0.smithi088.stderr: -129> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.607 INFO:tasks.workunit.client.0.smithi088.stderr: -128> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:40.607 INFO:tasks.workunit.client.0.smithi088.stderr: -127> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: dump: 2024-03-09T14:40:40.607 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.607 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.607 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.607 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.608 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.608 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.608 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.608 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.608 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.608 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.608 INFO:tasks.workunit.client.0.smithi088.stderr: -126> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: _finish_auth 0 2024-03-09T14:40:40.608 INFO:tasks.workunit.client.0.smithi088.stderr: -125> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: _check_auth_tickets 2024-03-09T14:40:40.608 INFO:tasks.workunit.client.0.smithi088.stderr: -124> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:40.608 INFO:tasks.workunit.client.0.smithi088.stderr: -123> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.608 INFO:tasks.workunit.client.0.smithi088.stderr: -122> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:40.608 INFO:tasks.workunit.client.0.smithi088.stderr: -121> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: dump: 2024-03-09T14:40:40.608 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.608 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.608 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.609 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.609 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.609 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.609 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.609 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.609 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.609 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.609 INFO:tasks.workunit.client.0.smithi088.stderr: -120> 2024-03-09T14:40:40.316+0000 7f798e711800 5 monclient: authenticate success, global_id 6032 2024-03-09T14:40:40.609 INFO:tasks.workunit.client.0.smithi088.stderr: -119> 2024-03-09T14:40:40.316+0000 7f78637fe640 4 set_mon_vals no callback set 2024-03-09T14:40:40.609 INFO:tasks.workunit.client.0.smithi088.stderr: -118> 2024-03-09T14:40:40.316+0000 7f798e711800 10 monclient: _renew_subs 2024-03-09T14:40:40.609 INFO:tasks.workunit.client.0.smithi088.stderr: -117> 2024-03-09T14:40:40.316+0000 7f798e711800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.609 INFO:tasks.workunit.client.0.smithi088.stderr: -116> 2024-03-09T14:40:40.316+0000 7f798e711800 10 monclient: _renew_subs 2024-03-09T14:40:40.609 INFO:tasks.workunit.client.0.smithi088.stderr: -115> 2024-03-09T14:40:40.316+0000 7f798e711800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.609 INFO:tasks.workunit.client.0.smithi088.stderr: -114> 2024-03-09T14:40:40.316+0000 7f798e711800 1 librados: init done 2024-03-09T14:40:40.609 INFO:tasks.workunit.client.0.smithi088.stderr: -113> 2024-03-09T14:40:40.316+0000 7f798e711800 5 asok(0x55bf74e18780) register_command cr dump hook 0x55bf75105028 2024-03-09T14:40:40.610 INFO:tasks.workunit.client.0.smithi088.stderr: -112> 2024-03-09T14:40:40.317+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.610 INFO:tasks.workunit.client.0.smithi088.stderr: -111> 2024-03-09T14:40:40.318+0000 7f7861ffb640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:40:40.610 INFO:tasks.workunit.client.0.smithi088.stderr: -110> 2024-03-09T14:40:40.318+0000 7f7861ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:40:40.610 INFO:tasks.workunit.client.0.smithi088.stderr: -109> 2024-03-09T14:40:40.318+0000 7f7861ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:40:40.610 INFO:tasks.workunit.client.0.smithi088.stderr: -108> 2024-03-09T14:40:40.318+0000 7f798ca0e640 10 monclient: get_auth_request con 0x55bf7511e6d0 auth_method 0 2024-03-09T14:40:40.610 INFO:tasks.workunit.client.0.smithi088.stderr: -107> 2024-03-09T14:40:40.318+0000 7f798ba0c640 10 monclient: get_auth_request con 0x7f785406a670 auth_method 0 2024-03-09T14:40:40.610 INFO:tasks.workunit.client.0.smithi088.stderr: -106> 2024-03-09T14:40:40.319+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.610 INFO:tasks.workunit.client.0.smithi088.stderr: -105> 2024-03-09T14:40:40.319+0000 7f798e711800 20 realm 2024-03-09T14:40:40.610 INFO:tasks.workunit.client.0.smithi088.stderr: -104> 2024-03-09T14:40:40.319+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.610 INFO:tasks.workunit.client.0.smithi088.stderr: -103> 2024-03-09T14:40:40.319+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.610 INFO:tasks.workunit.client.0.smithi088.stderr: -102> 2024-03-09T14:40:40.319+0000 7f798e711800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:40.610 INFO:tasks.workunit.client.0.smithi088.stderr: -101> 2024-03-09T14:40:40.319+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.610 INFO:tasks.workunit.client.0.smithi088.stderr: -100> 2024-03-09T14:40:40.319+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.610 INFO:tasks.workunit.client.0.smithi088.stderr: -99> 2024-03-09T14:40:40.319+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.611 INFO:tasks.workunit.client.0.smithi088.stderr: -98> 2024-03-09T14:40:40.319+0000 7f798ba0c640 10 monclient: get_auth_request con 0x55bf751228e0 auth_method 0 2024-03-09T14:40:40.611 INFO:tasks.workunit.client.0.smithi088.stderr: -97> 2024-03-09T14:40:40.320+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:40.611 INFO:tasks.workunit.client.0.smithi088.stderr: -96> 2024-03-09T14:40:40.320+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.611 INFO:tasks.workunit.client.0.smithi088.stderr: -95> 2024-03-09T14:40:40.320+0000 7f798ca0e640 10 monclient: get_auth_request con 0x55bf75126120 auth_method 0 2024-03-09T14:40:40.611 INFO:tasks.workunit.client.0.smithi088.stderr: -94> 2024-03-09T14:40:40.321+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:40.611 INFO:tasks.workunit.client.0.smithi088.stderr: -93> 2024-03-09T14:40:40.321+0000 7f798e711800 20 searching for the correct realm 2024-03-09T14:40:40.611 INFO:tasks.workunit.client.0.smithi088.stderr: -92> 2024-03-09T14:40:40.321+0000 7f798c20d640 10 monclient: get_auth_request con 0x55bf7512aaa0 auth_method 0 2024-03-09T14:40:40.611 INFO:tasks.workunit.client.0.smithi088.stderr: -91> 2024-03-09T14:40:40.321+0000 7f798ba0c640 0 -- 172.21.15.88:0/2314801468 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f797c0666a0 msgr2=0x7f797c009b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:40.611 INFO:tasks.workunit.client.0.smithi088.stderr: -90> 2024-03-09T14:40:40.522+0000 7f798ba0c640 10 monclient: get_auth_request con 0x7f797c0666a0 auth_method 0 2024-03-09T14:40:40.611 INFO:tasks.workunit.client.0.smithi088.stderr: -89> 2024-03-09T14:40:40.523+0000 7f798ca0e640 10 monclient: get_auth_request con 0x7f7984031040 auth_method 0 2024-03-09T14:40:40.611 INFO:tasks.workunit.client.0.smithi088.stderr: -88> 2024-03-09T14:40:40.526+0000 7f798c20d640 10 monclient: get_auth_request con 0x7f798400e040 auth_method 0 2024-03-09T14:40:40.611 INFO:tasks.workunit.client.0.smithi088.stderr: -87> 2024-03-09T14:40:40.527+0000 7f798ca0e640 0 -- 172.21.15.88:0/2314801468 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x55bf75126120 msgr2=0x55bf75128530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:40.611 INFO:tasks.workunit.client.0.smithi088.stderr: -86> 2024-03-09T14:40:40.527+0000 7f7861ffb640 1 client.6032.objecter ms_handle_reset 0x55bf75126120 session 0x55bf75121c70 osd.2 2024-03-09T14:40:40.611 INFO:tasks.workunit.client.0.smithi088.stderr: -85> 2024-03-09T14:40:40.527+0000 7f7861ffb640 10 monclient: _renew_subs 2024-03-09T14:40:40.611 INFO:tasks.workunit.client.0.smithi088.stderr: -84> 2024-03-09T14:40:40.527+0000 7f7861ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.612 INFO:tasks.workunit.client.0.smithi088.stderr: -83> 2024-03-09T14:40:40.527+0000 7f798ca0e640 10 monclient: get_auth_request con 0x7f785407ada0 auth_method 0 2024-03-09T14:40:40.612 INFO:tasks.workunit.client.0.smithi088.stderr: -82> 2024-03-09T14:40:40.528+0000 7f798ba0c640 10 monclient: get_auth_request con 0x7f79840456b0 auth_method 0 2024-03-09T14:40:40.612 INFO:tasks.workunit.client.0.smithi088.stderr: -81> 2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:40.612 INFO:tasks.workunit.client.0.smithi088.stderr: -80> 2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:40.612 INFO:tasks.workunit.client.0.smithi088.stderr: -79> 2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:40.612 INFO:tasks.workunit.client.0.smithi088.stderr: -78> 2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:40.612 INFO:tasks.workunit.client.0.smithi088.stderr: -77> 2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:40.612 INFO:tasks.workunit.client.0.smithi088.stderr: -76> 2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:40.612 INFO:tasks.workunit.client.0.smithi088.stderr: -75> 2024-03-09T14:40:40.533+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.612 INFO:tasks.workunit.client.0.smithi088.stderr: -74> 2024-03-09T14:40:40.533+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.612 INFO:tasks.workunit.client.0.smithi088.stderr: -73> 2024-03-09T14:40:40.533+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.612 INFO:tasks.workunit.client.0.smithi088.stderr: -72> 2024-03-09T14:40:40.533+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:40.612 INFO:tasks.workunit.client.0.smithi088.stderr: -71> 2024-03-09T14:40:40.533+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.612 INFO:tasks.workunit.client.0.smithi088.stderr: -70> 2024-03-09T14:40:40.534+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:40.612 INFO:tasks.workunit.client.0.smithi088.stderr: -69> 2024-03-09T14:40:40.534+0000 7f798e711800 20 zone default found 2024-03-09T14:40:40.613 INFO:tasks.workunit.client.0.smithi088.stderr: -68> 2024-03-09T14:40:40.534+0000 7f798e711800 4 Realm: () 2024-03-09T14:40:40.613 INFO:tasks.workunit.client.0.smithi088.stderr: -67> 2024-03-09T14:40:40.534+0000 7f798e711800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:40.613 INFO:tasks.workunit.client.0.smithi088.stderr: -66> 2024-03-09T14:40:40.534+0000 7f798e711800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:40.613 INFO:tasks.workunit.client.0.smithi088.stderr: -65> 2024-03-09T14:40:40.534+0000 7f798e711800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:40.613 INFO:tasks.workunit.client.0.smithi088.stderr: -64> 2024-03-09T14:40:40.534+0000 7f798e711800 20 zonegroup default 2024-03-09T14:40:40.613 INFO:tasks.workunit.client.0.smithi088.stderr: -63> 2024-03-09T14:40:40.534+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.613 INFO:tasks.workunit.client.0.smithi088.stderr: -62> 2024-03-09T14:40:40.534+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.613 INFO:tasks.workunit.client.0.smithi088.stderr: -61> 2024-03-09T14:40:40.534+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.613 INFO:tasks.workunit.client.0.smithi088.stderr: -60> 2024-03-09T14:40:40.534+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.613 INFO:tasks.workunit.client.0.smithi088.stderr: -59> 2024-03-09T14:40:40.534+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.613 INFO:tasks.workunit.client.0.smithi088.stderr: -58> 2024-03-09T14:40:40.535+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.613 INFO:tasks.workunit.client.0.smithi088.stderr: -57> 2024-03-09T14:40:40.535+0000 7f798e711800 20 started sync module instance, tier type = 2024-03-09T14:40:40.613 INFO:tasks.workunit.client.0.smithi088.stderr: -56> 2024-03-09T14:40:40.535+0000 7f798e711800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:40.613 INFO:tasks.workunit.client.0.smithi088.stderr: -55> 2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=0 2024-03-09T14:40:40.613 INFO:tasks.workunit.client.0.smithi088.stderr: -54> 2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=1 2024-03-09T14:40:40.614 INFO:tasks.workunit.client.0.smithi088.stderr: -53> 2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=2 2024-03-09T14:40:40.614 INFO:tasks.workunit.client.0.smithi088.stderr: -52> 2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=3 2024-03-09T14:40:40.614 INFO:tasks.workunit.client.0.smithi088.stderr: -51> 2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=4 2024-03-09T14:40:40.614 INFO:tasks.workunit.client.0.smithi088.stderr: -50> 2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=5 2024-03-09T14:40:40.614 INFO:tasks.workunit.client.0.smithi088.stderr: -49> 2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=6 2024-03-09T14:40:40.614 INFO:tasks.workunit.client.0.smithi088.stderr: -48> 2024-03-09T14:40:40.544+0000 7f798e711800 20 add_watcher() i=7 2024-03-09T14:40:40.614 INFO:tasks.workunit.client.0.smithi088.stderr: -47> 2024-03-09T14:40:40.544+0000 7f798e711800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:40.614 INFO:tasks.workunit.client.0.smithi088.stderr: -46> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding auth protocol: cephx 2024-03-09T14:40:40.614 INFO:tasks.workunit.client.0.smithi088.stderr: -45> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding auth protocol: cephx 2024-03-09T14:40:40.614 INFO:tasks.workunit.client.0.smithi088.stderr: -44> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding auth protocol: cephx 2024-03-09T14:40:40.614 INFO:tasks.workunit.client.0.smithi088.stderr: -43> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: secure 2024-03-09T14:40:40.614 INFO:tasks.workunit.client.0.smithi088.stderr: -42> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: crc 2024-03-09T14:40:40.614 INFO:tasks.workunit.client.0.smithi088.stderr: -41> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: secure 2024-03-09T14:40:40.614 INFO:tasks.workunit.client.0.smithi088.stderr: -40> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: crc 2024-03-09T14:40:40.614 INFO:tasks.workunit.client.0.smithi088.stderr: -39> 2024-03-09T14:40:40.546+0000 7f7842fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:40.615 INFO:tasks.workunit.client.0.smithi088.stderr: -38> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: secure 2024-03-09T14:40:40.615 INFO:tasks.workunit.client.0.smithi088.stderr: -37> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: crc 2024-03-09T14:40:40.615 INFO:tasks.workunit.client.0.smithi088.stderr: -36> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: crc 2024-03-09T14:40:40.615 INFO:tasks.workunit.client.0.smithi088.stderr: -35> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: secure 2024-03-09T14:40:40.615 INFO:tasks.workunit.client.0.smithi088.stderr: -34> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: crc 2024-03-09T14:40:40.615 INFO:tasks.workunit.client.0.smithi088.stderr: -33> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: secure 2024-03-09T14:40:40.615 INFO:tasks.workunit.client.0.smithi088.stderr: -32> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: crc 2024-03-09T14:40:40.615 INFO:tasks.workunit.client.0.smithi088.stderr: -31> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: secure 2024-03-09T14:40:40.615 INFO:tasks.workunit.client.0.smithi088.stderr: -30> 2024-03-09T14:40:40.546+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.615 INFO:tasks.workunit.client.0.smithi088.stderr: -29> 2024-03-09T14:40:40.546+0000 7f798e711800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:40.615 INFO:tasks.workunit.client.0.smithi088.stderr: -28> 2024-03-09T14:40:40.546+0000 7f798e711800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:40.615 INFO:tasks.workunit.client.0.smithi088.stderr: -27> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command cache list hook 0x55bf750ff820 2024-03-09T14:40:40.615 INFO:tasks.workunit.client.0.smithi088.stderr: -26> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command cache inspect hook 0x55bf750ff820 2024-03-09T14:40:40.615 INFO:tasks.workunit.client.0.smithi088.stderr: -25> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command cache erase hook 0x55bf750ff820 2024-03-09T14:40:40.616 INFO:tasks.workunit.client.0.smithi088.stderr: -24> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command cache zap hook 0x55bf750ff820 2024-03-09T14:40:40.616 INFO:tasks.workunit.client.0.smithi088.stderr: -23> 2024-03-09T14:40:40.546+0000 7f798e711800 5 note: GC not initialized 2024-03-09T14:40:40.616 INFO:tasks.workunit.client.0.smithi088.stderr: -22> 2024-03-09T14:40:40.546+0000 7f7841fdb640 20 reqs_thread_entry: start 2024-03-09T14:40:40.616 INFO:tasks.workunit.client.0.smithi088.stderr: -21> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command sync trace show hook 0x7f797c05b040 2024-03-09T14:40:40.616 INFO:tasks.workunit.client.0.smithi088.stderr: -20> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command sync trace history hook 0x7f797c05b040 2024-03-09T14:40:40.616 INFO:tasks.workunit.client.0.smithi088.stderr: -19> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command sync trace active hook 0x7f797c05b040 2024-03-09T14:40:40.616 INFO:tasks.workunit.client.0.smithi088.stderr: -18> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command sync trace active_short hook 0x7f797c05b040 2024-03-09T14:40:40.616 INFO:tasks.workunit.client.0.smithi088.stderr: -17> 2024-03-09T14:40:40.546+0000 7f798e711800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:40.616 INFO:tasks.workunit.client.0.smithi088.stderr: -16> 2024-03-09T14:40:40.547+0000 7f798e711800 20 Filter name: none 2024-03-09T14:40:40.616 INFO:tasks.workunit.client.0.smithi088.stderr: -15> 2024-03-09T14:40:40.547+0000 7f77b37fe640 20 reqs_thread_entry: start 2024-03-09T14:40:40.616 INFO:tasks.workunit.client.0.smithi088.stderr: -14> 2024-03-09T14:40:40.547+0000 7f798e711800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-09T14:40:40.616 INFO:tasks.workunit.client.0.smithi088.stderr: -13> 2024-03-09T14:40:40.547+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.616 INFO:tasks.workunit.client.0.smithi088.stderr: -12> 2024-03-09T14:40:40.547+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:40.616 INFO:tasks.workunit.client.0.smithi088.stderr: -11> 2024-03-09T14:40:40.547+0000 7f798e711800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-09T14:40:40.616 INFO:tasks.workunit.client.0.smithi088.stderr: -10> 2024-03-09T14:40:40.547+0000 7f798e711800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-09T14:40:40.617 INFO:tasks.workunit.client.0.smithi088.stderr: -9> 2024-03-09T14:40:40.547+0000 7f798e711800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 : miss 2024-03-09T14:40:40.617 INFO:tasks.workunit.client.0.smithi088.stderr: -8> 2024-03-09T14:40:40.547+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.617 INFO:tasks.workunit.client.0.smithi088.stderr: -7> 2024-03-09T14:40:40.548+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:40.617 INFO:tasks.workunit.client.0.smithi088.stderr: -6> 2024-03-09T14:40:40.548+0000 7f798e711800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 info.flags=0x17 2024-03-09T14:40:40.617 INFO:tasks.workunit.client.0.smithi088.stderr: -5> 2024-03-09T14:40:40.548+0000 7f798e711800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 to cache LRU end 2024-03-09T14:40:40.617 INFO:tasks.workunit.client.0.smithi088.stderr: -4> 2024-03-09T14:40:40.548+0000 7f798e711800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:40.617 INFO:tasks.workunit.client.0.smithi088.stderr: -3> 2024-03-09T14:40:40.548+0000 7f798e711800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:40.617 INFO:tasks.workunit.client.0.smithi088.stderr: -2> 2024-03-09T14:40:40.548+0000 7f798e711800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 2024-03-09T14:40:40.617 INFO:tasks.workunit.client.0.smithi088.stderr: -1> 2024-03-09T14:40:40.552+0000 7f798e711800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f798e711800 time 2024-03-09T14:40:40.552937+0000 2024-03-09T14:40:40.617 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:40:40.617 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.617 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:40.617 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7991b80e86] 2024-03-09T14:40:40.617 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f7991b81044] 2024-03-09T14:40:40.618 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf7290bf91] 2024-03-09T14:40:40.618 INFO:tasks.workunit.client.0.smithi088.stderr: 4: radosgw-admin(+0x802a32) [0x55bf7291ba32] 2024-03-09T14:40:40.618 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55bf72926e0b] 2024-03-09T14:40:40.618 INFO:tasks.workunit.client.0.smithi088.stderr: 6: main() 2024-03-09T14:40:40.618 INFO:tasks.workunit.client.0.smithi088.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f7990a3feb0] 2024-03-09T14:40:40.618 INFO:tasks.workunit.client.0.smithi088.stderr: 8: __libc_start_main() 2024-03-09T14:40:40.618 INFO:tasks.workunit.client.0.smithi088.stderr: 9: _start() 2024-03-09T14:40:40.618 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.618 INFO:tasks.workunit.client.0.smithi088.stderr: 0> 2024-03-09T14:40:40.553+0000 7f798e711800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:40:40.618 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7f798e711800 thread_name:radosgw-admin 2024-03-09T14:40:40.618 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.618 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:40.618 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7990a54db0] 2024-03-09T14:40:40.618 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7990aa154c] 2024-03-09T14:40:40.619 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:40:40.619 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:40:40.619 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7991b80ee0] 2024-03-09T14:40:40.619 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f7991b81044] 2024-03-09T14:40:40.619 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf7290bf91] 2024-03-09T14:40:40.619 INFO:tasks.workunit.client.0.smithi088.stderr: 8: radosgw-admin(+0x802a32) [0x55bf7291ba32] 2024-03-09T14:40:40.619 INFO:tasks.workunit.client.0.smithi088.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55bf72926e0b] 2024-03-09T14:40:40.619 INFO:tasks.workunit.client.0.smithi088.stderr: 10: main() 2024-03-09T14:40:40.619 INFO:tasks.workunit.client.0.smithi088.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f7990a3feb0] 2024-03-09T14:40:40.619 INFO:tasks.workunit.client.0.smithi088.stderr: 12: __libc_start_main() 2024-03-09T14:40:40.619 INFO:tasks.workunit.client.0.smithi088.stderr: 13: _start() 2024-03-09T14:40:40.619 INFO:tasks.workunit.client.0.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:40:40.619 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.619 INFO:tasks.workunit.client.0.smithi088.stderr:--- logging levels --- 2024-03-09T14:40:40.619 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 none 2024-03-09T14:40:40.620 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 lockdep 2024-03-09T14:40:40.620 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 context 2024-03-09T14:40:40.620 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 crush 2024-03-09T14:40:40.620 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds 2024-03-09T14:40:40.620 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_balancer 2024-03-09T14:40:40.620 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_locker 2024-03-09T14:40:40.620 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log 2024-03-09T14:40:40.620 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log_expire 2024-03-09T14:40:40.620 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_migrator 2024-03-09T14:40:40.620 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 buffer 2024-03-09T14:40:40.620 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 timer 2024-03-09T14:40:40.620 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 filer 2024-03-09T14:40:40.620 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 striper 2024-03-09T14:40:40.620 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 objecter 2024-03-09T14:40:40.620 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rados 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_mirror 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_replay 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_pwl 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 journaler 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objectcacher 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 client 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 osd 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 optracker 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objclass 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 filestore 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 journal 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 ms 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mon 2024-03-09T14:40:40.621 INFO:tasks.workunit.client.0.smithi088.stderr: 0/10 monc 2024-03-09T14:40:40.622 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 paxos 2024-03-09T14:40:40.622 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 tp 2024-03-09T14:40:40.622 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 auth 2024-03-09T14:40:40.622 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 crypto 2024-03-09T14:40:40.622 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 finisher 2024-03-09T14:40:40.622 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 reserver 2024-03-09T14:40:40.622 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 heartbeatmap 2024-03-09T14:40:40.622 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 perfcounter 2024-03-09T14:40:40.622 INFO:tasks.workunit.client.0.smithi088.stderr: 20/20 rgw 2024-03-09T14:40:40.622 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_sync 2024-03-09T14:40:40.622 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_datacache 2024-03-09T14:40:40.622 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_access 2024-03-09T14:40:40.622 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:40:40.622 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_flight 2024-03-09T14:40:40.622 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:40:40.623 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 javaclient 2024-03-09T14:40:40.623 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 asok 2024-03-09T14:40:40.623 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 throttle 2024-03-09T14:40:40.623 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 refs 2024-03-09T14:40:40.623 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 compressor 2024-03-09T14:40:40.623 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluestore 2024-03-09T14:40:40.623 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluefs 2024-03-09T14:40:40.623 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 bdev 2024-03-09T14:40:40.623 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 kstore 2024-03-09T14:40:40.623 INFO:tasks.workunit.client.0.smithi088.stderr: 4/ 5 rocksdb 2024-03-09T14:40:40.623 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 fuse 2024-03-09T14:40:40.623 INFO:tasks.workunit.client.0.smithi088.stderr: 2/ 5 mgr 2024-03-09T14:40:40.623 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mgrc 2024-03-09T14:40:40.623 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 dpdk 2024-03-09T14:40:40.623 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 eventtrace 2024-03-09T14:40:40.624 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 prioritycache 2024-03-09T14:40:40.624 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 test 2024-03-09T14:40:40.624 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:40:40.624 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephsqlite 2024-03-09T14:40:40.624 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:40:40.624 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore 2024-03-09T14:40:40.624 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_onode 2024-03-09T14:40:40.624 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_odata 2024-03-09T14:40:40.624 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_omap 2024-03-09T14:40:40.624 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_tm 2024-03-09T14:40:40.624 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_t 2024-03-09T14:40:40.624 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:40:40.624 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_epm 2024-03-09T14:40:40.624 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_lba 2024-03-09T14:40:40.624 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:40:40.625 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cache 2024-03-09T14:40:40.625 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_journal 2024-03-09T14:40:40.625 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_device 2024-03-09T14:40:40.625 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_backref 2024-03-09T14:40:40.625 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 alienstore 2024-03-09T14:40:40.625 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mclock 2024-03-09T14:40:40.625 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cyanstore 2024-03-09T14:40:40.625 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 ceph_exporter 2024-03-09T14:40:40.625 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 memstore 2024-03-09T14:40:40.625 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 trace 2024-03-09T14:40:40.625 INFO:tasks.workunit.client.0.smithi088.stderr: -2/-2 (syslog threshold) 2024-03-09T14:40:40.625 INFO:tasks.workunit.client.0.smithi088.stderr: 99/99 (stderr threshold) 2024-03-09T14:40:40.625 INFO:tasks.workunit.client.0.smithi088.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:40:40.625 INFO:tasks.workunit.client.0.smithi088.stderr: 7f77b37fe640 / http_manager 2024-03-09T14:40:40.625 INFO:tasks.workunit.client.0.smithi088.stderr: 7f7841fdb640 / http_manager 2024-03-09T14:40:40.626 INFO:tasks.workunit.client.0.smithi088.stderr: 7f7842fdd640 / rgw_dt_lg_renew 2024-03-09T14:40:40.626 INFO:tasks.workunit.client.0.smithi088.stderr: 7f7861ffb640 / ms_dispatch 2024-03-09T14:40:40.626 INFO:tasks.workunit.client.0.smithi088.stderr: 7f78637fe640 / io_context_pool 2024-03-09T14:40:40.626 INFO:tasks.workunit.client.0.smithi088.stderr: 7f7871ffb640 / ms_dispatch 2024-03-09T14:40:40.626 INFO:tasks.workunit.client.0.smithi088.stderr: 7f7878e09640 / ms_dispatch 2024-03-09T14:40:40.626 INFO:tasks.workunit.client.0.smithi088.stderr: 7f787a60c640 / io_context_pool 2024-03-09T14:40:40.626 INFO:tasks.workunit.client.0.smithi088.stderr: 7f798ba0c640 / msgr-worker-2 2024-03-09T14:40:40.626 INFO:tasks.workunit.client.0.smithi088.stderr: 7f798c20d640 / msgr-worker-1 2024-03-09T14:40:40.626 INFO:tasks.workunit.client.0.smithi088.stderr: 7f798ca0e640 / msgr-worker-0 2024-03-09T14:40:40.626 INFO:tasks.workunit.client.0.smithi088.stderr: 7f798d20f640 / io_context_pool 2024-03-09T14:40:40.626 INFO:tasks.workunit.client.0.smithi088.stderr: 7f798e711800 / radosgw-admin 2024-03-09T14:40:40.626 INFO:tasks.workunit.client.0.smithi088.stderr: max_recent 500 2024-03-09T14:40:40.626 INFO:tasks.workunit.client.0.smithi088.stderr: max_new 1000 2024-03-09T14:40:40.626 INFO:tasks.workunit.client.0.smithi088.stderr: log_file /var/log/ceph/ceph-client.admin.89706.log 2024-03-09T14:40:40.627 INFO:tasks.workunit.client.0.smithi088.stderr:--- end dump of recent events --- 2024-03-09T14:40:40.627 INFO:tasks.workunit.client.0.smithi088.stderr:--- begin dump of recent events --- 2024-03-09T14:40:40.627 INFO:tasks.workunit.client.0.smithi088.stderr: -499> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf7503dbc0) adding con mode: secure 2024-03-09T14:40:40.627 INFO:tasks.workunit.client.0.smithi088.stderr: -498> 2024-03-09T14:40:40.101+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.627 INFO:tasks.workunit.client.0.smithi088.stderr: -497> 2024-03-09T14:40:40.101+0000 7f798e711800 1 librados: starting msgr at 2024-03-09T14:40:40.627 INFO:tasks.workunit.client.0.smithi088.stderr: -496> 2024-03-09T14:40:40.101+0000 7f798e711800 1 librados: starting objecter 2024-03-09T14:40:40.627 INFO:tasks.workunit.client.0.smithi088.stderr: -495> 2024-03-09T14:40:40.101+0000 7f798e711800 5 asok(0x55bf74e18780) register_command objecter_requests hook 0x55bf7503a440 2024-03-09T14:40:40.627 INFO:tasks.workunit.client.0.smithi088.stderr: -494> 2024-03-09T14:40:40.101+0000 7f798e711800 1 librados: setting wanted keys 2024-03-09T14:40:40.627 INFO:tasks.workunit.client.0.smithi088.stderr: -493> 2024-03-09T14:40:40.101+0000 7f798e711800 1 librados: calling monclient init 2024-03-09T14:40:40.627 INFO:tasks.workunit.client.0.smithi088.stderr: -492> 2024-03-09T14:40:40.101+0000 7f798e711800 10 monclient: init 2024-03-09T14:40:40.627 INFO:tasks.workunit.client.0.smithi088.stderr: -491> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding auth protocol: cephx 2024-03-09T14:40:40.627 INFO:tasks.workunit.client.0.smithi088.stderr: -490> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding auth protocol: cephx 2024-03-09T14:40:40.627 INFO:tasks.workunit.client.0.smithi088.stderr: -489> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding auth protocol: cephx 2024-03-09T14:40:40.627 INFO:tasks.workunit.client.0.smithi088.stderr: -488> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: secure 2024-03-09T14:40:40.627 INFO:tasks.workunit.client.0.smithi088.stderr: -487> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: crc 2024-03-09T14:40:40.628 INFO:tasks.workunit.client.0.smithi088.stderr: -486> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: secure 2024-03-09T14:40:40.628 INFO:tasks.workunit.client.0.smithi088.stderr: -485> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: crc 2024-03-09T14:40:40.628 INFO:tasks.workunit.client.0.smithi088.stderr: -484> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: secure 2024-03-09T14:40:40.628 INFO:tasks.workunit.client.0.smithi088.stderr: -483> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: crc 2024-03-09T14:40:40.628 INFO:tasks.workunit.client.0.smithi088.stderr: -482> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: crc 2024-03-09T14:40:40.628 INFO:tasks.workunit.client.0.smithi088.stderr: -481> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: secure 2024-03-09T14:40:40.628 INFO:tasks.workunit.client.0.smithi088.stderr: -480> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: crc 2024-03-09T14:40:40.628 INFO:tasks.workunit.client.0.smithi088.stderr: -479> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: secure 2024-03-09T14:40:40.628 INFO:tasks.workunit.client.0.smithi088.stderr: -478> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: crc 2024-03-09T14:40:40.628 INFO:tasks.workunit.client.0.smithi088.stderr: -477> 2024-03-09T14:40:40.101+0000 7f798e711800 5 AuthRegistry(0x55bf750368f0) adding con mode: secure 2024-03-09T14:40:40.628 INFO:tasks.workunit.client.0.smithi088.stderr: -476> 2024-03-09T14:40:40.101+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.628 INFO:tasks.workunit.client.0.smithi088.stderr: -475> 2024-03-09T14:40:40.102+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.628 INFO:tasks.workunit.client.0.smithi088.stderr: -474> 2024-03-09T14:40:40.102+0000 7f798e711800 5 asok(0x55bf74e18780) register_command rotate-key hook 0x55bf75036a38 2024-03-09T14:40:40.628 INFO:tasks.workunit.client.0.smithi088.stderr: -473> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:40.629 INFO:tasks.workunit.client.0.smithi088.stderr: -472> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:40:40.629 INFO:tasks.workunit.client.0.smithi088.stderr: -471> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): picked mon.noname-c con 0x55bf74eed380 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:40:40.629 INFO:tasks.workunit.client.0.smithi088.stderr: -470> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): picked mon.noname-b con 0x55bf74f78680 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:40:40.629 INFO:tasks.workunit.client.0.smithi088.stderr: -469> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): picked mon.noname-a con 0x55bf74f7b5d0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:40:40.629 INFO:tasks.workunit.client.0.smithi088.stderr: -468> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.629 INFO:tasks.workunit.client.0.smithi088.stderr: -467> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.629 INFO:tasks.workunit.client.0.smithi088.stderr: -466> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.629 INFO:tasks.workunit.client.0.smithi088.stderr: -465> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:40.629 INFO:tasks.workunit.client.0.smithi088.stderr: -464> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient(hunting): authenticate will time out at 1655.440542s 2024-03-09T14:40:40.629 INFO:tasks.workunit.client.0.smithi088.stderr: -463> 2024-03-09T14:40:40.102+0000 7f798ca0e640 10 monclient(hunting): get_auth_request con 0x55bf74f7b5d0 auth_method 0 2024-03-09T14:40:40.629 INFO:tasks.workunit.client.0.smithi088.stderr: -462> 2024-03-09T14:40:40.102+0000 7f798ca0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.629 INFO:tasks.workunit.client.0.smithi088.stderr: -461> 2024-03-09T14:40:40.102+0000 7f798ca0e640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.629 INFO:tasks.workunit.client.0.smithi088.stderr: -460> 2024-03-09T14:40:40.102+0000 7f798ca0e640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.629 INFO:tasks.workunit.client.0.smithi088.stderr: -459> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): get_auth_request con 0x55bf74eed380 auth_method 0 2024-03-09T14:40:40.630 INFO:tasks.workunit.client.0.smithi088.stderr: -458> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.630 INFO:tasks.workunit.client.0.smithi088.stderr: -457> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.630 INFO:tasks.workunit.client.0.smithi088.stderr: -456> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.630 INFO:tasks.workunit.client.0.smithi088.stderr: -455> 2024-03-09T14:40:40.102+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.630 INFO:tasks.workunit.client.0.smithi088.stderr: -454> 2024-03-09T14:40:40.102+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.630 INFO:tasks.workunit.client.0.smithi088.stderr: -453> 2024-03-09T14:40:40.102+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.630 INFO:tasks.workunit.client.0.smithi088.stderr: -452> 2024-03-09T14:40:40.102+0000 7f798ba0c640 10 monclient(hunting): get_auth_request con 0x55bf74f78680 auth_method 0 2024-03-09T14:40:40.630 INFO:tasks.workunit.client.0.smithi088.stderr: -451> 2024-03-09T14:40:40.102+0000 7f798ba0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.630 INFO:tasks.workunit.client.0.smithi088.stderr: -450> 2024-03-09T14:40:40.102+0000 7f798ba0c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.630 INFO:tasks.workunit.client.0.smithi088.stderr: -449> 2024-03-09T14:40:40.102+0000 7f798ba0c640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.630 INFO:tasks.workunit.client.0.smithi088.stderr: -448> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.630 INFO:tasks.workunit.client.0.smithi088.stderr: -447> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.630 INFO:tasks.workunit.client.0.smithi088.stderr: -446> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.630 INFO:tasks.workunit.client.0.smithi088.stderr: -445> 2024-03-09T14:40:40.102+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.631 INFO:tasks.workunit.client.0.smithi088.stderr: -444> 2024-03-09T14:40:40.102+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.631 INFO:tasks.workunit.client.0.smithi088.stderr: -443> 2024-03-09T14:40:40.102+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.631 INFO:tasks.workunit.client.0.smithi088.stderr: -442> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient(hunting): handle_auth_done global_id 6023 payload 824 2024-03-09T14:40:40.631 INFO:tasks.workunit.client.0.smithi088.stderr: -441> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient: _finish_hunting 0 2024-03-09T14:40:40.631 INFO:tasks.workunit.client.0.smithi088.stderr: -440> 2024-03-09T14:40:40.102+0000 7f798c20d640 1 monclient: found mon.noname-c 2024-03-09T14:40:40.631 INFO:tasks.workunit.client.0.smithi088.stderr: -439> 2024-03-09T14:40:40.102+0000 7f798c20d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.631 INFO:tasks.workunit.client.0.smithi088.stderr: -438> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.631 INFO:tasks.workunit.client.0.smithi088.stderr: -437> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:40.631 INFO:tasks.workunit.client.0.smithi088.stderr: -436> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: dump: 2024-03-09T14:40:40.631 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.631 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.631 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.631 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.631 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.631 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.632 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.632 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.632 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.632 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.632 INFO:tasks.workunit.client.0.smithi088.stderr: -435> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: _finish_auth 0 2024-03-09T14:40:40.632 INFO:tasks.workunit.client.0.smithi088.stderr: -434> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: _check_auth_tickets 2024-03-09T14:40:40.632 INFO:tasks.workunit.client.0.smithi088.stderr: -433> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:40.632 INFO:tasks.workunit.client.0.smithi088.stderr: -432> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.634 INFO:tasks.workunit.client.0.smithi088.stderr: -431> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:40.634 INFO:tasks.workunit.client.0.smithi088.stderr: -430> 2024-03-09T14:40:40.102+0000 7f7878e09640 10 monclient: dump: 2024-03-09T14:40:40.634 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.634 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.634 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.634 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.634 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.634 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.634 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.634 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.634 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.635 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.635 INFO:tasks.workunit.client.0.smithi088.stderr: -429> 2024-03-09T14:40:40.102+0000 7f798e711800 5 monclient: authenticate success, global_id 6023 2024-03-09T14:40:40.635 INFO:tasks.workunit.client.0.smithi088.stderr: -428> 2024-03-09T14:40:40.102+0000 7f787a60c640 4 set_mon_vals no callback set 2024-03-09T14:40:40.635 INFO:tasks.workunit.client.0.smithi088.stderr: -427> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient: _renew_subs 2024-03-09T14:40:40.635 INFO:tasks.workunit.client.0.smithi088.stderr: -426> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.635 INFO:tasks.workunit.client.0.smithi088.stderr: -425> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient: _renew_subs 2024-03-09T14:40:40.635 INFO:tasks.workunit.client.0.smithi088.stderr: -424> 2024-03-09T14:40:40.102+0000 7f798e711800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.635 INFO:tasks.workunit.client.0.smithi088.stderr: -423> 2024-03-09T14:40:40.102+0000 7f798e711800 1 librados: init done 2024-03-09T14:40:40.635 INFO:tasks.workunit.client.0.smithi088.stderr: -422> 2024-03-09T14:40:40.104+0000 7f7878e09640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:40:40.635 INFO:tasks.workunit.client.0.smithi088.stderr: -421> 2024-03-09T14:40:40.104+0000 7f7878e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:40:40.635 INFO:tasks.workunit.client.0.smithi088.stderr: -420> 2024-03-09T14:40:40.104+0000 7f7878e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:40:40.635 INFO:tasks.workunit.client.0.smithi088.stderr: -419> 2024-03-09T14:40:40.104+0000 7f798ba0c640 10 monclient: get_auth_request con 0x7f787406a5b0 auth_method 0 2024-03-09T14:40:40.635 INFO:tasks.workunit.client.0.smithi088.stderr: -418> 2024-03-09T14:40:40.104+0000 7f798ca0e640 10 monclient: get_auth_request con 0x55bf7505dd80 auth_method 0 2024-03-09T14:40:40.635 INFO:tasks.workunit.client.0.smithi088.stderr: -417> 2024-03-09T14:40:40.105+0000 7f798c20d640 10 monclient: get_auth_request con 0x55bf750827f0 auth_method 0 2024-03-09T14:40:40.636 INFO:tasks.workunit.client.0.smithi088.stderr: -416> 2024-03-09T14:40:40.106+0000 7f798ba0c640 10 monclient: get_auth_request con 0x55bf75086b50 auth_method 0 2024-03-09T14:40:40.636 INFO:tasks.workunit.client.0.smithi088.stderr: -415> 2024-03-09T14:40:40.107+0000 7f798ca0e640 10 monclient: get_auth_request con 0x55bf75086020 auth_method 0 2024-03-09T14:40:40.636 INFO:tasks.workunit.client.0.smithi088.stderr: -414> 2024-03-09T14:40:40.107+0000 7f798e711800 10 monclient: build_initial_monmap 2024-03-09T14:40:40.636 INFO:tasks.workunit.client.0.smithi088.stderr: -413> 2024-03-09T14:40:40.107+0000 7f798e711800 1 build_initial for_mkfs: 0 2024-03-09T14:40:40.636 INFO:tasks.workunit.client.0.smithi088.stderr: -412> 2024-03-09T14:40:40.107+0000 7f798e711800 10 monclient: monmap: 2024-03-09T14:40:40.636 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:40:40.636 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:40.636 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:40:40.636 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:40:40.636 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:40.636 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.636 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:40:40.636 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:40:40.636 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:40:40.636 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.637 INFO:tasks.workunit.client.0.smithi088.stderr: -411> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding auth protocol: cephx 2024-03-09T14:40:40.637 INFO:tasks.workunit.client.0.smithi088.stderr: -410> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding auth protocol: cephx 2024-03-09T14:40:40.637 INFO:tasks.workunit.client.0.smithi088.stderr: -409> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding auth protocol: cephx 2024-03-09T14:40:40.637 INFO:tasks.workunit.client.0.smithi088.stderr: -408> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: secure 2024-03-09T14:40:40.637 INFO:tasks.workunit.client.0.smithi088.stderr: -407> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: crc 2024-03-09T14:40:40.637 INFO:tasks.workunit.client.0.smithi088.stderr: -406> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: secure 2024-03-09T14:40:40.637 INFO:tasks.workunit.client.0.smithi088.stderr: -405> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: crc 2024-03-09T14:40:40.637 INFO:tasks.workunit.client.0.smithi088.stderr: -404> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: secure 2024-03-09T14:40:40.637 INFO:tasks.workunit.client.0.smithi088.stderr: -403> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: crc 2024-03-09T14:40:40.637 INFO:tasks.workunit.client.0.smithi088.stderr: -402> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: crc 2024-03-09T14:40:40.637 INFO:tasks.workunit.client.0.smithi088.stderr: -401> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: secure 2024-03-09T14:40:40.637 INFO:tasks.workunit.client.0.smithi088.stderr: -400> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: crc 2024-03-09T14:40:40.637 INFO:tasks.workunit.client.0.smithi088.stderr: -399> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: secure 2024-03-09T14:40:40.637 INFO:tasks.workunit.client.0.smithi088.stderr: -398> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: crc 2024-03-09T14:40:40.637 INFO:tasks.workunit.client.0.smithi088.stderr: -397> 2024-03-09T14:40:40.107+0000 7f798e711800 5 AuthRegistry(0x55bf7508ea80) adding con mode: secure 2024-03-09T14:40:40.638 INFO:tasks.workunit.client.0.smithi088.stderr: -396> 2024-03-09T14:40:40.108+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.638 INFO:tasks.workunit.client.0.smithi088.stderr: -395> 2024-03-09T14:40:40.108+0000 7f798e711800 5 asok(0x55bf74e18780) register_command objecter_requests cmddesc objecter_requests hook 0x55bf7508fc40 EEXIST 2024-03-09T14:40:40.638 INFO:tasks.workunit.client.0.smithi088.stderr: -394> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient: init 2024-03-09T14:40:40.638 INFO:tasks.workunit.client.0.smithi088.stderr: -393> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding auth protocol: cephx 2024-03-09T14:40:40.638 INFO:tasks.workunit.client.0.smithi088.stderr: -392> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding auth protocol: cephx 2024-03-09T14:40:40.638 INFO:tasks.workunit.client.0.smithi088.stderr: -391> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding auth protocol: cephx 2024-03-09T14:40:40.638 INFO:tasks.workunit.client.0.smithi088.stderr: -390> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: secure 2024-03-09T14:40:40.638 INFO:tasks.workunit.client.0.smithi088.stderr: -389> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: crc 2024-03-09T14:40:40.638 INFO:tasks.workunit.client.0.smithi088.stderr: -388> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: secure 2024-03-09T14:40:40.638 INFO:tasks.workunit.client.0.smithi088.stderr: -387> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: crc 2024-03-09T14:40:40.638 INFO:tasks.workunit.client.0.smithi088.stderr: -386> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: secure 2024-03-09T14:40:40.638 INFO:tasks.workunit.client.0.smithi088.stderr: -385> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: crc 2024-03-09T14:40:40.638 INFO:tasks.workunit.client.0.smithi088.stderr: -384> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: crc 2024-03-09T14:40:40.638 INFO:tasks.workunit.client.0.smithi088.stderr: -383> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: secure 2024-03-09T14:40:40.639 INFO:tasks.workunit.client.0.smithi088.stderr: -382> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: crc 2024-03-09T14:40:40.639 INFO:tasks.workunit.client.0.smithi088.stderr: -381> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: secure 2024-03-09T14:40:40.639 INFO:tasks.workunit.client.0.smithi088.stderr: -380> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: crc 2024-03-09T14:40:40.639 INFO:tasks.workunit.client.0.smithi088.stderr: -379> 2024-03-09T14:40:40.108+0000 7f798e711800 5 AuthRegistry(0x55bf7508d9c8) adding con mode: secure 2024-03-09T14:40:40.639 INFO:tasks.workunit.client.0.smithi088.stderr: -378> 2024-03-09T14:40:40.108+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.639 INFO:tasks.workunit.client.0.smithi088.stderr: -377> 2024-03-09T14:40:40.108+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.639 INFO:tasks.workunit.client.0.smithi088.stderr: -376> 2024-03-09T14:40:40.108+0000 7f798e711800 5 asok(0x55bf74e18780) register_command rotate-key cmddesc rotate-key hook 0x55bf7508db10 EEXIST 2024-03-09T14:40:40.639 INFO:tasks.workunit.client.0.smithi088.stderr: -375> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:40.639 INFO:tasks.workunit.client.0.smithi088.stderr: -374> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:40:40.639 INFO:tasks.workunit.client.0.smithi088.stderr: -373> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): picked mon.noname-a con 0x55bf750b8ea0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:40:40.639 INFO:tasks.workunit.client.0.smithi088.stderr: -372> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): picked mon.noname-b con 0x55bf750b9280 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:40:40.639 INFO:tasks.workunit.client.0.smithi088.stderr: -371> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): picked mon.noname-c con 0x55bf750cbc30 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:40:40.639 INFO:tasks.workunit.client.0.smithi088.stderr: -370> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.639 INFO:tasks.workunit.client.0.smithi088.stderr: -369> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.639 INFO:tasks.workunit.client.0.smithi088.stderr: -368> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.640 INFO:tasks.workunit.client.0.smithi088.stderr: -367> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:40.640 INFO:tasks.workunit.client.0.smithi088.stderr: -366> 2024-03-09T14:40:40.108+0000 7f798e711800 10 monclient(hunting): authenticate will time out at 1655.447199s 2024-03-09T14:40:40.640 INFO:tasks.workunit.client.0.smithi088.stderr: -365> 2024-03-09T14:40:40.109+0000 7f798ba0c640 10 monclient(hunting): get_auth_request con 0x55bf750b8ea0 auth_method 0 2024-03-09T14:40:40.640 INFO:tasks.workunit.client.0.smithi088.stderr: -364> 2024-03-09T14:40:40.109+0000 7f798ba0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.640 INFO:tasks.workunit.client.0.smithi088.stderr: -363> 2024-03-09T14:40:40.109+0000 7f798ba0c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.640 INFO:tasks.workunit.client.0.smithi088.stderr: -362> 2024-03-09T14:40:40.109+0000 7f798ba0c640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.640 INFO:tasks.workunit.client.0.smithi088.stderr: -361> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): get_auth_request con 0x55bf750cbc30 auth_method 0 2024-03-09T14:40:40.640 INFO:tasks.workunit.client.0.smithi088.stderr: -360> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.640 INFO:tasks.workunit.client.0.smithi088.stderr: -359> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.640 INFO:tasks.workunit.client.0.smithi088.stderr: -358> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.640 INFO:tasks.workunit.client.0.smithi088.stderr: -357> 2024-03-09T14:40:40.109+0000 7f798ca0e640 10 monclient(hunting): get_auth_request con 0x55bf750b9280 auth_method 0 2024-03-09T14:40:40.640 INFO:tasks.workunit.client.0.smithi088.stderr: -356> 2024-03-09T14:40:40.109+0000 7f798ca0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.640 INFO:tasks.workunit.client.0.smithi088.stderr: -355> 2024-03-09T14:40:40.109+0000 7f798ca0e640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.640 INFO:tasks.workunit.client.0.smithi088.stderr: -354> 2024-03-09T14:40:40.109+0000 7f798ca0e640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.641 INFO:tasks.workunit.client.0.smithi088.stderr: -353> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.641 INFO:tasks.workunit.client.0.smithi088.stderr: -352> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.641 INFO:tasks.workunit.client.0.smithi088.stderr: -351> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.641 INFO:tasks.workunit.client.0.smithi088.stderr: -350> 2024-03-09T14:40:40.109+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.641 INFO:tasks.workunit.client.0.smithi088.stderr: -349> 2024-03-09T14:40:40.109+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.641 INFO:tasks.workunit.client.0.smithi088.stderr: -348> 2024-03-09T14:40:40.109+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.641 INFO:tasks.workunit.client.0.smithi088.stderr: -347> 2024-03-09T14:40:40.109+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.641 INFO:tasks.workunit.client.0.smithi088.stderr: -346> 2024-03-09T14:40:40.109+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.641 INFO:tasks.workunit.client.0.smithi088.stderr: -345> 2024-03-09T14:40:40.109+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.641 INFO:tasks.workunit.client.0.smithi088.stderr: -344> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient(hunting): handle_auth_done global_id 6026 payload 824 2024-03-09T14:40:40.641 INFO:tasks.workunit.client.0.smithi088.stderr: -343> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient: _finish_hunting 0 2024-03-09T14:40:40.641 INFO:tasks.workunit.client.0.smithi088.stderr: -342> 2024-03-09T14:40:40.109+0000 7f798c20d640 1 monclient: found mon.noname-c 2024-03-09T14:40:40.641 INFO:tasks.workunit.client.0.smithi088.stderr: -341> 2024-03-09T14:40:40.109+0000 7f798c20d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.641 INFO:tasks.workunit.client.0.smithi088.stderr: -340> 2024-03-09T14:40:40.310+0000 7f798c20d640 10 monclient: get_auth_request con 0x55bf750cbc30 auth_method 0 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi088.stderr: -339> 2024-03-09T14:40:40.310+0000 7f798c20d640 0 --2- 172.21.15.88:0/1655327022 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55bf750cbc30 0x55bf750b6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi088.stderr: -338> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: ms_handle_reset current mon [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi088.stderr: -337> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: _reopen_session rank -1 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi088.stderr: -336> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: _add_conns ranks=[0,2,1] 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi088.stderr: -335> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient(hunting): picked mon.noname-a con 0x55bf750b8ea0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi088.stderr: -334> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f7864004810 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi088.stderr: -333> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient(hunting): picked mon.noname-b con 0x55bf750b9280 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi088.stderr: -332> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi088.stderr: -331> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi088.stderr: -330> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi088.stderr: -329> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient(hunting): _renew_subs 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi088.stderr: -328> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): get_auth_request con 0x55bf750b8ea0 auth_method 0 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi088.stderr: -327> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi088.stderr: -326> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi088.stderr: -325> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-09T14:40:40.643 INFO:tasks.workunit.client.0.smithi088.stderr: -324> 2024-03-09T14:40:40.310+0000 7f798ca0e640 10 monclient(hunting): get_auth_request con 0x7f7864004810 auth_method 0 2024-03-09T14:40:40.643 INFO:tasks.workunit.client.0.smithi088.stderr: -323> 2024-03-09T14:40:40.310+0000 7f798ca0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.643 INFO:tasks.workunit.client.0.smithi088.stderr: -322> 2024-03-09T14:40:40.310+0000 7f798ca0e640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.643 INFO:tasks.workunit.client.0.smithi088.stderr: -321> 2024-03-09T14:40:40.310+0000 7f798ca0e640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-09T14:40:40.643 INFO:tasks.workunit.client.0.smithi088.stderr: -320> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.643 INFO:tasks.workunit.client.0.smithi088.stderr: -319> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.643 INFO:tasks.workunit.client.0.smithi088.stderr: -318> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-09T14:40:40.643 INFO:tasks.workunit.client.0.smithi088.stderr: -317> 2024-03-09T14:40:40.310+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.643 INFO:tasks.workunit.client.0.smithi088.stderr: -316> 2024-03-09T14:40:40.310+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.643 INFO:tasks.workunit.client.0.smithi088.stderr: -315> 2024-03-09T14:40:40.310+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-09T14:40:40.643 INFO:tasks.workunit.client.0.smithi088.stderr: -314> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient(hunting): handle_auth_done global_id 6026 payload 293 2024-03-09T14:40:40.643 INFO:tasks.workunit.client.0.smithi088.stderr: -313> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient: _finish_hunting 0 2024-03-09T14:40:40.643 INFO:tasks.workunit.client.0.smithi088.stderr: -312> 2024-03-09T14:40:40.310+0000 7f798ba0c640 1 monclient: found mon.noname-a 2024-03-09T14:40:40.643 INFO:tasks.workunit.client.0.smithi088.stderr: -311> 2024-03-09T14:40:40.310+0000 7f798ba0c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.88:3300/0 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi088.stderr: -310> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi088.stderr: -309> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi088.stderr: -308> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: dump: 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi088.stderr: -307> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: _finish_auth 0 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi088.stderr: -306> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: _check_auth_tickets 2024-03-09T14:40:40.645 INFO:tasks.workunit.client.0.smithi088.stderr: -305> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:40.645 INFO:tasks.workunit.client.0.smithi088.stderr: -304> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.645 INFO:tasks.workunit.client.0.smithi088.stderr: -303> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:40:40.645 INFO:tasks.workunit.client.0.smithi088.stderr: -302> 2024-03-09T14:40:40.310+0000 7f7871ffb640 10 monclient: dump: 2024-03-09T14:40:40.645 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.645 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.645 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.645 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.645 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.645 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.645 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.645 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.645 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.645 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.645 INFO:tasks.workunit.client.0.smithi088.stderr: -301> 2024-03-09T14:40:40.310+0000 7f798e711800 5 monclient: authenticate success, global_id 6026 2024-03-09T14:40:40.646 INFO:tasks.workunit.client.0.smithi088.stderr: -300> 2024-03-09T14:40:40.310+0000 7f798d20f640 4 set_mon_vals no callback set 2024-03-09T14:40:40.646 INFO:tasks.workunit.client.0.smithi088.stderr: -299> 2024-03-09T14:40:40.310+0000 7f798e711800 10 monclient: _renew_subs 2024-03-09T14:40:40.646 INFO:tasks.workunit.client.0.smithi088.stderr: -298> 2024-03-09T14:40:40.310+0000 7f798e711800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:40:40.646 INFO:tasks.workunit.client.0.smithi088.stderr: -297> 2024-03-09T14:40:40.310+0000 7f798e711800 10 monclient: _renew_subs 2024-03-09T14:40:40.646 INFO:tasks.workunit.client.0.smithi088.stderr: -296> 2024-03-09T14:40:40.310+0000 7f798e711800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:40:40.646 INFO:tasks.workunit.client.0.smithi088.stderr: -295> 2024-03-09T14:40:40.312+0000 7f7871ffb640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:40:40.646 INFO:tasks.workunit.client.0.smithi088.stderr: -294> 2024-03-09T14:40:40.312+0000 7f7871ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:40:40.646 INFO:tasks.workunit.client.0.smithi088.stderr: -293> 2024-03-09T14:40:40.312+0000 7f7871ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:40:40.646 INFO:tasks.workunit.client.0.smithi088.stderr: -292> 2024-03-09T14:40:40.312+0000 7f798ca0e640 10 monclient: get_auth_request con 0x55bf750cbc30 auth_method 0 2024-03-09T14:40:40.646 INFO:tasks.workunit.client.0.smithi088.stderr: -291> 2024-03-09T14:40:40.312+0000 7f798e711800 10 monclient: get_monmap_and_config 2024-03-09T14:40:40.646 INFO:tasks.workunit.client.0.smithi088.stderr: -290> 2024-03-09T14:40:40.312+0000 7f798e711800 10 monclient: build_initial_monmap 2024-03-09T14:40:40.646 INFO:tasks.workunit.client.0.smithi088.stderr: -289> 2024-03-09T14:40:40.312+0000 7f798e711800 1 build_initial for_mkfs: 0 2024-03-09T14:40:40.646 INFO:tasks.workunit.client.0.smithi088.stderr: -288> 2024-03-09T14:40:40.312+0000 7f798e711800 10 monclient: monmap: 2024-03-09T14:40:40.646 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:40:40.647 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:40.647 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:40:40.647 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:40:40.647 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:40.647 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.647 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:40:40.647 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:40:40.647 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:40:40.647 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.647 INFO:tasks.workunit.client.0.smithi088.stderr: -287> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding auth protocol: cephx 2024-03-09T14:40:40.647 INFO:tasks.workunit.client.0.smithi088.stderr: -286> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding auth protocol: cephx 2024-03-09T14:40:40.647 INFO:tasks.workunit.client.0.smithi088.stderr: -285> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding auth protocol: cephx 2024-03-09T14:40:40.647 INFO:tasks.workunit.client.0.smithi088.stderr: -284> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.647 INFO:tasks.workunit.client.0.smithi088.stderr: -283> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.647 INFO:tasks.workunit.client.0.smithi088.stderr: -282> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.648 INFO:tasks.workunit.client.0.smithi088.stderr: -281> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.648 INFO:tasks.workunit.client.0.smithi088.stderr: -280> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.648 INFO:tasks.workunit.client.0.smithi088.stderr: -279> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.648 INFO:tasks.workunit.client.0.smithi088.stderr: -278> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.648 INFO:tasks.workunit.client.0.smithi088.stderr: -277> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.648 INFO:tasks.workunit.client.0.smithi088.stderr: -276> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.648 INFO:tasks.workunit.client.0.smithi088.stderr: -275> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.648 INFO:tasks.workunit.client.0.smithi088.stderr: -274> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.648 INFO:tasks.workunit.client.0.smithi088.stderr: -273> 2024-03-09T14:40:40.312+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.648 INFO:tasks.workunit.client.0.smithi088.stderr: -272> 2024-03-09T14:40:40.312+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.648 INFO:tasks.workunit.client.0.smithi088.stderr: -271> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient: init 2024-03-09T14:40:40.648 INFO:tasks.workunit.client.0.smithi088.stderr: -270> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding auth protocol: cephx 2024-03-09T14:40:40.648 INFO:tasks.workunit.client.0.smithi088.stderr: -269> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding auth protocol: cephx 2024-03-09T14:40:40.648 INFO:tasks.workunit.client.0.smithi088.stderr: -268> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding auth protocol: cephx 2024-03-09T14:40:40.648 INFO:tasks.workunit.client.0.smithi088.stderr: -267> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: secure 2024-03-09T14:40:40.649 INFO:tasks.workunit.client.0.smithi088.stderr: -266> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: crc 2024-03-09T14:40:40.649 INFO:tasks.workunit.client.0.smithi088.stderr: -265> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: secure 2024-03-09T14:40:40.649 INFO:tasks.workunit.client.0.smithi088.stderr: -264> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: crc 2024-03-09T14:40:40.649 INFO:tasks.workunit.client.0.smithi088.stderr: -263> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: secure 2024-03-09T14:40:40.649 INFO:tasks.workunit.client.0.smithi088.stderr: -262> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: crc 2024-03-09T14:40:40.649 INFO:tasks.workunit.client.0.smithi088.stderr: -261> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: crc 2024-03-09T14:40:40.649 INFO:tasks.workunit.client.0.smithi088.stderr: -260> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: secure 2024-03-09T14:40:40.649 INFO:tasks.workunit.client.0.smithi088.stderr: -259> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: crc 2024-03-09T14:40:40.649 INFO:tasks.workunit.client.0.smithi088.stderr: -258> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: secure 2024-03-09T14:40:40.649 INFO:tasks.workunit.client.0.smithi088.stderr: -257> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: crc 2024-03-09T14:40:40.649 INFO:tasks.workunit.client.0.smithi088.stderr: -256> 2024-03-09T14:40:40.313+0000 7f798e711800 5 AuthRegistry(0x7fff28e050e0) adding con mode: secure 2024-03-09T14:40:40.649 INFO:tasks.workunit.client.0.smithi088.stderr: -255> 2024-03-09T14:40:40.313+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.649 INFO:tasks.workunit.client.0.smithi088.stderr: -254> 2024-03-09T14:40:40.313+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.649 INFO:tasks.workunit.client.0.smithi088.stderr: -253> 2024-03-09T14:40:40.313+0000 7f798e711800 5 asok(0x55bf74e18780) register_command rotate-key cmddesc rotate-key hook 0x7fff28e05228 EEXIST 2024-03-09T14:40:40.649 INFO:tasks.workunit.client.0.smithi088.stderr: -252> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:40.650 INFO:tasks.workunit.client.0.smithi088.stderr: -251> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:40:40.650 INFO:tasks.workunit.client.0.smithi088.stderr: -250> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): picked mon.noname-a con 0x55bf75104190 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:40:40.650 INFO:tasks.workunit.client.0.smithi088.stderr: -249> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): picked mon.noname-b con 0x55bf75104570 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:40:40.650 INFO:tasks.workunit.client.0.smithi088.stderr: -248> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): picked mon.noname-c con 0x55bf75100040 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:40:40.650 INFO:tasks.workunit.client.0.smithi088.stderr: -247> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.650 INFO:tasks.workunit.client.0.smithi088.stderr: -246> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.650 INFO:tasks.workunit.client.0.smithi088.stderr: -245> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.650 INFO:tasks.workunit.client.0.smithi088.stderr: -244> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:40.650 INFO:tasks.workunit.client.0.smithi088.stderr: -243> 2024-03-09T14:40:40.313+0000 7f798e711800 10 monclient(hunting): authenticate will time out at 1655.651871s 2024-03-09T14:40:40.650 INFO:tasks.workunit.client.0.smithi088.stderr: -242> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): get_auth_request con 0x55bf75104190 auth_method 0 2024-03-09T14:40:40.650 INFO:tasks.workunit.client.0.smithi088.stderr: -241> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.650 INFO:tasks.workunit.client.0.smithi088.stderr: -240> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.650 INFO:tasks.workunit.client.0.smithi088.stderr: -239> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.650 INFO:tasks.workunit.client.0.smithi088.stderr: -238> 2024-03-09T14:40:40.313+0000 7f798c20d640 10 monclient(hunting): get_auth_request con 0x55bf75100040 auth_method 0 2024-03-09T14:40:40.651 INFO:tasks.workunit.client.0.smithi088.stderr: -237> 2024-03-09T14:40:40.313+0000 7f798c20d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.651 INFO:tasks.workunit.client.0.smithi088.stderr: -236> 2024-03-09T14:40:40.313+0000 7f798c20d640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.651 INFO:tasks.workunit.client.0.smithi088.stderr: -235> 2024-03-09T14:40:40.313+0000 7f798c20d640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.651 INFO:tasks.workunit.client.0.smithi088.stderr: -234> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.651 INFO:tasks.workunit.client.0.smithi088.stderr: -233> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.651 INFO:tasks.workunit.client.0.smithi088.stderr: -232> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.651 INFO:tasks.workunit.client.0.smithi088.stderr: -231> 2024-03-09T14:40:40.313+0000 7f798ca0e640 10 monclient(hunting): get_auth_request con 0x55bf75104570 auth_method 0 2024-03-09T14:40:40.651 INFO:tasks.workunit.client.0.smithi088.stderr: -230> 2024-03-09T14:40:40.313+0000 7f798ca0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.651 INFO:tasks.workunit.client.0.smithi088.stderr: -229> 2024-03-09T14:40:40.313+0000 7f798ca0e640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.651 INFO:tasks.workunit.client.0.smithi088.stderr: -228> 2024-03-09T14:40:40.313+0000 7f798ca0e640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.651 INFO:tasks.workunit.client.0.smithi088.stderr: -227> 2024-03-09T14:40:40.313+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.651 INFO:tasks.workunit.client.0.smithi088.stderr: -226> 2024-03-09T14:40:40.313+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.651 INFO:tasks.workunit.client.0.smithi088.stderr: -225> 2024-03-09T14:40:40.313+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.651 INFO:tasks.workunit.client.0.smithi088.stderr: -224> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient(hunting): handle_auth_done global_id 6285 payload 274 2024-03-09T14:40:40.652 INFO:tasks.workunit.client.0.smithi088.stderr: -223> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient: _finish_hunting 0 2024-03-09T14:40:40.652 INFO:tasks.workunit.client.0.smithi088.stderr: -222> 2024-03-09T14:40:40.313+0000 7f798ba0c640 1 monclient: found mon.noname-a 2024-03-09T14:40:40.652 INFO:tasks.workunit.client.0.smithi088.stderr: -221> 2024-03-09T14:40:40.313+0000 7f798ba0c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.88:3300/0 2024-03-09T14:40:40.652 INFO:tasks.workunit.client.0.smithi088.stderr: -220> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.652 INFO:tasks.workunit.client.0.smithi088.stderr: -219> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:40:40.652 INFO:tasks.workunit.client.0.smithi088.stderr: -218> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: dump: 2024-03-09T14:40:40.652 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.652 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.652 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.652 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.652 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.652 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.652 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.652 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.652 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.653 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.653 INFO:tasks.workunit.client.0.smithi088.stderr: -217> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: _finish_auth 0 2024-03-09T14:40:40.653 INFO:tasks.workunit.client.0.smithi088.stderr: -216> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: _check_auth_tickets 2024-03-09T14:40:40.653 INFO:tasks.workunit.client.0.smithi088.stderr: -215> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:40.653 INFO:tasks.workunit.client.0.smithi088.stderr: -214> 2024-03-09T14:40:40.314+0000 7f798e711800 5 monclient: authenticate success, global_id 6285 2024-03-09T14:40:40.653 INFO:tasks.workunit.client.0.smithi088.stderr: -213> 2024-03-09T14:40:40.314+0000 7f798e711800 10 monclient: get_monmap_and_config success 2024-03-09T14:40:40.653 INFO:tasks.workunit.client.0.smithi088.stderr: -212> 2024-03-09T14:40:40.314+0000 7f798e711800 4 set_mon_vals no callback set 2024-03-09T14:40:40.653 INFO:tasks.workunit.client.0.smithi088.stderr: -211> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.653 INFO:tasks.workunit.client.0.smithi088.stderr: -210> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:40:40.653 INFO:tasks.workunit.client.0.smithi088.stderr: -209> 2024-03-09T14:40:40.314+0000 7f78637fe640 10 monclient: dump: 2024-03-09T14:40:40.653 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.653 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.653 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.653 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.653 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.654 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.654 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.654 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.654 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.654 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.654 INFO:tasks.workunit.client.0.smithi088.stderr: -208> 2024-03-09T14:40:40.314+0000 7f798e711800 10 monclient: shutdown 2024-03-09T14:40:40.654 INFO:tasks.workunit.client.0.smithi088.stderr: -207> 2024-03-09T14:40:40.314+0000 7f798e711800 10 monclient: build_initial_monmap 2024-03-09T14:40:40.654 INFO:tasks.workunit.client.0.smithi088.stderr: -206> 2024-03-09T14:40:40.314+0000 7f798e711800 1 build_initial for_mkfs: 0 2024-03-09T14:40:40.654 INFO:tasks.workunit.client.0.smithi088.stderr: -205> 2024-03-09T14:40:40.314+0000 7f798e711800 10 monclient: monmap: 2024-03-09T14:40:40.654 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:40:40.654 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:40.654 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:40:40.654 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:40:40.654 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:40.655 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.655 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:40:40.655 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:40:40.655 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:40:40.655 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.655 INFO:tasks.workunit.client.0.smithi088.stderr: -204> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding auth protocol: cephx 2024-03-09T14:40:40.655 INFO:tasks.workunit.client.0.smithi088.stderr: -203> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding auth protocol: cephx 2024-03-09T14:40:40.655 INFO:tasks.workunit.client.0.smithi088.stderr: -202> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding auth protocol: cephx 2024-03-09T14:40:40.655 INFO:tasks.workunit.client.0.smithi088.stderr: -201> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.655 INFO:tasks.workunit.client.0.smithi088.stderr: -200> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.655 INFO:tasks.workunit.client.0.smithi088.stderr: -199> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.655 INFO:tasks.workunit.client.0.smithi088.stderr: -198> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.655 INFO:tasks.workunit.client.0.smithi088.stderr: -197> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.655 INFO:tasks.workunit.client.0.smithi088.stderr: -196> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.655 INFO:tasks.workunit.client.0.smithi088.stderr: -195> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.656 INFO:tasks.workunit.client.0.smithi088.stderr: -194> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.656 INFO:tasks.workunit.client.0.smithi088.stderr: -193> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.656 INFO:tasks.workunit.client.0.smithi088.stderr: -192> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.656 INFO:tasks.workunit.client.0.smithi088.stderr: -191> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: crc 2024-03-09T14:40:40.656 INFO:tasks.workunit.client.0.smithi088.stderr: -190> 2024-03-09T14:40:40.314+0000 7f798e711800 5 AuthRegistry(0x55bf750cfbc0) adding con mode: secure 2024-03-09T14:40:40.656 INFO:tasks.workunit.client.0.smithi088.stderr: -189> 2024-03-09T14:40:40.315+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.656 INFO:tasks.workunit.client.0.smithi088.stderr: -188> 2024-03-09T14:40:40.315+0000 7f798e711800 1 librados: starting msgr at 2024-03-09T14:40:40.656 INFO:tasks.workunit.client.0.smithi088.stderr: -187> 2024-03-09T14:40:40.315+0000 7f798e711800 1 librados: starting objecter 2024-03-09T14:40:40.656 INFO:tasks.workunit.client.0.smithi088.stderr: -186> 2024-03-09T14:40:40.315+0000 7f798e711800 5 asok(0x55bf74e18780) register_command objecter_requests cmddesc objecter_requests hook 0x55bf750bb5b0 EEXIST 2024-03-09T14:40:40.656 INFO:tasks.workunit.client.0.smithi088.stderr: -185> 2024-03-09T14:40:40.315+0000 7f798e711800 1 librados: setting wanted keys 2024-03-09T14:40:40.656 INFO:tasks.workunit.client.0.smithi088.stderr: -184> 2024-03-09T14:40:40.315+0000 7f798e711800 1 librados: calling monclient init 2024-03-09T14:40:40.656 INFO:tasks.workunit.client.0.smithi088.stderr: -183> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient: init 2024-03-09T14:40:40.656 INFO:tasks.workunit.client.0.smithi088.stderr: -182> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding auth protocol: cephx 2024-03-09T14:40:40.656 INFO:tasks.workunit.client.0.smithi088.stderr: -181> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding auth protocol: cephx 2024-03-09T14:40:40.656 INFO:tasks.workunit.client.0.smithi088.stderr: -180> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding auth protocol: cephx 2024-03-09T14:40:40.657 INFO:tasks.workunit.client.0.smithi088.stderr: -179> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: secure 2024-03-09T14:40:40.657 INFO:tasks.workunit.client.0.smithi088.stderr: -178> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: crc 2024-03-09T14:40:40.657 INFO:tasks.workunit.client.0.smithi088.stderr: -177> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: secure 2024-03-09T14:40:40.657 INFO:tasks.workunit.client.0.smithi088.stderr: -176> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: crc 2024-03-09T14:40:40.657 INFO:tasks.workunit.client.0.smithi088.stderr: -175> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: secure 2024-03-09T14:40:40.657 INFO:tasks.workunit.client.0.smithi088.stderr: -174> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: crc 2024-03-09T14:40:40.657 INFO:tasks.workunit.client.0.smithi088.stderr: -173> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: crc 2024-03-09T14:40:40.657 INFO:tasks.workunit.client.0.smithi088.stderr: -172> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: secure 2024-03-09T14:40:40.657 INFO:tasks.workunit.client.0.smithi088.stderr: -171> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: crc 2024-03-09T14:40:40.657 INFO:tasks.workunit.client.0.smithi088.stderr: -170> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: secure 2024-03-09T14:40:40.657 INFO:tasks.workunit.client.0.smithi088.stderr: -169> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: crc 2024-03-09T14:40:40.657 INFO:tasks.workunit.client.0.smithi088.stderr: -168> 2024-03-09T14:40:40.315+0000 7f798e711800 5 AuthRegistry(0x55bf750ce840) adding con mode: secure 2024-03-09T14:40:40.657 INFO:tasks.workunit.client.0.smithi088.stderr: -167> 2024-03-09T14:40:40.315+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.657 INFO:tasks.workunit.client.0.smithi088.stderr: -166> 2024-03-09T14:40:40.315+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.657 INFO:tasks.workunit.client.0.smithi088.stderr: -165> 2024-03-09T14:40:40.315+0000 7f798e711800 5 asok(0x55bf74e18780) register_command rotate-key cmddesc rotate-key hook 0x55bf750ce988 EEXIST 2024-03-09T14:40:40.658 INFO:tasks.workunit.client.0.smithi088.stderr: -164> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:40.658 INFO:tasks.workunit.client.0.smithi088.stderr: -163> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:40:40.658 INFO:tasks.workunit.client.0.smithi088.stderr: -162> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): picked mon.noname-b con 0x55bf75100040 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:40:40.658 INFO:tasks.workunit.client.0.smithi088.stderr: -161> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): picked mon.noname-a con 0x55bf75104190 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:40:40.658 INFO:tasks.workunit.client.0.smithi088.stderr: -160> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): picked mon.noname-c con 0x55bf751116c0 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:40:40.658 INFO:tasks.workunit.client.0.smithi088.stderr: -159> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.658 INFO:tasks.workunit.client.0.smithi088.stderr: -158> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.658 INFO:tasks.workunit.client.0.smithi088.stderr: -157> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:40.658 INFO:tasks.workunit.client.0.smithi088.stderr: -156> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:40.658 INFO:tasks.workunit.client.0.smithi088.stderr: -155> 2024-03-09T14:40:40.315+0000 7f798e711800 10 monclient(hunting): authenticate will time out at 1655.654157s 2024-03-09T14:40:40.658 INFO:tasks.workunit.client.0.smithi088.stderr: -154> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): get_auth_request con 0x55bf751116c0 auth_method 0 2024-03-09T14:40:40.658 INFO:tasks.workunit.client.0.smithi088.stderr: -153> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.658 INFO:tasks.workunit.client.0.smithi088.stderr: -152> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.658 INFO:tasks.workunit.client.0.smithi088.stderr: -151> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.659 INFO:tasks.workunit.client.0.smithi088.stderr: -150> 2024-03-09T14:40:40.316+0000 7f798ca0e640 10 monclient(hunting): get_auth_request con 0x55bf75104190 auth_method 0 2024-03-09T14:40:40.659 INFO:tasks.workunit.client.0.smithi088.stderr: -149> 2024-03-09T14:40:40.316+0000 7f798ca0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.659 INFO:tasks.workunit.client.0.smithi088.stderr: -148> 2024-03-09T14:40:40.316+0000 7f798ca0e640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.659 INFO:tasks.workunit.client.0.smithi088.stderr: -147> 2024-03-09T14:40:40.316+0000 7f798ca0e640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.659 INFO:tasks.workunit.client.0.smithi088.stderr: -146> 2024-03-09T14:40:40.316+0000 7f798ba0c640 10 monclient(hunting): get_auth_request con 0x55bf75100040 auth_method 0 2024-03-09T14:40:40.659 INFO:tasks.workunit.client.0.smithi088.stderr: -145> 2024-03-09T14:40:40.316+0000 7f798ba0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:40.659 INFO:tasks.workunit.client.0.smithi088.stderr: -144> 2024-03-09T14:40:40.316+0000 7f798ba0c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:40.659 INFO:tasks.workunit.client.0.smithi088.stderr: -143> 2024-03-09T14:40:40.316+0000 7f798ba0c640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:40.659 INFO:tasks.workunit.client.0.smithi088.stderr: -142> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.659 INFO:tasks.workunit.client.0.smithi088.stderr: -141> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.659 INFO:tasks.workunit.client.0.smithi088.stderr: -140> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.659 INFO:tasks.workunit.client.0.smithi088.stderr: -139> 2024-03-09T14:40:40.316+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.659 INFO:tasks.workunit.client.0.smithi088.stderr: -138> 2024-03-09T14:40:40.316+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.659 INFO:tasks.workunit.client.0.smithi088.stderr: -137> 2024-03-09T14:40:40.316+0000 7f798ca0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.660 INFO:tasks.workunit.client.0.smithi088.stderr: -136> 2024-03-09T14:40:40.316+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:40.660 INFO:tasks.workunit.client.0.smithi088.stderr: -135> 2024-03-09T14:40:40.316+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:40.660 INFO:tasks.workunit.client.0.smithi088.stderr: -134> 2024-03-09T14:40:40.316+0000 7f798ba0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:40.660 INFO:tasks.workunit.client.0.smithi088.stderr: -133> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient(hunting): handle_auth_done global_id 6032 payload 824 2024-03-09T14:40:40.660 INFO:tasks.workunit.client.0.smithi088.stderr: -132> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient: _finish_hunting 0 2024-03-09T14:40:40.660 INFO:tasks.workunit.client.0.smithi088.stderr: -131> 2024-03-09T14:40:40.316+0000 7f798c20d640 1 monclient: found mon.noname-c 2024-03-09T14:40:40.660 INFO:tasks.workunit.client.0.smithi088.stderr: -130> 2024-03-09T14:40:40.316+0000 7f798c20d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.660 INFO:tasks.workunit.client.0.smithi088.stderr: -129> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.660 INFO:tasks.workunit.client.0.smithi088.stderr: -128> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:40.660 INFO:tasks.workunit.client.0.smithi088.stderr: -127> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: dump: 2024-03-09T14:40:40.660 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.660 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.660 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.660 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.660 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.661 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.661 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.661 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.661 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.661 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.661 INFO:tasks.workunit.client.0.smithi088.stderr: -126> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: _finish_auth 0 2024-03-09T14:40:40.661 INFO:tasks.workunit.client.0.smithi088.stderr: -125> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: _check_auth_tickets 2024-03-09T14:40:40.661 INFO:tasks.workunit.client.0.smithi088.stderr: -124> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:40.661 INFO:tasks.workunit.client.0.smithi088.stderr: -123> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:40.661 INFO:tasks.workunit.client.0.smithi088.stderr: -122> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:40.661 INFO:tasks.workunit.client.0.smithi088.stderr: -121> 2024-03-09T14:40:40.316+0000 7f7861ffb640 10 monclient: dump: 2024-03-09T14:40:40.661 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:40:40.661 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:40:40.661 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.662 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:40:40.662 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:40.662 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:40:40.662 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:40:40.662 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:40:40.662 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:40:40.662 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.662 INFO:tasks.workunit.client.0.smithi088.stderr: -120> 2024-03-09T14:40:40.316+0000 7f798e711800 5 monclient: authenticate success, global_id 6032 2024-03-09T14:40:40.662 INFO:tasks.workunit.client.0.smithi088.stderr: -119> 2024-03-09T14:40:40.316+0000 7f78637fe640 4 set_mon_vals no callback set 2024-03-09T14:40:40.662 INFO:tasks.workunit.client.0.smithi088.stderr: -118> 2024-03-09T14:40:40.316+0000 7f798e711800 10 monclient: _renew_subs 2024-03-09T14:40:40.662 INFO:tasks.workunit.client.0.smithi088.stderr: -117> 2024-03-09T14:40:40.316+0000 7f798e711800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.662 INFO:tasks.workunit.client.0.smithi088.stderr: -116> 2024-03-09T14:40:40.316+0000 7f798e711800 10 monclient: _renew_subs 2024-03-09T14:40:40.662 INFO:tasks.workunit.client.0.smithi088.stderr: -115> 2024-03-09T14:40:40.316+0000 7f798e711800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.662 INFO:tasks.workunit.client.0.smithi088.stderr: -114> 2024-03-09T14:40:40.316+0000 7f798e711800 1 librados: init done 2024-03-09T14:40:40.662 INFO:tasks.workunit.client.0.smithi088.stderr: -113> 2024-03-09T14:40:40.316+0000 7f798e711800 5 asok(0x55bf74e18780) register_command cr dump hook 0x55bf75105028 2024-03-09T14:40:40.663 INFO:tasks.workunit.client.0.smithi088.stderr: -112> 2024-03-09T14:40:40.317+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.663 INFO:tasks.workunit.client.0.smithi088.stderr: -111> 2024-03-09T14:40:40.318+0000 7f7861ffb640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:40:40.663 INFO:tasks.workunit.client.0.smithi088.stderr: -110> 2024-03-09T14:40:40.318+0000 7f7861ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:40:40.663 INFO:tasks.workunit.client.0.smithi088.stderr: -109> 2024-03-09T14:40:40.318+0000 7f7861ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:40:40.663 INFO:tasks.workunit.client.0.smithi088.stderr: -108> 2024-03-09T14:40:40.318+0000 7f798ca0e640 10 monclient: get_auth_request con 0x55bf7511e6d0 auth_method 0 2024-03-09T14:40:40.663 INFO:tasks.workunit.client.0.smithi088.stderr: -107> 2024-03-09T14:40:40.318+0000 7f798ba0c640 10 monclient: get_auth_request con 0x7f785406a670 auth_method 0 2024-03-09T14:40:40.663 INFO:tasks.workunit.client.0.smithi088.stderr: -106> 2024-03-09T14:40:40.319+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.663 INFO:tasks.workunit.client.0.smithi088.stderr: -105> 2024-03-09T14:40:40.319+0000 7f798e711800 20 realm 2024-03-09T14:40:40.663 INFO:tasks.workunit.client.0.smithi088.stderr: -104> 2024-03-09T14:40:40.319+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.663 INFO:tasks.workunit.client.0.smithi088.stderr: -103> 2024-03-09T14:40:40.319+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.663 INFO:tasks.workunit.client.0.smithi088.stderr: -102> 2024-03-09T14:40:40.319+0000 7f798e711800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:40.663 INFO:tasks.workunit.client.0.smithi088.stderr: -101> 2024-03-09T14:40:40.319+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.663 INFO:tasks.workunit.client.0.smithi088.stderr: -100> 2024-03-09T14:40:40.319+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.663 INFO:tasks.workunit.client.0.smithi088.stderr: -99> 2024-03-09T14:40:40.319+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.663 INFO:tasks.workunit.client.0.smithi088.stderr: -98> 2024-03-09T14:40:40.319+0000 7f798ba0c640 10 monclient: get_auth_request con 0x55bf751228e0 auth_method 0 2024-03-09T14:40:40.664 INFO:tasks.workunit.client.0.smithi088.stderr: -97> 2024-03-09T14:40:40.320+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:40.664 INFO:tasks.workunit.client.0.smithi088.stderr: -96> 2024-03-09T14:40:40.320+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.664 INFO:tasks.workunit.client.0.smithi088.stderr: -95> 2024-03-09T14:40:40.320+0000 7f798ca0e640 10 monclient: get_auth_request con 0x55bf75126120 auth_method 0 2024-03-09T14:40:40.664 INFO:tasks.workunit.client.0.smithi088.stderr: -94> 2024-03-09T14:40:40.321+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:40.664 INFO:tasks.workunit.client.0.smithi088.stderr: -93> 2024-03-09T14:40:40.321+0000 7f798e711800 20 searching for the correct realm 2024-03-09T14:40:40.664 INFO:tasks.workunit.client.0.smithi088.stderr: -92> 2024-03-09T14:40:40.321+0000 7f798c20d640 10 monclient: get_auth_request con 0x55bf7512aaa0 auth_method 0 2024-03-09T14:40:40.664 INFO:tasks.workunit.client.0.smithi088.stderr: -91> 2024-03-09T14:40:40.321+0000 7f798ba0c640 0 -- 172.21.15.88:0/2314801468 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f797c0666a0 msgr2=0x7f797c009b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:40.664 INFO:tasks.workunit.client.0.smithi088.stderr: -90> 2024-03-09T14:40:40.522+0000 7f798ba0c640 10 monclient: get_auth_request con 0x7f797c0666a0 auth_method 0 2024-03-09T14:40:40.664 INFO:tasks.workunit.client.0.smithi088.stderr: -89> 2024-03-09T14:40:40.523+0000 7f798ca0e640 10 monclient: get_auth_request con 0x7f7984031040 auth_method 0 2024-03-09T14:40:40.664 INFO:tasks.workunit.client.0.smithi088.stderr: -88> 2024-03-09T14:40:40.526+0000 7f798c20d640 10 monclient: get_auth_request con 0x7f798400e040 auth_method 0 2024-03-09T14:40:40.664 INFO:tasks.workunit.client.0.smithi088.stderr: -87> 2024-03-09T14:40:40.527+0000 7f798ca0e640 0 -- 172.21.15.88:0/2314801468 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x55bf75126120 msgr2=0x55bf75128530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:40.664 INFO:tasks.workunit.client.0.smithi088.stderr: -86> 2024-03-09T14:40:40.527+0000 7f7861ffb640 1 client.6032.objecter ms_handle_reset 0x55bf75126120 session 0x55bf75121c70 osd.2 2024-03-09T14:40:40.664 INFO:tasks.workunit.client.0.smithi088.stderr: -85> 2024-03-09T14:40:40.527+0000 7f7861ffb640 10 monclient: _renew_subs 2024-03-09T14:40:40.664 INFO:tasks.workunit.client.0.smithi088.stderr: -84> 2024-03-09T14:40:40.527+0000 7f7861ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:40:40.665 INFO:tasks.workunit.client.0.smithi088.stderr: -83> 2024-03-09T14:40:40.527+0000 7f798ca0e640 10 monclient: get_auth_request con 0x7f785407ada0 auth_method 0 2024-03-09T14:40:40.665 INFO:tasks.workunit.client.0.smithi088.stderr: -82> 2024-03-09T14:40:40.528+0000 7f798ba0c640 10 monclient: get_auth_request con 0x7f79840456b0 auth_method 0 2024-03-09T14:40:40.665 INFO:tasks.workunit.client.0.smithi088.stderr: -81> 2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:40.665 INFO:tasks.workunit.client.0.smithi088.stderr: -80> 2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:40.665 INFO:tasks.workunit.client.0.smithi088.stderr: -79> 2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:40.665 INFO:tasks.workunit.client.0.smithi088.stderr: -78> 2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:40.665 INFO:tasks.workunit.client.0.smithi088.stderr: -77> 2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:40.665 INFO:tasks.workunit.client.0.smithi088.stderr: -76> 2024-03-09T14:40:40.533+0000 7f798e711800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:40.665 INFO:tasks.workunit.client.0.smithi088.stderr: -75> 2024-03-09T14:40:40.533+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.665 INFO:tasks.workunit.client.0.smithi088.stderr: -74> 2024-03-09T14:40:40.533+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.665 INFO:tasks.workunit.client.0.smithi088.stderr: -73> 2024-03-09T14:40:40.533+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.665 INFO:tasks.workunit.client.0.smithi088.stderr: -72> 2024-03-09T14:40:40.533+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:40.665 INFO:tasks.workunit.client.0.smithi088.stderr: -71> 2024-03-09T14:40:40.533+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.665 INFO:tasks.workunit.client.0.smithi088.stderr: -70> 2024-03-09T14:40:40.534+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:40.665 INFO:tasks.workunit.client.0.smithi088.stderr: -69> 2024-03-09T14:40:40.534+0000 7f798e711800 20 zone default found 2024-03-09T14:40:40.666 INFO:tasks.workunit.client.0.smithi088.stderr: -68> 2024-03-09T14:40:40.534+0000 7f798e711800 4 Realm: () 2024-03-09T14:40:40.666 INFO:tasks.workunit.client.0.smithi088.stderr: -67> 2024-03-09T14:40:40.534+0000 7f798e711800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:40.666 INFO:tasks.workunit.client.0.smithi088.stderr: -66> 2024-03-09T14:40:40.534+0000 7f798e711800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:40.666 INFO:tasks.workunit.client.0.smithi088.stderr: -65> 2024-03-09T14:40:40.534+0000 7f798e711800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:40.666 INFO:tasks.workunit.client.0.smithi088.stderr: -64> 2024-03-09T14:40:40.534+0000 7f798e711800 20 zonegroup default 2024-03-09T14:40:40.666 INFO:tasks.workunit.client.0.smithi088.stderr: -63> 2024-03-09T14:40:40.534+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.666 INFO:tasks.workunit.client.0.smithi088.stderr: -62> 2024-03-09T14:40:40.534+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.666 INFO:tasks.workunit.client.0.smithi088.stderr: -61> 2024-03-09T14:40:40.534+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.666 INFO:tasks.workunit.client.0.smithi088.stderr: -60> 2024-03-09T14:40:40.534+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.666 INFO:tasks.workunit.client.0.smithi088.stderr: -59> 2024-03-09T14:40:40.534+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.666 INFO:tasks.workunit.client.0.smithi088.stderr: -58> 2024-03-09T14:40:40.535+0000 7f798e711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.666 INFO:tasks.workunit.client.0.smithi088.stderr: -57> 2024-03-09T14:40:40.535+0000 7f798e711800 20 started sync module instance, tier type = 2024-03-09T14:40:40.666 INFO:tasks.workunit.client.0.smithi088.stderr: -56> 2024-03-09T14:40:40.535+0000 7f798e711800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:40.666 INFO:tasks.workunit.client.0.smithi088.stderr: -55> 2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=0 2024-03-09T14:40:40.667 INFO:tasks.workunit.client.0.smithi088.stderr: -54> 2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=1 2024-03-09T14:40:40.667 INFO:tasks.workunit.client.0.smithi088.stderr: -53> 2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=2 2024-03-09T14:40:40.667 INFO:tasks.workunit.client.0.smithi088.stderr: -52> 2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=3 2024-03-09T14:40:40.667 INFO:tasks.workunit.client.0.smithi088.stderr: -51> 2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=4 2024-03-09T14:40:40.667 INFO:tasks.workunit.client.0.smithi088.stderr: -50> 2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=5 2024-03-09T14:40:40.667 INFO:tasks.workunit.client.0.smithi088.stderr: -49> 2024-03-09T14:40:40.543+0000 7f798e711800 20 add_watcher() i=6 2024-03-09T14:40:40.667 INFO:tasks.workunit.client.0.smithi088.stderr: -48> 2024-03-09T14:40:40.544+0000 7f798e711800 20 add_watcher() i=7 2024-03-09T14:40:40.667 INFO:tasks.workunit.client.0.smithi088.stderr: -47> 2024-03-09T14:40:40.544+0000 7f798e711800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:40.667 INFO:tasks.workunit.client.0.smithi088.stderr: -46> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding auth protocol: cephx 2024-03-09T14:40:40.667 INFO:tasks.workunit.client.0.smithi088.stderr: -45> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding auth protocol: cephx 2024-03-09T14:40:40.667 INFO:tasks.workunit.client.0.smithi088.stderr: -44> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding auth protocol: cephx 2024-03-09T14:40:40.667 INFO:tasks.workunit.client.0.smithi088.stderr: -43> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: secure 2024-03-09T14:40:40.667 INFO:tasks.workunit.client.0.smithi088.stderr: -42> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: crc 2024-03-09T14:40:40.667 INFO:tasks.workunit.client.0.smithi088.stderr: -41> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: secure 2024-03-09T14:40:40.667 INFO:tasks.workunit.client.0.smithi088.stderr: -40> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: crc 2024-03-09T14:40:40.668 INFO:tasks.workunit.client.0.smithi088.stderr: -39> 2024-03-09T14:40:40.546+0000 7f7842fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:40.668 INFO:tasks.workunit.client.0.smithi088.stderr: -38> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: secure 2024-03-09T14:40:40.668 INFO:tasks.workunit.client.0.smithi088.stderr: -37> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: crc 2024-03-09T14:40:40.668 INFO:tasks.workunit.client.0.smithi088.stderr: -36> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: crc 2024-03-09T14:40:40.668 INFO:tasks.workunit.client.0.smithi088.stderr: -35> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: secure 2024-03-09T14:40:40.668 INFO:tasks.workunit.client.0.smithi088.stderr: -34> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: crc 2024-03-09T14:40:40.668 INFO:tasks.workunit.client.0.smithi088.stderr: -33> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: secure 2024-03-09T14:40:40.668 INFO:tasks.workunit.client.0.smithi088.stderr: -32> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: crc 2024-03-09T14:40:40.668 INFO:tasks.workunit.client.0.smithi088.stderr: -31> 2024-03-09T14:40:40.546+0000 7f798e711800 5 AuthRegistry(0x7fff28e05570) adding con mode: secure 2024-03-09T14:40:40.668 INFO:tasks.workunit.client.0.smithi088.stderr: -30> 2024-03-09T14:40:40.546+0000 7f798e711800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:40.668 INFO:tasks.workunit.client.0.smithi088.stderr: -29> 2024-03-09T14:40:40.546+0000 7f798e711800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:40.668 INFO:tasks.workunit.client.0.smithi088.stderr: -28> 2024-03-09T14:40:40.546+0000 7f798e711800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:40.668 INFO:tasks.workunit.client.0.smithi088.stderr: -27> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command cache list hook 0x55bf750ff820 2024-03-09T14:40:40.668 INFO:tasks.workunit.client.0.smithi088.stderr: -26> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command cache inspect hook 0x55bf750ff820 2024-03-09T14:40:40.668 INFO:tasks.workunit.client.0.smithi088.stderr: -25> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command cache erase hook 0x55bf750ff820 2024-03-09T14:40:40.669 INFO:tasks.workunit.client.0.smithi088.stderr: -24> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command cache zap hook 0x55bf750ff820 2024-03-09T14:40:40.669 INFO:tasks.workunit.client.0.smithi088.stderr: -23> 2024-03-09T14:40:40.546+0000 7f798e711800 5 note: GC not initialized 2024-03-09T14:40:40.669 INFO:tasks.workunit.client.0.smithi088.stderr: -22> 2024-03-09T14:40:40.546+0000 7f7841fdb640 20 reqs_thread_entry: start 2024-03-09T14:40:40.669 INFO:tasks.workunit.client.0.smithi088.stderr: -21> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command sync trace show hook 0x7f797c05b040 2024-03-09T14:40:40.669 INFO:tasks.workunit.client.0.smithi088.stderr: -20> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command sync trace history hook 0x7f797c05b040 2024-03-09T14:40:40.669 INFO:tasks.workunit.client.0.smithi088.stderr: -19> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command sync trace active hook 0x7f797c05b040 2024-03-09T14:40:40.669 INFO:tasks.workunit.client.0.smithi088.stderr: -18> 2024-03-09T14:40:40.546+0000 7f798e711800 5 asok(0x55bf74e18780) register_command sync trace active_short hook 0x7f797c05b040 2024-03-09T14:40:40.669 INFO:tasks.workunit.client.0.smithi088.stderr: -17> 2024-03-09T14:40:40.546+0000 7f798e711800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:40.669 INFO:tasks.workunit.client.0.smithi088.stderr: -16> 2024-03-09T14:40:40.547+0000 7f798e711800 20 Filter name: none 2024-03-09T14:40:40.669 INFO:tasks.workunit.client.0.smithi088.stderr: -15> 2024-03-09T14:40:40.547+0000 7f77b37fe640 20 reqs_thread_entry: start 2024-03-09T14:40:40.669 INFO:tasks.workunit.client.0.smithi088.stderr: -14> 2024-03-09T14:40:40.547+0000 7f798e711800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-09T14:40:40.669 INFO:tasks.workunit.client.0.smithi088.stderr: -13> 2024-03-09T14:40:40.547+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.669 INFO:tasks.workunit.client.0.smithi088.stderr: -12> 2024-03-09T14:40:40.547+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:40.669 INFO:tasks.workunit.client.0.smithi088.stderr: -11> 2024-03-09T14:40:40.547+0000 7f798e711800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-09T14:40:40.669 INFO:tasks.workunit.client.0.smithi088.stderr: -10> 2024-03-09T14:40:40.547+0000 7f798e711800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-09T14:40:40.670 INFO:tasks.workunit.client.0.smithi088.stderr: -9> 2024-03-09T14:40:40.547+0000 7f798e711800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 : miss 2024-03-09T14:40:40.670 INFO:tasks.workunit.client.0.smithi088.stderr: -8> 2024-03-09T14:40:40.547+0000 7f798e711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.670 INFO:tasks.workunit.client.0.smithi088.stderr: -7> 2024-03-09T14:40:40.548+0000 7f798e711800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:40.670 INFO:tasks.workunit.client.0.smithi088.stderr: -6> 2024-03-09T14:40:40.548+0000 7f798e711800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 info.flags=0x17 2024-03-09T14:40:40.670 INFO:tasks.workunit.client.0.smithi088.stderr: -5> 2024-03-09T14:40:40.548+0000 7f798e711800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 to cache LRU end 2024-03-09T14:40:40.670 INFO:tasks.workunit.client.0.smithi088.stderr: -4> 2024-03-09T14:40:40.548+0000 7f798e711800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:40.670 INFO:tasks.workunit.client.0.smithi088.stderr: -3> 2024-03-09T14:40:40.548+0000 7f798e711800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:40.670 INFO:tasks.workunit.client.0.smithi088.stderr: -2> 2024-03-09T14:40:40.548+0000 7f798e711800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 2024-03-09T14:40:40.670 INFO:tasks.workunit.client.0.smithi088.stderr: -1> 2024-03-09T14:40:40.552+0000 7f798e711800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f798e711800 time 2024-03-09T14:40:40.552937+0000 2024-03-09T14:40:40.670 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:40:40.670 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.670 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:40.670 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7991b80e86] 2024-03-09T14:40:40.671 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f7991b81044] 2024-03-09T14:40:40.671 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf7290bf91] 2024-03-09T14:40:40.671 INFO:tasks.workunit.client.0.smithi088.stderr: 4: radosgw-admin(+0x802a32) [0x55bf7291ba32] 2024-03-09T14:40:40.671 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55bf72926e0b] 2024-03-09T14:40:40.671 INFO:tasks.workunit.client.0.smithi088.stderr: 6: main() 2024-03-09T14:40:40.671 INFO:tasks.workunit.client.0.smithi088.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f7990a3feb0] 2024-03-09T14:40:40.671 INFO:tasks.workunit.client.0.smithi088.stderr: 8: __libc_start_main() 2024-03-09T14:40:40.671 INFO:tasks.workunit.client.0.smithi088.stderr: 9: _start() 2024-03-09T14:40:40.671 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.671 INFO:tasks.workunit.client.0.smithi088.stderr: 0> 2024-03-09T14:40:40.553+0000 7f798e711800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:40:40.671 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7f798e711800 thread_name:radosgw-admin 2024-03-09T14:40:40.671 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.671 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:40.671 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7990a54db0] 2024-03-09T14:40:40.671 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7990aa154c] 2024-03-09T14:40:40.672 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:40:40.672 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:40:40.672 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7991b80ee0] 2024-03-09T14:40:40.672 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f7991b81044] 2024-03-09T14:40:40.672 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bf7290bf91] 2024-03-09T14:40:40.672 INFO:tasks.workunit.client.0.smithi088.stderr: 8: radosgw-admin(+0x802a32) [0x55bf7291ba32] 2024-03-09T14:40:40.672 INFO:tasks.workunit.client.0.smithi088.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55bf72926e0b] 2024-03-09T14:40:40.672 INFO:tasks.workunit.client.0.smithi088.stderr: 10: main() 2024-03-09T14:40:40.672 INFO:tasks.workunit.client.0.smithi088.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f7990a3feb0] 2024-03-09T14:40:40.672 INFO:tasks.workunit.client.0.smithi088.stderr: 12: __libc_start_main() 2024-03-09T14:40:40.672 INFO:tasks.workunit.client.0.smithi088.stderr: 13: _start() 2024-03-09T14:40:40.672 INFO:tasks.workunit.client.0.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:40:40.672 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:40.672 INFO:tasks.workunit.client.0.smithi088.stderr:--- logging levels --- 2024-03-09T14:40:40.672 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 none 2024-03-09T14:40:40.673 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 lockdep 2024-03-09T14:40:40.673 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 context 2024-03-09T14:40:40.673 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 crush 2024-03-09T14:40:40.673 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds 2024-03-09T14:40:40.673 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_balancer 2024-03-09T14:40:40.673 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_locker 2024-03-09T14:40:40.673 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log 2024-03-09T14:40:40.673 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log_expire 2024-03-09T14:40:40.673 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_migrator 2024-03-09T14:40:40.673 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 buffer 2024-03-09T14:40:40.673 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 timer 2024-03-09T14:40:40.673 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 filer 2024-03-09T14:40:40.673 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 striper 2024-03-09T14:40:40.673 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 objecter 2024-03-09T14:40:40.673 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rados 2024-03-09T14:40:40.674 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd 2024-03-09T14:40:40.674 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_mirror 2024-03-09T14:40:40.674 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_replay 2024-03-09T14:40:40.674 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_pwl 2024-03-09T14:40:40.674 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 journaler 2024-03-09T14:40:40.674 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objectcacher 2024-03-09T14:40:40.674 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:40:40.674 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 client 2024-03-09T14:40:40.674 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 osd 2024-03-09T14:40:40.674 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 optracker 2024-03-09T14:40:40.674 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objclass 2024-03-09T14:40:40.674 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 filestore 2024-03-09T14:40:40.674 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 journal 2024-03-09T14:40:40.674 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 ms 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mon 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 0/10 monc 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 paxos 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 tp 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 auth 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 crypto 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 finisher 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 reserver 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 heartbeatmap 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 perfcounter 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 20/20 rgw 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_sync 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_datacache 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_access 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:40:40.675 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_flight 2024-03-09T14:40:40.676 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:40:40.676 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 javaclient 2024-03-09T14:40:40.676 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 asok 2024-03-09T14:40:40.676 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 throttle 2024-03-09T14:40:40.676 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 refs 2024-03-09T14:40:40.676 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 compressor 2024-03-09T14:40:40.676 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluestore 2024-03-09T14:40:40.676 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluefs 2024-03-09T14:40:40.676 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 bdev 2024-03-09T14:40:40.676 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 kstore 2024-03-09T14:40:40.676 INFO:tasks.workunit.client.0.smithi088.stderr: 4/ 5 rocksdb 2024-03-09T14:40:40.676 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 fuse 2024-03-09T14:40:40.676 INFO:tasks.workunit.client.0.smithi088.stderr: 2/ 5 mgr 2024-03-09T14:40:40.676 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mgrc 2024-03-09T14:40:40.676 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 dpdk 2024-03-09T14:40:40.677 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 eventtrace 2024-03-09T14:40:40.677 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 prioritycache 2024-03-09T14:40:40.677 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 test 2024-03-09T14:40:40.677 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:40:40.677 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephsqlite 2024-03-09T14:40:40.677 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:40:40.677 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore 2024-03-09T14:40:40.677 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_onode 2024-03-09T14:40:40.677 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_odata 2024-03-09T14:40:40.677 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_omap 2024-03-09T14:40:40.677 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_tm 2024-03-09T14:40:40.677 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_t 2024-03-09T14:40:40.677 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:40:40.677 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_epm 2024-03-09T14:40:40.677 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_lba 2024-03-09T14:40:40.678 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:40:40.678 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cache 2024-03-09T14:40:40.678 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_journal 2024-03-09T14:40:40.678 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_device 2024-03-09T14:40:40.678 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_backref 2024-03-09T14:40:40.678 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 alienstore 2024-03-09T14:40:40.678 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mclock 2024-03-09T14:40:40.678 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cyanstore 2024-03-09T14:40:40.678 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 ceph_exporter 2024-03-09T14:40:40.678 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 memstore 2024-03-09T14:40:40.678 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 trace 2024-03-09T14:40:40.678 INFO:tasks.workunit.client.0.smithi088.stderr: -2/-2 (syslog threshold) 2024-03-09T14:40:40.678 INFO:tasks.workunit.client.0.smithi088.stderr: 99/99 (stderr threshold) 2024-03-09T14:40:40.678 INFO:tasks.workunit.client.0.smithi088.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:40:40.678 INFO:tasks.workunit.client.0.smithi088.stderr: 7f77b37fe640 / http_manager 2024-03-09T14:40:40.679 INFO:tasks.workunit.client.0.smithi088.stderr: 7f7841fdb640 / http_manager 2024-03-09T14:40:40.679 INFO:tasks.workunit.client.0.smithi088.stderr: 7f7842fdd640 / rgw_dt_lg_renew 2024-03-09T14:40:40.679 INFO:tasks.workunit.client.0.smithi088.stderr: 7f7861ffb640 / ms_dispatch 2024-03-09T14:40:40.679 INFO:tasks.workunit.client.0.smithi088.stderr: 7f78637fe640 / io_context_pool 2024-03-09T14:40:40.679 INFO:tasks.workunit.client.0.smithi088.stderr: 7f7871ffb640 / ms_dispatch 2024-03-09T14:40:40.679 INFO:tasks.workunit.client.0.smithi088.stderr: 7f7878e09640 / ms_dispatch 2024-03-09T14:40:40.679 INFO:tasks.workunit.client.0.smithi088.stderr: 7f787a60c640 / io_context_pool 2024-03-09T14:40:40.679 INFO:tasks.workunit.client.0.smithi088.stderr: 7f798ba0c640 / msgr-worker-2 2024-03-09T14:40:40.679 INFO:tasks.workunit.client.0.smithi088.stderr: 7f798c20d640 / msgr-worker-1 2024-03-09T14:40:40.679 INFO:tasks.workunit.client.0.smithi088.stderr: 7f798ca0e640 / msgr-worker-0 2024-03-09T14:40:40.679 INFO:tasks.workunit.client.0.smithi088.stderr: 7f798d20f640 / io_context_pool 2024-03-09T14:40:40.679 INFO:tasks.workunit.client.0.smithi088.stderr: 7f798e711800 / radosgw-admin 2024-03-09T14:40:40.679 INFO:tasks.workunit.client.0.smithi088.stderr: max_recent 500 2024-03-09T14:40:40.679 INFO:tasks.workunit.client.0.smithi088.stderr: max_new 1000 2024-03-09T14:40:40.679 INFO:tasks.workunit.client.0.smithi088.stderr: log_file /var/lib/ceph/crash/2024-03-09T14:40:40.554577Z_f8ac34ff-add1-4256-a004-902c492234cd/log 2024-03-09T14:40:40.680 INFO:tasks.workunit.client.0.smithi088.stderr:--- end dump of recent events --- 2024-03-09T14:40:40.680 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-03-09T14:40:40.681 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:40.681 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:40.681 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.624+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.681 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.625+0000 7f14db011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.625+0000 7f14db011800 20 realm 2024-03-09T14:40:40.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.625+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.625+0000 7f14db011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.625+0000 7f14db011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:40.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.626+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.626+0000 7f14db011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.626+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.627+0000 7f14db011800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:40.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.627+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.627+0000 7f14db011800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:40.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.627+0000 7f14db011800 20 searching for the correct realm 2024-03-09T14:40:40.682 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.629+0000 7f14d930e640 0 -- 172.21.15.88:0/2254174041 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f14d405e570 msgr2=0x7f14d4088a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:40.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:40.835+0000 7f14d3fff640 0 -- 172.21.15.88:0/2254174041 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f14d4077750 msgr2=0x7f14d4056b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:41.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:41.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:41.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:41.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:41.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:41.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:41.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:41.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:41.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 20 zone default found 2024-03-09T14:40:41.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 4 Realm: () 2024-03-09T14:40:41.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:41.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:41.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:41.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 20 zonegroup default 2024-03-09T14:40:41.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.042+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.043+0000 7f14db011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.043+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.043+0000 7f14db011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.043+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.043+0000 7f14db011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.043+0000 7f14db011800 20 started sync module instance, tier type = 2024-03-09T14:40:41.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.043+0000 7f14db011800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:41.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.053+0000 7f14db011800 20 add_watcher() i=0 2024-03-09T14:40:41.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.053+0000 7f14db011800 20 add_watcher() i=1 2024-03-09T14:40:41.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.053+0000 7f14db011800 20 add_watcher() i=2 2024-03-09T14:40:41.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.053+0000 7f14db011800 20 add_watcher() i=3 2024-03-09T14:40:41.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.053+0000 7f14db011800 20 add_watcher() i=4 2024-03-09T14:40:41.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.053+0000 7f14db011800 20 add_watcher() i=5 2024-03-09T14:40:41.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.053+0000 7f14db011800 20 add_watcher() i=6 2024-03-09T14:40:41.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.054+0000 7f14db011800 20 add_watcher() i=7 2024-03-09T14:40:41.055 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.054+0000 7f14db011800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:41.056 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.056+0000 7f138efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:41.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.056+0000 7f14db011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:41.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.056+0000 7f14db011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:41.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.056+0000 7f14db011800 5 note: GC not initialized 2024-03-09T14:40:41.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.056+0000 7f138dfe3640 20 reqs_thread_entry: start 2024-03-09T14:40:41.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.056+0000 7f14db011800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:41.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.056+0000 7f14db011800 20 Filter name: none 2024-03-09T14:40:41.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.056+0000 7f12ff7fe640 20 reqs_thread_entry: start 2024-03-09T14:40:41.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.056+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.058 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.057+0000 7f14db011800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:41.058 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.057+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.058+0000 7f14db011800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:41.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.058+0000 7f14db011800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:41.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.058+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.058+0000 7f14db011800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:41.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.058+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.059+0000 7f14db011800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:41.060 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.059+0000 7f14db011800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:41.060 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.059+0000 7f14db011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.060 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.060+0000 7f14db011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.061 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.061+0000 7f138efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:41.063 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.063+0000 7f14db011800 20 remove_watcher() i=0 2024-03-09T14:40:41.063 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.063+0000 7f14db011800 2 removed watcher, disabling cache 2024-03-09T14:40:41.064 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.064+0000 7f14db011800 20 remove_watcher() i=1 2024-03-09T14:40:41.066 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.065+0000 7f14db011800 20 remove_watcher() i=2 2024-03-09T14:40:41.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.066+0000 7f14db011800 20 remove_watcher() i=3 2024-03-09T14:40:41.068 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.067+0000 7f14db011800 20 remove_watcher() i=4 2024-03-09T14:40:41.069 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.068+0000 7f14db011800 20 remove_watcher() i=5 2024-03-09T14:40:41.070 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.069+0000 7f14db011800 20 remove_watcher() i=6 2024-03-09T14:40:41.071 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.070+0000 7f14db011800 20 remove_watcher() i=7 2024-03-09T14:40:41.080 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:41.080 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:40:41.080 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: abort-at-set-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:40:41.080 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:40:41.167 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:40:41.199 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:41.199 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:41.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.232+0000 7ff226d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.234+0000 7ff226d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.234+0000 7ff226d2d800 20 realm 2024-03-09T14:40:41.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.234+0000 7ff226d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.234+0000 7ff226d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.234+0000 7ff226d2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:41.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.234+0000 7ff226d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.234+0000 7ff226d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.234+0000 7ff226d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.236 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.235+0000 7ff226d2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:41.236 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.235+0000 7ff226d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.236 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.236+0000 7ff226d2d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:41.236 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.236+0000 7ff226d2d800 20 searching for the correct realm 2024-03-09T14:40:41.239 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.238+0000 7ff223265640 0 -- 172.21.15.88:0/3648214745 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7ff21c066070 msgr2=0x7ff21c067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:41.444 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.443+0000 7ff222263640 0 -- 172.21.15.88:0/3648214745 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7ff21c08b870 msgr2=0x7ff21c088400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:41.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.649+0000 7ff226d2d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:40:41.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.649+0000 7ff226d2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:41.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.649+0000 7ff226d2d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:40:41.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.649+0000 7ff226d2d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:41.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.649+0000 7ff226d2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:41.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.649+0000 7ff226d2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:41.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.649+0000 7ff226d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.650+0000 7ff226d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.650+0000 7ff226d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.650+0000 7ff226d2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:41.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.650+0000 7ff226d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.650+0000 7ff226d2d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:41.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.651+0000 7ff226d2d800 20 zone default found 2024-03-09T14:40:41.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.651+0000 7ff226d2d800 4 Realm: () 2024-03-09T14:40:41.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.651+0000 7ff226d2d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:40:41.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.651+0000 7ff226d2d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:40:41.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.651+0000 7ff226d2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:41.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.651+0000 7ff226d2d800 20 zonegroup default 2024-03-09T14:40:41.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.651+0000 7ff226d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.651+0000 7ff226d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.651+0000 7ff226d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.651+0000 7ff226d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.651+0000 7ff226d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.652+0000 7ff226d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.652+0000 7ff226d2d800 20 started sync module instance, tier type = 2024-03-09T14:40:41.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.652+0000 7ff226d2d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:40:41.662 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.661+0000 7ff226d2d800 20 add_watcher() i=0 2024-03-09T14:40:41.662 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.661+0000 7ff226d2d800 20 add_watcher() i=1 2024-03-09T14:40:41.662 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.661+0000 7ff226d2d800 20 add_watcher() i=2 2024-03-09T14:40:41.662 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.661+0000 7ff226d2d800 20 add_watcher() i=3 2024-03-09T14:40:41.662 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.661+0000 7ff226d2d800 20 add_watcher() i=4 2024-03-09T14:40:41.662 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.661+0000 7ff226d2d800 20 add_watcher() i=5 2024-03-09T14:40:41.662 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.661+0000 7ff226d2d800 20 add_watcher() i=6 2024-03-09T14:40:41.663 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.662+0000 7ff226d2d800 20 add_watcher() i=7 2024-03-09T14:40:41.663 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.662+0000 7ff226d2d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:41.665 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.664+0000 7ff0d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:41.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.665+0000 7ff226d2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:41.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.665+0000 7ff226d2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:41.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.665+0000 7ff226d2d800 5 note: GC not initialized 2024-03-09T14:40:41.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.665+0000 7ff053fff640 20 reqs_thread_entry: start 2024-03-09T14:40:41.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.665+0000 7ff226d2d800 20 init_complete bucket index max shards: 11 2024-03-09T14:40:41.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.665+0000 7ff226d2d800 20 Filter name: none 2024-03-09T14:40:41.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.665+0000 7ff051ffb640 20 reqs_thread_entry: start 2024-03-09T14:40:41.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.665+0000 7ff226d2d800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-09T14:40:41.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.665+0000 7ff226d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.666+0000 7ff226d2d800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:40:41.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.666+0000 7ff226d2d800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-09T14:40:41.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.666+0000 7ff226d2d800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-09T14:40:41.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.666+0000 7ff226d2d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 : miss 2024-03-09T14:40:41.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.666+0000 7ff226d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.666+0000 7ff226d2d800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:40:41.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.666+0000 7ff226d2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 info.flags=0x17 2024-03-09T14:40:41.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.666+0000 7ff226d2d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 to cache LRU end 2024-03-09T14:40:41.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.666+0000 7ff226d2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:41.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.666+0000 7ff226d2d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:41.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.666+0000 7ff226d2d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 2024-03-09T14:40:41.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.668+0000 7ff226d2d800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 to be held by another RGW process; skipping for now 2024-03-09T14:40:41.669 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.668+0000 7ff0d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:41.672 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.671+0000 7ff226d2d800 20 remove_watcher() i=0 2024-03-09T14:40:41.672 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.671+0000 7ff226d2d800 2 removed watcher, disabling cache 2024-03-09T14:40:41.672 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.672+0000 7ff226d2d800 20 remove_watcher() i=1 2024-03-09T14:40:41.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.673+0000 7ff226d2d800 20 remove_watcher() i=2 2024-03-09T14:40:41.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.674+0000 7ff226d2d800 20 remove_watcher() i=3 2024-03-09T14:40:41.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.675+0000 7ff226d2d800 20 remove_watcher() i=4 2024-03-09T14:40:41.677 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.676+0000 7ff226d2d800 20 remove_watcher() i=5 2024-03-09T14:40:41.678 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.677+0000 7ff226d2d800 20 remove_watcher() i=6 2024-03-09T14:40:41.679 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:40:41.678+0000 7ff226d2d800 20 remove_watcher() i=7 2024-03-09T14:40:41.688 INFO:tasks.workunit.client.0.smithi088.stderr:waiting 30 seconds for reshard lock to expire... 2024-03-09T14:41:11.713 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:41:11.748 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:11.748 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:11.786 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:11.786+0000 7fe762439800 20 rados->read ofs=0 len=0 2024-03-09T14:41:11.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:11.787+0000 7fe762439800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:11.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:11.787+0000 7fe762439800 20 realm 2024-03-09T14:41:11.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:11.787+0000 7fe762439800 20 rados->read ofs=0 len=0 2024-03-09T14:41:11.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:11.787+0000 7fe762439800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:11.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:11.787+0000 7fe762439800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:11.789 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:11.787+0000 7fe762439800 20 rados->read ofs=0 len=0 2024-03-09T14:41:11.789 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:11.787+0000 7fe762439800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:11.789 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:11.787+0000 7fe762439800 20 rados->read ofs=0 len=0 2024-03-09T14:41:11.789 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:11.788+0000 7fe762439800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:11.789 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:11.789+0000 7fe762439800 20 rados->read ofs=0 len=0 2024-03-09T14:41:11.790 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:11.789+0000 7fe762439800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:11.790 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:11.789+0000 7fe762439800 20 searching for the correct realm 2024-03-09T14:41:11.793 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:11.792+0000 7fe75c9a8640 0 -- 172.21.15.88:0/766071661 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7fe7500540d0 msgr2=0x7fe75006b110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:11.797 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:11.796+0000 7fe75c9a8640 0 -- 172.21.15.88:0/766071661 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fe75801f410 msgr2=0x7fe75801f890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:12.004 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.003+0000 7fe762439800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:12.004 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.003+0000 7fe762439800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:12.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.003+0000 7fe762439800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:12.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.003+0000 7fe762439800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:12.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.003+0000 7fe762439800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:12.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.003+0000 7fe762439800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:12.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.003+0000 7fe762439800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.003+0000 7fe762439800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:12.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.003+0000 7fe762439800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.004+0000 7fe762439800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:12.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.004+0000 7fe762439800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.004+0000 7fe762439800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:12.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.004+0000 7fe762439800 20 zone default found 2024-03-09T14:41:12.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.004+0000 7fe762439800 4 Realm: () 2024-03-09T14:41:12.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.004+0000 7fe762439800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:12.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.004+0000 7fe762439800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:12.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.004+0000 7fe762439800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:12.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.004+0000 7fe762439800 20 zonegroup default 2024-03-09T14:41:12.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.004+0000 7fe762439800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.004+0000 7fe762439800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:12.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.004+0000 7fe762439800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.005+0000 7fe762439800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:12.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.005+0000 7fe762439800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.005+0000 7fe762439800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:12.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.005+0000 7fe762439800 20 started sync module instance, tier type = 2024-03-09T14:41:12.008 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.005+0000 7fe762439800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:12.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.015+0000 7fe762439800 20 add_watcher() i=0 2024-03-09T14:41:12.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.015+0000 7fe762439800 20 add_watcher() i=1 2024-03-09T14:41:12.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.015+0000 7fe762439800 20 add_watcher() i=2 2024-03-09T14:41:12.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.015+0000 7fe762439800 20 add_watcher() i=3 2024-03-09T14:41:12.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.015+0000 7fe762439800 20 add_watcher() i=4 2024-03-09T14:41:12.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.015+0000 7fe762439800 20 add_watcher() i=5 2024-03-09T14:41:12.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.015+0000 7fe762439800 20 add_watcher() i=6 2024-03-09T14:41:12.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.016+0000 7fe762439800 20 add_watcher() i=7 2024-03-09T14:41:12.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.016+0000 7fe762439800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:12.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.018+0000 7fe6137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:12.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.018+0000 7fe762439800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:12.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.018+0000 7fe762439800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:12.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.018+0000 7fe762439800 5 note: GC not initialized 2024-03-09T14:41:12.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.018+0000 7fe6127e4640 20 reqs_thread_entry: start 2024-03-09T14:41:12.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.018+0000 7fe762439800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:12.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.018+0000 7fe762439800 20 Filter name: none 2024-03-09T14:41:12.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.019+0000 7fe583fff640 20 reqs_thread_entry: start 2024-03-09T14:41:12.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.019+0000 7fe762439800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-09T14:41:12.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.019+0000 7fe762439800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.019+0000 7fe762439800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:41:12.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.019+0000 7fe762439800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-09T14:41:12.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.019+0000 7fe762439800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-09T14:41:12.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.019+0000 7fe762439800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 : miss 2024-03-09T14:41:12.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.019+0000 7fe762439800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.020+0000 7fe762439800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:41:12.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.020+0000 7fe762439800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 info.flags=0x17 2024-03-09T14:41:12.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.020+0000 7fe762439800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 to cache LRU end 2024-03-09T14:41:12.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.020+0000 7fe762439800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:12.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.020+0000 7fe762439800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:12.022 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.020+0000 7fe762439800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 2024-03-09T14:41:12.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.025+0000 7fe762439800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 info.flags=0x17 2024-03-09T14:41:12.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.025+0000 7fe762439800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 to cache LRU end 2024-03-09T14:41:12.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.025+0000 7fe762439800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:12.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.025+0000 7fe762439800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21, ofs0, ns] 2024-03-09T14:41:12.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.025+0000 7fe62ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464339 cookie 94289609459744 notifier 6083 bl.length()=917 2024-03-09T14:41:12.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.025+0000 7fe62ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 info.flags=0x17 2024-03-09T14:41:12.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.025+0000 7fe62ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 to cache LRU end 2024-03-09T14:41:12.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.025+0000 7fe62ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:12.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.027+0000 7fe762439800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.21]): orig_sources= new_sources= 2024-03-09T14:41:12.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.027+0000 7fe762439800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.21]): potential sources added=[] removed=[] 2024-03-09T14:41:12.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.027+0000 7fe762439800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.21]): orig_dests= new_dests= 2024-03-09T14:41:12.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.027+0000 7fe762439800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.21]): potential dests added=[] removed=[] 2024-03-09T14:41:12.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.0 2024-03-09T14:41:12.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.0 2024-03-09T14:41:12.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.1 2024-03-09T14:41:12.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.1 2024-03-09T14:41:12.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.2 2024-03-09T14:41:12.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.2 2024-03-09T14:41:12.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.3 2024-03-09T14:41:12.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.3 2024-03-09T14:41:12.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.4 2024-03-09T14:41:12.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.4 2024-03-09T14:41:12.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.5 2024-03-09T14:41:12.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.5 2024-03-09T14:41:12.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.6 2024-03-09T14:41:12.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.6 2024-03-09T14:41:12.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.7 2024-03-09T14:41:12.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.7 2024-03-09T14:41:12.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.8 2024-03-09T14:41:12.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.8 2024-03-09T14:41:12.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.9 2024-03-09T14:41:12.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.9 2024-03-09T14:41:12.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.10 2024-03-09T14:41:12.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.10 2024-03-09T14:41:12.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.11 2024-03-09T14:41:12.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1.11 2024-03-09T14:41:12.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.032+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.0 2024-03-09T14:41:12.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.033+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.1 2024-03-09T14:41:12.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.033+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.2 2024-03-09T14:41:12.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.034+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.3 2024-03-09T14:41:12.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.034+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.4 2024-03-09T14:41:12.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.035+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.5 2024-03-09T14:41:12.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.035+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.6 2024-03-09T14:41:12.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.036+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.7 2024-03-09T14:41:12.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.037+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.8 2024-03-09T14:41:12.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.037+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.9 2024-03-09T14:41:12.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.038+0000 7fe762439800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.21.10 2024-03-09T14:41:12.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.042+0000 7fe762439800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 : hit (requested=0x17, cached=0x17) 2024-03-09T14:41:12.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.042+0000 7fe762439800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 2024-03-09T14:41:12.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.043+0000 7fe762439800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 info.flags=0x17 2024-03-09T14:41:12.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.043+0000 7fe762439800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 to cache LRU end 2024-03-09T14:41:12.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.043+0000 7fe762439800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:12.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.043+0000 7fe762439800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21, ofs0, ns] 2024-03-09T14:41:12.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.044+0000 7fe640ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464340 cookie 94289609459744 notifier 6083 bl.length()=885 2024-03-09T14:41:12.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.044+0000 7fe640ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 info.flags=0x17 2024-03-09T14:41:12.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.044+0000 7fe640ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.21 to cache LRU end 2024-03-09T14:41:12.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.044+0000 7fe640ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:12.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.045+0000 7fe762439800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.21]): orig_sources= new_sources= 2024-03-09T14:41:12.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.045+0000 7fe762439800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.21]): potential sources added=[] removed=[] 2024-03-09T14:41:12.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.045+0000 7fe762439800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.21]): orig_dests= new_dests= 2024-03-09T14:41:12.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.045+0000 7fe762439800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.21]): potential dests added=[] removed=[] 2024-03-09T14:41:12.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.050+0000 7fe762439800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" completed successfully 2024-03-09T14:41:12.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.052+0000 7fe6137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:12.055 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.054+0000 7fe762439800 20 remove_watcher() i=0 2024-03-09T14:41:12.055 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.054+0000 7fe762439800 2 removed watcher, disabling cache 2024-03-09T14:41:12.056 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.055+0000 7fe762439800 20 remove_watcher() i=1 2024-03-09T14:41:12.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.056+0000 7fe762439800 20 remove_watcher() i=2 2024-03-09T14:41:12.058 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.058+0000 7fe762439800 20 remove_watcher() i=3 2024-03-09T14:41:12.060 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.059+0000 7fe762439800 20 remove_watcher() i=4 2024-03-09T14:41:12.061 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.060+0000 7fe762439800 20 remove_watcher() i=5 2024-03-09T14:41:12.061 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.061+0000 7fe762439800 20 remove_watcher() i=6 2024-03-09T14:41:12.062 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.062+0000 7fe762439800 20 remove_watcher() i=7 2024-03-09T14:41:12.074 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-03-09T14:41:12.101 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:12.101 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:12.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.134+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.136+0000 7f1ff5329800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:12.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.136+0000 7f1ff5329800 20 realm 2024-03-09T14:41:12.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.136+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.136+0000 7f1ff5329800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:12.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.136+0000 7f1ff5329800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:12.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.136+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.136+0000 7f1ff5329800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:12.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.136+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.137+0000 7f1ff5329800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:12.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.137+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.138+0000 7f1ff5329800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:12.139 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.138+0000 7f1ff5329800 20 searching for the correct realm 2024-03-09T14:41:12.141 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.141+0000 7f1ff1751640 0 -- 172.21.15.88:0/1065476364 >> [v2:172.21.15.88:6805/1625923178,v1:172.21.15.88:6809/1625923178] conn(0x55df8be305d0 msgr2=0x55df8be32a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:12.145 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.144+0000 7f1fe874f640 0 -- 172.21.15.88:0/1065476364 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f1fec065b00 msgr2=0x7f1fec0b3450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:12.149 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.148+0000 7f1ff5329800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:12.149 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.148+0000 7f1ff5329800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:12.149 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.148+0000 7f1ff5329800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:12.149 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.148+0000 7f1ff5329800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:12.149 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.148+0000 7f1ff5329800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:12.149 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.148+0000 7f1ff5329800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:12.149 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.148+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.149 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.148+0000 7f1ff5329800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:12.150 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.148+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.150 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.148+0000 7f1ff5329800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:12.150 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.148+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.151 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.149+0000 7f1ff5329800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:12.151 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.149+0000 7f1ff5329800 20 zone default found 2024-03-09T14:41:12.151 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.149+0000 7f1ff5329800 4 Realm: () 2024-03-09T14:41:12.151 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.149+0000 7f1ff5329800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:12.151 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.149+0000 7f1ff5329800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:12.151 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.149+0000 7f1ff5329800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:12.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.149+0000 7f1ff5329800 20 zonegroup default 2024-03-09T14:41:12.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.149+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.149+0000 7f1ff5329800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:12.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.149+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.149+0000 7f1ff5329800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:12.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.149+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.150+0000 7f1ff5329800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:12.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.150+0000 7f1ff5329800 20 started sync module instance, tier type = 2024-03-09T14:41:12.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.150+0000 7f1ff5329800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:12.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.158+0000 7f1ff5329800 20 add_watcher() i=0 2024-03-09T14:41:12.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.158+0000 7f1ff5329800 20 add_watcher() i=1 2024-03-09T14:41:12.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.158+0000 7f1ff5329800 20 add_watcher() i=2 2024-03-09T14:41:12.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.158+0000 7f1ff5329800 20 add_watcher() i=3 2024-03-09T14:41:12.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.158+0000 7f1ff5329800 20 add_watcher() i=4 2024-03-09T14:41:12.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.158+0000 7f1ff5329800 20 add_watcher() i=5 2024-03-09T14:41:12.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.158+0000 7f1ff5329800 20 add_watcher() i=6 2024-03-09T14:41:12.160 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.159+0000 7f1ff5329800 20 add_watcher() i=7 2024-03-09T14:41:12.160 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.159+0000 7f1ff5329800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:12.161 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.161+0000 7f1ea6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:12.162 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.161+0000 7f1ff5329800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:12.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.161+0000 7f1ff5329800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:12.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.161+0000 7f1ff5329800 5 note: GC not initialized 2024-03-09T14:41:12.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.161+0000 7f1ea5fe3640 20 reqs_thread_entry: start 2024-03-09T14:41:12.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.161+0000 7f1ff5329800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:12.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.161+0000 7f1ff5329800 20 Filter name: none 2024-03-09T14:41:12.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.162+0000 7f1e177fe640 20 reqs_thread_entry: start 2024-03-09T14:41:12.163 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.162+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.162+0000 7f1ff5329800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:41:12.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.162+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.163+0000 7f1ff5329800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:41:12.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.163+0000 7f1ff5329800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:12.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.163+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.163+0000 7f1ff5329800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:41:12.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.163+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.164+0000 7f1ff5329800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:41:12.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.164+0000 7f1ff5329800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:12.166 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.164+0000 7f1ff5329800 20 rados->read ofs=0 len=0 2024-03-09T14:41:12.166 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.165+0000 7f1ff5329800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:12.166 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.165+0000 7f1ea6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:12.168 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.168+0000 7f1ff5329800 20 remove_watcher() i=0 2024-03-09T14:41:12.168 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.168+0000 7f1ff5329800 2 removed watcher, disabling cache 2024-03-09T14:41:12.169 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.169+0000 7f1ff5329800 20 remove_watcher() i=1 2024-03-09T14:41:12.170 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.170+0000 7f1ff5329800 20 remove_watcher() i=2 2024-03-09T14:41:12.171 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.171+0000 7f1ff5329800 20 remove_watcher() i=3 2024-03-09T14:41:12.172 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.172+0000 7f1ff5329800 20 remove_watcher() i=4 2024-03-09T14:41:12.173 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.173+0000 7f1ff5329800 20 remove_watcher() i=5 2024-03-09T14:41:12.174 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.174+0000 7f1ff5329800 20 remove_watcher() i=6 2024-03-09T14:41:12.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:12.174+0000 7f1ff5329800 20 remove_watcher() i=7 2024-03-09T14:41:12.185 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:12.185 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:41:12.185 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: abort-at-set-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:41:12.185 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:12.508 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-03-09T14:41:12.508 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:13.248 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-03-09T14:41:13.275 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:13.275 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:13.308 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.307+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.309+0000 7fc4c1c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.309+0000 7fc4c1c39800 20 realm 2024-03-09T14:41:13.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.309+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.309+0000 7fc4c1c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.309+0000 7fc4c1c39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:13.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.309+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.309+0000 7fc4c1c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.309+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.311 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.310+0000 7fc4c1c39800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:13.311 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.310+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.311 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.310+0000 7fc4c1c39800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:13.311 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.310+0000 7fc4c1c39800 20 searching for the correct realm 2024-03-09T14:41:13.312 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.312+0000 7fc4bd070640 0 -- 172.21.15.88:0/310514779 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x55f451170f20 msgr2=0x55f451173310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:13.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.315+0000 7fc4bd070640 0 -- 172.21.15.88:0/310514779 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x7fc38807ad10 msgr2=0x7fc38807d140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:13.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.320+0000 7fc4c1c39800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:13.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.320+0000 7fc4c1c39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:13.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.320+0000 7fc4c1c39800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:13.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.320+0000 7fc4c1c39800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:13.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.320+0000 7fc4c1c39800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:13.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.320+0000 7fc4c1c39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:13.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.320+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.321+0000 7fc4c1c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.321+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.321+0000 7fc4c1c39800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:13.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.321+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.321+0000 7fc4c1c39800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:13.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.321+0000 7fc4c1c39800 20 zone default found 2024-03-09T14:41:13.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.321+0000 7fc4c1c39800 4 Realm: () 2024-03-09T14:41:13.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.321+0000 7fc4c1c39800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:13.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.321+0000 7fc4c1c39800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:13.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.321+0000 7fc4c1c39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:13.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.321+0000 7fc4c1c39800 20 zonegroup default 2024-03-09T14:41:13.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.321+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.321+0000 7fc4c1c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.321+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.322+0000 7fc4c1c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.322+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.324 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.322+0000 7fc4c1c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.322+0000 7fc4c1c39800 20 started sync module instance, tier type = 2024-03-09T14:41:13.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.322+0000 7fc4c1c39800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:13.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.330+0000 7fc4c1c39800 20 add_watcher() i=0 2024-03-09T14:41:13.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.330+0000 7fc4c1c39800 20 add_watcher() i=1 2024-03-09T14:41:13.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.330+0000 7fc4c1c39800 20 add_watcher() i=2 2024-03-09T14:41:13.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.330+0000 7fc4c1c39800 20 add_watcher() i=3 2024-03-09T14:41:13.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.330+0000 7fc4c1c39800 20 add_watcher() i=4 2024-03-09T14:41:13.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.330+0000 7fc4c1c39800 20 add_watcher() i=5 2024-03-09T14:41:13.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.330+0000 7fc4c1c39800 20 add_watcher() i=6 2024-03-09T14:41:13.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.331+0000 7fc4c1c39800 20 add_watcher() i=7 2024-03-09T14:41:13.332 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.331+0000 7fc4c1c39800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:13.333 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.332+0000 7fc372fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:13.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.332+0000 7fc4c1c39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:13.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.333+0000 7fc4c1c39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:13.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.333+0000 7fc4c1c39800 5 note: GC not initialized 2024-03-09T14:41:13.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.333+0000 7fc371fe3640 20 reqs_thread_entry: start 2024-03-09T14:41:13.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.333+0000 7fc4c1c39800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:13.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.333+0000 7fc4c1c39800 20 Filter name: none 2024-03-09T14:41:13.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.333+0000 7fc2e37fe640 20 reqs_thread_entry: start 2024-03-09T14:41:13.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.333+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.335 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.334+0000 7fc4c1c39800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:13.335 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.334+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.335 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.334+0000 7fc4c1c39800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:41:13.335 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.334+0000 7fc4c1c39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:13.336 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.334+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.336 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.335+0000 7fc4c1c39800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:13.336 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.335+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.337 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.335+0000 7fc4c1c39800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:41:13.337 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.335+0000 7fc4c1c39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:13.337 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.336+0000 7fc4c1c39800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.337 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.336+0000 7fc4c1c39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.337 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.337+0000 7fc372fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:13.339 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.339+0000 7fc4c1c39800 20 remove_watcher() i=0 2024-03-09T14:41:13.339 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.339+0000 7fc4c1c39800 2 removed watcher, disabling cache 2024-03-09T14:41:13.340 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.340+0000 7fc4c1c39800 20 remove_watcher() i=1 2024-03-09T14:41:13.341 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.341+0000 7fc4c1c39800 20 remove_watcher() i=2 2024-03-09T14:41:13.342 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.342+0000 7fc4c1c39800 20 remove_watcher() i=3 2024-03-09T14:41:13.343 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.342+0000 7fc4c1c39800 20 remove_watcher() i=4 2024-03-09T14:41:13.344 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.343+0000 7fc4c1c39800 20 remove_watcher() i=5 2024-03-09T14:41:13.345 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.344+0000 7fc4c1c39800 20 remove_watcher() i=6 2024-03-09T14:41:13.346 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.345+0000 7fc4c1c39800 20 remove_watcher() i=7 2024-03-09T14:41:13.356 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:13.356 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:41:13.356 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-block-writes id: 5d93e872-363b-498b-b665-658644296b85.4535.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:41:13.356 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:13.357 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-03-09T14:41:13.389 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:13.389 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:13.423 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.422+0000 7f720ea1e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.424 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.424+0000 7f720ea1e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.424+0000 7f720ea1e800 20 realm 2024-03-09T14:41:13.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.424+0000 7f720ea1e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.424+0000 7f720ea1e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.424+0000 7f720ea1e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:13.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.424+0000 7f720ea1e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.424+0000 7f720ea1e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.424+0000 7f720ea1e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.425 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.425+0000 7f720ea1e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:13.426 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.425+0000 7f720ea1e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.426 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.426+0000 7f720ea1e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:13.426 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.426+0000 7f720ea1e800 20 searching for the correct realm 2024-03-09T14:41:13.427 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.426+0000 7f720c51a640 0 -- 172.21.15.88:0/2694569678 >> [v2:172.21.15.88:6800/4216886240,v1:172.21.15.88:6802/4216886240] conn(0x5636f4a41e50 msgr2=0x5636f4a44310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:13.430 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.430+0000 7f720c51a640 0 -- 172.21.15.88:0/2694569678 >> [v2:172.21.15.132:6824/731564406,v1:172.21.15.132:6825/731564406] conn(0x5636f47d0e10 msgr2=0x7f72040943f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:13.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.637+0000 7f720ea1e800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:13.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.637+0000 7f720ea1e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:13.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.637+0000 7f720ea1e800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:13.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.637+0000 7f720ea1e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:13.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.637+0000 7f720ea1e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:13.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.637+0000 7f720ea1e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:13.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.637+0000 7f720ea1e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.638+0000 7f720ea1e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.638+0000 7f720ea1e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.638+0000 7f720ea1e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:13.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.638+0000 7f720ea1e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.638+0000 7f720ea1e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:13.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.638+0000 7f720ea1e800 20 zone default found 2024-03-09T14:41:13.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.638+0000 7f720ea1e800 4 Realm: () 2024-03-09T14:41:13.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.638+0000 7f720ea1e800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:13.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.638+0000 7f720ea1e800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:13.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.638+0000 7f720ea1e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:13.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.638+0000 7f720ea1e800 20 zonegroup default 2024-03-09T14:41:13.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.638+0000 7f720ea1e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.639+0000 7f720ea1e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.639+0000 7f720ea1e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.639+0000 7f720ea1e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.639+0000 7f720ea1e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.639+0000 7f720ea1e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.639+0000 7f720ea1e800 20 started sync module instance, tier type = 2024-03-09T14:41:13.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.639+0000 7f720ea1e800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:13.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.648+0000 7f720ea1e800 20 add_watcher() i=0 2024-03-09T14:41:13.649 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.648+0000 7f720ea1e800 20 add_watcher() i=1 2024-03-09T14:41:13.649 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.648+0000 7f720ea1e800 20 add_watcher() i=2 2024-03-09T14:41:13.649 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.648+0000 7f720ea1e800 20 add_watcher() i=3 2024-03-09T14:41:13.649 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.648+0000 7f720ea1e800 20 add_watcher() i=4 2024-03-09T14:41:13.649 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.648+0000 7f720ea1e800 20 add_watcher() i=5 2024-03-09T14:41:13.649 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.648+0000 7f720ea1e800 20 add_watcher() i=6 2024-03-09T14:41:13.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.649+0000 7f720ea1e800 20 add_watcher() i=7 2024-03-09T14:41:13.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.649+0000 7f720ea1e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:13.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.651+0000 7f70c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:13.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.651+0000 7f720ea1e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:13.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.651+0000 7f720ea1e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:13.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.651+0000 7f720ea1e800 5 note: GC not initialized 2024-03-09T14:41:13.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.651+0000 7f70c1fdb640 20 reqs_thread_entry: start 2024-03-09T14:41:13.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.651+0000 7f720ea1e800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:13.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.651+0000 7f720ea1e800 20 Filter name: none 2024-03-09T14:41:13.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.651+0000 7f70337fe640 20 reqs_thread_entry: start 2024-03-09T14:41:13.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.651+0000 7f720ea1e800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-03-09T14:41:13.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.651+0000 7f720ea1e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.652+0000 7f720ea1e800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:13.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.652+0000 7f720ea1e800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-03-09T14:41:13.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.652+0000 7f720ea1e800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-03-09T14:41:13.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.652+0000 7f720ea1e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 : miss 2024-03-09T14:41:13.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.652+0000 7f720ea1e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.653+0000 7f720ea1e800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:41:13.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.653+0000 7f720ea1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 info.flags=0x17 2024-03-09T14:41:13.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.653+0000 7f720ea1e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 to cache LRU end 2024-03-09T14:41:13.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.653+0000 7f720ea1e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:13.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.653+0000 7f720ea1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:13.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.653+0000 7f720ea1e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 2024-03-09T14:41:13.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.658+0000 7f720ea1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 info.flags=0x17 2024-03-09T14:41:13.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.658+0000 7f720ea1e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 to cache LRU end 2024-03-09T14:41:13.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.658+0000 7f720ea1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:13.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.658+0000 7f720ea1e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22, ofs0, ns] 2024-03-09T14:41:13.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.658+0000 7f70e37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464318 cookie 94794032628016 notifier 6399 bl.length()=907 2024-03-09T14:41:13.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.658+0000 7f70e37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 info.flags=0x17 2024-03-09T14:41:13.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.658+0000 7f70e37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 to cache LRU end 2024-03-09T14:41:13.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.658+0000 7f70e37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:13.660 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.659+0000 7f720ea1e800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): orig_sources= new_sources= 2024-03-09T14:41:13.660 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.659+0000 7f720ea1e800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): potential sources added=[] removed=[] 2024-03-09T14:41:13.660 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.659+0000 7f720ea1e800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): orig_dests= new_dests= 2024-03-09T14:41:13.660 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.659+0000 7f720ea1e800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): potential dests added=[] removed=[] 2024-03-09T14:41:13.660 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.660+0000 7f720ea1e800 -1 Injecting error=-5 at location=block_writes 2024-03-09T14:41:13.661 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.660+0000 7f720ea1e800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-03-09T14:41:13.662 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.662+0000 7f720ea1e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 : hit (requested=0x17, cached=0x17) 2024-03-09T14:41:13.662 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.662+0000 7f720ea1e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 2024-03-09T14:41:13.663 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.663+0000 7f720ea1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 info.flags=0x17 2024-03-09T14:41:13.664 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.663+0000 7f720ea1e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 to cache LRU end 2024-03-09T14:41:13.664 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.663+0000 7f720ea1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:13.664 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.663+0000 7f720ea1e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22, ofs0, ns] 2024-03-09T14:41:13.664 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.663+0000 7f70e37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464319 cookie 94794032628016 notifier 6399 bl.length()=875 2024-03-09T14:41:13.664 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.663+0000 7f70e37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 info.flags=0x17 2024-03-09T14:41:13.664 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.663+0000 7f70e37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 to cache LRU end 2024-03-09T14:41:13.665 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.663+0000 7f70e37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:13.665 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.665+0000 7f720ea1e800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): orig_sources= new_sources= 2024-03-09T14:41:13.665 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.665+0000 7f720ea1e800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): potential sources added=[] removed=[] 2024-03-09T14:41:13.665 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.665+0000 7f720ea1e800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): orig_dests= new_dests= 2024-03-09T14:41:13.665 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.665+0000 7f720ea1e800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): potential dests added=[] removed=[] 2024-03-09T14:41:13.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.666+0000 7f70c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:13.669 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.669+0000 7f720ea1e800 20 remove_watcher() i=0 2024-03-09T14:41:13.669 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.669+0000 7f720ea1e800 2 removed watcher, disabling cache 2024-03-09T14:41:13.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.669+0000 7f720ea1e800 20 remove_watcher() i=1 2024-03-09T14:41:13.671 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.670+0000 7f720ea1e800 20 remove_watcher() i=2 2024-03-09T14:41:13.672 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.671+0000 7f720ea1e800 20 remove_watcher() i=3 2024-03-09T14:41:13.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.672+0000 7f720ea1e800 20 remove_watcher() i=4 2024-03-09T14:41:13.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.673+0000 7f720ea1e800 20 remove_watcher() i=5 2024-03-09T14:41:13.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.674+0000 7f720ea1e800 20 remove_watcher() i=6 2024-03-09T14:41:13.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.675+0000 7f720ea1e800 20 remove_watcher() i=7 2024-03-09T14:41:13.687 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-03-09T14:41:13.713 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:13.714 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:13.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.746+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.747+0000 7f49fe12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.747+0000 7f49fe12f800 20 realm 2024-03-09T14:41:13.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.747+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.747+0000 7f49fe12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.747+0000 7f49fe12f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:13.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.747+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.747+0000 7f49fe12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:13.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.747+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.748+0000 7f49fe12f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:13.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.748+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:13.751 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.749+0000 7f49fe12f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:13.751 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.749+0000 7f49fe12f800 20 searching for the correct realm 2024-03-09T14:41:13.751 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.750+0000 7f49fa5b1640 0 -- 172.21.15.88:0/1532399697 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f49f405c910 msgr2=0x7f49f4062a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:13.957 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:13.957+0000 7f49f15af640 0 -- 172.21.15.88:0/1532399697 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f49f405c010 msgr2=0x7f49f4061160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:14.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.163+0000 7f49fe12f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:14.164 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.163+0000 7f49fe12f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:14.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.163+0000 7f49fe12f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:14.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.163+0000 7f49fe12f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:14.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.163+0000 7f49fe12f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:14.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.163+0000 7f49fe12f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:14.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.163+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.163+0000 7f49fe12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.163+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.164+0000 7f49fe12f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:14.165 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.164+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.166 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.164+0000 7f49fe12f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:14.166 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.164+0000 7f49fe12f800 20 zone default found 2024-03-09T14:41:14.166 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.164+0000 7f49fe12f800 4 Realm: () 2024-03-09T14:41:14.166 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.164+0000 7f49fe12f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:14.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.164+0000 7f49fe12f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:14.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.164+0000 7f49fe12f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:14.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.164+0000 7f49fe12f800 20 zonegroup default 2024-03-09T14:41:14.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.164+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.164+0000 7f49fe12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.164+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.165+0000 7f49fe12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.165+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.165+0000 7f49fe12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.165+0000 7f49fe12f800 20 started sync module instance, tier type = 2024-03-09T14:41:14.167 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.165+0000 7f49fe12f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:14.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.174+0000 7f49fe12f800 20 add_watcher() i=0 2024-03-09T14:41:14.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.174+0000 7f49fe12f800 20 add_watcher() i=1 2024-03-09T14:41:14.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.174+0000 7f49fe12f800 20 add_watcher() i=2 2024-03-09T14:41:14.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.174+0000 7f49fe12f800 20 add_watcher() i=3 2024-03-09T14:41:14.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.174+0000 7f49fe12f800 20 add_watcher() i=4 2024-03-09T14:41:14.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.174+0000 7f49fe12f800 20 add_watcher() i=5 2024-03-09T14:41:14.175 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.174+0000 7f49fe12f800 20 add_watcher() i=6 2024-03-09T14:41:14.176 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.175+0000 7f49fe12f800 20 add_watcher() i=7 2024-03-09T14:41:14.176 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.175+0000 7f49fe12f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:14.177 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.177+0000 7f48ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:14.178 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.177+0000 7f49fe12f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:14.178 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.177+0000 7f49fe12f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:14.178 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.177+0000 7f49fe12f800 5 note: GC not initialized 2024-03-09T14:41:14.179 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.177+0000 7f48aa7fc640 20 reqs_thread_entry: start 2024-03-09T14:41:14.179 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.178+0000 7f49fe12f800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:14.179 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.178+0000 7f49fe12f800 20 Filter name: none 2024-03-09T14:41:14.179 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.178+0000 7f481bfff640 20 reqs_thread_entry: start 2024-03-09T14:41:14.179 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.178+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.180 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.178+0000 7f49fe12f800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:14.180 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.178+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.180 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.179+0000 7f49fe12f800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:41:14.180 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.179+0000 7f49fe12f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:14.180 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.179+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.180 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.179+0000 7f49fe12f800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:14.180 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.179+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.181 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.180+0000 7f49fe12f800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:41:14.181 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.180+0000 7f49fe12f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:14.181 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.181+0000 7f49fe12f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.181 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.181+0000 7f49fe12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.182 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.182+0000 7f48ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:14.184 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.184+0000 7f49fe12f800 20 remove_watcher() i=0 2024-03-09T14:41:14.184 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.184+0000 7f49fe12f800 2 removed watcher, disabling cache 2024-03-09T14:41:14.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.185+0000 7f49fe12f800 20 remove_watcher() i=1 2024-03-09T14:41:14.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.186+0000 7f49fe12f800 20 remove_watcher() i=2 2024-03-09T14:41:14.187 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.187+0000 7f49fe12f800 20 remove_watcher() i=3 2024-03-09T14:41:14.188 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.188+0000 7f49fe12f800 20 remove_watcher() i=4 2024-03-09T14:41:14.189 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.189+0000 7f49fe12f800 20 remove_watcher() i=5 2024-03-09T14:41:14.190 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.190+0000 7f49fe12f800 20 remove_watcher() i=6 2024-03-09T14:41:14.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.191+0000 7f49fe12f800 20 remove_watcher() i=7 2024-03-09T14:41:14.201 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:14.201 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:41:14.201 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-block-writes id: 5d93e872-363b-498b-b665-658644296b85.4535.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:41:14.202 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:14.290 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:41:14.319 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:14.319 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:14.352 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.352+0000 7fb24534b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.354 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.353+0000 7fb24534b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.353+0000 7fb24534b800 20 realm 2024-03-09T14:41:14.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.353+0000 7fb24534b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.353+0000 7fb24534b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.353+0000 7fb24534b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:14.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.353+0000 7fb24534b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.353+0000 7fb24534b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.355 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.353+0000 7fb24534b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.354+0000 7fb24534b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:14.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.354+0000 7fb24534b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.355+0000 7fb24534b800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:14.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.355+0000 7fb24534b800 20 searching for the correct realm 2024-03-09T14:41:14.357 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.356+0000 7fb23a64d640 0 -- 172.21.15.88:0/3066955678 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7fb23402db00 msgr2=0x7fb23403c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:14.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.561+0000 7fb24364f640 0 -- 172.21.15.88:0/3066955678 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x55c78cdbdb80 msgr2=0x55c78cdbff90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:14.568 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.567+0000 7fb24534b800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:14.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.567+0000 7fb24534b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:14.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.567+0000 7fb24534b800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:14.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.567+0000 7fb24534b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:14.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.567+0000 7fb24534b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:14.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.567+0000 7fb24534b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:14.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.567+0000 7fb24534b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.568+0000 7fb24534b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.568+0000 7fb24534b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.568+0000 7fb24534b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:14.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.568+0000 7fb24534b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.568+0000 7fb24534b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:14.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.568+0000 7fb24534b800 20 zone default found 2024-03-09T14:41:14.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.568+0000 7fb24534b800 4 Realm: () 2024-03-09T14:41:14.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.568+0000 7fb24534b800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:14.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.568+0000 7fb24534b800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:14.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.568+0000 7fb24534b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:14.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.568+0000 7fb24534b800 20 zonegroup default 2024-03-09T14:41:14.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.568+0000 7fb24534b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.569+0000 7fb24534b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.569+0000 7fb24534b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.569+0000 7fb24534b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.569+0000 7fb24534b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.569+0000 7fb24534b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.569+0000 7fb24534b800 20 started sync module instance, tier type = 2024-03-09T14:41:14.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.569+0000 7fb24534b800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:14.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.578+0000 7fb24534b800 20 add_watcher() i=0 2024-03-09T14:41:14.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.578+0000 7fb24534b800 20 add_watcher() i=1 2024-03-09T14:41:14.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.578+0000 7fb24534b800 20 add_watcher() i=2 2024-03-09T14:41:14.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.578+0000 7fb24534b800 20 add_watcher() i=3 2024-03-09T14:41:14.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.578+0000 7fb24534b800 20 add_watcher() i=4 2024-03-09T14:41:14.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.578+0000 7fb24534b800 20 add_watcher() i=5 2024-03-09T14:41:14.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.578+0000 7fb24534b800 20 add_watcher() i=6 2024-03-09T14:41:14.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.579+0000 7fb24534b800 20 add_watcher() i=7 2024-03-09T14:41:14.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.579+0000 7fb24534b800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:14.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.581+0000 7fb0f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:14.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.581+0000 7fb24534b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:14.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.581+0000 7fb24534b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:14.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.581+0000 7fb24534b800 5 note: GC not initialized 2024-03-09T14:41:14.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.581+0000 7fb073fff640 20 reqs_thread_entry: start 2024-03-09T14:41:14.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.581+0000 7fb24534b800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:14.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.581+0000 7fb24534b800 20 Filter name: none 2024-03-09T14:41:14.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.581+0000 7fb071ffb640 20 reqs_thread_entry: start 2024-03-09T14:41:14.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.582+0000 7fb24534b800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-03-09T14:41:14.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.582+0000 7fb24534b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.582+0000 7fb24534b800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:14.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.582+0000 7fb24534b800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-03-09T14:41:14.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.582+0000 7fb24534b800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-03-09T14:41:14.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.582+0000 7fb24534b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 : miss 2024-03-09T14:41:14.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.582+0000 7fb24534b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.583+0000 7fb24534b800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:41:14.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.583+0000 7fb24534b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 info.flags=0x17 2024-03-09T14:41:14.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.583+0000 7fb24534b800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 to cache LRU end 2024-03-09T14:41:14.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.583+0000 7fb24534b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:14.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.583+0000 7fb24534b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:14.585 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.583+0000 7fb24534b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 2024-03-09T14:41:14.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.587+0000 7fb24534b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 info.flags=0x17 2024-03-09T14:41:14.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.587+0000 7fb24534b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 to cache LRU end 2024-03-09T14:41:14.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.587+0000 7fb24534b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:14.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.587+0000 7fb24534b800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22, ofs0, ns] 2024-03-09T14:41:14.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.587+0000 7fb125ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464320 cookie 94315550103728 notifier 6164 bl.length()=907 2024-03-09T14:41:14.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.587+0000 7fb125ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 info.flags=0x17 2024-03-09T14:41:14.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.587+0000 7fb125ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 to cache LRU end 2024-03-09T14:41:14.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.587+0000 7fb125ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:14.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.589+0000 7fb24534b800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): orig_sources= new_sources= 2024-03-09T14:41:14.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.589+0000 7fb24534b800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): potential sources added=[] removed=[] 2024-03-09T14:41:14.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.589+0000 7fb24534b800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): orig_dests= new_dests= 2024-03-09T14:41:14.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.589+0000 7fb24534b800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): potential dests added=[] removed=[] 2024-03-09T14:41:14.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.0 2024-03-09T14:41:14.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.0 2024-03-09T14:41:14.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.1 2024-03-09T14:41:14.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.1 2024-03-09T14:41:14.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.2 2024-03-09T14:41:14.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.2 2024-03-09T14:41:14.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.3 2024-03-09T14:41:14.594 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.3 2024-03-09T14:41:14.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.4 2024-03-09T14:41:14.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.4 2024-03-09T14:41:14.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.5 2024-03-09T14:41:14.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.5 2024-03-09T14:41:14.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.6 2024-03-09T14:41:14.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.6 2024-03-09T14:41:14.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.7 2024-03-09T14:41:14.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.7 2024-03-09T14:41:14.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.8 2024-03-09T14:41:14.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.8 2024-03-09T14:41:14.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.9 2024-03-09T14:41:14.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.592+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.9 2024-03-09T14:41:14.595 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.593+0000 7fb24534b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.10 2024-03-09T14:41:14.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.593+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.10 2024-03-09T14:41:14.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.593+0000 7fb24534b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.11 2024-03-09T14:41:14.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.593+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1.11 2024-03-09T14:41:14.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.593+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.0 2024-03-09T14:41:14.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.593+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.1 2024-03-09T14:41:14.597 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.593+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.2 2024-03-09T14:41:14.597 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.594+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.3 2024-03-09T14:41:14.597 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.594+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.4 2024-03-09T14:41:14.597 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.595+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.5 2024-03-09T14:41:14.597 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.595+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.6 2024-03-09T14:41:14.597 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.596+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.7 2024-03-09T14:41:14.597 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.596+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.8 2024-03-09T14:41:14.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.597+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.9 2024-03-09T14:41:14.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.598+0000 7fb24534b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.22.10 2024-03-09T14:41:14.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.601+0000 7fb24534b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 : hit (requested=0x17, cached=0x17) 2024-03-09T14:41:14.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.601+0000 7fb24534b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 2024-03-09T14:41:14.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.602+0000 7fb24534b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 info.flags=0x17 2024-03-09T14:41:14.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.602+0000 7fb24534b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 to cache LRU end 2024-03-09T14:41:14.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.602+0000 7fb24534b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:14.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.602+0000 7fb24534b800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22, ofs0, ns] 2024-03-09T14:41:14.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.602+0000 7fb1267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464321 cookie 94315550103728 notifier 6164 bl.length()=875 2024-03-09T14:41:14.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.602+0000 7fb1267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 info.flags=0x17 2024-03-09T14:41:14.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.602+0000 7fb1267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.22 to cache LRU end 2024-03-09T14:41:14.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.602+0000 7fb1267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:14.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.604+0000 7fb24534b800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): orig_sources= new_sources= 2024-03-09T14:41:14.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.604+0000 7fb24534b800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): potential sources added=[] removed=[] 2024-03-09T14:41:14.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.604+0000 7fb24534b800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): orig_dests= new_dests= 2024-03-09T14:41:14.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.604+0000 7fb24534b800 20 handle_bi_update(): bucket=:error-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.22]): potential dests added=[] removed=[] 2024-03-09T14:41:14.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.607+0000 7fb24534b800 1 execute INFO: reshard of bucket "error-at-block-writes" completed successfully 2024-03-09T14:41:14.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.609+0000 7fb0f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:14.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.611+0000 7fb24534b800 20 remove_watcher() i=0 2024-03-09T14:41:14.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.611+0000 7fb24534b800 2 removed watcher, disabling cache 2024-03-09T14:41:14.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.612+0000 7fb24534b800 20 remove_watcher() i=1 2024-03-09T14:41:14.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.613+0000 7fb24534b800 20 remove_watcher() i=2 2024-03-09T14:41:14.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.614+0000 7fb24534b800 20 remove_watcher() i=3 2024-03-09T14:41:14.615 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.615+0000 7fb24534b800 20 remove_watcher() i=4 2024-03-09T14:41:14.616 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.616+0000 7fb24534b800 20 remove_watcher() i=5 2024-03-09T14:41:14.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.617+0000 7fb24534b800 20 remove_watcher() i=6 2024-03-09T14:41:14.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.618+0000 7fb24534b800 20 remove_watcher() i=7 2024-03-09T14:41:14.629 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-03-09T14:41:14.657 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:14.658 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:14.691 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.690+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.691+0000 7fabb6b11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.691+0000 7fabb6b11800 20 realm 2024-03-09T14:41:14.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.691+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.692+0000 7fabb6b11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.692+0000 7fabb6b11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:14.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.692+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.692+0000 7fabb6b11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.692+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.693+0000 7fabb6b11800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:14.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.693+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.693+0000 7fabb6b11800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:14.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.693+0000 7fabb6b11800 20 searching for the correct realm 2024-03-09T14:41:14.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.696+0000 7fabb4e15640 0 -- 172.21.15.88:0/3733721978 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fabac069ab0 msgr2=0x7fabac065050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:14.700 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.700+0000 7fabb3e13640 0 -- 172.21.15.88:0/3733721978 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fabac062b60 msgr2=0x7fabac079130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:14.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.906+0000 7fabb6b11800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:14.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.906+0000 7fabb6b11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:14.910 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.906+0000 7fabb6b11800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:14.910 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.906+0000 7fabb6b11800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:14.910 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.906+0000 7fabb6b11800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:14.910 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.906+0000 7fabb6b11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:14.910 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.906+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.910 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.906+0000 7fabb6b11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.906+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.907+0000 7fabb6b11800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:14.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.907+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.907+0000 7fabb6b11800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:14.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.907+0000 7fabb6b11800 20 zone default found 2024-03-09T14:41:14.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.907+0000 7fabb6b11800 4 Realm: () 2024-03-09T14:41:14.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.907+0000 7fabb6b11800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:14.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.907+0000 7fabb6b11800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:14.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.907+0000 7fabb6b11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:14.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.907+0000 7fabb6b11800 20 zonegroup default 2024-03-09T14:41:14.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.907+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.907+0000 7fabb6b11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.907+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.908+0000 7fabb6b11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.908+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.908+0000 7fabb6b11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.908+0000 7fabb6b11800 20 started sync module instance, tier type = 2024-03-09T14:41:14.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.908+0000 7fabb6b11800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:14.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.917+0000 7fabb6b11800 20 add_watcher() i=0 2024-03-09T14:41:14.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.917+0000 7fabb6b11800 20 add_watcher() i=1 2024-03-09T14:41:14.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.917+0000 7fabb6b11800 20 add_watcher() i=2 2024-03-09T14:41:14.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.917+0000 7fabb6b11800 20 add_watcher() i=3 2024-03-09T14:41:14.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.917+0000 7fabb6b11800 20 add_watcher() i=4 2024-03-09T14:41:14.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.917+0000 7fabb6b11800 20 add_watcher() i=5 2024-03-09T14:41:14.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.917+0000 7fabb6b11800 20 add_watcher() i=6 2024-03-09T14:41:14.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.918+0000 7fabb6b11800 20 add_watcher() i=7 2024-03-09T14:41:14.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.918+0000 7fabb6b11800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:14.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.920+0000 7faa6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:14.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.920+0000 7fabb6b11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:14.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.920+0000 7fabb6b11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:14.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.920+0000 7fabb6b11800 5 note: GC not initialized 2024-03-09T14:41:14.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.920+0000 7faa697e2640 20 reqs_thread_entry: start 2024-03-09T14:41:14.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.920+0000 7fabb6b11800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:14.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.921+0000 7fabb6b11800 20 Filter name: none 2024-03-09T14:41:14.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.921+0000 7fa9daffd640 20 reqs_thread_entry: start 2024-03-09T14:41:14.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.921+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.921+0000 7fabb6b11800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:14.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.921+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.922+0000 7fabb6b11800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:41:14.926 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.922+0000 7fabb6b11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:14.926 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.922+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.926 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.922+0000 7fabb6b11800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:14.926 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.922+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.926 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.923+0000 7fabb6b11800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:41:14.927 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.923+0000 7fabb6b11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:14.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.924+0000 7fabb6b11800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.924+0000 7fabb6b11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.925+0000 7faa6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:14.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.927+0000 7fabb6b11800 20 remove_watcher() i=0 2024-03-09T14:41:14.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.927+0000 7fabb6b11800 2 removed watcher, disabling cache 2024-03-09T14:41:14.929 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.928+0000 7fabb6b11800 20 remove_watcher() i=1 2024-03-09T14:41:14.930 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.929+0000 7fabb6b11800 20 remove_watcher() i=2 2024-03-09T14:41:14.930 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.930+0000 7fabb6b11800 20 remove_watcher() i=3 2024-03-09T14:41:14.931 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.931+0000 7fabb6b11800 20 remove_watcher() i=4 2024-03-09T14:41:14.932 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.932+0000 7fabb6b11800 20 remove_watcher() i=5 2024-03-09T14:41:14.933 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.933+0000 7fabb6b11800 20 remove_watcher() i=6 2024-03-09T14:41:14.934 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:14.934+0000 7fabb6b11800 20 remove_watcher() i=7 2024-03-09T14:41:14.944 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:14.944 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:41:14.944 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-block-writes id: 5d93e872-363b-498b-b665-658644296b85.4535.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:41:14.944 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:15.270 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: reshard bucket with abort at block_writes 2024-03-09T14:41:15.270 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:16.011 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-03-09T14:41:16.038 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:16.038 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:16.072 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.071+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.072+0000 7fb363444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.072+0000 7fb363444800 20 realm 2024-03-09T14:41:16.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.072+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.072+0000 7fb363444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.072+0000 7fb363444800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:16.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.072+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.072+0000 7fb363444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.072+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.073+0000 7fb363444800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:16.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.073+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.074+0000 7fb363444800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:16.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.074+0000 7fb363444800 20 searching for the correct realm 2024-03-09T14:41:16.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.076+0000 7fb361741640 0 -- 172.21.15.88:0/2349218857 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fb35c089b70 msgr2=0x7fb35c080920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:16.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.282+0000 7fb35873f640 0 -- 172.21.15.88:0/2349218857 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fb35c07f460 msgr2=0x7fb35c07f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:16.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.489+0000 7fb363444800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:16.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.489+0000 7fb363444800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:16.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.489+0000 7fb363444800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:16.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.489+0000 7fb363444800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:16.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.489+0000 7fb363444800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:16.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.489+0000 7fb363444800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:16.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.489+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.489+0000 7fb363444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.489+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.490+0000 7fb363444800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:16.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.490+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.490+0000 7fb363444800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:16.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.490+0000 7fb363444800 20 zone default found 2024-03-09T14:41:16.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.490+0000 7fb363444800 4 Realm: () 2024-03-09T14:41:16.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.490+0000 7fb363444800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:16.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.490+0000 7fb363444800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:16.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.490+0000 7fb363444800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:16.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.490+0000 7fb363444800 20 zonegroup default 2024-03-09T14:41:16.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.490+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.490+0000 7fb363444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.490+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.491+0000 7fb363444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.491+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.491+0000 7fb363444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.491+0000 7fb363444800 20 started sync module instance, tier type = 2024-03-09T14:41:16.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.491+0000 7fb363444800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:16.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.501+0000 7fb363444800 20 add_watcher() i=0 2024-03-09T14:41:16.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.501+0000 7fb363444800 20 add_watcher() i=1 2024-03-09T14:41:16.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.501+0000 7fb363444800 20 add_watcher() i=2 2024-03-09T14:41:16.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.501+0000 7fb363444800 20 add_watcher() i=3 2024-03-09T14:41:16.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.501+0000 7fb363444800 20 add_watcher() i=4 2024-03-09T14:41:16.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.501+0000 7fb363444800 20 add_watcher() i=5 2024-03-09T14:41:16.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.501+0000 7fb363444800 20 add_watcher() i=6 2024-03-09T14:41:16.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.502+0000 7fb363444800 20 add_watcher() i=7 2024-03-09T14:41:16.503 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.502+0000 7fb363444800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:16.504 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.504+0000 7fb216fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:16.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.504+0000 7fb363444800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:16.505 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.504+0000 7fb363444800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:16.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.504+0000 7fb363444800 5 note: GC not initialized 2024-03-09T14:41:16.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.505+0000 7fb215fe3640 20 reqs_thread_entry: start 2024-03-09T14:41:16.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.505+0000 7fb363444800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:16.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.505+0000 7fb363444800 20 Filter name: none 2024-03-09T14:41:16.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.505+0000 7fb1877fe640 20 reqs_thread_entry: start 2024-03-09T14:41:16.506 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.505+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.505+0000 7fb363444800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:16.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.505+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.506+0000 7fb363444800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:41:16.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.506+0000 7fb363444800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:16.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.506+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.506+0000 7fb363444800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:16.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.506+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.507+0000 7fb363444800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:41:16.507 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.507+0000 7fb363444800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:16.508 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.508+0000 7fb363444800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.508 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.508+0000 7fb363444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.509 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.509+0000 7fb216fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:16.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.511+0000 7fb363444800 20 remove_watcher() i=0 2024-03-09T14:41:16.512 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.511+0000 7fb363444800 2 removed watcher, disabling cache 2024-03-09T14:41:16.513 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.512+0000 7fb363444800 20 remove_watcher() i=1 2024-03-09T14:41:16.514 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.513+0000 7fb363444800 20 remove_watcher() i=2 2024-03-09T14:41:16.515 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.515+0000 7fb363444800 20 remove_watcher() i=3 2024-03-09T14:41:16.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.516+0000 7fb363444800 20 remove_watcher() i=4 2024-03-09T14:41:16.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.517+0000 7fb363444800 20 remove_watcher() i=5 2024-03-09T14:41:16.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.518+0000 7fb363444800 20 remove_watcher() i=6 2024-03-09T14:41:16.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.519+0000 7fb363444800 20 remove_watcher() i=7 2024-03-09T14:41:16.529 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:16.529 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:41:16.529 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: abort-at-block-writes id: 5d93e872-363b-498b-b665-658644296b85.4535.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:41:16.530 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:16.531 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-03-09T14:41:16.563 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:16.563 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:16.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.596+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.597+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.597+0000 7feec400f800 20 realm 2024-03-09T14:41:16.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.597+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.597+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.598 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.597+0000 7feec400f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:16.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.597+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.597+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.597+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.598+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:16.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.598+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.599+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:16.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.599+0000 7feec400f800 20 searching for the correct realm 2024-03-09T14:41:16.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.601+0000 7feebfe82640 0 -- 172.21.15.88:0/3560501939 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7feeb805e050 msgr2=0x7feeb8099580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:16.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:16.807+0000 7feeb6e80640 0 -- 172.21.15.88:0/3560501939 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7feeb80a2940 msgr2=0x7feeb80b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:17.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:17.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:17.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:17.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:17.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:17.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:17.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.013+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.014+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.014+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.014+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.014+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.014+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:17.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.014+0000 7feec400f800 20 zone default found 2024-03-09T14:41:17.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.014+0000 7feec400f800 4 Realm: () 2024-03-09T14:41:17.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.014+0000 7feec400f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:17.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.014+0000 7feec400f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:17.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.014+0000 7feec400f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:17.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.014+0000 7feec400f800 20 zonegroup default 2024-03-09T14:41:17.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.014+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.014+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.014+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.015+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.017 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.015+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.015+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.015+0000 7feec400f800 20 started sync module instance, tier type = 2024-03-09T14:41:17.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.015+0000 7feec400f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:17.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=0 2024-03-09T14:41:17.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=1 2024-03-09T14:41:17.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=2 2024-03-09T14:41:17.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=3 2024-03-09T14:41:17.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=4 2024-03-09T14:41:17.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=5 2024-03-09T14:41:17.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=6 2024-03-09T14:41:17.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.025+0000 7feec400f800 20 add_watcher() i=7 2024-03-09T14:41:17.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.025+0000 7feec400f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:17.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.027+0000 7fed75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:17.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.027+0000 7feec400f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:17.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.027+0000 7feec400f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:17.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.027+0000 7feec400f800 5 note: GC not initialized 2024-03-09T14:41:17.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.027+0000 7fed74fe1640 20 reqs_thread_entry: start 2024-03-09T14:41:17.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.027+0000 7feec400f800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:17.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.027+0000 7feec400f800 20 Filter name: none 2024-03-09T14:41:17.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.027+0000 7fecee7fc640 20 reqs_thread_entry: start 2024-03-09T14:41:17.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.028+0000 7feec400f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-09T14:41:17.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.028+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.028+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:17.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.028+0000 7feec400f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-09T14:41:17.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.028+0000 7feec400f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-09T14:41:17.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.028+0000 7feec400f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 : miss 2024-03-09T14:41:17.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.028+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.028+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:41:17.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.028+0000 7feec400f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 info.flags=0x17 2024-03-09T14:41:17.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.028+0000 7feec400f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to cache LRU end 2024-03-09T14:41:17.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.028+0000 7feec400f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:17.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.028+0000 7feec400f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:17.031 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.028+0000 7feec400f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 2024-03-09T14:41:17.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.034+0000 7feec400f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 info.flags=0x17 2024-03-09T14:41:17.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.034+0000 7feec400f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to cache LRU end 2024-03-09T14:41:17.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.034+0000 7feec400f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:17.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.034+0000 7feec400f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23, ofs0, ns] 2024-03-09T14:41:17.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.034+0000 7feda2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464344 cookie 94396058061952 notifier 6215 bl.length()=907 2024-03-09T14:41:17.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.034+0000 7feda2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 info.flags=0x17 2024-03-09T14:41:17.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.034+0000 7feda2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to cache LRU end 2024-03-09T14:41:17.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.034+0000 7feda2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:17.037 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feec400f800 time 2024-03-09T14:41:17.037901+0000 2024-03-09T14:41:17.037 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:41:17.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.036+0000 7feec400f800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): orig_sources= new_sources= 2024-03-09T14:41:17.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.036+0000 7feec400f800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): potential sources added=[] removed=[] 2024-03-09T14:41:17.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.036+0000 7feec400f800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): orig_dests= new_dests= 2024-03-09T14:41:17.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.036+0000 7feec400f800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): potential dests added=[] removed=[] 2024-03-09T14:41:17.037 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:17.038 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feec4f80e86] 2024-03-09T14:41:17.038 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7feec4f81044] 2024-03-09T14:41:17.038 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da4a95af91] 2024-03-09T14:41:17.038 INFO:tasks.workunit.client.0.smithi088.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55da4a975e64] 2024-03-09T14:41:17.038 INFO:tasks.workunit.client.0.smithi088.stderr: 5: main() 2024-03-09T14:41:17.038 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7feec3e3feb0] 2024-03-09T14:41:17.038 INFO:tasks.workunit.client.0.smithi088.stderr: 7: __libc_start_main() 2024-03-09T14:41:17.038 INFO:tasks.workunit.client.0.smithi088.stderr: 8: _start() 2024-03-09T14:41:17.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.037+0000 7feec400f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feec400f800 time 2024-03-09T14:41:17.037901+0000 2024-03-09T14:41:17.038 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:41:17.038 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.038 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:17.039 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feec4f80e86] 2024-03-09T14:41:17.039 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7feec4f81044] 2024-03-09T14:41:17.039 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da4a95af91] 2024-03-09T14:41:17.039 INFO:tasks.workunit.client.0.smithi088.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55da4a975e64] 2024-03-09T14:41:17.039 INFO:tasks.workunit.client.0.smithi088.stderr: 5: main() 2024-03-09T14:41:17.039 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7feec3e3feb0] 2024-03-09T14:41:17.039 INFO:tasks.workunit.client.0.smithi088.stderr: 7: __libc_start_main() 2024-03-09T14:41:17.039 INFO:tasks.workunit.client.0.smithi088.stderr: 8: _start() 2024-03-09T14:41:17.039 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.039 INFO:tasks.workunit.client.0.smithi088.stderr:*** Caught signal (Aborted) ** 2024-03-09T14:41:17.039 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7feec400f800 thread_name:radosgw-admin 2024-03-09T14:41:17.063 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:17.063 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7feec3e54db0] 2024-03-09T14:41:17.063 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7feec3ea154c] 2024-03-09T14:41:17.063 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:41:17.063 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:41:17.063 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feec4f80ee0] 2024-03-09T14:41:17.063 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7feec4f81044] 2024-03-09T14:41:17.064 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da4a95af91] 2024-03-09T14:41:17.064 INFO:tasks.workunit.client.0.smithi088.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55da4a975e64] 2024-03-09T14:41:17.064 INFO:tasks.workunit.client.0.smithi088.stderr: 9: main() 2024-03-09T14:41:17.064 INFO:tasks.workunit.client.0.smithi088.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7feec3e3feb0] 2024-03-09T14:41:17.064 INFO:tasks.workunit.client.0.smithi088.stderr: 11: __libc_start_main() 2024-03-09T14:41:17.064 INFO:tasks.workunit.client.0.smithi088.stderr: 12: _start() 2024-03-09T14:41:17.064 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.038+0000 7feec400f800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:41:17.064 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7feec400f800 thread_name:radosgw-admin 2024-03-09T14:41:17.064 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.064 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:17.064 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7feec3e54db0] 2024-03-09T14:41:17.064 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7feec3ea154c] 2024-03-09T14:41:17.064 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:41:17.064 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:41:17.064 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feec4f80ee0] 2024-03-09T14:41:17.065 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7feec4f81044] 2024-03-09T14:41:17.065 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da4a95af91] 2024-03-09T14:41:17.065 INFO:tasks.workunit.client.0.smithi088.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55da4a975e64] 2024-03-09T14:41:17.065 INFO:tasks.workunit.client.0.smithi088.stderr: 9: main() 2024-03-09T14:41:17.065 INFO:tasks.workunit.client.0.smithi088.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7feec3e3feb0] 2024-03-09T14:41:17.065 INFO:tasks.workunit.client.0.smithi088.stderr: 11: __libc_start_main() 2024-03-09T14:41:17.065 INFO:tasks.workunit.client.0.smithi088.stderr: 12: _start() 2024-03-09T14:41:17.065 INFO:tasks.workunit.client.0.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:41:17.065 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.065 INFO:tasks.workunit.client.0.smithi088.stderr:--- begin dump of recent events --- 2024-03-09T14:41:17.065 INFO:tasks.workunit.client.0.smithi088.stderr: -499> 2024-03-09T14:41:16.580+0000 7feec400f800 4 set_mon_vals no callback set 2024-03-09T14:41:17.065 INFO:tasks.workunit.client.0.smithi088.stderr: -498> 2024-03-09T14:41:16.580+0000 7fedad60a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.065 INFO:tasks.workunit.client.0.smithi088.stderr: -497> 2024-03-09T14:41:16.580+0000 7fedad60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:41:17.065 INFO:tasks.workunit.client.0.smithi088.stderr: -496> 2024-03-09T14:41:16.580+0000 7fedad60a640 10 monclient: dump: 2024-03-09T14:41:17.065 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.066 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.066 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.066 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.066 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.066 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.066 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.066 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.066 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.066 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.066 INFO:tasks.workunit.client.0.smithi088.stderr: -495> 2024-03-09T14:41:16.580+0000 7feec400f800 10 monclient: shutdown 2024-03-09T14:41:17.066 INFO:tasks.workunit.client.0.smithi088.stderr: -494> 2024-03-09T14:41:16.580+0000 7feec400f800 5 asok(0x55da4b506780) unregister_commands rotate-key 2024-03-09T14:41:17.066 INFO:tasks.workunit.client.0.smithi088.stderr: -493> 2024-03-09T14:41:16.580+0000 7feec400f800 10 monclient: build_initial_monmap 2024-03-09T14:41:17.066 INFO:tasks.workunit.client.0.smithi088.stderr: -492> 2024-03-09T14:41:16.580+0000 7feec400f800 1 build_initial for_mkfs: 0 2024-03-09T14:41:17.066 INFO:tasks.workunit.client.0.smithi088.stderr: -491> 2024-03-09T14:41:16.580+0000 7feec400f800 10 monclient: monmap: 2024-03-09T14:41:17.067 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:41:17.067 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:41:17.067 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:41:17.067 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:41:17.067 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:41:17.067 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.067 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:41:17.067 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:41:17.067 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:41:17.067 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.068 INFO:tasks.workunit.client.0.smithi088.stderr: -490> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding auth protocol: cephx 2024-03-09T14:41:17.068 INFO:tasks.workunit.client.0.smithi088.stderr: -489> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding auth protocol: cephx 2024-03-09T14:41:17.068 INFO:tasks.workunit.client.0.smithi088.stderr: -488> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding auth protocol: cephx 2024-03-09T14:41:17.068 INFO:tasks.workunit.client.0.smithi088.stderr: -487> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: secure 2024-03-09T14:41:17.068 INFO:tasks.workunit.client.0.smithi088.stderr: -486> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: crc 2024-03-09T14:41:17.068 INFO:tasks.workunit.client.0.smithi088.stderr: -485> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: secure 2024-03-09T14:41:17.068 INFO:tasks.workunit.client.0.smithi088.stderr: -484> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: crc 2024-03-09T14:41:17.068 INFO:tasks.workunit.client.0.smithi088.stderr: -483> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: secure 2024-03-09T14:41:17.068 INFO:tasks.workunit.client.0.smithi088.stderr: -482> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: crc 2024-03-09T14:41:17.068 INFO:tasks.workunit.client.0.smithi088.stderr: -481> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: crc 2024-03-09T14:41:17.068 INFO:tasks.workunit.client.0.smithi088.stderr: -480> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: secure 2024-03-09T14:41:17.068 INFO:tasks.workunit.client.0.smithi088.stderr: -479> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: crc 2024-03-09T14:41:17.068 INFO:tasks.workunit.client.0.smithi088.stderr: -478> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: secure 2024-03-09T14:41:17.068 INFO:tasks.workunit.client.0.smithi088.stderr: -477> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: crc 2024-03-09T14:41:17.068 INFO:tasks.workunit.client.0.smithi088.stderr: -476> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: secure 2024-03-09T14:41:17.069 INFO:tasks.workunit.client.0.smithi088.stderr: -475> 2024-03-09T14:41:16.581+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.069 INFO:tasks.workunit.client.0.smithi088.stderr: -474> 2024-03-09T14:41:16.581+0000 7feec400f800 1 librados: starting msgr at 2024-03-09T14:41:17.069 INFO:tasks.workunit.client.0.smithi088.stderr: -473> 2024-03-09T14:41:16.581+0000 7feec400f800 1 librados: starting objecter 2024-03-09T14:41:17.069 INFO:tasks.workunit.client.0.smithi088.stderr: -472> 2024-03-09T14:41:16.581+0000 7feec400f800 5 asok(0x55da4b506780) register_command objecter_requests hook 0x55da4b72a220 2024-03-09T14:41:17.069 INFO:tasks.workunit.client.0.smithi088.stderr: -471> 2024-03-09T14:41:16.581+0000 7feec400f800 1 librados: setting wanted keys 2024-03-09T14:41:17.069 INFO:tasks.workunit.client.0.smithi088.stderr: -470> 2024-03-09T14:41:16.581+0000 7feec400f800 1 librados: calling monclient init 2024-03-09T14:41:17.069 INFO:tasks.workunit.client.0.smithi088.stderr: -469> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient: init 2024-03-09T14:41:17.069 INFO:tasks.workunit.client.0.smithi088.stderr: -468> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding auth protocol: cephx 2024-03-09T14:41:17.069 INFO:tasks.workunit.client.0.smithi088.stderr: -467> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding auth protocol: cephx 2024-03-09T14:41:17.069 INFO:tasks.workunit.client.0.smithi088.stderr: -466> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding auth protocol: cephx 2024-03-09T14:41:17.069 INFO:tasks.workunit.client.0.smithi088.stderr: -465> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: secure 2024-03-09T14:41:17.069 INFO:tasks.workunit.client.0.smithi088.stderr: -464> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: crc 2024-03-09T14:41:17.069 INFO:tasks.workunit.client.0.smithi088.stderr: -463> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: secure 2024-03-09T14:41:17.069 INFO:tasks.workunit.client.0.smithi088.stderr: -462> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: crc 2024-03-09T14:41:17.070 INFO:tasks.workunit.client.0.smithi088.stderr: -461> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: secure 2024-03-09T14:41:17.070 INFO:tasks.workunit.client.0.smithi088.stderr: -460> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: crc 2024-03-09T14:41:17.070 INFO:tasks.workunit.client.0.smithi088.stderr: -459> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: crc 2024-03-09T14:41:17.070 INFO:tasks.workunit.client.0.smithi088.stderr: -458> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: secure 2024-03-09T14:41:17.070 INFO:tasks.workunit.client.0.smithi088.stderr: -457> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: crc 2024-03-09T14:41:17.070 INFO:tasks.workunit.client.0.smithi088.stderr: -456> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: secure 2024-03-09T14:41:17.070 INFO:tasks.workunit.client.0.smithi088.stderr: -455> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: crc 2024-03-09T14:41:17.070 INFO:tasks.workunit.client.0.smithi088.stderr: -454> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: secure 2024-03-09T14:41:17.070 INFO:tasks.workunit.client.0.smithi088.stderr: -453> 2024-03-09T14:41:16.581+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.070 INFO:tasks.workunit.client.0.smithi088.stderr: -452> 2024-03-09T14:41:16.581+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.070 INFO:tasks.workunit.client.0.smithi088.stderr: -451> 2024-03-09T14:41:16.581+0000 7feec400f800 5 asok(0x55da4b506780) register_command rotate-key hook 0x55da4b724b08 2024-03-09T14:41:17.070 INFO:tasks.workunit.client.0.smithi088.stderr: -450> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient: _reopen_session rank -1 2024-03-09T14:41:17.070 INFO:tasks.workunit.client.0.smithi088.stderr: -449> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:41:17.071 INFO:tasks.workunit.client.0.smithi088.stderr: -448> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): picked mon.noname-b con 0x55da4b5db380 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:17.071 INFO:tasks.workunit.client.0.smithi088.stderr: -447> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): picked mon.noname-a con 0x55da4b665630 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:17.071 INFO:tasks.workunit.client.0.smithi088.stderr: -446> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): picked mon.noname-c con 0x55da4b66bf60 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:17.071 INFO:tasks.workunit.client.0.smithi088.stderr: -445> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.071 INFO:tasks.workunit.client.0.smithi088.stderr: -444> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.071 INFO:tasks.workunit.client.0.smithi088.stderr: -443> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.071 INFO:tasks.workunit.client.0.smithi088.stderr: -442> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): _renew_subs 2024-03-09T14:41:17.071 INFO:tasks.workunit.client.0.smithi088.stderr: -441> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): authenticate will time out at 1691.920173s 2024-03-09T14:41:17.071 INFO:tasks.workunit.client.0.smithi088.stderr: -440> 2024-03-09T14:41:16.581+0000 7feebfe82640 10 monclient(hunting): get_auth_request con 0x55da4b66bf60 auth_method 0 2024-03-09T14:41:17.071 INFO:tasks.workunit.client.0.smithi088.stderr: -439> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.071 INFO:tasks.workunit.client.0.smithi088.stderr: -438> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.071 INFO:tasks.workunit.client.0.smithi088.stderr: -437> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.072 INFO:tasks.workunit.client.0.smithi088.stderr: -436> 2024-03-09T14:41:16.582+0000 7feeb6e80640 10 monclient(hunting): get_auth_request con 0x55da4b665630 auth_method 0 2024-03-09T14:41:17.072 INFO:tasks.workunit.client.0.smithi088.stderr: -435> 2024-03-09T14:41:16.582+0000 7feeb6e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.072 INFO:tasks.workunit.client.0.smithi088.stderr: -434> 2024-03-09T14:41:16.582+0000 7feeb6e80640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.072 INFO:tasks.workunit.client.0.smithi088.stderr: -433> 2024-03-09T14:41:16.582+0000 7feeb6e80640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.072 INFO:tasks.workunit.client.0.smithi088.stderr: -432> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.072 INFO:tasks.workunit.client.0.smithi088.stderr: -431> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.072 INFO:tasks.workunit.client.0.smithi088.stderr: -430> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.072 INFO:tasks.workunit.client.0.smithi088.stderr: -429> 2024-03-09T14:41:16.582+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.072 INFO:tasks.workunit.client.0.smithi088.stderr: -428> 2024-03-09T14:41:16.582+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.072 INFO:tasks.workunit.client.0.smithi088.stderr: -427> 2024-03-09T14:41:16.582+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.072 INFO:tasks.workunit.client.0.smithi088.stderr: -426> 2024-03-09T14:41:16.582+0000 7feebf681640 10 monclient(hunting): get_auth_request con 0x55da4b5db380 auth_method 0 2024-03-09T14:41:17.072 INFO:tasks.workunit.client.0.smithi088.stderr: -425> 2024-03-09T14:41:16.582+0000 7feebf681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.072 INFO:tasks.workunit.client.0.smithi088.stderr: -424> 2024-03-09T14:41:16.582+0000 7feebf681640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.072 INFO:tasks.workunit.client.0.smithi088.stderr: -423> 2024-03-09T14:41:16.582+0000 7feebf681640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.072 INFO:tasks.workunit.client.0.smithi088.stderr: -422> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient(hunting): handle_auth_done global_id 6206 payload 824 2024-03-09T14:41:17.073 INFO:tasks.workunit.client.0.smithi088.stderr: -421> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient: _finish_hunting 0 2024-03-09T14:41:17.073 INFO:tasks.workunit.client.0.smithi088.stderr: -420> 2024-03-09T14:41:16.582+0000 7feebfe82640 1 monclient: found mon.noname-c 2024-03-09T14:41:17.073 INFO:tasks.workunit.client.0.smithi088.stderr: -419> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:41:17.073 INFO:tasks.workunit.client.0.smithi088.stderr: -418> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.073 INFO:tasks.workunit.client.0.smithi088.stderr: -417> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:41:17.073 INFO:tasks.workunit.client.0.smithi088.stderr: -416> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: dump: 2024-03-09T14:41:17.073 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.073 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.073 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.073 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.073 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.073 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.073 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.073 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.073 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.074 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.074 INFO:tasks.workunit.client.0.smithi088.stderr: -415> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: _finish_auth 0 2024-03-09T14:41:17.074 INFO:tasks.workunit.client.0.smithi088.stderr: -414> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: _check_auth_tickets 2024-03-09T14:41:17.074 INFO:tasks.workunit.client.0.smithi088.stderr: -413> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:17.074 INFO:tasks.workunit.client.0.smithi088.stderr: -412> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.074 INFO:tasks.workunit.client.0.smithi088.stderr: -411> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:41:17.074 INFO:tasks.workunit.client.0.smithi088.stderr: -410> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: dump: 2024-03-09T14:41:17.074 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.074 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.074 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.074 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.074 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.074 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.074 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.075 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.075 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.075 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.075 INFO:tasks.workunit.client.0.smithi088.stderr: -409> 2024-03-09T14:41:16.582+0000 7feec400f800 5 monclient: authenticate success, global_id 6206 2024-03-09T14:41:17.075 INFO:tasks.workunit.client.0.smithi088.stderr: -408> 2024-03-09T14:41:16.582+0000 7fedad60a640 4 set_mon_vals no callback set 2024-03-09T14:41:17.075 INFO:tasks.workunit.client.0.smithi088.stderr: -407> 2024-03-09T14:41:16.582+0000 7feec400f800 10 monclient: _renew_subs 2024-03-09T14:41:17.075 INFO:tasks.workunit.client.0.smithi088.stderr: -406> 2024-03-09T14:41:16.582+0000 7feec400f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:41:17.075 INFO:tasks.workunit.client.0.smithi088.stderr: -405> 2024-03-09T14:41:16.582+0000 7feec400f800 10 monclient: _renew_subs 2024-03-09T14:41:17.075 INFO:tasks.workunit.client.0.smithi088.stderr: -404> 2024-03-09T14:41:16.582+0000 7feec400f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:41:17.075 INFO:tasks.workunit.client.0.smithi088.stderr: -403> 2024-03-09T14:41:16.582+0000 7feec400f800 1 librados: init done 2024-03-09T14:41:17.075 INFO:tasks.workunit.client.0.smithi088.stderr: -402> 2024-03-09T14:41:16.584+0000 7fedabe07640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:41:17.076 INFO:tasks.workunit.client.0.smithi088.stderr: -401> 2024-03-09T14:41:16.584+0000 7fedabe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:17.076 INFO:tasks.workunit.client.0.smithi088.stderr: -400> 2024-03-09T14:41:16.584+0000 7fedabe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:17.076 INFO:tasks.workunit.client.0.smithi088.stderr: -399> 2024-03-09T14:41:16.584+0000 7feebf681640 10 monclient: get_auth_request con 0x7feda406a5b0 auth_method 0 2024-03-09T14:41:17.076 INFO:tasks.workunit.client.0.smithi088.stderr: -398> 2024-03-09T14:41:16.584+0000 7feeb6e80640 10 monclient: get_auth_request con 0x55da4b766d50 auth_method 0 2024-03-09T14:41:17.076 INFO:tasks.workunit.client.0.smithi088.stderr: -397> 2024-03-09T14:41:16.585+0000 7feebf681640 10 monclient: get_auth_request con 0x55da4b770780 auth_method 0 2024-03-09T14:41:17.076 INFO:tasks.workunit.client.0.smithi088.stderr: -396> 2024-03-09T14:41:16.586+0000 7feeb6e80640 10 monclient: get_auth_request con 0x55da4b774ae0 auth_method 0 2024-03-09T14:41:17.076 INFO:tasks.workunit.client.0.smithi088.stderr: -395> 2024-03-09T14:41:16.587+0000 7feebfe82640 10 monclient: get_auth_request con 0x55da4b773fd0 auth_method 0 2024-03-09T14:41:17.076 INFO:tasks.workunit.client.0.smithi088.stderr: -394> 2024-03-09T14:41:16.587+0000 7feec400f800 10 monclient: build_initial_monmap 2024-03-09T14:41:17.076 INFO:tasks.workunit.client.0.smithi088.stderr: -393> 2024-03-09T14:41:16.587+0000 7feec400f800 1 build_initial for_mkfs: 0 2024-03-09T14:41:17.076 INFO:tasks.workunit.client.0.smithi088.stderr: -392> 2024-03-09T14:41:16.587+0000 7feec400f800 10 monclient: monmap: 2024-03-09T14:41:17.076 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:41:17.076 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:41:17.076 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:41:17.076 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:41:17.076 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:41:17.077 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.077 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:41:17.077 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:41:17.077 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:41:17.077 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.077 INFO:tasks.workunit.client.0.smithi088.stderr: -391> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding auth protocol: cephx 2024-03-09T14:41:17.077 INFO:tasks.workunit.client.0.smithi088.stderr: -390> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding auth protocol: cephx 2024-03-09T14:41:17.077 INFO:tasks.workunit.client.0.smithi088.stderr: -389> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding auth protocol: cephx 2024-03-09T14:41:17.077 INFO:tasks.workunit.client.0.smithi088.stderr: -388> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: secure 2024-03-09T14:41:17.077 INFO:tasks.workunit.client.0.smithi088.stderr: -387> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: crc 2024-03-09T14:41:17.077 INFO:tasks.workunit.client.0.smithi088.stderr: -386> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: secure 2024-03-09T14:41:17.077 INFO:tasks.workunit.client.0.smithi088.stderr: -385> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: crc 2024-03-09T14:41:17.077 INFO:tasks.workunit.client.0.smithi088.stderr: -384> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: secure 2024-03-09T14:41:17.078 INFO:tasks.workunit.client.0.smithi088.stderr: -383> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: crc 2024-03-09T14:41:17.078 INFO:tasks.workunit.client.0.smithi088.stderr: -382> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: crc 2024-03-09T14:41:17.078 INFO:tasks.workunit.client.0.smithi088.stderr: -381> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: secure 2024-03-09T14:41:17.078 INFO:tasks.workunit.client.0.smithi088.stderr: -380> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: crc 2024-03-09T14:41:17.078 INFO:tasks.workunit.client.0.smithi088.stderr: -379> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: secure 2024-03-09T14:41:17.078 INFO:tasks.workunit.client.0.smithi088.stderr: -378> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: crc 2024-03-09T14:41:17.078 INFO:tasks.workunit.client.0.smithi088.stderr: -377> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: secure 2024-03-09T14:41:17.078 INFO:tasks.workunit.client.0.smithi088.stderr: -376> 2024-03-09T14:41:16.588+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.078 INFO:tasks.workunit.client.0.smithi088.stderr: -375> 2024-03-09T14:41:16.588+0000 7feec400f800 5 asok(0x55da4b506780) register_command objecter_requests cmddesc objecter_requests hook 0x55da4b780790 EEXIST 2024-03-09T14:41:17.078 INFO:tasks.workunit.client.0.smithi088.stderr: -374> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient: init 2024-03-09T14:41:17.079 INFO:tasks.workunit.client.0.smithi088.stderr: -373> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding auth protocol: cephx 2024-03-09T14:41:17.079 INFO:tasks.workunit.client.0.smithi088.stderr: -372> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding auth protocol: cephx 2024-03-09T14:41:17.079 INFO:tasks.workunit.client.0.smithi088.stderr: -371> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding auth protocol: cephx 2024-03-09T14:41:17.079 INFO:tasks.workunit.client.0.smithi088.stderr: -370> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: secure 2024-03-09T14:41:17.079 INFO:tasks.workunit.client.0.smithi088.stderr: -369> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: crc 2024-03-09T14:41:17.079 INFO:tasks.workunit.client.0.smithi088.stderr: -368> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: secure 2024-03-09T14:41:17.079 INFO:tasks.workunit.client.0.smithi088.stderr: -367> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: crc 2024-03-09T14:41:17.079 INFO:tasks.workunit.client.0.smithi088.stderr: -366> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: secure 2024-03-09T14:41:17.079 INFO:tasks.workunit.client.0.smithi088.stderr: -365> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: crc 2024-03-09T14:41:17.079 INFO:tasks.workunit.client.0.smithi088.stderr: -364> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: crc 2024-03-09T14:41:17.079 INFO:tasks.workunit.client.0.smithi088.stderr: -363> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: secure 2024-03-09T14:41:17.079 INFO:tasks.workunit.client.0.smithi088.stderr: -362> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: crc 2024-03-09T14:41:17.079 INFO:tasks.workunit.client.0.smithi088.stderr: -361> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: secure 2024-03-09T14:41:17.079 INFO:tasks.workunit.client.0.smithi088.stderr: -360> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: crc 2024-03-09T14:41:17.080 INFO:tasks.workunit.client.0.smithi088.stderr: -359> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: secure 2024-03-09T14:41:17.080 INFO:tasks.workunit.client.0.smithi088.stderr: -358> 2024-03-09T14:41:16.588+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.080 INFO:tasks.workunit.client.0.smithi088.stderr: -357> 2024-03-09T14:41:16.588+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.080 INFO:tasks.workunit.client.0.smithi088.stderr: -356> 2024-03-09T14:41:16.588+0000 7feec400f800 5 asok(0x55da4b506780) register_command rotate-key cmddesc rotate-key hook 0x55da4b77bbc0 EEXIST 2024-03-09T14:41:17.080 INFO:tasks.workunit.client.0.smithi088.stderr: -355> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient: _reopen_session rank -1 2024-03-09T14:41:17.080 INFO:tasks.workunit.client.0.smithi088.stderr: -354> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:41:17.080 INFO:tasks.workunit.client.0.smithi088.stderr: -353> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): picked mon.noname-b con 0x55da4b7a6df0 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:17.080 INFO:tasks.workunit.client.0.smithi088.stderr: -352> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): picked mon.noname-c con 0x55da4b7b9410 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:17.080 INFO:tasks.workunit.client.0.smithi088.stderr: -351> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): picked mon.noname-a con 0x55da4b7a3d30 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:17.080 INFO:tasks.workunit.client.0.smithi088.stderr: -350> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.080 INFO:tasks.workunit.client.0.smithi088.stderr: -349> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.080 INFO:tasks.workunit.client.0.smithi088.stderr: -348> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.080 INFO:tasks.workunit.client.0.smithi088.stderr: -347> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): _renew_subs 2024-03-09T14:41:17.080 INFO:tasks.workunit.client.0.smithi088.stderr: -346> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): authenticate will time out at 1691.927026s 2024-03-09T14:41:17.081 INFO:tasks.workunit.client.0.smithi088.stderr: -345> 2024-03-09T14:41:16.588+0000 7feebf681640 10 monclient(hunting): get_auth_request con 0x55da4b7a3d30 auth_method 0 2024-03-09T14:41:17.081 INFO:tasks.workunit.client.0.smithi088.stderr: -344> 2024-03-09T14:41:16.588+0000 7feebf681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.081 INFO:tasks.workunit.client.0.smithi088.stderr: -343> 2024-03-09T14:41:16.588+0000 7feebf681640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.081 INFO:tasks.workunit.client.0.smithi088.stderr: -342> 2024-03-09T14:41:16.588+0000 7feebf681640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.081 INFO:tasks.workunit.client.0.smithi088.stderr: -341> 2024-03-09T14:41:16.588+0000 7feebfe82640 10 monclient(hunting): get_auth_request con 0x55da4b7b9410 auth_method 0 2024-03-09T14:41:17.081 INFO:tasks.workunit.client.0.smithi088.stderr: -340> 2024-03-09T14:41:16.588+0000 7feebfe82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.081 INFO:tasks.workunit.client.0.smithi088.stderr: -339> 2024-03-09T14:41:16.588+0000 7feebfe82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.081 INFO:tasks.workunit.client.0.smithi088.stderr: -338> 2024-03-09T14:41:16.588+0000 7feebfe82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.082 INFO:tasks.workunit.client.0.smithi088.stderr: -337> 2024-03-09T14:41:16.588+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.082 INFO:tasks.workunit.client.0.smithi088.stderr: -336> 2024-03-09T14:41:16.588+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.082 INFO:tasks.workunit.client.0.smithi088.stderr: -335> 2024-03-09T14:41:16.588+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.082 INFO:tasks.workunit.client.0.smithi088.stderr: -334> 2024-03-09T14:41:16.588+0000 7feeb6e80640 10 monclient(hunting): get_auth_request con 0x55da4b7a6df0 auth_method 0 2024-03-09T14:41:17.082 INFO:tasks.workunit.client.0.smithi088.stderr: -333> 2024-03-09T14:41:16.588+0000 7feeb6e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.082 INFO:tasks.workunit.client.0.smithi088.stderr: -332> 2024-03-09T14:41:16.588+0000 7feeb6e80640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.082 INFO:tasks.workunit.client.0.smithi088.stderr: -331> 2024-03-09T14:41:16.588+0000 7feeb6e80640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.082 INFO:tasks.workunit.client.0.smithi088.stderr: -330> 2024-03-09T14:41:16.588+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.082 INFO:tasks.workunit.client.0.smithi088.stderr: -329> 2024-03-09T14:41:16.588+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.083 INFO:tasks.workunit.client.0.smithi088.stderr: -328> 2024-03-09T14:41:16.588+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.083 INFO:tasks.workunit.client.0.smithi088.stderr: -327> 2024-03-09T14:41:16.589+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.083 INFO:tasks.workunit.client.0.smithi088.stderr: -326> 2024-03-09T14:41:16.589+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.083 INFO:tasks.workunit.client.0.smithi088.stderr: -325> 2024-03-09T14:41:16.589+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.083 INFO:tasks.workunit.client.0.smithi088.stderr: -324> 2024-03-09T14:41:16.589+0000 7feebf681640 10 monclient(hunting): handle_auth_done global_id 6483 payload 824 2024-03-09T14:41:17.083 INFO:tasks.workunit.client.0.smithi088.stderr: -323> 2024-03-09T14:41:16.589+0000 7feebf681640 10 monclient: _finish_hunting 0 2024-03-09T14:41:17.083 INFO:tasks.workunit.client.0.smithi088.stderr: -322> 2024-03-09T14:41:16.589+0000 7feebf681640 1 monclient: found mon.noname-a 2024-03-09T14:41:17.083 INFO:tasks.workunit.client.0.smithi088.stderr: -321> 2024-03-09T14:41:16.589+0000 7feebf681640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.88:3300/0 2024-03-09T14:41:17.083 INFO:tasks.workunit.client.0.smithi088.stderr: -320> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.083 INFO:tasks.workunit.client.0.smithi088.stderr: -319> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:41:17.083 INFO:tasks.workunit.client.0.smithi088.stderr: -318> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: dump: 2024-03-09T14:41:17.083 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.083 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.083 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.083 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.084 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.084 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.084 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.084 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.084 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.084 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.084 INFO:tasks.workunit.client.0.smithi088.stderr: -317> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: _finish_auth 0 2024-03-09T14:41:17.084 INFO:tasks.workunit.client.0.smithi088.stderr: -316> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: _check_auth_tickets 2024-03-09T14:41:17.084 INFO:tasks.workunit.client.0.smithi088.stderr: -315> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:17.084 INFO:tasks.workunit.client.0.smithi088.stderr: -314> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.084 INFO:tasks.workunit.client.0.smithi088.stderr: -313> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:41:17.084 INFO:tasks.workunit.client.0.smithi088.stderr: -312> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: dump: 2024-03-09T14:41:17.084 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.084 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.085 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.085 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.085 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.085 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.085 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.085 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.085 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.085 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.085 INFO:tasks.workunit.client.0.smithi088.stderr: -311> 2024-03-09T14:41:16.589+0000 7feec400f800 5 monclient: authenticate success, global_id 6483 2024-03-09T14:41:17.085 INFO:tasks.workunit.client.0.smithi088.stderr: -310> 2024-03-09T14:41:16.589+0000 7feec400f800 10 monclient: _renew_subs 2024-03-09T14:41:17.085 INFO:tasks.workunit.client.0.smithi088.stderr: -309> 2024-03-09T14:41:16.589+0000 7feec0683640 4 set_mon_vals no callback set 2024-03-09T14:41:17.085 INFO:tasks.workunit.client.0.smithi088.stderr: -308> 2024-03-09T14:41:16.589+0000 7feec400f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:17.085 INFO:tasks.workunit.client.0.smithi088.stderr: -307> 2024-03-09T14:41:16.589+0000 7feec400f800 10 monclient: _renew_subs 2024-03-09T14:41:17.085 INFO:tasks.workunit.client.0.smithi088.stderr: -306> 2024-03-09T14:41:16.589+0000 7feec400f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:17.086 INFO:tasks.workunit.client.0.smithi088.stderr: -305> 2024-03-09T14:41:16.590+0000 7feda9602640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:41:17.086 INFO:tasks.workunit.client.0.smithi088.stderr: -304> 2024-03-09T14:41:16.590+0000 7feda9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:17.086 INFO:tasks.workunit.client.0.smithi088.stderr: -303> 2024-03-09T14:41:16.590+0000 7feda9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:17.086 INFO:tasks.workunit.client.0.smithi088.stderr: -302> 2024-03-09T14:41:16.591+0000 7feeb6e80640 10 monclient: get_auth_request con 0x7fed9806a4c0 auth_method 0 2024-03-09T14:41:17.086 INFO:tasks.workunit.client.0.smithi088.stderr: -301> 2024-03-09T14:41:16.591+0000 7feec400f800 10 monclient: get_monmap_and_config 2024-03-09T14:41:17.086 INFO:tasks.workunit.client.0.smithi088.stderr: -300> 2024-03-09T14:41:16.591+0000 7feec400f800 10 monclient: build_initial_monmap 2024-03-09T14:41:17.086 INFO:tasks.workunit.client.0.smithi088.stderr: -299> 2024-03-09T14:41:16.591+0000 7feec400f800 1 build_initial for_mkfs: 0 2024-03-09T14:41:17.086 INFO:tasks.workunit.client.0.smithi088.stderr: -298> 2024-03-09T14:41:16.591+0000 7feec400f800 10 monclient: monmap: 2024-03-09T14:41:17.086 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:41:17.086 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:41:17.086 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:41:17.087 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:41:17.087 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:41:17.087 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.087 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:41:17.087 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:41:17.087 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:41:17.087 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.087 INFO:tasks.workunit.client.0.smithi088.stderr: -297> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding auth protocol: cephx 2024-03-09T14:41:17.087 INFO:tasks.workunit.client.0.smithi088.stderr: -296> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding auth protocol: cephx 2024-03-09T14:41:17.087 INFO:tasks.workunit.client.0.smithi088.stderr: -295> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding auth protocol: cephx 2024-03-09T14:41:17.087 INFO:tasks.workunit.client.0.smithi088.stderr: -294> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: secure 2024-03-09T14:41:17.087 INFO:tasks.workunit.client.0.smithi088.stderr: -293> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: crc 2024-03-09T14:41:17.087 INFO:tasks.workunit.client.0.smithi088.stderr: -292> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: secure 2024-03-09T14:41:17.087 INFO:tasks.workunit.client.0.smithi088.stderr: -291> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: crc 2024-03-09T14:41:17.088 INFO:tasks.workunit.client.0.smithi088.stderr: -290> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: secure 2024-03-09T14:41:17.088 INFO:tasks.workunit.client.0.smithi088.stderr: -289> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: crc 2024-03-09T14:41:17.088 INFO:tasks.workunit.client.0.smithi088.stderr: -288> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: crc 2024-03-09T14:41:17.088 INFO:tasks.workunit.client.0.smithi088.stderr: -287> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: secure 2024-03-09T14:41:17.088 INFO:tasks.workunit.client.0.smithi088.stderr: -286> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: crc 2024-03-09T14:41:17.088 INFO:tasks.workunit.client.0.smithi088.stderr: -285> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: secure 2024-03-09T14:41:17.088 INFO:tasks.workunit.client.0.smithi088.stderr: -284> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: crc 2024-03-09T14:41:17.088 INFO:tasks.workunit.client.0.smithi088.stderr: -283> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: secure 2024-03-09T14:41:17.088 INFO:tasks.workunit.client.0.smithi088.stderr: -282> 2024-03-09T14:41:16.591+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.088 INFO:tasks.workunit.client.0.smithi088.stderr: -281> 2024-03-09T14:41:16.591+0000 7feec400f800 10 monclient: init 2024-03-09T14:41:17.088 INFO:tasks.workunit.client.0.smithi088.stderr: -280> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding auth protocol: cephx 2024-03-09T14:41:17.088 INFO:tasks.workunit.client.0.smithi088.stderr: -279> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding auth protocol: cephx 2024-03-09T14:41:17.088 INFO:tasks.workunit.client.0.smithi088.stderr: -278> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding auth protocol: cephx 2024-03-09T14:41:17.088 INFO:tasks.workunit.client.0.smithi088.stderr: -277> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: secure 2024-03-09T14:41:17.088 INFO:tasks.workunit.client.0.smithi088.stderr: -276> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: crc 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -275> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: secure 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -274> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: crc 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -273> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: secure 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -272> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: crc 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -271> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: crc 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -270> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: secure 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -269> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: crc 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -268> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: secure 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -267> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: crc 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -266> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: secure 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -265> 2024-03-09T14:41:16.591+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -264> 2024-03-09T14:41:16.592+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -263> 2024-03-09T14:41:16.592+0000 7feec400f800 5 asok(0x55da4b506780) register_command rotate-key cmddesc rotate-key hook 0x7ffe1557ab68 EEXIST 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -262> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient: _reopen_session rank -1 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -261> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:41:17.089 INFO:tasks.workunit.client.0.smithi088.stderr: -260> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): picked mon.noname-a con 0x55da4b7f9360 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:17.090 INFO:tasks.workunit.client.0.smithi088.stderr: -259> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): picked mon.noname-b con 0x55da4b7eb120 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:17.090 INFO:tasks.workunit.client.0.smithi088.stderr: -258> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): picked mon.noname-c con 0x55da4b7ebe30 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:17.090 INFO:tasks.workunit.client.0.smithi088.stderr: -257> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.090 INFO:tasks.workunit.client.0.smithi088.stderr: -256> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.090 INFO:tasks.workunit.client.0.smithi088.stderr: -255> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.090 INFO:tasks.workunit.client.0.smithi088.stderr: -254> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): _renew_subs 2024-03-09T14:41:17.090 INFO:tasks.workunit.client.0.smithi088.stderr: -253> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): authenticate will time out at 1691.930425s 2024-03-09T14:41:17.090 INFO:tasks.workunit.client.0.smithi088.stderr: -252> 2024-03-09T14:41:16.592+0000 7feeb6e80640 10 monclient(hunting): get_auth_request con 0x55da4b7f9360 auth_method 0 2024-03-09T14:41:17.090 INFO:tasks.workunit.client.0.smithi088.stderr: -251> 2024-03-09T14:41:16.592+0000 7feeb6e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.090 INFO:tasks.workunit.client.0.smithi088.stderr: -250> 2024-03-09T14:41:16.592+0000 7feeb6e80640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.090 INFO:tasks.workunit.client.0.smithi088.stderr: -249> 2024-03-09T14:41:16.592+0000 7feeb6e80640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.090 INFO:tasks.workunit.client.0.smithi088.stderr: -248> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): get_auth_request con 0x55da4b7ebe30 auth_method 0 2024-03-09T14:41:17.090 INFO:tasks.workunit.client.0.smithi088.stderr: -247> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.091 INFO:tasks.workunit.client.0.smithi088.stderr: -246> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.091 INFO:tasks.workunit.client.0.smithi088.stderr: -245> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.091 INFO:tasks.workunit.client.0.smithi088.stderr: -244> 2024-03-09T14:41:16.592+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.091 INFO:tasks.workunit.client.0.smithi088.stderr: -243> 2024-03-09T14:41:16.592+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.091 INFO:tasks.workunit.client.0.smithi088.stderr: -242> 2024-03-09T14:41:16.592+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.091 INFO:tasks.workunit.client.0.smithi088.stderr: -241> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.091 INFO:tasks.workunit.client.0.smithi088.stderr: -240> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.091 INFO:tasks.workunit.client.0.smithi088.stderr: -239> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.091 INFO:tasks.workunit.client.0.smithi088.stderr: -238> 2024-03-09T14:41:16.592+0000 7feebfe82640 10 monclient(hunting): get_auth_request con 0x55da4b7eb120 auth_method 0 2024-03-09T14:41:17.091 INFO:tasks.workunit.client.0.smithi088.stderr: -237> 2024-03-09T14:41:16.592+0000 7feebfe82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.091 INFO:tasks.workunit.client.0.smithi088.stderr: -236> 2024-03-09T14:41:16.592+0000 7feebfe82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.091 INFO:tasks.workunit.client.0.smithi088.stderr: -235> 2024-03-09T14:41:16.592+0000 7feebfe82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.091 INFO:tasks.workunit.client.0.smithi088.stderr: -234> 2024-03-09T14:41:16.592+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.092 INFO:tasks.workunit.client.0.smithi088.stderr: -233> 2024-03-09T14:41:16.592+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.092 INFO:tasks.workunit.client.0.smithi088.stderr: -232> 2024-03-09T14:41:16.592+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.092 INFO:tasks.workunit.client.0.smithi088.stderr: -231> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): handle_auth_done global_id 6212 payload 274 2024-03-09T14:41:17.092 INFO:tasks.workunit.client.0.smithi088.stderr: -230> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient: _finish_hunting 0 2024-03-09T14:41:17.092 INFO:tasks.workunit.client.0.smithi088.stderr: -229> 2024-03-09T14:41:16.592+0000 7feebf681640 1 monclient: found mon.noname-c 2024-03-09T14:41:17.092 INFO:tasks.workunit.client.0.smithi088.stderr: -228> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:41:17.092 INFO:tasks.workunit.client.0.smithi088.stderr: -227> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.092 INFO:tasks.workunit.client.0.smithi088.stderr: -226> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:41:17.092 INFO:tasks.workunit.client.0.smithi088.stderr: -225> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: dump: 2024-03-09T14:41:17.092 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.092 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.092 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.092 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.092 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.093 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.093 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.093 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.093 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.093 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.093 INFO:tasks.workunit.client.0.smithi088.stderr: -224> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: _finish_auth 0 2024-03-09T14:41:17.093 INFO:tasks.workunit.client.0.smithi088.stderr: -223> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: _check_auth_tickets 2024-03-09T14:41:17.093 INFO:tasks.workunit.client.0.smithi088.stderr: -222> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:17.093 INFO:tasks.workunit.client.0.smithi088.stderr: -221> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.093 INFO:tasks.workunit.client.0.smithi088.stderr: -220> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:41:17.093 INFO:tasks.workunit.client.0.smithi088.stderr: -219> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: dump: 2024-03-09T14:41:17.093 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.093 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.093 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.093 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.094 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.094 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.094 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.094 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.094 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.094 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.094 INFO:tasks.workunit.client.0.smithi088.stderr: -218> 2024-03-09T14:41:16.592+0000 7feec400f800 5 monclient: authenticate success, global_id 6212 2024-03-09T14:41:17.094 INFO:tasks.workunit.client.0.smithi088.stderr: -217> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient: get_monmap_and_config success 2024-03-09T14:41:17.094 INFO:tasks.workunit.client.0.smithi088.stderr: -216> 2024-03-09T14:41:16.592+0000 7feec400f800 4 set_mon_vals no callback set 2024-03-09T14:41:17.094 INFO:tasks.workunit.client.0.smithi088.stderr: -215> 2024-03-09T14:41:16.593+0000 7feec400f800 10 monclient: shutdown 2024-03-09T14:41:17.094 INFO:tasks.workunit.client.0.smithi088.stderr: -214> 2024-03-09T14:41:16.593+0000 7feec400f800 10 monclient: build_initial_monmap 2024-03-09T14:41:17.095 INFO:tasks.workunit.client.0.smithi088.stderr: -213> 2024-03-09T14:41:16.593+0000 7feec400f800 1 build_initial for_mkfs: 0 2024-03-09T14:41:17.095 INFO:tasks.workunit.client.0.smithi088.stderr: -212> 2024-03-09T14:41:16.593+0000 7feec400f800 10 monclient: monmap: 2024-03-09T14:41:17.095 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:41:17.095 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:41:17.095 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:41:17.095 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:41:17.095 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:41:17.095 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.095 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:41:17.095 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:41:17.095 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:41:17.095 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.095 INFO:tasks.workunit.client.0.smithi088.stderr: -211> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding auth protocol: cephx 2024-03-09T14:41:17.095 INFO:tasks.workunit.client.0.smithi088.stderr: -210> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding auth protocol: cephx 2024-03-09T14:41:17.095 INFO:tasks.workunit.client.0.smithi088.stderr: -209> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding auth protocol: cephx 2024-03-09T14:41:17.096 INFO:tasks.workunit.client.0.smithi088.stderr: -208> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: secure 2024-03-09T14:41:17.096 INFO:tasks.workunit.client.0.smithi088.stderr: -207> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: crc 2024-03-09T14:41:17.096 INFO:tasks.workunit.client.0.smithi088.stderr: -206> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: secure 2024-03-09T14:41:17.096 INFO:tasks.workunit.client.0.smithi088.stderr: -205> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: crc 2024-03-09T14:41:17.096 INFO:tasks.workunit.client.0.smithi088.stderr: -204> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: secure 2024-03-09T14:41:17.096 INFO:tasks.workunit.client.0.smithi088.stderr: -203> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: crc 2024-03-09T14:41:17.096 INFO:tasks.workunit.client.0.smithi088.stderr: -202> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: crc 2024-03-09T14:41:17.096 INFO:tasks.workunit.client.0.smithi088.stderr: -201> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: secure 2024-03-09T14:41:17.096 INFO:tasks.workunit.client.0.smithi088.stderr: -200> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: crc 2024-03-09T14:41:17.096 INFO:tasks.workunit.client.0.smithi088.stderr: -199> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: secure 2024-03-09T14:41:17.096 INFO:tasks.workunit.client.0.smithi088.stderr: -198> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: crc 2024-03-09T14:41:17.096 INFO:tasks.workunit.client.0.smithi088.stderr: -197> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: secure 2024-03-09T14:41:17.096 INFO:tasks.workunit.client.0.smithi088.stderr: -196> 2024-03-09T14:41:16.593+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.096 INFO:tasks.workunit.client.0.smithi088.stderr: -195> 2024-03-09T14:41:16.593+0000 7feec400f800 1 librados: starting msgr at 2024-03-09T14:41:17.097 INFO:tasks.workunit.client.0.smithi088.stderr: -194> 2024-03-09T14:41:16.593+0000 7feec400f800 1 librados: starting objecter 2024-03-09T14:41:17.097 INFO:tasks.workunit.client.0.smithi088.stderr: -193> 2024-03-09T14:41:16.593+0000 7feec400f800 5 asok(0x55da4b506780) register_command objecter_requests cmddesc objecter_requests hook 0x55da4b7f4f60 EEXIST 2024-03-09T14:41:17.097 INFO:tasks.workunit.client.0.smithi088.stderr: -192> 2024-03-09T14:41:16.593+0000 7feec400f800 1 librados: setting wanted keys 2024-03-09T14:41:17.097 INFO:tasks.workunit.client.0.smithi088.stderr: -191> 2024-03-09T14:41:16.593+0000 7feec400f800 1 librados: calling monclient init 2024-03-09T14:41:17.097 INFO:tasks.workunit.client.0.smithi088.stderr: -190> 2024-03-09T14:41:16.593+0000 7feec400f800 10 monclient: init 2024-03-09T14:41:17.097 INFO:tasks.workunit.client.0.smithi088.stderr: -189> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding auth protocol: cephx 2024-03-09T14:41:17.097 INFO:tasks.workunit.client.0.smithi088.stderr: -188> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding auth protocol: cephx 2024-03-09T14:41:17.097 INFO:tasks.workunit.client.0.smithi088.stderr: -187> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding auth protocol: cephx 2024-03-09T14:41:17.097 INFO:tasks.workunit.client.0.smithi088.stderr: -186> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: secure 2024-03-09T14:41:17.097 INFO:tasks.workunit.client.0.smithi088.stderr: -185> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: crc 2024-03-09T14:41:17.097 INFO:tasks.workunit.client.0.smithi088.stderr: -184> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: secure 2024-03-09T14:41:17.097 INFO:tasks.workunit.client.0.smithi088.stderr: -183> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: crc 2024-03-09T14:41:17.097 INFO:tasks.workunit.client.0.smithi088.stderr: -182> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: secure 2024-03-09T14:41:17.097 INFO:tasks.workunit.client.0.smithi088.stderr: -181> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: crc 2024-03-09T14:41:17.097 INFO:tasks.workunit.client.0.smithi088.stderr: -180> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: crc 2024-03-09T14:41:17.098 INFO:tasks.workunit.client.0.smithi088.stderr: -179> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: secure 2024-03-09T14:41:17.098 INFO:tasks.workunit.client.0.smithi088.stderr: -178> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: crc 2024-03-09T14:41:17.098 INFO:tasks.workunit.client.0.smithi088.stderr: -177> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: secure 2024-03-09T14:41:17.098 INFO:tasks.workunit.client.0.smithi088.stderr: -176> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: crc 2024-03-09T14:41:17.098 INFO:tasks.workunit.client.0.smithi088.stderr: -175> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: secure 2024-03-09T14:41:17.098 INFO:tasks.workunit.client.0.smithi088.stderr: -174> 2024-03-09T14:41:16.594+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.098 INFO:tasks.workunit.client.0.smithi088.stderr: -173> 2024-03-09T14:41:16.594+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.098 INFO:tasks.workunit.client.0.smithi088.stderr: -172> 2024-03-09T14:41:16.594+0000 7feec400f800 5 asok(0x55da4b506780) register_command rotate-key cmddesc rotate-key hook 0x55da4b7bcb38 EEXIST 2024-03-09T14:41:17.098 INFO:tasks.workunit.client.0.smithi088.stderr: -171> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient: _reopen_session rank -1 2024-03-09T14:41:17.099 INFO:tasks.workunit.client.0.smithi088.stderr: -170> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:41:17.099 INFO:tasks.workunit.client.0.smithi088.stderr: -169> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): picked mon.noname-c con 0x55da4b7eb120 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:17.099 INFO:tasks.workunit.client.0.smithi088.stderr: -168> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): picked mon.noname-b con 0x55da4b7ebe30 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:17.099 INFO:tasks.workunit.client.0.smithi088.stderr: -167> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): picked mon.noname-a con 0x55da4b7f9360 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:17.099 INFO:tasks.workunit.client.0.smithi088.stderr: -166> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.099 INFO:tasks.workunit.client.0.smithi088.stderr: -165> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.099 INFO:tasks.workunit.client.0.smithi088.stderr: -164> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.099 INFO:tasks.workunit.client.0.smithi088.stderr: -163> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): _renew_subs 2024-03-09T14:41:17.099 INFO:tasks.workunit.client.0.smithi088.stderr: -162> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): authenticate will time out at 1691.932561s 2024-03-09T14:41:17.099 INFO:tasks.workunit.client.0.smithi088.stderr: -161> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): get_auth_request con 0x55da4b7eb120 auth_method 0 2024-03-09T14:41:17.099 INFO:tasks.workunit.client.0.smithi088.stderr: -160> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.099 INFO:tasks.workunit.client.0.smithi088.stderr: -159> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.100 INFO:tasks.workunit.client.0.smithi088.stderr: -158> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.100 INFO:tasks.workunit.client.0.smithi088.stderr: -157> 2024-03-09T14:41:16.594+0000 7feebf681640 10 monclient(hunting): get_auth_request con 0x55da4b7f9360 auth_method 0 2024-03-09T14:41:17.100 INFO:tasks.workunit.client.0.smithi088.stderr: -156> 2024-03-09T14:41:16.594+0000 7feebf681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.100 INFO:tasks.workunit.client.0.smithi088.stderr: -155> 2024-03-09T14:41:16.594+0000 7feebf681640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.100 INFO:tasks.workunit.client.0.smithi088.stderr: -154> 2024-03-09T14:41:16.594+0000 7feebf681640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.100 INFO:tasks.workunit.client.0.smithi088.stderr: -153> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.100 INFO:tasks.workunit.client.0.smithi088.stderr: -152> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.100 INFO:tasks.workunit.client.0.smithi088.stderr: -151> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.100 INFO:tasks.workunit.client.0.smithi088.stderr: -150> 2024-03-09T14:41:16.594+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.100 INFO:tasks.workunit.client.0.smithi088.stderr: -149> 2024-03-09T14:41:16.594+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.100 INFO:tasks.workunit.client.0.smithi088.stderr: -148> 2024-03-09T14:41:16.594+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.100 INFO:tasks.workunit.client.0.smithi088.stderr: -147> 2024-03-09T14:41:16.594+0000 7feebfe82640 10 monclient(hunting): get_auth_request con 0x55da4b7ebe30 auth_method 0 2024-03-09T14:41:17.100 INFO:tasks.workunit.client.0.smithi088.stderr: -146> 2024-03-09T14:41:16.594+0000 7feebfe82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.100 INFO:tasks.workunit.client.0.smithi088.stderr: -145> 2024-03-09T14:41:16.594+0000 7feebfe82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.101 INFO:tasks.workunit.client.0.smithi088.stderr: -144> 2024-03-09T14:41:16.594+0000 7feebfe82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.101 INFO:tasks.workunit.client.0.smithi088.stderr: -143> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): handle_auth_done global_id 6215 payload 824 2024-03-09T14:41:17.101 INFO:tasks.workunit.client.0.smithi088.stderr: -142> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient: _finish_hunting 0 2024-03-09T14:41:17.101 INFO:tasks.workunit.client.0.smithi088.stderr: -141> 2024-03-09T14:41:16.594+0000 7feeb6e80640 1 monclient: found mon.noname-c 2024-03-09T14:41:17.101 INFO:tasks.workunit.client.0.smithi088.stderr: -140> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:41:17.101 INFO:tasks.workunit.client.0.smithi088.stderr: -139> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.101 INFO:tasks.workunit.client.0.smithi088.stderr: -138> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:41:17.101 INFO:tasks.workunit.client.0.smithi088.stderr: -137> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: dump: 2024-03-09T14:41:17.101 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.102 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.102 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.102 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.102 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.102 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.102 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.102 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.102 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.102 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.102 INFO:tasks.workunit.client.0.smithi088.stderr: -136> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: _finish_auth 0 2024-03-09T14:41:17.102 INFO:tasks.workunit.client.0.smithi088.stderr: -135> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: _check_auth_tickets 2024-03-09T14:41:17.102 INFO:tasks.workunit.client.0.smithi088.stderr: -134> 2024-03-09T14:41:16.594+0000 7feec400f800 5 monclient: authenticate success, global_id 6215 2024-03-09T14:41:17.102 INFO:tasks.workunit.client.0.smithi088.stderr: -133> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient: _renew_subs 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr: -132> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr: -131> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr: -130> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr: -129> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr: -128> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: dump: 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.103 INFO:tasks.workunit.client.0.smithi088.stderr: -127> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient: _renew_subs 2024-03-09T14:41:17.104 INFO:tasks.workunit.client.0.smithi088.stderr: -126> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:41:17.104 INFO:tasks.workunit.client.0.smithi088.stderr: -125> 2024-03-09T14:41:16.594+0000 7feda2ffd640 4 set_mon_vals no callback set 2024-03-09T14:41:17.104 INFO:tasks.workunit.client.0.smithi088.stderr: -124> 2024-03-09T14:41:16.594+0000 7feec400f800 1 librados: init done 2024-03-09T14:41:17.104 INFO:tasks.workunit.client.0.smithi088.stderr: -123> 2024-03-09T14:41:16.595+0000 7feec400f800 5 asok(0x55da4b506780) register_command cr dump hook 0x55da4b806bf8 2024-03-09T14:41:17.104 INFO:tasks.workunit.client.0.smithi088.stderr: -122> 2024-03-09T14:41:16.596+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.104 INFO:tasks.workunit.client.0.smithi088.stderr: -121> 2024-03-09T14:41:16.596+0000 7feda17fa640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:41:17.104 INFO:tasks.workunit.client.0.smithi088.stderr: -120> 2024-03-09T14:41:16.596+0000 7feda17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:17.104 INFO:tasks.workunit.client.0.smithi088.stderr: -119> 2024-03-09T14:41:16.596+0000 7feda17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:17.104 INFO:tasks.workunit.client.0.smithi088.stderr: -118> 2024-03-09T14:41:16.597+0000 7feebf681640 10 monclient: get_auth_request con 0x55da4b813ee0 auth_method 0 2024-03-09T14:41:17.104 INFO:tasks.workunit.client.0.smithi088.stderr: -117> 2024-03-09T14:41:16.597+0000 7feebfe82640 10 monclient: get_auth_request con 0x7fed8806a5b0 auth_method 0 2024-03-09T14:41:17.104 INFO:tasks.workunit.client.0.smithi088.stderr: -116> 2024-03-09T14:41:16.597+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.104 INFO:tasks.workunit.client.0.smithi088.stderr: -115> 2024-03-09T14:41:16.597+0000 7feec400f800 20 realm 2024-03-09T14:41:17.104 INFO:tasks.workunit.client.0.smithi088.stderr: -114> 2024-03-09T14:41:16.597+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.104 INFO:tasks.workunit.client.0.smithi088.stderr: -113> 2024-03-09T14:41:16.597+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.105 INFO:tasks.workunit.client.0.smithi088.stderr: -112> 2024-03-09T14:41:16.597+0000 7feec400f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:17.105 INFO:tasks.workunit.client.0.smithi088.stderr: -111> 2024-03-09T14:41:16.597+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.105 INFO:tasks.workunit.client.0.smithi088.stderr: -110> 2024-03-09T14:41:16.597+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.105 INFO:tasks.workunit.client.0.smithi088.stderr: -109> 2024-03-09T14:41:16.597+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.105 INFO:tasks.workunit.client.0.smithi088.stderr: -108> 2024-03-09T14:41:16.598+0000 7feeb6e80640 10 monclient: get_auth_request con 0x55da4b818120 auth_method 0 2024-03-09T14:41:17.105 INFO:tasks.workunit.client.0.smithi088.stderr: -107> 2024-03-09T14:41:16.598+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.105 INFO:tasks.workunit.client.0.smithi088.stderr: -106> 2024-03-09T14:41:16.598+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.105 INFO:tasks.workunit.client.0.smithi088.stderr: -105> 2024-03-09T14:41:16.598+0000 7feebfe82640 10 monclient: get_auth_request con 0x55da4b81b960 auth_method 0 2024-03-09T14:41:17.105 INFO:tasks.workunit.client.0.smithi088.stderr: -104> 2024-03-09T14:41:16.599+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:17.105 INFO:tasks.workunit.client.0.smithi088.stderr: -103> 2024-03-09T14:41:16.599+0000 7feec400f800 20 searching for the correct realm 2024-03-09T14:41:17.105 INFO:tasks.workunit.client.0.smithi088.stderr: -102> 2024-03-09T14:41:16.599+0000 7feebf681640 10 monclient: get_auth_request con 0x55da4b8206f0 auth_method 0 2024-03-09T14:41:17.105 INFO:tasks.workunit.client.0.smithi088.stderr: -101> 2024-03-09T14:41:16.600+0000 7feeb6e80640 10 monclient: get_auth_request con 0x7feeb0041060 auth_method 0 2024-03-09T14:41:17.105 INFO:tasks.workunit.client.0.smithi088.stderr: -100> 2024-03-09T14:41:16.601+0000 7feebfe82640 10 monclient: get_auth_request con 0x7feeb805e050 auth_method 0 2024-03-09T14:41:17.105 INFO:tasks.workunit.client.0.smithi088.stderr: -99> 2024-03-09T14:41:16.601+0000 7feebfe82640 0 -- 172.21.15.88:0/3560501939 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7feeb805e050 msgr2=0x7feeb8099580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:17.106 INFO:tasks.workunit.client.0.smithi088.stderr: -98> 2024-03-09T14:41:16.802+0000 7feebfe82640 10 monclient: get_auth_request con 0x7feeb805e050 auth_method 0 2024-03-09T14:41:17.106 INFO:tasks.workunit.client.0.smithi088.stderr: -97> 2024-03-09T14:41:16.804+0000 7feebf681640 10 monclient: get_auth_request con 0x7feeb80c2040 auth_method 0 2024-03-09T14:41:17.106 INFO:tasks.workunit.client.0.smithi088.stderr: -96> 2024-03-09T14:41:16.807+0000 7feeb6e80640 10 monclient: get_auth_request con 0x7feeb80a2940 auth_method 0 2024-03-09T14:41:17.106 INFO:tasks.workunit.client.0.smithi088.stderr: -95> 2024-03-09T14:41:16.807+0000 7feeb6e80640 0 -- 172.21.15.88:0/3560501939 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7feeb80a2940 msgr2=0x7feeb80b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:17.106 INFO:tasks.workunit.client.0.smithi088.stderr: -94> 2024-03-09T14:41:17.008+0000 7feeb6e80640 10 monclient: get_auth_request con 0x7feeb80a2940 auth_method 0 2024-03-09T14:41:17.106 INFO:tasks.workunit.client.0.smithi088.stderr: -93> 2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:17.106 INFO:tasks.workunit.client.0.smithi088.stderr: -92> 2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:17.106 INFO:tasks.workunit.client.0.smithi088.stderr: -91> 2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:17.106 INFO:tasks.workunit.client.0.smithi088.stderr: -90> 2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:17.106 INFO:tasks.workunit.client.0.smithi088.stderr: -89> 2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:17.107 INFO:tasks.workunit.client.0.smithi088.stderr: -88> 2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:17.107 INFO:tasks.workunit.client.0.smithi088.stderr: -87> 2024-03-09T14:41:17.013+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.107 INFO:tasks.workunit.client.0.smithi088.stderr: -86> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.107 INFO:tasks.workunit.client.0.smithi088.stderr: -85> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.107 INFO:tasks.workunit.client.0.smithi088.stderr: -84> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.107 INFO:tasks.workunit.client.0.smithi088.stderr: -83> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.107 INFO:tasks.workunit.client.0.smithi088.stderr: -82> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:17.107 INFO:tasks.workunit.client.0.smithi088.stderr: -81> 2024-03-09T14:41:17.014+0000 7feec400f800 20 zone default found 2024-03-09T14:41:17.107 INFO:tasks.workunit.client.0.smithi088.stderr: -80> 2024-03-09T14:41:17.014+0000 7feec400f800 4 Realm: () 2024-03-09T14:41:17.107 INFO:tasks.workunit.client.0.smithi088.stderr: -79> 2024-03-09T14:41:17.014+0000 7feec400f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:17.107 INFO:tasks.workunit.client.0.smithi088.stderr: -78> 2024-03-09T14:41:17.014+0000 7feec400f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:17.107 INFO:tasks.workunit.client.0.smithi088.stderr: -77> 2024-03-09T14:41:17.014+0000 7feec400f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:17.107 INFO:tasks.workunit.client.0.smithi088.stderr: -76> 2024-03-09T14:41:17.014+0000 7feec400f800 20 zonegroup default 2024-03-09T14:41:17.108 INFO:tasks.workunit.client.0.smithi088.stderr: -75> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.108 INFO:tasks.workunit.client.0.smithi088.stderr: -74> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.108 INFO:tasks.workunit.client.0.smithi088.stderr: -73> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.108 INFO:tasks.workunit.client.0.smithi088.stderr: -72> 2024-03-09T14:41:17.015+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.108 INFO:tasks.workunit.client.0.smithi088.stderr: -71> 2024-03-09T14:41:17.015+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.108 INFO:tasks.workunit.client.0.smithi088.stderr: -70> 2024-03-09T14:41:17.015+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.108 INFO:tasks.workunit.client.0.smithi088.stderr: -69> 2024-03-09T14:41:17.015+0000 7feec400f800 20 started sync module instance, tier type = 2024-03-09T14:41:17.108 INFO:tasks.workunit.client.0.smithi088.stderr: -68> 2024-03-09T14:41:17.015+0000 7feec400f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:17.108 INFO:tasks.workunit.client.0.smithi088.stderr: -67> 2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=0 2024-03-09T14:41:17.108 INFO:tasks.workunit.client.0.smithi088.stderr: -66> 2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=1 2024-03-09T14:41:17.108 INFO:tasks.workunit.client.0.smithi088.stderr: -65> 2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=2 2024-03-09T14:41:17.108 INFO:tasks.workunit.client.0.smithi088.stderr: -64> 2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=3 2024-03-09T14:41:17.108 INFO:tasks.workunit.client.0.smithi088.stderr: -63> 2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=4 2024-03-09T14:41:17.108 INFO:tasks.workunit.client.0.smithi088.stderr: -62> 2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=5 2024-03-09T14:41:17.108 INFO:tasks.workunit.client.0.smithi088.stderr: -61> 2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=6 2024-03-09T14:41:17.109 INFO:tasks.workunit.client.0.smithi088.stderr: -60> 2024-03-09T14:41:17.025+0000 7feec400f800 20 add_watcher() i=7 2024-03-09T14:41:17.109 INFO:tasks.workunit.client.0.smithi088.stderr: -59> 2024-03-09T14:41:17.025+0000 7feec400f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:17.109 INFO:tasks.workunit.client.0.smithi088.stderr: -58> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding auth protocol: cephx 2024-03-09T14:41:17.109 INFO:tasks.workunit.client.0.smithi088.stderr: -57> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding auth protocol: cephx 2024-03-09T14:41:17.109 INFO:tasks.workunit.client.0.smithi088.stderr: -56> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding auth protocol: cephx 2024-03-09T14:41:17.109 INFO:tasks.workunit.client.0.smithi088.stderr: -55> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: secure 2024-03-09T14:41:17.109 INFO:tasks.workunit.client.0.smithi088.stderr: -54> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: crc 2024-03-09T14:41:17.109 INFO:tasks.workunit.client.0.smithi088.stderr: -53> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: secure 2024-03-09T14:41:17.109 INFO:tasks.workunit.client.0.smithi088.stderr: -52> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: crc 2024-03-09T14:41:17.109 INFO:tasks.workunit.client.0.smithi088.stderr: -51> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: secure 2024-03-09T14:41:17.109 INFO:tasks.workunit.client.0.smithi088.stderr: -50> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: crc 2024-03-09T14:41:17.110 INFO:tasks.workunit.client.0.smithi088.stderr: -49> 2024-03-09T14:41:17.027+0000 7fed75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:17.110 INFO:tasks.workunit.client.0.smithi088.stderr: -48> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: crc 2024-03-09T14:41:17.110 INFO:tasks.workunit.client.0.smithi088.stderr: -47> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: secure 2024-03-09T14:41:17.110 INFO:tasks.workunit.client.0.smithi088.stderr: -46> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: crc 2024-03-09T14:41:17.110 INFO:tasks.workunit.client.0.smithi088.stderr: -45> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: secure 2024-03-09T14:41:17.110 INFO:tasks.workunit.client.0.smithi088.stderr: -44> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: crc 2024-03-09T14:41:17.110 INFO:tasks.workunit.client.0.smithi088.stderr: -43> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: secure 2024-03-09T14:41:17.110 INFO:tasks.workunit.client.0.smithi088.stderr: -42> 2024-03-09T14:41:17.027+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.110 INFO:tasks.workunit.client.0.smithi088.stderr: -41> 2024-03-09T14:41:17.027+0000 7feec400f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:17.110 INFO:tasks.workunit.client.0.smithi088.stderr: -40> 2024-03-09T14:41:17.027+0000 7feec400f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:17.110 INFO:tasks.workunit.client.0.smithi088.stderr: -39> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command cache list hook 0x55da4b7ef030 2024-03-09T14:41:17.110 INFO:tasks.workunit.client.0.smithi088.stderr: -38> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command cache inspect hook 0x55da4b7ef030 2024-03-09T14:41:17.110 INFO:tasks.workunit.client.0.smithi088.stderr: -37> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command cache erase hook 0x55da4b7ef030 2024-03-09T14:41:17.110 INFO:tasks.workunit.client.0.smithi088.stderr: -36> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command cache zap hook 0x55da4b7ef030 2024-03-09T14:41:17.111 INFO:tasks.workunit.client.0.smithi088.stderr: -35> 2024-03-09T14:41:17.027+0000 7feec400f800 5 note: GC not initialized 2024-03-09T14:41:17.111 INFO:tasks.workunit.client.0.smithi088.stderr: -34> 2024-03-09T14:41:17.027+0000 7fed74fe1640 20 reqs_thread_entry: start 2024-03-09T14:41:17.111 INFO:tasks.workunit.client.0.smithi088.stderr: -33> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command sync trace show hook 0x7feea8002dc0 2024-03-09T14:41:17.111 INFO:tasks.workunit.client.0.smithi088.stderr: -32> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command sync trace history hook 0x7feea8002dc0 2024-03-09T14:41:17.111 INFO:tasks.workunit.client.0.smithi088.stderr: -31> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command sync trace active hook 0x7feea8002dc0 2024-03-09T14:41:17.111 INFO:tasks.workunit.client.0.smithi088.stderr: -30> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command sync trace active_short hook 0x7feea8002dc0 2024-03-09T14:41:17.111 INFO:tasks.workunit.client.0.smithi088.stderr: -29> 2024-03-09T14:41:17.027+0000 7feec400f800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:17.111 INFO:tasks.workunit.client.0.smithi088.stderr: -28> 2024-03-09T14:41:17.027+0000 7feec400f800 20 Filter name: none 2024-03-09T14:41:17.111 INFO:tasks.workunit.client.0.smithi088.stderr: -27> 2024-03-09T14:41:17.027+0000 7fecee7fc640 20 reqs_thread_entry: start 2024-03-09T14:41:17.111 INFO:tasks.workunit.client.0.smithi088.stderr: -26> 2024-03-09T14:41:17.028+0000 7feec400f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-09T14:41:17.111 INFO:tasks.workunit.client.0.smithi088.stderr: -25> 2024-03-09T14:41:17.028+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.111 INFO:tasks.workunit.client.0.smithi088.stderr: -24> 2024-03-09T14:41:17.028+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:17.111 INFO:tasks.workunit.client.0.smithi088.stderr: -23> 2024-03-09T14:41:17.028+0000 7feec400f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-09T14:41:17.111 INFO:tasks.workunit.client.0.smithi088.stderr: -22> 2024-03-09T14:41:17.028+0000 7feec400f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-09T14:41:17.112 INFO:tasks.workunit.client.0.smithi088.stderr: -21> 2024-03-09T14:41:17.028+0000 7feec400f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 : miss 2024-03-09T14:41:17.112 INFO:tasks.workunit.client.0.smithi088.stderr: -20> 2024-03-09T14:41:17.028+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.112 INFO:tasks.workunit.client.0.smithi088.stderr: -19> 2024-03-09T14:41:17.028+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:41:17.112 INFO:tasks.workunit.client.0.smithi088.stderr: -18> 2024-03-09T14:41:17.028+0000 7feec400f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 info.flags=0x17 2024-03-09T14:41:17.112 INFO:tasks.workunit.client.0.smithi088.stderr: -17> 2024-03-09T14:41:17.028+0000 7feec400f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to cache LRU end 2024-03-09T14:41:17.112 INFO:tasks.workunit.client.0.smithi088.stderr: -16> 2024-03-09T14:41:17.028+0000 7feec400f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:17.112 INFO:tasks.workunit.client.0.smithi088.stderr: -15> 2024-03-09T14:41:17.028+0000 7feec400f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:17.112 INFO:tasks.workunit.client.0.smithi088.stderr: -14> 2024-03-09T14:41:17.028+0000 7feec400f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 2024-03-09T14:41:17.112 INFO:tasks.workunit.client.0.smithi088.stderr: -13> 2024-03-09T14:41:17.034+0000 7feec400f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 info.flags=0x17 2024-03-09T14:41:17.112 INFO:tasks.workunit.client.0.smithi088.stderr: -12> 2024-03-09T14:41:17.034+0000 7feec400f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to cache LRU end 2024-03-09T14:41:17.112 INFO:tasks.workunit.client.0.smithi088.stderr: -11> 2024-03-09T14:41:17.034+0000 7feec400f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:17.112 INFO:tasks.workunit.client.0.smithi088.stderr: -10> 2024-03-09T14:41:17.034+0000 7feec400f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23, ofs0, ns] 2024-03-09T14:41:17.112 INFO:tasks.workunit.client.0.smithi088.stderr: -9> 2024-03-09T14:41:17.034+0000 7feda2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464344 cookie 94396058061952 notifier 6215 bl.length()=907 2024-03-09T14:41:17.112 INFO:tasks.workunit.client.0.smithi088.stderr: -8> 2024-03-09T14:41:17.034+0000 7feda2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 info.flags=0x17 2024-03-09T14:41:17.112 INFO:tasks.workunit.client.0.smithi088.stderr: -7> 2024-03-09T14:41:17.034+0000 7feda2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to cache LRU end 2024-03-09T14:41:17.113 INFO:tasks.workunit.client.0.smithi088.stderr: -6> 2024-03-09T14:41:17.034+0000 7feda2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:17.113 INFO:tasks.workunit.client.0.smithi088.stderr: -5> 2024-03-09T14:41:17.036+0000 7feec400f800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): orig_sources= new_sources= 2024-03-09T14:41:17.113 INFO:tasks.workunit.client.0.smithi088.stderr: -4> 2024-03-09T14:41:17.036+0000 7feec400f800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): potential sources added=[] removed=[] 2024-03-09T14:41:17.113 INFO:tasks.workunit.client.0.smithi088.stderr: -3> 2024-03-09T14:41:17.036+0000 7feec400f800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): orig_dests= new_dests= 2024-03-09T14:41:17.113 INFO:tasks.workunit.client.0.smithi088.stderr: -2> 2024-03-09T14:41:17.036+0000 7feec400f800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): potential dests added=[] removed=[] 2024-03-09T14:41:17.113 INFO:tasks.workunit.client.0.smithi088.stderr: -1> 2024-03-09T14:41:17.037+0000 7feec400f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feec400f800 time 2024-03-09T14:41:17.037901+0000 2024-03-09T14:41:17.113 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:41:17.113 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.113 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:17.113 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feec4f80e86] 2024-03-09T14:41:17.113 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7feec4f81044] 2024-03-09T14:41:17.113 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da4a95af91] 2024-03-09T14:41:17.113 INFO:tasks.workunit.client.0.smithi088.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55da4a975e64] 2024-03-09T14:41:17.113 INFO:tasks.workunit.client.0.smithi088.stderr: 5: main() 2024-03-09T14:41:17.114 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7feec3e3feb0] 2024-03-09T14:41:17.114 INFO:tasks.workunit.client.0.smithi088.stderr: 7: __libc_start_main() 2024-03-09T14:41:17.114 INFO:tasks.workunit.client.0.smithi088.stderr: 8: _start() 2024-03-09T14:41:17.114 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.114 INFO:tasks.workunit.client.0.smithi088.stderr: 0> 2024-03-09T14:41:17.038+0000 7feec400f800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:41:17.114 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7feec400f800 thread_name:radosgw-admin 2024-03-09T14:41:17.114 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.114 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:17.114 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7feec3e54db0] 2024-03-09T14:41:17.115 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7feec3ea154c] 2024-03-09T14:41:17.115 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:41:17.115 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:41:17.115 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feec4f80ee0] 2024-03-09T14:41:17.115 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7feec4f81044] 2024-03-09T14:41:17.115 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da4a95af91] 2024-03-09T14:41:17.115 INFO:tasks.workunit.client.0.smithi088.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55da4a975e64] 2024-03-09T14:41:17.115 INFO:tasks.workunit.client.0.smithi088.stderr: 9: main() 2024-03-09T14:41:17.115 INFO:tasks.workunit.client.0.smithi088.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7feec3e3feb0] 2024-03-09T14:41:17.115 INFO:tasks.workunit.client.0.smithi088.stderr: 11: __libc_start_main() 2024-03-09T14:41:17.115 INFO:tasks.workunit.client.0.smithi088.stderr: 12: _start() 2024-03-09T14:41:17.115 INFO:tasks.workunit.client.0.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:41:17.116 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.116 INFO:tasks.workunit.client.0.smithi088.stderr:--- logging levels --- 2024-03-09T14:41:17.116 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 none 2024-03-09T14:41:17.116 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 lockdep 2024-03-09T14:41:17.116 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 context 2024-03-09T14:41:17.116 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 crush 2024-03-09T14:41:17.117 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds 2024-03-09T14:41:17.117 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_balancer 2024-03-09T14:41:17.117 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_locker 2024-03-09T14:41:17.117 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log 2024-03-09T14:41:17.117 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log_expire 2024-03-09T14:41:17.117 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_migrator 2024-03-09T14:41:17.118 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 buffer 2024-03-09T14:41:17.118 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 timer 2024-03-09T14:41:17.118 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 filer 2024-03-09T14:41:17.118 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 striper 2024-03-09T14:41:17.118 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 objecter 2024-03-09T14:41:17.119 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rados 2024-03-09T14:41:17.119 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd 2024-03-09T14:41:17.119 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_mirror 2024-03-09T14:41:17.119 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_replay 2024-03-09T14:41:17.119 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_pwl 2024-03-09T14:41:17.119 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 journaler 2024-03-09T14:41:17.120 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objectcacher 2024-03-09T14:41:17.120 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:41:17.120 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 client 2024-03-09T14:41:17.120 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 osd 2024-03-09T14:41:17.120 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 optracker 2024-03-09T14:41:17.120 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objclass 2024-03-09T14:41:17.120 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 filestore 2024-03-09T14:41:17.120 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 journal 2024-03-09T14:41:17.120 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 ms 2024-03-09T14:41:17.121 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mon 2024-03-09T14:41:17.121 INFO:tasks.workunit.client.0.smithi088.stderr: 0/10 monc 2024-03-09T14:41:17.121 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 paxos 2024-03-09T14:41:17.121 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 tp 2024-03-09T14:41:17.121 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 auth 2024-03-09T14:41:17.121 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 crypto 2024-03-09T14:41:17.121 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 finisher 2024-03-09T14:41:17.121 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 reserver 2024-03-09T14:41:17.121 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 heartbeatmap 2024-03-09T14:41:17.121 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 perfcounter 2024-03-09T14:41:17.121 INFO:tasks.workunit.client.0.smithi088.stderr: 20/20 rgw 2024-03-09T14:41:17.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_sync 2024-03-09T14:41:17.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_datacache 2024-03-09T14:41:17.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_access 2024-03-09T14:41:17.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:41:17.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_flight 2024-03-09T14:41:17.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:41:17.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 javaclient 2024-03-09T14:41:17.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 asok 2024-03-09T14:41:17.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 throttle 2024-03-09T14:41:17.122 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 refs 2024-03-09T14:41:17.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 compressor 2024-03-09T14:41:17.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluestore 2024-03-09T14:41:17.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluefs 2024-03-09T14:41:17.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 bdev 2024-03-09T14:41:17.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 kstore 2024-03-09T14:41:17.123 INFO:tasks.workunit.client.0.smithi088.stderr: 4/ 5 rocksdb 2024-03-09T14:41:17.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 fuse 2024-03-09T14:41:17.123 INFO:tasks.workunit.client.0.smithi088.stderr: 2/ 5 mgr 2024-03-09T14:41:17.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mgrc 2024-03-09T14:41:17.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 dpdk 2024-03-09T14:41:17.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 eventtrace 2024-03-09T14:41:17.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 prioritycache 2024-03-09T14:41:17.123 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 test 2024-03-09T14:41:17.123 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:41:17.123 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephsqlite 2024-03-09T14:41:17.123 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:41:17.123 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore 2024-03-09T14:41:17.123 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_onode 2024-03-09T14:41:17.124 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_odata 2024-03-09T14:41:17.124 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_omap 2024-03-09T14:41:17.124 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_tm 2024-03-09T14:41:17.124 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_t 2024-03-09T14:41:17.124 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:41:17.124 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_epm 2024-03-09T14:41:17.124 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_lba 2024-03-09T14:41:17.124 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:41:17.124 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cache 2024-03-09T14:41:17.124 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_journal 2024-03-09T14:41:17.125 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_device 2024-03-09T14:41:17.125 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_backref 2024-03-09T14:41:17.125 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 alienstore 2024-03-09T14:41:17.125 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mclock 2024-03-09T14:41:17.125 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cyanstore 2024-03-09T14:41:17.125 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 ceph_exporter 2024-03-09T14:41:17.125 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 memstore 2024-03-09T14:41:17.125 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 trace 2024-03-09T14:41:17.125 INFO:tasks.workunit.client.0.smithi088.stderr: -2/-2 (syslog threshold) 2024-03-09T14:41:17.125 INFO:tasks.workunit.client.0.smithi088.stderr: 99/99 (stderr threshold) 2024-03-09T14:41:17.125 INFO:tasks.workunit.client.0.smithi088.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:41:17.125 INFO:tasks.workunit.client.0.smithi088.stderr: 7fecee7fc640 / http_manager 2024-03-09T14:41:17.126 INFO:tasks.workunit.client.0.smithi088.stderr: 7fed74fe1640 / http_manager 2024-03-09T14:41:17.126 INFO:tasks.workunit.client.0.smithi088.stderr: 7fed75fe3640 / rgw_dt_lg_renew 2024-03-09T14:41:17.126 INFO:tasks.workunit.client.0.smithi088.stderr: 7feda17fa640 / ms_dispatch 2024-03-09T14:41:17.126 INFO:tasks.workunit.client.0.smithi088.stderr: 7feda2ffd640 / io_context_pool 2024-03-09T14:41:17.126 INFO:tasks.workunit.client.0.smithi088.stderr: 7feda9602640 / ms_dispatch 2024-03-09T14:41:17.126 INFO:tasks.workunit.client.0.smithi088.stderr: 7fedabe07640 / ms_dispatch 2024-03-09T14:41:17.126 INFO:tasks.workunit.client.0.smithi088.stderr: 7fedad60a640 / io_context_pool 2024-03-09T14:41:17.126 INFO:tasks.workunit.client.0.smithi088.stderr: 7feeb6e80640 / msgr-worker-2 2024-03-09T14:41:17.126 INFO:tasks.workunit.client.0.smithi088.stderr: 7feebf681640 / msgr-worker-1 2024-03-09T14:41:17.126 INFO:tasks.workunit.client.0.smithi088.stderr: 7feebfe82640 / msgr-worker-0 2024-03-09T14:41:17.126 INFO:tasks.workunit.client.0.smithi088.stderr: 7feec0683640 / io_context_pool 2024-03-09T14:41:17.126 INFO:tasks.workunit.client.0.smithi088.stderr: 7feec400f800 / radosgw-admin 2024-03-09T14:41:17.126 INFO:tasks.workunit.client.0.smithi088.stderr: max_recent 500 2024-03-09T14:41:17.127 INFO:tasks.workunit.client.0.smithi088.stderr: max_new 1000 2024-03-09T14:41:17.127 INFO:tasks.workunit.client.0.smithi088.stderr: log_file /var/log/ceph/ceph-client.admin.96185.log 2024-03-09T14:41:17.127 INFO:tasks.workunit.client.0.smithi088.stderr:--- end dump of recent events --- 2024-03-09T14:41:17.127 INFO:tasks.workunit.client.0.smithi088.stderr:--- begin dump of recent events --- 2024-03-09T14:41:17.127 INFO:tasks.workunit.client.0.smithi088.stderr: -499> 2024-03-09T14:41:16.580+0000 7feec400f800 4 set_mon_vals no callback set 2024-03-09T14:41:17.127 INFO:tasks.workunit.client.0.smithi088.stderr: -498> 2024-03-09T14:41:16.580+0000 7fedad60a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.127 INFO:tasks.workunit.client.0.smithi088.stderr: -497> 2024-03-09T14:41:16.580+0000 7fedad60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:41:17.127 INFO:tasks.workunit.client.0.smithi088.stderr: -496> 2024-03-09T14:41:16.580+0000 7fedad60a640 10 monclient: dump: 2024-03-09T14:41:17.127 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.127 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.127 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.127 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.127 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.127 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.128 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.128 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.128 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.128 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.128 INFO:tasks.workunit.client.0.smithi088.stderr: -495> 2024-03-09T14:41:16.580+0000 7feec400f800 10 monclient: shutdown 2024-03-09T14:41:17.128 INFO:tasks.workunit.client.0.smithi088.stderr: -494> 2024-03-09T14:41:16.580+0000 7feec400f800 5 asok(0x55da4b506780) unregister_commands rotate-key 2024-03-09T14:41:17.128 INFO:tasks.workunit.client.0.smithi088.stderr: -493> 2024-03-09T14:41:16.580+0000 7feec400f800 10 monclient: build_initial_monmap 2024-03-09T14:41:17.128 INFO:tasks.workunit.client.0.smithi088.stderr: -492> 2024-03-09T14:41:16.580+0000 7feec400f800 1 build_initial for_mkfs: 0 2024-03-09T14:41:17.128 INFO:tasks.workunit.client.0.smithi088.stderr: -491> 2024-03-09T14:41:16.580+0000 7feec400f800 10 monclient: monmap: 2024-03-09T14:41:17.128 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:41:17.128 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:41:17.128 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:41:17.128 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:41:17.128 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:41:17.128 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.129 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:41:17.129 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:41:17.129 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:41:17.129 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.129 INFO:tasks.workunit.client.0.smithi088.stderr: -490> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding auth protocol: cephx 2024-03-09T14:41:17.129 INFO:tasks.workunit.client.0.smithi088.stderr: -489> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding auth protocol: cephx 2024-03-09T14:41:17.129 INFO:tasks.workunit.client.0.smithi088.stderr: -488> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding auth protocol: cephx 2024-03-09T14:41:17.129 INFO:tasks.workunit.client.0.smithi088.stderr: -487> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: secure 2024-03-09T14:41:17.129 INFO:tasks.workunit.client.0.smithi088.stderr: -486> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: crc 2024-03-09T14:41:17.129 INFO:tasks.workunit.client.0.smithi088.stderr: -485> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: secure 2024-03-09T14:41:17.129 INFO:tasks.workunit.client.0.smithi088.stderr: -484> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: crc 2024-03-09T14:41:17.129 INFO:tasks.workunit.client.0.smithi088.stderr: -483> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: secure 2024-03-09T14:41:17.129 INFO:tasks.workunit.client.0.smithi088.stderr: -482> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: crc 2024-03-09T14:41:17.129 INFO:tasks.workunit.client.0.smithi088.stderr: -481> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: crc 2024-03-09T14:41:17.130 INFO:tasks.workunit.client.0.smithi088.stderr: -480> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: secure 2024-03-09T14:41:17.130 INFO:tasks.workunit.client.0.smithi088.stderr: -479> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: crc 2024-03-09T14:41:17.130 INFO:tasks.workunit.client.0.smithi088.stderr: -478> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: secure 2024-03-09T14:41:17.130 INFO:tasks.workunit.client.0.smithi088.stderr: -477> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: crc 2024-03-09T14:41:17.130 INFO:tasks.workunit.client.0.smithi088.stderr: -476> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b727cb0) adding con mode: secure 2024-03-09T14:41:17.130 INFO:tasks.workunit.client.0.smithi088.stderr: -475> 2024-03-09T14:41:16.581+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.130 INFO:tasks.workunit.client.0.smithi088.stderr: -474> 2024-03-09T14:41:16.581+0000 7feec400f800 1 librados: starting msgr at 2024-03-09T14:41:17.130 INFO:tasks.workunit.client.0.smithi088.stderr: -473> 2024-03-09T14:41:16.581+0000 7feec400f800 1 librados: starting objecter 2024-03-09T14:41:17.130 INFO:tasks.workunit.client.0.smithi088.stderr: -472> 2024-03-09T14:41:16.581+0000 7feec400f800 5 asok(0x55da4b506780) register_command objecter_requests hook 0x55da4b72a220 2024-03-09T14:41:17.130 INFO:tasks.workunit.client.0.smithi088.stderr: -471> 2024-03-09T14:41:16.581+0000 7feec400f800 1 librados: setting wanted keys 2024-03-09T14:41:17.130 INFO:tasks.workunit.client.0.smithi088.stderr: -470> 2024-03-09T14:41:16.581+0000 7feec400f800 1 librados: calling monclient init 2024-03-09T14:41:17.130 INFO:tasks.workunit.client.0.smithi088.stderr: -469> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient: init 2024-03-09T14:41:17.130 INFO:tasks.workunit.client.0.smithi088.stderr: -468> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding auth protocol: cephx 2024-03-09T14:41:17.130 INFO:tasks.workunit.client.0.smithi088.stderr: -467> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding auth protocol: cephx 2024-03-09T14:41:17.130 INFO:tasks.workunit.client.0.smithi088.stderr: -466> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding auth protocol: cephx 2024-03-09T14:41:17.131 INFO:tasks.workunit.client.0.smithi088.stderr: -465> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: secure 2024-03-09T14:41:17.131 INFO:tasks.workunit.client.0.smithi088.stderr: -464> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: crc 2024-03-09T14:41:17.131 INFO:tasks.workunit.client.0.smithi088.stderr: -463> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: secure 2024-03-09T14:41:17.131 INFO:tasks.workunit.client.0.smithi088.stderr: -462> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: crc 2024-03-09T14:41:17.131 INFO:tasks.workunit.client.0.smithi088.stderr: -461> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: secure 2024-03-09T14:41:17.131 INFO:tasks.workunit.client.0.smithi088.stderr: -460> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: crc 2024-03-09T14:41:17.131 INFO:tasks.workunit.client.0.smithi088.stderr: -459> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: crc 2024-03-09T14:41:17.131 INFO:tasks.workunit.client.0.smithi088.stderr: -458> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: secure 2024-03-09T14:41:17.131 INFO:tasks.workunit.client.0.smithi088.stderr: -457> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: crc 2024-03-09T14:41:17.131 INFO:tasks.workunit.client.0.smithi088.stderr: -456> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: secure 2024-03-09T14:41:17.131 INFO:tasks.workunit.client.0.smithi088.stderr: -455> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: crc 2024-03-09T14:41:17.131 INFO:tasks.workunit.client.0.smithi088.stderr: -454> 2024-03-09T14:41:16.581+0000 7feec400f800 5 AuthRegistry(0x55da4b7249c0) adding con mode: secure 2024-03-09T14:41:17.131 INFO:tasks.workunit.client.0.smithi088.stderr: -453> 2024-03-09T14:41:16.581+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.131 INFO:tasks.workunit.client.0.smithi088.stderr: -452> 2024-03-09T14:41:16.581+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.132 INFO:tasks.workunit.client.0.smithi088.stderr: -451> 2024-03-09T14:41:16.581+0000 7feec400f800 5 asok(0x55da4b506780) register_command rotate-key hook 0x55da4b724b08 2024-03-09T14:41:17.132 INFO:tasks.workunit.client.0.smithi088.stderr: -450> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient: _reopen_session rank -1 2024-03-09T14:41:17.132 INFO:tasks.workunit.client.0.smithi088.stderr: -449> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:41:17.132 INFO:tasks.workunit.client.0.smithi088.stderr: -448> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): picked mon.noname-b con 0x55da4b5db380 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:17.132 INFO:tasks.workunit.client.0.smithi088.stderr: -447> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): picked mon.noname-a con 0x55da4b665630 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:17.132 INFO:tasks.workunit.client.0.smithi088.stderr: -446> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): picked mon.noname-c con 0x55da4b66bf60 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:17.132 INFO:tasks.workunit.client.0.smithi088.stderr: -445> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.132 INFO:tasks.workunit.client.0.smithi088.stderr: -444> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.132 INFO:tasks.workunit.client.0.smithi088.stderr: -443> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.132 INFO:tasks.workunit.client.0.smithi088.stderr: -442> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): _renew_subs 2024-03-09T14:41:17.132 INFO:tasks.workunit.client.0.smithi088.stderr: -441> 2024-03-09T14:41:16.581+0000 7feec400f800 10 monclient(hunting): authenticate will time out at 1691.920173s 2024-03-09T14:41:17.132 INFO:tasks.workunit.client.0.smithi088.stderr: -440> 2024-03-09T14:41:16.581+0000 7feebfe82640 10 monclient(hunting): get_auth_request con 0x55da4b66bf60 auth_method 0 2024-03-09T14:41:17.132 INFO:tasks.workunit.client.0.smithi088.stderr: -439> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.133 INFO:tasks.workunit.client.0.smithi088.stderr: -438> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.133 INFO:tasks.workunit.client.0.smithi088.stderr: -437> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.133 INFO:tasks.workunit.client.0.smithi088.stderr: -436> 2024-03-09T14:41:16.582+0000 7feeb6e80640 10 monclient(hunting): get_auth_request con 0x55da4b665630 auth_method 0 2024-03-09T14:41:17.133 INFO:tasks.workunit.client.0.smithi088.stderr: -435> 2024-03-09T14:41:16.582+0000 7feeb6e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.133 INFO:tasks.workunit.client.0.smithi088.stderr: -434> 2024-03-09T14:41:16.582+0000 7feeb6e80640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.133 INFO:tasks.workunit.client.0.smithi088.stderr: -433> 2024-03-09T14:41:16.582+0000 7feeb6e80640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.133 INFO:tasks.workunit.client.0.smithi088.stderr: -432> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.133 INFO:tasks.workunit.client.0.smithi088.stderr: -431> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.133 INFO:tasks.workunit.client.0.smithi088.stderr: -430> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.133 INFO:tasks.workunit.client.0.smithi088.stderr: -429> 2024-03-09T14:41:16.582+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.133 INFO:tasks.workunit.client.0.smithi088.stderr: -428> 2024-03-09T14:41:16.582+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.133 INFO:tasks.workunit.client.0.smithi088.stderr: -427> 2024-03-09T14:41:16.582+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.133 INFO:tasks.workunit.client.0.smithi088.stderr: -426> 2024-03-09T14:41:16.582+0000 7feebf681640 10 monclient(hunting): get_auth_request con 0x55da4b5db380 auth_method 0 2024-03-09T14:41:17.133 INFO:tasks.workunit.client.0.smithi088.stderr: -425> 2024-03-09T14:41:16.582+0000 7feebf681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.134 INFO:tasks.workunit.client.0.smithi088.stderr: -424> 2024-03-09T14:41:16.582+0000 7feebf681640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.134 INFO:tasks.workunit.client.0.smithi088.stderr: -423> 2024-03-09T14:41:16.582+0000 7feebf681640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.134 INFO:tasks.workunit.client.0.smithi088.stderr: -422> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient(hunting): handle_auth_done global_id 6206 payload 824 2024-03-09T14:41:17.134 INFO:tasks.workunit.client.0.smithi088.stderr: -421> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient: _finish_hunting 0 2024-03-09T14:41:17.134 INFO:tasks.workunit.client.0.smithi088.stderr: -420> 2024-03-09T14:41:16.582+0000 7feebfe82640 1 monclient: found mon.noname-c 2024-03-09T14:41:17.134 INFO:tasks.workunit.client.0.smithi088.stderr: -419> 2024-03-09T14:41:16.582+0000 7feebfe82640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:41:17.134 INFO:tasks.workunit.client.0.smithi088.stderr: -418> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.134 INFO:tasks.workunit.client.0.smithi088.stderr: -417> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:41:17.134 INFO:tasks.workunit.client.0.smithi088.stderr: -416> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: dump: 2024-03-09T14:41:17.134 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.134 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.135 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.135 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.135 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.135 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.135 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.135 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.135 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.135 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.135 INFO:tasks.workunit.client.0.smithi088.stderr: -415> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: _finish_auth 0 2024-03-09T14:41:17.135 INFO:tasks.workunit.client.0.smithi088.stderr: -414> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: _check_auth_tickets 2024-03-09T14:41:17.135 INFO:tasks.workunit.client.0.smithi088.stderr: -413> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:17.135 INFO:tasks.workunit.client.0.smithi088.stderr: -412> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.135 INFO:tasks.workunit.client.0.smithi088.stderr: -411> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:41:17.135 INFO:tasks.workunit.client.0.smithi088.stderr: -410> 2024-03-09T14:41:16.582+0000 7fedabe07640 10 monclient: dump: 2024-03-09T14:41:17.135 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.136 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.136 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.136 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.136 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.136 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.136 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.136 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.136 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.136 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.136 INFO:tasks.workunit.client.0.smithi088.stderr: -409> 2024-03-09T14:41:16.582+0000 7feec400f800 5 monclient: authenticate success, global_id 6206 2024-03-09T14:41:17.136 INFO:tasks.workunit.client.0.smithi088.stderr: -408> 2024-03-09T14:41:16.582+0000 7fedad60a640 4 set_mon_vals no callback set 2024-03-09T14:41:17.136 INFO:tasks.workunit.client.0.smithi088.stderr: -407> 2024-03-09T14:41:16.582+0000 7feec400f800 10 monclient: _renew_subs 2024-03-09T14:41:17.136 INFO:tasks.workunit.client.0.smithi088.stderr: -406> 2024-03-09T14:41:16.582+0000 7feec400f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:41:17.136 INFO:tasks.workunit.client.0.smithi088.stderr: -405> 2024-03-09T14:41:16.582+0000 7feec400f800 10 monclient: _renew_subs 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr: -404> 2024-03-09T14:41:16.582+0000 7feec400f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr: -403> 2024-03-09T14:41:16.582+0000 7feec400f800 1 librados: init done 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr: -402> 2024-03-09T14:41:16.584+0000 7fedabe07640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr: -401> 2024-03-09T14:41:16.584+0000 7fedabe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr: -400> 2024-03-09T14:41:16.584+0000 7fedabe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr: -399> 2024-03-09T14:41:16.584+0000 7feebf681640 10 monclient: get_auth_request con 0x7feda406a5b0 auth_method 0 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr: -398> 2024-03-09T14:41:16.584+0000 7feeb6e80640 10 monclient: get_auth_request con 0x55da4b766d50 auth_method 0 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr: -397> 2024-03-09T14:41:16.585+0000 7feebf681640 10 monclient: get_auth_request con 0x55da4b770780 auth_method 0 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr: -396> 2024-03-09T14:41:16.586+0000 7feeb6e80640 10 monclient: get_auth_request con 0x55da4b774ae0 auth_method 0 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr: -395> 2024-03-09T14:41:16.587+0000 7feebfe82640 10 monclient: get_auth_request con 0x55da4b773fd0 auth_method 0 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr: -394> 2024-03-09T14:41:16.587+0000 7feec400f800 10 monclient: build_initial_monmap 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr: -393> 2024-03-09T14:41:16.587+0000 7feec400f800 1 build_initial for_mkfs: 0 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr: -392> 2024-03-09T14:41:16.587+0000 7feec400f800 10 monclient: monmap: 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:41:17.137 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:41:17.138 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:41:17.138 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:41:17.138 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.138 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:41:17.138 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:41:17.138 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:41:17.138 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.138 INFO:tasks.workunit.client.0.smithi088.stderr: -391> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding auth protocol: cephx 2024-03-09T14:41:17.138 INFO:tasks.workunit.client.0.smithi088.stderr: -390> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding auth protocol: cephx 2024-03-09T14:41:17.138 INFO:tasks.workunit.client.0.smithi088.stderr: -389> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding auth protocol: cephx 2024-03-09T14:41:17.138 INFO:tasks.workunit.client.0.smithi088.stderr: -388> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: secure 2024-03-09T14:41:17.138 INFO:tasks.workunit.client.0.smithi088.stderr: -387> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: crc 2024-03-09T14:41:17.138 INFO:tasks.workunit.client.0.smithi088.stderr: -386> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: secure 2024-03-09T14:41:17.138 INFO:tasks.workunit.client.0.smithi088.stderr: -385> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: crc 2024-03-09T14:41:17.139 INFO:tasks.workunit.client.0.smithi088.stderr: -384> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: secure 2024-03-09T14:41:17.139 INFO:tasks.workunit.client.0.smithi088.stderr: -383> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: crc 2024-03-09T14:41:17.139 INFO:tasks.workunit.client.0.smithi088.stderr: -382> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: crc 2024-03-09T14:41:17.139 INFO:tasks.workunit.client.0.smithi088.stderr: -381> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: secure 2024-03-09T14:41:17.139 INFO:tasks.workunit.client.0.smithi088.stderr: -380> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: crc 2024-03-09T14:41:17.139 INFO:tasks.workunit.client.0.smithi088.stderr: -379> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: secure 2024-03-09T14:41:17.139 INFO:tasks.workunit.client.0.smithi088.stderr: -378> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: crc 2024-03-09T14:41:17.139 INFO:tasks.workunit.client.0.smithi088.stderr: -377> 2024-03-09T14:41:16.587+0000 7feec400f800 5 AuthRegistry(0x55da4b77cba0) adding con mode: secure 2024-03-09T14:41:17.139 INFO:tasks.workunit.client.0.smithi088.stderr: -376> 2024-03-09T14:41:16.588+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.139 INFO:tasks.workunit.client.0.smithi088.stderr: -375> 2024-03-09T14:41:16.588+0000 7feec400f800 5 asok(0x55da4b506780) register_command objecter_requests cmddesc objecter_requests hook 0x55da4b780790 EEXIST 2024-03-09T14:41:17.139 INFO:tasks.workunit.client.0.smithi088.stderr: -374> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient: init 2024-03-09T14:41:17.139 INFO:tasks.workunit.client.0.smithi088.stderr: -373> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding auth protocol: cephx 2024-03-09T14:41:17.139 INFO:tasks.workunit.client.0.smithi088.stderr: -372> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding auth protocol: cephx 2024-03-09T14:41:17.140 INFO:tasks.workunit.client.0.smithi088.stderr: -371> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding auth protocol: cephx 2024-03-09T14:41:17.140 INFO:tasks.workunit.client.0.smithi088.stderr: -370> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: secure 2024-03-09T14:41:17.140 INFO:tasks.workunit.client.0.smithi088.stderr: -369> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: crc 2024-03-09T14:41:17.140 INFO:tasks.workunit.client.0.smithi088.stderr: -368> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: secure 2024-03-09T14:41:17.140 INFO:tasks.workunit.client.0.smithi088.stderr: -367> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: crc 2024-03-09T14:41:17.140 INFO:tasks.workunit.client.0.smithi088.stderr: -366> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: secure 2024-03-09T14:41:17.140 INFO:tasks.workunit.client.0.smithi088.stderr: -365> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: crc 2024-03-09T14:41:17.140 INFO:tasks.workunit.client.0.smithi088.stderr: -364> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: crc 2024-03-09T14:41:17.140 INFO:tasks.workunit.client.0.smithi088.stderr: -363> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: secure 2024-03-09T14:41:17.140 INFO:tasks.workunit.client.0.smithi088.stderr: -362> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: crc 2024-03-09T14:41:17.140 INFO:tasks.workunit.client.0.smithi088.stderr: -361> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: secure 2024-03-09T14:41:17.140 INFO:tasks.workunit.client.0.smithi088.stderr: -360> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: crc 2024-03-09T14:41:17.140 INFO:tasks.workunit.client.0.smithi088.stderr: -359> 2024-03-09T14:41:16.588+0000 7feec400f800 5 AuthRegistry(0x55da4b77ba78) adding con mode: secure 2024-03-09T14:41:17.140 INFO:tasks.workunit.client.0.smithi088.stderr: -358> 2024-03-09T14:41:16.588+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.140 INFO:tasks.workunit.client.0.smithi088.stderr: -357> 2024-03-09T14:41:16.588+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.141 INFO:tasks.workunit.client.0.smithi088.stderr: -356> 2024-03-09T14:41:16.588+0000 7feec400f800 5 asok(0x55da4b506780) register_command rotate-key cmddesc rotate-key hook 0x55da4b77bbc0 EEXIST 2024-03-09T14:41:17.141 INFO:tasks.workunit.client.0.smithi088.stderr: -355> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient: _reopen_session rank -1 2024-03-09T14:41:17.141 INFO:tasks.workunit.client.0.smithi088.stderr: -354> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:41:17.141 INFO:tasks.workunit.client.0.smithi088.stderr: -353> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): picked mon.noname-b con 0x55da4b7a6df0 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:17.141 INFO:tasks.workunit.client.0.smithi088.stderr: -352> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): picked mon.noname-c con 0x55da4b7b9410 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:17.141 INFO:tasks.workunit.client.0.smithi088.stderr: -351> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): picked mon.noname-a con 0x55da4b7a3d30 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:17.141 INFO:tasks.workunit.client.0.smithi088.stderr: -350> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.141 INFO:tasks.workunit.client.0.smithi088.stderr: -349> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.141 INFO:tasks.workunit.client.0.smithi088.stderr: -348> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.141 INFO:tasks.workunit.client.0.smithi088.stderr: -347> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): _renew_subs 2024-03-09T14:41:17.141 INFO:tasks.workunit.client.0.smithi088.stderr: -346> 2024-03-09T14:41:16.588+0000 7feec400f800 10 monclient(hunting): authenticate will time out at 1691.927026s 2024-03-09T14:41:17.141 INFO:tasks.workunit.client.0.smithi088.stderr: -345> 2024-03-09T14:41:16.588+0000 7feebf681640 10 monclient(hunting): get_auth_request con 0x55da4b7a3d30 auth_method 0 2024-03-09T14:41:17.141 INFO:tasks.workunit.client.0.smithi088.stderr: -344> 2024-03-09T14:41:16.588+0000 7feebf681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.142 INFO:tasks.workunit.client.0.smithi088.stderr: -343> 2024-03-09T14:41:16.588+0000 7feebf681640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.142 INFO:tasks.workunit.client.0.smithi088.stderr: -342> 2024-03-09T14:41:16.588+0000 7feebf681640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.142 INFO:tasks.workunit.client.0.smithi088.stderr: -341> 2024-03-09T14:41:16.588+0000 7feebfe82640 10 monclient(hunting): get_auth_request con 0x55da4b7b9410 auth_method 0 2024-03-09T14:41:17.142 INFO:tasks.workunit.client.0.smithi088.stderr: -340> 2024-03-09T14:41:16.588+0000 7feebfe82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.142 INFO:tasks.workunit.client.0.smithi088.stderr: -339> 2024-03-09T14:41:16.588+0000 7feebfe82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.142 INFO:tasks.workunit.client.0.smithi088.stderr: -338> 2024-03-09T14:41:16.588+0000 7feebfe82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.142 INFO:tasks.workunit.client.0.smithi088.stderr: -337> 2024-03-09T14:41:16.588+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.142 INFO:tasks.workunit.client.0.smithi088.stderr: -336> 2024-03-09T14:41:16.588+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.142 INFO:tasks.workunit.client.0.smithi088.stderr: -335> 2024-03-09T14:41:16.588+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.142 INFO:tasks.workunit.client.0.smithi088.stderr: -334> 2024-03-09T14:41:16.588+0000 7feeb6e80640 10 monclient(hunting): get_auth_request con 0x55da4b7a6df0 auth_method 0 2024-03-09T14:41:17.142 INFO:tasks.workunit.client.0.smithi088.stderr: -333> 2024-03-09T14:41:16.588+0000 7feeb6e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.142 INFO:tasks.workunit.client.0.smithi088.stderr: -332> 2024-03-09T14:41:16.588+0000 7feeb6e80640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.142 INFO:tasks.workunit.client.0.smithi088.stderr: -331> 2024-03-09T14:41:16.588+0000 7feeb6e80640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.142 INFO:tasks.workunit.client.0.smithi088.stderr: -330> 2024-03-09T14:41:16.588+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.143 INFO:tasks.workunit.client.0.smithi088.stderr: -329> 2024-03-09T14:41:16.588+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.143 INFO:tasks.workunit.client.0.smithi088.stderr: -328> 2024-03-09T14:41:16.588+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.143 INFO:tasks.workunit.client.0.smithi088.stderr: -327> 2024-03-09T14:41:16.589+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.143 INFO:tasks.workunit.client.0.smithi088.stderr: -326> 2024-03-09T14:41:16.589+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.143 INFO:tasks.workunit.client.0.smithi088.stderr: -325> 2024-03-09T14:41:16.589+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.143 INFO:tasks.workunit.client.0.smithi088.stderr: -324> 2024-03-09T14:41:16.589+0000 7feebf681640 10 monclient(hunting): handle_auth_done global_id 6483 payload 824 2024-03-09T14:41:17.143 INFO:tasks.workunit.client.0.smithi088.stderr: -323> 2024-03-09T14:41:16.589+0000 7feebf681640 10 monclient: _finish_hunting 0 2024-03-09T14:41:17.143 INFO:tasks.workunit.client.0.smithi088.stderr: -322> 2024-03-09T14:41:16.589+0000 7feebf681640 1 monclient: found mon.noname-a 2024-03-09T14:41:17.143 INFO:tasks.workunit.client.0.smithi088.stderr: -321> 2024-03-09T14:41:16.589+0000 7feebf681640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.88:3300/0 2024-03-09T14:41:17.143 INFO:tasks.workunit.client.0.smithi088.stderr: -320> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.143 INFO:tasks.workunit.client.0.smithi088.stderr: -319> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:41:17.143 INFO:tasks.workunit.client.0.smithi088.stderr: -318> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: dump: 2024-03-09T14:41:17.143 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.143 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.144 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.144 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.144 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.144 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.144 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.144 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.144 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.144 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.144 INFO:tasks.workunit.client.0.smithi088.stderr: -317> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: _finish_auth 0 2024-03-09T14:41:17.144 INFO:tasks.workunit.client.0.smithi088.stderr: -316> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: _check_auth_tickets 2024-03-09T14:41:17.144 INFO:tasks.workunit.client.0.smithi088.stderr: -315> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:17.144 INFO:tasks.workunit.client.0.smithi088.stderr: -314> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.144 INFO:tasks.workunit.client.0.smithi088.stderr: -313> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:41:17.145 INFO:tasks.workunit.client.0.smithi088.stderr: -312> 2024-03-09T14:41:16.589+0000 7feda9602640 10 monclient: dump: 2024-03-09T14:41:17.145 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.145 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.145 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.145 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.145 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.145 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.145 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.145 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.145 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.145 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.145 INFO:tasks.workunit.client.0.smithi088.stderr: -311> 2024-03-09T14:41:16.589+0000 7feec400f800 5 monclient: authenticate success, global_id 6483 2024-03-09T14:41:17.145 INFO:tasks.workunit.client.0.smithi088.stderr: -310> 2024-03-09T14:41:16.589+0000 7feec400f800 10 monclient: _renew_subs 2024-03-09T14:41:17.145 INFO:tasks.workunit.client.0.smithi088.stderr: -309> 2024-03-09T14:41:16.589+0000 7feec0683640 4 set_mon_vals no callback set 2024-03-09T14:41:17.145 INFO:tasks.workunit.client.0.smithi088.stderr: -308> 2024-03-09T14:41:16.589+0000 7feec400f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:17.146 INFO:tasks.workunit.client.0.smithi088.stderr: -307> 2024-03-09T14:41:16.589+0000 7feec400f800 10 monclient: _renew_subs 2024-03-09T14:41:17.146 INFO:tasks.workunit.client.0.smithi088.stderr: -306> 2024-03-09T14:41:16.589+0000 7feec400f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:17.146 INFO:tasks.workunit.client.0.smithi088.stderr: -305> 2024-03-09T14:41:16.590+0000 7feda9602640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:41:17.146 INFO:tasks.workunit.client.0.smithi088.stderr: -304> 2024-03-09T14:41:16.590+0000 7feda9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:17.146 INFO:tasks.workunit.client.0.smithi088.stderr: -303> 2024-03-09T14:41:16.590+0000 7feda9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:17.146 INFO:tasks.workunit.client.0.smithi088.stderr: -302> 2024-03-09T14:41:16.591+0000 7feeb6e80640 10 monclient: get_auth_request con 0x7fed9806a4c0 auth_method 0 2024-03-09T14:41:17.146 INFO:tasks.workunit.client.0.smithi088.stderr: -301> 2024-03-09T14:41:16.591+0000 7feec400f800 10 monclient: get_monmap_and_config 2024-03-09T14:41:17.146 INFO:tasks.workunit.client.0.smithi088.stderr: -300> 2024-03-09T14:41:16.591+0000 7feec400f800 10 monclient: build_initial_monmap 2024-03-09T14:41:17.146 INFO:tasks.workunit.client.0.smithi088.stderr: -299> 2024-03-09T14:41:16.591+0000 7feec400f800 1 build_initial for_mkfs: 0 2024-03-09T14:41:17.146 INFO:tasks.workunit.client.0.smithi088.stderr: -298> 2024-03-09T14:41:16.591+0000 7feec400f800 10 monclient: monmap: 2024-03-09T14:41:17.146 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:41:17.146 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:41:17.146 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:41:17.146 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:41:17.147 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:41:17.147 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.147 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:41:17.147 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:41:17.147 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:41:17.147 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.147 INFO:tasks.workunit.client.0.smithi088.stderr: -297> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding auth protocol: cephx 2024-03-09T14:41:17.147 INFO:tasks.workunit.client.0.smithi088.stderr: -296> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding auth protocol: cephx 2024-03-09T14:41:17.147 INFO:tasks.workunit.client.0.smithi088.stderr: -295> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding auth protocol: cephx 2024-03-09T14:41:17.147 INFO:tasks.workunit.client.0.smithi088.stderr: -294> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: secure 2024-03-09T14:41:17.147 INFO:tasks.workunit.client.0.smithi088.stderr: -293> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: crc 2024-03-09T14:41:17.147 INFO:tasks.workunit.client.0.smithi088.stderr: -292> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: secure 2024-03-09T14:41:17.147 INFO:tasks.workunit.client.0.smithi088.stderr: -291> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: crc 2024-03-09T14:41:17.147 INFO:tasks.workunit.client.0.smithi088.stderr: -290> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: secure 2024-03-09T14:41:17.148 INFO:tasks.workunit.client.0.smithi088.stderr: -289> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: crc 2024-03-09T14:41:17.148 INFO:tasks.workunit.client.0.smithi088.stderr: -288> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: crc 2024-03-09T14:41:17.148 INFO:tasks.workunit.client.0.smithi088.stderr: -287> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: secure 2024-03-09T14:41:17.148 INFO:tasks.workunit.client.0.smithi088.stderr: -286> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: crc 2024-03-09T14:41:17.148 INFO:tasks.workunit.client.0.smithi088.stderr: -285> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: secure 2024-03-09T14:41:17.148 INFO:tasks.workunit.client.0.smithi088.stderr: -284> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: crc 2024-03-09T14:41:17.148 INFO:tasks.workunit.client.0.smithi088.stderr: -283> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4850) adding con mode: secure 2024-03-09T14:41:17.148 INFO:tasks.workunit.client.0.smithi088.stderr: -282> 2024-03-09T14:41:16.591+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.149 INFO:tasks.workunit.client.0.smithi088.stderr: -281> 2024-03-09T14:41:16.591+0000 7feec400f800 10 monclient: init 2024-03-09T14:41:17.149 INFO:tasks.workunit.client.0.smithi088.stderr: -280> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding auth protocol: cephx 2024-03-09T14:41:17.149 INFO:tasks.workunit.client.0.smithi088.stderr: -279> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding auth protocol: cephx 2024-03-09T14:41:17.149 INFO:tasks.workunit.client.0.smithi088.stderr: -278> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding auth protocol: cephx 2024-03-09T14:41:17.149 INFO:tasks.workunit.client.0.smithi088.stderr: -277> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: secure 2024-03-09T14:41:17.149 INFO:tasks.workunit.client.0.smithi088.stderr: -276> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: crc 2024-03-09T14:41:17.149 INFO:tasks.workunit.client.0.smithi088.stderr: -275> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: secure 2024-03-09T14:41:17.149 INFO:tasks.workunit.client.0.smithi088.stderr: -274> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: crc 2024-03-09T14:41:17.150 INFO:tasks.workunit.client.0.smithi088.stderr: -273> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: secure 2024-03-09T14:41:17.150 INFO:tasks.workunit.client.0.smithi088.stderr: -272> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: crc 2024-03-09T14:41:17.150 INFO:tasks.workunit.client.0.smithi088.stderr: -271> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: crc 2024-03-09T14:41:17.150 INFO:tasks.workunit.client.0.smithi088.stderr: -270> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: secure 2024-03-09T14:41:17.150 INFO:tasks.workunit.client.0.smithi088.stderr: -269> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: crc 2024-03-09T14:41:17.150 INFO:tasks.workunit.client.0.smithi088.stderr: -268> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: secure 2024-03-09T14:41:17.150 INFO:tasks.workunit.client.0.smithi088.stderr: -267> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: crc 2024-03-09T14:41:17.150 INFO:tasks.workunit.client.0.smithi088.stderr: -266> 2024-03-09T14:41:16.591+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aa20) adding con mode: secure 2024-03-09T14:41:17.150 INFO:tasks.workunit.client.0.smithi088.stderr: -265> 2024-03-09T14:41:16.591+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.150 INFO:tasks.workunit.client.0.smithi088.stderr: -264> 2024-03-09T14:41:16.592+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.150 INFO:tasks.workunit.client.0.smithi088.stderr: -263> 2024-03-09T14:41:16.592+0000 7feec400f800 5 asok(0x55da4b506780) register_command rotate-key cmddesc rotate-key hook 0x7ffe1557ab68 EEXIST 2024-03-09T14:41:17.150 INFO:tasks.workunit.client.0.smithi088.stderr: -262> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient: _reopen_session rank -1 2024-03-09T14:41:17.151 INFO:tasks.workunit.client.0.smithi088.stderr: -261> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:41:17.151 INFO:tasks.workunit.client.0.smithi088.stderr: -260> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): picked mon.noname-a con 0x55da4b7f9360 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:17.151 INFO:tasks.workunit.client.0.smithi088.stderr: -259> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): picked mon.noname-b con 0x55da4b7eb120 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:17.151 INFO:tasks.workunit.client.0.smithi088.stderr: -258> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): picked mon.noname-c con 0x55da4b7ebe30 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:17.151 INFO:tasks.workunit.client.0.smithi088.stderr: -257> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.151 INFO:tasks.workunit.client.0.smithi088.stderr: -256> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.151 INFO:tasks.workunit.client.0.smithi088.stderr: -255> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.151 INFO:tasks.workunit.client.0.smithi088.stderr: -254> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): _renew_subs 2024-03-09T14:41:17.151 INFO:tasks.workunit.client.0.smithi088.stderr: -253> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient(hunting): authenticate will time out at 1691.930425s 2024-03-09T14:41:17.151 INFO:tasks.workunit.client.0.smithi088.stderr: -252> 2024-03-09T14:41:16.592+0000 7feeb6e80640 10 monclient(hunting): get_auth_request con 0x55da4b7f9360 auth_method 0 2024-03-09T14:41:17.151 INFO:tasks.workunit.client.0.smithi088.stderr: -251> 2024-03-09T14:41:16.592+0000 7feeb6e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.151 INFO:tasks.workunit.client.0.smithi088.stderr: -250> 2024-03-09T14:41:16.592+0000 7feeb6e80640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.151 INFO:tasks.workunit.client.0.smithi088.stderr: -249> 2024-03-09T14:41:16.592+0000 7feeb6e80640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.151 INFO:tasks.workunit.client.0.smithi088.stderr: -248> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): get_auth_request con 0x55da4b7ebe30 auth_method 0 2024-03-09T14:41:17.152 INFO:tasks.workunit.client.0.smithi088.stderr: -247> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.152 INFO:tasks.workunit.client.0.smithi088.stderr: -246> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.152 INFO:tasks.workunit.client.0.smithi088.stderr: -245> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.152 INFO:tasks.workunit.client.0.smithi088.stderr: -244> 2024-03-09T14:41:16.592+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.152 INFO:tasks.workunit.client.0.smithi088.stderr: -243> 2024-03-09T14:41:16.592+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.152 INFO:tasks.workunit.client.0.smithi088.stderr: -242> 2024-03-09T14:41:16.592+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.152 INFO:tasks.workunit.client.0.smithi088.stderr: -241> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.152 INFO:tasks.workunit.client.0.smithi088.stderr: -240> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.152 INFO:tasks.workunit.client.0.smithi088.stderr: -239> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.152 INFO:tasks.workunit.client.0.smithi088.stderr: -238> 2024-03-09T14:41:16.592+0000 7feebfe82640 10 monclient(hunting): get_auth_request con 0x55da4b7eb120 auth_method 0 2024-03-09T14:41:17.152 INFO:tasks.workunit.client.0.smithi088.stderr: -237> 2024-03-09T14:41:16.592+0000 7feebfe82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.152 INFO:tasks.workunit.client.0.smithi088.stderr: -236> 2024-03-09T14:41:16.592+0000 7feebfe82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.152 INFO:tasks.workunit.client.0.smithi088.stderr: -235> 2024-03-09T14:41:16.592+0000 7feebfe82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.152 INFO:tasks.workunit.client.0.smithi088.stderr: -234> 2024-03-09T14:41:16.592+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.153 INFO:tasks.workunit.client.0.smithi088.stderr: -233> 2024-03-09T14:41:16.592+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.153 INFO:tasks.workunit.client.0.smithi088.stderr: -232> 2024-03-09T14:41:16.592+0000 7feebfe82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.153 INFO:tasks.workunit.client.0.smithi088.stderr: -231> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient(hunting): handle_auth_done global_id 6212 payload 274 2024-03-09T14:41:17.153 INFO:tasks.workunit.client.0.smithi088.stderr: -230> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient: _finish_hunting 0 2024-03-09T14:41:17.153 INFO:tasks.workunit.client.0.smithi088.stderr: -229> 2024-03-09T14:41:16.592+0000 7feebf681640 1 monclient: found mon.noname-c 2024-03-09T14:41:17.153 INFO:tasks.workunit.client.0.smithi088.stderr: -228> 2024-03-09T14:41:16.592+0000 7feebf681640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:41:17.153 INFO:tasks.workunit.client.0.smithi088.stderr: -227> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.153 INFO:tasks.workunit.client.0.smithi088.stderr: -226> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:41:17.153 INFO:tasks.workunit.client.0.smithi088.stderr: -225> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: dump: 2024-03-09T14:41:17.153 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.153 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.153 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.153 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.153 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.154 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.154 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.154 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.154 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.154 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.154 INFO:tasks.workunit.client.0.smithi088.stderr: -224> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: _finish_auth 0 2024-03-09T14:41:17.154 INFO:tasks.workunit.client.0.smithi088.stderr: -223> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: _check_auth_tickets 2024-03-09T14:41:17.154 INFO:tasks.workunit.client.0.smithi088.stderr: -222> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:17.154 INFO:tasks.workunit.client.0.smithi088.stderr: -221> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.154 INFO:tasks.workunit.client.0.smithi088.stderr: -220> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:41:17.154 INFO:tasks.workunit.client.0.smithi088.stderr: -219> 2024-03-09T14:41:16.592+0000 7feda2ffd640 10 monclient: dump: 2024-03-09T14:41:17.154 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.154 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.154 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.155 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.155 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.155 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.155 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.155 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.155 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.155 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.155 INFO:tasks.workunit.client.0.smithi088.stderr: -218> 2024-03-09T14:41:16.592+0000 7feec400f800 5 monclient: authenticate success, global_id 6212 2024-03-09T14:41:17.155 INFO:tasks.workunit.client.0.smithi088.stderr: -217> 2024-03-09T14:41:16.592+0000 7feec400f800 10 monclient: get_monmap_and_config success 2024-03-09T14:41:17.155 INFO:tasks.workunit.client.0.smithi088.stderr: -216> 2024-03-09T14:41:16.592+0000 7feec400f800 4 set_mon_vals no callback set 2024-03-09T14:41:17.155 INFO:tasks.workunit.client.0.smithi088.stderr: -215> 2024-03-09T14:41:16.593+0000 7feec400f800 10 monclient: shutdown 2024-03-09T14:41:17.155 INFO:tasks.workunit.client.0.smithi088.stderr: -214> 2024-03-09T14:41:16.593+0000 7feec400f800 10 monclient: build_initial_monmap 2024-03-09T14:41:17.155 INFO:tasks.workunit.client.0.smithi088.stderr: -213> 2024-03-09T14:41:16.593+0000 7feec400f800 1 build_initial for_mkfs: 0 2024-03-09T14:41:17.155 INFO:tasks.workunit.client.0.smithi088.stderr: -212> 2024-03-09T14:41:16.593+0000 7feec400f800 10 monclient: monmap: 2024-03-09T14:41:17.156 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:41:17.156 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:41:17.156 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:41:17.156 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:41:17.156 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:41:17.156 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.156 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:41:17.156 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:41:17.156 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:41:17.156 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.156 INFO:tasks.workunit.client.0.smithi088.stderr: -211> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding auth protocol: cephx 2024-03-09T14:41:17.156 INFO:tasks.workunit.client.0.smithi088.stderr: -210> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding auth protocol: cephx 2024-03-09T14:41:17.156 INFO:tasks.workunit.client.0.smithi088.stderr: -209> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding auth protocol: cephx 2024-03-09T14:41:17.156 INFO:tasks.workunit.client.0.smithi088.stderr: -208> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: secure 2024-03-09T14:41:17.156 INFO:tasks.workunit.client.0.smithi088.stderr: -207> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: crc 2024-03-09T14:41:17.157 INFO:tasks.workunit.client.0.smithi088.stderr: -206> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: secure 2024-03-09T14:41:17.157 INFO:tasks.workunit.client.0.smithi088.stderr: -205> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: crc 2024-03-09T14:41:17.157 INFO:tasks.workunit.client.0.smithi088.stderr: -204> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: secure 2024-03-09T14:41:17.157 INFO:tasks.workunit.client.0.smithi088.stderr: -203> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: crc 2024-03-09T14:41:17.157 INFO:tasks.workunit.client.0.smithi088.stderr: -202> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: crc 2024-03-09T14:41:17.157 INFO:tasks.workunit.client.0.smithi088.stderr: -201> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: secure 2024-03-09T14:41:17.157 INFO:tasks.workunit.client.0.smithi088.stderr: -200> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: crc 2024-03-09T14:41:17.157 INFO:tasks.workunit.client.0.smithi088.stderr: -199> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: secure 2024-03-09T14:41:17.157 INFO:tasks.workunit.client.0.smithi088.stderr: -198> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: crc 2024-03-09T14:41:17.157 INFO:tasks.workunit.client.0.smithi088.stderr: -197> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7c4800) adding con mode: secure 2024-03-09T14:41:17.157 INFO:tasks.workunit.client.0.smithi088.stderr: -196> 2024-03-09T14:41:16.593+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.158 INFO:tasks.workunit.client.0.smithi088.stderr: -195> 2024-03-09T14:41:16.593+0000 7feec400f800 1 librados: starting msgr at 2024-03-09T14:41:17.158 INFO:tasks.workunit.client.0.smithi088.stderr: -194> 2024-03-09T14:41:16.593+0000 7feec400f800 1 librados: starting objecter 2024-03-09T14:41:17.158 INFO:tasks.workunit.client.0.smithi088.stderr: -193> 2024-03-09T14:41:16.593+0000 7feec400f800 5 asok(0x55da4b506780) register_command objecter_requests cmddesc objecter_requests hook 0x55da4b7f4f60 EEXIST 2024-03-09T14:41:17.158 INFO:tasks.workunit.client.0.smithi088.stderr: -192> 2024-03-09T14:41:16.593+0000 7feec400f800 1 librados: setting wanted keys 2024-03-09T14:41:17.158 INFO:tasks.workunit.client.0.smithi088.stderr: -191> 2024-03-09T14:41:16.593+0000 7feec400f800 1 librados: calling monclient init 2024-03-09T14:41:17.158 INFO:tasks.workunit.client.0.smithi088.stderr: -190> 2024-03-09T14:41:16.593+0000 7feec400f800 10 monclient: init 2024-03-09T14:41:17.158 INFO:tasks.workunit.client.0.smithi088.stderr: -189> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding auth protocol: cephx 2024-03-09T14:41:17.158 INFO:tasks.workunit.client.0.smithi088.stderr: -188> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding auth protocol: cephx 2024-03-09T14:41:17.158 INFO:tasks.workunit.client.0.smithi088.stderr: -187> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding auth protocol: cephx 2024-03-09T14:41:17.158 INFO:tasks.workunit.client.0.smithi088.stderr: -186> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: secure 2024-03-09T14:41:17.158 INFO:tasks.workunit.client.0.smithi088.stderr: -185> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: crc 2024-03-09T14:41:17.158 INFO:tasks.workunit.client.0.smithi088.stderr: -184> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: secure 2024-03-09T14:41:17.158 INFO:tasks.workunit.client.0.smithi088.stderr: -183> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: crc 2024-03-09T14:41:17.158 INFO:tasks.workunit.client.0.smithi088.stderr: -182> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: secure 2024-03-09T14:41:17.159 INFO:tasks.workunit.client.0.smithi088.stderr: -181> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: crc 2024-03-09T14:41:17.159 INFO:tasks.workunit.client.0.smithi088.stderr: -180> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: crc 2024-03-09T14:41:17.159 INFO:tasks.workunit.client.0.smithi088.stderr: -179> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: secure 2024-03-09T14:41:17.159 INFO:tasks.workunit.client.0.smithi088.stderr: -178> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: crc 2024-03-09T14:41:17.159 INFO:tasks.workunit.client.0.smithi088.stderr: -177> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: secure 2024-03-09T14:41:17.159 INFO:tasks.workunit.client.0.smithi088.stderr: -176> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: crc 2024-03-09T14:41:17.159 INFO:tasks.workunit.client.0.smithi088.stderr: -175> 2024-03-09T14:41:16.593+0000 7feec400f800 5 AuthRegistry(0x55da4b7bc9f0) adding con mode: secure 2024-03-09T14:41:17.159 INFO:tasks.workunit.client.0.smithi088.stderr: -174> 2024-03-09T14:41:16.594+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.159 INFO:tasks.workunit.client.0.smithi088.stderr: -173> 2024-03-09T14:41:16.594+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.159 INFO:tasks.workunit.client.0.smithi088.stderr: -172> 2024-03-09T14:41:16.594+0000 7feec400f800 5 asok(0x55da4b506780) register_command rotate-key cmddesc rotate-key hook 0x55da4b7bcb38 EEXIST 2024-03-09T14:41:17.159 INFO:tasks.workunit.client.0.smithi088.stderr: -171> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient: _reopen_session rank -1 2024-03-09T14:41:17.159 INFO:tasks.workunit.client.0.smithi088.stderr: -170> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:41:17.159 INFO:tasks.workunit.client.0.smithi088.stderr: -169> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): picked mon.noname-c con 0x55da4b7eb120 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:17.159 INFO:tasks.workunit.client.0.smithi088.stderr: -168> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): picked mon.noname-b con 0x55da4b7ebe30 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:17.159 INFO:tasks.workunit.client.0.smithi088.stderr: -167> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): picked mon.noname-a con 0x55da4b7f9360 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:17.160 INFO:tasks.workunit.client.0.smithi088.stderr: -166> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.160 INFO:tasks.workunit.client.0.smithi088.stderr: -165> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.160 INFO:tasks.workunit.client.0.smithi088.stderr: -164> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:17.160 INFO:tasks.workunit.client.0.smithi088.stderr: -163> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): _renew_subs 2024-03-09T14:41:17.160 INFO:tasks.workunit.client.0.smithi088.stderr: -162> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient(hunting): authenticate will time out at 1691.932561s 2024-03-09T14:41:17.160 INFO:tasks.workunit.client.0.smithi088.stderr: -161> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): get_auth_request con 0x55da4b7eb120 auth_method 0 2024-03-09T14:41:17.160 INFO:tasks.workunit.client.0.smithi088.stderr: -160> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.160 INFO:tasks.workunit.client.0.smithi088.stderr: -159> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.160 INFO:tasks.workunit.client.0.smithi088.stderr: -158> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.160 INFO:tasks.workunit.client.0.smithi088.stderr: -157> 2024-03-09T14:41:16.594+0000 7feebf681640 10 monclient(hunting): get_auth_request con 0x55da4b7f9360 auth_method 0 2024-03-09T14:41:17.160 INFO:tasks.workunit.client.0.smithi088.stderr: -156> 2024-03-09T14:41:16.594+0000 7feebf681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.160 INFO:tasks.workunit.client.0.smithi088.stderr: -155> 2024-03-09T14:41:16.594+0000 7feebf681640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.160 INFO:tasks.workunit.client.0.smithi088.stderr: -154> 2024-03-09T14:41:16.594+0000 7feebf681640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.160 INFO:tasks.workunit.client.0.smithi088.stderr: -153> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.161 INFO:tasks.workunit.client.0.smithi088.stderr: -152> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.161 INFO:tasks.workunit.client.0.smithi088.stderr: -151> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.161 INFO:tasks.workunit.client.0.smithi088.stderr: -150> 2024-03-09T14:41:16.594+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:17.161 INFO:tasks.workunit.client.0.smithi088.stderr: -149> 2024-03-09T14:41:16.594+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:17.161 INFO:tasks.workunit.client.0.smithi088.stderr: -148> 2024-03-09T14:41:16.594+0000 7feebf681640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:17.161 INFO:tasks.workunit.client.0.smithi088.stderr: -147> 2024-03-09T14:41:16.594+0000 7feebfe82640 10 monclient(hunting): get_auth_request con 0x55da4b7ebe30 auth_method 0 2024-03-09T14:41:17.161 INFO:tasks.workunit.client.0.smithi088.stderr: -146> 2024-03-09T14:41:16.594+0000 7feebfe82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:17.161 INFO:tasks.workunit.client.0.smithi088.stderr: -145> 2024-03-09T14:41:16.594+0000 7feebfe82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:17.161 INFO:tasks.workunit.client.0.smithi088.stderr: -144> 2024-03-09T14:41:16.594+0000 7feebfe82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:17.161 INFO:tasks.workunit.client.0.smithi088.stderr: -143> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient(hunting): handle_auth_done global_id 6215 payload 824 2024-03-09T14:41:17.161 INFO:tasks.workunit.client.0.smithi088.stderr: -142> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient: _finish_hunting 0 2024-03-09T14:41:17.161 INFO:tasks.workunit.client.0.smithi088.stderr: -141> 2024-03-09T14:41:16.594+0000 7feeb6e80640 1 monclient: found mon.noname-c 2024-03-09T14:41:17.161 INFO:tasks.workunit.client.0.smithi088.stderr: -140> 2024-03-09T14:41:16.594+0000 7feeb6e80640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:41:17.161 INFO:tasks.workunit.client.0.smithi088.stderr: -139> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.162 INFO:tasks.workunit.client.0.smithi088.stderr: -138> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:41:17.162 INFO:tasks.workunit.client.0.smithi088.stderr: -137> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: dump: 2024-03-09T14:41:17.162 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.162 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.162 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.162 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.162 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.162 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.162 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.162 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.162 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.162 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.162 INFO:tasks.workunit.client.0.smithi088.stderr: -136> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: _finish_auth 0 2024-03-09T14:41:17.162 INFO:tasks.workunit.client.0.smithi088.stderr: -135> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: _check_auth_tickets 2024-03-09T14:41:17.163 INFO:tasks.workunit.client.0.smithi088.stderr: -134> 2024-03-09T14:41:16.594+0000 7feec400f800 5 monclient: authenticate success, global_id 6215 2024-03-09T14:41:17.163 INFO:tasks.workunit.client.0.smithi088.stderr: -133> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient: _renew_subs 2024-03-09T14:41:17.163 INFO:tasks.workunit.client.0.smithi088.stderr: -132> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:41:17.163 INFO:tasks.workunit.client.0.smithi088.stderr: -131> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:17.163 INFO:tasks.workunit.client.0.smithi088.stderr: -130> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:17.163 INFO:tasks.workunit.client.0.smithi088.stderr: -129> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:41:17.163 INFO:tasks.workunit.client.0.smithi088.stderr: -128> 2024-03-09T14:41:16.594+0000 7feda17fa640 10 monclient: dump: 2024-03-09T14:41:17.163 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:17.163 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:17.163 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.163 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:17.163 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:17.163 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:17.163 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:17.164 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:17.164 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:17.164 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.164 INFO:tasks.workunit.client.0.smithi088.stderr: -127> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient: _renew_subs 2024-03-09T14:41:17.164 INFO:tasks.workunit.client.0.smithi088.stderr: -126> 2024-03-09T14:41:16.594+0000 7feec400f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:41:17.164 INFO:tasks.workunit.client.0.smithi088.stderr: -125> 2024-03-09T14:41:16.594+0000 7feda2ffd640 4 set_mon_vals no callback set 2024-03-09T14:41:17.164 INFO:tasks.workunit.client.0.smithi088.stderr: -124> 2024-03-09T14:41:16.594+0000 7feec400f800 1 librados: init done 2024-03-09T14:41:17.164 INFO:tasks.workunit.client.0.smithi088.stderr: -123> 2024-03-09T14:41:16.595+0000 7feec400f800 5 asok(0x55da4b506780) register_command cr dump hook 0x55da4b806bf8 2024-03-09T14:41:17.164 INFO:tasks.workunit.client.0.smithi088.stderr: -122> 2024-03-09T14:41:16.596+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.164 INFO:tasks.workunit.client.0.smithi088.stderr: -121> 2024-03-09T14:41:16.596+0000 7feda17fa640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:41:17.164 INFO:tasks.workunit.client.0.smithi088.stderr: -120> 2024-03-09T14:41:16.596+0000 7feda17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:17.164 INFO:tasks.workunit.client.0.smithi088.stderr: -119> 2024-03-09T14:41:16.596+0000 7feda17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:17.164 INFO:tasks.workunit.client.0.smithi088.stderr: -118> 2024-03-09T14:41:16.597+0000 7feebf681640 10 monclient: get_auth_request con 0x55da4b813ee0 auth_method 0 2024-03-09T14:41:17.164 INFO:tasks.workunit.client.0.smithi088.stderr: -117> 2024-03-09T14:41:16.597+0000 7feebfe82640 10 monclient: get_auth_request con 0x7fed8806a5b0 auth_method 0 2024-03-09T14:41:17.165 INFO:tasks.workunit.client.0.smithi088.stderr: -116> 2024-03-09T14:41:16.597+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.165 INFO:tasks.workunit.client.0.smithi088.stderr: -115> 2024-03-09T14:41:16.597+0000 7feec400f800 20 realm 2024-03-09T14:41:17.165 INFO:tasks.workunit.client.0.smithi088.stderr: -114> 2024-03-09T14:41:16.597+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.165 INFO:tasks.workunit.client.0.smithi088.stderr: -113> 2024-03-09T14:41:16.597+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.165 INFO:tasks.workunit.client.0.smithi088.stderr: -112> 2024-03-09T14:41:16.597+0000 7feec400f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:17.165 INFO:tasks.workunit.client.0.smithi088.stderr: -111> 2024-03-09T14:41:16.597+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.165 INFO:tasks.workunit.client.0.smithi088.stderr: -110> 2024-03-09T14:41:16.597+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.165 INFO:tasks.workunit.client.0.smithi088.stderr: -109> 2024-03-09T14:41:16.597+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.165 INFO:tasks.workunit.client.0.smithi088.stderr: -108> 2024-03-09T14:41:16.598+0000 7feeb6e80640 10 monclient: get_auth_request con 0x55da4b818120 auth_method 0 2024-03-09T14:41:17.165 INFO:tasks.workunit.client.0.smithi088.stderr: -107> 2024-03-09T14:41:16.598+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.165 INFO:tasks.workunit.client.0.smithi088.stderr: -106> 2024-03-09T14:41:16.598+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.165 INFO:tasks.workunit.client.0.smithi088.stderr: -105> 2024-03-09T14:41:16.598+0000 7feebfe82640 10 monclient: get_auth_request con 0x55da4b81b960 auth_method 0 2024-03-09T14:41:17.165 INFO:tasks.workunit.client.0.smithi088.stderr: -104> 2024-03-09T14:41:16.599+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:17.165 INFO:tasks.workunit.client.0.smithi088.stderr: -103> 2024-03-09T14:41:16.599+0000 7feec400f800 20 searching for the correct realm 2024-03-09T14:41:17.165 INFO:tasks.workunit.client.0.smithi088.stderr: -102> 2024-03-09T14:41:16.599+0000 7feebf681640 10 monclient: get_auth_request con 0x55da4b8206f0 auth_method 0 2024-03-09T14:41:17.166 INFO:tasks.workunit.client.0.smithi088.stderr: -101> 2024-03-09T14:41:16.600+0000 7feeb6e80640 10 monclient: get_auth_request con 0x7feeb0041060 auth_method 0 2024-03-09T14:41:17.166 INFO:tasks.workunit.client.0.smithi088.stderr: -100> 2024-03-09T14:41:16.601+0000 7feebfe82640 10 monclient: get_auth_request con 0x7feeb805e050 auth_method 0 2024-03-09T14:41:17.166 INFO:tasks.workunit.client.0.smithi088.stderr: -99> 2024-03-09T14:41:16.601+0000 7feebfe82640 0 -- 172.21.15.88:0/3560501939 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7feeb805e050 msgr2=0x7feeb8099580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:17.166 INFO:tasks.workunit.client.0.smithi088.stderr: -98> 2024-03-09T14:41:16.802+0000 7feebfe82640 10 monclient: get_auth_request con 0x7feeb805e050 auth_method 0 2024-03-09T14:41:17.166 INFO:tasks.workunit.client.0.smithi088.stderr: -97> 2024-03-09T14:41:16.804+0000 7feebf681640 10 monclient: get_auth_request con 0x7feeb80c2040 auth_method 0 2024-03-09T14:41:17.166 INFO:tasks.workunit.client.0.smithi088.stderr: -96> 2024-03-09T14:41:16.807+0000 7feeb6e80640 10 monclient: get_auth_request con 0x7feeb80a2940 auth_method 0 2024-03-09T14:41:17.166 INFO:tasks.workunit.client.0.smithi088.stderr: -95> 2024-03-09T14:41:16.807+0000 7feeb6e80640 0 -- 172.21.15.88:0/3560501939 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7feeb80a2940 msgr2=0x7feeb80b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:17.166 INFO:tasks.workunit.client.0.smithi088.stderr: -94> 2024-03-09T14:41:17.008+0000 7feeb6e80640 10 monclient: get_auth_request con 0x7feeb80a2940 auth_method 0 2024-03-09T14:41:17.166 INFO:tasks.workunit.client.0.smithi088.stderr: -93> 2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:17.166 INFO:tasks.workunit.client.0.smithi088.stderr: -92> 2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:17.166 INFO:tasks.workunit.client.0.smithi088.stderr: -91> 2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:17.166 INFO:tasks.workunit.client.0.smithi088.stderr: -90> 2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:17.166 INFO:tasks.workunit.client.0.smithi088.stderr: -89> 2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:17.167 INFO:tasks.workunit.client.0.smithi088.stderr: -88> 2024-03-09T14:41:17.013+0000 7feec400f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:17.167 INFO:tasks.workunit.client.0.smithi088.stderr: -87> 2024-03-09T14:41:17.013+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.167 INFO:tasks.workunit.client.0.smithi088.stderr: -86> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.167 INFO:tasks.workunit.client.0.smithi088.stderr: -85> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.167 INFO:tasks.workunit.client.0.smithi088.stderr: -84> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.167 INFO:tasks.workunit.client.0.smithi088.stderr: -83> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.167 INFO:tasks.workunit.client.0.smithi088.stderr: -82> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:17.167 INFO:tasks.workunit.client.0.smithi088.stderr: -81> 2024-03-09T14:41:17.014+0000 7feec400f800 20 zone default found 2024-03-09T14:41:17.167 INFO:tasks.workunit.client.0.smithi088.stderr: -80> 2024-03-09T14:41:17.014+0000 7feec400f800 4 Realm: () 2024-03-09T14:41:17.167 INFO:tasks.workunit.client.0.smithi088.stderr: -79> 2024-03-09T14:41:17.014+0000 7feec400f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:17.167 INFO:tasks.workunit.client.0.smithi088.stderr: -78> 2024-03-09T14:41:17.014+0000 7feec400f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:17.167 INFO:tasks.workunit.client.0.smithi088.stderr: -77> 2024-03-09T14:41:17.014+0000 7feec400f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:17.167 INFO:tasks.workunit.client.0.smithi088.stderr: -76> 2024-03-09T14:41:17.014+0000 7feec400f800 20 zonegroup default 2024-03-09T14:41:17.167 INFO:tasks.workunit.client.0.smithi088.stderr: -75> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.167 INFO:tasks.workunit.client.0.smithi088.stderr: -74> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.168 INFO:tasks.workunit.client.0.smithi088.stderr: -73> 2024-03-09T14:41:17.014+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.168 INFO:tasks.workunit.client.0.smithi088.stderr: -72> 2024-03-09T14:41:17.015+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.168 INFO:tasks.workunit.client.0.smithi088.stderr: -71> 2024-03-09T14:41:17.015+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.168 INFO:tasks.workunit.client.0.smithi088.stderr: -70> 2024-03-09T14:41:17.015+0000 7feec400f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.168 INFO:tasks.workunit.client.0.smithi088.stderr: -69> 2024-03-09T14:41:17.015+0000 7feec400f800 20 started sync module instance, tier type = 2024-03-09T14:41:17.168 INFO:tasks.workunit.client.0.smithi088.stderr: -68> 2024-03-09T14:41:17.015+0000 7feec400f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:17.168 INFO:tasks.workunit.client.0.smithi088.stderr: -67> 2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=0 2024-03-09T14:41:17.168 INFO:tasks.workunit.client.0.smithi088.stderr: -66> 2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=1 2024-03-09T14:41:17.168 INFO:tasks.workunit.client.0.smithi088.stderr: -65> 2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=2 2024-03-09T14:41:17.168 INFO:tasks.workunit.client.0.smithi088.stderr: -64> 2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=3 2024-03-09T14:41:17.168 INFO:tasks.workunit.client.0.smithi088.stderr: -63> 2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=4 2024-03-09T14:41:17.168 INFO:tasks.workunit.client.0.smithi088.stderr: -62> 2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=5 2024-03-09T14:41:17.168 INFO:tasks.workunit.client.0.smithi088.stderr: -61> 2024-03-09T14:41:17.024+0000 7feec400f800 20 add_watcher() i=6 2024-03-09T14:41:17.168 INFO:tasks.workunit.client.0.smithi088.stderr: -60> 2024-03-09T14:41:17.025+0000 7feec400f800 20 add_watcher() i=7 2024-03-09T14:41:17.168 INFO:tasks.workunit.client.0.smithi088.stderr: -59> 2024-03-09T14:41:17.025+0000 7feec400f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:17.169 INFO:tasks.workunit.client.0.smithi088.stderr: -58> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding auth protocol: cephx 2024-03-09T14:41:17.169 INFO:tasks.workunit.client.0.smithi088.stderr: -57> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding auth protocol: cephx 2024-03-09T14:41:17.169 INFO:tasks.workunit.client.0.smithi088.stderr: -56> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding auth protocol: cephx 2024-03-09T14:41:17.169 INFO:tasks.workunit.client.0.smithi088.stderr: -55> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: secure 2024-03-09T14:41:17.169 INFO:tasks.workunit.client.0.smithi088.stderr: -54> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: crc 2024-03-09T14:41:17.169 INFO:tasks.workunit.client.0.smithi088.stderr: -53> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: secure 2024-03-09T14:41:17.169 INFO:tasks.workunit.client.0.smithi088.stderr: -52> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: crc 2024-03-09T14:41:17.169 INFO:tasks.workunit.client.0.smithi088.stderr: -51> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: secure 2024-03-09T14:41:17.169 INFO:tasks.workunit.client.0.smithi088.stderr: -50> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: crc 2024-03-09T14:41:17.169 INFO:tasks.workunit.client.0.smithi088.stderr: -49> 2024-03-09T14:41:17.027+0000 7fed75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:17.169 INFO:tasks.workunit.client.0.smithi088.stderr: -48> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: crc 2024-03-09T14:41:17.169 INFO:tasks.workunit.client.0.smithi088.stderr: -47> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: secure 2024-03-09T14:41:17.169 INFO:tasks.workunit.client.0.smithi088.stderr: -46> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: crc 2024-03-09T14:41:17.169 INFO:tasks.workunit.client.0.smithi088.stderr: -45> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: secure 2024-03-09T14:41:17.170 INFO:tasks.workunit.client.0.smithi088.stderr: -44> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: crc 2024-03-09T14:41:17.170 INFO:tasks.workunit.client.0.smithi088.stderr: -43> 2024-03-09T14:41:17.027+0000 7feec400f800 5 AuthRegistry(0x7ffe1557aeb0) adding con mode: secure 2024-03-09T14:41:17.170 INFO:tasks.workunit.client.0.smithi088.stderr: -42> 2024-03-09T14:41:17.027+0000 7feec400f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:17.170 INFO:tasks.workunit.client.0.smithi088.stderr: -41> 2024-03-09T14:41:17.027+0000 7feec400f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:17.170 INFO:tasks.workunit.client.0.smithi088.stderr: -40> 2024-03-09T14:41:17.027+0000 7feec400f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:17.170 INFO:tasks.workunit.client.0.smithi088.stderr: -39> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command cache list hook 0x55da4b7ef030 2024-03-09T14:41:17.170 INFO:tasks.workunit.client.0.smithi088.stderr: -38> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command cache inspect hook 0x55da4b7ef030 2024-03-09T14:41:17.170 INFO:tasks.workunit.client.0.smithi088.stderr: -37> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command cache erase hook 0x55da4b7ef030 2024-03-09T14:41:17.170 INFO:tasks.workunit.client.0.smithi088.stderr: -36> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command cache zap hook 0x55da4b7ef030 2024-03-09T14:41:17.170 INFO:tasks.workunit.client.0.smithi088.stderr: -35> 2024-03-09T14:41:17.027+0000 7feec400f800 5 note: GC not initialized 2024-03-09T14:41:17.170 INFO:tasks.workunit.client.0.smithi088.stderr: -34> 2024-03-09T14:41:17.027+0000 7fed74fe1640 20 reqs_thread_entry: start 2024-03-09T14:41:17.170 INFO:tasks.workunit.client.0.smithi088.stderr: -33> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command sync trace show hook 0x7feea8002dc0 2024-03-09T14:41:17.170 INFO:tasks.workunit.client.0.smithi088.stderr: -32> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command sync trace history hook 0x7feea8002dc0 2024-03-09T14:41:17.170 INFO:tasks.workunit.client.0.smithi088.stderr: -31> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command sync trace active hook 0x7feea8002dc0 2024-03-09T14:41:17.170 INFO:tasks.workunit.client.0.smithi088.stderr: -30> 2024-03-09T14:41:17.027+0000 7feec400f800 5 asok(0x55da4b506780) register_command sync trace active_short hook 0x7feea8002dc0 2024-03-09T14:41:17.171 INFO:tasks.workunit.client.0.smithi088.stderr: -29> 2024-03-09T14:41:17.027+0000 7feec400f800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:17.171 INFO:tasks.workunit.client.0.smithi088.stderr: -28> 2024-03-09T14:41:17.027+0000 7feec400f800 20 Filter name: none 2024-03-09T14:41:17.171 INFO:tasks.workunit.client.0.smithi088.stderr: -27> 2024-03-09T14:41:17.027+0000 7fecee7fc640 20 reqs_thread_entry: start 2024-03-09T14:41:17.171 INFO:tasks.workunit.client.0.smithi088.stderr: -26> 2024-03-09T14:41:17.028+0000 7feec400f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-09T14:41:17.171 INFO:tasks.workunit.client.0.smithi088.stderr: -25> 2024-03-09T14:41:17.028+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.171 INFO:tasks.workunit.client.0.smithi088.stderr: -24> 2024-03-09T14:41:17.028+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:17.171 INFO:tasks.workunit.client.0.smithi088.stderr: -23> 2024-03-09T14:41:17.028+0000 7feec400f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-09T14:41:17.171 INFO:tasks.workunit.client.0.smithi088.stderr: -22> 2024-03-09T14:41:17.028+0000 7feec400f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-09T14:41:17.171 INFO:tasks.workunit.client.0.smithi088.stderr: -21> 2024-03-09T14:41:17.028+0000 7feec400f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 : miss 2024-03-09T14:41:17.171 INFO:tasks.workunit.client.0.smithi088.stderr: -20> 2024-03-09T14:41:17.028+0000 7feec400f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.171 INFO:tasks.workunit.client.0.smithi088.stderr: -19> 2024-03-09T14:41:17.028+0000 7feec400f800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:41:17.171 INFO:tasks.workunit.client.0.smithi088.stderr: -18> 2024-03-09T14:41:17.028+0000 7feec400f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 info.flags=0x17 2024-03-09T14:41:17.171 INFO:tasks.workunit.client.0.smithi088.stderr: -17> 2024-03-09T14:41:17.028+0000 7feec400f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to cache LRU end 2024-03-09T14:41:17.171 INFO:tasks.workunit.client.0.smithi088.stderr: -16> 2024-03-09T14:41:17.028+0000 7feec400f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:17.172 INFO:tasks.workunit.client.0.smithi088.stderr: -15> 2024-03-09T14:41:17.028+0000 7feec400f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:17.172 INFO:tasks.workunit.client.0.smithi088.stderr: -14> 2024-03-09T14:41:17.028+0000 7feec400f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 2024-03-09T14:41:17.172 INFO:tasks.workunit.client.0.smithi088.stderr: -13> 2024-03-09T14:41:17.034+0000 7feec400f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 info.flags=0x17 2024-03-09T14:41:17.172 INFO:tasks.workunit.client.0.smithi088.stderr: -12> 2024-03-09T14:41:17.034+0000 7feec400f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to cache LRU end 2024-03-09T14:41:17.172 INFO:tasks.workunit.client.0.smithi088.stderr: -11> 2024-03-09T14:41:17.034+0000 7feec400f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:17.172 INFO:tasks.workunit.client.0.smithi088.stderr: -10> 2024-03-09T14:41:17.034+0000 7feec400f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23, ofs0, ns] 2024-03-09T14:41:17.172 INFO:tasks.workunit.client.0.smithi088.stderr: -9> 2024-03-09T14:41:17.034+0000 7feda2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464344 cookie 94396058061952 notifier 6215 bl.length()=907 2024-03-09T14:41:17.172 INFO:tasks.workunit.client.0.smithi088.stderr: -8> 2024-03-09T14:41:17.034+0000 7feda2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 info.flags=0x17 2024-03-09T14:41:17.172 INFO:tasks.workunit.client.0.smithi088.stderr: -7> 2024-03-09T14:41:17.034+0000 7feda2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to cache LRU end 2024-03-09T14:41:17.172 INFO:tasks.workunit.client.0.smithi088.stderr: -6> 2024-03-09T14:41:17.034+0000 7feda2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:17.172 INFO:tasks.workunit.client.0.smithi088.stderr: -5> 2024-03-09T14:41:17.036+0000 7feec400f800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): orig_sources= new_sources= 2024-03-09T14:41:17.172 INFO:tasks.workunit.client.0.smithi088.stderr: -4> 2024-03-09T14:41:17.036+0000 7feec400f800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): potential sources added=[] removed=[] 2024-03-09T14:41:17.172 INFO:tasks.workunit.client.0.smithi088.stderr: -3> 2024-03-09T14:41:17.036+0000 7feec400f800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): orig_dests= new_dests= 2024-03-09T14:41:17.172 INFO:tasks.workunit.client.0.smithi088.stderr: -2> 2024-03-09T14:41:17.036+0000 7feec400f800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): potential dests added=[] removed=[] 2024-03-09T14:41:17.173 INFO:tasks.workunit.client.0.smithi088.stderr: -1> 2024-03-09T14:41:17.037+0000 7feec400f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feec400f800 time 2024-03-09T14:41:17.037901+0000 2024-03-09T14:41:17.173 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:41:17.173 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.173 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:17.173 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feec4f80e86] 2024-03-09T14:41:17.173 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7feec4f81044] 2024-03-09T14:41:17.173 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da4a95af91] 2024-03-09T14:41:17.173 INFO:tasks.workunit.client.0.smithi088.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55da4a975e64] 2024-03-09T14:41:17.173 INFO:tasks.workunit.client.0.smithi088.stderr: 5: main() 2024-03-09T14:41:17.173 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7feec3e3feb0] 2024-03-09T14:41:17.173 INFO:tasks.workunit.client.0.smithi088.stderr: 7: __libc_start_main() 2024-03-09T14:41:17.173 INFO:tasks.workunit.client.0.smithi088.stderr: 8: _start() 2024-03-09T14:41:17.174 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.174 INFO:tasks.workunit.client.0.smithi088.stderr: 0> 2024-03-09T14:41:17.038+0000 7feec400f800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:41:17.174 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7feec400f800 thread_name:radosgw-admin 2024-03-09T14:41:17.174 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.174 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:17.174 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7feec3e54db0] 2024-03-09T14:41:17.174 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7feec3ea154c] 2024-03-09T14:41:17.174 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:41:17.174 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:41:17.174 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feec4f80ee0] 2024-03-09T14:41:17.174 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7feec4f81044] 2024-03-09T14:41:17.174 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da4a95af91] 2024-03-09T14:41:17.174 INFO:tasks.workunit.client.0.smithi088.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55da4a975e64] 2024-03-09T14:41:17.174 INFO:tasks.workunit.client.0.smithi088.stderr: 9: main() 2024-03-09T14:41:17.174 INFO:tasks.workunit.client.0.smithi088.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7feec3e3feb0] 2024-03-09T14:41:17.175 INFO:tasks.workunit.client.0.smithi088.stderr: 11: __libc_start_main() 2024-03-09T14:41:17.175 INFO:tasks.workunit.client.0.smithi088.stderr: 12: _start() 2024-03-09T14:41:17.175 INFO:tasks.workunit.client.0.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:41:17.175 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.175 INFO:tasks.workunit.client.0.smithi088.stderr:--- logging levels --- 2024-03-09T14:41:17.175 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 none 2024-03-09T14:41:17.175 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 lockdep 2024-03-09T14:41:17.175 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 context 2024-03-09T14:41:17.175 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 crush 2024-03-09T14:41:17.175 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds 2024-03-09T14:41:17.175 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_balancer 2024-03-09T14:41:17.175 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_locker 2024-03-09T14:41:17.176 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log 2024-03-09T14:41:17.176 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log_expire 2024-03-09T14:41:17.176 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_migrator 2024-03-09T14:41:17.176 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 buffer 2024-03-09T14:41:17.176 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 timer 2024-03-09T14:41:17.176 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 filer 2024-03-09T14:41:17.176 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 striper 2024-03-09T14:41:17.176 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 objecter 2024-03-09T14:41:17.176 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rados 2024-03-09T14:41:17.176 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd 2024-03-09T14:41:17.176 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_mirror 2024-03-09T14:41:17.176 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_replay 2024-03-09T14:41:17.176 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_pwl 2024-03-09T14:41:17.176 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 journaler 2024-03-09T14:41:17.176 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objectcacher 2024-03-09T14:41:17.177 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:41:17.177 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 client 2024-03-09T14:41:17.177 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 osd 2024-03-09T14:41:17.177 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 optracker 2024-03-09T14:41:17.177 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objclass 2024-03-09T14:41:17.177 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 filestore 2024-03-09T14:41:17.177 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 journal 2024-03-09T14:41:17.177 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 ms 2024-03-09T14:41:17.177 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mon 2024-03-09T14:41:17.177 INFO:tasks.workunit.client.0.smithi088.stderr: 0/10 monc 2024-03-09T14:41:17.177 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 paxos 2024-03-09T14:41:17.177 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 tp 2024-03-09T14:41:17.177 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 auth 2024-03-09T14:41:17.177 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 crypto 2024-03-09T14:41:17.177 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 finisher 2024-03-09T14:41:17.178 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 reserver 2024-03-09T14:41:17.178 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 heartbeatmap 2024-03-09T14:41:17.178 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 perfcounter 2024-03-09T14:41:17.178 INFO:tasks.workunit.client.0.smithi088.stderr: 20/20 rgw 2024-03-09T14:41:17.178 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_sync 2024-03-09T14:41:17.178 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_datacache 2024-03-09T14:41:17.178 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_access 2024-03-09T14:41:17.178 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:41:17.178 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_flight 2024-03-09T14:41:17.178 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:41:17.178 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 javaclient 2024-03-09T14:41:17.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 asok 2024-03-09T14:41:17.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 throttle 2024-03-09T14:41:17.179 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 refs 2024-03-09T14:41:17.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 compressor 2024-03-09T14:41:17.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluestore 2024-03-09T14:41:17.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluefs 2024-03-09T14:41:17.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 bdev 2024-03-09T14:41:17.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 kstore 2024-03-09T14:41:17.179 INFO:tasks.workunit.client.0.smithi088.stderr: 4/ 5 rocksdb 2024-03-09T14:41:17.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 fuse 2024-03-09T14:41:17.179 INFO:tasks.workunit.client.0.smithi088.stderr: 2/ 5 mgr 2024-03-09T14:41:17.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mgrc 2024-03-09T14:41:17.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 dpdk 2024-03-09T14:41:17.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 eventtrace 2024-03-09T14:41:17.180 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 prioritycache 2024-03-09T14:41:17.180 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 test 2024-03-09T14:41:17.180 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:41:17.180 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephsqlite 2024-03-09T14:41:17.180 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:41:17.180 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore 2024-03-09T14:41:17.180 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_onode 2024-03-09T14:41:17.180 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_odata 2024-03-09T14:41:17.180 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_omap 2024-03-09T14:41:17.180 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_tm 2024-03-09T14:41:17.180 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_t 2024-03-09T14:41:17.180 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:41:17.180 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_epm 2024-03-09T14:41:17.180 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_lba 2024-03-09T14:41:17.180 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:41:17.181 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cache 2024-03-09T14:41:17.181 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_journal 2024-03-09T14:41:17.181 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_device 2024-03-09T14:41:17.181 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_backref 2024-03-09T14:41:17.181 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 alienstore 2024-03-09T14:41:17.181 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mclock 2024-03-09T14:41:17.181 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cyanstore 2024-03-09T14:41:17.181 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 ceph_exporter 2024-03-09T14:41:17.181 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 memstore 2024-03-09T14:41:17.181 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 trace 2024-03-09T14:41:17.181 INFO:tasks.workunit.client.0.smithi088.stderr: -2/-2 (syslog threshold) 2024-03-09T14:41:17.181 INFO:tasks.workunit.client.0.smithi088.stderr: 99/99 (stderr threshold) 2024-03-09T14:41:17.181 INFO:tasks.workunit.client.0.smithi088.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:41:17.182 INFO:tasks.workunit.client.0.smithi088.stderr: 7fecee7fc640 / http_manager 2024-03-09T14:41:17.182 INFO:tasks.workunit.client.0.smithi088.stderr: 7fed74fe1640 / http_manager 2024-03-09T14:41:17.182 INFO:tasks.workunit.client.0.smithi088.stderr: 7fed75fe3640 / rgw_dt_lg_renew 2024-03-09T14:41:17.182 INFO:tasks.workunit.client.0.smithi088.stderr: 7feda17fa640 / ms_dispatch 2024-03-09T14:41:17.182 INFO:tasks.workunit.client.0.smithi088.stderr: 7feda2ffd640 / io_context_pool 2024-03-09T14:41:17.182 INFO:tasks.workunit.client.0.smithi088.stderr: 7feda9602640 / ms_dispatch 2024-03-09T14:41:17.182 INFO:tasks.workunit.client.0.smithi088.stderr: 7fedabe07640 / ms_dispatch 2024-03-09T14:41:17.182 INFO:tasks.workunit.client.0.smithi088.stderr: 7fedad60a640 / io_context_pool 2024-03-09T14:41:17.182 INFO:tasks.workunit.client.0.smithi088.stderr: 7feeb6e80640 / msgr-worker-2 2024-03-09T14:41:17.182 INFO:tasks.workunit.client.0.smithi088.stderr: 7feebf681640 / msgr-worker-1 2024-03-09T14:41:17.182 INFO:tasks.workunit.client.0.smithi088.stderr: 7feebfe82640 / msgr-worker-0 2024-03-09T14:41:17.182 INFO:tasks.workunit.client.0.smithi088.stderr: 7feec0683640 / io_context_pool 2024-03-09T14:41:17.182 INFO:tasks.workunit.client.0.smithi088.stderr: 7feec400f800 / radosgw-admin 2024-03-09T14:41:17.182 INFO:tasks.workunit.client.0.smithi088.stderr: max_recent 500 2024-03-09T14:41:17.182 INFO:tasks.workunit.client.0.smithi088.stderr: max_new 1000 2024-03-09T14:41:17.183 INFO:tasks.workunit.client.0.smithi088.stderr: log_file /var/lib/ceph/crash/2024-03-09T14:41:17.039563Z_9d6187f7-4533-410c-b2ed-39a5ec84bd14/log 2024-03-09T14:41:17.183 INFO:tasks.workunit.client.0.smithi088.stderr:--- end dump of recent events --- 2024-03-09T14:41:17.183 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-03-09T14:41:17.184 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:17.184 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:17.184 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.108+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.109+0000 7f5e5f00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.109+0000 7f5e5f00f800 20 realm 2024-03-09T14:41:17.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.109+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.109+0000 7f5e5f00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.109+0000 7f5e5f00f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:17.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.109+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.109+0000 7f5e5f00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.109+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.110+0000 7f5e5f00f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.110+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.111+0000 7f5e5f00f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:17.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.111+0000 7f5e5f00f800 20 searching for the correct realm 2024-03-09T14:41:17.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.113+0000 7f5e5ae82640 0 -- 172.21.15.88:0/3301171418 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f5e54020070 msgr2=0x7f5e5405e640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:17.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.319+0000 7f5e51e80640 0 -- 172.21.15.88:0/3301171418 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f5e5407e930 msgr2=0x7f5e5407e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:17.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.526+0000 7f5e5f00f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:17.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.526+0000 7f5e5f00f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:17.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.526+0000 7f5e5f00f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:17.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.526+0000 7f5e5f00f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:17.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.526+0000 7f5e5f00f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:17.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.526+0000 7f5e5f00f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:17.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.526+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.526+0000 7f5e5f00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.526+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.526+0000 7f5e5f00f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.526+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.527+0000 7f5e5f00f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:17.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.527+0000 7f5e5f00f800 20 zone default found 2024-03-09T14:41:17.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.527+0000 7f5e5f00f800 4 Realm: () 2024-03-09T14:41:17.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.527+0000 7f5e5f00f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:17.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.527+0000 7f5e5f00f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:17.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.527+0000 7f5e5f00f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:17.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.527+0000 7f5e5f00f800 20 zonegroup default 2024-03-09T14:41:17.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.527+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.527+0000 7f5e5f00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.527+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.527+0000 7f5e5f00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.527+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.527+0000 7f5e5f00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.528+0000 7f5e5f00f800 20 started sync module instance, tier type = 2024-03-09T14:41:17.529 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.528+0000 7f5e5f00f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:17.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.537+0000 7f5e5f00f800 20 add_watcher() i=0 2024-03-09T14:41:17.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.538+0000 7f5e5f00f800 20 add_watcher() i=1 2024-03-09T14:41:17.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.538+0000 7f5e5f00f800 20 add_watcher() i=2 2024-03-09T14:41:17.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.538+0000 7f5e5f00f800 20 add_watcher() i=3 2024-03-09T14:41:17.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.538+0000 7f5e5f00f800 20 add_watcher() i=4 2024-03-09T14:41:17.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.538+0000 7f5e5f00f800 20 add_watcher() i=5 2024-03-09T14:41:17.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.538+0000 7f5e5f00f800 20 add_watcher() i=6 2024-03-09T14:41:17.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.538+0000 7f5e5f00f800 20 add_watcher() i=7 2024-03-09T14:41:17.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.538+0000 7f5e5f00f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:17.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.540+0000 7f5d10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:17.541 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.540+0000 7f5e5f00f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:17.541 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.540+0000 7f5e5f00f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:17.541 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.540+0000 7f5e5f00f800 5 note: GC not initialized 2024-03-09T14:41:17.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.540+0000 7f5c8b7fe640 20 reqs_thread_entry: start 2024-03-09T14:41:17.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.541+0000 7f5e5f00f800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:17.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.541+0000 7f5e5f00f800 20 Filter name: none 2024-03-09T14:41:17.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.541+0000 7f5c897fa640 20 reqs_thread_entry: start 2024-03-09T14:41:17.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.541+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.541+0000 7f5e5f00f800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:17.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.541+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.542+0000 7f5e5f00f800 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:41:17.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.542+0000 7f5e5f00f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:17.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.542+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.542+0000 7f5e5f00f800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:17.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.542+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.542+0000 7f5e5f00f800 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:41:17.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.542+0000 7f5e5f00f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:17.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.543+0000 7f5e5f00f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.544+0000 7f5e5f00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.544+0000 7f5d10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:17.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.547+0000 7f5e5f00f800 20 remove_watcher() i=0 2024-03-09T14:41:17.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.547+0000 7f5e5f00f800 2 removed watcher, disabling cache 2024-03-09T14:41:17.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.548+0000 7f5e5f00f800 20 remove_watcher() i=1 2024-03-09T14:41:17.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.549+0000 7f5e5f00f800 20 remove_watcher() i=2 2024-03-09T14:41:17.550 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.550+0000 7f5e5f00f800 20 remove_watcher() i=3 2024-03-09T14:41:17.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.551+0000 7f5e5f00f800 20 remove_watcher() i=4 2024-03-09T14:41:17.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.552+0000 7f5e5f00f800 20 remove_watcher() i=5 2024-03-09T14:41:17.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.553+0000 7f5e5f00f800 20 remove_watcher() i=6 2024-03-09T14:41:17.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.554+0000 7f5e5f00f800 20 remove_watcher() i=7 2024-03-09T14:41:17.564 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.564 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:41:17.564 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: abort-at-block-writes id: 5d93e872-363b-498b-b665-658644296b85.4535.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:41:17.564 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:17.652 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:41:17.681 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:17.682 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:17.715 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.714+0000 7f54e210b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.716 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.715+0000 7f54e210b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.716 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.715+0000 7f54e210b800 20 realm 2024-03-09T14:41:17.716 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.715+0000 7f54e210b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.716 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.715+0000 7f54e210b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.717 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.715+0000 7f54e210b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:17.717 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.715+0000 7f54e210b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.717 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.716+0000 7f54e210b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.717 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.716+0000 7f54e210b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.717 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.717+0000 7f54e210b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.717 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.717+0000 7f54e210b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.718 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.717+0000 7f54e210b800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:17.718 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.717+0000 7f54e210b800 20 searching for the correct realm 2024-03-09T14:41:17.720 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.719+0000 7f54e0408640 0 -- 172.21.15.88:0/1091615575 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x56455e3edd60 msgr2=0x56455e3f0150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:17.724 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.723+0000 7f54e0408640 0 -- 172.21.15.88:0/1091615575 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x7f53a807ace0 msgr2=0x7f53a807d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:17.729 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.729+0000 7f54e210b800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:17.729 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.729+0000 7f54e210b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:17.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.729+0000 7f54e210b800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:17.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.729+0000 7f54e210b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:17.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.729+0000 7f54e210b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:17.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.729+0000 7f54e210b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:17.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.729+0000 7f54e210b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.729+0000 7f54e210b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.730 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.729+0000 7f54e210b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.731 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.729+0000 7f54e210b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.729+0000 7f54e210b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.729+0000 7f54e210b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:17.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.730+0000 7f54e210b800 20 zone default found 2024-03-09T14:41:17.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.730+0000 7f54e210b800 4 Realm: () 2024-03-09T14:41:17.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.730+0000 7f54e210b800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:17.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.730+0000 7f54e210b800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:17.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.730+0000 7f54e210b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:17.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.730+0000 7f54e210b800 20 zonegroup default 2024-03-09T14:41:17.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.730+0000 7f54e210b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.730+0000 7f54e210b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.732 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.730+0000 7f54e210b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.733 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.730+0000 7f54e210b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.733 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.730+0000 7f54e210b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.733 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.730+0000 7f54e210b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.733 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.730+0000 7f54e210b800 20 started sync module instance, tier type = 2024-03-09T14:41:17.733 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.730+0000 7f54e210b800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:17.741 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.740+0000 7f54e210b800 20 add_watcher() i=0 2024-03-09T14:41:17.741 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.740+0000 7f54e210b800 20 add_watcher() i=1 2024-03-09T14:41:17.741 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.740+0000 7f54e210b800 20 add_watcher() i=2 2024-03-09T14:41:17.741 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.740+0000 7f54e210b800 20 add_watcher() i=3 2024-03-09T14:41:17.742 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.740+0000 7f54e210b800 20 add_watcher() i=4 2024-03-09T14:41:17.742 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.740+0000 7f54e210b800 20 add_watcher() i=5 2024-03-09T14:41:17.742 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.740+0000 7f54e210b800 20 add_watcher() i=6 2024-03-09T14:41:17.743 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.741+0000 7f54e210b800 20 add_watcher() i=7 2024-03-09T14:41:17.743 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.741+0000 7f54e210b800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:17.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.743+0000 7f5395fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:17.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.743+0000 7f54e210b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:17.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.743+0000 7f54e210b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:17.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.743+0000 7f54e210b800 5 note: GC not initialized 2024-03-09T14:41:17.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.743+0000 7f5394fe1640 20 reqs_thread_entry: start 2024-03-09T14:41:17.746 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f54e210b800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:17.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f54e210b800 20 Filter name: none 2024-03-09T14:41:17.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f530e7fc640 20 reqs_thread_entry: start 2024-03-09T14:41:17.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f54e210b800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-09T14:41:17.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f54e210b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f54e210b800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:17.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f54e210b800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-09T14:41:17.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f54e210b800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-09T14:41:17.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f54e210b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 : miss 2024-03-09T14:41:17.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f54e210b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f54e210b800 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:41:17.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f54e210b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 info.flags=0x17 2024-03-09T14:41:17.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f54e210b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to cache LRU end 2024-03-09T14:41:17.748 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f54e210b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:17.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f54e210b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:17.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.744+0000 7f54e210b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 2024-03-09T14:41:17.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.746+0000 7f54e210b800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to be held by another RGW process; skipping for now 2024-03-09T14:41:17.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.746+0000 7f5395fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:17.751 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.749+0000 7f54e210b800 20 remove_watcher() i=0 2024-03-09T14:41:17.751 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.749+0000 7f54e210b800 2 removed watcher, disabling cache 2024-03-09T14:41:17.752 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.750+0000 7f54e210b800 20 remove_watcher() i=1 2024-03-09T14:41:17.752 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.751+0000 7f54e210b800 20 remove_watcher() i=2 2024-03-09T14:41:17.753 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.752+0000 7f54e210b800 20 remove_watcher() i=3 2024-03-09T14:41:17.754 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.753+0000 7f54e210b800 20 remove_watcher() i=4 2024-03-09T14:41:17.755 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.754+0000 7f54e210b800 20 remove_watcher() i=5 2024-03-09T14:41:17.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.755+0000 7f54e210b800 20 remove_watcher() i=6 2024-03-09T14:41:17.756 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:17.756+0000 7f54e210b800 20 remove_watcher() i=7 2024-03-09T14:41:17.766 INFO:tasks.workunit.client.0.smithi088.stderr:waiting 30 seconds for reshard lock to expire... 2024-03-09T14:41:47.775 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:41:47.808 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:47.809 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:47.847 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:47.848+0000 7fd495b26800 20 rados->read ofs=0 len=0 2024-03-09T14:41:47.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:47.849+0000 7fd495b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:47.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:47.849+0000 7fd495b26800 20 realm 2024-03-09T14:41:47.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:47.849+0000 7fd495b26800 20 rados->read ofs=0 len=0 2024-03-09T14:41:47.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:47.849+0000 7fd495b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:47.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:47.849+0000 7fd495b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:47.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:47.849+0000 7fd495b26800 20 rados->read ofs=0 len=0 2024-03-09T14:41:47.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:47.850+0000 7fd495b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:47.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:47.850+0000 7fd495b26800 20 rados->read ofs=0 len=0 2024-03-09T14:41:47.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:47.850+0000 7fd495b26800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:47.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:47.850+0000 7fd495b26800 20 rados->read ofs=0 len=0 2024-03-09T14:41:47.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:47.851+0000 7fd495b26800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:47.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:47.851+0000 7fd495b26800 20 searching for the correct realm 2024-03-09T14:41:47.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:47.853+0000 7fd49202b640 0 -- 172.21.15.88:0/3495870166 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fd48c083040 msgr2=0x7fd48c076410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:48.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.060+0000 7fd491029640 0 -- 172.21.15.88:0/3495870166 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fd48c05e3d0 msgr2=0x7fd48c05e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:48.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.267+0000 7fd495b26800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:48.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.267+0000 7fd495b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:48.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.267+0000 7fd495b26800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:48.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.267+0000 7fd495b26800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:48.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.267+0000 7fd495b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:48.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.267+0000 7fd495b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:48.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.267+0000 7fd495b26800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.267+0000 7fd495b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:48.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.267+0000 7fd495b26800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.268+0000 7fd495b26800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:48.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.268+0000 7fd495b26800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.268+0000 7fd495b26800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:48.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.268+0000 7fd495b26800 20 zone default found 2024-03-09T14:41:48.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.268+0000 7fd495b26800 4 Realm: () 2024-03-09T14:41:48.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.268+0000 7fd495b26800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:48.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.268+0000 7fd495b26800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:48.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.268+0000 7fd495b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:48.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.268+0000 7fd495b26800 20 zonegroup default 2024-03-09T14:41:48.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.268+0000 7fd495b26800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.268+0000 7fd495b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:48.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.268+0000 7fd495b26800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.269+0000 7fd495b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:48.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.269+0000 7fd495b26800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.269+0000 7fd495b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:48.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.269+0000 7fd495b26800 20 started sync module instance, tier type = 2024-03-09T14:41:48.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.269+0000 7fd495b26800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:48.279 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.279+0000 7fd495b26800 20 add_watcher() i=0 2024-03-09T14:41:48.279 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.279+0000 7fd495b26800 20 add_watcher() i=1 2024-03-09T14:41:48.279 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.279+0000 7fd495b26800 20 add_watcher() i=2 2024-03-09T14:41:48.279 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.279+0000 7fd495b26800 20 add_watcher() i=3 2024-03-09T14:41:48.279 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.279+0000 7fd495b26800 20 add_watcher() i=4 2024-03-09T14:41:48.279 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.279+0000 7fd495b26800 20 add_watcher() i=5 2024-03-09T14:41:48.279 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.279+0000 7fd495b26800 20 add_watcher() i=6 2024-03-09T14:41:48.280 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.280+0000 7fd495b26800 20 add_watcher() i=7 2024-03-09T14:41:48.280 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.280+0000 7fd495b26800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:48.281 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.282+0000 7fd3437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:48.282 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.282+0000 7fd495b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:48.282 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.282+0000 7fd495b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:48.282 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.282+0000 7fd495b26800 5 note: GC not initialized 2024-03-09T14:41:48.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.282+0000 7fd3427fc640 20 reqs_thread_entry: start 2024-03-09T14:41:48.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.282+0000 7fd495b26800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:48.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.283+0000 7fd495b26800 20 Filter name: none 2024-03-09T14:41:48.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.283+0000 7fd2b3fff640 20 reqs_thread_entry: start 2024-03-09T14:41:48.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.283+0000 7fd495b26800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-09T14:41:48.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.283+0000 7fd495b26800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.283+0000 7fd495b26800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:48.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.283+0000 7fd495b26800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-09T14:41:48.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.283+0000 7fd495b26800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-09T14:41:48.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.283+0000 7fd495b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 : miss 2024-03-09T14:41:48.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.283+0000 7fd495b26800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.283+0000 7fd495b26800 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:41:48.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.283+0000 7fd495b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 info.flags=0x17 2024-03-09T14:41:48.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.283+0000 7fd495b26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to cache LRU end 2024-03-09T14:41:48.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.283+0000 7fd495b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:48.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.283+0000 7fd495b26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:48.284 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.284+0000 7fd495b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 2024-03-09T14:41:48.285 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.285+0000 7fd495b26800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-03-09T14:41:48.291 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.292+0000 7fd495b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 info.flags=0x17 2024-03-09T14:41:48.291 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.292+0000 7fd495b26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to cache LRU end 2024-03-09T14:41:48.291 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.292+0000 7fd495b26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:48.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.292+0000 7fd495b26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23, ofs0, ns] 2024-03-09T14:41:48.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.292+0000 7fd3757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464345 cookie 94279887618880 notifier 6546 bl.length()=907 2024-03-09T14:41:48.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.292+0000 7fd3757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 info.flags=0x17 2024-03-09T14:41:48.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.292+0000 7fd3757fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to cache LRU end 2024-03-09T14:41:48.292 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.292+0000 7fd3757fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:48.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.294+0000 7fd495b26800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): orig_sources= new_sources= 2024-03-09T14:41:48.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.294+0000 7fd495b26800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): potential sources added=[] removed=[] 2024-03-09T14:41:48.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.294+0000 7fd495b26800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): orig_dests= new_dests= 2024-03-09T14:41:48.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.294+0000 7fd495b26800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): potential dests added=[] removed=[] 2024-03-09T14:41:48.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.0 2024-03-09T14:41:48.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.0 2024-03-09T14:41:48.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.1 2024-03-09T14:41:48.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.1 2024-03-09T14:41:48.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.2 2024-03-09T14:41:48.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.2 2024-03-09T14:41:48.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.3 2024-03-09T14:41:48.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.3 2024-03-09T14:41:48.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.4 2024-03-09T14:41:48.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.4 2024-03-09T14:41:48.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.5 2024-03-09T14:41:48.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.5 2024-03-09T14:41:48.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.6 2024-03-09T14:41:48.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.6 2024-03-09T14:41:48.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.7 2024-03-09T14:41:48.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.7 2024-03-09T14:41:48.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.8 2024-03-09T14:41:48.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.8 2024-03-09T14:41:48.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.9 2024-03-09T14:41:48.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.9 2024-03-09T14:41:48.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.10 2024-03-09T14:41:48.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.10 2024-03-09T14:41:48.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.11 2024-03-09T14:41:48.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2.11 2024-03-09T14:41:48.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.296+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.0 2024-03-09T14:41:48.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.297+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.1 2024-03-09T14:41:48.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.297+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.2 2024-03-09T14:41:48.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.298+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.3 2024-03-09T14:41:48.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.298+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.4 2024-03-09T14:41:48.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.299+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.5 2024-03-09T14:41:48.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.300+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.6 2024-03-09T14:41:48.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.300+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.7 2024-03-09T14:41:48.300 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.300+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.8 2024-03-09T14:41:48.300 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.301+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.9 2024-03-09T14:41:48.301 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.301+0000 7fd495b26800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.23.10 2024-03-09T14:41:48.304 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.305+0000 7fd495b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 : hit (requested=0x17, cached=0x17) 2024-03-09T14:41:48.304 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.305+0000 7fd495b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 2024-03-09T14:41:48.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.306+0000 7fd495b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 info.flags=0x17 2024-03-09T14:41:48.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.306+0000 7fd495b26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to cache LRU end 2024-03-09T14:41:48.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.306+0000 7fd495b26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:48.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.306+0000 7fd495b26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23, ofs0, ns] 2024-03-09T14:41:48.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.306+0000 7fd3757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464346 cookie 94279887618880 notifier 6546 bl.length()=875 2024-03-09T14:41:48.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.306+0000 7fd3757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 info.flags=0x17 2024-03-09T14:41:48.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.306+0000 7fd3757fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:5d93e872-363b-498b-b665-658644296b85.4535.23 to cache LRU end 2024-03-09T14:41:48.307 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.306+0000 7fd3757fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:48.308 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.308+0000 7fd495b26800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): orig_sources= new_sources= 2024-03-09T14:41:48.308 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.308+0000 7fd495b26800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): potential sources added=[] removed=[] 2024-03-09T14:41:48.308 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.308+0000 7fd495b26800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): orig_dests= new_dests= 2024-03-09T14:41:48.308 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.308+0000 7fd495b26800 20 handle_bi_update(): bucket=:abort-at-block-writes[5d93e872-363b-498b-b665-658644296b85.4535.23]): potential dests added=[] removed=[] 2024-03-09T14:41:48.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.311+0000 7fd495b26800 1 execute INFO: reshard of bucket "abort-at-block-writes" completed successfully 2024-03-09T14:41:48.312 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.312+0000 7fd3437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:48.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.314+0000 7fd495b26800 20 remove_watcher() i=0 2024-03-09T14:41:48.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.314+0000 7fd495b26800 2 removed watcher, disabling cache 2024-03-09T14:41:48.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.316+0000 7fd495b26800 20 remove_watcher() i=1 2024-03-09T14:41:48.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.317+0000 7fd495b26800 20 remove_watcher() i=2 2024-03-09T14:41:48.317 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.318+0000 7fd495b26800 20 remove_watcher() i=3 2024-03-09T14:41:48.318 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.319+0000 7fd495b26800 20 remove_watcher() i=4 2024-03-09T14:41:48.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.320+0000 7fd495b26800 20 remove_watcher() i=5 2024-03-09T14:41:48.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.321+0000 7fd495b26800 20 remove_watcher() i=6 2024-03-09T14:41:48.321 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.322+0000 7fd495b26800 20 remove_watcher() i=7 2024-03-09T14:41:48.333 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-03-09T14:41:48.360 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:48.360 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:48.392 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.393+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.394+0000 7f21cb73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:48.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.394+0000 7f21cb73b800 20 realm 2024-03-09T14:41:48.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.394+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.394+0000 7f21cb73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:48.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.394+0000 7f21cb73b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:48.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.394+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.396 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.395+0000 7f21cb73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:48.396 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.395+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.396 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.395+0000 7f21cb73b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:48.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.395+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.396+0000 7f21cb73b800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:48.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.396+0000 7f21cb73b800 20 searching for the correct realm 2024-03-09T14:41:48.398 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.398+0000 7f21c7cd5640 0 -- 172.21.15.88:0/2270313211 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f21b800e040 msgr2=0x7f21b805f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:48.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.604+0000 7f21c6cd3640 0 -- 172.21.15.88:0/2270313211 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f21b8090040 msgr2=0x7f21b807f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:48.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.810+0000 7f21cb73b800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:48.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.810+0000 7f21cb73b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:48.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.810+0000 7f21cb73b800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:48.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.810+0000 7f21cb73b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:48.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.810+0000 7f21cb73b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:48.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.810+0000 7f21cb73b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:48.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.810+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.810+0000 7f21cb73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:48.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.810+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.811+0000 7f21cb73b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:48.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.811+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.811+0000 7f21cb73b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:48.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.811+0000 7f21cb73b800 20 zone default found 2024-03-09T14:41:48.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.811+0000 7f21cb73b800 4 Realm: () 2024-03-09T14:41:48.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.811+0000 7f21cb73b800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:48.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.811+0000 7f21cb73b800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:48.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.811+0000 7f21cb73b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:48.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.811+0000 7f21cb73b800 20 zonegroup default 2024-03-09T14:41:48.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.811+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.811+0000 7f21cb73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:48.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.811+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.812+0000 7f21cb73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:48.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.812+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.812+0000 7f21cb73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:48.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.812+0000 7f21cb73b800 20 started sync module instance, tier type = 2024-03-09T14:41:48.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.812+0000 7f21cb73b800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:48.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.821+0000 7f21cb73b800 20 add_watcher() i=0 2024-03-09T14:41:48.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.821+0000 7f21cb73b800 20 add_watcher() i=1 2024-03-09T14:41:48.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.821+0000 7f21cb73b800 20 add_watcher() i=2 2024-03-09T14:41:48.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.821+0000 7f21cb73b800 20 add_watcher() i=3 2024-03-09T14:41:48.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.821+0000 7f21cb73b800 20 add_watcher() i=4 2024-03-09T14:41:48.822 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.821+0000 7f21cb73b800 20 add_watcher() i=5 2024-03-09T14:41:48.822 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.821+0000 7f21cb73b800 20 add_watcher() i=6 2024-03-09T14:41:48.822 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.822+0000 7f21cb73b800 20 add_watcher() i=7 2024-03-09T14:41:48.822 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.822+0000 7f21cb73b800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:48.824 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.824+0000 7f207dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:48.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.824+0000 7f21cb73b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:48.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.824+0000 7f21cb73b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:48.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.824+0000 7f21cb73b800 5 note: GC not initialized 2024-03-09T14:41:48.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.825+0000 7f207cfe1640 20 reqs_thread_entry: start 2024-03-09T14:41:48.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.825+0000 7f21cb73b800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:48.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.825+0000 7f21cb73b800 20 Filter name: none 2024-03-09T14:41:48.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.825+0000 7f1ff67fc640 20 reqs_thread_entry: start 2024-03-09T14:41:48.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.825+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.825+0000 7f21cb73b800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:48.826 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.825+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.826 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.826+0000 7f21cb73b800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:41:48.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.826+0000 7f21cb73b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:48.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.826+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.826+0000 7f21cb73b800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:41:48.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.826+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.826+0000 7f21cb73b800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:41:48.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.826+0000 7f21cb73b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:48.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.827+0000 7f21cb73b800 20 rados->read ofs=0 len=0 2024-03-09T14:41:48.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.828+0000 7f21cb73b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:48.828 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.828+0000 7f207dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:48.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.831+0000 7f21cb73b800 20 remove_watcher() i=0 2024-03-09T14:41:48.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.831+0000 7f21cb73b800 2 removed watcher, disabling cache 2024-03-09T14:41:48.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.832+0000 7f21cb73b800 20 remove_watcher() i=1 2024-03-09T14:41:48.833 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.833+0000 7f21cb73b800 20 remove_watcher() i=2 2024-03-09T14:41:48.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.834+0000 7f21cb73b800 20 remove_watcher() i=3 2024-03-09T14:41:48.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.835+0000 7f21cb73b800 20 remove_watcher() i=4 2024-03-09T14:41:48.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.836+0000 7f21cb73b800 20 remove_watcher() i=5 2024-03-09T14:41:48.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.837+0000 7f21cb73b800 20 remove_watcher() i=6 2024-03-09T14:41:48.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:48.838+0000 7f21cb73b800 20 remove_watcher() i=7 2024-03-09T14:41:48.847 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:48.847 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:41:48.847 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: abort-at-block-writes id: 5d93e872-363b-498b-b665-658644296b85.4535.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:41:48.847 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:49.189 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-03-09T14:41:49.189 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:49.936 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-09T14:41:49.962 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:49.962 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:49.996 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:49.996+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:49.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:49.997+0000 7fdc95933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:49.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:49.997+0000 7fdc95933800 20 realm 2024-03-09T14:41:49.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:49.997+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:49.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:49.998+0000 7fdc95933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:49.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:49.998+0000 7fdc95933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:49.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:49.998+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:49.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:49.998+0000 7fdc95933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:49.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:49.998+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:49.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:49.999+0000 7fdc95933800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:49.998 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:49.999+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:49.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:49.999+0000 7fdc95933800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:49.999 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:49.999+0000 7fdc95933800 20 searching for the correct realm 2024-03-09T14:41:50.001 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.002+0000 7fdc91dd4640 0 -- 172.21.15.88:0/2494072423 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fdc8c03f040 msgr2=0x7fdc8c095050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:50.005 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.006+0000 7fdc88dd2640 0 -- 172.21.15.88:0/2494072423 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fdc8c06da60 msgr2=0x7fdc8c095140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:50.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.212+0000 7fdc95933800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:50.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.212+0000 7fdc95933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:50.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.212+0000 7fdc95933800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:50.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.212+0000 7fdc95933800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:50.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.212+0000 7fdc95933800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:50.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.212+0000 7fdc95933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:50.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.212+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.213+0000 7fdc95933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.213+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.213+0000 7fdc95933800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:50.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.213+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.213+0000 7fdc95933800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:50.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.213+0000 7fdc95933800 20 zone default found 2024-03-09T14:41:50.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.213+0000 7fdc95933800 4 Realm: () 2024-03-09T14:41:50.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.213+0000 7fdc95933800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:50.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.213+0000 7fdc95933800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:50.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.213+0000 7fdc95933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:50.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.213+0000 7fdc95933800 20 zonegroup default 2024-03-09T14:41:50.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.213+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.214+0000 7fdc95933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.214+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.214+0000 7fdc95933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.214+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.214+0000 7fdc95933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.214+0000 7fdc95933800 20 started sync module instance, tier type = 2024-03-09T14:41:50.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.214+0000 7fdc95933800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:50.223 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.224+0000 7fdc95933800 20 add_watcher() i=0 2024-03-09T14:41:50.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.224+0000 7fdc95933800 20 add_watcher() i=1 2024-03-09T14:41:50.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.224+0000 7fdc95933800 20 add_watcher() i=2 2024-03-09T14:41:50.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.224+0000 7fdc95933800 20 add_watcher() i=3 2024-03-09T14:41:50.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.224+0000 7fdc95933800 20 add_watcher() i=4 2024-03-09T14:41:50.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.224+0000 7fdc95933800 20 add_watcher() i=5 2024-03-09T14:41:50.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.224+0000 7fdc95933800 20 add_watcher() i=6 2024-03-09T14:41:50.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.225+0000 7fdc95933800 20 add_watcher() i=7 2024-03-09T14:41:50.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.225+0000 7fdc95933800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:50.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.226+0000 7fdb477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:50.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.227+0000 7fdc95933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:50.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.227+0000 7fdc95933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:50.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.227+0000 7fdc95933800 5 note: GC not initialized 2024-03-09T14:41:50.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.227+0000 7fdb467e4640 20 reqs_thread_entry: start 2024-03-09T14:41:50.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.227+0000 7fdc95933800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:50.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.227+0000 7fdc95933800 20 Filter name: none 2024-03-09T14:41:50.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.227+0000 7fdab7fff640 20 reqs_thread_entry: start 2024-03-09T14:41:50.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.227+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.228+0000 7fdc95933800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:50.228 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.228+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.228 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.229+0000 7fdc95933800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:41:50.228 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.229+0000 7fdc95933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:50.229 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.229+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.229 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.229+0000 7fdc95933800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:50.229 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.229+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.229 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.230+0000 7fdc95933800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:41:50.229 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.230+0000 7fdc95933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:50.230 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.231+0000 7fdc95933800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.230 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.231+0000 7fdc95933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.231 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.232+0000 7fdb477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:50.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.234+0000 7fdc95933800 20 remove_watcher() i=0 2024-03-09T14:41:50.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.234+0000 7fdc95933800 2 removed watcher, disabling cache 2024-03-09T14:41:50.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.235+0000 7fdc95933800 20 remove_watcher() i=1 2024-03-09T14:41:50.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.236+0000 7fdc95933800 20 remove_watcher() i=2 2024-03-09T14:41:50.236 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.237+0000 7fdc95933800 20 remove_watcher() i=3 2024-03-09T14:41:50.237 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.238+0000 7fdc95933800 20 remove_watcher() i=4 2024-03-09T14:41:50.238 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.239+0000 7fdc95933800 20 remove_watcher() i=5 2024-03-09T14:41:50.239 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.240+0000 7fdc95933800 20 remove_watcher() i=6 2024-03-09T14:41:50.240 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.241+0000 7fdc95933800 20 remove_watcher() i=7 2024-03-09T14:41:50.250 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:50.250 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:41:50.250 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-commit-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:41:50.250 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:50.251 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-03-09T14:41:50.283 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:50.284 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:50.317 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.318+0000 7f3d0800f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.319+0000 7f3d0800f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.319+0000 7f3d0800f800 20 realm 2024-03-09T14:41:50.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.319+0000 7f3d0800f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.319+0000 7f3d0800f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.319+0000 7f3d0800f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:50.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.319+0000 7f3d0800f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.319+0000 7f3d0800f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.319+0000 7f3d0800f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.320+0000 7f3d0800f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:50.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.320+0000 7f3d0800f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.321+0000 7f3d0800f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:50.321 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.321+0000 7f3d0800f800 20 searching for the correct realm 2024-03-09T14:41:50.321 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.321+0000 7f3d0375e640 0 -- 172.21.15.88:0/523843603 >> [v2:172.21.15.88:6800/4216886240,v1:172.21.15.88:6802/4216886240] conn(0x55775252c3c0 msgr2=0x55775252e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:50.325 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.325+0000 7f3d0375e640 0 -- 172.21.15.88:0/523843603 >> [v2:172.21.15.132:6824/731564406,v1:172.21.15.132:6825/731564406] conn(0x5577522ea380 msgr2=0x7f3cfc060420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:50.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.534+0000 7f3d0800f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:50.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.534+0000 7f3d0800f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:50.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.534+0000 7f3d0800f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:50.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.534+0000 7f3d0800f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:50.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.534+0000 7f3d0800f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:50.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.534+0000 7f3d0800f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:50.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.534+0000 7f3d0800f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.535+0000 7f3d0800f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.535+0000 7f3d0800f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.535+0000 7f3d0800f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:50.535 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.535+0000 7f3d0800f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.536 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.535+0000 7f3d0800f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.535+0000 7f3d0800f800 20 zone default found 2024-03-09T14:41:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.535+0000 7f3d0800f800 4 Realm: () 2024-03-09T14:41:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.535+0000 7f3d0800f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.535+0000 7f3d0800f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.535+0000 7f3d0800f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.535+0000 7f3d0800f800 20 zonegroup default 2024-03-09T14:41:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.535+0000 7f3d0800f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.536+0000 7f3d0800f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.536+0000 7f3d0800f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.536+0000 7f3d0800f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.536+0000 7f3d0800f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.536+0000 7f3d0800f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.536+0000 7f3d0800f800 20 started sync module instance, tier type = 2024-03-09T14:41:50.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.536+0000 7f3d0800f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:50.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.546+0000 7f3d0800f800 20 add_watcher() i=0 2024-03-09T14:41:50.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.546+0000 7f3d0800f800 20 add_watcher() i=1 2024-03-09T14:41:50.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.546+0000 7f3d0800f800 20 add_watcher() i=2 2024-03-09T14:41:50.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.546+0000 7f3d0800f800 20 add_watcher() i=3 2024-03-09T14:41:50.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.546+0000 7f3d0800f800 20 add_watcher() i=4 2024-03-09T14:41:50.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.546+0000 7f3d0800f800 20 add_watcher() i=5 2024-03-09T14:41:50.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.546+0000 7f3d0800f800 20 add_watcher() i=6 2024-03-09T14:41:50.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.547+0000 7f3d0800f800 20 add_watcher() i=7 2024-03-09T14:41:50.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.547+0000 7f3d0800f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:50.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.548+0000 7f3bb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:50.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.549+0000 7f3d0800f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:50.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.549+0000 7f3d0800f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:50.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.549+0000 7f3d0800f800 5 note: GC not initialized 2024-03-09T14:41:50.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.549+0000 7f3bb8fe1640 20 reqs_thread_entry: start 2024-03-09T14:41:50.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.549+0000 7f3d0800f800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:50.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.549+0000 7f3d0800f800 20 Filter name: none 2024-03-09T14:41:50.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.549+0000 7f3b327fc640 20 reqs_thread_entry: start 2024-03-09T14:41:50.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.549+0000 7f3d0800f800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-03-09T14:41:50.550 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.549+0000 7f3d0800f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.550+0000 7f3d0800f800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:50.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.550+0000 7f3d0800f800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-03-09T14:41:50.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.550+0000 7f3d0800f800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-03-09T14:41:50.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.550+0000 7f3d0800f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 : miss 2024-03-09T14:41:50.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.550+0000 7f3d0800f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.550+0000 7f3d0800f800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:41:50.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.550+0000 7f3d0800f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 info.flags=0x17 2024-03-09T14:41:50.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.550+0000 7f3d0800f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 to cache LRU end 2024-03-09T14:41:50.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.550+0000 7f3d0800f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:50.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.550+0000 7f3d0800f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:50.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.550+0000 7f3d0800f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 2024-03-09T14:41:50.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.556+0000 7f3d0800f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 info.flags=0x17 2024-03-09T14:41:50.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.556+0000 7f3d0800f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 to cache LRU end 2024-03-09T14:41:50.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.556+0000 7f3d0800f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:50.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.556+0000 7f3d0800f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24, ofs0, ns] 2024-03-09T14:41:50.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.556+0000 7f3be6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464351 cookie 93970970642880 notifier 6311 bl.length()=923 2024-03-09T14:41:50.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.556+0000 7f3be6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 info.flags=0x17 2024-03-09T14:41:50.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.556+0000 7f3be6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 to cache LRU end 2024-03-09T14:41:50.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.556+0000 7f3be6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:50.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.558+0000 7f3d0800f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.24]): orig_sources= new_sources= 2024-03-09T14:41:50.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.558+0000 7f3d0800f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.24]): potential sources added=[] removed=[] 2024-03-09T14:41:50.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.558+0000 7f3d0800f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.24]): orig_dests= new_dests= 2024-03-09T14:41:50.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.558+0000 7f3d0800f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.24]): potential dests added=[] removed=[] 2024-03-09T14:41:50.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.0 2024-03-09T14:41:50.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.0 2024-03-09T14:41:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.1 2024-03-09T14:41:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.1 2024-03-09T14:41:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.2 2024-03-09T14:41:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.2 2024-03-09T14:41:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.3 2024-03-09T14:41:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.3 2024-03-09T14:41:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.4 2024-03-09T14:41:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.4 2024-03-09T14:41:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.5 2024-03-09T14:41:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.5 2024-03-09T14:41:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.6 2024-03-09T14:41:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.6 2024-03-09T14:41:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.7 2024-03-09T14:41:50.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.7 2024-03-09T14:41:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.8 2024-03-09T14:41:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.8 2024-03-09T14:41:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.9 2024-03-09T14:41:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.9 2024-03-09T14:41:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.10 2024-03-09T14:41:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.10 2024-03-09T14:41:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.11 2024-03-09T14:41:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1.11 2024-03-09T14:41:50.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.0 2024-03-09T14:41:50.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.563+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1 2024-03-09T14:41:50.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.564+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2 2024-03-09T14:41:50.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.564+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.3 2024-03-09T14:41:50.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.565+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.4 2024-03-09T14:41:50.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.565+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.5 2024-03-09T14:41:50.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.565+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.6 2024-03-09T14:41:50.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.566+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.7 2024-03-09T14:41:50.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.566+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.8 2024-03-09T14:41:50.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.567+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.9 2024-03-09T14:41:50.567 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.567+0000 7f3d0800f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.10 2024-03-09T14:41:50.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.571+0000 7f3d0800f800 -1 Injecting error=-5 at location=commit_target_layout 2024-03-09T14:41:50.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.571+0000 7f3d0800f800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-03-09T14:41:50.574 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.575+0000 7f3bb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:50.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.577+0000 7f3d0800f800 20 remove_watcher() i=0 2024-03-09T14:41:50.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.577+0000 7f3d0800f800 2 removed watcher, disabling cache 2024-03-09T14:41:50.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.578+0000 7f3d0800f800 20 remove_watcher() i=1 2024-03-09T14:41:50.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.579+0000 7f3d0800f800 20 remove_watcher() i=2 2024-03-09T14:41:50.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.580+0000 7f3d0800f800 20 remove_watcher() i=3 2024-03-09T14:41:50.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.581+0000 7f3d0800f800 20 remove_watcher() i=4 2024-03-09T14:41:50.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.582+0000 7f3d0800f800 20 remove_watcher() i=5 2024-03-09T14:41:50.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.583+0000 7f3d0800f800 20 remove_watcher() i=6 2024-03-09T14:41:50.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.584+0000 7f3d0800f800 20 remove_watcher() i=7 2024-03-09T14:41:50.595 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-09T14:41:50.622 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:50.623 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:50.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.656+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.657+0000 7f0972c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.657+0000 7f0972c24800 20 realm 2024-03-09T14:41:50.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.657+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.658+0000 7f0972c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.658+0000 7f0972c24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:50.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.658+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.658+0000 7f0972c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.658+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.659+0000 7f0972c24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:50.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.659+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.659+0000 7f0972c24800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:50.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.659+0000 7f0972c24800 20 searching for the correct realm 2024-03-09T14:41:50.661 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.661+0000 7f0970f28640 0 -- 172.21.15.88:0/929053749 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f096805d040 msgr2=0x7f09680b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:50.866 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:50.866+0000 7f0967f26640 0 -- 172.21.15.88:0/929053749 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f0968004050 msgr2=0x7f09680ba690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:51.473 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.473+0000 7f0972c24800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:51.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.473+0000 7f0972c24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:51.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.473+0000 7f0972c24800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:51.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.473+0000 7f0972c24800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:51.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.473+0000 7f0972c24800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:51.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.473+0000 7f0972c24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:51.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.473+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.474+0000 7f0972c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.474 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.474+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.475 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.474+0000 7f0972c24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:51.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.474+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.474+0000 7f0972c24800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:51.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.474+0000 7f0972c24800 20 zone default found 2024-03-09T14:41:51.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.474+0000 7f0972c24800 4 Realm: () 2024-03-09T14:41:51.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.474+0000 7f0972c24800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:51.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.474+0000 7f0972c24800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:51.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.474+0000 7f0972c24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:51.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.474+0000 7f0972c24800 20 zonegroup default 2024-03-09T14:41:51.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.474+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.475+0000 7f0972c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.475+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.475+0000 7f0972c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.475+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.475+0000 7f0972c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.475+0000 7f0972c24800 20 started sync module instance, tier type = 2024-03-09T14:41:51.477 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.475+0000 7f0972c24800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:51.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.485+0000 7f0972c24800 20 add_watcher() i=0 2024-03-09T14:41:51.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.485+0000 7f0972c24800 20 add_watcher() i=1 2024-03-09T14:41:51.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.485+0000 7f0972c24800 20 add_watcher() i=2 2024-03-09T14:41:51.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.485+0000 7f0972c24800 20 add_watcher() i=3 2024-03-09T14:41:51.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.485+0000 7f0972c24800 20 add_watcher() i=4 2024-03-09T14:41:51.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.485+0000 7f0972c24800 20 add_watcher() i=5 2024-03-09T14:41:51.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.485+0000 7f0972c24800 20 add_watcher() i=6 2024-03-09T14:41:51.486 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.486+0000 7f0972c24800 20 add_watcher() i=7 2024-03-09T14:41:51.486 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.486+0000 7f0972c24800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:51.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.488+0000 7f0826fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:51.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.489+0000 7f0972c24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:51.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.489+0000 7f0972c24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:51.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.489+0000 7f0972c24800 5 note: GC not initialized 2024-03-09T14:41:51.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.489+0000 7f0825fdb640 20 reqs_thread_entry: start 2024-03-09T14:41:51.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.489+0000 7f0972c24800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:51.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.489+0000 7f0972c24800 20 Filter name: none 2024-03-09T14:41:51.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.489+0000 7f07977fe640 20 reqs_thread_entry: start 2024-03-09T14:41:51.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.489+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.490+0000 7f0972c24800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:51.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.490+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.490+0000 7f0972c24800 20 rados_obj.operate() r=0 bl.length=443 2024-03-09T14:41:51.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.490+0000 7f0972c24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:51.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.490+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.491+0000 7f0972c24800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:51.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.491+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.491+0000 7f0972c24800 20 rados_obj.operate() r=0 bl.length=443 2024-03-09T14:41:51.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.491+0000 7f0972c24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:51.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.492+0000 7f0972c24800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.492+0000 7f0972c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.493+0000 7f0826fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:51.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.496+0000 7f0972c24800 20 remove_watcher() i=0 2024-03-09T14:41:51.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.496+0000 7f0972c24800 2 removed watcher, disabling cache 2024-03-09T14:41:51.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.497+0000 7f0972c24800 20 remove_watcher() i=1 2024-03-09T14:41:51.497 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.498+0000 7f0972c24800 20 remove_watcher() i=2 2024-03-09T14:41:51.498 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.499+0000 7f0972c24800 20 remove_watcher() i=3 2024-03-09T14:41:51.499 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.500+0000 7f0972c24800 20 remove_watcher() i=4 2024-03-09T14:41:51.500 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.501+0000 7f0972c24800 20 remove_watcher() i=5 2024-03-09T14:41:51.501 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.502+0000 7f0972c24800 20 remove_watcher() i=6 2024-03-09T14:41:51.502 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.503+0000 7f0972c24800 20 remove_watcher() i=7 2024-03-09T14:41:51.512 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:51.512 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:41:51.512 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-commit-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:41:51.512 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:51.601 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:41:51.631 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:51.631 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:51.664 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.664+0000 7f4cca333800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.665 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.665+0000 7f4cca333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.665+0000 7f4cca333800 20 realm 2024-03-09T14:41:51.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.665+0000 7f4cca333800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.666+0000 7f4cca333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.666+0000 7f4cca333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:51.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.666+0000 7f4cca333800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.666+0000 7f4cca333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.666 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.666+0000 7f4cca333800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.667+0000 7f4cca333800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:51.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.667+0000 7f4cca333800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.668+0000 7f4cca333800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:51.667 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.668+0000 7f4cca333800 20 searching for the correct realm 2024-03-09T14:41:51.669 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.670+0000 7f4cc67f8640 0 -- 172.21.15.88:0/3770913824 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f4cc0092060 msgr2=0x7f4cc0089ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:51.876 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:51.876+0000 7f4cbd7f6640 0 -- 172.21.15.88:0/3770913824 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f4cc0075bb0 msgr2=0x7f4cc0009250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:52.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.083+0000 7f4cca333800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:52.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.083+0000 7f4cca333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:52.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.083+0000 7f4cca333800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:52.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.083+0000 7f4cca333800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:52.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.083+0000 7f4cca333800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:52.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.083+0000 7f4cca333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:52.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.083+0000 7f4cca333800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.083 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.083+0000 7f4cca333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:52.084 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.083+0000 7f4cca333800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.084+0000 7f4cca333800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:52.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.084+0000 7f4cca333800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.084+0000 7f4cca333800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:52.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.084+0000 7f4cca333800 20 zone default found 2024-03-09T14:41:52.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.084+0000 7f4cca333800 4 Realm: () 2024-03-09T14:41:52.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.084+0000 7f4cca333800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:52.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.084+0000 7f4cca333800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:52.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.084+0000 7f4cca333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:52.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.084+0000 7f4cca333800 20 zonegroup default 2024-03-09T14:41:52.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.084+0000 7f4cca333800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.084+0000 7f4cca333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:52.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.084+0000 7f4cca333800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.085+0000 7f4cca333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:52.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.085+0000 7f4cca333800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.085+0000 7f4cca333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:52.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.085+0000 7f4cca333800 20 started sync module instance, tier type = 2024-03-09T14:41:52.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.085+0000 7f4cca333800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:52.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.095+0000 7f4cca333800 20 add_watcher() i=0 2024-03-09T14:41:52.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.095+0000 7f4cca333800 20 add_watcher() i=1 2024-03-09T14:41:52.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.095+0000 7f4cca333800 20 add_watcher() i=2 2024-03-09T14:41:52.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.095+0000 7f4cca333800 20 add_watcher() i=3 2024-03-09T14:41:52.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.095+0000 7f4cca333800 20 add_watcher() i=4 2024-03-09T14:41:52.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.095+0000 7f4cca333800 20 add_watcher() i=5 2024-03-09T14:41:52.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.095+0000 7f4cca333800 20 add_watcher() i=6 2024-03-09T14:41:52.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.096+0000 7f4cca333800 20 add_watcher() i=7 2024-03-09T14:41:52.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.096+0000 7f4cca333800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:52.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.098+0000 7f4b777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:52.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.098+0000 7f4cca333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:52.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.098+0000 7f4cca333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:52.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.098+0000 7f4cca333800 5 note: GC not initialized 2024-03-09T14:41:52.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.098+0000 7f4b767fc640 20 reqs_thread_entry: start 2024-03-09T14:41:52.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.098+0000 7f4cca333800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:52.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.099+0000 7f4cca333800 20 Filter name: none 2024-03-09T14:41:52.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.099+0000 7f4ae7fff640 20 reqs_thread_entry: start 2024-03-09T14:41:52.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.099+0000 7f4cca333800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-03-09T14:41:52.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.099+0000 7f4cca333800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.099+0000 7f4cca333800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:52.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.099+0000 7f4cca333800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-03-09T14:41:52.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.099+0000 7f4cca333800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-03-09T14:41:52.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.099+0000 7f4cca333800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 : miss 2024-03-09T14:41:52.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.099+0000 7f4cca333800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.100+0000 7f4cca333800 20 rados_obj.operate() r=0 bl.length=443 2024-03-09T14:41:52.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.100+0000 7f4cca333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 info.flags=0x17 2024-03-09T14:41:52.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.100+0000 7f4cca333800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 to cache LRU end 2024-03-09T14:41:52.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.100+0000 7f4cca333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:52.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.100+0000 7f4cca333800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:52.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.100+0000 7f4cca333800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 2024-03-09T14:41:52.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.101+0000 7f4cca333800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-03-09T14:41:52.108 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.108+0000 7f4cca333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 info.flags=0x17 2024-03-09T14:41:52.108 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.108+0000 7f4cca333800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 to cache LRU end 2024-03-09T14:41:52.108 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.108+0000 7f4cca333800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:52.108 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.108+0000 7f4cca333800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24, ofs0, ns] 2024-03-09T14:41:52.109 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.109+0000 7f4ba8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464352 cookie 94105161356208 notifier 6344 bl.length()=923 2024-03-09T14:41:52.109 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.109+0000 7f4ba8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 info.flags=0x17 2024-03-09T14:41:52.109 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.109+0000 7f4ba8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 to cache LRU end 2024-03-09T14:41:52.109 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.109+0000 7f4ba8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:52.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.110+0000 7f4cca333800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.24]): orig_sources= new_sources= 2024-03-09T14:41:52.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.110+0000 7f4cca333800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.24]): potential sources added=[] removed=[] 2024-03-09T14:41:52.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.110+0000 7f4cca333800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.24]): orig_dests= new_dests= 2024-03-09T14:41:52.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.110+0000 7f4cca333800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.24]): potential dests added=[] removed=[] 2024-03-09T14:41:52.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.0 2024-03-09T14:41:52.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.0 2024-03-09T14:41:52.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.1 2024-03-09T14:41:52.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.1 2024-03-09T14:41:52.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.2 2024-03-09T14:41:52.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.2 2024-03-09T14:41:52.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.3 2024-03-09T14:41:52.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.3 2024-03-09T14:41:52.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.4 2024-03-09T14:41:52.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.4 2024-03-09T14:41:52.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.5 2024-03-09T14:41:52.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.5 2024-03-09T14:41:52.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.6 2024-03-09T14:41:52.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.6 2024-03-09T14:41:52.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.7 2024-03-09T14:41:52.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.7 2024-03-09T14:41:52.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.8 2024-03-09T14:41:52.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.8 2024-03-09T14:41:52.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.9 2024-03-09T14:41:52.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.9 2024-03-09T14:41:52.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.10 2024-03-09T14:41:52.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.10 2024-03-09T14:41:52.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.11 2024-03-09T14:41:52.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2.11 2024-03-09T14:41:52.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.113+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.0 2024-03-09T14:41:52.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.114+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.1 2024-03-09T14:41:52.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.114+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.2 2024-03-09T14:41:52.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.115+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.3 2024-03-09T14:41:52.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.115+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.4 2024-03-09T14:41:52.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.116+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.5 2024-03-09T14:41:52.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.116+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.6 2024-03-09T14:41:52.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.117+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.7 2024-03-09T14:41:52.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.117+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.8 2024-03-09T14:41:52.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.118+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.9 2024-03-09T14:41:52.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.119+0000 7f4cca333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.24.10 2024-03-09T14:41:52.122 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.122+0000 7f4cca333800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 : hit (requested=0x17, cached=0x17) 2024-03-09T14:41:52.122 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.122+0000 7f4cca333800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 2024-03-09T14:41:52.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.123+0000 7f4cca333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 info.flags=0x17 2024-03-09T14:41:52.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.123+0000 7f4cca333800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 to cache LRU end 2024-03-09T14:41:52.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.123+0000 7f4cca333800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:52.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.123+0000 7f4cca333800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24, ofs0, ns] 2024-03-09T14:41:52.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.124+0000 7f4ba97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464353 cookie 94105161356208 notifier 6344 bl.length()=891 2024-03-09T14:41:52.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.124+0000 7f4ba97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 info.flags=0x17 2024-03-09T14:41:52.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.124+0000 7f4ba97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.24 to cache LRU end 2024-03-09T14:41:52.124 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.124+0000 7f4ba97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:52.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.125+0000 7f4cca333800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.24]): orig_sources= new_sources= 2024-03-09T14:41:52.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.125+0000 7f4cca333800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.24]): potential sources added=[] removed=[] 2024-03-09T14:41:52.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.125+0000 7f4cca333800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.24]): orig_dests= new_dests= 2024-03-09T14:41:52.125 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.125+0000 7f4cca333800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.24]): potential dests added=[] removed=[] 2024-03-09T14:41:52.127 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.128+0000 7f4cca333800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-03-09T14:41:52.129 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.130+0000 7f4b777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:52.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.132+0000 7f4cca333800 20 remove_watcher() i=0 2024-03-09T14:41:52.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.132+0000 7f4cca333800 2 removed watcher, disabling cache 2024-03-09T14:41:52.133 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.133+0000 7f4cca333800 20 remove_watcher() i=1 2024-03-09T14:41:52.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.135+0000 7f4cca333800 20 remove_watcher() i=2 2024-03-09T14:41:52.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.136+0000 7f4cca333800 20 remove_watcher() i=3 2024-03-09T14:41:52.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.137+0000 7f4cca333800 20 remove_watcher() i=4 2024-03-09T14:41:52.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.138+0000 7f4cca333800 20 remove_watcher() i=5 2024-03-09T14:41:52.138 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.139+0000 7f4cca333800 20 remove_watcher() i=6 2024-03-09T14:41:52.139 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.140+0000 7f4cca333800 20 remove_watcher() i=7 2024-03-09T14:41:52.151 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-09T14:41:52.179 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:52.179 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:52.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.212+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.213+0000 7fb5b4342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:52.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.213+0000 7fb5b4342800 20 realm 2024-03-09T14:41:52.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.213+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.213+0000 7fb5b4342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:52.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.213+0000 7fb5b4342800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:52.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.214+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.214+0000 7fb5b4342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:52.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.214+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.214+0000 7fb5b4342800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:52.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.214+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.215+0000 7fb5b4342800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:52.215 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.215+0000 7fb5b4342800 20 searching for the correct realm 2024-03-09T14:41:52.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.217+0000 7fb5b0842640 0 -- 172.21.15.88:0/1451643281 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fb5a803a040 msgr2=0x7fb5a803a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:52.423 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.423+0000 7fb5af840640 0 -- 172.21.15.88:0/1451643281 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fb5a804c400 msgr2=0x7fb5a804c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:52.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.629+0000 7fb5b4342800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:52.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.629+0000 7fb5b4342800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:52.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.629+0000 7fb5b4342800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:52.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.629+0000 7fb5b4342800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:52.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.629+0000 7fb5b4342800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:52.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.629+0000 7fb5b4342800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:52.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.629+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.630+0000 7fb5b4342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:52.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.630+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.630+0000 7fb5b4342800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:52.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.630+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.630+0000 7fb5b4342800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:52.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.630+0000 7fb5b4342800 20 zone default found 2024-03-09T14:41:52.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.630+0000 7fb5b4342800 4 Realm: () 2024-03-09T14:41:52.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.630+0000 7fb5b4342800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:52.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.630+0000 7fb5b4342800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:52.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.630+0000 7fb5b4342800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:52.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.630+0000 7fb5b4342800 20 zonegroup default 2024-03-09T14:41:52.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.630+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.631+0000 7fb5b4342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:52.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.631+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.631+0000 7fb5b4342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:52.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.631+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.631+0000 7fb5b4342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:52.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.631+0000 7fb5b4342800 20 started sync module instance, tier type = 2024-03-09T14:41:52.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.631+0000 7fb5b4342800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:52.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.641+0000 7fb5b4342800 20 add_watcher() i=0 2024-03-09T14:41:52.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.641+0000 7fb5b4342800 20 add_watcher() i=1 2024-03-09T14:41:52.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.641+0000 7fb5b4342800 20 add_watcher() i=2 2024-03-09T14:41:52.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.641+0000 7fb5b4342800 20 add_watcher() i=3 2024-03-09T14:41:52.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.641+0000 7fb5b4342800 20 add_watcher() i=4 2024-03-09T14:41:52.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.641+0000 7fb5b4342800 20 add_watcher() i=5 2024-03-09T14:41:52.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.641+0000 7fb5b4342800 20 add_watcher() i=6 2024-03-09T14:41:52.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.642+0000 7fb5b4342800 20 add_watcher() i=7 2024-03-09T14:41:52.642 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.642+0000 7fb5b4342800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:52.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.644+0000 7fb466fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:52.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.644+0000 7fb5b4342800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:52.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.644+0000 7fb5b4342800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:52.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.644+0000 7fb5b4342800 5 note: GC not initialized 2024-03-09T14:41:52.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.645+0000 7fb465fdb640 20 reqs_thread_entry: start 2024-03-09T14:41:52.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.645+0000 7fb5b4342800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:52.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.645+0000 7fb5b4342800 20 Filter name: none 2024-03-09T14:41:52.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.645+0000 7fb3d77fe640 20 reqs_thread_entry: start 2024-03-09T14:41:52.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.645+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.645+0000 7fb5b4342800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:52.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.645+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.646+0000 7fb5b4342800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:41:52.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.646+0000 7fb5b4342800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:52.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.646+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.647+0000 7fb5b4342800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:52.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.647+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.647 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.647+0000 7fb5b4342800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:41:52.647 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.647+0000 7fb5b4342800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:52.647 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.648+0000 7fb5b4342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:52.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.648+0000 7fb5b4342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:52.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.649+0000 7fb466fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:52.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.651+0000 7fb5b4342800 20 remove_watcher() i=0 2024-03-09T14:41:52.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.651+0000 7fb5b4342800 2 removed watcher, disabling cache 2024-03-09T14:41:52.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.652+0000 7fb5b4342800 20 remove_watcher() i=1 2024-03-09T14:41:52.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.653+0000 7fb5b4342800 20 remove_watcher() i=2 2024-03-09T14:41:52.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.654+0000 7fb5b4342800 20 remove_watcher() i=3 2024-03-09T14:41:52.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.656+0000 7fb5b4342800 20 remove_watcher() i=4 2024-03-09T14:41:52.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.656+0000 7fb5b4342800 20 remove_watcher() i=5 2024-03-09T14:41:52.657 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.657+0000 7fb5b4342800 20 remove_watcher() i=6 2024-03-09T14:41:52.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:52.658+0000 7fb5b4342800 20 remove_watcher() i=7 2024-03-09T14:41:52.667 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:52.667 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:41:52.668 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-commit-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:41:52.668 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:52.991 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-03-09T14:41:52.991 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:53.726 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-09T14:41:53.752 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:53.752 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:53.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:53.785+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:53.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:53.787+0000 7fb4b4e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:53.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:53.787+0000 7fb4b4e30800 20 realm 2024-03-09T14:41:53.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:53.787+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:53.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:53.787+0000 7fb4b4e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:53.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:53.787+0000 7fb4b4e30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:53.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:53.787+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:53.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:53.787+0000 7fb4b4e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:53.787 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:53.787+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:53.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:53.788+0000 7fb4b4e30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:53.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:53.788+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:53.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:53.789+0000 7fb4b4e30800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:53.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:53.789+0000 7fb4b4e30800 20 searching for the correct realm 2024-03-09T14:41:53.790 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:53.791+0000 7fb4b0931640 0 -- 172.21.15.88:0/654991167 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fb4a80103e0 msgr2=0x7fb4a8010840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:53.997 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:53.998+0000 7fb4af92f640 0 -- 172.21.15.88:0/654991167 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fb4a8056960 msgr2=0x7fb4a80273d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:54.205 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.204+0000 7fb4b4e30800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:54.205 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.204+0000 7fb4b4e30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:54.205 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.204+0000 7fb4b4e30800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:54.205 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.204+0000 7fb4b4e30800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:54.205 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.204+0000 7fb4b4e30800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:54.205 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.204+0000 7fb4b4e30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:54.205 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.204+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.205 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.204+0000 7fb4b4e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:54.206 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.204+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.206 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.204+0000 7fb4b4e30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:54.206 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.204+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.207 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.205+0000 7fb4b4e30800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:54.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.205+0000 7fb4b4e30800 20 zone default found 2024-03-09T14:41:54.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.205+0000 7fb4b4e30800 4 Realm: () 2024-03-09T14:41:54.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.205+0000 7fb4b4e30800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:54.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.205+0000 7fb4b4e30800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:54.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.205+0000 7fb4b4e30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:54.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.205+0000 7fb4b4e30800 20 zonegroup default 2024-03-09T14:41:54.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.205+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.205+0000 7fb4b4e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:54.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.205+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.205+0000 7fb4b4e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:54.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.205+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.209 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.206+0000 7fb4b4e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:54.209 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.206+0000 7fb4b4e30800 20 started sync module instance, tier type = 2024-03-09T14:41:54.209 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.206+0000 7fb4b4e30800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:54.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.215+0000 7fb4b4e30800 20 add_watcher() i=0 2024-03-09T14:41:54.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.215+0000 7fb4b4e30800 20 add_watcher() i=1 2024-03-09T14:41:54.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.215+0000 7fb4b4e30800 20 add_watcher() i=2 2024-03-09T14:41:54.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.215+0000 7fb4b4e30800 20 add_watcher() i=3 2024-03-09T14:41:54.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.215+0000 7fb4b4e30800 20 add_watcher() i=4 2024-03-09T14:41:54.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.215+0000 7fb4b4e30800 20 add_watcher() i=5 2024-03-09T14:41:54.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.215+0000 7fb4b4e30800 20 add_watcher() i=6 2024-03-09T14:41:54.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.216+0000 7fb4b4e30800 20 add_watcher() i=7 2024-03-09T14:41:54.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.216+0000 7fb4b4e30800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:54.218 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.218+0000 7fb366fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:54.219 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.218+0000 7fb4b4e30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:54.219 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.218+0000 7fb4b4e30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:54.219 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.218+0000 7fb4b4e30800 5 note: GC not initialized 2024-03-09T14:41:54.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.218+0000 7fb365fdb640 20 reqs_thread_entry: start 2024-03-09T14:41:54.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.219+0000 7fb4b4e30800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:54.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.219+0000 7fb4b4e30800 20 Filter name: none 2024-03-09T14:41:54.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.219+0000 7fb2d77fe640 20 reqs_thread_entry: start 2024-03-09T14:41:54.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.219+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.219+0000 7fb4b4e30800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:54.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.219+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.220+0000 7fb4b4e30800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:41:54.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.220+0000 7fb4b4e30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:54.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.220+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.222 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.221+0000 7fb4b4e30800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:54.222 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.221+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.222 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.222+0000 7fb4b4e30800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:41:54.222 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.222+0000 7fb4b4e30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:54.223 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.223+0000 7fb4b4e30800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.223 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.223+0000 7fb4b4e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:54.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.224+0000 7fb366fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:54.226 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.226+0000 7fb4b4e30800 20 remove_watcher() i=0 2024-03-09T14:41:54.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.226+0000 7fb4b4e30800 2 removed watcher, disabling cache 2024-03-09T14:41:54.228 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.227+0000 7fb4b4e30800 20 remove_watcher() i=1 2024-03-09T14:41:54.229 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.228+0000 7fb4b4e30800 20 remove_watcher() i=2 2024-03-09T14:41:54.230 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.229+0000 7fb4b4e30800 20 remove_watcher() i=3 2024-03-09T14:41:54.231 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.230+0000 7fb4b4e30800 20 remove_watcher() i=4 2024-03-09T14:41:54.232 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.231+0000 7fb4b4e30800 20 remove_watcher() i=5 2024-03-09T14:41:54.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.232+0000 7fb4b4e30800 20 remove_watcher() i=6 2024-03-09T14:41:54.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.233+0000 7fb4b4e30800 20 remove_watcher() i=7 2024-03-09T14:41:54.243 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:54.243 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:41:54.244 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-commit-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:41:54.244 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:54.245 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-03-09T14:41:54.279 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:54.279 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:54.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.313+0000 7f72c3133800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.314+0000 7f72c3133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:54.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.314+0000 7f72c3133800 20 realm 2024-03-09T14:41:54.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.314+0000 7f72c3133800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.314+0000 7f72c3133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:54.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.314+0000 7f72c3133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:54.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.314+0000 7f72c3133800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.314+0000 7f72c3133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:54.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.314+0000 7f72c3133800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.315+0000 7f72c3133800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:54.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.315+0000 7f72c3133800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.316+0000 7f72c3133800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:54.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.316+0000 7f72c3133800 20 searching for the correct realm 2024-03-09T14:41:54.318 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.318+0000 7f72bf665640 0 -- 172.21.15.88:0/3256788396 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f72b803e630 msgr2=0x7f72b803eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:54.323 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.323+0000 7f72b7fff640 0 -- 172.21.15.88:0/3256788396 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f72b804c910 msgr2=0x7f72b8019440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:54.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.529+0000 7f72c3133800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:54.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.529+0000 7f72c3133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:54.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.529+0000 7f72c3133800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:54.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.529+0000 7f72c3133800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:54.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.529+0000 7f72c3133800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:54.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.529+0000 7f72c3133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:54.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.529+0000 7f72c3133800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.529+0000 7f72c3133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:54.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.529+0000 7f72c3133800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.530+0000 7f72c3133800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:54.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.530+0000 7f72c3133800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.530+0000 7f72c3133800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:54.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.530+0000 7f72c3133800 20 zone default found 2024-03-09T14:41:54.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.530+0000 7f72c3133800 4 Realm: () 2024-03-09T14:41:54.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.530+0000 7f72c3133800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:54.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.530+0000 7f72c3133800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:54.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.530+0000 7f72c3133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:54.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.530+0000 7f72c3133800 20 zonegroup default 2024-03-09T14:41:54.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.530+0000 7f72c3133800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.530+0000 7f72c3133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:54.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.530+0000 7f72c3133800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.531+0000 7f72c3133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:54.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.531+0000 7f72c3133800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.531+0000 7f72c3133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:54.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.531+0000 7f72c3133800 20 started sync module instance, tier type = 2024-03-09T14:41:54.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.531+0000 7f72c3133800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:54.541 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.540+0000 7f72c3133800 20 add_watcher() i=0 2024-03-09T14:41:54.541 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.540+0000 7f72c3133800 20 add_watcher() i=1 2024-03-09T14:41:54.541 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.540+0000 7f72c3133800 20 add_watcher() i=2 2024-03-09T14:41:54.541 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.540+0000 7f72c3133800 20 add_watcher() i=3 2024-03-09T14:41:54.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.540+0000 7f72c3133800 20 add_watcher() i=4 2024-03-09T14:41:54.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.540+0000 7f72c3133800 20 add_watcher() i=5 2024-03-09T14:41:54.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.540+0000 7f72c3133800 20 add_watcher() i=6 2024-03-09T14:41:54.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.541+0000 7f72c3133800 20 add_watcher() i=7 2024-03-09T14:41:54.542 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.541+0000 7f72c3133800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:54.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.543+0000 7f71757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:54.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.544+0000 7f72c3133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:54.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.544+0000 7f72c3133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:54.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.544+0000 7f72c3133800 5 note: GC not initialized 2024-03-09T14:41:54.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.544+0000 7f70effff640 20 reqs_thread_entry: start 2024-03-09T14:41:54.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.544+0000 7f72c3133800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:54.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.544+0000 7f72c3133800 20 Filter name: none 2024-03-09T14:41:54.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.544+0000 7f70edffb640 20 reqs_thread_entry: start 2024-03-09T14:41:54.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.544+0000 7f72c3133800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-03-09T14:41:54.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.544+0000 7f72c3133800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.545+0000 7f72c3133800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:54.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.545+0000 7f72c3133800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-03-09T14:41:54.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.545+0000 7f72c3133800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-03-09T14:41:54.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.545+0000 7f72c3133800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25 : miss 2024-03-09T14:41:54.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.545+0000 7f72c3133800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.545+0000 7f72c3133800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:41:54.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.545+0000 7f72c3133800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25 info.flags=0x17 2024-03-09T14:41:54.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.545+0000 7f72c3133800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25 to cache LRU end 2024-03-09T14:41:54.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.545+0000 7f72c3133800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:54.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.545+0000 7f72c3133800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:54.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.545+0000 7f72c3133800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25 2024-03-09T14:41:54.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.551+0000 7f72c3133800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25 info.flags=0x17 2024-03-09T14:41:54.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.551+0000 7f72c3133800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25 to cache LRU end 2024-03-09T14:41:54.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.551+0000 7f72c3133800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:54.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.551+0000 7f72c3133800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25, ofs0, ns] 2024-03-09T14:41:54.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.551+0000 7f71a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464358 cookie 94540935018208 notifier 6395 bl.length()=923 2024-03-09T14:41:54.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.551+0000 7f71a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25 info.flags=0x17 2024-03-09T14:41:54.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.551+0000 7f71a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25 to cache LRU end 2024-03-09T14:41:54.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.551+0000 7f71a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:54.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.553+0000 7f72c3133800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.25]): orig_sources= new_sources= 2024-03-09T14:41:54.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.553+0000 7f72c3133800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.25]): potential sources added=[] removed=[] 2024-03-09T14:41:54.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.553+0000 7f72c3133800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.25]): orig_dests= new_dests= 2024-03-09T14:41:54.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.553+0000 7f72c3133800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.25]): potential dests added=[] removed=[] 2024-03-09T14:41:54.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.0 2024-03-09T14:41:54.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.0 2024-03-09T14:41:54.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.1 2024-03-09T14:41:54.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.1 2024-03-09T14:41:54.556 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.2 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.2 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.3 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.3 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.4 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.4 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.5 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.5 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.6 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.6 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.7 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.7 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.8 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.8 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.9 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.9 2024-03-09T14:41:54.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.10 2024-03-09T14:41:54.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.10 2024-03-09T14:41:54.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.11 2024-03-09T14:41:54.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1.11 2024-03-09T14:41:54.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.555+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.0 2024-03-09T14:41:54.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.556+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.1 2024-03-09T14:41:54.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.556+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.2 2024-03-09T14:41:54.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.557+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.3 2024-03-09T14:41:54.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.557+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.4 2024-03-09T14:41:54.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.557+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.5 2024-03-09T14:41:54.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.558+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.6 2024-03-09T14:41:54.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.558+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.7 2024-03-09T14:41:54.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.559+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.8 2024-03-09T14:41:54.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.559+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.9 2024-03-09T14:41:54.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.560+0000 7f72c3133800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.25.10 2024-03-09T14:41:54.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.565+0000 7f72c3133800 -1 Injecting error=-125 at location=commit_target_layout 2024-03-09T14:41:54.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.565+0000 7f72c3133800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25 : hit (requested=0x17, cached=0x17) 2024-03-09T14:41:54.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.565+0000 7f72c3133800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25 2024-03-09T14:41:54.567 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.566+0000 7f72c3133800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25 info.flags=0x17 2024-03-09T14:41:54.567 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.566+0000 7f72c3133800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25 to cache LRU end 2024-03-09T14:41:54.567 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.566+0000 7f72c3133800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:54.567 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.566+0000 7f72c3133800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25, ofs0, ns] 2024-03-09T14:41:54.567 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.567+0000 7f71a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464359 cookie 94540935018208 notifier 6395 bl.length()=891 2024-03-09T14:41:54.568 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.567+0000 7f71a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25 info.flags=0x17 2024-03-09T14:41:54.568 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.567+0000 7f71a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.25 to cache LRU end 2024-03-09T14:41:54.568 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.567+0000 7f71a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:54.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.568+0000 7f72c3133800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.25]): orig_sources= new_sources= 2024-03-09T14:41:54.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.568+0000 7f72c3133800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.25]): potential sources added=[] removed=[] 2024-03-09T14:41:54.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.568+0000 7f72c3133800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.25]): orig_dests= new_dests= 2024-03-09T14:41:54.569 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.568+0000 7f72c3133800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.25]): potential dests added=[] removed=[] 2024-03-09T14:41:54.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.570+0000 7f72c3133800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-03-09T14:41:54.573 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.572+0000 7f71757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:54.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.574+0000 7f72c3133800 20 remove_watcher() i=0 2024-03-09T14:41:54.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.574+0000 7f72c3133800 2 removed watcher, disabling cache 2024-03-09T14:41:54.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.575+0000 7f72c3133800 20 remove_watcher() i=1 2024-03-09T14:41:54.577 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.577+0000 7f72c3133800 20 remove_watcher() i=2 2024-03-09T14:41:54.578 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.578+0000 7f72c3133800 20 remove_watcher() i=3 2024-03-09T14:41:54.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.579+0000 7f72c3133800 20 remove_watcher() i=4 2024-03-09T14:41:54.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.580+0000 7f72c3133800 20 remove_watcher() i=5 2024-03-09T14:41:54.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.581+0000 7f72c3133800 20 remove_watcher() i=6 2024-03-09T14:41:54.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.582+0000 7f72c3133800 20 remove_watcher() i=7 2024-03-09T14:41:54.593 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-09T14:41:54.620 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:54.620 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:54.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.655+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.657+0000 7fd40282d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:54.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.657+0000 7fd40282d800 20 realm 2024-03-09T14:41:54.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.657+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.657+0000 7fd40282d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:54.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.657+0000 7fd40282d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:54.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.657+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.658 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.657+0000 7fd40282d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:54.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.657+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.658+0000 7fd40282d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:54.659 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.658+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:54.660 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.658+0000 7fd40282d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:54.660 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.658+0000 7fd40282d800 20 searching for the correct realm 2024-03-09T14:41:54.661 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.660+0000 7fd3fe2da640 0 -- 172.21.15.88:0/2638014445 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fd3f8068250 msgr2=0x7fd3f80800d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:54.867 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:54.866+0000 7fd3f52d8640 0 -- 172.21.15.88:0/2638014445 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fd3f806b0c0 msgr2=0x7fd3f8042510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:55.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.073+0000 7fd40282d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:55.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.073+0000 7fd40282d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:55.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.073+0000 7fd40282d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:55.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.073+0000 7fd40282d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:55.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.073+0000 7fd40282d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:55.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.073+0000 7fd40282d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:55.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.073+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:55.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.073+0000 7fd40282d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:55.074 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.073+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:55.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.074+0000 7fd40282d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:55.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.074+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:55.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.074+0000 7fd40282d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:55.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.074+0000 7fd40282d800 20 zone default found 2024-03-09T14:41:55.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.074+0000 7fd40282d800 4 Realm: () 2024-03-09T14:41:55.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.074+0000 7fd40282d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:55.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.074+0000 7fd40282d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:55.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.074+0000 7fd40282d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:55.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.074+0000 7fd40282d800 20 zonegroup default 2024-03-09T14:41:55.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.074+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:55.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.074+0000 7fd40282d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:55.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.074+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:55.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.075+0000 7fd40282d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:55.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.075+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:55.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.075+0000 7fd40282d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:55.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.075+0000 7fd40282d800 20 started sync module instance, tier type = 2024-03-09T14:41:55.077 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.075+0000 7fd40282d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:55.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.084+0000 7fd40282d800 20 add_watcher() i=0 2024-03-09T14:41:55.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.084+0000 7fd40282d800 20 add_watcher() i=1 2024-03-09T14:41:55.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.084+0000 7fd40282d800 20 add_watcher() i=2 2024-03-09T14:41:55.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.084+0000 7fd40282d800 20 add_watcher() i=3 2024-03-09T14:41:55.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.084+0000 7fd40282d800 20 add_watcher() i=4 2024-03-09T14:41:55.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.084+0000 7fd40282d800 20 add_watcher() i=5 2024-03-09T14:41:55.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.084+0000 7fd40282d800 20 add_watcher() i=6 2024-03-09T14:41:55.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.085+0000 7fd40282d800 20 add_watcher() i=7 2024-03-09T14:41:55.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.085+0000 7fd40282d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:55.088 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.087+0000 7fd2af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:55.090 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.088+0000 7fd40282d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:55.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.088+0000 7fd40282d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:55.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.088+0000 7fd40282d800 5 note: GC not initialized 2024-03-09T14:41:55.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.088+0000 7fd2ae7fc640 20 reqs_thread_entry: start 2024-03-09T14:41:55.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.088+0000 7fd40282d800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:55.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.088+0000 7fd40282d800 20 Filter name: none 2024-03-09T14:41:55.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.088+0000 7fd21ffff640 20 reqs_thread_entry: start 2024-03-09T14:41:55.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.088+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:55.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.089+0000 7fd40282d800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:55.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.089+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:55.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.089+0000 7fd40282d800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:41:55.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.089+0000 7fd40282d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:55.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.089+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:55.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.089+0000 7fd40282d800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:55.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.090+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:55.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.090+0000 7fd40282d800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:41:55.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.090+0000 7fd40282d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:55.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.091+0000 7fd40282d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:55.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.091+0000 7fd40282d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:55.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.092+0000 7fd2af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:55.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.094+0000 7fd40282d800 20 remove_watcher() i=0 2024-03-09T14:41:55.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.094+0000 7fd40282d800 2 removed watcher, disabling cache 2024-03-09T14:41:55.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.095+0000 7fd40282d800 20 remove_watcher() i=1 2024-03-09T14:41:55.097 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.096+0000 7fd40282d800 20 remove_watcher() i=2 2024-03-09T14:41:55.098 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.097+0000 7fd40282d800 20 remove_watcher() i=3 2024-03-09T14:41:55.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.098+0000 7fd40282d800 20 remove_watcher() i=4 2024-03-09T14:41:55.100 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.099+0000 7fd40282d800 20 remove_watcher() i=5 2024-03-09T14:41:55.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.100+0000 7fd40282d800 20 remove_watcher() i=6 2024-03-09T14:41:55.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:55.101+0000 7fd40282d800 20 remove_watcher() i=7 2024-03-09T14:41:55.111 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:55.112 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:41:55.112 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-commit-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.25 num_objects: 20 size_kb: 1 num_shards: 12 2024-03-09T14:41:55.112 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:55.443 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-03-09T14:41:55.443 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:56.214 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-03-09T14:41:56.240 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:56.241 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:56.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.272+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.274+0000 7f4db4baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:56.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.274+0000 7f4db4baf800 20 realm 2024-03-09T14:41:56.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.274+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.274+0000 7f4db4baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:56.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.274+0000 7f4db4baf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:56.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.274+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.274+0000 7f4db4baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:56.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.274+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.276 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.275+0000 7f4db4baf800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:56.276 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.275+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.276 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.276+0000 7f4db4baf800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:56.277 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.276+0000 7f4db4baf800 20 searching for the correct realm 2024-03-09T14:41:56.278 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.278+0000 7f4db2eac640 0 -- 172.21.15.88:0/2569310687 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f4dac080040 msgr2=0x7f4dac080420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:56.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.484+0000 7f4da9eaa640 0 -- 172.21.15.88:0/2569310687 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f4dac095930 msgr2=0x7f4dac0733f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:56.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.690+0000 7f4db4baf800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:56.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.690+0000 7f4db4baf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:56.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.690+0000 7f4db4baf800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:56.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.690+0000 7f4db4baf800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:56.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.690+0000 7f4db4baf800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:56.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.690+0000 7f4db4baf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:56.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.690+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.691+0000 7f4db4baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:56.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.691+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.691+0000 7f4db4baf800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:56.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.691+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.691+0000 7f4db4baf800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:56.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.691+0000 7f4db4baf800 20 zone default found 2024-03-09T14:41:56.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.691+0000 7f4db4baf800 4 Realm: () 2024-03-09T14:41:56.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.691+0000 7f4db4baf800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:56.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.691+0000 7f4db4baf800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:56.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.691+0000 7f4db4baf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:56.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.691+0000 7f4db4baf800 20 zonegroup default 2024-03-09T14:41:56.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.691+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.691+0000 7f4db4baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:56.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.692+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.692+0000 7f4db4baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:56.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.692+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.692+0000 7f4db4baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:56.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.692+0000 7f4db4baf800 20 started sync module instance, tier type = 2024-03-09T14:41:56.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.692+0000 7f4db4baf800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:56.702 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.702+0000 7f4db4baf800 20 add_watcher() i=0 2024-03-09T14:41:56.703 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.702+0000 7f4db4baf800 20 add_watcher() i=1 2024-03-09T14:41:56.703 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.702+0000 7f4db4baf800 20 add_watcher() i=2 2024-03-09T14:41:56.703 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.702+0000 7f4db4baf800 20 add_watcher() i=3 2024-03-09T14:41:56.703 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.702+0000 7f4db4baf800 20 add_watcher() i=4 2024-03-09T14:41:56.704 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.702+0000 7f4db4baf800 20 add_watcher() i=5 2024-03-09T14:41:56.704 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.702+0000 7f4db4baf800 20 add_watcher() i=6 2024-03-09T14:41:56.704 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.703+0000 7f4db4baf800 20 add_watcher() i=7 2024-03-09T14:41:56.704 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.703+0000 7f4db4baf800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:56.705 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.704+0000 7f4c68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:56.708 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.705+0000 7f4db4baf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:56.708 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.705+0000 7f4db4baf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:56.708 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.705+0000 7f4db4baf800 5 note: GC not initialized 2024-03-09T14:41:56.708 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.705+0000 7f4be37fe640 20 reqs_thread_entry: start 2024-03-09T14:41:56.708 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.705+0000 7f4db4baf800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:56.708 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.705+0000 7f4db4baf800 20 Filter name: none 2024-03-09T14:41:56.708 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.705+0000 7f4be17fa640 20 reqs_thread_entry: start 2024-03-09T14:41:56.708 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.705+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.709 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.706+0000 7f4db4baf800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:56.709 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.706+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.709 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.706+0000 7f4db4baf800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:41:56.709 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.706+0000 7f4db4baf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:56.710 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.706+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.710 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.706+0000 7f4db4baf800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:56.710 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.706+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.710 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.707+0000 7f4db4baf800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:41:56.710 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.707+0000 7f4db4baf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:56.711 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.708+0000 7f4db4baf800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.711 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.708+0000 7f4db4baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:56.711 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.709+0000 7f4c68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:56.712 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.711+0000 7f4db4baf800 20 remove_watcher() i=0 2024-03-09T14:41:56.712 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.711+0000 7f4db4baf800 2 removed watcher, disabling cache 2024-03-09T14:41:56.712 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.712+0000 7f4db4baf800 20 remove_watcher() i=1 2024-03-09T14:41:56.713 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.713+0000 7f4db4baf800 20 remove_watcher() i=2 2024-03-09T14:41:56.715 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.714+0000 7f4db4baf800 20 remove_watcher() i=3 2024-03-09T14:41:56.716 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.715+0000 7f4db4baf800 20 remove_watcher() i=4 2024-03-09T14:41:56.717 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.716+0000 7f4db4baf800 20 remove_watcher() i=5 2024-03-09T14:41:56.718 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.717+0000 7f4db4baf800 20 remove_watcher() i=6 2024-03-09T14:41:56.719 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.718+0000 7f4db4baf800 20 remove_watcher() i=7 2024-03-09T14:41:56.730 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:56.730 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:41:56.730 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: abort-at-commit-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:41:56.730 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:56.731 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-03-09T14:41:56.762 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:56.763 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:56.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.795+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:56.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.797+0000 7f84c909d800 20 realm 2024-03-09T14:41:56.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:56.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.797+0000 7f84c909d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:56.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:56.799 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.800 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.798+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:56.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.798+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:56.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.799+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:56.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.799+0000 7f84c909d800 20 searching for the correct realm 2024-03-09T14:41:56.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:56.800+0000 7f84c6398640 0 -- 172.21.15.88:0/2391042725 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f84b8032040 msgr2=0x7f84b8017410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:57.007 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.006+0000 7f84c739a640 0 -- 172.21.15.88:0/2391042725 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x560648250d70 msgr2=0x560648253160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:57.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:57.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:57.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:57.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:57.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:57.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:57.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:57.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:57.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 20 zone default found 2024-03-09T14:41:57.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 4 Realm: () 2024-03-09T14:41:57.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:57.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:57.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:57.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 20 zonegroup default 2024-03-09T14:41:57.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.014+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.014+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.014+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.014+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.014+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.014+0000 7f84c909d800 20 started sync module instance, tier type = 2024-03-09T14:41:57.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.014+0000 7f84c909d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:57.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=0 2024-03-09T14:41:57.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=1 2024-03-09T14:41:57.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=2 2024-03-09T14:41:57.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=3 2024-03-09T14:41:57.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=4 2024-03-09T14:41:57.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=5 2024-03-09T14:41:57.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=6 2024-03-09T14:41:57.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.025+0000 7f84c909d800 20 add_watcher() i=7 2024-03-09T14:41:57.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.025+0000 7f84c909d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:57.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.026+0000 7f8378ff9640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:57.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.027+0000 7f84c909d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:57.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.027+0000 7f84c909d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:57.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.027+0000 7f84c909d800 5 note: GC not initialized 2024-03-09T14:41:57.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.027+0000 7f82f37fe640 20 reqs_thread_entry: start 2024-03-09T14:41:57.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.027+0000 7f84c909d800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:57.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.027+0000 7f84c909d800 20 Filter name: none 2024-03-09T14:41:57.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.027+0000 7f82f17fa640 20 reqs_thread_entry: start 2024-03-09T14:41:57.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.027+0000 7f84c909d800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-09T14:41:57.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.027+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.028+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:57.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.028+0000 7f84c909d800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-09T14:41:57.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.028+0000 7f84c909d800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-09T14:41:57.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.028+0000 7f84c909d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 : miss 2024-03-09T14:41:57.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.028+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.028+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:41:57.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.028+0000 7f84c909d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 info.flags=0x17 2024-03-09T14:41:57.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.028+0000 7f84c909d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 to cache LRU end 2024-03-09T14:41:57.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.028+0000 7f84c909d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:57.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.028+0000 7f84c909d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:57.030 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.028+0000 7f84c909d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 2024-03-09T14:41:57.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.033+0000 7f84c909d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 info.flags=0x17 2024-03-09T14:41:57.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.033+0000 7f84c909d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 to cache LRU end 2024-03-09T14:41:57.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.033+0000 7f84c909d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:57.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.033+0000 7f84c909d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26, ofs0, ns] 2024-03-09T14:41:57.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.034+0000 7f83a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464290 cookie 94584980216064 notifier 6756 bl.length()=923 2024-03-09T14:41:57.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.034+0000 7f83a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 info.flags=0x17 2024-03-09T14:41:57.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.034+0000 7f83a9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 to cache LRU end 2024-03-09T14:41:57.035 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.034+0000 7f83a9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:57.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.035+0000 7f84c909d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): orig_sources= new_sources= 2024-03-09T14:41:57.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.035+0000 7f84c909d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): potential sources added=[] removed=[] 2024-03-09T14:41:57.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.035+0000 7f84c909d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): orig_dests= new_dests= 2024-03-09T14:41:57.036 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.035+0000 7f84c909d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): potential dests added=[] removed=[] 2024-03-09T14:41:57.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.0 2024-03-09T14:41:57.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.0 2024-03-09T14:41:57.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.1 2024-03-09T14:41:57.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.1 2024-03-09T14:41:57.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.2 2024-03-09T14:41:57.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.2 2024-03-09T14:41:57.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.3 2024-03-09T14:41:57.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.3 2024-03-09T14:41:57.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.4 2024-03-09T14:41:57.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.4 2024-03-09T14:41:57.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.5 2024-03-09T14:41:57.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.5 2024-03-09T14:41:57.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.6 2024-03-09T14:41:57.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.6 2024-03-09T14:41:57.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.7 2024-03-09T14:41:57.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.7 2024-03-09T14:41:57.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.8 2024-03-09T14:41:57.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.8 2024-03-09T14:41:57.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.9 2024-03-09T14:41:57.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.9 2024-03-09T14:41:57.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.10 2024-03-09T14:41:57.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.10 2024-03-09T14:41:57.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.11 2024-03-09T14:41:57.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.11 2024-03-09T14:41:57.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.0 2024-03-09T14:41:57.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.039+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1 2024-03-09T14:41:57.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.039+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.2 2024-03-09T14:41:57.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.040+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.3 2024-03-09T14:41:57.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.040+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.4 2024-03-09T14:41:57.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.041+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.5 2024-03-09T14:41:57.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.041+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.6 2024-03-09T14:41:57.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.042+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.7 2024-03-09T14:41:57.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.042+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.8 2024-03-09T14:41:57.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.042+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.9 2024-03-09T14:41:57.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.043+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.10 2024-03-09T14:41:57.047 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84c909d800 time 2024-03-09T14:41:57.048218+0000 2024-03-09T14:41:57.047 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:41:57.048 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:57.048 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84cc380e86] 2024-03-09T14:41:57.048 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f84cc381044] 2024-03-09T14:41:57.048 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56064699df91] 2024-03-09T14:41:57.048 INFO:tasks.workunit.client.0.smithi088.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5606469b9178] 2024-03-09T14:41:57.048 INFO:tasks.workunit.client.0.smithi088.stderr: 5: main() 2024-03-09T14:41:57.048 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f84cb23feb0] 2024-03-09T14:41:57.048 INFO:tasks.workunit.client.0.smithi088.stderr: 7: __libc_start_main() 2024-03-09T14:41:57.048 INFO:tasks.workunit.client.0.smithi088.stderr: 8: _start() 2024-03-09T14:41:57.049 INFO:tasks.workunit.client.0.smithi088.stderr:*** Caught signal (Aborted) ** 2024-03-09T14:41:57.049 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7f84c909d800 thread_name:radosgw-admin 2024-03-09T14:41:57.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.047+0000 7f84c909d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84c909d800 time 2024-03-09T14:41:57.048218+0000 2024-03-09T14:41:57.049 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:41:57.049 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.049 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:57.049 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84cc380e86] 2024-03-09T14:41:57.049 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f84cc381044] 2024-03-09T14:41:57.049 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56064699df91] 2024-03-09T14:41:57.049 INFO:tasks.workunit.client.0.smithi088.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5606469b9178] 2024-03-09T14:41:57.049 INFO:tasks.workunit.client.0.smithi088.stderr: 5: main() 2024-03-09T14:41:57.049 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f84cb23feb0] 2024-03-09T14:41:57.049 INFO:tasks.workunit.client.0.smithi088.stderr: 7: __libc_start_main() 2024-03-09T14:41:57.049 INFO:tasks.workunit.client.0.smithi088.stderr: 8: _start() 2024-03-09T14:41:57.050 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.071 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:57.071 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f84cb254db0] 2024-03-09T14:41:57.071 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f84cb2a154c] 2024-03-09T14:41:57.071 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:41:57.071 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:41:57.071 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84cc380ee0] 2024-03-09T14:41:57.072 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f84cc381044] 2024-03-09T14:41:57.072 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56064699df91] 2024-03-09T14:41:57.072 INFO:tasks.workunit.client.0.smithi088.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5606469b9178] 2024-03-09T14:41:57.072 INFO:tasks.workunit.client.0.smithi088.stderr: 9: main() 2024-03-09T14:41:57.072 INFO:tasks.workunit.client.0.smithi088.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f84cb23feb0] 2024-03-09T14:41:57.072 INFO:tasks.workunit.client.0.smithi088.stderr: 11: __libc_start_main() 2024-03-09T14:41:57.072 INFO:tasks.workunit.client.0.smithi088.stderr: 12: _start() 2024-03-09T14:41:57.072 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.048+0000 7f84c909d800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:41:57.072 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7f84c909d800 thread_name:radosgw-admin 2024-03-09T14:41:57.072 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.072 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:57.072 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f84cb254db0] 2024-03-09T14:41:57.072 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f84cb2a154c] 2024-03-09T14:41:57.072 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:41:57.073 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:41:57.073 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84cc380ee0] 2024-03-09T14:41:57.073 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f84cc381044] 2024-03-09T14:41:57.073 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56064699df91] 2024-03-09T14:41:57.073 INFO:tasks.workunit.client.0.smithi088.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5606469b9178] 2024-03-09T14:41:57.073 INFO:tasks.workunit.client.0.smithi088.stderr: 9: main() 2024-03-09T14:41:57.073 INFO:tasks.workunit.client.0.smithi088.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f84cb23feb0] 2024-03-09T14:41:57.073 INFO:tasks.workunit.client.0.smithi088.stderr: 11: __libc_start_main() 2024-03-09T14:41:57.073 INFO:tasks.workunit.client.0.smithi088.stderr: 12: _start() 2024-03-09T14:41:57.073 INFO:tasks.workunit.client.0.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:41:57.073 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.073 INFO:tasks.workunit.client.0.smithi088.stderr:--- begin dump of recent events --- 2024-03-09T14:41:57.073 INFO:tasks.workunit.client.0.smithi088.stderr: -499> 2024-03-09T14:41:56.781+0000 7f84c6b99640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.073 INFO:tasks.workunit.client.0.smithi088.stderr: -498> 2024-03-09T14:41:56.781+0000 7f84c6398640 10 monclient(hunting): handle_auth_done global_id 6747 payload 824 2024-03-09T14:41:57.073 INFO:tasks.workunit.client.0.smithi088.stderr: -497> 2024-03-09T14:41:56.781+0000 7f84c6398640 10 monclient: _finish_hunting 0 2024-03-09T14:41:57.074 INFO:tasks.workunit.client.0.smithi088.stderr: -496> 2024-03-09T14:41:56.781+0000 7f84c6398640 1 monclient: found mon.noname-a 2024-03-09T14:41:57.074 INFO:tasks.workunit.client.0.smithi088.stderr: -495> 2024-03-09T14:41:56.781+0000 7f84c6398640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.074 INFO:tasks.workunit.client.0.smithi088.stderr: -494> 2024-03-09T14:41:56.781+0000 7f83b3606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.074 INFO:tasks.workunit.client.0.smithi088.stderr: -493> 2024-03-09T14:41:56.781+0000 7f83b3606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:41:57.074 INFO:tasks.workunit.client.0.smithi088.stderr: -492> 2024-03-09T14:41:56.781+0000 7f83b3606640 10 monclient: dump: 2024-03-09T14:41:57.074 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.074 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.074 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.074 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.074 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.074 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.074 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.074 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.074 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.075 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.075 INFO:tasks.workunit.client.0.smithi088.stderr: -491> 2024-03-09T14:41:56.781+0000 7f83b3606640 10 monclient: _finish_auth 0 2024-03-09T14:41:57.075 INFO:tasks.workunit.client.0.smithi088.stderr: -490> 2024-03-09T14:41:56.781+0000 7f83b3606640 10 monclient: _check_auth_tickets 2024-03-09T14:41:57.075 INFO:tasks.workunit.client.0.smithi088.stderr: -489> 2024-03-09T14:41:56.782+0000 7f83b3606640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:57.075 INFO:tasks.workunit.client.0.smithi088.stderr: -488> 2024-03-09T14:41:56.782+0000 7f83b3606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.075 INFO:tasks.workunit.client.0.smithi088.stderr: -487> 2024-03-09T14:41:56.782+0000 7f83b3606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:41:57.075 INFO:tasks.workunit.client.0.smithi088.stderr: -486> 2024-03-09T14:41:56.782+0000 7f83b3606640 10 monclient: dump: 2024-03-09T14:41:57.075 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.075 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.075 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.075 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.075 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.075 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.075 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.075 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.076 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.076 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.076 INFO:tasks.workunit.client.0.smithi088.stderr: -485> 2024-03-09T14:41:56.782+0000 7f84c909d800 5 monclient: authenticate success, global_id 6747 2024-03-09T14:41:57.076 INFO:tasks.workunit.client.0.smithi088.stderr: -484> 2024-03-09T14:41:56.782+0000 7f84c909d800 10 monclient: _renew_subs 2024-03-09T14:41:57.076 INFO:tasks.workunit.client.0.smithi088.stderr: -483> 2024-03-09T14:41:56.782+0000 7f83b4e09640 4 set_mon_vals no callback set 2024-03-09T14:41:57.076 INFO:tasks.workunit.client.0.smithi088.stderr: -482> 2024-03-09T14:41:56.782+0000 7f84c909d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.076 INFO:tasks.workunit.client.0.smithi088.stderr: -481> 2024-03-09T14:41:56.782+0000 7f84c909d800 10 monclient: _renew_subs 2024-03-09T14:41:57.076 INFO:tasks.workunit.client.0.smithi088.stderr: -480> 2024-03-09T14:41:56.782+0000 7f84c909d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.076 INFO:tasks.workunit.client.0.smithi088.stderr: -479> 2024-03-09T14:41:56.782+0000 7f84c909d800 1 librados: init done 2024-03-09T14:41:57.076 INFO:tasks.workunit.client.0.smithi088.stderr: -478> 2024-03-09T14:41:56.783+0000 7f83b3606640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:41:57.076 INFO:tasks.workunit.client.0.smithi088.stderr: -477> 2024-03-09T14:41:56.783+0000 7f83b3606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:57.076 INFO:tasks.workunit.client.0.smithi088.stderr: -476> 2024-03-09T14:41:56.783+0000 7f83b3606640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:57.076 INFO:tasks.workunit.client.0.smithi088.stderr: -475> 2024-03-09T14:41:56.783+0000 7f84c6b99640 10 monclient: get_auth_request con 0x7f83ac06a5b0 auth_method 0 2024-03-09T14:41:57.076 INFO:tasks.workunit.client.0.smithi088.stderr: -474> 2024-03-09T14:41:56.784+0000 7f84c739a640 10 monclient: get_auth_request con 0x56064818e3e0 auth_method 0 2024-03-09T14:41:57.077 INFO:tasks.workunit.client.0.smithi088.stderr: -473> 2024-03-09T14:41:56.784+0000 7f84c6b99640 10 monclient: get_auth_request con 0x5606481ad250 auth_method 0 2024-03-09T14:41:57.077 INFO:tasks.workunit.client.0.smithi088.stderr: -472> 2024-03-09T14:41:56.785+0000 7f84c6398640 10 monclient: get_auth_request con 0x5606481b16c0 auth_method 0 2024-03-09T14:41:57.077 INFO:tasks.workunit.client.0.smithi088.stderr: -471> 2024-03-09T14:41:56.786+0000 7f84c739a640 10 monclient: get_auth_request con 0x5606481b0b40 auth_method 0 2024-03-09T14:41:57.077 INFO:tasks.workunit.client.0.smithi088.stderr: -470> 2024-03-09T14:41:56.787+0000 7f84c909d800 10 monclient: build_initial_monmap 2024-03-09T14:41:57.077 INFO:tasks.workunit.client.0.smithi088.stderr: -469> 2024-03-09T14:41:56.787+0000 7f84c909d800 1 build_initial for_mkfs: 0 2024-03-09T14:41:57.077 INFO:tasks.workunit.client.0.smithi088.stderr: -468> 2024-03-09T14:41:56.787+0000 7f84c909d800 10 monclient: monmap: 2024-03-09T14:41:57.077 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:41:57.077 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:41:57.077 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:41:57.077 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:41:57.077 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:41:57.077 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.077 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:41:57.077 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:41:57.078 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:41:57.078 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.078 INFO:tasks.workunit.client.0.smithi088.stderr: -467> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding auth protocol: cephx 2024-03-09T14:41:57.078 INFO:tasks.workunit.client.0.smithi088.stderr: -466> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding auth protocol: cephx 2024-03-09T14:41:57.078 INFO:tasks.workunit.client.0.smithi088.stderr: -465> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding auth protocol: cephx 2024-03-09T14:41:57.078 INFO:tasks.workunit.client.0.smithi088.stderr: -464> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: secure 2024-03-09T14:41:57.078 INFO:tasks.workunit.client.0.smithi088.stderr: -463> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: crc 2024-03-09T14:41:57.078 INFO:tasks.workunit.client.0.smithi088.stderr: -462> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: secure 2024-03-09T14:41:57.078 INFO:tasks.workunit.client.0.smithi088.stderr: -461> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: crc 2024-03-09T14:41:57.078 INFO:tasks.workunit.client.0.smithi088.stderr: -460> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: secure 2024-03-09T14:41:57.078 INFO:tasks.workunit.client.0.smithi088.stderr: -459> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: crc 2024-03-09T14:41:57.078 INFO:tasks.workunit.client.0.smithi088.stderr: -458> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: crc 2024-03-09T14:41:57.078 INFO:tasks.workunit.client.0.smithi088.stderr: -457> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: secure 2024-03-09T14:41:57.079 INFO:tasks.workunit.client.0.smithi088.stderr: -456> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: crc 2024-03-09T14:41:57.079 INFO:tasks.workunit.client.0.smithi088.stderr: -455> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: secure 2024-03-09T14:41:57.079 INFO:tasks.workunit.client.0.smithi088.stderr: -454> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: crc 2024-03-09T14:41:57.079 INFO:tasks.workunit.client.0.smithi088.stderr: -453> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: secure 2024-03-09T14:41:57.079 INFO:tasks.workunit.client.0.smithi088.stderr: -452> 2024-03-09T14:41:56.787+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.079 INFO:tasks.workunit.client.0.smithi088.stderr: -451> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 asok(0x560647f43780) register_command objecter_requests cmddesc objecter_requests hook 0x5606481befb0 EEXIST 2024-03-09T14:41:57.079 INFO:tasks.workunit.client.0.smithi088.stderr: -450> 2024-03-09T14:41:56.787+0000 7f84c909d800 10 monclient: init 2024-03-09T14:41:57.079 INFO:tasks.workunit.client.0.smithi088.stderr: -449> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding auth protocol: cephx 2024-03-09T14:41:57.079 INFO:tasks.workunit.client.0.smithi088.stderr: -448> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding auth protocol: cephx 2024-03-09T14:41:57.079 INFO:tasks.workunit.client.0.smithi088.stderr: -447> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding auth protocol: cephx 2024-03-09T14:41:57.079 INFO:tasks.workunit.client.0.smithi088.stderr: -446> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: secure 2024-03-09T14:41:57.079 INFO:tasks.workunit.client.0.smithi088.stderr: -445> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: crc 2024-03-09T14:41:57.079 INFO:tasks.workunit.client.0.smithi088.stderr: -444> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: secure 2024-03-09T14:41:57.079 INFO:tasks.workunit.client.0.smithi088.stderr: -443> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: crc 2024-03-09T14:41:57.079 INFO:tasks.workunit.client.0.smithi088.stderr: -442> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: secure 2024-03-09T14:41:57.080 INFO:tasks.workunit.client.0.smithi088.stderr: -441> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: crc 2024-03-09T14:41:57.080 INFO:tasks.workunit.client.0.smithi088.stderr: -440> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: crc 2024-03-09T14:41:57.080 INFO:tasks.workunit.client.0.smithi088.stderr: -439> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: secure 2024-03-09T14:41:57.080 INFO:tasks.workunit.client.0.smithi088.stderr: -438> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: crc 2024-03-09T14:41:57.080 INFO:tasks.workunit.client.0.smithi088.stderr: -437> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: secure 2024-03-09T14:41:57.080 INFO:tasks.workunit.client.0.smithi088.stderr: -436> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: crc 2024-03-09T14:41:57.080 INFO:tasks.workunit.client.0.smithi088.stderr: -435> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: secure 2024-03-09T14:41:57.080 INFO:tasks.workunit.client.0.smithi088.stderr: -434> 2024-03-09T14:41:56.787+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.080 INFO:tasks.workunit.client.0.smithi088.stderr: -433> 2024-03-09T14:41:56.787+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.080 INFO:tasks.workunit.client.0.smithi088.stderr: -432> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 asok(0x560647f43780) register_command rotate-key cmddesc rotate-key hook 0x5606481b8930 EEXIST 2024-03-09T14:41:57.080 INFO:tasks.workunit.client.0.smithi088.stderr: -431> 2024-03-09T14:41:56.787+0000 7f84c909d800 10 monclient: _reopen_session rank -1 2024-03-09T14:41:57.080 INFO:tasks.workunit.client.0.smithi088.stderr: -430> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:41:57.080 INFO:tasks.workunit.client.0.smithi088.stderr: -429> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-c con 0x5606481e3d10 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:57.080 INFO:tasks.workunit.client.0.smithi088.stderr: -428> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-b con 0x5606481e40f0 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:57.081 INFO:tasks.workunit.client.0.smithi088.stderr: -427> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-a con 0x5606481df1b0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:57.081 INFO:tasks.workunit.client.0.smithi088.stderr: -426> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.081 INFO:tasks.workunit.client.0.smithi088.stderr: -425> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.081 INFO:tasks.workunit.client.0.smithi088.stderr: -424> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.081 INFO:tasks.workunit.client.0.smithi088.stderr: -423> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): _renew_subs 2024-03-09T14:41:57.081 INFO:tasks.workunit.client.0.smithi088.stderr: -422> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): authenticate will time out at 1732.126315s 2024-03-09T14:41:57.081 INFO:tasks.workunit.client.0.smithi088.stderr: -421> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): get_auth_request con 0x5606481e3d10 auth_method 0 2024-03-09T14:41:57.081 INFO:tasks.workunit.client.0.smithi088.stderr: -420> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.081 INFO:tasks.workunit.client.0.smithi088.stderr: -419> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.081 INFO:tasks.workunit.client.0.smithi088.stderr: -418> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.081 INFO:tasks.workunit.client.0.smithi088.stderr: -417> 2024-03-09T14:41:56.788+0000 7f84c6b99640 10 monclient(hunting): get_auth_request con 0x5606481df1b0 auth_method 0 2024-03-09T14:41:57.081 INFO:tasks.workunit.client.0.smithi088.stderr: -416> 2024-03-09T14:41:56.788+0000 7f84c6b99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.081 INFO:tasks.workunit.client.0.smithi088.stderr: -415> 2024-03-09T14:41:56.788+0000 7f84c6b99640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.081 INFO:tasks.workunit.client.0.smithi088.stderr: -414> 2024-03-09T14:41:56.788+0000 7f84c6b99640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.081 INFO:tasks.workunit.client.0.smithi088.stderr: -413> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.082 INFO:tasks.workunit.client.0.smithi088.stderr: -412> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.082 INFO:tasks.workunit.client.0.smithi088.stderr: -411> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:57.082 INFO:tasks.workunit.client.0.smithi088.stderr: -410> 2024-03-09T14:41:56.788+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.082 INFO:tasks.workunit.client.0.smithi088.stderr: -409> 2024-03-09T14:41:56.788+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.082 INFO:tasks.workunit.client.0.smithi088.stderr: -408> 2024-03-09T14:41:56.788+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:57.082 INFO:tasks.workunit.client.0.smithi088.stderr: -407> 2024-03-09T14:41:56.788+0000 7f84c739a640 10 monclient(hunting): get_auth_request con 0x5606481e40f0 auth_method 0 2024-03-09T14:41:57.082 INFO:tasks.workunit.client.0.smithi088.stderr: -406> 2024-03-09T14:41:56.788+0000 7f84c739a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.082 INFO:tasks.workunit.client.0.smithi088.stderr: -405> 2024-03-09T14:41:56.788+0000 7f84c739a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.082 INFO:tasks.workunit.client.0.smithi088.stderr: -404> 2024-03-09T14:41:56.788+0000 7f84c739a640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.082 INFO:tasks.workunit.client.0.smithi088.stderr: -403> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): handle_auth_done global_id 6440 payload 824 2024-03-09T14:41:57.082 INFO:tasks.workunit.client.0.smithi088.stderr: -402> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient: _finish_hunting 0 2024-03-09T14:41:57.082 INFO:tasks.workunit.client.0.smithi088.stderr: -401> 2024-03-09T14:41:56.788+0000 7f84c6398640 1 monclient: found mon.noname-c 2024-03-09T14:41:57.082 INFO:tasks.workunit.client.0.smithi088.stderr: -400> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr: -399> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr: -398> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr: -397> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: dump: 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr: -396> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: _finish_auth 0 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr: -395> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: _check_auth_tickets 2024-03-09T14:41:57.083 INFO:tasks.workunit.client.0.smithi088.stderr: -394> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:57.084 INFO:tasks.workunit.client.0.smithi088.stderr: -393> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.084 INFO:tasks.workunit.client.0.smithi088.stderr: -392> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:41:57.084 INFO:tasks.workunit.client.0.smithi088.stderr: -391> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: dump: 2024-03-09T14:41:57.084 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.084 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.084 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.084 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.084 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.084 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.084 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.084 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.084 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.084 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.084 INFO:tasks.workunit.client.0.smithi088.stderr: -390> 2024-03-09T14:41:56.788+0000 7f84c909d800 5 monclient: authenticate success, global_id 6440 2024-03-09T14:41:57.085 INFO:tasks.workunit.client.0.smithi088.stderr: -389> 2024-03-09T14:41:56.788+0000 7f84c7b9b640 4 set_mon_vals no callback set 2024-03-09T14:41:57.085 INFO:tasks.workunit.client.0.smithi088.stderr: -388> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient: _renew_subs 2024-03-09T14:41:57.085 INFO:tasks.workunit.client.0.smithi088.stderr: -387> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:41:57.085 INFO:tasks.workunit.client.0.smithi088.stderr: -386> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient: _renew_subs 2024-03-09T14:41:57.085 INFO:tasks.workunit.client.0.smithi088.stderr: -385> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:41:57.085 INFO:tasks.workunit.client.0.smithi088.stderr: -384> 2024-03-09T14:41:56.790+0000 7f83b0e01640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:41:57.085 INFO:tasks.workunit.client.0.smithi088.stderr: -383> 2024-03-09T14:41:56.790+0000 7f83b0e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:57.085 INFO:tasks.workunit.client.0.smithi088.stderr: -382> 2024-03-09T14:41:56.790+0000 7f83b0e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:57.085 INFO:tasks.workunit.client.0.smithi088.stderr: -381> 2024-03-09T14:41:56.790+0000 7f84c739a640 10 monclient: get_auth_request con 0x7f83a006a4c0 auth_method 0 2024-03-09T14:41:57.085 INFO:tasks.workunit.client.0.smithi088.stderr: -380> 2024-03-09T14:41:56.790+0000 7f84c909d800 10 monclient: get_monmap_and_config 2024-03-09T14:41:57.085 INFO:tasks.workunit.client.0.smithi088.stderr: -379> 2024-03-09T14:41:56.790+0000 7f84c909d800 10 monclient: build_initial_monmap 2024-03-09T14:41:57.085 INFO:tasks.workunit.client.0.smithi088.stderr: -378> 2024-03-09T14:41:56.790+0000 7f84c909d800 1 build_initial for_mkfs: 0 2024-03-09T14:41:57.085 INFO:tasks.workunit.client.0.smithi088.stderr: -377> 2024-03-09T14:41:56.790+0000 7f84c909d800 10 monclient: monmap: 2024-03-09T14:41:57.085 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:41:57.086 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:41:57.086 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:41:57.086 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:41:57.086 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:41:57.086 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.086 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:41:57.086 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:41:57.086 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:41:57.086 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.086 INFO:tasks.workunit.client.0.smithi088.stderr: -376> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding auth protocol: cephx 2024-03-09T14:41:57.086 INFO:tasks.workunit.client.0.smithi088.stderr: -375> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding auth protocol: cephx 2024-03-09T14:41:57.086 INFO:tasks.workunit.client.0.smithi088.stderr: -374> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding auth protocol: cephx 2024-03-09T14:41:57.086 INFO:tasks.workunit.client.0.smithi088.stderr: -373> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.086 INFO:tasks.workunit.client.0.smithi088.stderr: -372> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.087 INFO:tasks.workunit.client.0.smithi088.stderr: -371> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.087 INFO:tasks.workunit.client.0.smithi088.stderr: -370> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.087 INFO:tasks.workunit.client.0.smithi088.stderr: -369> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.087 INFO:tasks.workunit.client.0.smithi088.stderr: -368> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.087 INFO:tasks.workunit.client.0.smithi088.stderr: -367> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.087 INFO:tasks.workunit.client.0.smithi088.stderr: -366> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.087 INFO:tasks.workunit.client.0.smithi088.stderr: -365> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.087 INFO:tasks.workunit.client.0.smithi088.stderr: -364> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.087 INFO:tasks.workunit.client.0.smithi088.stderr: -363> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.087 INFO:tasks.workunit.client.0.smithi088.stderr: -362> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.087 INFO:tasks.workunit.client.0.smithi088.stderr: -361> 2024-03-09T14:41:56.790+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.087 INFO:tasks.workunit.client.0.smithi088.stderr: -360> 2024-03-09T14:41:56.790+0000 7f84c909d800 10 monclient: init 2024-03-09T14:41:57.087 INFO:tasks.workunit.client.0.smithi088.stderr: -359> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding auth protocol: cephx 2024-03-09T14:41:57.087 INFO:tasks.workunit.client.0.smithi088.stderr: -358> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding auth protocol: cephx 2024-03-09T14:41:57.087 INFO:tasks.workunit.client.0.smithi088.stderr: -357> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding auth protocol: cephx 2024-03-09T14:41:57.088 INFO:tasks.workunit.client.0.smithi088.stderr: -356> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: secure 2024-03-09T14:41:57.088 INFO:tasks.workunit.client.0.smithi088.stderr: -355> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: crc 2024-03-09T14:41:57.088 INFO:tasks.workunit.client.0.smithi088.stderr: -354> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: secure 2024-03-09T14:41:57.088 INFO:tasks.workunit.client.0.smithi088.stderr: -353> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: crc 2024-03-09T14:41:57.088 INFO:tasks.workunit.client.0.smithi088.stderr: -352> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: secure 2024-03-09T14:41:57.088 INFO:tasks.workunit.client.0.smithi088.stderr: -351> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: crc 2024-03-09T14:41:57.088 INFO:tasks.workunit.client.0.smithi088.stderr: -350> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: crc 2024-03-09T14:41:57.088 INFO:tasks.workunit.client.0.smithi088.stderr: -349> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: secure 2024-03-09T14:41:57.088 INFO:tasks.workunit.client.0.smithi088.stderr: -348> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: crc 2024-03-09T14:41:57.088 INFO:tasks.workunit.client.0.smithi088.stderr: -347> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: secure 2024-03-09T14:41:57.088 INFO:tasks.workunit.client.0.smithi088.stderr: -346> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: crc 2024-03-09T14:41:57.088 INFO:tasks.workunit.client.0.smithi088.stderr: -345> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: secure 2024-03-09T14:41:57.088 INFO:tasks.workunit.client.0.smithi088.stderr: -344> 2024-03-09T14:41:56.791+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.088 INFO:tasks.workunit.client.0.smithi088.stderr: -343> 2024-03-09T14:41:56.791+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.089 INFO:tasks.workunit.client.0.smithi088.stderr: -342> 2024-03-09T14:41:56.791+0000 7f84c909d800 5 asok(0x560647f43780) register_command rotate-key cmddesc rotate-key hook 0x7ffccd0199a8 EEXIST 2024-03-09T14:41:57.089 INFO:tasks.workunit.client.0.smithi088.stderr: -341> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient: _reopen_session rank -1 2024-03-09T14:41:57.089 INFO:tasks.workunit.client.0.smithi088.stderr: -340> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:41:57.089 INFO:tasks.workunit.client.0.smithi088.stderr: -339> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-b con 0x560648236000 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:57.089 INFO:tasks.workunit.client.0.smithi088.stderr: -338> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-a con 0x5606482363e0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:57.089 INFO:tasks.workunit.client.0.smithi088.stderr: -337> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-c con 0x560648231eb0 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:57.089 INFO:tasks.workunit.client.0.smithi088.stderr: -336> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.089 INFO:tasks.workunit.client.0.smithi088.stderr: -335> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.089 INFO:tasks.workunit.client.0.smithi088.stderr: -334> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.089 INFO:tasks.workunit.client.0.smithi088.stderr: -333> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): _renew_subs 2024-03-09T14:41:57.089 INFO:tasks.workunit.client.0.smithi088.stderr: -332> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): authenticate will time out at 1732.129567s 2024-03-09T14:41:57.089 INFO:tasks.workunit.client.0.smithi088.stderr: -331> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): get_auth_request con 0x5606482363e0 auth_method 0 2024-03-09T14:41:57.089 INFO:tasks.workunit.client.0.smithi088.stderr: -330> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.089 INFO:tasks.workunit.client.0.smithi088.stderr: -329> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.090 INFO:tasks.workunit.client.0.smithi088.stderr: -328> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.090 INFO:tasks.workunit.client.0.smithi088.stderr: -327> 2024-03-09T14:41:56.791+0000 7f84c6b99640 10 monclient(hunting): get_auth_request con 0x560648231eb0 auth_method 0 2024-03-09T14:41:57.090 INFO:tasks.workunit.client.0.smithi088.stderr: -326> 2024-03-09T14:41:56.791+0000 7f84c6b99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.090 INFO:tasks.workunit.client.0.smithi088.stderr: -325> 2024-03-09T14:41:56.791+0000 7f84c6b99640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.090 INFO:tasks.workunit.client.0.smithi088.stderr: -324> 2024-03-09T14:41:56.791+0000 7f84c6b99640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.090 INFO:tasks.workunit.client.0.smithi088.stderr: -323> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.090 INFO:tasks.workunit.client.0.smithi088.stderr: -322> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.090 INFO:tasks.workunit.client.0.smithi088.stderr: -321> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:57.090 INFO:tasks.workunit.client.0.smithi088.stderr: -320> 2024-03-09T14:41:56.791+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.090 INFO:tasks.workunit.client.0.smithi088.stderr: -319> 2024-03-09T14:41:56.791+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.090 INFO:tasks.workunit.client.0.smithi088.stderr: -318> 2024-03-09T14:41:56.791+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:57.090 INFO:tasks.workunit.client.0.smithi088.stderr: -317> 2024-03-09T14:41:56.791+0000 7f84c6398640 10 monclient(hunting): get_auth_request con 0x560648236000 auth_method 0 2024-03-09T14:41:57.091 INFO:tasks.workunit.client.0.smithi088.stderr: -316> 2024-03-09T14:41:56.791+0000 7f84c6398640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.091 INFO:tasks.workunit.client.0.smithi088.stderr: -315> 2024-03-09T14:41:56.791+0000 7f84c6398640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.091 INFO:tasks.workunit.client.0.smithi088.stderr: -314> 2024-03-09T14:41:56.791+0000 7f84c6398640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.091 INFO:tasks.workunit.client.0.smithi088.stderr: -313> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): handle_auth_done global_id 6753 payload 274 2024-03-09T14:41:57.091 INFO:tasks.workunit.client.0.smithi088.stderr: -312> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient: _finish_hunting 0 2024-03-09T14:41:57.091 INFO:tasks.workunit.client.0.smithi088.stderr: -311> 2024-03-09T14:41:56.791+0000 7f84c739a640 1 monclient: found mon.noname-a 2024-03-09T14:41:57.091 INFO:tasks.workunit.client.0.smithi088.stderr: -310> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.091 INFO:tasks.workunit.client.0.smithi088.stderr: -309> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.091 INFO:tasks.workunit.client.0.smithi088.stderr: -308> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:41:57.091 INFO:tasks.workunit.client.0.smithi088.stderr: -307> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: dump: 2024-03-09T14:41:57.091 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.091 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.092 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.092 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.092 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.092 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.092 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.092 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.092 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.092 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.092 INFO:tasks.workunit.client.0.smithi088.stderr: -306> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: _finish_auth 0 2024-03-09T14:41:57.092 INFO:tasks.workunit.client.0.smithi088.stderr: -305> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: _check_auth_tickets 2024-03-09T14:41:57.092 INFO:tasks.workunit.client.0.smithi088.stderr: -304> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:57.092 INFO:tasks.workunit.client.0.smithi088.stderr: -303> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.092 INFO:tasks.workunit.client.0.smithi088.stderr: -302> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:41:57.092 INFO:tasks.workunit.client.0.smithi088.stderr: -301> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: dump: 2024-03-09T14:41:57.093 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.093 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.093 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.093 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.093 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.093 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.093 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.093 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.093 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.093 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.093 INFO:tasks.workunit.client.0.smithi088.stderr: -300> 2024-03-09T14:41:56.791+0000 7f84c909d800 5 monclient: authenticate success, global_id 6753 2024-03-09T14:41:57.093 INFO:tasks.workunit.client.0.smithi088.stderr: -299> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient: get_monmap_and_config success 2024-03-09T14:41:57.093 INFO:tasks.workunit.client.0.smithi088.stderr: -298> 2024-03-09T14:41:56.791+0000 7f84c909d800 4 set_mon_vals no callback set 2024-03-09T14:41:57.093 INFO:tasks.workunit.client.0.smithi088.stderr: -297> 2024-03-09T14:41:56.792+0000 7f84c909d800 10 monclient: shutdown 2024-03-09T14:41:57.094 INFO:tasks.workunit.client.0.smithi088.stderr: -296> 2024-03-09T14:41:56.792+0000 7f84c909d800 10 monclient: build_initial_monmap 2024-03-09T14:41:57.094 INFO:tasks.workunit.client.0.smithi088.stderr: -295> 2024-03-09T14:41:56.792+0000 7f84c909d800 1 build_initial for_mkfs: 0 2024-03-09T14:41:57.094 INFO:tasks.workunit.client.0.smithi088.stderr: -294> 2024-03-09T14:41:56.792+0000 7f84c909d800 10 monclient: monmap: 2024-03-09T14:41:57.094 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:41:57.094 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:41:57.094 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:41:57.094 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:41:57.094 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:41:57.094 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.094 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:41:57.094 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:41:57.094 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:41:57.094 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.094 INFO:tasks.workunit.client.0.smithi088.stderr: -293> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding auth protocol: cephx 2024-03-09T14:41:57.095 INFO:tasks.workunit.client.0.smithi088.stderr: -292> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding auth protocol: cephx 2024-03-09T14:41:57.095 INFO:tasks.workunit.client.0.smithi088.stderr: -291> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding auth protocol: cephx 2024-03-09T14:41:57.095 INFO:tasks.workunit.client.0.smithi088.stderr: -290> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.095 INFO:tasks.workunit.client.0.smithi088.stderr: -289> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.095 INFO:tasks.workunit.client.0.smithi088.stderr: -288> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.095 INFO:tasks.workunit.client.0.smithi088.stderr: -287> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.095 INFO:tasks.workunit.client.0.smithi088.stderr: -286> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.095 INFO:tasks.workunit.client.0.smithi088.stderr: -285> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.095 INFO:tasks.workunit.client.0.smithi088.stderr: -284> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.095 INFO:tasks.workunit.client.0.smithi088.stderr: -283> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.095 INFO:tasks.workunit.client.0.smithi088.stderr: -282> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.095 INFO:tasks.workunit.client.0.smithi088.stderr: -281> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.095 INFO:tasks.workunit.client.0.smithi088.stderr: -280> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.095 INFO:tasks.workunit.client.0.smithi088.stderr: -279> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.096 INFO:tasks.workunit.client.0.smithi088.stderr: -278> 2024-03-09T14:41:56.792+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.096 INFO:tasks.workunit.client.0.smithi088.stderr: -277> 2024-03-09T14:41:56.792+0000 7f84c909d800 1 librados: starting msgr at 2024-03-09T14:41:57.096 INFO:tasks.workunit.client.0.smithi088.stderr: -276> 2024-03-09T14:41:56.792+0000 7f84c909d800 1 librados: starting objecter 2024-03-09T14:41:57.096 INFO:tasks.workunit.client.0.smithi088.stderr: -275> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 asok(0x560647f43780) register_command objecter_requests cmddesc objecter_requests hook 0x5606481e2b60 EEXIST 2024-03-09T14:41:57.096 INFO:tasks.workunit.client.0.smithi088.stderr: -274> 2024-03-09T14:41:56.792+0000 7f84c909d800 1 librados: setting wanted keys 2024-03-09T14:41:57.096 INFO:tasks.workunit.client.0.smithi088.stderr: -273> 2024-03-09T14:41:56.792+0000 7f84c909d800 1 librados: calling monclient init 2024-03-09T14:41:57.096 INFO:tasks.workunit.client.0.smithi088.stderr: -272> 2024-03-09T14:41:56.792+0000 7f84c909d800 10 monclient: init 2024-03-09T14:41:57.096 INFO:tasks.workunit.client.0.smithi088.stderr: -271> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding auth protocol: cephx 2024-03-09T14:41:57.096 INFO:tasks.workunit.client.0.smithi088.stderr: -270> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding auth protocol: cephx 2024-03-09T14:41:57.096 INFO:tasks.workunit.client.0.smithi088.stderr: -269> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding auth protocol: cephx 2024-03-09T14:41:57.096 INFO:tasks.workunit.client.0.smithi088.stderr: -268> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: secure 2024-03-09T14:41:57.096 INFO:tasks.workunit.client.0.smithi088.stderr: -267> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: crc 2024-03-09T14:41:57.096 INFO:tasks.workunit.client.0.smithi088.stderr: -266> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: secure 2024-03-09T14:41:57.097 INFO:tasks.workunit.client.0.smithi088.stderr: -265> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: crc 2024-03-09T14:41:57.097 INFO:tasks.workunit.client.0.smithi088.stderr: -264> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: secure 2024-03-09T14:41:57.097 INFO:tasks.workunit.client.0.smithi088.stderr: -263> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: crc 2024-03-09T14:41:57.097 INFO:tasks.workunit.client.0.smithi088.stderr: -262> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: crc 2024-03-09T14:41:57.097 INFO:tasks.workunit.client.0.smithi088.stderr: -261> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: secure 2024-03-09T14:41:57.097 INFO:tasks.workunit.client.0.smithi088.stderr: -260> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: crc 2024-03-09T14:41:57.097 INFO:tasks.workunit.client.0.smithi088.stderr: -259> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: secure 2024-03-09T14:41:57.097 INFO:tasks.workunit.client.0.smithi088.stderr: -258> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: crc 2024-03-09T14:41:57.097 INFO:tasks.workunit.client.0.smithi088.stderr: -257> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: secure 2024-03-09T14:41:57.097 INFO:tasks.workunit.client.0.smithi088.stderr: -256> 2024-03-09T14:41:56.793+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.097 INFO:tasks.workunit.client.0.smithi088.stderr: -255> 2024-03-09T14:41:56.793+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.097 INFO:tasks.workunit.client.0.smithi088.stderr: -254> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 asok(0x560647f43780) register_command rotate-key cmddesc rotate-key hook 0x560648200b78 EEXIST 2024-03-09T14:41:57.097 INFO:tasks.workunit.client.0.smithi088.stderr: -253> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient: _reopen_session rank -1 2024-03-09T14:41:57.097 INFO:tasks.workunit.client.0.smithi088.stderr: -252> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:41:57.098 INFO:tasks.workunit.client.0.smithi088.stderr: -251> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-b con 0x560648231eb0 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:57.098 INFO:tasks.workunit.client.0.smithi088.stderr: -250> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-a con 0x560648236000 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:57.098 INFO:tasks.workunit.client.0.smithi088.stderr: -249> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-c con 0x56064822eb20 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:57.098 INFO:tasks.workunit.client.0.smithi088.stderr: -248> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.098 INFO:tasks.workunit.client.0.smithi088.stderr: -247> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.098 INFO:tasks.workunit.client.0.smithi088.stderr: -246> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.098 INFO:tasks.workunit.client.0.smithi088.stderr: -245> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): _renew_subs 2024-03-09T14:41:57.098 INFO:tasks.workunit.client.0.smithi088.stderr: -244> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): authenticate will time out at 1732.131756s 2024-03-09T14:41:57.098 INFO:tasks.workunit.client.0.smithi088.stderr: -243> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): get_auth_request con 0x560648236000 auth_method 0 2024-03-09T14:41:57.098 INFO:tasks.workunit.client.0.smithi088.stderr: -242> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.098 INFO:tasks.workunit.client.0.smithi088.stderr: -241> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.098 INFO:tasks.workunit.client.0.smithi088.stderr: -240> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.098 INFO:tasks.workunit.client.0.smithi088.stderr: -239> 2024-03-09T14:41:56.793+0000 7f84c6b99640 10 monclient(hunting): get_auth_request con 0x56064822eb20 auth_method 0 2024-03-09T14:41:57.099 INFO:tasks.workunit.client.0.smithi088.stderr: -238> 2024-03-09T14:41:56.793+0000 7f84c6b99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.099 INFO:tasks.workunit.client.0.smithi088.stderr: -237> 2024-03-09T14:41:56.793+0000 7f84c6b99640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.099 INFO:tasks.workunit.client.0.smithi088.stderr: -236> 2024-03-09T14:41:56.793+0000 7f84c6b99640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.099 INFO:tasks.workunit.client.0.smithi088.stderr: -235> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.099 INFO:tasks.workunit.client.0.smithi088.stderr: -234> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.099 INFO:tasks.workunit.client.0.smithi088.stderr: -233> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:57.099 INFO:tasks.workunit.client.0.smithi088.stderr: -232> 2024-03-09T14:41:56.793+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.099 INFO:tasks.workunit.client.0.smithi088.stderr: -231> 2024-03-09T14:41:56.793+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.099 INFO:tasks.workunit.client.0.smithi088.stderr: -230> 2024-03-09T14:41:56.793+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:57.099 INFO:tasks.workunit.client.0.smithi088.stderr: -229> 2024-03-09T14:41:56.793+0000 7f84c6398640 10 monclient(hunting): get_auth_request con 0x560648231eb0 auth_method 0 2024-03-09T14:41:57.099 INFO:tasks.workunit.client.0.smithi088.stderr: -228> 2024-03-09T14:41:56.793+0000 7f84c6398640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.099 INFO:tasks.workunit.client.0.smithi088.stderr: -227> 2024-03-09T14:41:56.793+0000 7f84c6398640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.099 INFO:tasks.workunit.client.0.smithi088.stderr: -226> 2024-03-09T14:41:56.793+0000 7f84c6398640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.100 INFO:tasks.workunit.client.0.smithi088.stderr: -225> 2024-03-09T14:41:56.793+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.100 INFO:tasks.workunit.client.0.smithi088.stderr: -224> 2024-03-09T14:41:56.793+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.100 INFO:tasks.workunit.client.0.smithi088.stderr: -223> 2024-03-09T14:41:56.793+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:57.100 INFO:tasks.workunit.client.0.smithi088.stderr: -222> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): handle_auth_done global_id 6756 payload 824 2024-03-09T14:41:57.100 INFO:tasks.workunit.client.0.smithi088.stderr: -221> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient: _finish_hunting 0 2024-03-09T14:41:57.100 INFO:tasks.workunit.client.0.smithi088.stderr: -220> 2024-03-09T14:41:56.793+0000 7f84c739a640 1 monclient: found mon.noname-a 2024-03-09T14:41:57.100 INFO:tasks.workunit.client.0.smithi088.stderr: -219> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.100 INFO:tasks.workunit.client.0.smithi088.stderr: -218> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.100 INFO:tasks.workunit.client.0.smithi088.stderr: -217> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:41:57.100 INFO:tasks.workunit.client.0.smithi088.stderr: -216> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: dump: 2024-03-09T14:41:57.100 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.100 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.100 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.100 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.100 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.101 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.101 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.101 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.101 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.101 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.101 INFO:tasks.workunit.client.0.smithi088.stderr: -215> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: _finish_auth 0 2024-03-09T14:41:57.101 INFO:tasks.workunit.client.0.smithi088.stderr: -214> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: _check_auth_tickets 2024-03-09T14:41:57.101 INFO:tasks.workunit.client.0.smithi088.stderr: -213> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:57.101 INFO:tasks.workunit.client.0.smithi088.stderr: -212> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.101 INFO:tasks.workunit.client.0.smithi088.stderr: -211> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:41:57.101 INFO:tasks.workunit.client.0.smithi088.stderr: -210> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: dump: 2024-03-09T14:41:57.101 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.101 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.101 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.101 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.102 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.102 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.102 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.102 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.102 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.102 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.102 INFO:tasks.workunit.client.0.smithi088.stderr: -209> 2024-03-09T14:41:56.794+0000 7f83aa7fc640 4 set_mon_vals no callback set 2024-03-09T14:41:57.102 INFO:tasks.workunit.client.0.smithi088.stderr: -208> 2024-03-09T14:41:56.794+0000 7f84c909d800 5 monclient: authenticate success, global_id 6756 2024-03-09T14:41:57.102 INFO:tasks.workunit.client.0.smithi088.stderr: -207> 2024-03-09T14:41:56.794+0000 7f84c909d800 10 monclient: _renew_subs 2024-03-09T14:41:57.102 INFO:tasks.workunit.client.0.smithi088.stderr: -206> 2024-03-09T14:41:56.794+0000 7f84c909d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.102 INFO:tasks.workunit.client.0.smithi088.stderr: -205> 2024-03-09T14:41:56.794+0000 7f84c909d800 10 monclient: _renew_subs 2024-03-09T14:41:57.102 INFO:tasks.workunit.client.0.smithi088.stderr: -204> 2024-03-09T14:41:56.794+0000 7f84c909d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.102 INFO:tasks.workunit.client.0.smithi088.stderr: -203> 2024-03-09T14:41:56.794+0000 7f84c909d800 1 librados: init done 2024-03-09T14:41:57.103 INFO:tasks.workunit.client.0.smithi088.stderr: -202> 2024-03-09T14:41:56.794+0000 7f84c909d800 5 asok(0x560647f43780) register_command cr dump hook 0x5606482390e8 2024-03-09T14:41:57.103 INFO:tasks.workunit.client.0.smithi088.stderr: -201> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: ms_handle_reset current mon [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:57.103 INFO:tasks.workunit.client.0.smithi088.stderr: -200> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: _reopen_session rank -1 2024-03-09T14:41:57.103 INFO:tasks.workunit.client.0.smithi088.stderr: -199> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:41:57.103 INFO:tasks.workunit.client.0.smithi088.stderr: -198> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient(hunting): picked mon.b con 0x560648231eb0 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:57.103 INFO:tasks.workunit.client.0.smithi088.stderr: -197> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient(hunting): picked mon.a con 0x7f8390004c20 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:57.103 INFO:tasks.workunit.client.0.smithi088.stderr: -196> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient(hunting): picked mon.c con 0x56064822eb20 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:57.103 INFO:tasks.workunit.client.0.smithi088.stderr: -195> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.103 INFO:tasks.workunit.client.0.smithi088.stderr: -194> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.103 INFO:tasks.workunit.client.0.smithi088.stderr: -193> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.103 INFO:tasks.workunit.client.0.smithi088.stderr: -192> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient(hunting): _renew_subs 2024-03-09T14:41:57.103 INFO:tasks.workunit.client.0.smithi088.stderr: -191> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): get_auth_request con 0x7f8390004c20 auth_method 0 2024-03-09T14:41:57.103 INFO:tasks.workunit.client.0.smithi088.stderr: -190> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.103 INFO:tasks.workunit.client.0.smithi088.stderr: -189> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.103 INFO:tasks.workunit.client.0.smithi088.stderr: -188> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-09T14:41:57.104 INFO:tasks.workunit.client.0.smithi088.stderr: -187> 2024-03-09T14:41:56.794+0000 7f84c6b99640 10 monclient(hunting): get_auth_request con 0x56064822eb20 auth_method 0 2024-03-09T14:41:57.104 INFO:tasks.workunit.client.0.smithi088.stderr: -186> 2024-03-09T14:41:56.794+0000 7f84c6b99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.104 INFO:tasks.workunit.client.0.smithi088.stderr: -185> 2024-03-09T14:41:56.794+0000 7f84c6b99640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.104 INFO:tasks.workunit.client.0.smithi088.stderr: -184> 2024-03-09T14:41:56.794+0000 7f84c6b99640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-09T14:41:57.104 INFO:tasks.workunit.client.0.smithi088.stderr: -183> 2024-03-09T14:41:56.794+0000 7f84c6398640 10 monclient(hunting): get_auth_request con 0x560648231eb0 auth_method 0 2024-03-09T14:41:57.104 INFO:tasks.workunit.client.0.smithi088.stderr: -182> 2024-03-09T14:41:56.794+0000 7f84c6398640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.104 INFO:tasks.workunit.client.0.smithi088.stderr: -181> 2024-03-09T14:41:56.794+0000 7f84c6398640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.104 INFO:tasks.workunit.client.0.smithi088.stderr: -180> 2024-03-09T14:41:56.794+0000 7f84c6398640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-09T14:41:57.104 INFO:tasks.workunit.client.0.smithi088.stderr: -179> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.104 INFO:tasks.workunit.client.0.smithi088.stderr: -178> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.104 INFO:tasks.workunit.client.0.smithi088.stderr: -177> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-09T14:41:57.104 INFO:tasks.workunit.client.0.smithi088.stderr: -176> 2024-03-09T14:41:56.794+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.104 INFO:tasks.workunit.client.0.smithi088.stderr: -175> 2024-03-09T14:41:56.794+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.104 INFO:tasks.workunit.client.0.smithi088.stderr: -174> 2024-03-09T14:41:56.794+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-09T14:41:57.104 INFO:tasks.workunit.client.0.smithi088.stderr: -173> 2024-03-09T14:41:56.794+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.105 INFO:tasks.workunit.client.0.smithi088.stderr: -172> 2024-03-09T14:41:56.794+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.105 INFO:tasks.workunit.client.0.smithi088.stderr: -171> 2024-03-09T14:41:56.794+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-09T14:41:57.105 INFO:tasks.workunit.client.0.smithi088.stderr: -170> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): handle_auth_done global_id 6756 payload 293 2024-03-09T14:41:57.105 INFO:tasks.workunit.client.0.smithi088.stderr: -169> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient: _finish_hunting 0 2024-03-09T14:41:57.105 INFO:tasks.workunit.client.0.smithi088.stderr: -168> 2024-03-09T14:41:56.794+0000 7f84c739a640 1 monclient: found mon.a 2024-03-09T14:41:57.105 INFO:tasks.workunit.client.0.smithi088.stderr: -167> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.105 INFO:tasks.workunit.client.0.smithi088.stderr: -166> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient: _finish_auth 0 2024-03-09T14:41:57.105 INFO:tasks.workunit.client.0.smithi088.stderr: -165> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient: _check_auth_tickets 2024-03-09T14:41:57.105 INFO:tasks.workunit.client.0.smithi088.stderr: -164> 2024-03-09T14:41:56.795+0000 7f83a8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.105 INFO:tasks.workunit.client.0.smithi088.stderr: -163> 2024-03-09T14:41:56.795+0000 7f83a8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:41:57.105 INFO:tasks.workunit.client.0.smithi088.stderr: -162> 2024-03-09T14:41:56.795+0000 7f83a8ff9640 10 monclient: dump: 2024-03-09T14:41:57.105 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.105 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.106 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.106 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.106 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.106 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.106 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.106 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.106 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.106 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.106 INFO:tasks.workunit.client.0.smithi088.stderr: -161> 2024-03-09T14:41:56.795+0000 7f83a8ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:57.106 INFO:tasks.workunit.client.0.smithi088.stderr: -160> 2024-03-09T14:41:56.795+0000 7f83a9ffb640 4 set_mon_vals no callback set 2024-03-09T14:41:57.106 INFO:tasks.workunit.client.0.smithi088.stderr: -159> 2024-03-09T14:41:56.795+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.106 INFO:tasks.workunit.client.0.smithi088.stderr: -158> 2024-03-09T14:41:56.796+0000 7f83a8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:41:57.106 INFO:tasks.workunit.client.0.smithi088.stderr: -157> 2024-03-09T14:41:56.796+0000 7f83a8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:57.106 INFO:tasks.workunit.client.0.smithi088.stderr: -156> 2024-03-09T14:41:56.796+0000 7f83a8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:57.107 INFO:tasks.workunit.client.0.smithi088.stderr: -155> 2024-03-09T14:41:56.796+0000 7f84c6398640 10 monclient: get_auth_request con 0x560648236000 auth_method 0 2024-03-09T14:41:57.107 INFO:tasks.workunit.client.0.smithi088.stderr: -154> 2024-03-09T14:41:56.796+0000 7f84c6b99640 10 monclient: get_auth_request con 0x5606482494d0 auth_method 0 2024-03-09T14:41:57.107 INFO:tasks.workunit.client.0.smithi088.stderr: -153> 2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.107 INFO:tasks.workunit.client.0.smithi088.stderr: -152> 2024-03-09T14:41:56.797+0000 7f84c909d800 20 realm 2024-03-09T14:41:57.107 INFO:tasks.workunit.client.0.smithi088.stderr: -151> 2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.107 INFO:tasks.workunit.client.0.smithi088.stderr: -150> 2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.107 INFO:tasks.workunit.client.0.smithi088.stderr: -149> 2024-03-09T14:41:56.797+0000 7f84c909d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:57.107 INFO:tasks.workunit.client.0.smithi088.stderr: -148> 2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.107 INFO:tasks.workunit.client.0.smithi088.stderr: -147> 2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.107 INFO:tasks.workunit.client.0.smithi088.stderr: -146> 2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.107 INFO:tasks.workunit.client.0.smithi088.stderr: -145> 2024-03-09T14:41:56.798+0000 7f84c6398640 10 monclient: get_auth_request con 0x56064824d670 auth_method 0 2024-03-09T14:41:57.107 INFO:tasks.workunit.client.0.smithi088.stderr: -144> 2024-03-09T14:41:56.798+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:57.107 INFO:tasks.workunit.client.0.smithi088.stderr: -143> 2024-03-09T14:41:56.798+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.107 INFO:tasks.workunit.client.0.smithi088.stderr: -142> 2024-03-09T14:41:56.798+0000 7f84c739a640 10 monclient: get_auth_request con 0x560648250d70 auth_method 0 2024-03-09T14:41:57.107 INFO:tasks.workunit.client.0.smithi088.stderr: -141> 2024-03-09T14:41:56.799+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:57.108 INFO:tasks.workunit.client.0.smithi088.stderr: -140> 2024-03-09T14:41:56.799+0000 7f84c909d800 20 searching for the correct realm 2024-03-09T14:41:57.108 INFO:tasks.workunit.client.0.smithi088.stderr: -139> 2024-03-09T14:41:56.799+0000 7f84c6b99640 10 monclient: get_auth_request con 0x560648255ac0 auth_method 0 2024-03-09T14:41:57.108 INFO:tasks.workunit.client.0.smithi088.stderr: -138> 2024-03-09T14:41:56.800+0000 7f84c6398640 0 -- 172.21.15.88:0/2391042725 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f84b8032040 msgr2=0x7f84b8017410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:57.108 INFO:tasks.workunit.client.0.smithi088.stderr: -137> 2024-03-09T14:41:57.001+0000 7f84c6398640 10 monclient: get_auth_request con 0x7f84b8032040 auth_method 0 2024-03-09T14:41:57.108 INFO:tasks.workunit.client.0.smithi088.stderr: -136> 2024-03-09T14:41:57.003+0000 7f84c739a640 10 monclient: get_auth_request con 0x7f84c0067070 auth_method 0 2024-03-09T14:41:57.108 INFO:tasks.workunit.client.0.smithi088.stderr: -135> 2024-03-09T14:41:57.005+0000 7f84c6b99640 10 monclient: get_auth_request con 0x7f84c005e070 auth_method 0 2024-03-09T14:41:57.108 INFO:tasks.workunit.client.0.smithi088.stderr: -134> 2024-03-09T14:41:57.006+0000 7f84c739a640 0 -- 172.21.15.88:0/2391042725 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x560648250d70 msgr2=0x560648253160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:57.108 INFO:tasks.workunit.client.0.smithi088.stderr: -133> 2024-03-09T14:41:57.006+0000 7f83a8ff9640 1 client.6756.objecter ms_handle_reset 0x560648250d70 session 0x56064824cf10 osd.2 2024-03-09T14:41:57.108 INFO:tasks.workunit.client.0.smithi088.stderr: -132> 2024-03-09T14:41:57.006+0000 7f83a8ff9640 10 monclient: _renew_subs 2024-03-09T14:41:57.108 INFO:tasks.workunit.client.0.smithi088.stderr: -131> 2024-03-09T14:41:57.006+0000 7f83a8ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.108 INFO:tasks.workunit.client.0.smithi088.stderr: -130> 2024-03-09T14:41:57.006+0000 7f84c739a640 10 monclient: get_auth_request con 0x7f8390082590 auth_method 0 2024-03-09T14:41:57.108 INFO:tasks.workunit.client.0.smithi088.stderr: -129> 2024-03-09T14:41:57.008+0000 7f84c6398640 10 monclient: get_auth_request con 0x7f84c009d8d0 auth_method 0 2024-03-09T14:41:57.108 INFO:tasks.workunit.client.0.smithi088.stderr: -128> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:57.108 INFO:tasks.workunit.client.0.smithi088.stderr: -127> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:57.109 INFO:tasks.workunit.client.0.smithi088.stderr: -126> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:57.109 INFO:tasks.workunit.client.0.smithi088.stderr: -125> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:57.109 INFO:tasks.workunit.client.0.smithi088.stderr: -124> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:57.109 INFO:tasks.workunit.client.0.smithi088.stderr: -123> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:57.109 INFO:tasks.workunit.client.0.smithi088.stderr: -122> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.109 INFO:tasks.workunit.client.0.smithi088.stderr: -121> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.109 INFO:tasks.workunit.client.0.smithi088.stderr: -120> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.109 INFO:tasks.workunit.client.0.smithi088.stderr: -119> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:57.109 INFO:tasks.workunit.client.0.smithi088.stderr: -118> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.109 INFO:tasks.workunit.client.0.smithi088.stderr: -117> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:57.109 INFO:tasks.workunit.client.0.smithi088.stderr: -116> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 zone default found 2024-03-09T14:41:57.109 INFO:tasks.workunit.client.0.smithi088.stderr: -115> 2024-03-09T14:41:57.013+0000 7f84c909d800 4 Realm: () 2024-03-09T14:41:57.109 INFO:tasks.workunit.client.0.smithi088.stderr: -114> 2024-03-09T14:41:57.013+0000 7f84c909d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:57.109 INFO:tasks.workunit.client.0.smithi088.stderr: -113> 2024-03-09T14:41:57.013+0000 7f84c909d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:57.109 INFO:tasks.workunit.client.0.smithi088.stderr: -112> 2024-03-09T14:41:57.013+0000 7f84c909d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:57.110 INFO:tasks.workunit.client.0.smithi088.stderr: -111> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 zonegroup default 2024-03-09T14:41:57.110 INFO:tasks.workunit.client.0.smithi088.stderr: -110> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.110 INFO:tasks.workunit.client.0.smithi088.stderr: -109> 2024-03-09T14:41:57.014+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.110 INFO:tasks.workunit.client.0.smithi088.stderr: -108> 2024-03-09T14:41:57.014+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.110 INFO:tasks.workunit.client.0.smithi088.stderr: -107> 2024-03-09T14:41:57.014+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.110 INFO:tasks.workunit.client.0.smithi088.stderr: -106> 2024-03-09T14:41:57.014+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.110 INFO:tasks.workunit.client.0.smithi088.stderr: -105> 2024-03-09T14:41:57.014+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.110 INFO:tasks.workunit.client.0.smithi088.stderr: -104> 2024-03-09T14:41:57.014+0000 7f84c909d800 20 started sync module instance, tier type = 2024-03-09T14:41:57.110 INFO:tasks.workunit.client.0.smithi088.stderr: -103> 2024-03-09T14:41:57.014+0000 7f84c909d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:57.110 INFO:tasks.workunit.client.0.smithi088.stderr: -102> 2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=0 2024-03-09T14:41:57.110 INFO:tasks.workunit.client.0.smithi088.stderr: -101> 2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=1 2024-03-09T14:41:57.110 INFO:tasks.workunit.client.0.smithi088.stderr: -100> 2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=2 2024-03-09T14:41:57.110 INFO:tasks.workunit.client.0.smithi088.stderr: -99> 2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=3 2024-03-09T14:41:57.111 INFO:tasks.workunit.client.0.smithi088.stderr: -98> 2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=4 2024-03-09T14:41:57.111 INFO:tasks.workunit.client.0.smithi088.stderr: -97> 2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=5 2024-03-09T14:41:57.111 INFO:tasks.workunit.client.0.smithi088.stderr: -96> 2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=6 2024-03-09T14:41:57.111 INFO:tasks.workunit.client.0.smithi088.stderr: -95> 2024-03-09T14:41:57.025+0000 7f84c909d800 20 add_watcher() i=7 2024-03-09T14:41:57.111 INFO:tasks.workunit.client.0.smithi088.stderr: -94> 2024-03-09T14:41:57.025+0000 7f84c909d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:57.111 INFO:tasks.workunit.client.0.smithi088.stderr: -93> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding auth protocol: cephx 2024-03-09T14:41:57.111 INFO:tasks.workunit.client.0.smithi088.stderr: -92> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding auth protocol: cephx 2024-03-09T14:41:57.111 INFO:tasks.workunit.client.0.smithi088.stderr: -91> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding auth protocol: cephx 2024-03-09T14:41:57.111 INFO:tasks.workunit.client.0.smithi088.stderr: -90> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: secure 2024-03-09T14:41:57.111 INFO:tasks.workunit.client.0.smithi088.stderr: -89> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: crc 2024-03-09T14:41:57.111 INFO:tasks.workunit.client.0.smithi088.stderr: -88> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: secure 2024-03-09T14:41:57.111 INFO:tasks.workunit.client.0.smithi088.stderr: -87> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: crc 2024-03-09T14:41:57.111 INFO:tasks.workunit.client.0.smithi088.stderr: -86> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: secure 2024-03-09T14:41:57.111 INFO:tasks.workunit.client.0.smithi088.stderr: -85> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: crc 2024-03-09T14:41:57.112 INFO:tasks.workunit.client.0.smithi088.stderr: -84> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: crc 2024-03-09T14:41:57.112 INFO:tasks.workunit.client.0.smithi088.stderr: -83> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: secure 2024-03-09T14:41:57.112 INFO:tasks.workunit.client.0.smithi088.stderr: -82> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: crc 2024-03-09T14:41:57.112 INFO:tasks.workunit.client.0.smithi088.stderr: -81> 2024-03-09T14:41:57.026+0000 7f8378ff9640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:57.112 INFO:tasks.workunit.client.0.smithi088.stderr: -80> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: secure 2024-03-09T14:41:57.112 INFO:tasks.workunit.client.0.smithi088.stderr: -79> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: crc 2024-03-09T14:41:57.112 INFO:tasks.workunit.client.0.smithi088.stderr: -78> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: secure 2024-03-09T14:41:57.112 INFO:tasks.workunit.client.0.smithi088.stderr: -77> 2024-03-09T14:41:57.027+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.112 INFO:tasks.workunit.client.0.smithi088.stderr: -76> 2024-03-09T14:41:57.027+0000 7f84c909d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:57.112 INFO:tasks.workunit.client.0.smithi088.stderr: -75> 2024-03-09T14:41:57.027+0000 7f84c909d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:57.112 INFO:tasks.workunit.client.0.smithi088.stderr: -74> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command cache list hook 0x56064822ef60 2024-03-09T14:41:57.112 INFO:tasks.workunit.client.0.smithi088.stderr: -73> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command cache inspect hook 0x56064822ef60 2024-03-09T14:41:57.112 INFO:tasks.workunit.client.0.smithi088.stderr: -72> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command cache erase hook 0x56064822ef60 2024-03-09T14:41:57.112 INFO:tasks.workunit.client.0.smithi088.stderr: -71> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command cache zap hook 0x56064822ef60 2024-03-09T14:41:57.113 INFO:tasks.workunit.client.0.smithi088.stderr: -70> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 note: GC not initialized 2024-03-09T14:41:57.113 INFO:tasks.workunit.client.0.smithi088.stderr: -69> 2024-03-09T14:41:57.027+0000 7f82f37fe640 20 reqs_thread_entry: start 2024-03-09T14:41:57.113 INFO:tasks.workunit.client.0.smithi088.stderr: -68> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command sync trace show hook 0x7f84c0052770 2024-03-09T14:41:57.113 INFO:tasks.workunit.client.0.smithi088.stderr: -67> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command sync trace history hook 0x7f84c0052770 2024-03-09T14:41:57.113 INFO:tasks.workunit.client.0.smithi088.stderr: -66> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command sync trace active hook 0x7f84c0052770 2024-03-09T14:41:57.113 INFO:tasks.workunit.client.0.smithi088.stderr: -65> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command sync trace active_short hook 0x7f84c0052770 2024-03-09T14:41:57.113 INFO:tasks.workunit.client.0.smithi088.stderr: -64> 2024-03-09T14:41:57.027+0000 7f84c909d800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:57.113 INFO:tasks.workunit.client.0.smithi088.stderr: -63> 2024-03-09T14:41:57.027+0000 7f84c909d800 20 Filter name: none 2024-03-09T14:41:57.113 INFO:tasks.workunit.client.0.smithi088.stderr: -62> 2024-03-09T14:41:57.027+0000 7f82f17fa640 20 reqs_thread_entry: start 2024-03-09T14:41:57.113 INFO:tasks.workunit.client.0.smithi088.stderr: -61> 2024-03-09T14:41:57.027+0000 7f84c909d800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-09T14:41:57.113 INFO:tasks.workunit.client.0.smithi088.stderr: -60> 2024-03-09T14:41:57.027+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.113 INFO:tasks.workunit.client.0.smithi088.stderr: -59> 2024-03-09T14:41:57.028+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:57.113 INFO:tasks.workunit.client.0.smithi088.stderr: -58> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-09T14:41:57.113 INFO:tasks.workunit.client.0.smithi088.stderr: -57> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-09T14:41:57.114 INFO:tasks.workunit.client.0.smithi088.stderr: -56> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 : miss 2024-03-09T14:41:57.114 INFO:tasks.workunit.client.0.smithi088.stderr: -55> 2024-03-09T14:41:57.028+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.114 INFO:tasks.workunit.client.0.smithi088.stderr: -54> 2024-03-09T14:41:57.028+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:41:57.114 INFO:tasks.workunit.client.0.smithi088.stderr: -53> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 info.flags=0x17 2024-03-09T14:41:57.114 INFO:tasks.workunit.client.0.smithi088.stderr: -52> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 to cache LRU end 2024-03-09T14:41:57.114 INFO:tasks.workunit.client.0.smithi088.stderr: -51> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:57.114 INFO:tasks.workunit.client.0.smithi088.stderr: -50> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:57.114 INFO:tasks.workunit.client.0.smithi088.stderr: -49> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 2024-03-09T14:41:57.114 INFO:tasks.workunit.client.0.smithi088.stderr: -48> 2024-03-09T14:41:57.033+0000 7f84c909d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 info.flags=0x17 2024-03-09T14:41:57.114 INFO:tasks.workunit.client.0.smithi088.stderr: -47> 2024-03-09T14:41:57.033+0000 7f84c909d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 to cache LRU end 2024-03-09T14:41:57.114 INFO:tasks.workunit.client.0.smithi088.stderr: -46> 2024-03-09T14:41:57.033+0000 7f84c909d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:57.114 INFO:tasks.workunit.client.0.smithi088.stderr: -45> 2024-03-09T14:41:57.033+0000 7f84c909d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26, ofs0, ns] 2024-03-09T14:41:57.114 INFO:tasks.workunit.client.0.smithi088.stderr: -44> 2024-03-09T14:41:57.034+0000 7f83a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464290 cookie 94584980216064 notifier 6756 bl.length()=923 2024-03-09T14:41:57.115 INFO:tasks.workunit.client.0.smithi088.stderr: -43> 2024-03-09T14:41:57.034+0000 7f83a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 info.flags=0x17 2024-03-09T14:41:57.115 INFO:tasks.workunit.client.0.smithi088.stderr: -42> 2024-03-09T14:41:57.034+0000 7f83a9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 to cache LRU end 2024-03-09T14:41:57.115 INFO:tasks.workunit.client.0.smithi088.stderr: -41> 2024-03-09T14:41:57.034+0000 7f83a9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:57.115 INFO:tasks.workunit.client.0.smithi088.stderr: -40> 2024-03-09T14:41:57.035+0000 7f84c909d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): orig_sources= new_sources= 2024-03-09T14:41:57.115 INFO:tasks.workunit.client.0.smithi088.stderr: -39> 2024-03-09T14:41:57.035+0000 7f84c909d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): potential sources added=[] removed=[] 2024-03-09T14:41:57.115 INFO:tasks.workunit.client.0.smithi088.stderr: -38> 2024-03-09T14:41:57.035+0000 7f84c909d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): orig_dests= new_dests= 2024-03-09T14:41:57.115 INFO:tasks.workunit.client.0.smithi088.stderr: -37> 2024-03-09T14:41:57.035+0000 7f84c909d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): potential dests added=[] removed=[] 2024-03-09T14:41:57.115 INFO:tasks.workunit.client.0.smithi088.stderr: -36> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.0 2024-03-09T14:41:57.115 INFO:tasks.workunit.client.0.smithi088.stderr: -35> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.0 2024-03-09T14:41:57.115 INFO:tasks.workunit.client.0.smithi088.stderr: -34> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.1 2024-03-09T14:41:57.115 INFO:tasks.workunit.client.0.smithi088.stderr: -33> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.1 2024-03-09T14:41:57.115 INFO:tasks.workunit.client.0.smithi088.stderr: -32> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.2 2024-03-09T14:41:57.115 INFO:tasks.workunit.client.0.smithi088.stderr: -31> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.2 2024-03-09T14:41:57.115 INFO:tasks.workunit.client.0.smithi088.stderr: -30> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.3 2024-03-09T14:41:57.115 INFO:tasks.workunit.client.0.smithi088.stderr: -29> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.3 2024-03-09T14:41:57.116 INFO:tasks.workunit.client.0.smithi088.stderr: -28> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.4 2024-03-09T14:41:57.116 INFO:tasks.workunit.client.0.smithi088.stderr: -27> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.4 2024-03-09T14:41:57.116 INFO:tasks.workunit.client.0.smithi088.stderr: -26> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.5 2024-03-09T14:41:57.116 INFO:tasks.workunit.client.0.smithi088.stderr: -25> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.5 2024-03-09T14:41:57.116 INFO:tasks.workunit.client.0.smithi088.stderr: -24> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.6 2024-03-09T14:41:57.116 INFO:tasks.workunit.client.0.smithi088.stderr: -23> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.6 2024-03-09T14:41:57.116 INFO:tasks.workunit.client.0.smithi088.stderr: -22> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.7 2024-03-09T14:41:57.116 INFO:tasks.workunit.client.0.smithi088.stderr: -21> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.7 2024-03-09T14:41:57.116 INFO:tasks.workunit.client.0.smithi088.stderr: -20> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.8 2024-03-09T14:41:57.116 INFO:tasks.workunit.client.0.smithi088.stderr: -19> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.8 2024-03-09T14:41:57.116 INFO:tasks.workunit.client.0.smithi088.stderr: -18> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.9 2024-03-09T14:41:57.116 INFO:tasks.workunit.client.0.smithi088.stderr: -17> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.9 2024-03-09T14:41:57.116 INFO:tasks.workunit.client.0.smithi088.stderr: -16> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.10 2024-03-09T14:41:57.116 INFO:tasks.workunit.client.0.smithi088.stderr: -15> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.10 2024-03-09T14:41:57.117 INFO:tasks.workunit.client.0.smithi088.stderr: -14> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.11 2024-03-09T14:41:57.117 INFO:tasks.workunit.client.0.smithi088.stderr: -13> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.11 2024-03-09T14:41:57.117 INFO:tasks.workunit.client.0.smithi088.stderr: -12> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.0 2024-03-09T14:41:57.117 INFO:tasks.workunit.client.0.smithi088.stderr: -11> 2024-03-09T14:41:57.039+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1 2024-03-09T14:41:57.117 INFO:tasks.workunit.client.0.smithi088.stderr: -10> 2024-03-09T14:41:57.039+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.2 2024-03-09T14:41:57.117 INFO:tasks.workunit.client.0.smithi088.stderr: -9> 2024-03-09T14:41:57.040+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.3 2024-03-09T14:41:57.117 INFO:tasks.workunit.client.0.smithi088.stderr: -8> 2024-03-09T14:41:57.040+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.4 2024-03-09T14:41:57.117 INFO:tasks.workunit.client.0.smithi088.stderr: -7> 2024-03-09T14:41:57.041+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.5 2024-03-09T14:41:57.117 INFO:tasks.workunit.client.0.smithi088.stderr: -6> 2024-03-09T14:41:57.041+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.6 2024-03-09T14:41:57.117 INFO:tasks.workunit.client.0.smithi088.stderr: -5> 2024-03-09T14:41:57.042+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.7 2024-03-09T14:41:57.117 INFO:tasks.workunit.client.0.smithi088.stderr: -4> 2024-03-09T14:41:57.042+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.8 2024-03-09T14:41:57.117 INFO:tasks.workunit.client.0.smithi088.stderr: -3> 2024-03-09T14:41:57.042+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.9 2024-03-09T14:41:57.117 INFO:tasks.workunit.client.0.smithi088.stderr: -2> 2024-03-09T14:41:57.043+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.10 2024-03-09T14:41:57.117 INFO:tasks.workunit.client.0.smithi088.stderr: -1> 2024-03-09T14:41:57.047+0000 7f84c909d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84c909d800 time 2024-03-09T14:41:57.048218+0000 2024-03-09T14:41:57.118 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:41:57.118 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.118 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:57.118 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84cc380e86] 2024-03-09T14:41:57.118 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f84cc381044] 2024-03-09T14:41:57.118 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56064699df91] 2024-03-09T14:41:57.118 INFO:tasks.workunit.client.0.smithi088.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5606469b9178] 2024-03-09T14:41:57.118 INFO:tasks.workunit.client.0.smithi088.stderr: 5: main() 2024-03-09T14:41:57.118 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f84cb23feb0] 2024-03-09T14:41:57.118 INFO:tasks.workunit.client.0.smithi088.stderr: 7: __libc_start_main() 2024-03-09T14:41:57.118 INFO:tasks.workunit.client.0.smithi088.stderr: 8: _start() 2024-03-09T14:41:57.118 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.118 INFO:tasks.workunit.client.0.smithi088.stderr: 0> 2024-03-09T14:41:57.048+0000 7f84c909d800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:41:57.119 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7f84c909d800 thread_name:radosgw-admin 2024-03-09T14:41:57.119 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.119 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:57.119 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f84cb254db0] 2024-03-09T14:41:57.119 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f84cb2a154c] 2024-03-09T14:41:57.119 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:41:57.119 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:41:57.119 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84cc380ee0] 2024-03-09T14:41:57.119 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f84cc381044] 2024-03-09T14:41:57.119 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56064699df91] 2024-03-09T14:41:57.119 INFO:tasks.workunit.client.0.smithi088.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5606469b9178] 2024-03-09T14:41:57.119 INFO:tasks.workunit.client.0.smithi088.stderr: 9: main() 2024-03-09T14:41:57.119 INFO:tasks.workunit.client.0.smithi088.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f84cb23feb0] 2024-03-09T14:41:57.119 INFO:tasks.workunit.client.0.smithi088.stderr: 11: __libc_start_main() 2024-03-09T14:41:57.120 INFO:tasks.workunit.client.0.smithi088.stderr: 12: _start() 2024-03-09T14:41:57.120 INFO:tasks.workunit.client.0.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:41:57.120 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.120 INFO:tasks.workunit.client.0.smithi088.stderr:--- logging levels --- 2024-03-09T14:41:57.120 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 none 2024-03-09T14:41:57.120 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 lockdep 2024-03-09T14:41:57.120 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 context 2024-03-09T14:41:57.120 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 crush 2024-03-09T14:41:57.120 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds 2024-03-09T14:41:57.120 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_balancer 2024-03-09T14:41:57.120 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_locker 2024-03-09T14:41:57.120 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log 2024-03-09T14:41:57.120 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log_expire 2024-03-09T14:41:57.121 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_migrator 2024-03-09T14:41:57.121 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 buffer 2024-03-09T14:41:57.121 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 timer 2024-03-09T14:41:57.121 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 filer 2024-03-09T14:41:57.121 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 striper 2024-03-09T14:41:57.121 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 objecter 2024-03-09T14:41:57.121 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rados 2024-03-09T14:41:57.121 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd 2024-03-09T14:41:57.121 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_mirror 2024-03-09T14:41:57.122 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_replay 2024-03-09T14:41:57.122 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_pwl 2024-03-09T14:41:57.122 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 journaler 2024-03-09T14:41:57.122 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objectcacher 2024-03-09T14:41:57.122 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:41:57.122 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 client 2024-03-09T14:41:57.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 osd 2024-03-09T14:41:57.122 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 optracker 2024-03-09T14:41:57.122 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objclass 2024-03-09T14:41:57.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 filestore 2024-03-09T14:41:57.122 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 journal 2024-03-09T14:41:57.122 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 ms 2024-03-09T14:41:57.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mon 2024-03-09T14:41:57.123 INFO:tasks.workunit.client.0.smithi088.stderr: 0/10 monc 2024-03-09T14:41:57.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 paxos 2024-03-09T14:41:57.123 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 tp 2024-03-09T14:41:57.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 auth 2024-03-09T14:41:57.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 crypto 2024-03-09T14:41:57.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 finisher 2024-03-09T14:41:57.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 reserver 2024-03-09T14:41:57.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 heartbeatmap 2024-03-09T14:41:57.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 perfcounter 2024-03-09T14:41:57.123 INFO:tasks.workunit.client.0.smithi088.stderr: 20/20 rgw 2024-03-09T14:41:57.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_sync 2024-03-09T14:41:57.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_datacache 2024-03-09T14:41:57.123 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_access 2024-03-09T14:41:57.124 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:41:57.124 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_flight 2024-03-09T14:41:57.124 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:41:57.124 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 javaclient 2024-03-09T14:41:57.124 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 asok 2024-03-09T14:41:57.124 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 throttle 2024-03-09T14:41:57.124 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 refs 2024-03-09T14:41:57.124 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 compressor 2024-03-09T14:41:57.124 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluestore 2024-03-09T14:41:57.124 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluefs 2024-03-09T14:41:57.124 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 bdev 2024-03-09T14:41:57.124 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 kstore 2024-03-09T14:41:57.124 INFO:tasks.workunit.client.0.smithi088.stderr: 4/ 5 rocksdb 2024-03-09T14:41:57.124 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 fuse 2024-03-09T14:41:57.125 INFO:tasks.workunit.client.0.smithi088.stderr: 2/ 5 mgr 2024-03-09T14:41:57.125 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mgrc 2024-03-09T14:41:57.125 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 dpdk 2024-03-09T14:41:57.125 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 eventtrace 2024-03-09T14:41:57.125 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 prioritycache 2024-03-09T14:41:57.125 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 test 2024-03-09T14:41:57.125 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:41:57.125 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephsqlite 2024-03-09T14:41:57.125 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:41:57.125 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore 2024-03-09T14:41:57.125 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_onode 2024-03-09T14:41:57.125 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_odata 2024-03-09T14:41:57.125 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_omap 2024-03-09T14:41:57.125 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_tm 2024-03-09T14:41:57.126 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_t 2024-03-09T14:41:57.126 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:41:57.126 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_epm 2024-03-09T14:41:57.126 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_lba 2024-03-09T14:41:57.126 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:41:57.126 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cache 2024-03-09T14:41:57.126 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_journal 2024-03-09T14:41:57.126 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_device 2024-03-09T14:41:57.126 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_backref 2024-03-09T14:41:57.126 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 alienstore 2024-03-09T14:41:57.126 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mclock 2024-03-09T14:41:57.126 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cyanstore 2024-03-09T14:41:57.126 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 ceph_exporter 2024-03-09T14:41:57.127 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 memstore 2024-03-09T14:41:57.127 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 trace 2024-03-09T14:41:57.127 INFO:tasks.workunit.client.0.smithi088.stderr: -2/-2 (syslog threshold) 2024-03-09T14:41:57.127 INFO:tasks.workunit.client.0.smithi088.stderr: 99/99 (stderr threshold) 2024-03-09T14:41:57.127 INFO:tasks.workunit.client.0.smithi088.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:41:57.127 INFO:tasks.workunit.client.0.smithi088.stderr: 7f82f17fa640 / http_manager 2024-03-09T14:41:57.127 INFO:tasks.workunit.client.0.smithi088.stderr: 7f82f37fe640 / http_manager 2024-03-09T14:41:57.127 INFO:tasks.workunit.client.0.smithi088.stderr: 7f8378ff9640 / rgw_dt_lg_renew 2024-03-09T14:41:57.127 INFO:tasks.workunit.client.0.smithi088.stderr: 7f83a8ff9640 / ms_dispatch 2024-03-09T14:41:57.127 INFO:tasks.workunit.client.0.smithi088.stderr: 7f83a9ffb640 / io_context_pool 2024-03-09T14:41:57.127 INFO:tasks.workunit.client.0.smithi088.stderr: 7f83aa7fc640 / io_context_pool 2024-03-09T14:41:57.127 INFO:tasks.workunit.client.0.smithi088.stderr: 7f83b0e01640 / ms_dispatch 2024-03-09T14:41:57.127 INFO:tasks.workunit.client.0.smithi088.stderr: 7f83b3606640 / ms_dispatch 2024-03-09T14:41:57.127 INFO:tasks.workunit.client.0.smithi088.stderr: 7f83b4e09640 / io_context_pool 2024-03-09T14:41:57.127 INFO:tasks.workunit.client.0.smithi088.stderr: 7f84c6398640 / msgr-worker-2 2024-03-09T14:41:57.128 INFO:tasks.workunit.client.0.smithi088.stderr: 7f84c6b99640 / msgr-worker-1 2024-03-09T14:41:57.128 INFO:tasks.workunit.client.0.smithi088.stderr: 7f84c739a640 / msgr-worker-0 2024-03-09T14:41:57.128 INFO:tasks.workunit.client.0.smithi088.stderr: 7f84c7b9b640 / io_context_pool 2024-03-09T14:41:57.128 INFO:tasks.workunit.client.0.smithi088.stderr: 7f84c909d800 / radosgw-admin 2024-03-09T14:41:57.128 INFO:tasks.workunit.client.0.smithi088.stderr: max_recent 500 2024-03-09T14:41:57.128 INFO:tasks.workunit.client.0.smithi088.stderr: max_new 1000 2024-03-09T14:41:57.128 INFO:tasks.workunit.client.0.smithi088.stderr: log_file /var/log/ceph/ceph-client.admin.104431.log 2024-03-09T14:41:57.128 INFO:tasks.workunit.client.0.smithi088.stderr:--- end dump of recent events --- 2024-03-09T14:41:57.128 INFO:tasks.workunit.client.0.smithi088.stderr:--- begin dump of recent events --- 2024-03-09T14:41:57.128 INFO:tasks.workunit.client.0.smithi088.stderr: -499> 2024-03-09T14:41:56.781+0000 7f84c6b99640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.128 INFO:tasks.workunit.client.0.smithi088.stderr: -498> 2024-03-09T14:41:56.781+0000 7f84c6398640 10 monclient(hunting): handle_auth_done global_id 6747 payload 824 2024-03-09T14:41:57.128 INFO:tasks.workunit.client.0.smithi088.stderr: -497> 2024-03-09T14:41:56.781+0000 7f84c6398640 10 monclient: _finish_hunting 0 2024-03-09T14:41:57.128 INFO:tasks.workunit.client.0.smithi088.stderr: -496> 2024-03-09T14:41:56.781+0000 7f84c6398640 1 monclient: found mon.noname-a 2024-03-09T14:41:57.128 INFO:tasks.workunit.client.0.smithi088.stderr: -495> 2024-03-09T14:41:56.781+0000 7f84c6398640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.129 INFO:tasks.workunit.client.0.smithi088.stderr: -494> 2024-03-09T14:41:56.781+0000 7f83b3606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.129 INFO:tasks.workunit.client.0.smithi088.stderr: -493> 2024-03-09T14:41:56.781+0000 7f83b3606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:41:57.129 INFO:tasks.workunit.client.0.smithi088.stderr: -492> 2024-03-09T14:41:56.781+0000 7f83b3606640 10 monclient: dump: 2024-03-09T14:41:57.129 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.129 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.129 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.129 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.129 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.129 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.129 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.129 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.129 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.129 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.129 INFO:tasks.workunit.client.0.smithi088.stderr: -491> 2024-03-09T14:41:56.781+0000 7f83b3606640 10 monclient: _finish_auth 0 2024-03-09T14:41:57.130 INFO:tasks.workunit.client.0.smithi088.stderr: -490> 2024-03-09T14:41:56.781+0000 7f83b3606640 10 monclient: _check_auth_tickets 2024-03-09T14:41:57.130 INFO:tasks.workunit.client.0.smithi088.stderr: -489> 2024-03-09T14:41:56.782+0000 7f83b3606640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:57.130 INFO:tasks.workunit.client.0.smithi088.stderr: -488> 2024-03-09T14:41:56.782+0000 7f83b3606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.130 INFO:tasks.workunit.client.0.smithi088.stderr: -487> 2024-03-09T14:41:56.782+0000 7f83b3606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:41:57.130 INFO:tasks.workunit.client.0.smithi088.stderr: -486> 2024-03-09T14:41:56.782+0000 7f83b3606640 10 monclient: dump: 2024-03-09T14:41:57.130 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.130 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.130 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.130 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.130 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.130 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.130 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.130 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.130 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.130 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.131 INFO:tasks.workunit.client.0.smithi088.stderr: -485> 2024-03-09T14:41:56.782+0000 7f84c909d800 5 monclient: authenticate success, global_id 6747 2024-03-09T14:41:57.131 INFO:tasks.workunit.client.0.smithi088.stderr: -484> 2024-03-09T14:41:56.782+0000 7f84c909d800 10 monclient: _renew_subs 2024-03-09T14:41:57.131 INFO:tasks.workunit.client.0.smithi088.stderr: -483> 2024-03-09T14:41:56.782+0000 7f83b4e09640 4 set_mon_vals no callback set 2024-03-09T14:41:57.131 INFO:tasks.workunit.client.0.smithi088.stderr: -482> 2024-03-09T14:41:56.782+0000 7f84c909d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.131 INFO:tasks.workunit.client.0.smithi088.stderr: -481> 2024-03-09T14:41:56.782+0000 7f84c909d800 10 monclient: _renew_subs 2024-03-09T14:41:57.131 INFO:tasks.workunit.client.0.smithi088.stderr: -480> 2024-03-09T14:41:56.782+0000 7f84c909d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.131 INFO:tasks.workunit.client.0.smithi088.stderr: -479> 2024-03-09T14:41:56.782+0000 7f84c909d800 1 librados: init done 2024-03-09T14:41:57.131 INFO:tasks.workunit.client.0.smithi088.stderr: -478> 2024-03-09T14:41:56.783+0000 7f83b3606640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:41:57.131 INFO:tasks.workunit.client.0.smithi088.stderr: -477> 2024-03-09T14:41:56.783+0000 7f83b3606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:57.131 INFO:tasks.workunit.client.0.smithi088.stderr: -476> 2024-03-09T14:41:56.783+0000 7f83b3606640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:57.131 INFO:tasks.workunit.client.0.smithi088.stderr: -475> 2024-03-09T14:41:56.783+0000 7f84c6b99640 10 monclient: get_auth_request con 0x7f83ac06a5b0 auth_method 0 2024-03-09T14:41:57.131 INFO:tasks.workunit.client.0.smithi088.stderr: -474> 2024-03-09T14:41:56.784+0000 7f84c739a640 10 monclient: get_auth_request con 0x56064818e3e0 auth_method 0 2024-03-09T14:41:57.131 INFO:tasks.workunit.client.0.smithi088.stderr: -473> 2024-03-09T14:41:56.784+0000 7f84c6b99640 10 monclient: get_auth_request con 0x5606481ad250 auth_method 0 2024-03-09T14:41:57.131 INFO:tasks.workunit.client.0.smithi088.stderr: -472> 2024-03-09T14:41:56.785+0000 7f84c6398640 10 monclient: get_auth_request con 0x5606481b16c0 auth_method 0 2024-03-09T14:41:57.132 INFO:tasks.workunit.client.0.smithi088.stderr: -471> 2024-03-09T14:41:56.786+0000 7f84c739a640 10 monclient: get_auth_request con 0x5606481b0b40 auth_method 0 2024-03-09T14:41:57.132 INFO:tasks.workunit.client.0.smithi088.stderr: -470> 2024-03-09T14:41:56.787+0000 7f84c909d800 10 monclient: build_initial_monmap 2024-03-09T14:41:57.132 INFO:tasks.workunit.client.0.smithi088.stderr: -469> 2024-03-09T14:41:56.787+0000 7f84c909d800 1 build_initial for_mkfs: 0 2024-03-09T14:41:57.132 INFO:tasks.workunit.client.0.smithi088.stderr: -468> 2024-03-09T14:41:56.787+0000 7f84c909d800 10 monclient: monmap: 2024-03-09T14:41:57.132 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:41:57.132 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:41:57.132 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:41:57.132 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:41:57.132 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:41:57.132 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.132 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:41:57.132 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:41:57.132 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:41:57.132 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.133 INFO:tasks.workunit.client.0.smithi088.stderr: -467> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding auth protocol: cephx 2024-03-09T14:41:57.133 INFO:tasks.workunit.client.0.smithi088.stderr: -466> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding auth protocol: cephx 2024-03-09T14:41:57.133 INFO:tasks.workunit.client.0.smithi088.stderr: -465> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding auth protocol: cephx 2024-03-09T14:41:57.133 INFO:tasks.workunit.client.0.smithi088.stderr: -464> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: secure 2024-03-09T14:41:57.133 INFO:tasks.workunit.client.0.smithi088.stderr: -463> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: crc 2024-03-09T14:41:57.133 INFO:tasks.workunit.client.0.smithi088.stderr: -462> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: secure 2024-03-09T14:41:57.133 INFO:tasks.workunit.client.0.smithi088.stderr: -461> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: crc 2024-03-09T14:41:57.133 INFO:tasks.workunit.client.0.smithi088.stderr: -460> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: secure 2024-03-09T14:41:57.133 INFO:tasks.workunit.client.0.smithi088.stderr: -459> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: crc 2024-03-09T14:41:57.133 INFO:tasks.workunit.client.0.smithi088.stderr: -458> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: crc 2024-03-09T14:41:57.133 INFO:tasks.workunit.client.0.smithi088.stderr: -457> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: secure 2024-03-09T14:41:57.133 INFO:tasks.workunit.client.0.smithi088.stderr: -456> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: crc 2024-03-09T14:41:57.133 INFO:tasks.workunit.client.0.smithi088.stderr: -455> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: secure 2024-03-09T14:41:57.133 INFO:tasks.workunit.client.0.smithi088.stderr: -454> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: crc 2024-03-09T14:41:57.134 INFO:tasks.workunit.client.0.smithi088.stderr: -453> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b98a0) adding con mode: secure 2024-03-09T14:41:57.134 INFO:tasks.workunit.client.0.smithi088.stderr: -452> 2024-03-09T14:41:56.787+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.134 INFO:tasks.workunit.client.0.smithi088.stderr: -451> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 asok(0x560647f43780) register_command objecter_requests cmddesc objecter_requests hook 0x5606481befb0 EEXIST 2024-03-09T14:41:57.134 INFO:tasks.workunit.client.0.smithi088.stderr: -450> 2024-03-09T14:41:56.787+0000 7f84c909d800 10 monclient: init 2024-03-09T14:41:57.134 INFO:tasks.workunit.client.0.smithi088.stderr: -449> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding auth protocol: cephx 2024-03-09T14:41:57.134 INFO:tasks.workunit.client.0.smithi088.stderr: -448> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding auth protocol: cephx 2024-03-09T14:41:57.134 INFO:tasks.workunit.client.0.smithi088.stderr: -447> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding auth protocol: cephx 2024-03-09T14:41:57.134 INFO:tasks.workunit.client.0.smithi088.stderr: -446> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: secure 2024-03-09T14:41:57.134 INFO:tasks.workunit.client.0.smithi088.stderr: -445> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: crc 2024-03-09T14:41:57.134 INFO:tasks.workunit.client.0.smithi088.stderr: -444> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: secure 2024-03-09T14:41:57.134 INFO:tasks.workunit.client.0.smithi088.stderr: -443> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: crc 2024-03-09T14:41:57.134 INFO:tasks.workunit.client.0.smithi088.stderr: -442> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: secure 2024-03-09T14:41:57.134 INFO:tasks.workunit.client.0.smithi088.stderr: -441> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: crc 2024-03-09T14:41:57.134 INFO:tasks.workunit.client.0.smithi088.stderr: -440> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: crc 2024-03-09T14:41:57.135 INFO:tasks.workunit.client.0.smithi088.stderr: -439> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: secure 2024-03-09T14:41:57.135 INFO:tasks.workunit.client.0.smithi088.stderr: -438> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: crc 2024-03-09T14:41:57.137 INFO:tasks.workunit.client.0.smithi088.stderr: -437> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: secure 2024-03-09T14:41:57.137 INFO:tasks.workunit.client.0.smithi088.stderr: -436> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: crc 2024-03-09T14:41:57.137 INFO:tasks.workunit.client.0.smithi088.stderr: -435> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 AuthRegistry(0x5606481b87e8) adding con mode: secure 2024-03-09T14:41:57.137 INFO:tasks.workunit.client.0.smithi088.stderr: -434> 2024-03-09T14:41:56.787+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.137 INFO:tasks.workunit.client.0.smithi088.stderr: -433> 2024-03-09T14:41:56.787+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.137 INFO:tasks.workunit.client.0.smithi088.stderr: -432> 2024-03-09T14:41:56.787+0000 7f84c909d800 5 asok(0x560647f43780) register_command rotate-key cmddesc rotate-key hook 0x5606481b8930 EEXIST 2024-03-09T14:41:57.137 INFO:tasks.workunit.client.0.smithi088.stderr: -431> 2024-03-09T14:41:56.787+0000 7f84c909d800 10 monclient: _reopen_session rank -1 2024-03-09T14:41:57.137 INFO:tasks.workunit.client.0.smithi088.stderr: -430> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:41:57.137 INFO:tasks.workunit.client.0.smithi088.stderr: -429> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-c con 0x5606481e3d10 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:57.137 INFO:tasks.workunit.client.0.smithi088.stderr: -428> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-b con 0x5606481e40f0 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:57.138 INFO:tasks.workunit.client.0.smithi088.stderr: -427> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-a con 0x5606481df1b0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:57.138 INFO:tasks.workunit.client.0.smithi088.stderr: -426> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.138 INFO:tasks.workunit.client.0.smithi088.stderr: -425> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.138 INFO:tasks.workunit.client.0.smithi088.stderr: -424> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.138 INFO:tasks.workunit.client.0.smithi088.stderr: -423> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): _renew_subs 2024-03-09T14:41:57.138 INFO:tasks.workunit.client.0.smithi088.stderr: -422> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient(hunting): authenticate will time out at 1732.126315s 2024-03-09T14:41:57.138 INFO:tasks.workunit.client.0.smithi088.stderr: -421> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): get_auth_request con 0x5606481e3d10 auth_method 0 2024-03-09T14:41:57.138 INFO:tasks.workunit.client.0.smithi088.stderr: -420> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.138 INFO:tasks.workunit.client.0.smithi088.stderr: -419> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.138 INFO:tasks.workunit.client.0.smithi088.stderr: -418> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.138 INFO:tasks.workunit.client.0.smithi088.stderr: -417> 2024-03-09T14:41:56.788+0000 7f84c6b99640 10 monclient(hunting): get_auth_request con 0x5606481df1b0 auth_method 0 2024-03-09T14:41:57.138 INFO:tasks.workunit.client.0.smithi088.stderr: -416> 2024-03-09T14:41:56.788+0000 7f84c6b99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.138 INFO:tasks.workunit.client.0.smithi088.stderr: -415> 2024-03-09T14:41:56.788+0000 7f84c6b99640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.138 INFO:tasks.workunit.client.0.smithi088.stderr: -414> 2024-03-09T14:41:56.788+0000 7f84c6b99640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.139 INFO:tasks.workunit.client.0.smithi088.stderr: -413> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.139 INFO:tasks.workunit.client.0.smithi088.stderr: -412> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.139 INFO:tasks.workunit.client.0.smithi088.stderr: -411> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:57.139 INFO:tasks.workunit.client.0.smithi088.stderr: -410> 2024-03-09T14:41:56.788+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.139 INFO:tasks.workunit.client.0.smithi088.stderr: -409> 2024-03-09T14:41:56.788+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.139 INFO:tasks.workunit.client.0.smithi088.stderr: -408> 2024-03-09T14:41:56.788+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:57.139 INFO:tasks.workunit.client.0.smithi088.stderr: -407> 2024-03-09T14:41:56.788+0000 7f84c739a640 10 monclient(hunting): get_auth_request con 0x5606481e40f0 auth_method 0 2024-03-09T14:41:57.139 INFO:tasks.workunit.client.0.smithi088.stderr: -406> 2024-03-09T14:41:56.788+0000 7f84c739a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.139 INFO:tasks.workunit.client.0.smithi088.stderr: -405> 2024-03-09T14:41:56.788+0000 7f84c739a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.139 INFO:tasks.workunit.client.0.smithi088.stderr: -404> 2024-03-09T14:41:56.788+0000 7f84c739a640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.139 INFO:tasks.workunit.client.0.smithi088.stderr: -403> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient(hunting): handle_auth_done global_id 6440 payload 824 2024-03-09T14:41:57.139 INFO:tasks.workunit.client.0.smithi088.stderr: -402> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient: _finish_hunting 0 2024-03-09T14:41:57.139 INFO:tasks.workunit.client.0.smithi088.stderr: -401> 2024-03-09T14:41:56.788+0000 7f84c6398640 1 monclient: found mon.noname-c 2024-03-09T14:41:57.139 INFO:tasks.workunit.client.0.smithi088.stderr: -400> 2024-03-09T14:41:56.788+0000 7f84c6398640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:41:57.140 INFO:tasks.workunit.client.0.smithi088.stderr: -399> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.140 INFO:tasks.workunit.client.0.smithi088.stderr: -398> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:41:57.140 INFO:tasks.workunit.client.0.smithi088.stderr: -397> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: dump: 2024-03-09T14:41:57.140 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.140 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.140 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.140 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.140 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.140 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.140 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.140 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.140 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.140 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.140 INFO:tasks.workunit.client.0.smithi088.stderr: -396> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: _finish_auth 0 2024-03-09T14:41:57.140 INFO:tasks.workunit.client.0.smithi088.stderr: -395> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: _check_auth_tickets 2024-03-09T14:41:57.141 INFO:tasks.workunit.client.0.smithi088.stderr: -394> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:57.141 INFO:tasks.workunit.client.0.smithi088.stderr: -393> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.141 INFO:tasks.workunit.client.0.smithi088.stderr: -392> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:41:57.141 INFO:tasks.workunit.client.0.smithi088.stderr: -391> 2024-03-09T14:41:56.788+0000 7f83b0e01640 10 monclient: dump: 2024-03-09T14:41:57.141 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.141 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.141 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.141 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.141 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.141 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.141 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.141 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.141 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.141 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.141 INFO:tasks.workunit.client.0.smithi088.stderr: -390> 2024-03-09T14:41:56.788+0000 7f84c909d800 5 monclient: authenticate success, global_id 6440 2024-03-09T14:41:57.142 INFO:tasks.workunit.client.0.smithi088.stderr: -389> 2024-03-09T14:41:56.788+0000 7f84c7b9b640 4 set_mon_vals no callback set 2024-03-09T14:41:57.142 INFO:tasks.workunit.client.0.smithi088.stderr: -388> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient: _renew_subs 2024-03-09T14:41:57.142 INFO:tasks.workunit.client.0.smithi088.stderr: -387> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:41:57.142 INFO:tasks.workunit.client.0.smithi088.stderr: -386> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient: _renew_subs 2024-03-09T14:41:57.142 INFO:tasks.workunit.client.0.smithi088.stderr: -385> 2024-03-09T14:41:56.788+0000 7f84c909d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:41:57.142 INFO:tasks.workunit.client.0.smithi088.stderr: -384> 2024-03-09T14:41:56.790+0000 7f83b0e01640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:41:57.142 INFO:tasks.workunit.client.0.smithi088.stderr: -383> 2024-03-09T14:41:56.790+0000 7f83b0e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:57.142 INFO:tasks.workunit.client.0.smithi088.stderr: -382> 2024-03-09T14:41:56.790+0000 7f83b0e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:57.142 INFO:tasks.workunit.client.0.smithi088.stderr: -381> 2024-03-09T14:41:56.790+0000 7f84c739a640 10 monclient: get_auth_request con 0x7f83a006a4c0 auth_method 0 2024-03-09T14:41:57.142 INFO:tasks.workunit.client.0.smithi088.stderr: -380> 2024-03-09T14:41:56.790+0000 7f84c909d800 10 monclient: get_monmap_and_config 2024-03-09T14:41:57.142 INFO:tasks.workunit.client.0.smithi088.stderr: -379> 2024-03-09T14:41:56.790+0000 7f84c909d800 10 monclient: build_initial_monmap 2024-03-09T14:41:57.142 INFO:tasks.workunit.client.0.smithi088.stderr: -378> 2024-03-09T14:41:56.790+0000 7f84c909d800 1 build_initial for_mkfs: 0 2024-03-09T14:41:57.142 INFO:tasks.workunit.client.0.smithi088.stderr: -377> 2024-03-09T14:41:56.790+0000 7f84c909d800 10 monclient: monmap: 2024-03-09T14:41:57.143 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:41:57.143 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:41:57.143 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:41:57.143 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:41:57.143 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:41:57.143 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.143 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:41:57.143 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:41:57.143 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:41:57.143 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.143 INFO:tasks.workunit.client.0.smithi088.stderr: -376> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding auth protocol: cephx 2024-03-09T14:41:57.143 INFO:tasks.workunit.client.0.smithi088.stderr: -375> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding auth protocol: cephx 2024-03-09T14:41:57.143 INFO:tasks.workunit.client.0.smithi088.stderr: -374> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding auth protocol: cephx 2024-03-09T14:41:57.143 INFO:tasks.workunit.client.0.smithi088.stderr: -373> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.144 INFO:tasks.workunit.client.0.smithi088.stderr: -372> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.144 INFO:tasks.workunit.client.0.smithi088.stderr: -371> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.144 INFO:tasks.workunit.client.0.smithi088.stderr: -370> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.144 INFO:tasks.workunit.client.0.smithi088.stderr: -369> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.144 INFO:tasks.workunit.client.0.smithi088.stderr: -368> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.144 INFO:tasks.workunit.client.0.smithi088.stderr: -367> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.144 INFO:tasks.workunit.client.0.smithi088.stderr: -366> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.144 INFO:tasks.workunit.client.0.smithi088.stderr: -365> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.144 INFO:tasks.workunit.client.0.smithi088.stderr: -364> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.144 INFO:tasks.workunit.client.0.smithi088.stderr: -363> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.144 INFO:tasks.workunit.client.0.smithi088.stderr: -362> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.144 INFO:tasks.workunit.client.0.smithi088.stderr: -361> 2024-03-09T14:41:56.790+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.144 INFO:tasks.workunit.client.0.smithi088.stderr: -360> 2024-03-09T14:41:56.790+0000 7f84c909d800 10 monclient: init 2024-03-09T14:41:57.144 INFO:tasks.workunit.client.0.smithi088.stderr: -359> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding auth protocol: cephx 2024-03-09T14:41:57.145 INFO:tasks.workunit.client.0.smithi088.stderr: -358> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding auth protocol: cephx 2024-03-09T14:41:57.145 INFO:tasks.workunit.client.0.smithi088.stderr: -357> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding auth protocol: cephx 2024-03-09T14:41:57.145 INFO:tasks.workunit.client.0.smithi088.stderr: -356> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: secure 2024-03-09T14:41:57.145 INFO:tasks.workunit.client.0.smithi088.stderr: -355> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: crc 2024-03-09T14:41:57.145 INFO:tasks.workunit.client.0.smithi088.stderr: -354> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: secure 2024-03-09T14:41:57.145 INFO:tasks.workunit.client.0.smithi088.stderr: -353> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: crc 2024-03-09T14:41:57.145 INFO:tasks.workunit.client.0.smithi088.stderr: -352> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: secure 2024-03-09T14:41:57.145 INFO:tasks.workunit.client.0.smithi088.stderr: -351> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: crc 2024-03-09T14:41:57.145 INFO:tasks.workunit.client.0.smithi088.stderr: -350> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: crc 2024-03-09T14:41:57.145 INFO:tasks.workunit.client.0.smithi088.stderr: -349> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: secure 2024-03-09T14:41:57.145 INFO:tasks.workunit.client.0.smithi088.stderr: -348> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: crc 2024-03-09T14:41:57.145 INFO:tasks.workunit.client.0.smithi088.stderr: -347> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: secure 2024-03-09T14:41:57.145 INFO:tasks.workunit.client.0.smithi088.stderr: -346> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: crc 2024-03-09T14:41:57.145 INFO:tasks.workunit.client.0.smithi088.stderr: -345> 2024-03-09T14:41:56.790+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019860) adding con mode: secure 2024-03-09T14:41:57.146 INFO:tasks.workunit.client.0.smithi088.stderr: -344> 2024-03-09T14:41:56.791+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.146 INFO:tasks.workunit.client.0.smithi088.stderr: -343> 2024-03-09T14:41:56.791+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.146 INFO:tasks.workunit.client.0.smithi088.stderr: -342> 2024-03-09T14:41:56.791+0000 7f84c909d800 5 asok(0x560647f43780) register_command rotate-key cmddesc rotate-key hook 0x7ffccd0199a8 EEXIST 2024-03-09T14:41:57.146 INFO:tasks.workunit.client.0.smithi088.stderr: -341> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient: _reopen_session rank -1 2024-03-09T14:41:57.146 INFO:tasks.workunit.client.0.smithi088.stderr: -340> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:41:57.146 INFO:tasks.workunit.client.0.smithi088.stderr: -339> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-b con 0x560648236000 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:57.146 INFO:tasks.workunit.client.0.smithi088.stderr: -338> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-a con 0x5606482363e0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:57.146 INFO:tasks.workunit.client.0.smithi088.stderr: -337> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-c con 0x560648231eb0 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:57.146 INFO:tasks.workunit.client.0.smithi088.stderr: -336> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.146 INFO:tasks.workunit.client.0.smithi088.stderr: -335> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.146 INFO:tasks.workunit.client.0.smithi088.stderr: -334> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.146 INFO:tasks.workunit.client.0.smithi088.stderr: -333> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): _renew_subs 2024-03-09T14:41:57.146 INFO:tasks.workunit.client.0.smithi088.stderr: -332> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient(hunting): authenticate will time out at 1732.129567s 2024-03-09T14:41:57.147 INFO:tasks.workunit.client.0.smithi088.stderr: -331> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): get_auth_request con 0x5606482363e0 auth_method 0 2024-03-09T14:41:57.147 INFO:tasks.workunit.client.0.smithi088.stderr: -330> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.147 INFO:tasks.workunit.client.0.smithi088.stderr: -329> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.147 INFO:tasks.workunit.client.0.smithi088.stderr: -328> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.147 INFO:tasks.workunit.client.0.smithi088.stderr: -327> 2024-03-09T14:41:56.791+0000 7f84c6b99640 10 monclient(hunting): get_auth_request con 0x560648231eb0 auth_method 0 2024-03-09T14:41:57.147 INFO:tasks.workunit.client.0.smithi088.stderr: -326> 2024-03-09T14:41:56.791+0000 7f84c6b99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.147 INFO:tasks.workunit.client.0.smithi088.stderr: -325> 2024-03-09T14:41:56.791+0000 7f84c6b99640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.147 INFO:tasks.workunit.client.0.smithi088.stderr: -324> 2024-03-09T14:41:56.791+0000 7f84c6b99640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.147 INFO:tasks.workunit.client.0.smithi088.stderr: -323> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.147 INFO:tasks.workunit.client.0.smithi088.stderr: -322> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.147 INFO:tasks.workunit.client.0.smithi088.stderr: -321> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:57.147 INFO:tasks.workunit.client.0.smithi088.stderr: -320> 2024-03-09T14:41:56.791+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.147 INFO:tasks.workunit.client.0.smithi088.stderr: -319> 2024-03-09T14:41:56.791+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.147 INFO:tasks.workunit.client.0.smithi088.stderr: -318> 2024-03-09T14:41:56.791+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:57.147 INFO:tasks.workunit.client.0.smithi088.stderr: -317> 2024-03-09T14:41:56.791+0000 7f84c6398640 10 monclient(hunting): get_auth_request con 0x560648236000 auth_method 0 2024-03-09T14:41:57.148 INFO:tasks.workunit.client.0.smithi088.stderr: -316> 2024-03-09T14:41:56.791+0000 7f84c6398640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.148 INFO:tasks.workunit.client.0.smithi088.stderr: -315> 2024-03-09T14:41:56.791+0000 7f84c6398640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.148 INFO:tasks.workunit.client.0.smithi088.stderr: -314> 2024-03-09T14:41:56.791+0000 7f84c6398640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.148 INFO:tasks.workunit.client.0.smithi088.stderr: -313> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient(hunting): handle_auth_done global_id 6753 payload 274 2024-03-09T14:41:57.148 INFO:tasks.workunit.client.0.smithi088.stderr: -312> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient: _finish_hunting 0 2024-03-09T14:41:57.148 INFO:tasks.workunit.client.0.smithi088.stderr: -311> 2024-03-09T14:41:56.791+0000 7f84c739a640 1 monclient: found mon.noname-a 2024-03-09T14:41:57.148 INFO:tasks.workunit.client.0.smithi088.stderr: -310> 2024-03-09T14:41:56.791+0000 7f84c739a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.148 INFO:tasks.workunit.client.0.smithi088.stderr: -309> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.148 INFO:tasks.workunit.client.0.smithi088.stderr: -308> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:41:57.148 INFO:tasks.workunit.client.0.smithi088.stderr: -307> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: dump: 2024-03-09T14:41:57.148 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.148 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.148 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.148 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.149 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.149 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.149 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.149 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.149 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.149 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.149 INFO:tasks.workunit.client.0.smithi088.stderr: -306> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: _finish_auth 0 2024-03-09T14:41:57.149 INFO:tasks.workunit.client.0.smithi088.stderr: -305> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: _check_auth_tickets 2024-03-09T14:41:57.149 INFO:tasks.workunit.client.0.smithi088.stderr: -304> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:57.149 INFO:tasks.workunit.client.0.smithi088.stderr: -303> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.149 INFO:tasks.workunit.client.0.smithi088.stderr: -302> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:41:57.149 INFO:tasks.workunit.client.0.smithi088.stderr: -301> 2024-03-09T14:41:56.791+0000 7f83aa7fc640 10 monclient: dump: 2024-03-09T14:41:57.149 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.149 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.149 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.150 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.150 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.150 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.150 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.150 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.150 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.150 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.150 INFO:tasks.workunit.client.0.smithi088.stderr: -300> 2024-03-09T14:41:56.791+0000 7f84c909d800 5 monclient: authenticate success, global_id 6753 2024-03-09T14:41:57.150 INFO:tasks.workunit.client.0.smithi088.stderr: -299> 2024-03-09T14:41:56.791+0000 7f84c909d800 10 monclient: get_monmap_and_config success 2024-03-09T14:41:57.150 INFO:tasks.workunit.client.0.smithi088.stderr: -298> 2024-03-09T14:41:56.791+0000 7f84c909d800 4 set_mon_vals no callback set 2024-03-09T14:41:57.150 INFO:tasks.workunit.client.0.smithi088.stderr: -297> 2024-03-09T14:41:56.792+0000 7f84c909d800 10 monclient: shutdown 2024-03-09T14:41:57.150 INFO:tasks.workunit.client.0.smithi088.stderr: -296> 2024-03-09T14:41:56.792+0000 7f84c909d800 10 monclient: build_initial_monmap 2024-03-09T14:41:57.150 INFO:tasks.workunit.client.0.smithi088.stderr: -295> 2024-03-09T14:41:56.792+0000 7f84c909d800 1 build_initial for_mkfs: 0 2024-03-09T14:41:57.150 INFO:tasks.workunit.client.0.smithi088.stderr: -294> 2024-03-09T14:41:56.792+0000 7f84c909d800 10 monclient: monmap: 2024-03-09T14:41:57.151 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:41:57.151 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:41:57.151 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:41:57.151 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:41:57.151 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:41:57.151 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.151 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:41:57.151 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:41:57.151 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:41:57.151 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.151 INFO:tasks.workunit.client.0.smithi088.stderr: -293> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding auth protocol: cephx 2024-03-09T14:41:57.151 INFO:tasks.workunit.client.0.smithi088.stderr: -292> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding auth protocol: cephx 2024-03-09T14:41:57.151 INFO:tasks.workunit.client.0.smithi088.stderr: -291> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding auth protocol: cephx 2024-03-09T14:41:57.152 INFO:tasks.workunit.client.0.smithi088.stderr: -290> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.152 INFO:tasks.workunit.client.0.smithi088.stderr: -289> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.152 INFO:tasks.workunit.client.0.smithi088.stderr: -288> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.152 INFO:tasks.workunit.client.0.smithi088.stderr: -287> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.152 INFO:tasks.workunit.client.0.smithi088.stderr: -286> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.152 INFO:tasks.workunit.client.0.smithi088.stderr: -285> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.152 INFO:tasks.workunit.client.0.smithi088.stderr: -284> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.152 INFO:tasks.workunit.client.0.smithi088.stderr: -283> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.152 INFO:tasks.workunit.client.0.smithi088.stderr: -282> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.152 INFO:tasks.workunit.client.0.smithi088.stderr: -281> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.152 INFO:tasks.workunit.client.0.smithi088.stderr: -280> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: crc 2024-03-09T14:41:57.152 INFO:tasks.workunit.client.0.smithi088.stderr: -279> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648201860) adding con mode: secure 2024-03-09T14:41:57.152 INFO:tasks.workunit.client.0.smithi088.stderr: -278> 2024-03-09T14:41:56.792+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.152 INFO:tasks.workunit.client.0.smithi088.stderr: -277> 2024-03-09T14:41:56.792+0000 7f84c909d800 1 librados: starting msgr at 2024-03-09T14:41:57.152 INFO:tasks.workunit.client.0.smithi088.stderr: -276> 2024-03-09T14:41:56.792+0000 7f84c909d800 1 librados: starting objecter 2024-03-09T14:41:57.153 INFO:tasks.workunit.client.0.smithi088.stderr: -275> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 asok(0x560647f43780) register_command objecter_requests cmddesc objecter_requests hook 0x5606481e2b60 EEXIST 2024-03-09T14:41:57.153 INFO:tasks.workunit.client.0.smithi088.stderr: -274> 2024-03-09T14:41:56.792+0000 7f84c909d800 1 librados: setting wanted keys 2024-03-09T14:41:57.153 INFO:tasks.workunit.client.0.smithi088.stderr: -273> 2024-03-09T14:41:56.792+0000 7f84c909d800 1 librados: calling monclient init 2024-03-09T14:41:57.153 INFO:tasks.workunit.client.0.smithi088.stderr: -272> 2024-03-09T14:41:56.792+0000 7f84c909d800 10 monclient: init 2024-03-09T14:41:57.153 INFO:tasks.workunit.client.0.smithi088.stderr: -271> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding auth protocol: cephx 2024-03-09T14:41:57.153 INFO:tasks.workunit.client.0.smithi088.stderr: -270> 2024-03-09T14:41:56.792+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding auth protocol: cephx 2024-03-09T14:41:57.153 INFO:tasks.workunit.client.0.smithi088.stderr: -269> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding auth protocol: cephx 2024-03-09T14:41:57.153 INFO:tasks.workunit.client.0.smithi088.stderr: -268> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: secure 2024-03-09T14:41:57.153 INFO:tasks.workunit.client.0.smithi088.stderr: -267> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: crc 2024-03-09T14:41:57.153 INFO:tasks.workunit.client.0.smithi088.stderr: -266> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: secure 2024-03-09T14:41:57.153 INFO:tasks.workunit.client.0.smithi088.stderr: -265> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: crc 2024-03-09T14:41:57.153 INFO:tasks.workunit.client.0.smithi088.stderr: -264> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: secure 2024-03-09T14:41:57.153 INFO:tasks.workunit.client.0.smithi088.stderr: -263> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: crc 2024-03-09T14:41:57.153 INFO:tasks.workunit.client.0.smithi088.stderr: -262> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: crc 2024-03-09T14:41:57.153 INFO:tasks.workunit.client.0.smithi088.stderr: -261> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: secure 2024-03-09T14:41:57.154 INFO:tasks.workunit.client.0.smithi088.stderr: -260> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: crc 2024-03-09T14:41:57.154 INFO:tasks.workunit.client.0.smithi088.stderr: -259> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: secure 2024-03-09T14:41:57.154 INFO:tasks.workunit.client.0.smithi088.stderr: -258> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: crc 2024-03-09T14:41:57.154 INFO:tasks.workunit.client.0.smithi088.stderr: -257> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 AuthRegistry(0x560648200a30) adding con mode: secure 2024-03-09T14:41:57.154 INFO:tasks.workunit.client.0.smithi088.stderr: -256> 2024-03-09T14:41:56.793+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.154 INFO:tasks.workunit.client.0.smithi088.stderr: -255> 2024-03-09T14:41:56.793+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.154 INFO:tasks.workunit.client.0.smithi088.stderr: -254> 2024-03-09T14:41:56.793+0000 7f84c909d800 5 asok(0x560647f43780) register_command rotate-key cmddesc rotate-key hook 0x560648200b78 EEXIST 2024-03-09T14:41:57.154 INFO:tasks.workunit.client.0.smithi088.stderr: -253> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient: _reopen_session rank -1 2024-03-09T14:41:57.154 INFO:tasks.workunit.client.0.smithi088.stderr: -252> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:41:57.154 INFO:tasks.workunit.client.0.smithi088.stderr: -251> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-b con 0x560648231eb0 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:57.154 INFO:tasks.workunit.client.0.smithi088.stderr: -250> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-a con 0x560648236000 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:57.154 INFO:tasks.workunit.client.0.smithi088.stderr: -249> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): picked mon.noname-c con 0x56064822eb20 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:57.154 INFO:tasks.workunit.client.0.smithi088.stderr: -248> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.155 INFO:tasks.workunit.client.0.smithi088.stderr: -247> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.155 INFO:tasks.workunit.client.0.smithi088.stderr: -246> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.155 INFO:tasks.workunit.client.0.smithi088.stderr: -245> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): _renew_subs 2024-03-09T14:41:57.155 INFO:tasks.workunit.client.0.smithi088.stderr: -244> 2024-03-09T14:41:56.793+0000 7f84c909d800 10 monclient(hunting): authenticate will time out at 1732.131756s 2024-03-09T14:41:57.155 INFO:tasks.workunit.client.0.smithi088.stderr: -243> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): get_auth_request con 0x560648236000 auth_method 0 2024-03-09T14:41:57.155 INFO:tasks.workunit.client.0.smithi088.stderr: -242> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.155 INFO:tasks.workunit.client.0.smithi088.stderr: -241> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.155 INFO:tasks.workunit.client.0.smithi088.stderr: -240> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.155 INFO:tasks.workunit.client.0.smithi088.stderr: -239> 2024-03-09T14:41:56.793+0000 7f84c6b99640 10 monclient(hunting): get_auth_request con 0x56064822eb20 auth_method 0 2024-03-09T14:41:57.155 INFO:tasks.workunit.client.0.smithi088.stderr: -238> 2024-03-09T14:41:56.793+0000 7f84c6b99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.155 INFO:tasks.workunit.client.0.smithi088.stderr: -237> 2024-03-09T14:41:56.793+0000 7f84c6b99640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.155 INFO:tasks.workunit.client.0.smithi088.stderr: -236> 2024-03-09T14:41:56.793+0000 7f84c6b99640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.155 INFO:tasks.workunit.client.0.smithi088.stderr: -235> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.155 INFO:tasks.workunit.client.0.smithi088.stderr: -234> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.155 INFO:tasks.workunit.client.0.smithi088.stderr: -233> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:57.156 INFO:tasks.workunit.client.0.smithi088.stderr: -232> 2024-03-09T14:41:56.793+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.156 INFO:tasks.workunit.client.0.smithi088.stderr: -231> 2024-03-09T14:41:56.793+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.156 INFO:tasks.workunit.client.0.smithi088.stderr: -230> 2024-03-09T14:41:56.793+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:57.156 INFO:tasks.workunit.client.0.smithi088.stderr: -229> 2024-03-09T14:41:56.793+0000 7f84c6398640 10 monclient(hunting): get_auth_request con 0x560648231eb0 auth_method 0 2024-03-09T14:41:57.156 INFO:tasks.workunit.client.0.smithi088.stderr: -228> 2024-03-09T14:41:56.793+0000 7f84c6398640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.156 INFO:tasks.workunit.client.0.smithi088.stderr: -227> 2024-03-09T14:41:56.793+0000 7f84c6398640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.156 INFO:tasks.workunit.client.0.smithi088.stderr: -226> 2024-03-09T14:41:56.793+0000 7f84c6398640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:41:57.156 INFO:tasks.workunit.client.0.smithi088.stderr: -225> 2024-03-09T14:41:56.793+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.156 INFO:tasks.workunit.client.0.smithi088.stderr: -224> 2024-03-09T14:41:56.793+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.156 INFO:tasks.workunit.client.0.smithi088.stderr: -223> 2024-03-09T14:41:56.793+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:41:57.156 INFO:tasks.workunit.client.0.smithi088.stderr: -222> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient(hunting): handle_auth_done global_id 6756 payload 824 2024-03-09T14:41:57.156 INFO:tasks.workunit.client.0.smithi088.stderr: -221> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient: _finish_hunting 0 2024-03-09T14:41:57.156 INFO:tasks.workunit.client.0.smithi088.stderr: -220> 2024-03-09T14:41:56.793+0000 7f84c739a640 1 monclient: found mon.noname-a 2024-03-09T14:41:57.156 INFO:tasks.workunit.client.0.smithi088.stderr: -219> 2024-03-09T14:41:56.793+0000 7f84c739a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.157 INFO:tasks.workunit.client.0.smithi088.stderr: -218> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.157 INFO:tasks.workunit.client.0.smithi088.stderr: -217> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:41:57.157 INFO:tasks.workunit.client.0.smithi088.stderr: -216> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: dump: 2024-03-09T14:41:57.157 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.157 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.157 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.157 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.157 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.157 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.157 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.157 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.157 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.157 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.157 INFO:tasks.workunit.client.0.smithi088.stderr: -215> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: _finish_auth 0 2024-03-09T14:41:57.158 INFO:tasks.workunit.client.0.smithi088.stderr: -214> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: _check_auth_tickets 2024-03-09T14:41:57.158 INFO:tasks.workunit.client.0.smithi088.stderr: -213> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:57.158 INFO:tasks.workunit.client.0.smithi088.stderr: -212> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.158 INFO:tasks.workunit.client.0.smithi088.stderr: -211> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:41:57.158 INFO:tasks.workunit.client.0.smithi088.stderr: -210> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: dump: 2024-03-09T14:41:57.158 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.158 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.158 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.158 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.158 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.158 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.158 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.158 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.158 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.159 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.159 INFO:tasks.workunit.client.0.smithi088.stderr: -209> 2024-03-09T14:41:56.794+0000 7f83aa7fc640 4 set_mon_vals no callback set 2024-03-09T14:41:57.159 INFO:tasks.workunit.client.0.smithi088.stderr: -208> 2024-03-09T14:41:56.794+0000 7f84c909d800 5 monclient: authenticate success, global_id 6756 2024-03-09T14:41:57.159 INFO:tasks.workunit.client.0.smithi088.stderr: -207> 2024-03-09T14:41:56.794+0000 7f84c909d800 10 monclient: _renew_subs 2024-03-09T14:41:57.159 INFO:tasks.workunit.client.0.smithi088.stderr: -206> 2024-03-09T14:41:56.794+0000 7f84c909d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.159 INFO:tasks.workunit.client.0.smithi088.stderr: -205> 2024-03-09T14:41:56.794+0000 7f84c909d800 10 monclient: _renew_subs 2024-03-09T14:41:57.159 INFO:tasks.workunit.client.0.smithi088.stderr: -204> 2024-03-09T14:41:56.794+0000 7f84c909d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.159 INFO:tasks.workunit.client.0.smithi088.stderr: -203> 2024-03-09T14:41:56.794+0000 7f84c909d800 1 librados: init done 2024-03-09T14:41:57.159 INFO:tasks.workunit.client.0.smithi088.stderr: -202> 2024-03-09T14:41:56.794+0000 7f84c909d800 5 asok(0x560647f43780) register_command cr dump hook 0x5606482390e8 2024-03-09T14:41:57.159 INFO:tasks.workunit.client.0.smithi088.stderr: -201> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: ms_handle_reset current mon [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:57.159 INFO:tasks.workunit.client.0.smithi088.stderr: -200> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: _reopen_session rank -1 2024-03-09T14:41:57.159 INFO:tasks.workunit.client.0.smithi088.stderr: -199> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:41:57.159 INFO:tasks.workunit.client.0.smithi088.stderr: -198> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient(hunting): picked mon.b con 0x560648231eb0 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:41:57.159 INFO:tasks.workunit.client.0.smithi088.stderr: -197> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient(hunting): picked mon.a con 0x7f8390004c20 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:41:57.159 INFO:tasks.workunit.client.0.smithi088.stderr: -196> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient(hunting): picked mon.c con 0x56064822eb20 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:41:57.160 INFO:tasks.workunit.client.0.smithi088.stderr: -195> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.160 INFO:tasks.workunit.client.0.smithi088.stderr: -194> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.160 INFO:tasks.workunit.client.0.smithi088.stderr: -193> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient(hunting): start opening mon connection 2024-03-09T14:41:57.160 INFO:tasks.workunit.client.0.smithi088.stderr: -192> 2024-03-09T14:41:56.794+0000 7f83a8ff9640 10 monclient(hunting): _renew_subs 2024-03-09T14:41:57.160 INFO:tasks.workunit.client.0.smithi088.stderr: -191> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): get_auth_request con 0x7f8390004c20 auth_method 0 2024-03-09T14:41:57.160 INFO:tasks.workunit.client.0.smithi088.stderr: -190> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.160 INFO:tasks.workunit.client.0.smithi088.stderr: -189> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.160 INFO:tasks.workunit.client.0.smithi088.stderr: -188> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-09T14:41:57.160 INFO:tasks.workunit.client.0.smithi088.stderr: -187> 2024-03-09T14:41:56.794+0000 7f84c6b99640 10 monclient(hunting): get_auth_request con 0x56064822eb20 auth_method 0 2024-03-09T14:41:57.160 INFO:tasks.workunit.client.0.smithi088.stderr: -186> 2024-03-09T14:41:56.794+0000 7f84c6b99640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.160 INFO:tasks.workunit.client.0.smithi088.stderr: -185> 2024-03-09T14:41:56.794+0000 7f84c6b99640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.160 INFO:tasks.workunit.client.0.smithi088.stderr: -184> 2024-03-09T14:41:56.794+0000 7f84c6b99640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-09T14:41:57.160 INFO:tasks.workunit.client.0.smithi088.stderr: -183> 2024-03-09T14:41:56.794+0000 7f84c6398640 10 monclient(hunting): get_auth_request con 0x560648231eb0 auth_method 0 2024-03-09T14:41:57.160 INFO:tasks.workunit.client.0.smithi088.stderr: -182> 2024-03-09T14:41:56.794+0000 7f84c6398640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:41:57.161 INFO:tasks.workunit.client.0.smithi088.stderr: -181> 2024-03-09T14:41:56.794+0000 7f84c6398640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:41:57.161 INFO:tasks.workunit.client.0.smithi088.stderr: -180> 2024-03-09T14:41:56.794+0000 7f84c6398640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-09T14:41:57.161 INFO:tasks.workunit.client.0.smithi088.stderr: -179> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.161 INFO:tasks.workunit.client.0.smithi088.stderr: -178> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.161 INFO:tasks.workunit.client.0.smithi088.stderr: -177> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-09T14:41:57.161 INFO:tasks.workunit.client.0.smithi088.stderr: -176> 2024-03-09T14:41:56.794+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.161 INFO:tasks.workunit.client.0.smithi088.stderr: -175> 2024-03-09T14:41:56.794+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.161 INFO:tasks.workunit.client.0.smithi088.stderr: -174> 2024-03-09T14:41:56.794+0000 7f84c6b99640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-09T14:41:57.161 INFO:tasks.workunit.client.0.smithi088.stderr: -173> 2024-03-09T14:41:56.794+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:41:57.161 INFO:tasks.workunit.client.0.smithi088.stderr: -172> 2024-03-09T14:41:56.794+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:41:57.161 INFO:tasks.workunit.client.0.smithi088.stderr: -171> 2024-03-09T14:41:56.794+0000 7f84c6398640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-09T14:41:57.161 INFO:tasks.workunit.client.0.smithi088.stderr: -170> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient(hunting): handle_auth_done global_id 6756 payload 293 2024-03-09T14:41:57.161 INFO:tasks.workunit.client.0.smithi088.stderr: -169> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient: _finish_hunting 0 2024-03-09T14:41:57.161 INFO:tasks.workunit.client.0.smithi088.stderr: -168> 2024-03-09T14:41:56.794+0000 7f84c739a640 1 monclient: found mon.a 2024-03-09T14:41:57.162 INFO:tasks.workunit.client.0.smithi088.stderr: -167> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.162 INFO:tasks.workunit.client.0.smithi088.stderr: -166> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient: _finish_auth 0 2024-03-09T14:41:57.162 INFO:tasks.workunit.client.0.smithi088.stderr: -165> 2024-03-09T14:41:56.794+0000 7f84c739a640 10 monclient: _check_auth_tickets 2024-03-09T14:41:57.162 INFO:tasks.workunit.client.0.smithi088.stderr: -164> 2024-03-09T14:41:56.795+0000 7f83a8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:41:57.162 INFO:tasks.workunit.client.0.smithi088.stderr: -163> 2024-03-09T14:41:56.795+0000 7f83a8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:41:57.162 INFO:tasks.workunit.client.0.smithi088.stderr: -162> 2024-03-09T14:41:56.795+0000 7f83a8ff9640 10 monclient: dump: 2024-03-09T14:41:57.162 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:41:57.162 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:41:57.162 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.162 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:41:57.162 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:41:57.162 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:41:57.162 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:41:57.162 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:41:57.163 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:41:57.163 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.163 INFO:tasks.workunit.client.0.smithi088.stderr: -161> 2024-03-09T14:41:56.795+0000 7f83a8ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:41:57.163 INFO:tasks.workunit.client.0.smithi088.stderr: -160> 2024-03-09T14:41:56.795+0000 7f83a9ffb640 4 set_mon_vals no callback set 2024-03-09T14:41:57.163 INFO:tasks.workunit.client.0.smithi088.stderr: -159> 2024-03-09T14:41:56.795+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.163 INFO:tasks.workunit.client.0.smithi088.stderr: -158> 2024-03-09T14:41:56.796+0000 7f83a8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:41:57.163 INFO:tasks.workunit.client.0.smithi088.stderr: -157> 2024-03-09T14:41:56.796+0000 7f83a8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:57.163 INFO:tasks.workunit.client.0.smithi088.stderr: -156> 2024-03-09T14:41:56.796+0000 7f83a8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:41:57.163 INFO:tasks.workunit.client.0.smithi088.stderr: -155> 2024-03-09T14:41:56.796+0000 7f84c6398640 10 monclient: get_auth_request con 0x560648236000 auth_method 0 2024-03-09T14:41:57.163 INFO:tasks.workunit.client.0.smithi088.stderr: -154> 2024-03-09T14:41:56.796+0000 7f84c6b99640 10 monclient: get_auth_request con 0x5606482494d0 auth_method 0 2024-03-09T14:41:57.163 INFO:tasks.workunit.client.0.smithi088.stderr: -153> 2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.163 INFO:tasks.workunit.client.0.smithi088.stderr: -152> 2024-03-09T14:41:56.797+0000 7f84c909d800 20 realm 2024-03-09T14:41:57.163 INFO:tasks.workunit.client.0.smithi088.stderr: -151> 2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.163 INFO:tasks.workunit.client.0.smithi088.stderr: -150> 2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.164 INFO:tasks.workunit.client.0.smithi088.stderr: -149> 2024-03-09T14:41:56.797+0000 7f84c909d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:57.164 INFO:tasks.workunit.client.0.smithi088.stderr: -148> 2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.164 INFO:tasks.workunit.client.0.smithi088.stderr: -147> 2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.164 INFO:tasks.workunit.client.0.smithi088.stderr: -146> 2024-03-09T14:41:56.797+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.164 INFO:tasks.workunit.client.0.smithi088.stderr: -145> 2024-03-09T14:41:56.798+0000 7f84c6398640 10 monclient: get_auth_request con 0x56064824d670 auth_method 0 2024-03-09T14:41:57.164 INFO:tasks.workunit.client.0.smithi088.stderr: -144> 2024-03-09T14:41:56.798+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:57.164 INFO:tasks.workunit.client.0.smithi088.stderr: -143> 2024-03-09T14:41:56.798+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.164 INFO:tasks.workunit.client.0.smithi088.stderr: -142> 2024-03-09T14:41:56.798+0000 7f84c739a640 10 monclient: get_auth_request con 0x560648250d70 auth_method 0 2024-03-09T14:41:57.164 INFO:tasks.workunit.client.0.smithi088.stderr: -141> 2024-03-09T14:41:56.799+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:57.164 INFO:tasks.workunit.client.0.smithi088.stderr: -140> 2024-03-09T14:41:56.799+0000 7f84c909d800 20 searching for the correct realm 2024-03-09T14:41:57.164 INFO:tasks.workunit.client.0.smithi088.stderr: -139> 2024-03-09T14:41:56.799+0000 7f84c6b99640 10 monclient: get_auth_request con 0x560648255ac0 auth_method 0 2024-03-09T14:41:57.164 INFO:tasks.workunit.client.0.smithi088.stderr: -138> 2024-03-09T14:41:56.800+0000 7f84c6398640 0 -- 172.21.15.88:0/2391042725 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f84b8032040 msgr2=0x7f84b8017410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:57.164 INFO:tasks.workunit.client.0.smithi088.stderr: -137> 2024-03-09T14:41:57.001+0000 7f84c6398640 10 monclient: get_auth_request con 0x7f84b8032040 auth_method 0 2024-03-09T14:41:57.164 INFO:tasks.workunit.client.0.smithi088.stderr: -136> 2024-03-09T14:41:57.003+0000 7f84c739a640 10 monclient: get_auth_request con 0x7f84c0067070 auth_method 0 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -135> 2024-03-09T14:41:57.005+0000 7f84c6b99640 10 monclient: get_auth_request con 0x7f84c005e070 auth_method 0 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -134> 2024-03-09T14:41:57.006+0000 7f84c739a640 0 -- 172.21.15.88:0/2391042725 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x560648250d70 msgr2=0x560648253160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -133> 2024-03-09T14:41:57.006+0000 7f83a8ff9640 1 client.6756.objecter ms_handle_reset 0x560648250d70 session 0x56064824cf10 osd.2 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -132> 2024-03-09T14:41:57.006+0000 7f83a8ff9640 10 monclient: _renew_subs 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -131> 2024-03-09T14:41:57.006+0000 7f83a8ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.88:3300/0 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -130> 2024-03-09T14:41:57.006+0000 7f84c739a640 10 monclient: get_auth_request con 0x7f8390082590 auth_method 0 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -129> 2024-03-09T14:41:57.008+0000 7f84c6398640 10 monclient: get_auth_request con 0x7f84c009d8d0 auth_method 0 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -128> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -127> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -126> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -125> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -124> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -123> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -122> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -121> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.165 INFO:tasks.workunit.client.0.smithi088.stderr: -120> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.166 INFO:tasks.workunit.client.0.smithi088.stderr: -119> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:57.166 INFO:tasks.workunit.client.0.smithi088.stderr: -118> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.166 INFO:tasks.workunit.client.0.smithi088.stderr: -117> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:57.166 INFO:tasks.workunit.client.0.smithi088.stderr: -116> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 zone default found 2024-03-09T14:41:57.166 INFO:tasks.workunit.client.0.smithi088.stderr: -115> 2024-03-09T14:41:57.013+0000 7f84c909d800 4 Realm: () 2024-03-09T14:41:57.166 INFO:tasks.workunit.client.0.smithi088.stderr: -114> 2024-03-09T14:41:57.013+0000 7f84c909d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:57.166 INFO:tasks.workunit.client.0.smithi088.stderr: -113> 2024-03-09T14:41:57.013+0000 7f84c909d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:57.166 INFO:tasks.workunit.client.0.smithi088.stderr: -112> 2024-03-09T14:41:57.013+0000 7f84c909d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:57.166 INFO:tasks.workunit.client.0.smithi088.stderr: -111> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 zonegroup default 2024-03-09T14:41:57.166 INFO:tasks.workunit.client.0.smithi088.stderr: -110> 2024-03-09T14:41:57.013+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.166 INFO:tasks.workunit.client.0.smithi088.stderr: -109> 2024-03-09T14:41:57.014+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.166 INFO:tasks.workunit.client.0.smithi088.stderr: -108> 2024-03-09T14:41:57.014+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.166 INFO:tasks.workunit.client.0.smithi088.stderr: -107> 2024-03-09T14:41:57.014+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.167 INFO:tasks.workunit.client.0.smithi088.stderr: -106> 2024-03-09T14:41:57.014+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.167 INFO:tasks.workunit.client.0.smithi088.stderr: -105> 2024-03-09T14:41:57.014+0000 7f84c909d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.167 INFO:tasks.workunit.client.0.smithi088.stderr: -104> 2024-03-09T14:41:57.014+0000 7f84c909d800 20 started sync module instance, tier type = 2024-03-09T14:41:57.167 INFO:tasks.workunit.client.0.smithi088.stderr: -103> 2024-03-09T14:41:57.014+0000 7f84c909d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:57.167 INFO:tasks.workunit.client.0.smithi088.stderr: -102> 2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=0 2024-03-09T14:41:57.167 INFO:tasks.workunit.client.0.smithi088.stderr: -101> 2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=1 2024-03-09T14:41:57.167 INFO:tasks.workunit.client.0.smithi088.stderr: -100> 2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=2 2024-03-09T14:41:57.167 INFO:tasks.workunit.client.0.smithi088.stderr: -99> 2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=3 2024-03-09T14:41:57.167 INFO:tasks.workunit.client.0.smithi088.stderr: -98> 2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=4 2024-03-09T14:41:57.167 INFO:tasks.workunit.client.0.smithi088.stderr: -97> 2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=5 2024-03-09T14:41:57.167 INFO:tasks.workunit.client.0.smithi088.stderr: -96> 2024-03-09T14:41:57.024+0000 7f84c909d800 20 add_watcher() i=6 2024-03-09T14:41:57.167 INFO:tasks.workunit.client.0.smithi088.stderr: -95> 2024-03-09T14:41:57.025+0000 7f84c909d800 20 add_watcher() i=7 2024-03-09T14:41:57.167 INFO:tasks.workunit.client.0.smithi088.stderr: -94> 2024-03-09T14:41:57.025+0000 7f84c909d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:57.167 INFO:tasks.workunit.client.0.smithi088.stderr: -93> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding auth protocol: cephx 2024-03-09T14:41:57.167 INFO:tasks.workunit.client.0.smithi088.stderr: -92> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding auth protocol: cephx 2024-03-09T14:41:57.168 INFO:tasks.workunit.client.0.smithi088.stderr: -91> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding auth protocol: cephx 2024-03-09T14:41:57.168 INFO:tasks.workunit.client.0.smithi088.stderr: -90> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: secure 2024-03-09T14:41:57.168 INFO:tasks.workunit.client.0.smithi088.stderr: -89> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: crc 2024-03-09T14:41:57.168 INFO:tasks.workunit.client.0.smithi088.stderr: -88> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: secure 2024-03-09T14:41:57.168 INFO:tasks.workunit.client.0.smithi088.stderr: -87> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: crc 2024-03-09T14:41:57.168 INFO:tasks.workunit.client.0.smithi088.stderr: -86> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: secure 2024-03-09T14:41:57.168 INFO:tasks.workunit.client.0.smithi088.stderr: -85> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: crc 2024-03-09T14:41:57.168 INFO:tasks.workunit.client.0.smithi088.stderr: -84> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: crc 2024-03-09T14:41:57.168 INFO:tasks.workunit.client.0.smithi088.stderr: -83> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: secure 2024-03-09T14:41:57.168 INFO:tasks.workunit.client.0.smithi088.stderr: -82> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: crc 2024-03-09T14:41:57.168 INFO:tasks.workunit.client.0.smithi088.stderr: -81> 2024-03-09T14:41:57.026+0000 7f8378ff9640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:57.169 INFO:tasks.workunit.client.0.smithi088.stderr: -80> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: secure 2024-03-09T14:41:57.169 INFO:tasks.workunit.client.0.smithi088.stderr: -79> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: crc 2024-03-09T14:41:57.169 INFO:tasks.workunit.client.0.smithi088.stderr: -78> 2024-03-09T14:41:57.026+0000 7f84c909d800 5 AuthRegistry(0x7ffccd019cf0) adding con mode: secure 2024-03-09T14:41:57.169 INFO:tasks.workunit.client.0.smithi088.stderr: -77> 2024-03-09T14:41:57.027+0000 7f84c909d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:41:57.169 INFO:tasks.workunit.client.0.smithi088.stderr: -76> 2024-03-09T14:41:57.027+0000 7f84c909d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:57.169 INFO:tasks.workunit.client.0.smithi088.stderr: -75> 2024-03-09T14:41:57.027+0000 7f84c909d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:57.169 INFO:tasks.workunit.client.0.smithi088.stderr: -74> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command cache list hook 0x56064822ef60 2024-03-09T14:41:57.169 INFO:tasks.workunit.client.0.smithi088.stderr: -73> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command cache inspect hook 0x56064822ef60 2024-03-09T14:41:57.169 INFO:tasks.workunit.client.0.smithi088.stderr: -72> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command cache erase hook 0x56064822ef60 2024-03-09T14:41:57.169 INFO:tasks.workunit.client.0.smithi088.stderr: -71> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command cache zap hook 0x56064822ef60 2024-03-09T14:41:57.169 INFO:tasks.workunit.client.0.smithi088.stderr: -70> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 note: GC not initialized 2024-03-09T14:41:57.169 INFO:tasks.workunit.client.0.smithi088.stderr: -69> 2024-03-09T14:41:57.027+0000 7f82f37fe640 20 reqs_thread_entry: start 2024-03-09T14:41:57.169 INFO:tasks.workunit.client.0.smithi088.stderr: -68> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command sync trace show hook 0x7f84c0052770 2024-03-09T14:41:57.169 INFO:tasks.workunit.client.0.smithi088.stderr: -67> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command sync trace history hook 0x7f84c0052770 2024-03-09T14:41:57.170 INFO:tasks.workunit.client.0.smithi088.stderr: -66> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command sync trace active hook 0x7f84c0052770 2024-03-09T14:41:57.170 INFO:tasks.workunit.client.0.smithi088.stderr: -65> 2024-03-09T14:41:57.027+0000 7f84c909d800 5 asok(0x560647f43780) register_command sync trace active_short hook 0x7f84c0052770 2024-03-09T14:41:57.170 INFO:tasks.workunit.client.0.smithi088.stderr: -64> 2024-03-09T14:41:57.027+0000 7f84c909d800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:57.170 INFO:tasks.workunit.client.0.smithi088.stderr: -63> 2024-03-09T14:41:57.027+0000 7f84c909d800 20 Filter name: none 2024-03-09T14:41:57.170 INFO:tasks.workunit.client.0.smithi088.stderr: -62> 2024-03-09T14:41:57.027+0000 7f82f17fa640 20 reqs_thread_entry: start 2024-03-09T14:41:57.170 INFO:tasks.workunit.client.0.smithi088.stderr: -61> 2024-03-09T14:41:57.027+0000 7f84c909d800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-09T14:41:57.170 INFO:tasks.workunit.client.0.smithi088.stderr: -60> 2024-03-09T14:41:57.027+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.170 INFO:tasks.workunit.client.0.smithi088.stderr: -59> 2024-03-09T14:41:57.028+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:57.170 INFO:tasks.workunit.client.0.smithi088.stderr: -58> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-09T14:41:57.170 INFO:tasks.workunit.client.0.smithi088.stderr: -57> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-09T14:41:57.170 INFO:tasks.workunit.client.0.smithi088.stderr: -56> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 : miss 2024-03-09T14:41:57.170 INFO:tasks.workunit.client.0.smithi088.stderr: -55> 2024-03-09T14:41:57.028+0000 7f84c909d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.170 INFO:tasks.workunit.client.0.smithi088.stderr: -54> 2024-03-09T14:41:57.028+0000 7f84c909d800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:41:57.171 INFO:tasks.workunit.client.0.smithi088.stderr: -53> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 info.flags=0x17 2024-03-09T14:41:57.171 INFO:tasks.workunit.client.0.smithi088.stderr: -52> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 to cache LRU end 2024-03-09T14:41:57.171 INFO:tasks.workunit.client.0.smithi088.stderr: -51> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:57.171 INFO:tasks.workunit.client.0.smithi088.stderr: -50> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:57.171 INFO:tasks.workunit.client.0.smithi088.stderr: -49> 2024-03-09T14:41:57.028+0000 7f84c909d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 2024-03-09T14:41:57.171 INFO:tasks.workunit.client.0.smithi088.stderr: -48> 2024-03-09T14:41:57.033+0000 7f84c909d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 info.flags=0x17 2024-03-09T14:41:57.171 INFO:tasks.workunit.client.0.smithi088.stderr: -47> 2024-03-09T14:41:57.033+0000 7f84c909d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 to cache LRU end 2024-03-09T14:41:57.171 INFO:tasks.workunit.client.0.smithi088.stderr: -46> 2024-03-09T14:41:57.033+0000 7f84c909d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:57.171 INFO:tasks.workunit.client.0.smithi088.stderr: -45> 2024-03-09T14:41:57.033+0000 7f84c909d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26, ofs0, ns] 2024-03-09T14:41:57.171 INFO:tasks.workunit.client.0.smithi088.stderr: -44> 2024-03-09T14:41:57.034+0000 7f83a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464290 cookie 94584980216064 notifier 6756 bl.length()=923 2024-03-09T14:41:57.171 INFO:tasks.workunit.client.0.smithi088.stderr: -43> 2024-03-09T14:41:57.034+0000 7f83a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 info.flags=0x17 2024-03-09T14:41:57.171 INFO:tasks.workunit.client.0.smithi088.stderr: -42> 2024-03-09T14:41:57.034+0000 7f83a9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 to cache LRU end 2024-03-09T14:41:57.171 INFO:tasks.workunit.client.0.smithi088.stderr: -41> 2024-03-09T14:41:57.034+0000 7f83a9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:57.171 INFO:tasks.workunit.client.0.smithi088.stderr: -40> 2024-03-09T14:41:57.035+0000 7f84c909d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): orig_sources= new_sources= 2024-03-09T14:41:57.171 INFO:tasks.workunit.client.0.smithi088.stderr: -39> 2024-03-09T14:41:57.035+0000 7f84c909d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): potential sources added=[] removed=[] 2024-03-09T14:41:57.172 INFO:tasks.workunit.client.0.smithi088.stderr: -38> 2024-03-09T14:41:57.035+0000 7f84c909d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): orig_dests= new_dests= 2024-03-09T14:41:57.172 INFO:tasks.workunit.client.0.smithi088.stderr: -37> 2024-03-09T14:41:57.035+0000 7f84c909d800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): potential dests added=[] removed=[] 2024-03-09T14:41:57.172 INFO:tasks.workunit.client.0.smithi088.stderr: -36> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.0 2024-03-09T14:41:57.172 INFO:tasks.workunit.client.0.smithi088.stderr: -35> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.0 2024-03-09T14:41:57.172 INFO:tasks.workunit.client.0.smithi088.stderr: -34> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.1 2024-03-09T14:41:57.172 INFO:tasks.workunit.client.0.smithi088.stderr: -33> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.1 2024-03-09T14:41:57.172 INFO:tasks.workunit.client.0.smithi088.stderr: -32> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.2 2024-03-09T14:41:57.172 INFO:tasks.workunit.client.0.smithi088.stderr: -31> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.2 2024-03-09T14:41:57.172 INFO:tasks.workunit.client.0.smithi088.stderr: -30> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.3 2024-03-09T14:41:57.172 INFO:tasks.workunit.client.0.smithi088.stderr: -29> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.3 2024-03-09T14:41:57.172 INFO:tasks.workunit.client.0.smithi088.stderr: -28> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.4 2024-03-09T14:41:57.172 INFO:tasks.workunit.client.0.smithi088.stderr: -27> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.4 2024-03-09T14:41:57.172 INFO:tasks.workunit.client.0.smithi088.stderr: -26> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.5 2024-03-09T14:41:57.172 INFO:tasks.workunit.client.0.smithi088.stderr: -25> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.5 2024-03-09T14:41:57.173 INFO:tasks.workunit.client.0.smithi088.stderr: -24> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.6 2024-03-09T14:41:57.173 INFO:tasks.workunit.client.0.smithi088.stderr: -23> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.6 2024-03-09T14:41:57.173 INFO:tasks.workunit.client.0.smithi088.stderr: -22> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.7 2024-03-09T14:41:57.173 INFO:tasks.workunit.client.0.smithi088.stderr: -21> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.7 2024-03-09T14:41:57.173 INFO:tasks.workunit.client.0.smithi088.stderr: -20> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.8 2024-03-09T14:41:57.173 INFO:tasks.workunit.client.0.smithi088.stderr: -19> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.8 2024-03-09T14:41:57.173 INFO:tasks.workunit.client.0.smithi088.stderr: -18> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.9 2024-03-09T14:41:57.173 INFO:tasks.workunit.client.0.smithi088.stderr: -17> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.9 2024-03-09T14:41:57.173 INFO:tasks.workunit.client.0.smithi088.stderr: -16> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.10 2024-03-09T14:41:57.173 INFO:tasks.workunit.client.0.smithi088.stderr: -15> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.10 2024-03-09T14:41:57.173 INFO:tasks.workunit.client.0.smithi088.stderr: -14> 2024-03-09T14:41:57.038+0000 7f84c909d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.11 2024-03-09T14:41:57.173 INFO:tasks.workunit.client.0.smithi088.stderr: -13> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.11 2024-03-09T14:41:57.173 INFO:tasks.workunit.client.0.smithi088.stderr: -12> 2024-03-09T14:41:57.038+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.0 2024-03-09T14:41:57.174 INFO:tasks.workunit.client.0.smithi088.stderr: -11> 2024-03-09T14:41:57.039+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1 2024-03-09T14:41:57.174 INFO:tasks.workunit.client.0.smithi088.stderr: -10> 2024-03-09T14:41:57.039+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.2 2024-03-09T14:41:57.174 INFO:tasks.workunit.client.0.smithi088.stderr: -9> 2024-03-09T14:41:57.040+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.3 2024-03-09T14:41:57.174 INFO:tasks.workunit.client.0.smithi088.stderr: -8> 2024-03-09T14:41:57.040+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.4 2024-03-09T14:41:57.174 INFO:tasks.workunit.client.0.smithi088.stderr: -7> 2024-03-09T14:41:57.041+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.5 2024-03-09T14:41:57.174 INFO:tasks.workunit.client.0.smithi088.stderr: -6> 2024-03-09T14:41:57.041+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.6 2024-03-09T14:41:57.174 INFO:tasks.workunit.client.0.smithi088.stderr: -5> 2024-03-09T14:41:57.042+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.7 2024-03-09T14:41:57.174 INFO:tasks.workunit.client.0.smithi088.stderr: -4> 2024-03-09T14:41:57.042+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.8 2024-03-09T14:41:57.174 INFO:tasks.workunit.client.0.smithi088.stderr: -3> 2024-03-09T14:41:57.042+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.9 2024-03-09T14:41:57.174 INFO:tasks.workunit.client.0.smithi088.stderr: -2> 2024-03-09T14:41:57.043+0000 7f84c909d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.10 2024-03-09T14:41:57.174 INFO:tasks.workunit.client.0.smithi088.stderr: -1> 2024-03-09T14:41:57.047+0000 7f84c909d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84c909d800 time 2024-03-09T14:41:57.048218+0000 2024-03-09T14:41:57.174 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:41:57.174 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.175 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:57.175 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84cc380e86] 2024-03-09T14:41:57.175 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f84cc381044] 2024-03-09T14:41:57.175 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56064699df91] 2024-03-09T14:41:57.175 INFO:tasks.workunit.client.0.smithi088.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5606469b9178] 2024-03-09T14:41:57.175 INFO:tasks.workunit.client.0.smithi088.stderr: 5: main() 2024-03-09T14:41:57.175 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f84cb23feb0] 2024-03-09T14:41:57.175 INFO:tasks.workunit.client.0.smithi088.stderr: 7: __libc_start_main() 2024-03-09T14:41:57.175 INFO:tasks.workunit.client.0.smithi088.stderr: 8: _start() 2024-03-09T14:41:57.175 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.175 INFO:tasks.workunit.client.0.smithi088.stderr: 0> 2024-03-09T14:41:57.048+0000 7f84c909d800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:41:57.175 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7f84c909d800 thread_name:radosgw-admin 2024-03-09T14:41:57.175 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.175 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:41:57.175 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f84cb254db0] 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f84cb2a154c] 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84cc380ee0] 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f84cc381044] 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56064699df91] 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5606469b9178] 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr: 9: main() 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f84cb23feb0] 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr: 11: __libc_start_main() 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr: 12: _start() 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr:--- logging levels --- 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 none 2024-03-09T14:41:57.176 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 lockdep 2024-03-09T14:41:57.177 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 context 2024-03-09T14:41:57.177 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 crush 2024-03-09T14:41:57.177 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds 2024-03-09T14:41:57.177 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_balancer 2024-03-09T14:41:57.177 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_locker 2024-03-09T14:41:57.177 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log 2024-03-09T14:41:57.177 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log_expire 2024-03-09T14:41:57.177 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_migrator 2024-03-09T14:41:57.177 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 buffer 2024-03-09T14:41:57.177 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 timer 2024-03-09T14:41:57.177 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 filer 2024-03-09T14:41:57.177 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 striper 2024-03-09T14:41:57.177 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 objecter 2024-03-09T14:41:57.177 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rados 2024-03-09T14:41:57.178 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd 2024-03-09T14:41:57.178 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_mirror 2024-03-09T14:41:57.178 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_replay 2024-03-09T14:41:57.178 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_pwl 2024-03-09T14:41:57.178 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 journaler 2024-03-09T14:41:57.178 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objectcacher 2024-03-09T14:41:57.178 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:41:57.178 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 client 2024-03-09T14:41:57.178 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 osd 2024-03-09T14:41:57.178 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 optracker 2024-03-09T14:41:57.178 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objclass 2024-03-09T14:41:57.178 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 filestore 2024-03-09T14:41:57.178 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 journal 2024-03-09T14:41:57.178 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 ms 2024-03-09T14:41:57.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mon 2024-03-09T14:41:57.179 INFO:tasks.workunit.client.0.smithi088.stderr: 0/10 monc 2024-03-09T14:41:57.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 paxos 2024-03-09T14:41:57.179 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 tp 2024-03-09T14:41:57.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 auth 2024-03-09T14:41:57.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 crypto 2024-03-09T14:41:57.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 finisher 2024-03-09T14:41:57.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 reserver 2024-03-09T14:41:57.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 heartbeatmap 2024-03-09T14:41:57.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 perfcounter 2024-03-09T14:41:57.179 INFO:tasks.workunit.client.0.smithi088.stderr: 20/20 rgw 2024-03-09T14:41:57.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_sync 2024-03-09T14:41:57.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_datacache 2024-03-09T14:41:57.179 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_access 2024-03-09T14:41:57.180 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:41:57.180 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_flight 2024-03-09T14:41:57.180 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:41:57.180 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 javaclient 2024-03-09T14:41:57.180 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 asok 2024-03-09T14:41:57.180 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 throttle 2024-03-09T14:41:57.180 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 refs 2024-03-09T14:41:57.180 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 compressor 2024-03-09T14:41:57.180 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluestore 2024-03-09T14:41:57.180 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluefs 2024-03-09T14:41:57.180 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 bdev 2024-03-09T14:41:57.180 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 kstore 2024-03-09T14:41:57.180 INFO:tasks.workunit.client.0.smithi088.stderr: 4/ 5 rocksdb 2024-03-09T14:41:57.180 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 fuse 2024-03-09T14:41:57.180 INFO:tasks.workunit.client.0.smithi088.stderr: 2/ 5 mgr 2024-03-09T14:41:57.181 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mgrc 2024-03-09T14:41:57.181 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 dpdk 2024-03-09T14:41:57.181 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 eventtrace 2024-03-09T14:41:57.181 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 prioritycache 2024-03-09T14:41:57.181 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 test 2024-03-09T14:41:57.181 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:41:57.181 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephsqlite 2024-03-09T14:41:57.181 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:41:57.181 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore 2024-03-09T14:41:57.181 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_onode 2024-03-09T14:41:57.181 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_odata 2024-03-09T14:41:57.181 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_omap 2024-03-09T14:41:57.181 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_tm 2024-03-09T14:41:57.182 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_t 2024-03-09T14:41:57.182 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:41:57.182 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_epm 2024-03-09T14:41:57.182 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_lba 2024-03-09T14:41:57.182 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:41:57.182 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cache 2024-03-09T14:41:57.182 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_journal 2024-03-09T14:41:57.182 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_device 2024-03-09T14:41:57.182 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_backref 2024-03-09T14:41:57.182 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 alienstore 2024-03-09T14:41:57.182 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mclock 2024-03-09T14:41:57.182 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cyanstore 2024-03-09T14:41:57.182 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 ceph_exporter 2024-03-09T14:41:57.182 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 memstore 2024-03-09T14:41:57.183 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 trace 2024-03-09T14:41:57.183 INFO:tasks.workunit.client.0.smithi088.stderr: -2/-2 (syslog threshold) 2024-03-09T14:41:57.183 INFO:tasks.workunit.client.0.smithi088.stderr: 99/99 (stderr threshold) 2024-03-09T14:41:57.183 INFO:tasks.workunit.client.0.smithi088.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:41:57.183 INFO:tasks.workunit.client.0.smithi088.stderr: 7f82f17fa640 / http_manager 2024-03-09T14:41:57.183 INFO:tasks.workunit.client.0.smithi088.stderr: 7f82f37fe640 / http_manager 2024-03-09T14:41:57.183 INFO:tasks.workunit.client.0.smithi088.stderr: 7f8378ff9640 / rgw_dt_lg_renew 2024-03-09T14:41:57.183 INFO:tasks.workunit.client.0.smithi088.stderr: 7f83a8ff9640 / ms_dispatch 2024-03-09T14:41:57.183 INFO:tasks.workunit.client.0.smithi088.stderr: 7f83a9ffb640 / io_context_pool 2024-03-09T14:41:57.183 INFO:tasks.workunit.client.0.smithi088.stderr: 7f83aa7fc640 / io_context_pool 2024-03-09T14:41:57.183 INFO:tasks.workunit.client.0.smithi088.stderr: 7f83b0e01640 / ms_dispatch 2024-03-09T14:41:57.183 INFO:tasks.workunit.client.0.smithi088.stderr: 7f83b3606640 / ms_dispatch 2024-03-09T14:41:57.183 INFO:tasks.workunit.client.0.smithi088.stderr: 7f83b4e09640 / io_context_pool 2024-03-09T14:41:57.183 INFO:tasks.workunit.client.0.smithi088.stderr: 7f84c6398640 / msgr-worker-2 2024-03-09T14:41:57.183 INFO:tasks.workunit.client.0.smithi088.stderr: 7f84c6b99640 / msgr-worker-1 2024-03-09T14:41:57.184 INFO:tasks.workunit.client.0.smithi088.stderr: 7f84c739a640 / msgr-worker-0 2024-03-09T14:41:57.184 INFO:tasks.workunit.client.0.smithi088.stderr: 7f84c7b9b640 / io_context_pool 2024-03-09T14:41:57.184 INFO:tasks.workunit.client.0.smithi088.stderr: 7f84c909d800 / radosgw-admin 2024-03-09T14:41:57.184 INFO:tasks.workunit.client.0.smithi088.stderr: max_recent 500 2024-03-09T14:41:57.184 INFO:tasks.workunit.client.0.smithi088.stderr: max_new 1000 2024-03-09T14:41:57.184 INFO:tasks.workunit.client.0.smithi088.stderr: log_file /var/lib/ceph/crash/2024-03-09T14:41:57.049611Z_36a1f5cd-27ab-4501-9068-e5de2025ba60/log 2024-03-09T14:41:57.184 INFO:tasks.workunit.client.0.smithi088.stderr:--- end dump of recent events --- 2024-03-09T14:41:57.184 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-03-09T14:41:57.186 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:57.186 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:57.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.118+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.120+0000 7f515182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.120+0000 7f515182f800 20 realm 2024-03-09T14:41:57.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.120+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.120+0000 7f515182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.120+0000 7f515182f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:57.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.120+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.120+0000 7f515182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.120+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.121+0000 7f515182f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:57.186 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.121+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.187 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.122+0000 7f515182f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:57.187 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.122+0000 7f515182f800 20 searching for the correct realm 2024-03-09T14:41:57.187 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.124+0000 7f514d2da640 0 -- 172.21.15.88:0/3716491419 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f5148020070 msgr2=0x7f514805e810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:57.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.330+0000 7f5147fff640 0 -- 172.21.15.88:0/3716491419 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f5148067b20 msgr2=0x7f5148063170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:57.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.536+0000 7f515182f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:41:57.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.536+0000 7f515182f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:57.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.536+0000 7f515182f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:41:57.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.536+0000 7f515182f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:57.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.536+0000 7f515182f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:57.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.536+0000 7f515182f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:57.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.536+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.536+0000 7f515182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.536+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.537 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.536+0000 7f515182f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:57.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.536+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.537+0000 7f515182f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:57.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.537+0000 7f515182f800 20 zone default found 2024-03-09T14:41:57.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.537+0000 7f515182f800 4 Realm: () 2024-03-09T14:41:57.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.537+0000 7f515182f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:41:57.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.537+0000 7f515182f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:41:57.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.537+0000 7f515182f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:57.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.537+0000 7f515182f800 20 zonegroup default 2024-03-09T14:41:57.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.537+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.537+0000 7f515182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.537+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.537+0000 7f515182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.537+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.537+0000 7f515182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.537+0000 7f515182f800 20 started sync module instance, tier type = 2024-03-09T14:41:57.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.537+0000 7f515182f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:41:57.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.547+0000 7f515182f800 20 add_watcher() i=0 2024-03-09T14:41:57.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.547+0000 7f515182f800 20 add_watcher() i=1 2024-03-09T14:41:57.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.547+0000 7f515182f800 20 add_watcher() i=2 2024-03-09T14:41:57.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.547+0000 7f515182f800 20 add_watcher() i=3 2024-03-09T14:41:57.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.547+0000 7f515182f800 20 add_watcher() i=4 2024-03-09T14:41:57.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.547+0000 7f515182f800 20 add_watcher() i=5 2024-03-09T14:41:57.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.547+0000 7f515182f800 20 add_watcher() i=6 2024-03-09T14:41:57.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.548+0000 7f515182f800 20 add_watcher() i=7 2024-03-09T14:41:57.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.548+0000 7f515182f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:57.550 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.550+0000 7f5002fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:57.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.550+0000 7f515182f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:57.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.550+0000 7f515182f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:57.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.550+0000 7f515182f800 5 note: GC not initialized 2024-03-09T14:41:57.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.550+0000 7f5001fe3640 20 reqs_thread_entry: start 2024-03-09T14:41:57.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.550+0000 7f515182f800 20 init_complete bucket index max shards: 11 2024-03-09T14:41:57.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.551+0000 7f515182f800 20 Filter name: none 2024-03-09T14:41:57.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.551+0000 7f4f737fe640 20 reqs_thread_entry: start 2024-03-09T14:41:57.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.551+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.551+0000 7f515182f800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:57.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.551+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.552+0000 7f515182f800 20 rados_obj.operate() r=0 bl.length=443 2024-03-09T14:41:57.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.552+0000 7f515182f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:57.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.552+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.552+0000 7f515182f800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:41:57.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.552+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.552+0000 7f515182f800 20 rados_obj.operate() r=0 bl.length=443 2024-03-09T14:41:57.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.552+0000 7f515182f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:57.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.553+0000 7f515182f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:57.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.554+0000 7f515182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:57.555 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.554+0000 7f5002fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:57.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.556+0000 7f515182f800 20 remove_watcher() i=0 2024-03-09T14:41:57.557 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.556+0000 7f515182f800 2 removed watcher, disabling cache 2024-03-09T14:41:57.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.558+0000 7f515182f800 20 remove_watcher() i=1 2024-03-09T14:41:57.559 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.559+0000 7f515182f800 20 remove_watcher() i=2 2024-03-09T14:41:57.560 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.560+0000 7f515182f800 20 remove_watcher() i=3 2024-03-09T14:41:57.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.561+0000 7f515182f800 20 remove_watcher() i=4 2024-03-09T14:41:57.562 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.562+0000 7f515182f800 20 remove_watcher() i=5 2024-03-09T14:41:57.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.563+0000 7f515182f800 20 remove_watcher() i=6 2024-03-09T14:41:57.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:41:57.564+0000 7f515182f800 20 remove_watcher() i=7 2024-03-09T14:41:57.574 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:41:57.574 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:41:57.574 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: abort-at-commit-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:41:57.574 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:27.782 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:42:27.812 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:42:27.813 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:42:27.848 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:27.847+0000 7f58a013c800 20 rados->read ofs=0 len=0 2024-03-09T14:42:27.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:27.848+0000 7f58a013c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:27.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:27.848+0000 7f58a013c800 20 realm 2024-03-09T14:42:27.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:27.848+0000 7f58a013c800 20 rados->read ofs=0 len=0 2024-03-09T14:42:27.849 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:27.848+0000 7f58a013c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:27.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:27.848+0000 7f58a013c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:42:27.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:27.848+0000 7f58a013c800 20 rados->read ofs=0 len=0 2024-03-09T14:42:27.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:27.849+0000 7f58a013c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:27.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:27.849+0000 7f58a013c800 20 rados->read ofs=0 len=0 2024-03-09T14:42:27.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:27.850+0000 7f58a013c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:27.850 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:27.850+0000 7f58a013c800 20 rados->read ofs=0 len=0 2024-03-09T14:42:27.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:27.850+0000 7f58a013c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:42:27.851 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:27.850+0000 7f58a013c800 20 searching for the correct realm 2024-03-09T14:42:27.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:27.853+0000 7f589c702640 0 -- 172.21.15.88:0/1309205135 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f589400e040 msgr2=0x7f589405d4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:27.857 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:27.856+0000 7f589b700640 0 -- 172.21.15.88:0/1309205135 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f589407d220 msgr2=0x7f589405f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:28.064 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.063+0000 7f58a013c800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:42:28.064 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.063+0000 7f58a013c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:42:28.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.063+0000 7f58a013c800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:42:28.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.063+0000 7f58a013c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:42:28.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.063+0000 7f58a013c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:42:28.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.063+0000 7f58a013c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:42:28.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.063+0000 7f58a013c800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.063+0000 7f58a013c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:28.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.063+0000 7f58a013c800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.064+0000 7f58a013c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:28.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.064+0000 7f58a013c800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.066 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.064+0000 7f58a013c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:42:28.066 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.064+0000 7f58a013c800 20 zone default found 2024-03-09T14:42:28.066 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.064+0000 7f58a013c800 4 Realm: () 2024-03-09T14:42:28.066 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.064+0000 7f58a013c800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:42:28.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.064+0000 7f58a013c800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:42:28.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.064+0000 7f58a013c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:42:28.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.064+0000 7f58a013c800 20 zonegroup default 2024-03-09T14:42:28.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.064+0000 7f58a013c800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.064+0000 7f58a013c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:28.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.064+0000 7f58a013c800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.065+0000 7f58a013c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:28.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.065+0000 7f58a013c800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.065+0000 7f58a013c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:28.068 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.065+0000 7f58a013c800 20 started sync module instance, tier type = 2024-03-09T14:42:28.068 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.065+0000 7f58a013c800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:42:28.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.075+0000 7f58a013c800 20 add_watcher() i=0 2024-03-09T14:42:28.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.075+0000 7f58a013c800 20 add_watcher() i=1 2024-03-09T14:42:28.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.075+0000 7f58a013c800 20 add_watcher() i=2 2024-03-09T14:42:28.075 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.075+0000 7f58a013c800 20 add_watcher() i=3 2024-03-09T14:42:28.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.075+0000 7f58a013c800 20 add_watcher() i=4 2024-03-09T14:42:28.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.075+0000 7f58a013c800 20 add_watcher() i=5 2024-03-09T14:42:28.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.075+0000 7f58a013c800 20 add_watcher() i=6 2024-03-09T14:42:28.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.075+0000 7f58a013c800 20 add_watcher() i=7 2024-03-09T14:42:28.076 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.075+0000 7f58a013c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:42:28.078 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.077+0000 7f5751fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:28.080 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.077+0000 7f58a013c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:42:28.080 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.077+0000 7f58a013c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:42:28.080 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.077+0000 7f58a013c800 5 note: GC not initialized 2024-03-09T14:42:28.080 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.078+0000 7f5750fe1640 20 reqs_thread_entry: start 2024-03-09T14:42:28.080 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.078+0000 7f58a013c800 20 init_complete bucket index max shards: 11 2024-03-09T14:42:28.080 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.078+0000 7f58a013c800 20 Filter name: none 2024-03-09T14:42:28.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.078+0000 7f56ca7fc640 20 reqs_thread_entry: start 2024-03-09T14:42:28.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.078+0000 7f58a013c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-09T14:42:28.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.078+0000 7f58a013c800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.078+0000 7f58a013c800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:42:28.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.078+0000 7f58a013c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-09T14:42:28.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.078+0000 7f58a013c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-09T14:42:28.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.078+0000 7f58a013c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 : miss 2024-03-09T14:42:28.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.078+0000 7f58a013c800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.081 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.079+0000 7f58a013c800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:42:28.082 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.079+0000 7f58a013c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 info.flags=0x17 2024-03-09T14:42:28.082 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.079+0000 7f58a013c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 to cache LRU end 2024-03-09T14:42:28.082 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.079+0000 7f58a013c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:28.082 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.079+0000 7f58a013c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:28.082 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.079+0000 7f58a013c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 2024-03-09T14:42:28.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.084+0000 7f58a013c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 info.flags=0x17 2024-03-09T14:42:28.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.084+0000 7f58a013c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 to cache LRU end 2024-03-09T14:42:28.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.084+0000 7f58a013c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:28.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.084+0000 7f58a013c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26, ofs0, ns] 2024-03-09T14:42:28.085 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.084+0000 7f577a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 94116038627200 notifier 6792 bl.length()=923 2024-03-09T14:42:28.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.084+0000 7f577a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 info.flags=0x17 2024-03-09T14:42:28.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.084+0000 7f577a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 to cache LRU end 2024-03-09T14:42:28.086 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.084+0000 7f577a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:28.087 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.086+0000 7f58a013c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): orig_sources= new_sources= 2024-03-09T14:42:28.087 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.086+0000 7f58a013c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): potential sources added=[] removed=[] 2024-03-09T14:42:28.087 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.086+0000 7f58a013c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): orig_dests= new_dests= 2024-03-09T14:42:28.087 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.086+0000 7f58a013c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): potential dests added=[] removed=[] 2024-03-09T14:42:28.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.0 2024-03-09T14:42:28.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.0 2024-03-09T14:42:28.091 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.1 2024-03-09T14:42:28.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.1 2024-03-09T14:42:28.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.2 2024-03-09T14:42:28.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.2 2024-03-09T14:42:28.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.3 2024-03-09T14:42:28.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.3 2024-03-09T14:42:28.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.4 2024-03-09T14:42:28.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.4 2024-03-09T14:42:28.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.5 2024-03-09T14:42:28.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.5 2024-03-09T14:42:28.092 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.6 2024-03-09T14:42:28.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.6 2024-03-09T14:42:28.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.7 2024-03-09T14:42:28.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.7 2024-03-09T14:42:28.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.8 2024-03-09T14:42:28.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.8 2024-03-09T14:42:28.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.9 2024-03-09T14:42:28.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.9 2024-03-09T14:42:28.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.10 2024-03-09T14:42:28.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.10 2024-03-09T14:42:28.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.11 2024-03-09T14:42:28.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1.11 2024-03-09T14:42:28.093 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.090+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.0 2024-03-09T14:42:28.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.091+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.1 2024-03-09T14:42:28.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.091+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.2 2024-03-09T14:42:28.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.092+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.3 2024-03-09T14:42:28.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.092+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.4 2024-03-09T14:42:28.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.093+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.5 2024-03-09T14:42:28.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.093+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.6 2024-03-09T14:42:28.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.094+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.7 2024-03-09T14:42:28.095 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.094+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.8 2024-03-09T14:42:28.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.095+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.9 2024-03-09T14:42:28.096 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.095+0000 7f58a013c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.26.10 2024-03-09T14:42:28.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.099+0000 7f58a013c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 : hit (requested=0x17, cached=0x17) 2024-03-09T14:42:28.099 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.099+0000 7f58a013c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 2024-03-09T14:42:28.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.100+0000 7f58a013c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 info.flags=0x17 2024-03-09T14:42:28.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.100+0000 7f58a013c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 to cache LRU end 2024-03-09T14:42:28.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.100+0000 7f58a013c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:28.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.100+0000 7f58a013c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26, ofs0, ns] 2024-03-09T14:42:28.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.100+0000 7f577affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464293 cookie 94116038627200 notifier 6792 bl.length()=891 2024-03-09T14:42:28.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.100+0000 7f577affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 info.flags=0x17 2024-03-09T14:42:28.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.100+0000 7f577affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:5d93e872-363b-498b-b665-658644296b85.4535.26 to cache LRU end 2024-03-09T14:42:28.101 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.100+0000 7f577affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:28.102 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.102+0000 7f58a013c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): orig_sources= new_sources= 2024-03-09T14:42:28.102 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.102+0000 7f58a013c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): potential sources added=[] removed=[] 2024-03-09T14:42:28.102 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.102+0000 7f58a013c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): orig_dests= new_dests= 2024-03-09T14:42:28.102 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.102+0000 7f58a013c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[5d93e872-363b-498b-b665-658644296b85.4535.26]): potential dests added=[] removed=[] 2024-03-09T14:42:28.104 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.104+0000 7f58a013c800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" completed successfully 2024-03-09T14:42:28.106 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.106+0000 7f5751fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:28.109 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.108+0000 7f58a013c800 20 remove_watcher() i=0 2024-03-09T14:42:28.109 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.108+0000 7f58a013c800 2 removed watcher, disabling cache 2024-03-09T14:42:28.110 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.109+0000 7f58a013c800 20 remove_watcher() i=1 2024-03-09T14:42:28.111 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.111+0000 7f58a013c800 20 remove_watcher() i=2 2024-03-09T14:42:28.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.112+0000 7f58a013c800 20 remove_watcher() i=3 2024-03-09T14:42:28.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.113+0000 7f58a013c800 20 remove_watcher() i=4 2024-03-09T14:42:28.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.113+0000 7f58a013c800 20 remove_watcher() i=5 2024-03-09T14:42:28.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.114+0000 7f58a013c800 20 remove_watcher() i=6 2024-03-09T14:42:28.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.115+0000 7f58a013c800 20 remove_watcher() i=7 2024-03-09T14:42:28.127 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-03-09T14:42:28.154 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:42:28.154 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:42:28.189 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.188+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.190+0000 7f16bbe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:28.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.190+0000 7f16bbe0f800 20 realm 2024-03-09T14:42:28.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.190+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.190+0000 7f16bbe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:28.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.190+0000 7f16bbe0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:42:28.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.190+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.190+0000 7f16bbe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:28.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.190+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.191 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.191+0000 7f16bbe0f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:28.192 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.191+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.192 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.191+0000 7f16bbe0f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:42:28.192 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.191+0000 7f16bbe0f800 20 searching for the correct realm 2024-03-09T14:42:28.194 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.194+0000 7f16b7c82640 0 -- 172.21.15.88:0/2325086783 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f16b0021740 msgr2=0x7f16b0060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:28.400 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.400+0000 7f16b6c80640 0 -- 172.21.15.88:0/2325086783 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f16b0078000 msgr2=0x7f16b0008990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:28.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.607+0000 7f16bbe0f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:42:28.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.607+0000 7f16bbe0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:42:28.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.607+0000 7f16bbe0f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:42:28.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.607+0000 7f16bbe0f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:42:28.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.607+0000 7f16bbe0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:42:28.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.607+0000 7f16bbe0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:42:28.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.607+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.607+0000 7f16bbe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:28.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.607+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.607+0000 7f16bbe0f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:28.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.607+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.608+0000 7f16bbe0f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:42:28.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.608+0000 7f16bbe0f800 20 zone default found 2024-03-09T14:42:28.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.608+0000 7f16bbe0f800 4 Realm: () 2024-03-09T14:42:28.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.608+0000 7f16bbe0f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:42:28.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.608+0000 7f16bbe0f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:42:28.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.608+0000 7f16bbe0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:42:28.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.608+0000 7f16bbe0f800 20 zonegroup default 2024-03-09T14:42:28.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.608+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.608+0000 7f16bbe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:28.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.608+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.608+0000 7f16bbe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:28.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.608+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.609+0000 7f16bbe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:28.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.609+0000 7f16bbe0f800 20 started sync module instance, tier type = 2024-03-09T14:42:28.611 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.609+0000 7f16bbe0f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:42:28.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.619+0000 7f16bbe0f800 20 add_watcher() i=0 2024-03-09T14:42:28.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.619+0000 7f16bbe0f800 20 add_watcher() i=1 2024-03-09T14:42:28.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.619+0000 7f16bbe0f800 20 add_watcher() i=2 2024-03-09T14:42:28.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.619+0000 7f16bbe0f800 20 add_watcher() i=3 2024-03-09T14:42:28.620 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.619+0000 7f16bbe0f800 20 add_watcher() i=4 2024-03-09T14:42:28.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.619+0000 7f16bbe0f800 20 add_watcher() i=5 2024-03-09T14:42:28.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.619+0000 7f16bbe0f800 20 add_watcher() i=6 2024-03-09T14:42:28.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.620+0000 7f16bbe0f800 20 add_watcher() i=7 2024-03-09T14:42:28.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.620+0000 7f16bbe0f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:42:28.623 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.622+0000 7f156dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:28.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.622+0000 7f16bbe0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:42:28.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.622+0000 7f16bbe0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:42:28.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.622+0000 7f16bbe0f800 5 note: GC not initialized 2024-03-09T14:42:28.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.622+0000 7f156cfe1640 20 reqs_thread_entry: start 2024-03-09T14:42:28.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.622+0000 7f16bbe0f800 20 init_complete bucket index max shards: 11 2024-03-09T14:42:28.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.622+0000 7f16bbe0f800 20 Filter name: none 2024-03-09T14:42:28.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.622+0000 7f14e67fc640 20 reqs_thread_entry: start 2024-03-09T14:42:28.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.622+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.623+0000 7f16bbe0f800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:42:28.624 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.623+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.625 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.623+0000 7f16bbe0f800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:42:28.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.623+0000 7f16bbe0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:42:28.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.623+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.624+0000 7f16bbe0f800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:42:28.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.624+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.624+0000 7f16bbe0f800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:42:28.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.624+0000 7f16bbe0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:42:28.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.625+0000 7f16bbe0f800 20 rados->read ofs=0 len=0 2024-03-09T14:42:28.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.626+0000 7f16bbe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:28.627 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.626+0000 7f156dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:28.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.629+0000 7f16bbe0f800 20 remove_watcher() i=0 2024-03-09T14:42:28.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.629+0000 7f16bbe0f800 2 removed watcher, disabling cache 2024-03-09T14:42:28.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.630+0000 7f16bbe0f800 20 remove_watcher() i=1 2024-03-09T14:42:28.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.631+0000 7f16bbe0f800 20 remove_watcher() i=2 2024-03-09T14:42:28.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.632+0000 7f16bbe0f800 20 remove_watcher() i=3 2024-03-09T14:42:28.633 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.633+0000 7f16bbe0f800 20 remove_watcher() i=4 2024-03-09T14:42:28.634 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.634+0000 7f16bbe0f800 20 remove_watcher() i=5 2024-03-09T14:42:28.635 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.635+0000 7f16bbe0f800 20 remove_watcher() i=6 2024-03-09T14:42:28.637 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:28.636+0000 7f16bbe0f800 20 remove_watcher() i=7 2024-03-09T14:42:28.647 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:28.647 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:42:28.647 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: abort-at-commit-target-layout id: 5d93e872-363b-498b-b665-658644296b85.4535.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:42:28.647 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:28.971 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-03-09T14:42:28.971 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:29.717 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-03-09T14:42:29.744 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:42:29.744 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:42:29.777 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.777+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.779+0000 7feaf710d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:29.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.779+0000 7feaf710d800 20 realm 2024-03-09T14:42:29.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.779+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.779+0000 7feaf710d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:29.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.779+0000 7feaf710d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:42:29.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.779+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.779+0000 7feaf710d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:29.779 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.779+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.780 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.780+0000 7feaf710d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:29.780 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.780+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.780 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.781+0000 7feaf710d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:42:29.781 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.781+0000 7feaf710d800 20 searching for the correct realm 2024-03-09T14:42:29.784 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.784+0000 7feaf4c09640 0 -- 172.21.15.88:0/2794370575 >> [v2:172.21.15.88:6805/1625923178,v1:172.21.15.88:6809/1625923178] conn(0x5650ffebe130 msgr2=0x5650ffec0540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:42:29.788 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.789+0000 7feaeffff640 0 -- 172.21.15.88:0/2794370575 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7feaf0017040 msgr2=0x7feaf005b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:29.794 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.793+0000 7feaf710d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:42:29.794 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.793+0000 7feaf710d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:42:29.794 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.793+0000 7feaf710d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:42:29.794 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.793+0000 7feaf710d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:42:29.794 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.793+0000 7feaf710d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:42:29.794 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.793+0000 7feaf710d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:42:29.794 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.793+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.794 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.793+0000 7feaf710d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:29.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.793+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.794+0000 7feaf710d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:29.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.794+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.794+0000 7feaf710d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:42:29.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.794+0000 7feaf710d800 20 zone default found 2024-03-09T14:42:29.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.794+0000 7feaf710d800 4 Realm: () 2024-03-09T14:42:29.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.794+0000 7feaf710d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:42:29.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.794+0000 7feaf710d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:42:29.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.794+0000 7feaf710d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:42:29.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.794+0000 7feaf710d800 20 zonegroup default 2024-03-09T14:42:29.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.794+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.794+0000 7feaf710d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:29.795 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.794+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.796 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.795+0000 7feaf710d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:29.797 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.795+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.797 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.795+0000 7feaf710d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:29.797 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.795+0000 7feaf710d800 20 started sync module instance, tier type = 2024-03-09T14:42:29.797 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.795+0000 7feaf710d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:42:29.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.804+0000 7feaf710d800 20 add_watcher() i=0 2024-03-09T14:42:29.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.804+0000 7feaf710d800 20 add_watcher() i=1 2024-03-09T14:42:29.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.804+0000 7feaf710d800 20 add_watcher() i=2 2024-03-09T14:42:29.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.804+0000 7feaf710d800 20 add_watcher() i=3 2024-03-09T14:42:29.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.804+0000 7feaf710d800 20 add_watcher() i=4 2024-03-09T14:42:29.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.804+0000 7feaf710d800 20 add_watcher() i=5 2024-03-09T14:42:29.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.804+0000 7feaf710d800 20 add_watcher() i=6 2024-03-09T14:42:29.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.805+0000 7feaf710d800 20 add_watcher() i=7 2024-03-09T14:42:29.804 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.805+0000 7feaf710d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:42:29.806 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.806+0000 7fe9aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:29.807 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.806+0000 7feaf710d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:42:29.807 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.806+0000 7feaf710d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:42:29.807 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.807+0000 7feaf710d800 5 note: GC not initialized 2024-03-09T14:42:29.807 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.807+0000 7fe9a9fe3640 20 reqs_thread_entry: start 2024-03-09T14:42:29.807 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.807+0000 7feaf710d800 20 init_complete bucket index max shards: 11 2024-03-09T14:42:29.807 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.807+0000 7feaf710d800 20 Filter name: none 2024-03-09T14:42:29.807 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.807+0000 7fe91b7fe640 20 reqs_thread_entry: start 2024-03-09T14:42:29.807 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.807+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.808+0000 7feaf710d800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:42:29.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.808+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.808+0000 7feaf710d800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:42:29.808 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.808+0000 7feaf710d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:42:29.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.808+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.809+0000 7feaf710d800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:42:29.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.809+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.809+0000 7feaf710d800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:42:29.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.809+0000 7feaf710d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:42:29.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.810+0000 7feaf710d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.810+0000 7feaf710d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:29.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.811+0000 7fe9aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:29.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.813+0000 7feaf710d800 20 remove_watcher() i=0 2024-03-09T14:42:29.813 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.813+0000 7feaf710d800 2 removed watcher, disabling cache 2024-03-09T14:42:29.814 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.815+0000 7feaf710d800 20 remove_watcher() i=1 2024-03-09T14:42:29.815 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.816+0000 7feaf710d800 20 remove_watcher() i=2 2024-03-09T14:42:29.816 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.817+0000 7feaf710d800 20 remove_watcher() i=3 2024-03-09T14:42:29.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.818+0000 7feaf710d800 20 remove_watcher() i=4 2024-03-09T14:42:29.818 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.819+0000 7feaf710d800 20 remove_watcher() i=5 2024-03-09T14:42:29.819 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.820+0000 7feaf710d800 20 remove_watcher() i=6 2024-03-09T14:42:29.820 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.821+0000 7feaf710d800 20 remove_watcher() i=7 2024-03-09T14:42:29.830 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:29.830 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:42:29.830 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-do-reshard id: 5d93e872-363b-498b-b665-658644296b85.4535.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:42:29.830 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:29.831 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-03-09T14:42:29.863 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:42:29.863 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:42:29.897 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.897+0000 7f6c027a2800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.898+0000 7f6c027a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:29.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.898+0000 7f6c027a2800 20 realm 2024-03-09T14:42:29.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.898+0000 7f6c027a2800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.899+0000 7f6c027a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:29.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.899+0000 7f6c027a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:42:29.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.899+0000 7f6c027a2800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.899+0000 7f6c027a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:29.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.899+0000 7f6c027a2800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.900+0000 7f6c027a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:29.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.900+0000 7f6c027a2800 20 rados->read ofs=0 len=0 2024-03-09T14:42:29.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.900+0000 7f6c027a2800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:42:29.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.900+0000 7f6c027a2800 20 searching for the correct realm 2024-03-09T14:42:29.901 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.901+0000 7f6c002a5640 0 -- 172.21.15.88:0/3083433873 >> [v2:172.21.15.88:6800/4216886240,v1:172.21.15.88:6802/4216886240] conn(0x5611ed991b10 msgr2=0x5611ed993fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:29.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:29.905+0000 7f6c002a5640 0 -- 172.21.15.88:0/3083433873 >> [v2:172.21.15.132:6824/731564406,v1:172.21.15.132:6825/731564406] conn(0x5611ed74c380 msgr2=0x7f6bf8031410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:30.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.114+0000 7f6c027a2800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:42:30.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.114+0000 7f6c027a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:42:30.115 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.114+0000 7f6c027a2800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:42:30.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.114+0000 7f6c027a2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:42:30.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.114+0000 7f6c027a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:42:30.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.114+0000 7f6c027a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:42:30.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.114+0000 7f6c027a2800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.115+0000 7f6c027a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.116 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.115+0000 7f6c027a2800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.115+0000 7f6c027a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:30.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.115+0000 7f6c027a2800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.115+0000 7f6c027a2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:42:30.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.115+0000 7f6c027a2800 20 zone default found 2024-03-09T14:42:30.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.115+0000 7f6c027a2800 4 Realm: () 2024-03-09T14:42:30.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.115+0000 7f6c027a2800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:42:30.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.115+0000 7f6c027a2800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:42:30.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.115+0000 7f6c027a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:42:30.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.115+0000 7f6c027a2800 20 zonegroup default 2024-03-09T14:42:30.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.115+0000 7f6c027a2800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.116+0000 7f6c027a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.117 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.116+0000 7f6c027a2800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.116+0000 7f6c027a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.116+0000 7f6c027a2800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.116+0000 7f6c027a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.116+0000 7f6c027a2800 20 started sync module instance, tier type = 2024-03-09T14:42:30.118 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.116+0000 7f6c027a2800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:42:30.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.126+0000 7f6c027a2800 20 add_watcher() i=0 2024-03-09T14:42:30.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.126+0000 7f6c027a2800 20 add_watcher() i=1 2024-03-09T14:42:30.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.126+0000 7f6c027a2800 20 add_watcher() i=2 2024-03-09T14:42:30.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.126+0000 7f6c027a2800 20 add_watcher() i=3 2024-03-09T14:42:30.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.126+0000 7f6c027a2800 20 add_watcher() i=4 2024-03-09T14:42:30.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.126+0000 7f6c027a2800 20 add_watcher() i=5 2024-03-09T14:42:30.126 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.126+0000 7f6c027a2800 20 add_watcher() i=6 2024-03-09T14:42:30.127 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.127+0000 7f6c027a2800 20 add_watcher() i=7 2024-03-09T14:42:30.127 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.127+0000 7f6c027a2800 2 all 8 watchers are set, enabling cache 2024-03-09T14:42:30.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.129+0000 7f6ab6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:30.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.129+0000 7f6c027a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:42:30.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.129+0000 7f6c027a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:42:30.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.129+0000 7f6c027a2800 5 note: GC not initialized 2024-03-09T14:42:30.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.129+0000 7f6ab5fdb640 20 reqs_thread_entry: start 2024-03-09T14:42:30.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.129+0000 7f6c027a2800 20 init_complete bucket index max shards: 11 2024-03-09T14:42:30.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.129+0000 7f6c027a2800 20 Filter name: none 2024-03-09T14:42:30.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.129+0000 7f6a277fe640 20 reqs_thread_entry: start 2024-03-09T14:42:30.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.130+0000 7f6c027a2800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-03-09T14:42:30.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.130+0000 7f6c027a2800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.130+0000 7f6c027a2800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:42:30.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.130+0000 7f6c027a2800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-03-09T14:42:30.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.130+0000 7f6c027a2800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-03-09T14:42:30.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.130+0000 7f6c027a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 : miss 2024-03-09T14:42:30.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.130+0000 7f6c027a2800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.130+0000 7f6c027a2800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:42:30.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.130+0000 7f6c027a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 info.flags=0x17 2024-03-09T14:42:30.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.130+0000 7f6c027a2800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 to cache LRU end 2024-03-09T14:42:30.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.130+0000 7f6c027a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:30.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.130+0000 7f6c027a2800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:30.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.130+0000 7f6c027a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 2024-03-09T14:42:30.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.135+0000 7f6c027a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 info.flags=0x17 2024-03-09T14:42:30.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.135+0000 7f6c027a2800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 to cache LRU end 2024-03-09T14:42:30.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.135+0000 7f6c027a2800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:30.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.135+0000 7f6c027a2800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27, ofs0, ns] 2024-03-09T14:42:30.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.136+0000 7f6ad6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464364 cookie 94635000675664 notifier 6843 bl.length()=903 2024-03-09T14:42:30.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.136+0000 7f6ad6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 info.flags=0x17 2024-03-09T14:42:30.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.136+0000 7f6ad6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 to cache LRU end 2024-03-09T14:42:30.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.136+0000 7f6ad6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:30.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.137+0000 7f6c027a2800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): orig_sources= new_sources= 2024-03-09T14:42:30.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.137+0000 7f6c027a2800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): potential sources added=[] removed=[] 2024-03-09T14:42:30.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.137+0000 7f6c027a2800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): orig_dests= new_dests= 2024-03-09T14:42:30.137 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.137+0000 7f6c027a2800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): potential dests added=[] removed=[] 2024-03-09T14:42:30.139 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.140+0000 7f6c027a2800 -1 Injecting error=-5 at location=do_reshard 2024-03-09T14:42:30.145 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.145+0000 7f6c027a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 : hit (requested=0x17, cached=0x17) 2024-03-09T14:42:30.145 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.145+0000 7f6c027a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 2024-03-09T14:42:30.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.147+0000 7f6c027a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 info.flags=0x17 2024-03-09T14:42:30.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.147+0000 7f6c027a2800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 to cache LRU end 2024-03-09T14:42:30.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.147+0000 7f6c027a2800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:30.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.147+0000 7f6c027a2800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27, ofs0, ns] 2024-03-09T14:42:30.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.147+0000 7f6ad77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464365 cookie 94635000675664 notifier 6843 bl.length()=871 2024-03-09T14:42:30.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.147+0000 7f6ad77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 info.flags=0x17 2024-03-09T14:42:30.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.147+0000 7f6ad77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 to cache LRU end 2024-03-09T14:42:30.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.147+0000 7f6ad77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:30.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.149+0000 7f6c027a2800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): orig_sources= new_sources= 2024-03-09T14:42:30.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.149+0000 7f6c027a2800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): potential sources added=[] removed=[] 2024-03-09T14:42:30.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.149+0000 7f6c027a2800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): orig_dests= new_dests= 2024-03-09T14:42:30.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.149+0000 7f6c027a2800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): potential dests added=[] removed=[] 2024-03-09T14:42:30.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.149+0000 7f6c027a2800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-03-09T14:42:30.150 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.150+0000 7f6ab6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:30.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.153+0000 7f6c027a2800 20 remove_watcher() i=0 2024-03-09T14:42:30.152 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.153+0000 7f6c027a2800 2 removed watcher, disabling cache 2024-03-09T14:42:30.153 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.154+0000 7f6c027a2800 20 remove_watcher() i=1 2024-03-09T14:42:30.154 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.155+0000 7f6c027a2800 20 remove_watcher() i=2 2024-03-09T14:42:30.155 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.156+0000 7f6c027a2800 20 remove_watcher() i=3 2024-03-09T14:42:30.157 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.157+0000 7f6c027a2800 20 remove_watcher() i=4 2024-03-09T14:42:30.157 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.158+0000 7f6c027a2800 20 remove_watcher() i=5 2024-03-09T14:42:30.158 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.159+0000 7f6c027a2800 20 remove_watcher() i=6 2024-03-09T14:42:30.159 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.160+0000 7f6c027a2800 20 remove_watcher() i=7 2024-03-09T14:42:30.171 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-03-09T14:42:30.198 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:42:30.198 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:42:30.231 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.232+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.233+0000 7f33e3a2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.233+0000 7f33e3a2e800 20 realm 2024-03-09T14:42:30.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.233+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.233+0000 7f33e3a2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.233+0000 7f33e3a2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:42:30.233 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.233+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.234+0000 7f33e3a2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.234+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.234+0000 7f33e3a2e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:30.234 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.234+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.235+0000 7f33e3a2e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:42:30.235 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.235+0000 7f33e3a2e800 20 searching for the correct realm 2024-03-09T14:42:30.236 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.237+0000 7f33d7fff640 0 -- 172.21.15.88:0/4209641561 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f33d001a040 msgr2=0x7f33d005f020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:30.239 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.240+0000 7f33d7fff640 0 -- 172.21.15.88:0/4209641561 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f32a807ace0 msgr2=0x7f32a807d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:42:30.246 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.246+0000 7f33e3a2e800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:42:30.246 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.246+0000 7f33e3a2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:42:30.246 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.246+0000 7f33e3a2e800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:42:30.246 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.246+0000 7f33e3a2e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:42:30.246 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.246+0000 7f33e3a2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:42:30.246 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.246+0000 7f33e3a2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:42:30.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.246+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.246+0000 7f33e3a2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.246+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.247+0000 7f33e3a2e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:30.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.247+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.247+0000 7f33e3a2e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:42:30.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.247+0000 7f33e3a2e800 20 zone default found 2024-03-09T14:42:30.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.247+0000 7f33e3a2e800 4 Realm: () 2024-03-09T14:42:30.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.247+0000 7f33e3a2e800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:42:30.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.247+0000 7f33e3a2e800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:42:30.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.247+0000 7f33e3a2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:42:30.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.247+0000 7f33e3a2e800 20 zonegroup default 2024-03-09T14:42:30.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.247+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.247+0000 7f33e3a2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.247+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.247+0000 7f33e3a2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.247+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.248+0000 7f33e3a2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.248+0000 7f33e3a2e800 20 started sync module instance, tier type = 2024-03-09T14:42:30.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.248+0000 7f33e3a2e800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:42:30.257 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.258+0000 7f33e3a2e800 20 add_watcher() i=0 2024-03-09T14:42:30.257 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.258+0000 7f33e3a2e800 20 add_watcher() i=1 2024-03-09T14:42:30.257 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.258+0000 7f33e3a2e800 20 add_watcher() i=2 2024-03-09T14:42:30.257 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.258+0000 7f33e3a2e800 20 add_watcher() i=3 2024-03-09T14:42:30.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.258+0000 7f33e3a2e800 20 add_watcher() i=4 2024-03-09T14:42:30.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.258+0000 7f33e3a2e800 20 add_watcher() i=5 2024-03-09T14:42:30.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.258+0000 7f33e3a2e800 20 add_watcher() i=6 2024-03-09T14:42:30.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.259+0000 7f33e3a2e800 20 add_watcher() i=7 2024-03-09T14:42:30.258 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.259+0000 7f33e3a2e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:42:30.260 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.260+0000 7f32957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:30.263 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.261+0000 7f33e3a2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:42:30.264 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.261+0000 7f33e3a2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:42:30.264 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.261+0000 7f33e3a2e800 5 note: GC not initialized 2024-03-09T14:42:30.264 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.261+0000 7f320ffff640 20 reqs_thread_entry: start 2024-03-09T14:42:30.264 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.261+0000 7f33e3a2e800 20 init_complete bucket index max shards: 11 2024-03-09T14:42:30.264 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.261+0000 7f33e3a2e800 20 Filter name: none 2024-03-09T14:42:30.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.261+0000 7f320dffb640 20 reqs_thread_entry: start 2024-03-09T14:42:30.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.261+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.261+0000 7f33e3a2e800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:42:30.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.261+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.262+0000 7f33e3a2e800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:42:30.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.262+0000 7f33e3a2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:42:30.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.262+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.262+0000 7f33e3a2e800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:42:30.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.262+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.263+0000 7f33e3a2e800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:42:30.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.263+0000 7f33e3a2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:42:30.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.264+0000 7f33e3a2e800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.264+0000 7f33e3a2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.265+0000 7f32957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:30.268 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.268+0000 7f33e3a2e800 20 remove_watcher() i=0 2024-03-09T14:42:30.268 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.268+0000 7f33e3a2e800 2 removed watcher, disabling cache 2024-03-09T14:42:30.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.269+0000 7f33e3a2e800 20 remove_watcher() i=1 2024-03-09T14:42:30.270 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.270+0000 7f33e3a2e800 20 remove_watcher() i=2 2024-03-09T14:42:30.271 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.272+0000 7f33e3a2e800 20 remove_watcher() i=3 2024-03-09T14:42:30.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.273+0000 7f33e3a2e800 20 remove_watcher() i=4 2024-03-09T14:42:30.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.274+0000 7f33e3a2e800 20 remove_watcher() i=5 2024-03-09T14:42:30.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.275+0000 7f33e3a2e800 20 remove_watcher() i=6 2024-03-09T14:42:30.276 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.276+0000 7f33e3a2e800 20 remove_watcher() i=7 2024-03-09T14:42:30.286 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:30.286 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:42:30.286 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-do-reshard id: 5d93e872-363b-498b-b665-658644296b85.4535.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:42:30.287 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:30.373 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:42:30.402 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:42:30.402 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:42:30.435 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.436+0000 7f9eb253b800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.437 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.437+0000 7f9eb253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.437 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.437+0000 7f9eb253b800 20 realm 2024-03-09T14:42:30.437 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.437+0000 7f9eb253b800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.437+0000 7f9eb253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.437+0000 7f9eb253b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:42:30.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.437+0000 7f9eb253b800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.437+0000 7f9eb253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.438 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.437+0000 7f9eb253b800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.438+0000 7f9eb253b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:30.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.438+0000 7f9eb253b800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.439+0000 7f9eb253b800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:42:30.439 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.439+0000 7f9eb253b800 20 searching for the correct realm 2024-03-09T14:42:30.441 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.441+0000 7f9eaeace640 0 -- 172.21.15.88:0/3833038912 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f9ea800e040 msgr2=0x7f9ea805bfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:42:30.445 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.445+0000 7f9eadacc640 0 -- 172.21.15.88:0/3833038912 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f9ea8068420 msgr2=0x7f9ea802b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:30.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.652+0000 7f9eb253b800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:42:30.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.652+0000 7f9eb253b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:42:30.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.652+0000 7f9eb253b800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:42:30.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.652+0000 7f9eb253b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:42:30.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.652+0000 7f9eb253b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:42:30.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.652+0000 7f9eb253b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:42:30.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.652+0000 7f9eb253b800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.653+0000 7f9eb253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.653+0000 7f9eb253b800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.653+0000 7f9eb253b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:30.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.653+0000 7f9eb253b800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.653+0000 7f9eb253b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:42:30.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.653+0000 7f9eb253b800 20 zone default found 2024-03-09T14:42:30.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.653+0000 7f9eb253b800 4 Realm: () 2024-03-09T14:42:30.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.653+0000 7f9eb253b800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:42:30.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.653+0000 7f9eb253b800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:42:30.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.653+0000 7f9eb253b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:42:30.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.653+0000 7f9eb253b800 20 zonegroup default 2024-03-09T14:42:30.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.653+0000 7f9eb253b800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.653+0000 7f9eb253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.654+0000 7f9eb253b800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.654+0000 7f9eb253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.654+0000 7f9eb253b800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.654+0000 7f9eb253b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.654+0000 7f9eb253b800 20 started sync module instance, tier type = 2024-03-09T14:42:30.656 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.654+0000 7f9eb253b800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:42:30.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.668+0000 7f9eb253b800 20 add_watcher() i=0 2024-03-09T14:42:30.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.668+0000 7f9eb253b800 20 add_watcher() i=1 2024-03-09T14:42:30.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.668+0000 7f9eb253b800 20 add_watcher() i=2 2024-03-09T14:42:30.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.668+0000 7f9eb253b800 20 add_watcher() i=3 2024-03-09T14:42:30.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.668+0000 7f9eb253b800 20 add_watcher() i=4 2024-03-09T14:42:30.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.668+0000 7f9eb253b800 20 add_watcher() i=5 2024-03-09T14:42:30.668 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.668+0000 7f9eb253b800 20 add_watcher() i=6 2024-03-09T14:42:30.669 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.669+0000 7f9eb253b800 20 add_watcher() i=7 2024-03-09T14:42:30.669 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.669+0000 7f9eb253b800 2 all 8 watchers are set, enabling cache 2024-03-09T14:42:30.670 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.671+0000 7f9d64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:30.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.671+0000 7f9eb253b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:42:30.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.671+0000 7f9eb253b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:42:30.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.671+0000 7f9eb253b800 5 note: GC not initialized 2024-03-09T14:42:30.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.671+0000 7f9cdf7fe640 20 reqs_thread_entry: start 2024-03-09T14:42:30.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.671+0000 7f9eb253b800 20 init_complete bucket index max shards: 11 2024-03-09T14:42:30.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.671+0000 7f9eb253b800 20 Filter name: none 2024-03-09T14:42:30.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.672+0000 7f9cdd7fa640 20 reqs_thread_entry: start 2024-03-09T14:42:30.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.672+0000 7f9eb253b800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-03-09T14:42:30.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.672+0000 7f9eb253b800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.672+0000 7f9eb253b800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:42:30.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.672+0000 7f9eb253b800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-03-09T14:42:30.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.672+0000 7f9eb253b800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-03-09T14:42:30.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.672+0000 7f9eb253b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 : miss 2024-03-09T14:42:30.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.672+0000 7f9eb253b800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.672+0000 7f9eb253b800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:42:30.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.672+0000 7f9eb253b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 info.flags=0x17 2024-03-09T14:42:30.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.673+0000 7f9eb253b800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 to cache LRU end 2024-03-09T14:42:30.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.673+0000 7f9eb253b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:30.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.673+0000 7f9eb253b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:30.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.673+0000 7f9eb253b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 2024-03-09T14:42:30.678 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.678+0000 7f9eb253b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 info.flags=0x17 2024-03-09T14:42:30.678 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.678+0000 7f9eb253b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 to cache LRU end 2024-03-09T14:42:30.678 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.678+0000 7f9eb253b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:30.678 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.678+0000 7f9eb253b800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27, ofs0, ns] 2024-03-09T14:42:30.679 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.679+0000 7f9d91ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464366 cookie 94750264823648 notifier 6566 bl.length()=903 2024-03-09T14:42:30.679 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.679+0000 7f9d91ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 info.flags=0x17 2024-03-09T14:42:30.679 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.679+0000 7f9d91ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 to cache LRU end 2024-03-09T14:42:30.679 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.679+0000 7f9d91ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:30.680 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.681+0000 7f9eb253b800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): orig_sources= new_sources= 2024-03-09T14:42:30.680 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.681+0000 7f9eb253b800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): potential sources added=[] removed=[] 2024-03-09T14:42:30.680 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.681+0000 7f9eb253b800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): orig_dests= new_dests= 2024-03-09T14:42:30.680 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.681+0000 7f9eb253b800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): potential dests added=[] removed=[] 2024-03-09T14:42:30.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.0 2024-03-09T14:42:30.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.0 2024-03-09T14:42:30.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.1 2024-03-09T14:42:30.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.1 2024-03-09T14:42:30.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.2 2024-03-09T14:42:30.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.2 2024-03-09T14:42:30.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.3 2024-03-09T14:42:30.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.3 2024-03-09T14:42:30.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.4 2024-03-09T14:42:30.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.4 2024-03-09T14:42:30.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.5 2024-03-09T14:42:30.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.5 2024-03-09T14:42:30.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.6 2024-03-09T14:42:30.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.6 2024-03-09T14:42:30.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.7 2024-03-09T14:42:30.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.7 2024-03-09T14:42:30.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.8 2024-03-09T14:42:30.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.8 2024-03-09T14:42:30.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.9 2024-03-09T14:42:30.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.9 2024-03-09T14:42:30.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.10 2024-03-09T14:42:30.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.10 2024-03-09T14:42:30.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.11 2024-03-09T14:42:30.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1.11 2024-03-09T14:42:30.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.683+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.0 2024-03-09T14:42:30.685 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.684+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.1 2024-03-09T14:42:30.685 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.684+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.2 2024-03-09T14:42:30.685 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.685+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.3 2024-03-09T14:42:30.685 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.685+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.4 2024-03-09T14:42:30.686 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.686+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.5 2024-03-09T14:42:30.686 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.686+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.6 2024-03-09T14:42:30.686 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.687+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.7 2024-03-09T14:42:30.687 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.687+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.8 2024-03-09T14:42:30.687 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.688+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.9 2024-03-09T14:42:30.688 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.688+0000 7f9eb253b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.27.10 2024-03-09T14:42:30.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.692+0000 7f9eb253b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 : hit (requested=0x17, cached=0x17) 2024-03-09T14:42:30.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.692+0000 7f9eb253b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 2024-03-09T14:42:30.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.693+0000 7f9eb253b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 info.flags=0x17 2024-03-09T14:42:30.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.693+0000 7f9eb253b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 to cache LRU end 2024-03-09T14:42:30.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.693+0000 7f9eb253b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:30.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.693+0000 7f9eb253b800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27, ofs0, ns] 2024-03-09T14:42:30.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.693+0000 7f9d917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464367 cookie 94750264823648 notifier 6566 bl.length()=871 2024-03-09T14:42:30.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.694+0000 7f9d917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 info.flags=0x17 2024-03-09T14:42:30.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.694+0000 7f9d917fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.27 to cache LRU end 2024-03-09T14:42:30.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.694+0000 7f9d917fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:30.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.695+0000 7f9eb253b800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): orig_sources= new_sources= 2024-03-09T14:42:30.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.695+0000 7f9eb253b800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): potential sources added=[] removed=[] 2024-03-09T14:42:30.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.695+0000 7f9eb253b800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): orig_dests= new_dests= 2024-03-09T14:42:30.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.695+0000 7f9eb253b800 20 handle_bi_update(): bucket=:error-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.27]): potential dests added=[] removed=[] 2024-03-09T14:42:30.697 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.697+0000 7f9eb253b800 1 execute INFO: reshard of bucket "error-at-do-reshard" completed successfully 2024-03-09T14:42:30.698 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.699+0000 7f9d64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:30.702 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.701+0000 7f9eb253b800 20 remove_watcher() i=0 2024-03-09T14:42:30.702 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.701+0000 7f9eb253b800 2 removed watcher, disabling cache 2024-03-09T14:42:30.702 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.703+0000 7f9eb253b800 20 remove_watcher() i=1 2024-03-09T14:42:30.703 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.704+0000 7f9eb253b800 20 remove_watcher() i=2 2024-03-09T14:42:30.704 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.705+0000 7f9eb253b800 20 remove_watcher() i=3 2024-03-09T14:42:30.705 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.706+0000 7f9eb253b800 20 remove_watcher() i=4 2024-03-09T14:42:30.706 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.707+0000 7f9eb253b800 20 remove_watcher() i=5 2024-03-09T14:42:30.707 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.708+0000 7f9eb253b800 20 remove_watcher() i=6 2024-03-09T14:42:30.708 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.709+0000 7f9eb253b800 20 remove_watcher() i=7 2024-03-09T14:42:30.719 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-03-09T14:42:30.747 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:42:30.747 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:42:30.780 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.780+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.781 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.782+0000 7fcd17133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.782+0000 7fcd17133800 20 realm 2024-03-09T14:42:30.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.782+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.782+0000 7fcd17133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.782+0000 7fcd17133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:42:30.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.782+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.782+0000 7fcd17133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:30.782 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.782+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.783 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.783+0000 7fcd17133800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:30.783 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.783+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:30.783 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.784+0000 7fcd17133800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:42:30.783 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.784+0000 7fcd17133800 20 searching for the correct realm 2024-03-09T14:42:30.785 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.786+0000 7fcd13665640 0 -- 172.21.15.88:0/937763869 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fcd0c018040 msgr2=0x7fcd0c0389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:30.992 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:30.992+0000 7fcd12663640 0 -- 172.21.15.88:0/937763869 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fcd0c018930 msgr2=0x7fcd0c034410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:31.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.199+0000 7fcd17133800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:42:31.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.199+0000 7fcd17133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:42:31.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.199+0000 7fcd17133800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:42:31.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.199+0000 7fcd17133800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:42:31.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.199+0000 7fcd17133800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:42:31.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.199+0000 7fcd17133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:42:31.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.199+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.199+0000 7fcd17133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.199+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.200+0000 7fcd17133800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:31.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.200+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.201 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.200+0000 7fcd17133800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:42:31.201 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.200+0000 7fcd17133800 20 zone default found 2024-03-09T14:42:31.201 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.200+0000 7fcd17133800 4 Realm: () 2024-03-09T14:42:31.201 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.200+0000 7fcd17133800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:42:31.201 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.200+0000 7fcd17133800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:42:31.201 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.200+0000 7fcd17133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:42:31.201 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.200+0000 7fcd17133800 20 zonegroup default 2024-03-09T14:42:31.201 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.200+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.200+0000 7fcd17133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.200+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.201+0000 7fcd17133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.201+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.201+0000 7fcd17133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.201+0000 7fcd17133800 20 started sync module instance, tier type = 2024-03-09T14:42:31.202 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.201+0000 7fcd17133800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:42:31.210 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.211+0000 7fcd17133800 20 add_watcher() i=0 2024-03-09T14:42:31.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.211+0000 7fcd17133800 20 add_watcher() i=1 2024-03-09T14:42:31.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.211+0000 7fcd17133800 20 add_watcher() i=2 2024-03-09T14:42:31.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.211+0000 7fcd17133800 20 add_watcher() i=3 2024-03-09T14:42:31.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.211+0000 7fcd17133800 20 add_watcher() i=4 2024-03-09T14:42:31.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.211+0000 7fcd17133800 20 add_watcher() i=5 2024-03-09T14:42:31.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.211+0000 7fcd17133800 20 add_watcher() i=6 2024-03-09T14:42:31.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.212+0000 7fcd17133800 20 add_watcher() i=7 2024-03-09T14:42:31.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.212+0000 7fcd17133800 2 all 8 watchers are set, enabling cache 2024-03-09T14:42:31.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.214+0000 7fcbc97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:31.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.214+0000 7fcd17133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:42:31.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.214+0000 7fcd17133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:42:31.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.214+0000 7fcd17133800 5 note: GC not initialized 2024-03-09T14:42:31.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.214+0000 7fcb43fff640 20 reqs_thread_entry: start 2024-03-09T14:42:31.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.214+0000 7fcd17133800 20 init_complete bucket index max shards: 11 2024-03-09T14:42:31.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.214+0000 7fcd17133800 20 Filter name: none 2024-03-09T14:42:31.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.214+0000 7fcb41ffb640 20 reqs_thread_entry: start 2024-03-09T14:42:31.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.214+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.215+0000 7fcd17133800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:42:31.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.215+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.215+0000 7fcd17133800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:42:31.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.215+0000 7fcd17133800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:42:31.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.215+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.216+0000 7fcd17133800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:42:31.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.216+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.216+0000 7fcd17133800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:42:31.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.216+0000 7fcd17133800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:42:31.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.217+0000 7fcd17133800 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.217 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.218+0000 7fcd17133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.218 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.218+0000 7fcbc97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:31.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.221+0000 7fcd17133800 20 remove_watcher() i=0 2024-03-09T14:42:31.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.221+0000 7fcd17133800 2 removed watcher, disabling cache 2024-03-09T14:42:31.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.222+0000 7fcd17133800 20 remove_watcher() i=1 2024-03-09T14:42:31.222 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.223+0000 7fcd17133800 20 remove_watcher() i=2 2024-03-09T14:42:31.223 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.224+0000 7fcd17133800 20 remove_watcher() i=3 2024-03-09T14:42:31.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.225+0000 7fcd17133800 20 remove_watcher() i=4 2024-03-09T14:42:31.225 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.226+0000 7fcd17133800 20 remove_watcher() i=5 2024-03-09T14:42:31.226 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.227+0000 7fcd17133800 20 remove_watcher() i=6 2024-03-09T14:42:31.227 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:31.228+0000 7fcd17133800 20 remove_watcher() i=7 2024-03-09T14:42:31.237 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:31.237 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:42:31.237 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: error-at-do-reshard id: 5d93e872-363b-498b-b665-658644296b85.4535.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:42:31.237 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:31.562 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: reshard bucket with abort at do_reshard 2024-03-09T14:42:31.562 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:32.310 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-03-09T14:42:32.337 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:42:32.337 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:42:32.370 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.371+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.372+0000 7ff37f42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.372+0000 7ff37f42d800 20 realm 2024-03-09T14:42:32.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.372+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.372+0000 7ff37f42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.372+0000 7ff37f42d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:42:32.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.372+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.372+0000 7ff37f42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.372+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.373+0000 7ff37f42d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:32.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.373+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.374+0000 7ff37f42d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:42:32.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.374+0000 7ff37f42d800 20 searching for the correct realm 2024-03-09T14:42:32.376 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.376+0000 7ff37ae3d640 0 -- 172.21.15.88:0/866209384 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7ff37403d480 msgr2=0x7ff37403d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:32.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.381+0000 7ff371e3b640 0 -- 172.21.15.88:0/866209384 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7ff374055420 msgr2=0x7ff374055880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:32.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.587+0000 7ff37f42d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:42:32.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.587+0000 7ff37f42d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:42:32.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.587+0000 7ff37f42d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:42:32.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.587+0000 7ff37f42d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:42:32.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.587+0000 7ff37f42d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:42:32.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.587+0000 7ff37f42d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:42:32.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.587+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.587+0000 7ff37f42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.587+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.588+0000 7ff37f42d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:32.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.588+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.588+0000 7ff37f42d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:42:32.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.588+0000 7ff37f42d800 20 zone default found 2024-03-09T14:42:32.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.588+0000 7ff37f42d800 4 Realm: () 2024-03-09T14:42:32.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.588+0000 7ff37f42d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:42:32.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.588+0000 7ff37f42d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:42:32.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.588+0000 7ff37f42d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:42:32.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.588+0000 7ff37f42d800 20 zonegroup default 2024-03-09T14:42:32.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.588+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.588+0000 7ff37f42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.588+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.589+0000 7ff37f42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.589+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.589+0000 7ff37f42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.589+0000 7ff37f42d800 20 started sync module instance, tier type = 2024-03-09T14:42:32.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.589+0000 7ff37f42d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:42:32.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.599+0000 7ff37f42d800 20 add_watcher() i=0 2024-03-09T14:42:32.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.599+0000 7ff37f42d800 20 add_watcher() i=1 2024-03-09T14:42:32.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.599+0000 7ff37f42d800 20 add_watcher() i=2 2024-03-09T14:42:32.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.599+0000 7ff37f42d800 20 add_watcher() i=3 2024-03-09T14:42:32.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.599+0000 7ff37f42d800 20 add_watcher() i=4 2024-03-09T14:42:32.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.599+0000 7ff37f42d800 20 add_watcher() i=5 2024-03-09T14:42:32.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.599+0000 7ff37f42d800 20 add_watcher() i=6 2024-03-09T14:42:32.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.599+0000 7ff37f42d800 20 add_watcher() i=7 2024-03-09T14:42:32.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.599+0000 7ff37f42d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:42:32.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.601+0000 7ff230fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:32.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.602+0000 7ff37f42d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:42:32.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.602+0000 7ff37f42d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:42:32.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.602+0000 7ff37f42d800 5 note: GC not initialized 2024-03-09T14:42:32.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.602+0000 7ff1ab7fe640 20 reqs_thread_entry: start 2024-03-09T14:42:32.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.602+0000 7ff37f42d800 20 init_complete bucket index max shards: 11 2024-03-09T14:42:32.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.602+0000 7ff37f42d800 20 Filter name: none 2024-03-09T14:42:32.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.602+0000 7ff1a97fa640 20 reqs_thread_entry: start 2024-03-09T14:42:32.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.602+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.603+0000 7ff37f42d800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:42:32.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.603+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.603+0000 7ff37f42d800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:42:32.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.603+0000 7ff37f42d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:42:32.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.603+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.604+0000 7ff37f42d800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:42:32.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.604+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.605+0000 7ff37f42d800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:42:32.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.605+0000 7ff37f42d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:42:32.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.605+0000 7ff37f42d800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.606+0000 7ff37f42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.606+0000 7ff230fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:32.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.609+0000 7ff37f42d800 20 remove_watcher() i=0 2024-03-09T14:42:32.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.609+0000 7ff37f42d800 2 removed watcher, disabling cache 2024-03-09T14:42:32.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.610+0000 7ff37f42d800 20 remove_watcher() i=1 2024-03-09T14:42:32.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.611+0000 7ff37f42d800 20 remove_watcher() i=2 2024-03-09T14:42:32.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.612+0000 7ff37f42d800 20 remove_watcher() i=3 2024-03-09T14:42:32.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.613+0000 7ff37f42d800 20 remove_watcher() i=4 2024-03-09T14:42:32.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.614+0000 7ff37f42d800 20 remove_watcher() i=5 2024-03-09T14:42:32.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.615+0000 7ff37f42d800 20 remove_watcher() i=6 2024-03-09T14:42:32.615 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.616+0000 7ff37f42d800 20 remove_watcher() i=7 2024-03-09T14:42:32.625 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:32.625 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:42:32.625 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: abort-at-do-reshard id: 5d93e872-363b-498b-b665-658644296b85.4535.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:42:32.625 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:32.627 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-03-09T14:42:32.659 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:42:32.659 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:42:32.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.693+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.695+0000 7fbe3328a800 20 realm 2024-03-09T14:42:32.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.695+0000 7fbe3328a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:42:32.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.697 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.696+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:32.697 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.696+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.697 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.697+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:42:32.697 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.697+0000 7fbe3328a800 20 searching for the correct realm 2024-03-09T14:42:32.698 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.699+0000 7fbe31587640 0 -- 172.21.15.88:0/1417449907 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fbe2005e040 msgr2=0x7fbe200552e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:32.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:32.905+0000 7fbe30585640 0 -- 172.21.15.88:0/1417449907 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fbe200d6040 msgr2=0x7fbe2004c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:33.111 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:42:33.111 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:42:33.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:42:33.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:42:33.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:42:33.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:42:33.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.111+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.112 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:33.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.113 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:42:33.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.112+0000 7fbe3328a800 20 zone default found 2024-03-09T14:42:33.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.112+0000 7fbe3328a800 4 Realm: () 2024-03-09T14:42:33.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.112+0000 7fbe3328a800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:42:33.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.112+0000 7fbe3328a800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:42:33.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.112+0000 7fbe3328a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:42:33.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.112+0000 7fbe3328a800 20 zonegroup default 2024-03-09T14:42:33.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.113+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.113+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.113+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.113+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.113+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.113+0000 7fbe3328a800 20 started sync module instance, tier type = 2024-03-09T14:42:33.114 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.113+0000 7fbe3328a800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:42:33.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=0 2024-03-09T14:42:33.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=1 2024-03-09T14:42:33.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=2 2024-03-09T14:42:33.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=3 2024-03-09T14:42:33.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=4 2024-03-09T14:42:33.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=5 2024-03-09T14:42:33.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=6 2024-03-09T14:42:33.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.124+0000 7fbe3328a800 20 add_watcher() i=7 2024-03-09T14:42:33.123 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.124+0000 7fbe3328a800 2 all 8 watchers are set, enabling cache 2024-03-09T14:42:33.128 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.125+0000 7fbce77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:33.129 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.126+0000 7fbe3328a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:42:33.129 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.126+0000 7fbe3328a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:42:33.129 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.126+0000 7fbe3328a800 5 note: GC not initialized 2024-03-09T14:42:33.129 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.126+0000 7fbce67e4640 20 reqs_thread_entry: start 2024-03-09T14:42:33.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.126+0000 7fbe3328a800 20 init_complete bucket index max shards: 11 2024-03-09T14:42:33.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.126+0000 7fbe3328a800 20 Filter name: none 2024-03-09T14:42:33.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.126+0000 7fbcdf7fe640 20 reqs_thread_entry: start 2024-03-09T14:42:33.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.126+0000 7fbe3328a800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-09T14:42:33.130 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.126+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.127+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:42:33.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.127+0000 7fbe3328a800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-09T14:42:33.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.127+0000 7fbe3328a800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-09T14:42:33.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.127+0000 7fbe3328a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 : miss 2024-03-09T14:42:33.131 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.127+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.127+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:42:33.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.127+0000 7fbe3328a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 info.flags=0x17 2024-03-09T14:42:33.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.127+0000 7fbe3328a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 to cache LRU end 2024-03-09T14:42:33.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.127+0000 7fbe3328a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:33.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.127+0000 7fbe3328a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:33.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.127+0000 7fbe3328a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 2024-03-09T14:42:33.133 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.133+0000 7fbe3328a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 info.flags=0x17 2024-03-09T14:42:33.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.133+0000 7fbe3328a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 to cache LRU end 2024-03-09T14:42:33.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.133+0000 7fbe3328a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:33.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.133+0000 7fbe3328a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28, ofs0, ns] 2024-03-09T14:42:33.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.133+0000 7fbd077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464261 cookie 94885660778960 notifier 6617 bl.length()=903 2024-03-09T14:42:33.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.133+0000 7fbd077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 info.flags=0x17 2024-03-09T14:42:33.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.133+0000 7fbd077fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 to cache LRU end 2024-03-09T14:42:33.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.133+0000 7fbd077fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:33.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.135+0000 7fbe3328a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): orig_sources= new_sources= 2024-03-09T14:42:33.135 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.135+0000 7fbe3328a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): potential sources added=[] removed=[] 2024-03-09T14:42:33.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.135+0000 7fbe3328a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): orig_dests= new_dests= 2024-03-09T14:42:33.136 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.135+0000 7fbe3328a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): potential dests added=[] removed=[] 2024-03-09T14:42:33.138 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbe3328a800 time 2024-03-09T14:42:33.138849+0000 2024-03-09T14:42:33.138 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:42:33.139 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:42:33.139 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbe36580e86] 2024-03-09T14:42:33.139 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fbe36581044] 2024-03-09T14:42:33.139 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c48953f91] 2024-03-09T14:42:33.140 INFO:tasks.workunit.client.0.smithi088.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x564c4896eed4] 2024-03-09T14:42:33.140 INFO:tasks.workunit.client.0.smithi088.stderr: 5: main() 2024-03-09T14:42:33.140 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fbe3543feb0] 2024-03-09T14:42:33.140 INFO:tasks.workunit.client.0.smithi088.stderr: 7: __libc_start_main() 2024-03-09T14:42:33.140 INFO:tasks.workunit.client.0.smithi088.stderr: 8: _start() 2024-03-09T14:42:33.140 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.139+0000 7fbe3328a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbe3328a800 time 2024-03-09T14:42:33.138849+0000 2024-03-09T14:42:33.141 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:42:33.141 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.141 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:42:33.141 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbe36580e86] 2024-03-09T14:42:33.141 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fbe36581044] 2024-03-09T14:42:33.141 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c48953f91] 2024-03-09T14:42:33.142 INFO:tasks.workunit.client.0.smithi088.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x564c4896eed4] 2024-03-09T14:42:33.142 INFO:tasks.workunit.client.0.smithi088.stderr: 5: main() 2024-03-09T14:42:33.142 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fbe3543feb0] 2024-03-09T14:42:33.142 INFO:tasks.workunit.client.0.smithi088.stderr: 7: __libc_start_main() 2024-03-09T14:42:33.142 INFO:tasks.workunit.client.0.smithi088.stderr: 8: _start() 2024-03-09T14:42:33.143 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.143 INFO:tasks.workunit.client.0.smithi088.stderr:*** Caught signal (Aborted) ** 2024-03-09T14:42:33.143 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7fbe3328a800 thread_name:radosgw-admin 2024-03-09T14:42:33.183 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:42:33.183 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fbe35454db0] 2024-03-09T14:42:33.184 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fbe354a154c] 2024-03-09T14:42:33.184 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:42:33.184 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:42:33.184 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbe36580ee0] 2024-03-09T14:42:33.184 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fbe36581044] 2024-03-09T14:42:33.184 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c48953f91] 2024-03-09T14:42:33.184 INFO:tasks.workunit.client.0.smithi088.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x564c4896eed4] 2024-03-09T14:42:33.184 INFO:tasks.workunit.client.0.smithi088.stderr: 9: main() 2024-03-09T14:42:33.185 INFO:tasks.workunit.client.0.smithi088.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fbe3543feb0] 2024-03-09T14:42:33.185 INFO:tasks.workunit.client.0.smithi088.stderr: 11: __libc_start_main() 2024-03-09T14:42:33.185 INFO:tasks.workunit.client.0.smithi088.stderr: 12: _start() 2024-03-09T14:42:33.185 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.140+0000 7fbe3328a800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:42:33.185 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7fbe3328a800 thread_name:radosgw-admin 2024-03-09T14:42:33.185 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.185 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:42:33.185 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fbe35454db0] 2024-03-09T14:42:33.186 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fbe354a154c] 2024-03-09T14:42:33.186 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:42:33.186 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:42:33.186 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbe36580ee0] 2024-03-09T14:42:33.186 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fbe36581044] 2024-03-09T14:42:33.186 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c48953f91] 2024-03-09T14:42:33.186 INFO:tasks.workunit.client.0.smithi088.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x564c4896eed4] 2024-03-09T14:42:33.186 INFO:tasks.workunit.client.0.smithi088.stderr: 9: main() 2024-03-09T14:42:33.187 INFO:tasks.workunit.client.0.smithi088.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fbe3543feb0] 2024-03-09T14:42:33.187 INFO:tasks.workunit.client.0.smithi088.stderr: 11: __libc_start_main() 2024-03-09T14:42:33.187 INFO:tasks.workunit.client.0.smithi088.stderr: 12: _start() 2024-03-09T14:42:33.187 INFO:tasks.workunit.client.0.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:42:33.187 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.187 INFO:tasks.workunit.client.0.smithi088.stderr:--- begin dump of recent events --- 2024-03-09T14:42:33.187 INFO:tasks.workunit.client.0.smithi088.stderr: -499> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:42:33.187 INFO:tasks.workunit.client.0.smithi088.stderr: -498> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: dump: 2024-03-09T14:42:33.188 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.188 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.188 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.188 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.188 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.188 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.188 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.188 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.188 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.189 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.189 INFO:tasks.workunit.client.0.smithi088.stderr: -497> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: _finish_auth 0 2024-03-09T14:42:33.189 INFO:tasks.workunit.client.0.smithi088.stderr: -496> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: _check_auth_tickets 2024-03-09T14:42:33.189 INFO:tasks.workunit.client.0.smithi088.stderr: -495> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:42:33.189 INFO:tasks.workunit.client.0.smithi088.stderr: -494> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.189 INFO:tasks.workunit.client.0.smithi088.stderr: -493> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:42:33.189 INFO:tasks.workunit.client.0.smithi088.stderr: -492> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: dump: 2024-03-09T14:42:33.189 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.190 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.190 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.190 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.190 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.190 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.190 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.190 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.190 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.191 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.191 INFO:tasks.workunit.client.0.smithi088.stderr: -491> 2024-03-09T14:42:32.677+0000 7fbe3328a800 5 monclient: authenticate success, global_id 6605 2024-03-09T14:42:33.191 INFO:tasks.workunit.client.0.smithi088.stderr: -490> 2024-03-09T14:42:32.677+0000 7fbe3328a800 10 monclient: get_monmap_and_config success 2024-03-09T14:42:33.191 INFO:tasks.workunit.client.0.smithi088.stderr: -489> 2024-03-09T14:42:32.677+0000 7fbe3328a800 4 set_mon_vals no callback set 2024-03-09T14:42:33.191 INFO:tasks.workunit.client.0.smithi088.stderr: -488> 2024-03-09T14:42:32.678+0000 7fbe3328a800 10 monclient: shutdown 2024-03-09T14:42:33.191 INFO:tasks.workunit.client.0.smithi088.stderr: -487> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 asok(0x564c49e8a780) unregister_commands rotate-key 2024-03-09T14:42:33.191 INFO:tasks.workunit.client.0.smithi088.stderr: -486> 2024-03-09T14:42:32.678+0000 7fbe3328a800 10 monclient: build_initial_monmap 2024-03-09T14:42:33.191 INFO:tasks.workunit.client.0.smithi088.stderr: -485> 2024-03-09T14:42:32.678+0000 7fbe3328a800 1 build_initial for_mkfs: 0 2024-03-09T14:42:33.192 INFO:tasks.workunit.client.0.smithi088.stderr: -484> 2024-03-09T14:42:32.678+0000 7fbe3328a800 10 monclient: monmap: 2024-03-09T14:42:33.192 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:42:33.192 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:42:33.192 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:42:33.192 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:42:33.192 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:42:33.192 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.192 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:42:33.192 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:42:33.192 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:42:33.192 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.192 INFO:tasks.workunit.client.0.smithi088.stderr: -483> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding auth protocol: cephx 2024-03-09T14:42:33.193 INFO:tasks.workunit.client.0.smithi088.stderr: -482> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding auth protocol: cephx 2024-03-09T14:42:33.193 INFO:tasks.workunit.client.0.smithi088.stderr: -481> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding auth protocol: cephx 2024-03-09T14:42:33.193 INFO:tasks.workunit.client.0.smithi088.stderr: -480> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: secure 2024-03-09T14:42:33.193 INFO:tasks.workunit.client.0.smithi088.stderr: -479> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: crc 2024-03-09T14:42:33.193 INFO:tasks.workunit.client.0.smithi088.stderr: -478> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: secure 2024-03-09T14:42:33.193 INFO:tasks.workunit.client.0.smithi088.stderr: -477> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: crc 2024-03-09T14:42:33.193 INFO:tasks.workunit.client.0.smithi088.stderr: -476> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: secure 2024-03-09T14:42:33.193 INFO:tasks.workunit.client.0.smithi088.stderr: -475> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: crc 2024-03-09T14:42:33.193 INFO:tasks.workunit.client.0.smithi088.stderr: -474> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: crc 2024-03-09T14:42:33.193 INFO:tasks.workunit.client.0.smithi088.stderr: -473> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: secure 2024-03-09T14:42:33.193 INFO:tasks.workunit.client.0.smithi088.stderr: -472> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: crc 2024-03-09T14:42:33.193 INFO:tasks.workunit.client.0.smithi088.stderr: -471> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: secure 2024-03-09T14:42:33.193 INFO:tasks.workunit.client.0.smithi088.stderr: -470> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: crc 2024-03-09T14:42:33.193 INFO:tasks.workunit.client.0.smithi088.stderr: -469> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: secure 2024-03-09T14:42:33.193 INFO:tasks.workunit.client.0.smithi088.stderr: -468> 2024-03-09T14:42:32.678+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.194 INFO:tasks.workunit.client.0.smithi088.stderr: -467> 2024-03-09T14:42:32.678+0000 7fbe3328a800 1 librados: starting msgr at 2024-03-09T14:42:33.194 INFO:tasks.workunit.client.0.smithi088.stderr: -466> 2024-03-09T14:42:32.678+0000 7fbe3328a800 1 librados: starting objecter 2024-03-09T14:42:33.194 INFO:tasks.workunit.client.0.smithi088.stderr: -465> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command objecter_requests hook 0x564c4a0afa20 2024-03-09T14:42:33.194 INFO:tasks.workunit.client.0.smithi088.stderr: -464> 2024-03-09T14:42:32.678+0000 7fbe3328a800 1 librados: setting wanted keys 2024-03-09T14:42:33.194 INFO:tasks.workunit.client.0.smithi088.stderr: -463> 2024-03-09T14:42:32.678+0000 7fbe3328a800 1 librados: calling monclient init 2024-03-09T14:42:33.194 INFO:tasks.workunit.client.0.smithi088.stderr: -462> 2024-03-09T14:42:32.678+0000 7fbe3328a800 10 monclient: init 2024-03-09T14:42:33.194 INFO:tasks.workunit.client.0.smithi088.stderr: -461> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding auth protocol: cephx 2024-03-09T14:42:33.194 INFO:tasks.workunit.client.0.smithi088.stderr: -460> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding auth protocol: cephx 2024-03-09T14:42:33.194 INFO:tasks.workunit.client.0.smithi088.stderr: -459> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding auth protocol: cephx 2024-03-09T14:42:33.194 INFO:tasks.workunit.client.0.smithi088.stderr: -458> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: secure 2024-03-09T14:42:33.194 INFO:tasks.workunit.client.0.smithi088.stderr: -457> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: crc 2024-03-09T14:42:33.194 INFO:tasks.workunit.client.0.smithi088.stderr: -456> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: secure 2024-03-09T14:42:33.195 INFO:tasks.workunit.client.0.smithi088.stderr: -455> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: crc 2024-03-09T14:42:33.195 INFO:tasks.workunit.client.0.smithi088.stderr: -454> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: secure 2024-03-09T14:42:33.195 INFO:tasks.workunit.client.0.smithi088.stderr: -453> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: crc 2024-03-09T14:42:33.195 INFO:tasks.workunit.client.0.smithi088.stderr: -452> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: crc 2024-03-09T14:42:33.195 INFO:tasks.workunit.client.0.smithi088.stderr: -451> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: secure 2024-03-09T14:42:33.195 INFO:tasks.workunit.client.0.smithi088.stderr: -450> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: crc 2024-03-09T14:42:33.195 INFO:tasks.workunit.client.0.smithi088.stderr: -449> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: secure 2024-03-09T14:42:33.195 INFO:tasks.workunit.client.0.smithi088.stderr: -448> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: crc 2024-03-09T14:42:33.195 INFO:tasks.workunit.client.0.smithi088.stderr: -447> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: secure 2024-03-09T14:42:33.195 INFO:tasks.workunit.client.0.smithi088.stderr: -446> 2024-03-09T14:42:32.678+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.195 INFO:tasks.workunit.client.0.smithi088.stderr: -445> 2024-03-09T14:42:32.679+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.195 INFO:tasks.workunit.client.0.smithi088.stderr: -444> 2024-03-09T14:42:32.679+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command rotate-key hook 0x564c4a0a7728 2024-03-09T14:42:33.195 INFO:tasks.workunit.client.0.smithi088.stderr: -443> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient: _reopen_session rank -1 2024-03-09T14:42:33.195 INFO:tasks.workunit.client.0.smithi088.stderr: -442> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:42:33.195 INFO:tasks.workunit.client.0.smithi088.stderr: -441> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-b con 0x564c49f5f380 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:42:33.196 INFO:tasks.workunit.client.0.smithi088.stderr: -440> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-c con 0x564c49fe9800 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:42:33.196 INFO:tasks.workunit.client.0.smithi088.stderr: -439> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-a con 0x564c49fefd90 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:42:33.196 INFO:tasks.workunit.client.0.smithi088.stderr: -438> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.196 INFO:tasks.workunit.client.0.smithi088.stderr: -437> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.196 INFO:tasks.workunit.client.0.smithi088.stderr: -436> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.196 INFO:tasks.workunit.client.0.smithi088.stderr: -435> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): _renew_subs 2024-03-09T14:42:33.196 INFO:tasks.workunit.client.0.smithi088.stderr: -434> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): authenticate will time out at 1768.016462s 2024-03-09T14:42:33.196 INFO:tasks.workunit.client.0.smithi088.stderr: -433> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): get_auth_request con 0x564c49fe9800 auth_method 0 2024-03-09T14:42:33.196 INFO:tasks.workunit.client.0.smithi088.stderr: -432> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.196 INFO:tasks.workunit.client.0.smithi088.stderr: -431> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.196 INFO:tasks.workunit.client.0.smithi088.stderr: -430> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.196 INFO:tasks.workunit.client.0.smithi088.stderr: -429> 2024-03-09T14:42:32.679+0000 7fbe31587640 10 monclient(hunting): get_auth_request con 0x564c49fefd90 auth_method 0 2024-03-09T14:42:33.196 INFO:tasks.workunit.client.0.smithi088.stderr: -428> 2024-03-09T14:42:32.679+0000 7fbe31587640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.196 INFO:tasks.workunit.client.0.smithi088.stderr: -427> 2024-03-09T14:42:32.679+0000 7fbe31587640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.197 INFO:tasks.workunit.client.0.smithi088.stderr: -426> 2024-03-09T14:42:32.679+0000 7fbe31587640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.197 INFO:tasks.workunit.client.0.smithi088.stderr: -425> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.197 INFO:tasks.workunit.client.0.smithi088.stderr: -424> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.197 INFO:tasks.workunit.client.0.smithi088.stderr: -423> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.197 INFO:tasks.workunit.client.0.smithi088.stderr: -422> 2024-03-09T14:42:32.679+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.197 INFO:tasks.workunit.client.0.smithi088.stderr: -421> 2024-03-09T14:42:32.679+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.197 INFO:tasks.workunit.client.0.smithi088.stderr: -420> 2024-03-09T14:42:32.679+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.197 INFO:tasks.workunit.client.0.smithi088.stderr: -419> 2024-03-09T14:42:32.679+0000 7fbe30d86640 10 monclient(hunting): get_auth_request con 0x564c49f5f380 auth_method 0 2024-03-09T14:42:33.197 INFO:tasks.workunit.client.0.smithi088.stderr: -418> 2024-03-09T14:42:32.679+0000 7fbe30d86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.197 INFO:tasks.workunit.client.0.smithi088.stderr: -417> 2024-03-09T14:42:32.679+0000 7fbe30d86640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.197 INFO:tasks.workunit.client.0.smithi088.stderr: -416> 2024-03-09T14:42:32.679+0000 7fbe30d86640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.197 INFO:tasks.workunit.client.0.smithi088.stderr: -415> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): handle_auth_done global_id 6608 payload 824 2024-03-09T14:42:33.197 INFO:tasks.workunit.client.0.smithi088.stderr: -414> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient: _finish_hunting 0 2024-03-09T14:42:33.197 INFO:tasks.workunit.client.0.smithi088.stderr: -413> 2024-03-09T14:42:32.679+0000 7fbe30585640 1 monclient: found mon.noname-c 2024-03-09T14:42:33.197 INFO:tasks.workunit.client.0.smithi088.stderr: -412> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.198 INFO:tasks.workunit.client.0.smithi088.stderr: -411> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.198 INFO:tasks.workunit.client.0.smithi088.stderr: -410> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:42:33.198 INFO:tasks.workunit.client.0.smithi088.stderr: -409> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: dump: 2024-03-09T14:42:33.198 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.198 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.198 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.198 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.198 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.198 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.198 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.198 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.198 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.198 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.198 INFO:tasks.workunit.client.0.smithi088.stderr: -408> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: _finish_auth 0 2024-03-09T14:42:33.198 INFO:tasks.workunit.client.0.smithi088.stderr: -407> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: _check_auth_tickets 2024-03-09T14:42:33.199 INFO:tasks.workunit.client.0.smithi088.stderr: -406> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:42:33.199 INFO:tasks.workunit.client.0.smithi088.stderr: -405> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.199 INFO:tasks.workunit.client.0.smithi088.stderr: -404> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:42:33.199 INFO:tasks.workunit.client.0.smithi088.stderr: -403> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: dump: 2024-03-09T14:42:33.199 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.199 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.199 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.199 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.199 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.199 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.199 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.199 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.199 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.199 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.199 INFO:tasks.workunit.client.0.smithi088.stderr: -402> 2024-03-09T14:42:32.679+0000 7fbe3328a800 5 monclient: authenticate success, global_id 6608 2024-03-09T14:42:33.200 INFO:tasks.workunit.client.0.smithi088.stderr: -401> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient: _renew_subs 2024-03-09T14:42:33.200 INFO:tasks.workunit.client.0.smithi088.stderr: -400> 2024-03-09T14:42:32.679+0000 7fbd1ee0d640 4 set_mon_vals no callback set 2024-03-09T14:42:33.200 INFO:tasks.workunit.client.0.smithi088.stderr: -399> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.200 INFO:tasks.workunit.client.0.smithi088.stderr: -398> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient: _renew_subs 2024-03-09T14:42:33.200 INFO:tasks.workunit.client.0.smithi088.stderr: -397> 2024-03-09T14:42:32.680+0000 7fbe3328a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.200 INFO:tasks.workunit.client.0.smithi088.stderr: -396> 2024-03-09T14:42:32.680+0000 7fbe3328a800 1 librados: init done 2024-03-09T14:42:33.200 INFO:tasks.workunit.client.0.smithi088.stderr: -395> 2024-03-09T14:42:32.681+0000 7fbd1d60a640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:42:33.200 INFO:tasks.workunit.client.0.smithi088.stderr: -394> 2024-03-09T14:42:32.681+0000 7fbd1d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:42:33.200 INFO:tasks.workunit.client.0.smithi088.stderr: -393> 2024-03-09T14:42:32.681+0000 7fbd1d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:42:33.200 INFO:tasks.workunit.client.0.smithi088.stderr: -392> 2024-03-09T14:42:32.681+0000 7fbe30d86640 10 monclient: get_auth_request con 0x7fbd1806a5b0 auth_method 0 2024-03-09T14:42:33.200 INFO:tasks.workunit.client.0.smithi088.stderr: -391> 2024-03-09T14:42:32.681+0000 7fbe31587640 10 monclient: get_auth_request con 0x564c4a0d28a0 auth_method 0 2024-03-09T14:42:33.200 INFO:tasks.workunit.client.0.smithi088.stderr: -390> 2024-03-09T14:42:32.682+0000 7fbe30d86640 10 monclient: get_auth_request con 0x564c4a0f3190 auth_method 0 2024-03-09T14:42:33.200 INFO:tasks.workunit.client.0.smithi088.stderr: -389> 2024-03-09T14:42:32.683+0000 7fbe30585640 10 monclient: get_auth_request con 0x564c4a0f7380 auth_method 0 2024-03-09T14:42:33.200 INFO:tasks.workunit.client.0.smithi088.stderr: -388> 2024-03-09T14:42:32.684+0000 7fbe31587640 10 monclient: get_auth_request con 0x564c4a0f6a10 auth_method 0 2024-03-09T14:42:33.201 INFO:tasks.workunit.client.0.smithi088.stderr: -387> 2024-03-09T14:42:32.685+0000 7fbe3328a800 10 monclient: build_initial_monmap 2024-03-09T14:42:33.201 INFO:tasks.workunit.client.0.smithi088.stderr: -386> 2024-03-09T14:42:32.685+0000 7fbe3328a800 1 build_initial for_mkfs: 0 2024-03-09T14:42:33.201 INFO:tasks.workunit.client.0.smithi088.stderr: -385> 2024-03-09T14:42:32.685+0000 7fbe3328a800 10 monclient: monmap: 2024-03-09T14:42:33.201 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:42:33.201 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:42:33.201 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:42:33.201 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:42:33.201 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:42:33.201 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.201 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:42:33.201 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:42:33.201 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:42:33.201 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.201 INFO:tasks.workunit.client.0.smithi088.stderr: -384> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding auth protocol: cephx 2024-03-09T14:42:33.201 INFO:tasks.workunit.client.0.smithi088.stderr: -383> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding auth protocol: cephx 2024-03-09T14:42:33.202 INFO:tasks.workunit.client.0.smithi088.stderr: -382> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding auth protocol: cephx 2024-03-09T14:42:33.202 INFO:tasks.workunit.client.0.smithi088.stderr: -381> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: secure 2024-03-09T14:42:33.202 INFO:tasks.workunit.client.0.smithi088.stderr: -380> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: crc 2024-03-09T14:42:33.202 INFO:tasks.workunit.client.0.smithi088.stderr: -379> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: secure 2024-03-09T14:42:33.202 INFO:tasks.workunit.client.0.smithi088.stderr: -378> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: crc 2024-03-09T14:42:33.202 INFO:tasks.workunit.client.0.smithi088.stderr: -377> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: secure 2024-03-09T14:42:33.202 INFO:tasks.workunit.client.0.smithi088.stderr: -376> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: crc 2024-03-09T14:42:33.202 INFO:tasks.workunit.client.0.smithi088.stderr: -375> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: crc 2024-03-09T14:42:33.202 INFO:tasks.workunit.client.0.smithi088.stderr: -374> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: secure 2024-03-09T14:42:33.202 INFO:tasks.workunit.client.0.smithi088.stderr: -373> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: crc 2024-03-09T14:42:33.202 INFO:tasks.workunit.client.0.smithi088.stderr: -372> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: secure 2024-03-09T14:42:33.202 INFO:tasks.workunit.client.0.smithi088.stderr: -371> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: crc 2024-03-09T14:42:33.202 INFO:tasks.workunit.client.0.smithi088.stderr: -370> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: secure 2024-03-09T14:42:33.202 INFO:tasks.workunit.client.0.smithi088.stderr: -369> 2024-03-09T14:42:32.685+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.203 INFO:tasks.workunit.client.0.smithi088.stderr: -368> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command objecter_requests cmddesc objecter_requests hook 0x564c4a104a80 EEXIST 2024-03-09T14:42:33.203 INFO:tasks.workunit.client.0.smithi088.stderr: -367> 2024-03-09T14:42:32.685+0000 7fbe3328a800 10 monclient: init 2024-03-09T14:42:33.203 INFO:tasks.workunit.client.0.smithi088.stderr: -366> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding auth protocol: cephx 2024-03-09T14:42:33.203 INFO:tasks.workunit.client.0.smithi088.stderr: -365> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding auth protocol: cephx 2024-03-09T14:42:33.203 INFO:tasks.workunit.client.0.smithi088.stderr: -364> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding auth protocol: cephx 2024-03-09T14:42:33.203 INFO:tasks.workunit.client.0.smithi088.stderr: -363> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: secure 2024-03-09T14:42:33.203 INFO:tasks.workunit.client.0.smithi088.stderr: -362> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: crc 2024-03-09T14:42:33.203 INFO:tasks.workunit.client.0.smithi088.stderr: -361> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: secure 2024-03-09T14:42:33.203 INFO:tasks.workunit.client.0.smithi088.stderr: -360> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: crc 2024-03-09T14:42:33.203 INFO:tasks.workunit.client.0.smithi088.stderr: -359> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: secure 2024-03-09T14:42:33.203 INFO:tasks.workunit.client.0.smithi088.stderr: -358> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: crc 2024-03-09T14:42:33.203 INFO:tasks.workunit.client.0.smithi088.stderr: -357> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: crc 2024-03-09T14:42:33.203 INFO:tasks.workunit.client.0.smithi088.stderr: -356> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: secure 2024-03-09T14:42:33.203 INFO:tasks.workunit.client.0.smithi088.stderr: -355> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: crc 2024-03-09T14:42:33.203 INFO:tasks.workunit.client.0.smithi088.stderr: -354> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: secure 2024-03-09T14:42:33.204 INFO:tasks.workunit.client.0.smithi088.stderr: -353> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: crc 2024-03-09T14:42:33.204 INFO:tasks.workunit.client.0.smithi088.stderr: -352> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: secure 2024-03-09T14:42:33.204 INFO:tasks.workunit.client.0.smithi088.stderr: -351> 2024-03-09T14:42:32.686+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.204 INFO:tasks.workunit.client.0.smithi088.stderr: -350> 2024-03-09T14:42:32.686+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.204 INFO:tasks.workunit.client.0.smithi088.stderr: -349> 2024-03-09T14:42:32.686+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command rotate-key cmddesc rotate-key hook 0x564c4a0fe3e0 EEXIST 2024-03-09T14:42:33.204 INFO:tasks.workunit.client.0.smithi088.stderr: -348> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient: _reopen_session rank -1 2024-03-09T14:42:33.204 INFO:tasks.workunit.client.0.smithi088.stderr: -347> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient: _add_conns ranks=[0,2,1] 2024-03-09T14:42:33.204 INFO:tasks.workunit.client.0.smithi088.stderr: -346> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-a con 0x564c4a1297e0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:42:33.204 INFO:tasks.workunit.client.0.smithi088.stderr: -345> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-c con 0x564c4a129bc0 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:42:33.204 INFO:tasks.workunit.client.0.smithi088.stderr: -344> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-b con 0x564c4a124c80 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:42:33.204 INFO:tasks.workunit.client.0.smithi088.stderr: -343> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.204 INFO:tasks.workunit.client.0.smithi088.stderr: -342> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.204 INFO:tasks.workunit.client.0.smithi088.stderr: -341> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.204 INFO:tasks.workunit.client.0.smithi088.stderr: -340> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): _renew_subs 2024-03-09T14:42:33.204 INFO:tasks.workunit.client.0.smithi088.stderr: -339> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): authenticate will time out at 1768.023613s 2024-03-09T14:42:33.205 INFO:tasks.workunit.client.0.smithi088.stderr: -338> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): get_auth_request con 0x564c4a129bc0 auth_method 0 2024-03-09T14:42:33.205 INFO:tasks.workunit.client.0.smithi088.stderr: -337> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.205 INFO:tasks.workunit.client.0.smithi088.stderr: -336> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.205 INFO:tasks.workunit.client.0.smithi088.stderr: -335> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.205 INFO:tasks.workunit.client.0.smithi088.stderr: -334> 2024-03-09T14:42:32.686+0000 7fbe30585640 10 monclient(hunting): get_auth_request con 0x564c4a1297e0 auth_method 0 2024-03-09T14:42:33.205 INFO:tasks.workunit.client.0.smithi088.stderr: -333> 2024-03-09T14:42:32.686+0000 7fbe30585640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.205 INFO:tasks.workunit.client.0.smithi088.stderr: -332> 2024-03-09T14:42:32.686+0000 7fbe30585640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.205 INFO:tasks.workunit.client.0.smithi088.stderr: -331> 2024-03-09T14:42:32.686+0000 7fbe30585640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.205 INFO:tasks.workunit.client.0.smithi088.stderr: -330> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.205 INFO:tasks.workunit.client.0.smithi088.stderr: -329> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.205 INFO:tasks.workunit.client.0.smithi088.stderr: -328> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.205 INFO:tasks.workunit.client.0.smithi088.stderr: -327> 2024-03-09T14:42:32.686+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.205 INFO:tasks.workunit.client.0.smithi088.stderr: -326> 2024-03-09T14:42:32.686+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.205 INFO:tasks.workunit.client.0.smithi088.stderr: -325> 2024-03-09T14:42:32.686+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.205 INFO:tasks.workunit.client.0.smithi088.stderr: -324> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): handle_auth_done global_id 6611 payload 824 2024-03-09T14:42:33.206 INFO:tasks.workunit.client.0.smithi088.stderr: -323> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient: _finish_hunting 0 2024-03-09T14:42:33.206 INFO:tasks.workunit.client.0.smithi088.stderr: -322> 2024-03-09T14:42:32.686+0000 7fbe31587640 1 monclient: found mon.noname-c 2024-03-09T14:42:33.206 INFO:tasks.workunit.client.0.smithi088.stderr: -321> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.206 INFO:tasks.workunit.client.0.smithi088.stderr: -320> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.206 INFO:tasks.workunit.client.0.smithi088.stderr: -319> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:42:33.206 INFO:tasks.workunit.client.0.smithi088.stderr: -318> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: dump: 2024-03-09T14:42:33.206 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.206 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.206 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.206 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.206 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.206 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.206 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.206 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.206 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.207 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.207 INFO:tasks.workunit.client.0.smithi088.stderr: -317> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: _finish_auth 0 2024-03-09T14:42:33.207 INFO:tasks.workunit.client.0.smithi088.stderr: -316> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: _check_auth_tickets 2024-03-09T14:42:33.207 INFO:tasks.workunit.client.0.smithi088.stderr: -315> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:42:33.207 INFO:tasks.workunit.client.0.smithi088.stderr: -314> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.207 INFO:tasks.workunit.client.0.smithi088.stderr: -313> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:42:33.207 INFO:tasks.workunit.client.0.smithi088.stderr: -312> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: dump: 2024-03-09T14:42:33.207 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.207 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.207 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.207 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.207 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.207 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.207 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.208 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.208 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.208 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.208 INFO:tasks.workunit.client.0.smithi088.stderr: -311> 2024-03-09T14:42:32.686+0000 7fbe31d88640 4 set_mon_vals no callback set 2024-03-09T14:42:33.208 INFO:tasks.workunit.client.0.smithi088.stderr: -310> 2024-03-09T14:42:32.686+0000 7fbe3328a800 5 monclient: authenticate success, global_id 6611 2024-03-09T14:42:33.208 INFO:tasks.workunit.client.0.smithi088.stderr: -309> 2024-03-09T14:42:32.687+0000 7fbe3328a800 10 monclient: _renew_subs 2024-03-09T14:42:33.208 INFO:tasks.workunit.client.0.smithi088.stderr: -308> 2024-03-09T14:42:32.687+0000 7fbe3328a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.208 INFO:tasks.workunit.client.0.smithi088.stderr: -307> 2024-03-09T14:42:32.687+0000 7fbe3328a800 10 monclient: _renew_subs 2024-03-09T14:42:33.208 INFO:tasks.workunit.client.0.smithi088.stderr: -306> 2024-03-09T14:42:32.687+0000 7fbe3328a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.208 INFO:tasks.workunit.client.0.smithi088.stderr: -305> 2024-03-09T14:42:32.688+0000 7fbd167fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:42:33.208 INFO:tasks.workunit.client.0.smithi088.stderr: -304> 2024-03-09T14:42:32.688+0000 7fbd167fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:42:33.208 INFO:tasks.workunit.client.0.smithi088.stderr: -303> 2024-03-09T14:42:32.688+0000 7fbd167fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:42:33.208 INFO:tasks.workunit.client.0.smithi088.stderr: -302> 2024-03-09T14:42:32.688+0000 7fbe3328a800 10 monclient: get_monmap_and_config 2024-03-09T14:42:33.208 INFO:tasks.workunit.client.0.smithi088.stderr: -301> 2024-03-09T14:42:32.688+0000 7fbe3328a800 10 monclient: build_initial_monmap 2024-03-09T14:42:33.208 INFO:tasks.workunit.client.0.smithi088.stderr: -300> 2024-03-09T14:42:32.688+0000 7fbe3328a800 1 build_initial for_mkfs: 0 2024-03-09T14:42:33.209 INFO:tasks.workunit.client.0.smithi088.stderr: -299> 2024-03-09T14:42:32.688+0000 7fbe30585640 10 monclient: get_auth_request con 0x7fbd0806a4c0 auth_method 0 2024-03-09T14:42:33.209 INFO:tasks.workunit.client.0.smithi088.stderr: -298> 2024-03-09T14:42:32.688+0000 7fbe3328a800 10 monclient: monmap: 2024-03-09T14:42:33.209 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:42:33.209 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:42:33.209 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:42:33.209 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:42:33.209 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:42:33.209 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.209 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:42:33.209 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:42:33.209 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:42:33.209 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.209 INFO:tasks.workunit.client.0.smithi088.stderr: -297> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding auth protocol: cephx 2024-03-09T14:42:33.209 INFO:tasks.workunit.client.0.smithi088.stderr: -296> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding auth protocol: cephx 2024-03-09T14:42:33.209 INFO:tasks.workunit.client.0.smithi088.stderr: -295> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding auth protocol: cephx 2024-03-09T14:42:33.210 INFO:tasks.workunit.client.0.smithi088.stderr: -294> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: secure 2024-03-09T14:42:33.210 INFO:tasks.workunit.client.0.smithi088.stderr: -293> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: crc 2024-03-09T14:42:33.210 INFO:tasks.workunit.client.0.smithi088.stderr: -292> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: secure 2024-03-09T14:42:33.210 INFO:tasks.workunit.client.0.smithi088.stderr: -291> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: crc 2024-03-09T14:42:33.210 INFO:tasks.workunit.client.0.smithi088.stderr: -290> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: secure 2024-03-09T14:42:33.210 INFO:tasks.workunit.client.0.smithi088.stderr: -289> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: crc 2024-03-09T14:42:33.210 INFO:tasks.workunit.client.0.smithi088.stderr: -288> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: crc 2024-03-09T14:42:33.210 INFO:tasks.workunit.client.0.smithi088.stderr: -287> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: secure 2024-03-09T14:42:33.210 INFO:tasks.workunit.client.0.smithi088.stderr: -286> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: crc 2024-03-09T14:42:33.210 INFO:tasks.workunit.client.0.smithi088.stderr: -285> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: secure 2024-03-09T14:42:33.210 INFO:tasks.workunit.client.0.smithi088.stderr: -284> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: crc 2024-03-09T14:42:33.210 INFO:tasks.workunit.client.0.smithi088.stderr: -283> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: secure 2024-03-09T14:42:33.210 INFO:tasks.workunit.client.0.smithi088.stderr: -282> 2024-03-09T14:42:32.689+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.210 INFO:tasks.workunit.client.0.smithi088.stderr: -281> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient: init 2024-03-09T14:42:33.211 INFO:tasks.workunit.client.0.smithi088.stderr: -280> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding auth protocol: cephx 2024-03-09T14:42:33.211 INFO:tasks.workunit.client.0.smithi088.stderr: -279> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding auth protocol: cephx 2024-03-09T14:42:33.211 INFO:tasks.workunit.client.0.smithi088.stderr: -278> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding auth protocol: cephx 2024-03-09T14:42:33.211 INFO:tasks.workunit.client.0.smithi088.stderr: -277> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: secure 2024-03-09T14:42:33.211 INFO:tasks.workunit.client.0.smithi088.stderr: -276> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: crc 2024-03-09T14:42:33.211 INFO:tasks.workunit.client.0.smithi088.stderr: -275> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: secure 2024-03-09T14:42:33.211 INFO:tasks.workunit.client.0.smithi088.stderr: -274> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: crc 2024-03-09T14:42:33.211 INFO:tasks.workunit.client.0.smithi088.stderr: -273> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: secure 2024-03-09T14:42:33.211 INFO:tasks.workunit.client.0.smithi088.stderr: -272> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: crc 2024-03-09T14:42:33.211 INFO:tasks.workunit.client.0.smithi088.stderr: -271> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: crc 2024-03-09T14:42:33.211 INFO:tasks.workunit.client.0.smithi088.stderr: -270> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: secure 2024-03-09T14:42:33.211 INFO:tasks.workunit.client.0.smithi088.stderr: -269> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: crc 2024-03-09T14:42:33.211 INFO:tasks.workunit.client.0.smithi088.stderr: -268> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: secure 2024-03-09T14:42:33.211 INFO:tasks.workunit.client.0.smithi088.stderr: -267> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: crc 2024-03-09T14:42:33.211 INFO:tasks.workunit.client.0.smithi088.stderr: -266> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: secure 2024-03-09T14:42:33.212 INFO:tasks.workunit.client.0.smithi088.stderr: -265> 2024-03-09T14:42:32.689+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.212 INFO:tasks.workunit.client.0.smithi088.stderr: -264> 2024-03-09T14:42:32.689+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.212 INFO:tasks.workunit.client.0.smithi088.stderr: -263> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command rotate-key cmddesc rotate-key hook 0x7ffd9dea5eb8 EEXIST 2024-03-09T14:42:33.212 INFO:tasks.workunit.client.0.smithi088.stderr: -262> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient: _reopen_session rank -1 2024-03-09T14:42:33.212 INFO:tasks.workunit.client.0.smithi088.stderr: -261> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:42:33.212 INFO:tasks.workunit.client.0.smithi088.stderr: -260> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-b con 0x564c4a17bcf0 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:42:33.212 INFO:tasks.workunit.client.0.smithi088.stderr: -259> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-a con 0x564c4a17c0d0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:42:33.212 INFO:tasks.workunit.client.0.smithi088.stderr: -258> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-c con 0x564c4a181880 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:42:33.212 INFO:tasks.workunit.client.0.smithi088.stderr: -257> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.212 INFO:tasks.workunit.client.0.smithi088.stderr: -256> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.212 INFO:tasks.workunit.client.0.smithi088.stderr: -255> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.212 INFO:tasks.workunit.client.0.smithi088.stderr: -254> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): _renew_subs 2024-03-09T14:42:33.212 INFO:tasks.workunit.client.0.smithi088.stderr: -253> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): authenticate will time out at 1768.026953s 2024-03-09T14:42:33.212 INFO:tasks.workunit.client.0.smithi088.stderr: -252> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): get_auth_request con 0x564c4a181880 auth_method 0 2024-03-09T14:42:33.212 INFO:tasks.workunit.client.0.smithi088.stderr: -251> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.213 INFO:tasks.workunit.client.0.smithi088.stderr: -250> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.213 INFO:tasks.workunit.client.0.smithi088.stderr: -249> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.213 INFO:tasks.workunit.client.0.smithi088.stderr: -248> 2024-03-09T14:42:32.689+0000 7fbe31587640 10 monclient(hunting): get_auth_request con 0x564c4a17c0d0 auth_method 0 2024-03-09T14:42:33.213 INFO:tasks.workunit.client.0.smithi088.stderr: -247> 2024-03-09T14:42:32.689+0000 7fbe31587640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.213 INFO:tasks.workunit.client.0.smithi088.stderr: -246> 2024-03-09T14:42:32.689+0000 7fbe31587640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.213 INFO:tasks.workunit.client.0.smithi088.stderr: -245> 2024-03-09T14:42:32.689+0000 7fbe31587640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.213 INFO:tasks.workunit.client.0.smithi088.stderr: -244> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.213 INFO:tasks.workunit.client.0.smithi088.stderr: -243> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.213 INFO:tasks.workunit.client.0.smithi088.stderr: -242> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.213 INFO:tasks.workunit.client.0.smithi088.stderr: -241> 2024-03-09T14:42:32.689+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.213 INFO:tasks.workunit.client.0.smithi088.stderr: -240> 2024-03-09T14:42:32.689+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.213 INFO:tasks.workunit.client.0.smithi088.stderr: -239> 2024-03-09T14:42:32.689+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.213 INFO:tasks.workunit.client.0.smithi088.stderr: -238> 2024-03-09T14:42:32.689+0000 7fbe30585640 10 monclient(hunting): get_auth_request con 0x564c4a17bcf0 auth_method 0 2024-03-09T14:42:33.213 INFO:tasks.workunit.client.0.smithi088.stderr: -237> 2024-03-09T14:42:32.689+0000 7fbe30585640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.214 INFO:tasks.workunit.client.0.smithi088.stderr: -236> 2024-03-09T14:42:32.689+0000 7fbe30585640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.214 INFO:tasks.workunit.client.0.smithi088.stderr: -235> 2024-03-09T14:42:32.689+0000 7fbe30585640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.214 INFO:tasks.workunit.client.0.smithi088.stderr: -234> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): handle_auth_done global_id 6614 payload 274 2024-03-09T14:42:33.214 INFO:tasks.workunit.client.0.smithi088.stderr: -233> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient: _finish_hunting 0 2024-03-09T14:42:33.214 INFO:tasks.workunit.client.0.smithi088.stderr: -232> 2024-03-09T14:42:32.689+0000 7fbe30d86640 1 monclient: found mon.noname-c 2024-03-09T14:42:33.214 INFO:tasks.workunit.client.0.smithi088.stderr: -231> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.214 INFO:tasks.workunit.client.0.smithi088.stderr: -230> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.214 INFO:tasks.workunit.client.0.smithi088.stderr: -229> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:42:33.214 INFO:tasks.workunit.client.0.smithi088.stderr: -228> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: dump: 2024-03-09T14:42:33.214 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.214 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.214 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.214 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.214 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.214 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.215 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.215 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.215 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.215 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.215 INFO:tasks.workunit.client.0.smithi088.stderr: -227> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: _finish_auth 0 2024-03-09T14:42:33.215 INFO:tasks.workunit.client.0.smithi088.stderr: -226> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: _check_auth_tickets 2024-03-09T14:42:33.215 INFO:tasks.workunit.client.0.smithi088.stderr: -225> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:42:33.215 INFO:tasks.workunit.client.0.smithi088.stderr: -224> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.215 INFO:tasks.workunit.client.0.smithi088.stderr: -223> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:42:33.215 INFO:tasks.workunit.client.0.smithi088.stderr: -222> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: dump: 2024-03-09T14:42:33.215 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.215 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.215 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.215 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.215 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.216 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.216 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.216 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.216 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.216 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.216 INFO:tasks.workunit.client.0.smithi088.stderr: -221> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 monclient: authenticate success, global_id 6614 2024-03-09T14:42:33.216 INFO:tasks.workunit.client.0.smithi088.stderr: -220> 2024-03-09T14:42:32.690+0000 7fbe3328a800 10 monclient: get_monmap_and_config success 2024-03-09T14:42:33.216 INFO:tasks.workunit.client.0.smithi088.stderr: -219> 2024-03-09T14:42:32.690+0000 7fbe3328a800 4 set_mon_vals no callback set 2024-03-09T14:42:33.216 INFO:tasks.workunit.client.0.smithi088.stderr: -218> 2024-03-09T14:42:32.690+0000 7fbe3328a800 10 monclient: shutdown 2024-03-09T14:42:33.216 INFO:tasks.workunit.client.0.smithi088.stderr: -217> 2024-03-09T14:42:32.690+0000 7fbe3328a800 10 monclient: build_initial_monmap 2024-03-09T14:42:33.216 INFO:tasks.workunit.client.0.smithi088.stderr: -216> 2024-03-09T14:42:32.690+0000 7fbe3328a800 1 build_initial for_mkfs: 0 2024-03-09T14:42:33.216 INFO:tasks.workunit.client.0.smithi088.stderr: -215> 2024-03-09T14:42:32.690+0000 7fbe3328a800 10 monclient: monmap: 2024-03-09T14:42:33.216 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:42:33.216 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:42:33.216 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:42:33.217 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:42:33.217 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:42:33.217 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.217 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:42:33.217 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:42:33.217 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:42:33.217 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.217 INFO:tasks.workunit.client.0.smithi088.stderr: -214> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding auth protocol: cephx 2024-03-09T14:42:33.217 INFO:tasks.workunit.client.0.smithi088.stderr: -213> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding auth protocol: cephx 2024-03-09T14:42:33.217 INFO:tasks.workunit.client.0.smithi088.stderr: -212> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding auth protocol: cephx 2024-03-09T14:42:33.217 INFO:tasks.workunit.client.0.smithi088.stderr: -211> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: secure 2024-03-09T14:42:33.217 INFO:tasks.workunit.client.0.smithi088.stderr: -210> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: crc 2024-03-09T14:42:33.217 INFO:tasks.workunit.client.0.smithi088.stderr: -209> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: secure 2024-03-09T14:42:33.217 INFO:tasks.workunit.client.0.smithi088.stderr: -208> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: crc 2024-03-09T14:42:33.217 INFO:tasks.workunit.client.0.smithi088.stderr: -207> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: secure 2024-03-09T14:42:33.218 INFO:tasks.workunit.client.0.smithi088.stderr: -206> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: crc 2024-03-09T14:42:33.218 INFO:tasks.workunit.client.0.smithi088.stderr: -205> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: crc 2024-03-09T14:42:33.218 INFO:tasks.workunit.client.0.smithi088.stderr: -204> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: secure 2024-03-09T14:42:33.218 INFO:tasks.workunit.client.0.smithi088.stderr: -203> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: crc 2024-03-09T14:42:33.218 INFO:tasks.workunit.client.0.smithi088.stderr: -202> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: secure 2024-03-09T14:42:33.218 INFO:tasks.workunit.client.0.smithi088.stderr: -201> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: crc 2024-03-09T14:42:33.218 INFO:tasks.workunit.client.0.smithi088.stderr: -200> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: secure 2024-03-09T14:42:33.218 INFO:tasks.workunit.client.0.smithi088.stderr: -199> 2024-03-09T14:42:32.691+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.218 INFO:tasks.workunit.client.0.smithi088.stderr: -198> 2024-03-09T14:42:32.691+0000 7fbe3328a800 1 librados: starting msgr at 2024-03-09T14:42:33.218 INFO:tasks.workunit.client.0.smithi088.stderr: -197> 2024-03-09T14:42:32.691+0000 7fbe3328a800 1 librados: starting objecter 2024-03-09T14:42:33.218 INFO:tasks.workunit.client.0.smithi088.stderr: -196> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command objecter_requests cmddesc objecter_requests hook 0x564c4a0ea210 EEXIST 2024-03-09T14:42:33.218 INFO:tasks.workunit.client.0.smithi088.stderr: -195> 2024-03-09T14:42:32.691+0000 7fbe3328a800 1 librados: setting wanted keys 2024-03-09T14:42:33.218 INFO:tasks.workunit.client.0.smithi088.stderr: -194> 2024-03-09T14:42:32.691+0000 7fbe3328a800 1 librados: calling monclient init 2024-03-09T14:42:33.218 INFO:tasks.workunit.client.0.smithi088.stderr: -193> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient: init 2024-03-09T14:42:33.218 INFO:tasks.workunit.client.0.smithi088.stderr: -192> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding auth protocol: cephx 2024-03-09T14:42:33.219 INFO:tasks.workunit.client.0.smithi088.stderr: -191> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding auth protocol: cephx 2024-03-09T14:42:33.219 INFO:tasks.workunit.client.0.smithi088.stderr: -190> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding auth protocol: cephx 2024-03-09T14:42:33.219 INFO:tasks.workunit.client.0.smithi088.stderr: -189> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: secure 2024-03-09T14:42:33.219 INFO:tasks.workunit.client.0.smithi088.stderr: -188> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: crc 2024-03-09T14:42:33.219 INFO:tasks.workunit.client.0.smithi088.stderr: -187> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: secure 2024-03-09T14:42:33.219 INFO:tasks.workunit.client.0.smithi088.stderr: -186> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: crc 2024-03-09T14:42:33.219 INFO:tasks.workunit.client.0.smithi088.stderr: -185> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: secure 2024-03-09T14:42:33.219 INFO:tasks.workunit.client.0.smithi088.stderr: -184> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: crc 2024-03-09T14:42:33.219 INFO:tasks.workunit.client.0.smithi088.stderr: -183> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: crc 2024-03-09T14:42:33.219 INFO:tasks.workunit.client.0.smithi088.stderr: -182> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: secure 2024-03-09T14:42:33.219 INFO:tasks.workunit.client.0.smithi088.stderr: -181> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: crc 2024-03-09T14:42:33.219 INFO:tasks.workunit.client.0.smithi088.stderr: -180> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: secure 2024-03-09T14:42:33.219 INFO:tasks.workunit.client.0.smithi088.stderr: -179> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: crc 2024-03-09T14:42:33.219 INFO:tasks.workunit.client.0.smithi088.stderr: -178> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: secure 2024-03-09T14:42:33.219 INFO:tasks.workunit.client.0.smithi088.stderr: -177> 2024-03-09T14:42:32.691+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.220 INFO:tasks.workunit.client.0.smithi088.stderr: -176> 2024-03-09T14:42:32.691+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.220 INFO:tasks.workunit.client.0.smithi088.stderr: -175> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command rotate-key cmddesc rotate-key hook 0x564c4a146648 EEXIST 2024-03-09T14:42:33.220 INFO:tasks.workunit.client.0.smithi088.stderr: -174> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient: _reopen_session rank -1 2024-03-09T14:42:33.220 INFO:tasks.workunit.client.0.smithi088.stderr: -173> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:42:33.220 INFO:tasks.workunit.client.0.smithi088.stderr: -172> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-b con 0x564c4a17bcf0 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:42:33.220 INFO:tasks.workunit.client.0.smithi088.stderr: -171> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-c con 0x564c4a181880 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:42:33.220 INFO:tasks.workunit.client.0.smithi088.stderr: -170> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-a con 0x564c4a1751e0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:42:33.220 INFO:tasks.workunit.client.0.smithi088.stderr: -169> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.220 INFO:tasks.workunit.client.0.smithi088.stderr: -168> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.220 INFO:tasks.workunit.client.0.smithi088.stderr: -167> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.220 INFO:tasks.workunit.client.0.smithi088.stderr: -166> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): _renew_subs 2024-03-09T14:42:33.220 INFO:tasks.workunit.client.0.smithi088.stderr: -165> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): authenticate will time out at 1768.029137s 2024-03-09T14:42:33.220 INFO:tasks.workunit.client.0.smithi088.stderr: -164> 2024-03-09T14:42:32.691+0000 7fbe30d86640 10 monclient(hunting): get_auth_request con 0x564c4a1751e0 auth_method 0 2024-03-09T14:42:33.220 INFO:tasks.workunit.client.0.smithi088.stderr: -163> 2024-03-09T14:42:32.691+0000 7fbe30d86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.220 INFO:tasks.workunit.client.0.smithi088.stderr: -162> 2024-03-09T14:42:32.691+0000 7fbe30d86640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.221 INFO:tasks.workunit.client.0.smithi088.stderr: -161> 2024-03-09T14:42:32.691+0000 7fbe30d86640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.221 INFO:tasks.workunit.client.0.smithi088.stderr: -160> 2024-03-09T14:42:32.691+0000 7fbe31587640 10 monclient(hunting): get_auth_request con 0x564c4a181880 auth_method 0 2024-03-09T14:42:33.221 INFO:tasks.workunit.client.0.smithi088.stderr: -159> 2024-03-09T14:42:32.691+0000 7fbe31587640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.221 INFO:tasks.workunit.client.0.smithi088.stderr: -158> 2024-03-09T14:42:32.691+0000 7fbe31587640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.221 INFO:tasks.workunit.client.0.smithi088.stderr: -157> 2024-03-09T14:42:32.691+0000 7fbe31587640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.221 INFO:tasks.workunit.client.0.smithi088.stderr: -156> 2024-03-09T14:42:32.692+0000 7fbe30d86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.221 INFO:tasks.workunit.client.0.smithi088.stderr: -155> 2024-03-09T14:42:32.692+0000 7fbe30d86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.221 INFO:tasks.workunit.client.0.smithi088.stderr: -154> 2024-03-09T14:42:32.692+0000 7fbe30d86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.221 INFO:tasks.workunit.client.0.smithi088.stderr: -153> 2024-03-09T14:42:32.692+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.221 INFO:tasks.workunit.client.0.smithi088.stderr: -152> 2024-03-09T14:42:32.692+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.221 INFO:tasks.workunit.client.0.smithi088.stderr: -151> 2024-03-09T14:42:32.692+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.221 INFO:tasks.workunit.client.0.smithi088.stderr: -150> 2024-03-09T14:42:32.692+0000 7fbe30585640 10 monclient(hunting): get_auth_request con 0x564c4a17bcf0 auth_method 0 2024-03-09T14:42:33.221 INFO:tasks.workunit.client.0.smithi088.stderr: -149> 2024-03-09T14:42:32.692+0000 7fbe30585640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.221 INFO:tasks.workunit.client.0.smithi088.stderr: -148> 2024-03-09T14:42:32.692+0000 7fbe30585640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.221 INFO:tasks.workunit.client.0.smithi088.stderr: -147> 2024-03-09T14:42:32.692+0000 7fbe30585640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.222 INFO:tasks.workunit.client.0.smithi088.stderr: -146> 2024-03-09T14:42:32.692+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.222 INFO:tasks.workunit.client.0.smithi088.stderr: -145> 2024-03-09T14:42:32.692+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.222 INFO:tasks.workunit.client.0.smithi088.stderr: -144> 2024-03-09T14:42:32.692+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.222 INFO:tasks.workunit.client.0.smithi088.stderr: -143> 2024-03-09T14:42:32.692+0000 7fbe31587640 10 monclient(hunting): handle_auth_done global_id 6617 payload 824 2024-03-09T14:42:33.222 INFO:tasks.workunit.client.0.smithi088.stderr: -142> 2024-03-09T14:42:32.692+0000 7fbe31587640 10 monclient: _finish_hunting 0 2024-03-09T14:42:33.222 INFO:tasks.workunit.client.0.smithi088.stderr: -141> 2024-03-09T14:42:32.692+0000 7fbe31587640 1 monclient: found mon.noname-c 2024-03-09T14:42:33.222 INFO:tasks.workunit.client.0.smithi088.stderr: -140> 2024-03-09T14:42:32.692+0000 7fbe31587640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.222 INFO:tasks.workunit.client.0.smithi088.stderr: -139> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.222 INFO:tasks.workunit.client.0.smithi088.stderr: -138> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:42:33.222 INFO:tasks.workunit.client.0.smithi088.stderr: -137> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: dump: 2024-03-09T14:42:33.222 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.222 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.222 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.222 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr: -136> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: _finish_auth 0 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr: -135> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: _check_auth_tickets 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr: -134> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr: -133> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr: -132> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr: -131> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: dump: 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.223 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.224 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.224 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.224 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.224 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.224 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.224 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.224 INFO:tasks.workunit.client.0.smithi088.stderr: -130> 2024-03-09T14:42:32.692+0000 7fbe3328a800 5 monclient: authenticate success, global_id 6617 2024-03-09T14:42:33.224 INFO:tasks.workunit.client.0.smithi088.stderr: -129> 2024-03-09T14:42:32.692+0000 7fbd07fff640 4 set_mon_vals no callback set 2024-03-09T14:42:33.224 INFO:tasks.workunit.client.0.smithi088.stderr: -128> 2024-03-09T14:42:32.692+0000 7fbe3328a800 10 monclient: _renew_subs 2024-03-09T14:42:33.224 INFO:tasks.workunit.client.0.smithi088.stderr: -127> 2024-03-09T14:42:32.692+0000 7fbe3328a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.224 INFO:tasks.workunit.client.0.smithi088.stderr: -126> 2024-03-09T14:42:32.692+0000 7fbe3328a800 10 monclient: _renew_subs 2024-03-09T14:42:33.224 INFO:tasks.workunit.client.0.smithi088.stderr: -125> 2024-03-09T14:42:32.692+0000 7fbe3328a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.224 INFO:tasks.workunit.client.0.smithi088.stderr: -124> 2024-03-09T14:42:32.692+0000 7fbe3328a800 1 librados: init done 2024-03-09T14:42:33.224 INFO:tasks.workunit.client.0.smithi088.stderr: -123> 2024-03-09T14:42:32.692+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command cr dump hook 0x564c4a1708e8 2024-03-09T14:42:33.224 INFO:tasks.workunit.client.0.smithi088.stderr: -122> 2024-03-09T14:42:32.693+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.225 INFO:tasks.workunit.client.0.smithi088.stderr: -121> 2024-03-09T14:42:32.694+0000 7fbd067fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:42:33.225 INFO:tasks.workunit.client.0.smithi088.stderr: -120> 2024-03-09T14:42:32.694+0000 7fbd067fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:42:33.225 INFO:tasks.workunit.client.0.smithi088.stderr: -119> 2024-03-09T14:42:32.694+0000 7fbd067fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:42:33.225 INFO:tasks.workunit.client.0.smithi088.stderr: -118> 2024-03-09T14:42:32.694+0000 7fbe30585640 10 monclient: get_auth_request con 0x7fbcfc06a5e0 auth_method 0 2024-03-09T14:42:33.225 INFO:tasks.workunit.client.0.smithi088.stderr: -117> 2024-03-09T14:42:32.694+0000 7fbe30d86640 10 monclient: get_auth_request con 0x564c4a196880 auth_method 0 2024-03-09T14:42:33.225 INFO:tasks.workunit.client.0.smithi088.stderr: -116> 2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.225 INFO:tasks.workunit.client.0.smithi088.stderr: -115> 2024-03-09T14:42:32.695+0000 7fbe3328a800 20 realm 2024-03-09T14:42:33.225 INFO:tasks.workunit.client.0.smithi088.stderr: -114> 2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.225 INFO:tasks.workunit.client.0.smithi088.stderr: -113> 2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.225 INFO:tasks.workunit.client.0.smithi088.stderr: -112> 2024-03-09T14:42:32.695+0000 7fbe3328a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:42:33.225 INFO:tasks.workunit.client.0.smithi088.stderr: -111> 2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.225 INFO:tasks.workunit.client.0.smithi088.stderr: -110> 2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.225 INFO:tasks.workunit.client.0.smithi088.stderr: -109> 2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.225 INFO:tasks.workunit.client.0.smithi088.stderr: -108> 2024-03-09T14:42:32.695+0000 7fbe30585640 10 monclient: get_auth_request con 0x564c4a19aad0 auth_method 0 2024-03-09T14:42:33.225 INFO:tasks.workunit.client.0.smithi088.stderr: -107> 2024-03-09T14:42:32.696+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:33.226 INFO:tasks.workunit.client.0.smithi088.stderr: -106> 2024-03-09T14:42:32.696+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.226 INFO:tasks.workunit.client.0.smithi088.stderr: -105> 2024-03-09T14:42:32.696+0000 7fbe31587640 10 monclient: get_auth_request con 0x564c4a19e310 auth_method 0 2024-03-09T14:42:33.226 INFO:tasks.workunit.client.0.smithi088.stderr: -104> 2024-03-09T14:42:32.697+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:42:33.226 INFO:tasks.workunit.client.0.smithi088.stderr: -103> 2024-03-09T14:42:32.697+0000 7fbe3328a800 20 searching for the correct realm 2024-03-09T14:42:33.226 INFO:tasks.workunit.client.0.smithi088.stderr: -102> 2024-03-09T14:42:32.697+0000 7fbe30d86640 10 monclient: get_auth_request con 0x564c4a1a3080 auth_method 0 2024-03-09T14:42:33.226 INFO:tasks.workunit.client.0.smithi088.stderr: -101> 2024-03-09T14:42:32.697+0000 7fbe30585640 10 monclient: get_auth_request con 0x7fbe2803f040 auth_method 0 2024-03-09T14:42:33.226 INFO:tasks.workunit.client.0.smithi088.stderr: -100> 2024-03-09T14:42:32.698+0000 7fbe31587640 10 monclient: get_auth_request con 0x7fbe2005e040 auth_method 0 2024-03-09T14:42:33.226 INFO:tasks.workunit.client.0.smithi088.stderr: -99> 2024-03-09T14:42:32.699+0000 7fbe31587640 0 -- 172.21.15.88:0/1417449907 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fbe2005e040 msgr2=0x7fbe200552e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:33.226 INFO:tasks.workunit.client.0.smithi088.stderr: -98> 2024-03-09T14:42:32.900+0000 7fbe31587640 10 monclient: get_auth_request con 0x7fbe2005e040 auth_method 0 2024-03-09T14:42:33.226 INFO:tasks.workunit.client.0.smithi088.stderr: -97> 2024-03-09T14:42:32.902+0000 7fbe30d86640 10 monclient: get_auth_request con 0x7fbe200cbbc0 auth_method 0 2024-03-09T14:42:33.226 INFO:tasks.workunit.client.0.smithi088.stderr: -96> 2024-03-09T14:42:32.905+0000 7fbe30585640 10 monclient: get_auth_request con 0x7fbe200d6040 auth_method 0 2024-03-09T14:42:33.226 INFO:tasks.workunit.client.0.smithi088.stderr: -95> 2024-03-09T14:42:32.905+0000 7fbe30585640 0 -- 172.21.15.88:0/1417449907 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fbe200d6040 msgr2=0x7fbe2004c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:33.226 INFO:tasks.workunit.client.0.smithi088.stderr: -94> 2024-03-09T14:42:33.106+0000 7fbe30585640 10 monclient: get_auth_request con 0x7fbe200d6040 auth_method 0 2024-03-09T14:42:33.226 INFO:tasks.workunit.client.0.smithi088.stderr: -93> 2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -92> 2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -91> 2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -90> 2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -89> 2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -88> 2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -87> 2024-03-09T14:42:33.111+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -86> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -85> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -84> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -83> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -82> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -81> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 zone default found 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -80> 2024-03-09T14:42:33.112+0000 7fbe3328a800 4 Realm: () 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -79> 2024-03-09T14:42:33.112+0000 7fbe3328a800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -78> 2024-03-09T14:42:33.112+0000 7fbe3328a800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:42:33.227 INFO:tasks.workunit.client.0.smithi088.stderr: -77> 2024-03-09T14:42:33.112+0000 7fbe3328a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:42:33.228 INFO:tasks.workunit.client.0.smithi088.stderr: -76> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 zonegroup default 2024-03-09T14:42:33.228 INFO:tasks.workunit.client.0.smithi088.stderr: -75> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.228 INFO:tasks.workunit.client.0.smithi088.stderr: -74> 2024-03-09T14:42:33.113+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.228 INFO:tasks.workunit.client.0.smithi088.stderr: -73> 2024-03-09T14:42:33.113+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.228 INFO:tasks.workunit.client.0.smithi088.stderr: -72> 2024-03-09T14:42:33.113+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.228 INFO:tasks.workunit.client.0.smithi088.stderr: -71> 2024-03-09T14:42:33.113+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.228 INFO:tasks.workunit.client.0.smithi088.stderr: -70> 2024-03-09T14:42:33.113+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.228 INFO:tasks.workunit.client.0.smithi088.stderr: -69> 2024-03-09T14:42:33.113+0000 7fbe3328a800 20 started sync module instance, tier type = 2024-03-09T14:42:33.228 INFO:tasks.workunit.client.0.smithi088.stderr: -68> 2024-03-09T14:42:33.113+0000 7fbe3328a800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:42:33.228 INFO:tasks.workunit.client.0.smithi088.stderr: -67> 2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=0 2024-03-09T14:42:33.228 INFO:tasks.workunit.client.0.smithi088.stderr: -66> 2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=1 2024-03-09T14:42:33.228 INFO:tasks.workunit.client.0.smithi088.stderr: -65> 2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=2 2024-03-09T14:42:33.228 INFO:tasks.workunit.client.0.smithi088.stderr: -64> 2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=3 2024-03-09T14:42:33.228 INFO:tasks.workunit.client.0.smithi088.stderr: -63> 2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=4 2024-03-09T14:42:33.228 INFO:tasks.workunit.client.0.smithi088.stderr: -62> 2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=5 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -61> 2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=6 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -60> 2024-03-09T14:42:33.124+0000 7fbe3328a800 20 add_watcher() i=7 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -59> 2024-03-09T14:42:33.124+0000 7fbe3328a800 2 all 8 watchers are set, enabling cache 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -58> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding auth protocol: cephx 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -57> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding auth protocol: cephx 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -56> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding auth protocol: cephx 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -55> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: secure 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -54> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: crc 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -53> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: secure 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -52> 2024-03-09T14:42:33.125+0000 7fbce77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -51> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: crc 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -50> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: secure 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -49> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: crc 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -48> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: crc 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -47> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: secure 2024-03-09T14:42:33.229 INFO:tasks.workunit.client.0.smithi088.stderr: -46> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: crc 2024-03-09T14:42:33.230 INFO:tasks.workunit.client.0.smithi088.stderr: -45> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: secure 2024-03-09T14:42:33.230 INFO:tasks.workunit.client.0.smithi088.stderr: -44> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: crc 2024-03-09T14:42:33.230 INFO:tasks.workunit.client.0.smithi088.stderr: -43> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: secure 2024-03-09T14:42:33.230 INFO:tasks.workunit.client.0.smithi088.stderr: -42> 2024-03-09T14:42:33.126+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.230 INFO:tasks.workunit.client.0.smithi088.stderr: -41> 2024-03-09T14:42:33.126+0000 7fbe3328a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:42:33.230 INFO:tasks.workunit.client.0.smithi088.stderr: -40> 2024-03-09T14:42:33.126+0000 7fbe3328a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:42:33.230 INFO:tasks.workunit.client.0.smithi088.stderr: -39> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command cache list hook 0x564c4a1755e0 2024-03-09T14:42:33.230 INFO:tasks.workunit.client.0.smithi088.stderr: -38> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command cache inspect hook 0x564c4a1755e0 2024-03-09T14:42:33.230 INFO:tasks.workunit.client.0.smithi088.stderr: -37> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command cache erase hook 0x564c4a1755e0 2024-03-09T14:42:33.230 INFO:tasks.workunit.client.0.smithi088.stderr: -36> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command cache zap hook 0x564c4a1755e0 2024-03-09T14:42:33.230 INFO:tasks.workunit.client.0.smithi088.stderr: -35> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 note: GC not initialized 2024-03-09T14:42:33.230 INFO:tasks.workunit.client.0.smithi088.stderr: -34> 2024-03-09T14:42:33.126+0000 7fbce67e4640 20 reqs_thread_entry: start 2024-03-09T14:42:33.230 INFO:tasks.workunit.client.0.smithi088.stderr: -33> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command sync trace show hook 0x7fbe2800e9e0 2024-03-09T14:42:33.230 INFO:tasks.workunit.client.0.smithi088.stderr: -32> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command sync trace history hook 0x7fbe2800e9e0 2024-03-09T14:42:33.230 INFO:tasks.workunit.client.0.smithi088.stderr: -31> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command sync trace active hook 0x7fbe2800e9e0 2024-03-09T14:42:33.231 INFO:tasks.workunit.client.0.smithi088.stderr: -30> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command sync trace active_short hook 0x7fbe2800e9e0 2024-03-09T14:42:33.231 INFO:tasks.workunit.client.0.smithi088.stderr: -29> 2024-03-09T14:42:33.126+0000 7fbe3328a800 20 init_complete bucket index max shards: 11 2024-03-09T14:42:33.231 INFO:tasks.workunit.client.0.smithi088.stderr: -28> 2024-03-09T14:42:33.126+0000 7fbe3328a800 20 Filter name: none 2024-03-09T14:42:33.231 INFO:tasks.workunit.client.0.smithi088.stderr: -27> 2024-03-09T14:42:33.126+0000 7fbcdf7fe640 20 reqs_thread_entry: start 2024-03-09T14:42:33.231 INFO:tasks.workunit.client.0.smithi088.stderr: -26> 2024-03-09T14:42:33.126+0000 7fbe3328a800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-09T14:42:33.231 INFO:tasks.workunit.client.0.smithi088.stderr: -25> 2024-03-09T14:42:33.126+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.231 INFO:tasks.workunit.client.0.smithi088.stderr: -24> 2024-03-09T14:42:33.127+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:42:33.231 INFO:tasks.workunit.client.0.smithi088.stderr: -23> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-09T14:42:33.231 INFO:tasks.workunit.client.0.smithi088.stderr: -22> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-09T14:42:33.231 INFO:tasks.workunit.client.0.smithi088.stderr: -21> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 : miss 2024-03-09T14:42:33.231 INFO:tasks.workunit.client.0.smithi088.stderr: -20> 2024-03-09T14:42:33.127+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.231 INFO:tasks.workunit.client.0.smithi088.stderr: -19> 2024-03-09T14:42:33.127+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:42:33.231 INFO:tasks.workunit.client.0.smithi088.stderr: -18> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 info.flags=0x17 2024-03-09T14:42:33.231 INFO:tasks.workunit.client.0.smithi088.stderr: -17> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 to cache LRU end 2024-03-09T14:42:33.232 INFO:tasks.workunit.client.0.smithi088.stderr: -16> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:33.232 INFO:tasks.workunit.client.0.smithi088.stderr: -15> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:33.232 INFO:tasks.workunit.client.0.smithi088.stderr: -14> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 2024-03-09T14:42:33.232 INFO:tasks.workunit.client.0.smithi088.stderr: -13> 2024-03-09T14:42:33.133+0000 7fbe3328a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 info.flags=0x17 2024-03-09T14:42:33.232 INFO:tasks.workunit.client.0.smithi088.stderr: -12> 2024-03-09T14:42:33.133+0000 7fbe3328a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 to cache LRU end 2024-03-09T14:42:33.232 INFO:tasks.workunit.client.0.smithi088.stderr: -11> 2024-03-09T14:42:33.133+0000 7fbe3328a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:33.232 INFO:tasks.workunit.client.0.smithi088.stderr: -10> 2024-03-09T14:42:33.133+0000 7fbe3328a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28, ofs0, ns] 2024-03-09T14:42:33.232 INFO:tasks.workunit.client.0.smithi088.stderr: -9> 2024-03-09T14:42:33.133+0000 7fbd077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464261 cookie 94885660778960 notifier 6617 bl.length()=903 2024-03-09T14:42:33.232 INFO:tasks.workunit.client.0.smithi088.stderr: -8> 2024-03-09T14:42:33.133+0000 7fbd077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 info.flags=0x17 2024-03-09T14:42:33.232 INFO:tasks.workunit.client.0.smithi088.stderr: -7> 2024-03-09T14:42:33.133+0000 7fbd077fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 to cache LRU end 2024-03-09T14:42:33.232 INFO:tasks.workunit.client.0.smithi088.stderr: -6> 2024-03-09T14:42:33.133+0000 7fbd077fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:33.232 INFO:tasks.workunit.client.0.smithi088.stderr: -5> 2024-03-09T14:42:33.135+0000 7fbe3328a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): orig_sources= new_sources= 2024-03-09T14:42:33.232 INFO:tasks.workunit.client.0.smithi088.stderr: -4> 2024-03-09T14:42:33.135+0000 7fbe3328a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): potential sources added=[] removed=[] 2024-03-09T14:42:33.232 INFO:tasks.workunit.client.0.smithi088.stderr: -3> 2024-03-09T14:42:33.135+0000 7fbe3328a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): orig_dests= new_dests= 2024-03-09T14:42:33.232 INFO:tasks.workunit.client.0.smithi088.stderr: -2> 2024-03-09T14:42:33.135+0000 7fbe3328a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): potential dests added=[] removed=[] 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr: -1> 2024-03-09T14:42:33.139+0000 7fbe3328a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbe3328a800 time 2024-03-09T14:42:33.138849+0000 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbe36580e86] 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fbe36581044] 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c48953f91] 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x564c4896eed4] 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr: 5: main() 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fbe3543feb0] 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr: 7: __libc_start_main() 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr: 8: _start() 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr: 0> 2024-03-09T14:42:33.140+0000 7fbe3328a800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7fbe3328a800 thread_name:radosgw-admin 2024-03-09T14:42:33.233 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.234 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:42:33.234 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fbe35454db0] 2024-03-09T14:42:33.234 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fbe354a154c] 2024-03-09T14:42:33.234 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:42:33.234 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:42:33.234 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbe36580ee0] 2024-03-09T14:42:33.234 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fbe36581044] 2024-03-09T14:42:33.234 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c48953f91] 2024-03-09T14:42:33.234 INFO:tasks.workunit.client.0.smithi088.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x564c4896eed4] 2024-03-09T14:42:33.234 INFO:tasks.workunit.client.0.smithi088.stderr: 9: main() 2024-03-09T14:42:33.234 INFO:tasks.workunit.client.0.smithi088.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fbe3543feb0] 2024-03-09T14:42:33.234 INFO:tasks.workunit.client.0.smithi088.stderr: 11: __libc_start_main() 2024-03-09T14:42:33.234 INFO:tasks.workunit.client.0.smithi088.stderr: 12: _start() 2024-03-09T14:42:33.234 INFO:tasks.workunit.client.0.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr:--- logging levels --- 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 none 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 lockdep 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 context 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 crush 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_balancer 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_locker 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log_expire 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_migrator 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 buffer 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 timer 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 filer 2024-03-09T14:42:33.235 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 striper 2024-03-09T14:42:33.236 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 objecter 2024-03-09T14:42:33.236 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rados 2024-03-09T14:42:33.236 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd 2024-03-09T14:42:33.236 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_mirror 2024-03-09T14:42:33.236 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_replay 2024-03-09T14:42:33.236 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_pwl 2024-03-09T14:42:33.236 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 journaler 2024-03-09T14:42:33.236 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objectcacher 2024-03-09T14:42:33.236 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:42:33.236 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 client 2024-03-09T14:42:33.236 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 osd 2024-03-09T14:42:33.236 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 optracker 2024-03-09T14:42:33.236 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objclass 2024-03-09T14:42:33.236 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 filestore 2024-03-09T14:42:33.236 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 journal 2024-03-09T14:42:33.237 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 ms 2024-03-09T14:42:33.237 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mon 2024-03-09T14:42:33.237 INFO:tasks.workunit.client.0.smithi088.stderr: 0/10 monc 2024-03-09T14:42:33.237 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 paxos 2024-03-09T14:42:33.237 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 tp 2024-03-09T14:42:33.237 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 auth 2024-03-09T14:42:33.237 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 crypto 2024-03-09T14:42:33.237 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 finisher 2024-03-09T14:42:33.237 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 reserver 2024-03-09T14:42:33.237 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 heartbeatmap 2024-03-09T14:42:33.237 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 perfcounter 2024-03-09T14:42:33.237 INFO:tasks.workunit.client.0.smithi088.stderr: 20/20 rgw 2024-03-09T14:42:33.237 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_sync 2024-03-09T14:42:33.237 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_datacache 2024-03-09T14:42:33.237 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_access 2024-03-09T14:42:33.238 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:42:33.238 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_flight 2024-03-09T14:42:33.238 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:42:33.238 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 javaclient 2024-03-09T14:42:33.238 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 asok 2024-03-09T14:42:33.238 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 throttle 2024-03-09T14:42:33.238 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 refs 2024-03-09T14:42:33.238 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 compressor 2024-03-09T14:42:33.238 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluestore 2024-03-09T14:42:33.238 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluefs 2024-03-09T14:42:33.238 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 bdev 2024-03-09T14:42:33.238 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 kstore 2024-03-09T14:42:33.238 INFO:tasks.workunit.client.0.smithi088.stderr: 4/ 5 rocksdb 2024-03-09T14:42:33.238 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 fuse 2024-03-09T14:42:33.239 INFO:tasks.workunit.client.0.smithi088.stderr: 2/ 5 mgr 2024-03-09T14:42:33.239 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mgrc 2024-03-09T14:42:33.239 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 dpdk 2024-03-09T14:42:33.239 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 eventtrace 2024-03-09T14:42:33.239 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 prioritycache 2024-03-09T14:42:33.239 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 test 2024-03-09T14:42:33.239 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:42:33.239 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephsqlite 2024-03-09T14:42:33.239 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:42:33.239 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore 2024-03-09T14:42:33.239 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_onode 2024-03-09T14:42:33.239 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_odata 2024-03-09T14:42:33.239 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_omap 2024-03-09T14:42:33.239 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_tm 2024-03-09T14:42:33.239 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_t 2024-03-09T14:42:33.240 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:42:33.240 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_epm 2024-03-09T14:42:33.240 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_lba 2024-03-09T14:42:33.240 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:42:33.240 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cache 2024-03-09T14:42:33.240 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_journal 2024-03-09T14:42:33.240 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_device 2024-03-09T14:42:33.240 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_backref 2024-03-09T14:42:33.240 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 alienstore 2024-03-09T14:42:33.240 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mclock 2024-03-09T14:42:33.240 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cyanstore 2024-03-09T14:42:33.240 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 ceph_exporter 2024-03-09T14:42:33.240 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 memstore 2024-03-09T14:42:33.240 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 trace 2024-03-09T14:42:33.240 INFO:tasks.workunit.client.0.smithi088.stderr: -2/-2 (syslog threshold) 2024-03-09T14:42:33.241 INFO:tasks.workunit.client.0.smithi088.stderr: 99/99 (stderr threshold) 2024-03-09T14:42:33.241 INFO:tasks.workunit.client.0.smithi088.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:42:33.241 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbcdf7fe640 / http_manager 2024-03-09T14:42:33.241 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbce67e4640 / http_manager 2024-03-09T14:42:33.241 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbce77e6640 / rgw_dt_lg_renew 2024-03-09T14:42:33.241 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbd067fc640 / ms_dispatch 2024-03-09T14:42:33.241 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbd077fe640 / io_context_pool 2024-03-09T14:42:33.241 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbd07fff640 / io_context_pool 2024-03-09T14:42:33.241 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbd167fc640 / ms_dispatch 2024-03-09T14:42:33.241 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbd1d60a640 / ms_dispatch 2024-03-09T14:42:33.241 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbd1ee0d640 / io_context_pool 2024-03-09T14:42:33.241 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbe30585640 / msgr-worker-2 2024-03-09T14:42:33.241 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbe30d86640 / msgr-worker-1 2024-03-09T14:42:33.241 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbe31587640 / msgr-worker-0 2024-03-09T14:42:33.241 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbe31d88640 / io_context_pool 2024-03-09T14:42:33.242 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbe3328a800 / radosgw-admin 2024-03-09T14:42:33.242 INFO:tasks.workunit.client.0.smithi088.stderr: max_recent 500 2024-03-09T14:42:33.242 INFO:tasks.workunit.client.0.smithi088.stderr: max_new 1000 2024-03-09T14:42:33.242 INFO:tasks.workunit.client.0.smithi088.stderr: log_file /var/log/ceph/ceph-client.admin.110321.log 2024-03-09T14:42:33.242 INFO:tasks.workunit.client.0.smithi088.stderr:--- end dump of recent events --- 2024-03-09T14:42:33.242 INFO:tasks.workunit.client.0.smithi088.stderr:--- begin dump of recent events --- 2024-03-09T14:42:33.242 INFO:tasks.workunit.client.0.smithi088.stderr: -499> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:42:33.242 INFO:tasks.workunit.client.0.smithi088.stderr: -498> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: dump: 2024-03-09T14:42:33.242 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.242 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.242 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.242 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.242 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.242 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.242 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.243 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.243 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.243 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.243 INFO:tasks.workunit.client.0.smithi088.stderr: -497> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: _finish_auth 0 2024-03-09T14:42:33.243 INFO:tasks.workunit.client.0.smithi088.stderr: -496> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: _check_auth_tickets 2024-03-09T14:42:33.243 INFO:tasks.workunit.client.0.smithi088.stderr: -495> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:42:33.243 INFO:tasks.workunit.client.0.smithi088.stderr: -494> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.243 INFO:tasks.workunit.client.0.smithi088.stderr: -493> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:42:33.243 INFO:tasks.workunit.client.0.smithi088.stderr: -492> 2024-03-09T14:42:32.677+0000 7fbd1ee0d640 10 monclient: dump: 2024-03-09T14:42:33.243 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.243 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.243 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.243 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.243 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.243 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr: -491> 2024-03-09T14:42:32.677+0000 7fbe3328a800 5 monclient: authenticate success, global_id 6605 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr: -490> 2024-03-09T14:42:32.677+0000 7fbe3328a800 10 monclient: get_monmap_and_config success 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr: -489> 2024-03-09T14:42:32.677+0000 7fbe3328a800 4 set_mon_vals no callback set 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr: -488> 2024-03-09T14:42:32.678+0000 7fbe3328a800 10 monclient: shutdown 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr: -487> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 asok(0x564c49e8a780) unregister_commands rotate-key 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr: -486> 2024-03-09T14:42:32.678+0000 7fbe3328a800 10 monclient: build_initial_monmap 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr: -485> 2024-03-09T14:42:32.678+0000 7fbe3328a800 1 build_initial for_mkfs: 0 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr: -484> 2024-03-09T14:42:32.678+0000 7fbe3328a800 10 monclient: monmap: 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:42:33.244 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:42:33.245 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:42:33.245 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.245 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:42:33.245 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:42:33.245 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:42:33.245 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.245 INFO:tasks.workunit.client.0.smithi088.stderr: -483> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding auth protocol: cephx 2024-03-09T14:42:33.245 INFO:tasks.workunit.client.0.smithi088.stderr: -482> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding auth protocol: cephx 2024-03-09T14:42:33.245 INFO:tasks.workunit.client.0.smithi088.stderr: -481> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding auth protocol: cephx 2024-03-09T14:42:33.245 INFO:tasks.workunit.client.0.smithi088.stderr: -480> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: secure 2024-03-09T14:42:33.245 INFO:tasks.workunit.client.0.smithi088.stderr: -479> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: crc 2024-03-09T14:42:33.245 INFO:tasks.workunit.client.0.smithi088.stderr: -478> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: secure 2024-03-09T14:42:33.245 INFO:tasks.workunit.client.0.smithi088.stderr: -477> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: crc 2024-03-09T14:42:33.245 INFO:tasks.workunit.client.0.smithi088.stderr: -476> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: secure 2024-03-09T14:42:33.245 INFO:tasks.workunit.client.0.smithi088.stderr: -475> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: crc 2024-03-09T14:42:33.246 INFO:tasks.workunit.client.0.smithi088.stderr: -474> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: crc 2024-03-09T14:42:33.246 INFO:tasks.workunit.client.0.smithi088.stderr: -473> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: secure 2024-03-09T14:42:33.246 INFO:tasks.workunit.client.0.smithi088.stderr: -472> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: crc 2024-03-09T14:42:33.246 INFO:tasks.workunit.client.0.smithi088.stderr: -471> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: secure 2024-03-09T14:42:33.246 INFO:tasks.workunit.client.0.smithi088.stderr: -470> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: crc 2024-03-09T14:42:33.246 INFO:tasks.workunit.client.0.smithi088.stderr: -469> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0aa8d0) adding con mode: secure 2024-03-09T14:42:33.246 INFO:tasks.workunit.client.0.smithi088.stderr: -468> 2024-03-09T14:42:32.678+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.246 INFO:tasks.workunit.client.0.smithi088.stderr: -467> 2024-03-09T14:42:32.678+0000 7fbe3328a800 1 librados: starting msgr at 2024-03-09T14:42:33.246 INFO:tasks.workunit.client.0.smithi088.stderr: -466> 2024-03-09T14:42:32.678+0000 7fbe3328a800 1 librados: starting objecter 2024-03-09T14:42:33.246 INFO:tasks.workunit.client.0.smithi088.stderr: -465> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command objecter_requests hook 0x564c4a0afa20 2024-03-09T14:42:33.246 INFO:tasks.workunit.client.0.smithi088.stderr: -464> 2024-03-09T14:42:32.678+0000 7fbe3328a800 1 librados: setting wanted keys 2024-03-09T14:42:33.246 INFO:tasks.workunit.client.0.smithi088.stderr: -463> 2024-03-09T14:42:32.678+0000 7fbe3328a800 1 librados: calling monclient init 2024-03-09T14:42:33.246 INFO:tasks.workunit.client.0.smithi088.stderr: -462> 2024-03-09T14:42:32.678+0000 7fbe3328a800 10 monclient: init 2024-03-09T14:42:33.246 INFO:tasks.workunit.client.0.smithi088.stderr: -461> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding auth protocol: cephx 2024-03-09T14:42:33.246 INFO:tasks.workunit.client.0.smithi088.stderr: -460> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding auth protocol: cephx 2024-03-09T14:42:33.247 INFO:tasks.workunit.client.0.smithi088.stderr: -459> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding auth protocol: cephx 2024-03-09T14:42:33.247 INFO:tasks.workunit.client.0.smithi088.stderr: -458> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: secure 2024-03-09T14:42:33.247 INFO:tasks.workunit.client.0.smithi088.stderr: -457> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: crc 2024-03-09T14:42:33.247 INFO:tasks.workunit.client.0.smithi088.stderr: -456> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: secure 2024-03-09T14:42:33.247 INFO:tasks.workunit.client.0.smithi088.stderr: -455> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: crc 2024-03-09T14:42:33.247 INFO:tasks.workunit.client.0.smithi088.stderr: -454> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: secure 2024-03-09T14:42:33.247 INFO:tasks.workunit.client.0.smithi088.stderr: -453> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: crc 2024-03-09T14:42:33.247 INFO:tasks.workunit.client.0.smithi088.stderr: -452> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: crc 2024-03-09T14:42:33.247 INFO:tasks.workunit.client.0.smithi088.stderr: -451> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: secure 2024-03-09T14:42:33.247 INFO:tasks.workunit.client.0.smithi088.stderr: -450> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: crc 2024-03-09T14:42:33.247 INFO:tasks.workunit.client.0.smithi088.stderr: -449> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: secure 2024-03-09T14:42:33.247 INFO:tasks.workunit.client.0.smithi088.stderr: -448> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: crc 2024-03-09T14:42:33.247 INFO:tasks.workunit.client.0.smithi088.stderr: -447> 2024-03-09T14:42:32.678+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0a75e0) adding con mode: secure 2024-03-09T14:42:33.247 INFO:tasks.workunit.client.0.smithi088.stderr: -446> 2024-03-09T14:42:32.678+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.247 INFO:tasks.workunit.client.0.smithi088.stderr: -445> 2024-03-09T14:42:32.679+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.248 INFO:tasks.workunit.client.0.smithi088.stderr: -444> 2024-03-09T14:42:32.679+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command rotate-key hook 0x564c4a0a7728 2024-03-09T14:42:33.248 INFO:tasks.workunit.client.0.smithi088.stderr: -443> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient: _reopen_session rank -1 2024-03-09T14:42:33.248 INFO:tasks.workunit.client.0.smithi088.stderr: -442> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:42:33.248 INFO:tasks.workunit.client.0.smithi088.stderr: -441> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-b con 0x564c49f5f380 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:42:33.248 INFO:tasks.workunit.client.0.smithi088.stderr: -440> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-c con 0x564c49fe9800 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:42:33.248 INFO:tasks.workunit.client.0.smithi088.stderr: -439> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-a con 0x564c49fefd90 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:42:33.248 INFO:tasks.workunit.client.0.smithi088.stderr: -438> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.248 INFO:tasks.workunit.client.0.smithi088.stderr: -437> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.248 INFO:tasks.workunit.client.0.smithi088.stderr: -436> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.248 INFO:tasks.workunit.client.0.smithi088.stderr: -435> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): _renew_subs 2024-03-09T14:42:33.248 INFO:tasks.workunit.client.0.smithi088.stderr: -434> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient(hunting): authenticate will time out at 1768.016462s 2024-03-09T14:42:33.248 INFO:tasks.workunit.client.0.smithi088.stderr: -433> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): get_auth_request con 0x564c49fe9800 auth_method 0 2024-03-09T14:42:33.248 INFO:tasks.workunit.client.0.smithi088.stderr: -432> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.248 INFO:tasks.workunit.client.0.smithi088.stderr: -431> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.248 INFO:tasks.workunit.client.0.smithi088.stderr: -430> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.249 INFO:tasks.workunit.client.0.smithi088.stderr: -429> 2024-03-09T14:42:32.679+0000 7fbe31587640 10 monclient(hunting): get_auth_request con 0x564c49fefd90 auth_method 0 2024-03-09T14:42:33.249 INFO:tasks.workunit.client.0.smithi088.stderr: -428> 2024-03-09T14:42:32.679+0000 7fbe31587640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.249 INFO:tasks.workunit.client.0.smithi088.stderr: -427> 2024-03-09T14:42:32.679+0000 7fbe31587640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.249 INFO:tasks.workunit.client.0.smithi088.stderr: -426> 2024-03-09T14:42:32.679+0000 7fbe31587640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.249 INFO:tasks.workunit.client.0.smithi088.stderr: -425> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.249 INFO:tasks.workunit.client.0.smithi088.stderr: -424> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.249 INFO:tasks.workunit.client.0.smithi088.stderr: -423> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.249 INFO:tasks.workunit.client.0.smithi088.stderr: -422> 2024-03-09T14:42:32.679+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.249 INFO:tasks.workunit.client.0.smithi088.stderr: -421> 2024-03-09T14:42:32.679+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.249 INFO:tasks.workunit.client.0.smithi088.stderr: -420> 2024-03-09T14:42:32.679+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.249 INFO:tasks.workunit.client.0.smithi088.stderr: -419> 2024-03-09T14:42:32.679+0000 7fbe30d86640 10 monclient(hunting): get_auth_request con 0x564c49f5f380 auth_method 0 2024-03-09T14:42:33.249 INFO:tasks.workunit.client.0.smithi088.stderr: -418> 2024-03-09T14:42:32.679+0000 7fbe30d86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.249 INFO:tasks.workunit.client.0.smithi088.stderr: -417> 2024-03-09T14:42:32.679+0000 7fbe30d86640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.249 INFO:tasks.workunit.client.0.smithi088.stderr: -416> 2024-03-09T14:42:32.679+0000 7fbe30d86640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.249 INFO:tasks.workunit.client.0.smithi088.stderr: -415> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient(hunting): handle_auth_done global_id 6608 payload 824 2024-03-09T14:42:33.250 INFO:tasks.workunit.client.0.smithi088.stderr: -414> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient: _finish_hunting 0 2024-03-09T14:42:33.250 INFO:tasks.workunit.client.0.smithi088.stderr: -413> 2024-03-09T14:42:32.679+0000 7fbe30585640 1 monclient: found mon.noname-c 2024-03-09T14:42:33.250 INFO:tasks.workunit.client.0.smithi088.stderr: -412> 2024-03-09T14:42:32.679+0000 7fbe30585640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.250 INFO:tasks.workunit.client.0.smithi088.stderr: -411> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.250 INFO:tasks.workunit.client.0.smithi088.stderr: -410> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:42:33.250 INFO:tasks.workunit.client.0.smithi088.stderr: -409> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: dump: 2024-03-09T14:42:33.250 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.250 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.250 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.250 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.250 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.250 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.250 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.250 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.251 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.251 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.251 INFO:tasks.workunit.client.0.smithi088.stderr: -408> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: _finish_auth 0 2024-03-09T14:42:33.251 INFO:tasks.workunit.client.0.smithi088.stderr: -407> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: _check_auth_tickets 2024-03-09T14:42:33.251 INFO:tasks.workunit.client.0.smithi088.stderr: -406> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:42:33.251 INFO:tasks.workunit.client.0.smithi088.stderr: -405> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.251 INFO:tasks.workunit.client.0.smithi088.stderr: -404> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:42:33.251 INFO:tasks.workunit.client.0.smithi088.stderr: -403> 2024-03-09T14:42:32.679+0000 7fbd1d60a640 10 monclient: dump: 2024-03-09T14:42:33.251 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.251 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.251 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.251 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.251 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.251 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.251 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.252 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.252 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.252 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.252 INFO:tasks.workunit.client.0.smithi088.stderr: -402> 2024-03-09T14:42:32.679+0000 7fbe3328a800 5 monclient: authenticate success, global_id 6608 2024-03-09T14:42:33.252 INFO:tasks.workunit.client.0.smithi088.stderr: -401> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient: _renew_subs 2024-03-09T14:42:33.252 INFO:tasks.workunit.client.0.smithi088.stderr: -400> 2024-03-09T14:42:32.679+0000 7fbd1ee0d640 4 set_mon_vals no callback set 2024-03-09T14:42:33.252 INFO:tasks.workunit.client.0.smithi088.stderr: -399> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.252 INFO:tasks.workunit.client.0.smithi088.stderr: -398> 2024-03-09T14:42:32.679+0000 7fbe3328a800 10 monclient: _renew_subs 2024-03-09T14:42:33.252 INFO:tasks.workunit.client.0.smithi088.stderr: -397> 2024-03-09T14:42:32.680+0000 7fbe3328a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.252 INFO:tasks.workunit.client.0.smithi088.stderr: -396> 2024-03-09T14:42:32.680+0000 7fbe3328a800 1 librados: init done 2024-03-09T14:42:33.252 INFO:tasks.workunit.client.0.smithi088.stderr: -395> 2024-03-09T14:42:32.681+0000 7fbd1d60a640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:42:33.252 INFO:tasks.workunit.client.0.smithi088.stderr: -394> 2024-03-09T14:42:32.681+0000 7fbd1d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:42:33.252 INFO:tasks.workunit.client.0.smithi088.stderr: -393> 2024-03-09T14:42:32.681+0000 7fbd1d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:42:33.252 INFO:tasks.workunit.client.0.smithi088.stderr: -392> 2024-03-09T14:42:32.681+0000 7fbe30d86640 10 monclient: get_auth_request con 0x7fbd1806a5b0 auth_method 0 2024-03-09T14:42:33.252 INFO:tasks.workunit.client.0.smithi088.stderr: -391> 2024-03-09T14:42:32.681+0000 7fbe31587640 10 monclient: get_auth_request con 0x564c4a0d28a0 auth_method 0 2024-03-09T14:42:33.253 INFO:tasks.workunit.client.0.smithi088.stderr: -390> 2024-03-09T14:42:32.682+0000 7fbe30d86640 10 monclient: get_auth_request con 0x564c4a0f3190 auth_method 0 2024-03-09T14:42:33.253 INFO:tasks.workunit.client.0.smithi088.stderr: -389> 2024-03-09T14:42:32.683+0000 7fbe30585640 10 monclient: get_auth_request con 0x564c4a0f7380 auth_method 0 2024-03-09T14:42:33.253 INFO:tasks.workunit.client.0.smithi088.stderr: -388> 2024-03-09T14:42:32.684+0000 7fbe31587640 10 monclient: get_auth_request con 0x564c4a0f6a10 auth_method 0 2024-03-09T14:42:33.253 INFO:tasks.workunit.client.0.smithi088.stderr: -387> 2024-03-09T14:42:32.685+0000 7fbe3328a800 10 monclient: build_initial_monmap 2024-03-09T14:42:33.253 INFO:tasks.workunit.client.0.smithi088.stderr: -386> 2024-03-09T14:42:32.685+0000 7fbe3328a800 1 build_initial for_mkfs: 0 2024-03-09T14:42:33.253 INFO:tasks.workunit.client.0.smithi088.stderr: -385> 2024-03-09T14:42:32.685+0000 7fbe3328a800 10 monclient: monmap: 2024-03-09T14:42:33.253 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:42:33.253 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:42:33.253 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:42:33.253 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:42:33.253 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:42:33.253 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.253 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:42:33.253 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:42:33.253 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:42:33.254 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.254 INFO:tasks.workunit.client.0.smithi088.stderr: -384> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding auth protocol: cephx 2024-03-09T14:42:33.254 INFO:tasks.workunit.client.0.smithi088.stderr: -383> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding auth protocol: cephx 2024-03-09T14:42:33.254 INFO:tasks.workunit.client.0.smithi088.stderr: -382> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding auth protocol: cephx 2024-03-09T14:42:33.254 INFO:tasks.workunit.client.0.smithi088.stderr: -381> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: secure 2024-03-09T14:42:33.254 INFO:tasks.workunit.client.0.smithi088.stderr: -380> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: crc 2024-03-09T14:42:33.254 INFO:tasks.workunit.client.0.smithi088.stderr: -379> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: secure 2024-03-09T14:42:33.254 INFO:tasks.workunit.client.0.smithi088.stderr: -378> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: crc 2024-03-09T14:42:33.254 INFO:tasks.workunit.client.0.smithi088.stderr: -377> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: secure 2024-03-09T14:42:33.254 INFO:tasks.workunit.client.0.smithi088.stderr: -376> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: crc 2024-03-09T14:42:33.254 INFO:tasks.workunit.client.0.smithi088.stderr: -375> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: crc 2024-03-09T14:42:33.254 INFO:tasks.workunit.client.0.smithi088.stderr: -374> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: secure 2024-03-09T14:42:33.254 INFO:tasks.workunit.client.0.smithi088.stderr: -373> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: crc 2024-03-09T14:42:33.254 INFO:tasks.workunit.client.0.smithi088.stderr: -372> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: secure 2024-03-09T14:42:33.254 INFO:tasks.workunit.client.0.smithi088.stderr: -371> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: crc 2024-03-09T14:42:33.255 INFO:tasks.workunit.client.0.smithi088.stderr: -370> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0ff350) adding con mode: secure 2024-03-09T14:42:33.255 INFO:tasks.workunit.client.0.smithi088.stderr: -369> 2024-03-09T14:42:32.685+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.255 INFO:tasks.workunit.client.0.smithi088.stderr: -368> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command objecter_requests cmddesc objecter_requests hook 0x564c4a104a80 EEXIST 2024-03-09T14:42:33.255 INFO:tasks.workunit.client.0.smithi088.stderr: -367> 2024-03-09T14:42:32.685+0000 7fbe3328a800 10 monclient: init 2024-03-09T14:42:33.255 INFO:tasks.workunit.client.0.smithi088.stderr: -366> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding auth protocol: cephx 2024-03-09T14:42:33.255 INFO:tasks.workunit.client.0.smithi088.stderr: -365> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding auth protocol: cephx 2024-03-09T14:42:33.255 INFO:tasks.workunit.client.0.smithi088.stderr: -364> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding auth protocol: cephx 2024-03-09T14:42:33.255 INFO:tasks.workunit.client.0.smithi088.stderr: -363> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: secure 2024-03-09T14:42:33.255 INFO:tasks.workunit.client.0.smithi088.stderr: -362> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: crc 2024-03-09T14:42:33.255 INFO:tasks.workunit.client.0.smithi088.stderr: -361> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: secure 2024-03-09T14:42:33.255 INFO:tasks.workunit.client.0.smithi088.stderr: -360> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: crc 2024-03-09T14:42:33.255 INFO:tasks.workunit.client.0.smithi088.stderr: -359> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: secure 2024-03-09T14:42:33.255 INFO:tasks.workunit.client.0.smithi088.stderr: -358> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: crc 2024-03-09T14:42:33.255 INFO:tasks.workunit.client.0.smithi088.stderr: -357> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: crc 2024-03-09T14:42:33.255 INFO:tasks.workunit.client.0.smithi088.stderr: -356> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: secure 2024-03-09T14:42:33.256 INFO:tasks.workunit.client.0.smithi088.stderr: -355> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: crc 2024-03-09T14:42:33.256 INFO:tasks.workunit.client.0.smithi088.stderr: -354> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: secure 2024-03-09T14:42:33.256 INFO:tasks.workunit.client.0.smithi088.stderr: -353> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: crc 2024-03-09T14:42:33.256 INFO:tasks.workunit.client.0.smithi088.stderr: -352> 2024-03-09T14:42:32.685+0000 7fbe3328a800 5 AuthRegistry(0x564c4a0fe298) adding con mode: secure 2024-03-09T14:42:33.256 INFO:tasks.workunit.client.0.smithi088.stderr: -351> 2024-03-09T14:42:32.686+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.256 INFO:tasks.workunit.client.0.smithi088.stderr: -350> 2024-03-09T14:42:32.686+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.256 INFO:tasks.workunit.client.0.smithi088.stderr: -349> 2024-03-09T14:42:32.686+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command rotate-key cmddesc rotate-key hook 0x564c4a0fe3e0 EEXIST 2024-03-09T14:42:33.256 INFO:tasks.workunit.client.0.smithi088.stderr: -348> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient: _reopen_session rank -1 2024-03-09T14:42:33.256 INFO:tasks.workunit.client.0.smithi088.stderr: -347> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient: _add_conns ranks=[0,2,1] 2024-03-09T14:42:33.256 INFO:tasks.workunit.client.0.smithi088.stderr: -346> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-a con 0x564c4a1297e0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:42:33.256 INFO:tasks.workunit.client.0.smithi088.stderr: -345> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-c con 0x564c4a129bc0 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:42:33.256 INFO:tasks.workunit.client.0.smithi088.stderr: -344> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-b con 0x564c4a124c80 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:42:33.256 INFO:tasks.workunit.client.0.smithi088.stderr: -343> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.256 INFO:tasks.workunit.client.0.smithi088.stderr: -342> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.256 INFO:tasks.workunit.client.0.smithi088.stderr: -341> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -340> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): _renew_subs 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -339> 2024-03-09T14:42:32.686+0000 7fbe3328a800 10 monclient(hunting): authenticate will time out at 1768.023613s 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -338> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): get_auth_request con 0x564c4a129bc0 auth_method 0 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -337> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -336> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -335> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -334> 2024-03-09T14:42:32.686+0000 7fbe30585640 10 monclient(hunting): get_auth_request con 0x564c4a1297e0 auth_method 0 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -333> 2024-03-09T14:42:32.686+0000 7fbe30585640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -332> 2024-03-09T14:42:32.686+0000 7fbe30585640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -331> 2024-03-09T14:42:32.686+0000 7fbe30585640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -330> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -329> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -328> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -327> 2024-03-09T14:42:32.686+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -326> 2024-03-09T14:42:32.686+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.257 INFO:tasks.workunit.client.0.smithi088.stderr: -325> 2024-03-09T14:42:32.686+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.258 INFO:tasks.workunit.client.0.smithi088.stderr: -324> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient(hunting): handle_auth_done global_id 6611 payload 824 2024-03-09T14:42:33.258 INFO:tasks.workunit.client.0.smithi088.stderr: -323> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient: _finish_hunting 0 2024-03-09T14:42:33.258 INFO:tasks.workunit.client.0.smithi088.stderr: -322> 2024-03-09T14:42:32.686+0000 7fbe31587640 1 monclient: found mon.noname-c 2024-03-09T14:42:33.258 INFO:tasks.workunit.client.0.smithi088.stderr: -321> 2024-03-09T14:42:32.686+0000 7fbe31587640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.258 INFO:tasks.workunit.client.0.smithi088.stderr: -320> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.258 INFO:tasks.workunit.client.0.smithi088.stderr: -319> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:42:33.258 INFO:tasks.workunit.client.0.smithi088.stderr: -318> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: dump: 2024-03-09T14:42:33.258 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.258 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.258 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.258 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.258 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.258 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.258 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.259 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.259 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.259 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.259 INFO:tasks.workunit.client.0.smithi088.stderr: -317> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: _finish_auth 0 2024-03-09T14:42:33.259 INFO:tasks.workunit.client.0.smithi088.stderr: -316> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: _check_auth_tickets 2024-03-09T14:42:33.259 INFO:tasks.workunit.client.0.smithi088.stderr: -315> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:42:33.259 INFO:tasks.workunit.client.0.smithi088.stderr: -314> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.259 INFO:tasks.workunit.client.0.smithi088.stderr: -313> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:42:33.259 INFO:tasks.workunit.client.0.smithi088.stderr: -312> 2024-03-09T14:42:32.686+0000 7fbd167fc640 10 monclient: dump: 2024-03-09T14:42:33.259 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.259 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.259 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.259 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.259 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.259 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.260 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.260 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.260 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.260 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.260 INFO:tasks.workunit.client.0.smithi088.stderr: -311> 2024-03-09T14:42:32.686+0000 7fbe31d88640 4 set_mon_vals no callback set 2024-03-09T14:42:33.260 INFO:tasks.workunit.client.0.smithi088.stderr: -310> 2024-03-09T14:42:32.686+0000 7fbe3328a800 5 monclient: authenticate success, global_id 6611 2024-03-09T14:42:33.260 INFO:tasks.workunit.client.0.smithi088.stderr: -309> 2024-03-09T14:42:32.687+0000 7fbe3328a800 10 monclient: _renew_subs 2024-03-09T14:42:33.260 INFO:tasks.workunit.client.0.smithi088.stderr: -308> 2024-03-09T14:42:32.687+0000 7fbe3328a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.260 INFO:tasks.workunit.client.0.smithi088.stderr: -307> 2024-03-09T14:42:32.687+0000 7fbe3328a800 10 monclient: _renew_subs 2024-03-09T14:42:33.260 INFO:tasks.workunit.client.0.smithi088.stderr: -306> 2024-03-09T14:42:32.687+0000 7fbe3328a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.260 INFO:tasks.workunit.client.0.smithi088.stderr: -305> 2024-03-09T14:42:32.688+0000 7fbd167fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:42:33.260 INFO:tasks.workunit.client.0.smithi088.stderr: -304> 2024-03-09T14:42:32.688+0000 7fbd167fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:42:33.260 INFO:tasks.workunit.client.0.smithi088.stderr: -303> 2024-03-09T14:42:32.688+0000 7fbd167fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:42:33.260 INFO:tasks.workunit.client.0.smithi088.stderr: -302> 2024-03-09T14:42:32.688+0000 7fbe3328a800 10 monclient: get_monmap_and_config 2024-03-09T14:42:33.260 INFO:tasks.workunit.client.0.smithi088.stderr: -301> 2024-03-09T14:42:32.688+0000 7fbe3328a800 10 monclient: build_initial_monmap 2024-03-09T14:42:33.261 INFO:tasks.workunit.client.0.smithi088.stderr: -300> 2024-03-09T14:42:32.688+0000 7fbe3328a800 1 build_initial for_mkfs: 0 2024-03-09T14:42:33.261 INFO:tasks.workunit.client.0.smithi088.stderr: -299> 2024-03-09T14:42:32.688+0000 7fbe30585640 10 monclient: get_auth_request con 0x7fbd0806a4c0 auth_method 0 2024-03-09T14:42:33.261 INFO:tasks.workunit.client.0.smithi088.stderr: -298> 2024-03-09T14:42:32.688+0000 7fbe3328a800 10 monclient: monmap: 2024-03-09T14:42:33.261 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:42:33.261 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:42:33.261 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:42:33.261 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:42:33.261 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:42:33.261 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.261 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:42:33.261 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:42:33.261 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:42:33.261 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.261 INFO:tasks.workunit.client.0.smithi088.stderr: -297> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding auth protocol: cephx 2024-03-09T14:42:33.261 INFO:tasks.workunit.client.0.smithi088.stderr: -296> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding auth protocol: cephx 2024-03-09T14:42:33.262 INFO:tasks.workunit.client.0.smithi088.stderr: -295> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding auth protocol: cephx 2024-03-09T14:42:33.262 INFO:tasks.workunit.client.0.smithi088.stderr: -294> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: secure 2024-03-09T14:42:33.262 INFO:tasks.workunit.client.0.smithi088.stderr: -293> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: crc 2024-03-09T14:42:33.262 INFO:tasks.workunit.client.0.smithi088.stderr: -292> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: secure 2024-03-09T14:42:33.262 INFO:tasks.workunit.client.0.smithi088.stderr: -291> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: crc 2024-03-09T14:42:33.262 INFO:tasks.workunit.client.0.smithi088.stderr: -290> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: secure 2024-03-09T14:42:33.262 INFO:tasks.workunit.client.0.smithi088.stderr: -289> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: crc 2024-03-09T14:42:33.262 INFO:tasks.workunit.client.0.smithi088.stderr: -288> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: crc 2024-03-09T14:42:33.262 INFO:tasks.workunit.client.0.smithi088.stderr: -287> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: secure 2024-03-09T14:42:33.262 INFO:tasks.workunit.client.0.smithi088.stderr: -286> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: crc 2024-03-09T14:42:33.262 INFO:tasks.workunit.client.0.smithi088.stderr: -285> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: secure 2024-03-09T14:42:33.262 INFO:tasks.workunit.client.0.smithi088.stderr: -284> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: crc 2024-03-09T14:42:33.262 INFO:tasks.workunit.client.0.smithi088.stderr: -283> 2024-03-09T14:42:32.688+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147380) adding con mode: secure 2024-03-09T14:42:33.262 INFO:tasks.workunit.client.0.smithi088.stderr: -282> 2024-03-09T14:42:32.689+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.262 INFO:tasks.workunit.client.0.smithi088.stderr: -281> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient: init 2024-03-09T14:42:33.263 INFO:tasks.workunit.client.0.smithi088.stderr: -280> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding auth protocol: cephx 2024-03-09T14:42:33.263 INFO:tasks.workunit.client.0.smithi088.stderr: -279> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding auth protocol: cephx 2024-03-09T14:42:33.263 INFO:tasks.workunit.client.0.smithi088.stderr: -278> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding auth protocol: cephx 2024-03-09T14:42:33.263 INFO:tasks.workunit.client.0.smithi088.stderr: -277> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: secure 2024-03-09T14:42:33.263 INFO:tasks.workunit.client.0.smithi088.stderr: -276> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: crc 2024-03-09T14:42:33.263 INFO:tasks.workunit.client.0.smithi088.stderr: -275> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: secure 2024-03-09T14:42:33.263 INFO:tasks.workunit.client.0.smithi088.stderr: -274> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: crc 2024-03-09T14:42:33.263 INFO:tasks.workunit.client.0.smithi088.stderr: -273> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: secure 2024-03-09T14:42:33.263 INFO:tasks.workunit.client.0.smithi088.stderr: -272> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: crc 2024-03-09T14:42:33.263 INFO:tasks.workunit.client.0.smithi088.stderr: -271> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: crc 2024-03-09T14:42:33.263 INFO:tasks.workunit.client.0.smithi088.stderr: -270> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: secure 2024-03-09T14:42:33.263 INFO:tasks.workunit.client.0.smithi088.stderr: -269> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: crc 2024-03-09T14:42:33.263 INFO:tasks.workunit.client.0.smithi088.stderr: -268> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: secure 2024-03-09T14:42:33.263 INFO:tasks.workunit.client.0.smithi088.stderr: -267> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: crc 2024-03-09T14:42:33.263 INFO:tasks.workunit.client.0.smithi088.stderr: -266> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea5d70) adding con mode: secure 2024-03-09T14:42:33.264 INFO:tasks.workunit.client.0.smithi088.stderr: -265> 2024-03-09T14:42:32.689+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.264 INFO:tasks.workunit.client.0.smithi088.stderr: -264> 2024-03-09T14:42:32.689+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.264 INFO:tasks.workunit.client.0.smithi088.stderr: -263> 2024-03-09T14:42:32.689+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command rotate-key cmddesc rotate-key hook 0x7ffd9dea5eb8 EEXIST 2024-03-09T14:42:33.264 INFO:tasks.workunit.client.0.smithi088.stderr: -262> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient: _reopen_session rank -1 2024-03-09T14:42:33.264 INFO:tasks.workunit.client.0.smithi088.stderr: -261> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:42:33.264 INFO:tasks.workunit.client.0.smithi088.stderr: -260> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-b con 0x564c4a17bcf0 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:42:33.264 INFO:tasks.workunit.client.0.smithi088.stderr: -259> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-a con 0x564c4a17c0d0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:42:33.264 INFO:tasks.workunit.client.0.smithi088.stderr: -258> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-c con 0x564c4a181880 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:42:33.264 INFO:tasks.workunit.client.0.smithi088.stderr: -257> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.264 INFO:tasks.workunit.client.0.smithi088.stderr: -256> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.264 INFO:tasks.workunit.client.0.smithi088.stderr: -255> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.264 INFO:tasks.workunit.client.0.smithi088.stderr: -254> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): _renew_subs 2024-03-09T14:42:33.264 INFO:tasks.workunit.client.0.smithi088.stderr: -253> 2024-03-09T14:42:32.689+0000 7fbe3328a800 10 monclient(hunting): authenticate will time out at 1768.026953s 2024-03-09T14:42:33.264 INFO:tasks.workunit.client.0.smithi088.stderr: -252> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): get_auth_request con 0x564c4a181880 auth_method 0 2024-03-09T14:42:33.264 INFO:tasks.workunit.client.0.smithi088.stderr: -251> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.265 INFO:tasks.workunit.client.0.smithi088.stderr: -250> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.265 INFO:tasks.workunit.client.0.smithi088.stderr: -249> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.265 INFO:tasks.workunit.client.0.smithi088.stderr: -248> 2024-03-09T14:42:32.689+0000 7fbe31587640 10 monclient(hunting): get_auth_request con 0x564c4a17c0d0 auth_method 0 2024-03-09T14:42:33.265 INFO:tasks.workunit.client.0.smithi088.stderr: -247> 2024-03-09T14:42:32.689+0000 7fbe31587640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.265 INFO:tasks.workunit.client.0.smithi088.stderr: -246> 2024-03-09T14:42:32.689+0000 7fbe31587640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.265 INFO:tasks.workunit.client.0.smithi088.stderr: -245> 2024-03-09T14:42:32.689+0000 7fbe31587640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.265 INFO:tasks.workunit.client.0.smithi088.stderr: -244> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.265 INFO:tasks.workunit.client.0.smithi088.stderr: -243> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.265 INFO:tasks.workunit.client.0.smithi088.stderr: -242> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.265 INFO:tasks.workunit.client.0.smithi088.stderr: -241> 2024-03-09T14:42:32.689+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.265 INFO:tasks.workunit.client.0.smithi088.stderr: -240> 2024-03-09T14:42:32.689+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.265 INFO:tasks.workunit.client.0.smithi088.stderr: -239> 2024-03-09T14:42:32.689+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.265 INFO:tasks.workunit.client.0.smithi088.stderr: -238> 2024-03-09T14:42:32.689+0000 7fbe30585640 10 monclient(hunting): get_auth_request con 0x564c4a17bcf0 auth_method 0 2024-03-09T14:42:33.265 INFO:tasks.workunit.client.0.smithi088.stderr: -237> 2024-03-09T14:42:32.689+0000 7fbe30585640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.265 INFO:tasks.workunit.client.0.smithi088.stderr: -236> 2024-03-09T14:42:32.689+0000 7fbe30585640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.266 INFO:tasks.workunit.client.0.smithi088.stderr: -235> 2024-03-09T14:42:32.689+0000 7fbe30585640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.266 INFO:tasks.workunit.client.0.smithi088.stderr: -234> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient(hunting): handle_auth_done global_id 6614 payload 274 2024-03-09T14:42:33.266 INFO:tasks.workunit.client.0.smithi088.stderr: -233> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient: _finish_hunting 0 2024-03-09T14:42:33.266 INFO:tasks.workunit.client.0.smithi088.stderr: -232> 2024-03-09T14:42:32.689+0000 7fbe30d86640 1 monclient: found mon.noname-c 2024-03-09T14:42:33.266 INFO:tasks.workunit.client.0.smithi088.stderr: -231> 2024-03-09T14:42:32.689+0000 7fbe30d86640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.266 INFO:tasks.workunit.client.0.smithi088.stderr: -230> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.266 INFO:tasks.workunit.client.0.smithi088.stderr: -229> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:42:33.266 INFO:tasks.workunit.client.0.smithi088.stderr: -228> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: dump: 2024-03-09T14:42:33.266 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.266 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.267 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.267 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.267 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.267 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.267 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.267 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.267 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.267 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.267 INFO:tasks.workunit.client.0.smithi088.stderr: -227> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: _finish_auth 0 2024-03-09T14:42:33.267 INFO:tasks.workunit.client.0.smithi088.stderr: -226> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: _check_auth_tickets 2024-03-09T14:42:33.267 INFO:tasks.workunit.client.0.smithi088.stderr: -225> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:42:33.267 INFO:tasks.workunit.client.0.smithi088.stderr: -224> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.267 INFO:tasks.workunit.client.0.smithi088.stderr: -223> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:42:33.267 INFO:tasks.workunit.client.0.smithi088.stderr: -222> 2024-03-09T14:42:32.690+0000 7fbd07fff640 10 monclient: dump: 2024-03-09T14:42:33.267 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.268 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.268 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.268 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.268 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.268 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.268 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.268 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.268 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.268 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.268 INFO:tasks.workunit.client.0.smithi088.stderr: -221> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 monclient: authenticate success, global_id 6614 2024-03-09T14:42:33.268 INFO:tasks.workunit.client.0.smithi088.stderr: -220> 2024-03-09T14:42:32.690+0000 7fbe3328a800 10 monclient: get_monmap_and_config success 2024-03-09T14:42:33.268 INFO:tasks.workunit.client.0.smithi088.stderr: -219> 2024-03-09T14:42:32.690+0000 7fbe3328a800 4 set_mon_vals no callback set 2024-03-09T14:42:33.268 INFO:tasks.workunit.client.0.smithi088.stderr: -218> 2024-03-09T14:42:32.690+0000 7fbe3328a800 10 monclient: shutdown 2024-03-09T14:42:33.268 INFO:tasks.workunit.client.0.smithi088.stderr: -217> 2024-03-09T14:42:32.690+0000 7fbe3328a800 10 monclient: build_initial_monmap 2024-03-09T14:42:33.269 INFO:tasks.workunit.client.0.smithi088.stderr: -216> 2024-03-09T14:42:32.690+0000 7fbe3328a800 1 build_initial for_mkfs: 0 2024-03-09T14:42:33.269 INFO:tasks.workunit.client.0.smithi088.stderr: -215> 2024-03-09T14:42:32.690+0000 7fbe3328a800 10 monclient: monmap: 2024-03-09T14:42:33.269 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 0 2024-03-09T14:42:33.269 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:42:33.269 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 0.000000 2024-03-09T14:42:33.269 INFO:tasks.workunit.client.0.smithi088.stderr:created 0.000000 2024-03-09T14:42:33.269 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 0 (unknown) 2024-03-09T14:42:33.269 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.269 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.noname-a 2024-03-09T14:42:33.269 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.noname-b 2024-03-09T14:42:33.269 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.noname-c 2024-03-09T14:42:33.269 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.269 INFO:tasks.workunit.client.0.smithi088.stderr: -214> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding auth protocol: cephx 2024-03-09T14:42:33.269 INFO:tasks.workunit.client.0.smithi088.stderr: -213> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding auth protocol: cephx 2024-03-09T14:42:33.269 INFO:tasks.workunit.client.0.smithi088.stderr: -212> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding auth protocol: cephx 2024-03-09T14:42:33.270 INFO:tasks.workunit.client.0.smithi088.stderr: -211> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: secure 2024-03-09T14:42:33.270 INFO:tasks.workunit.client.0.smithi088.stderr: -210> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: crc 2024-03-09T14:42:33.270 INFO:tasks.workunit.client.0.smithi088.stderr: -209> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: secure 2024-03-09T14:42:33.270 INFO:tasks.workunit.client.0.smithi088.stderr: -208> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: crc 2024-03-09T14:42:33.270 INFO:tasks.workunit.client.0.smithi088.stderr: -207> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: secure 2024-03-09T14:42:33.270 INFO:tasks.workunit.client.0.smithi088.stderr: -206> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: crc 2024-03-09T14:42:33.270 INFO:tasks.workunit.client.0.smithi088.stderr: -205> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: crc 2024-03-09T14:42:33.270 INFO:tasks.workunit.client.0.smithi088.stderr: -204> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: secure 2024-03-09T14:42:33.270 INFO:tasks.workunit.client.0.smithi088.stderr: -203> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: crc 2024-03-09T14:42:33.270 INFO:tasks.workunit.client.0.smithi088.stderr: -202> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: secure 2024-03-09T14:42:33.270 INFO:tasks.workunit.client.0.smithi088.stderr: -201> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: crc 2024-03-09T14:42:33.270 INFO:tasks.workunit.client.0.smithi088.stderr: -200> 2024-03-09T14:42:32.690+0000 7fbe3328a800 5 AuthRegistry(0x564c4a147330) adding con mode: secure 2024-03-09T14:42:33.270 INFO:tasks.workunit.client.0.smithi088.stderr: -199> 2024-03-09T14:42:32.691+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.270 INFO:tasks.workunit.client.0.smithi088.stderr: -198> 2024-03-09T14:42:32.691+0000 7fbe3328a800 1 librados: starting msgr at 2024-03-09T14:42:33.270 INFO:tasks.workunit.client.0.smithi088.stderr: -197> 2024-03-09T14:42:32.691+0000 7fbe3328a800 1 librados: starting objecter 2024-03-09T14:42:33.271 INFO:tasks.workunit.client.0.smithi088.stderr: -196> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command objecter_requests cmddesc objecter_requests hook 0x564c4a0ea210 EEXIST 2024-03-09T14:42:33.271 INFO:tasks.workunit.client.0.smithi088.stderr: -195> 2024-03-09T14:42:32.691+0000 7fbe3328a800 1 librados: setting wanted keys 2024-03-09T14:42:33.271 INFO:tasks.workunit.client.0.smithi088.stderr: -194> 2024-03-09T14:42:32.691+0000 7fbe3328a800 1 librados: calling monclient init 2024-03-09T14:42:33.271 INFO:tasks.workunit.client.0.smithi088.stderr: -193> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient: init 2024-03-09T14:42:33.271 INFO:tasks.workunit.client.0.smithi088.stderr: -192> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding auth protocol: cephx 2024-03-09T14:42:33.271 INFO:tasks.workunit.client.0.smithi088.stderr: -191> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding auth protocol: cephx 2024-03-09T14:42:33.271 INFO:tasks.workunit.client.0.smithi088.stderr: -190> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding auth protocol: cephx 2024-03-09T14:42:33.271 INFO:tasks.workunit.client.0.smithi088.stderr: -189> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: secure 2024-03-09T14:42:33.271 INFO:tasks.workunit.client.0.smithi088.stderr: -188> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: crc 2024-03-09T14:42:33.271 INFO:tasks.workunit.client.0.smithi088.stderr: -187> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: secure 2024-03-09T14:42:33.271 INFO:tasks.workunit.client.0.smithi088.stderr: -186> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: crc 2024-03-09T14:42:33.271 INFO:tasks.workunit.client.0.smithi088.stderr: -185> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: secure 2024-03-09T14:42:33.271 INFO:tasks.workunit.client.0.smithi088.stderr: -184> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: crc 2024-03-09T14:42:33.271 INFO:tasks.workunit.client.0.smithi088.stderr: -183> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: crc 2024-03-09T14:42:33.272 INFO:tasks.workunit.client.0.smithi088.stderr: -182> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: secure 2024-03-09T14:42:33.272 INFO:tasks.workunit.client.0.smithi088.stderr: -181> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: crc 2024-03-09T14:42:33.272 INFO:tasks.workunit.client.0.smithi088.stderr: -180> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: secure 2024-03-09T14:42:33.272 INFO:tasks.workunit.client.0.smithi088.stderr: -179> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: crc 2024-03-09T14:42:33.272 INFO:tasks.workunit.client.0.smithi088.stderr: -178> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 AuthRegistry(0x564c4a146500) adding con mode: secure 2024-03-09T14:42:33.272 INFO:tasks.workunit.client.0.smithi088.stderr: -177> 2024-03-09T14:42:32.691+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.272 INFO:tasks.workunit.client.0.smithi088.stderr: -176> 2024-03-09T14:42:32.691+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.272 INFO:tasks.workunit.client.0.smithi088.stderr: -175> 2024-03-09T14:42:32.691+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command rotate-key cmddesc rotate-key hook 0x564c4a146648 EEXIST 2024-03-09T14:42:33.272 INFO:tasks.workunit.client.0.smithi088.stderr: -174> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient: _reopen_session rank -1 2024-03-09T14:42:33.272 INFO:tasks.workunit.client.0.smithi088.stderr: -173> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:42:33.272 INFO:tasks.workunit.client.0.smithi088.stderr: -172> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-b con 0x564c4a17bcf0 addr [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-03-09T14:42:33.272 INFO:tasks.workunit.client.0.smithi088.stderr: -171> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-c con 0x564c4a181880 addr [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-03-09T14:42:33.272 INFO:tasks.workunit.client.0.smithi088.stderr: -170> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): picked mon.noname-a con 0x564c4a1751e0 addr [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] 2024-03-09T14:42:33.272 INFO:tasks.workunit.client.0.smithi088.stderr: -169> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.273 INFO:tasks.workunit.client.0.smithi088.stderr: -168> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.273 INFO:tasks.workunit.client.0.smithi088.stderr: -167> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): start opening mon connection 2024-03-09T14:42:33.273 INFO:tasks.workunit.client.0.smithi088.stderr: -166> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): _renew_subs 2024-03-09T14:42:33.273 INFO:tasks.workunit.client.0.smithi088.stderr: -165> 2024-03-09T14:42:32.691+0000 7fbe3328a800 10 monclient(hunting): authenticate will time out at 1768.029137s 2024-03-09T14:42:33.273 INFO:tasks.workunit.client.0.smithi088.stderr: -164> 2024-03-09T14:42:32.691+0000 7fbe30d86640 10 monclient(hunting): get_auth_request con 0x564c4a1751e0 auth_method 0 2024-03-09T14:42:33.273 INFO:tasks.workunit.client.0.smithi088.stderr: -163> 2024-03-09T14:42:32.691+0000 7fbe30d86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.273 INFO:tasks.workunit.client.0.smithi088.stderr: -162> 2024-03-09T14:42:32.691+0000 7fbe30d86640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.273 INFO:tasks.workunit.client.0.smithi088.stderr: -161> 2024-03-09T14:42:32.691+0000 7fbe30d86640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.273 INFO:tasks.workunit.client.0.smithi088.stderr: -160> 2024-03-09T14:42:32.691+0000 7fbe31587640 10 monclient(hunting): get_auth_request con 0x564c4a181880 auth_method 0 2024-03-09T14:42:33.273 INFO:tasks.workunit.client.0.smithi088.stderr: -159> 2024-03-09T14:42:32.691+0000 7fbe31587640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.273 INFO:tasks.workunit.client.0.smithi088.stderr: -158> 2024-03-09T14:42:32.691+0000 7fbe31587640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.273 INFO:tasks.workunit.client.0.smithi088.stderr: -157> 2024-03-09T14:42:32.691+0000 7fbe31587640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.273 INFO:tasks.workunit.client.0.smithi088.stderr: -156> 2024-03-09T14:42:32.692+0000 7fbe30d86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.273 INFO:tasks.workunit.client.0.smithi088.stderr: -155> 2024-03-09T14:42:32.692+0000 7fbe30d86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.274 INFO:tasks.workunit.client.0.smithi088.stderr: -154> 2024-03-09T14:42:32.692+0000 7fbe30d86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.274 INFO:tasks.workunit.client.0.smithi088.stderr: -153> 2024-03-09T14:42:32.692+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.274 INFO:tasks.workunit.client.0.smithi088.stderr: -152> 2024-03-09T14:42:32.692+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.274 INFO:tasks.workunit.client.0.smithi088.stderr: -151> 2024-03-09T14:42:32.692+0000 7fbe31587640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.274 INFO:tasks.workunit.client.0.smithi088.stderr: -150> 2024-03-09T14:42:32.692+0000 7fbe30585640 10 monclient(hunting): get_auth_request con 0x564c4a17bcf0 auth_method 0 2024-03-09T14:42:33.274 INFO:tasks.workunit.client.0.smithi088.stderr: -149> 2024-03-09T14:42:32.692+0000 7fbe30585640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:42:33.274 INFO:tasks.workunit.client.0.smithi088.stderr: -148> 2024-03-09T14:42:32.692+0000 7fbe30585640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:42:33.274 INFO:tasks.workunit.client.0.smithi088.stderr: -147> 2024-03-09T14:42:32.692+0000 7fbe30585640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:42:33.274 INFO:tasks.workunit.client.0.smithi088.stderr: -146> 2024-03-09T14:42:32.692+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:42:33.274 INFO:tasks.workunit.client.0.smithi088.stderr: -145> 2024-03-09T14:42:32.692+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:42:33.274 INFO:tasks.workunit.client.0.smithi088.stderr: -144> 2024-03-09T14:42:32.692+0000 7fbe30585640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:42:33.274 INFO:tasks.workunit.client.0.smithi088.stderr: -143> 2024-03-09T14:42:32.692+0000 7fbe31587640 10 monclient(hunting): handle_auth_done global_id 6617 payload 824 2024-03-09T14:42:33.274 INFO:tasks.workunit.client.0.smithi088.stderr: -142> 2024-03-09T14:42:32.692+0000 7fbe31587640 10 monclient: _finish_hunting 0 2024-03-09T14:42:33.274 INFO:tasks.workunit.client.0.smithi088.stderr: -141> 2024-03-09T14:42:32.692+0000 7fbe31587640 1 monclient: found mon.noname-c 2024-03-09T14:42:33.275 INFO:tasks.workunit.client.0.smithi088.stderr: -140> 2024-03-09T14:42:32.692+0000 7fbe31587640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.275 INFO:tasks.workunit.client.0.smithi088.stderr: -139> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.275 INFO:tasks.workunit.client.0.smithi088.stderr: -138> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:42:33.275 INFO:tasks.workunit.client.0.smithi088.stderr: -137> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: dump: 2024-03-09T14:42:33.275 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.275 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.275 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.275 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.275 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.275 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.275 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.275 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.275 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.275 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.275 INFO:tasks.workunit.client.0.smithi088.stderr: -136> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: _finish_auth 0 2024-03-09T14:42:33.276 INFO:tasks.workunit.client.0.smithi088.stderr: -135> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: _check_auth_tickets 2024-03-09T14:42:33.276 INFO:tasks.workunit.client.0.smithi088.stderr: -134> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:42:33.276 INFO:tasks.workunit.client.0.smithi088.stderr: -133> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:42:33.276 INFO:tasks.workunit.client.0.smithi088.stderr: -132> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:42:33.276 INFO:tasks.workunit.client.0.smithi088.stderr: -131> 2024-03-09T14:42:32.692+0000 7fbd067fc640 10 monclient: dump: 2024-03-09T14:42:33.276 INFO:tasks.workunit.client.0.smithi088.stderr:epoch 1 2024-03-09T14:42:33.276 INFO:tasks.workunit.client.0.smithi088.stderr:fsid 03df7284-17fe-4d16-b21b-e9f66257a07a 2024-03-09T14:42:33.276 INFO:tasks.workunit.client.0.smithi088.stderr:last_changed 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.276 INFO:tasks.workunit.client.0.smithi088.stderr:created 2024-03-09T14:25:19.622780+0000 2024-03-09T14:42:33.276 INFO:tasks.workunit.client.0.smithi088.stderr:min_mon_release 19 (squid) 2024-03-09T14:42:33.276 INFO:tasks.workunit.client.0.smithi088.stderr:election_strategy: 1 2024-03-09T14:42:33.276 INFO:tasks.workunit.client.0.smithi088.stderr:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-03-09T14:42:33.276 INFO:tasks.workunit.client.0.smithi088.stderr:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-03-09T14:42:33.276 INFO:tasks.workunit.client.0.smithi088.stderr:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-03-09T14:42:33.276 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.277 INFO:tasks.workunit.client.0.smithi088.stderr: -130> 2024-03-09T14:42:32.692+0000 7fbe3328a800 5 monclient: authenticate success, global_id 6617 2024-03-09T14:42:33.277 INFO:tasks.workunit.client.0.smithi088.stderr: -129> 2024-03-09T14:42:32.692+0000 7fbd07fff640 4 set_mon_vals no callback set 2024-03-09T14:42:33.277 INFO:tasks.workunit.client.0.smithi088.stderr: -128> 2024-03-09T14:42:32.692+0000 7fbe3328a800 10 monclient: _renew_subs 2024-03-09T14:42:33.277 INFO:tasks.workunit.client.0.smithi088.stderr: -127> 2024-03-09T14:42:32.692+0000 7fbe3328a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.277 INFO:tasks.workunit.client.0.smithi088.stderr: -126> 2024-03-09T14:42:32.692+0000 7fbe3328a800 10 monclient: _renew_subs 2024-03-09T14:42:33.277 INFO:tasks.workunit.client.0.smithi088.stderr: -125> 2024-03-09T14:42:32.692+0000 7fbe3328a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.88:3301/0 2024-03-09T14:42:33.277 INFO:tasks.workunit.client.0.smithi088.stderr: -124> 2024-03-09T14:42:32.692+0000 7fbe3328a800 1 librados: init done 2024-03-09T14:42:33.277 INFO:tasks.workunit.client.0.smithi088.stderr: -123> 2024-03-09T14:42:32.692+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command cr dump hook 0x564c4a1708e8 2024-03-09T14:42:33.277 INFO:tasks.workunit.client.0.smithi088.stderr: -122> 2024-03-09T14:42:32.693+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.277 INFO:tasks.workunit.client.0.smithi088.stderr: -121> 2024-03-09T14:42:32.694+0000 7fbd067fc640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:42:33.277 INFO:tasks.workunit.client.0.smithi088.stderr: -120> 2024-03-09T14:42:32.694+0000 7fbd067fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:42:33.277 INFO:tasks.workunit.client.0.smithi088.stderr: -119> 2024-03-09T14:42:32.694+0000 7fbd067fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.132:6832/3170630856,v1:172.21.15.132:6833/3170630856] 2024-03-09T14:42:33.277 INFO:tasks.workunit.client.0.smithi088.stderr: -118> 2024-03-09T14:42:32.694+0000 7fbe30585640 10 monclient: get_auth_request con 0x7fbcfc06a5e0 auth_method 0 2024-03-09T14:42:33.277 INFO:tasks.workunit.client.0.smithi088.stderr: -117> 2024-03-09T14:42:32.694+0000 7fbe30d86640 10 monclient: get_auth_request con 0x564c4a196880 auth_method 0 2024-03-09T14:42:33.278 INFO:tasks.workunit.client.0.smithi088.stderr: -116> 2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.278 INFO:tasks.workunit.client.0.smithi088.stderr: -115> 2024-03-09T14:42:32.695+0000 7fbe3328a800 20 realm 2024-03-09T14:42:33.278 INFO:tasks.workunit.client.0.smithi088.stderr: -114> 2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.278 INFO:tasks.workunit.client.0.smithi088.stderr: -113> 2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.278 INFO:tasks.workunit.client.0.smithi088.stderr: -112> 2024-03-09T14:42:32.695+0000 7fbe3328a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:42:33.278 INFO:tasks.workunit.client.0.smithi088.stderr: -111> 2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.278 INFO:tasks.workunit.client.0.smithi088.stderr: -110> 2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.278 INFO:tasks.workunit.client.0.smithi088.stderr: -109> 2024-03-09T14:42:32.695+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.278 INFO:tasks.workunit.client.0.smithi088.stderr: -108> 2024-03-09T14:42:32.695+0000 7fbe30585640 10 monclient: get_auth_request con 0x564c4a19aad0 auth_method 0 2024-03-09T14:42:33.278 INFO:tasks.workunit.client.0.smithi088.stderr: -107> 2024-03-09T14:42:32.696+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:33.278 INFO:tasks.workunit.client.0.smithi088.stderr: -106> 2024-03-09T14:42:32.696+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.278 INFO:tasks.workunit.client.0.smithi088.stderr: -105> 2024-03-09T14:42:32.696+0000 7fbe31587640 10 monclient: get_auth_request con 0x564c4a19e310 auth_method 0 2024-03-09T14:42:33.278 INFO:tasks.workunit.client.0.smithi088.stderr: -104> 2024-03-09T14:42:32.697+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:42:33.278 INFO:tasks.workunit.client.0.smithi088.stderr: -103> 2024-03-09T14:42:32.697+0000 7fbe3328a800 20 searching for the correct realm 2024-03-09T14:42:33.278 INFO:tasks.workunit.client.0.smithi088.stderr: -102> 2024-03-09T14:42:32.697+0000 7fbe30d86640 10 monclient: get_auth_request con 0x564c4a1a3080 auth_method 0 2024-03-09T14:42:33.279 INFO:tasks.workunit.client.0.smithi088.stderr: -101> 2024-03-09T14:42:32.697+0000 7fbe30585640 10 monclient: get_auth_request con 0x7fbe2803f040 auth_method 0 2024-03-09T14:42:33.279 INFO:tasks.workunit.client.0.smithi088.stderr: -100> 2024-03-09T14:42:32.698+0000 7fbe31587640 10 monclient: get_auth_request con 0x7fbe2005e040 auth_method 0 2024-03-09T14:42:33.279 INFO:tasks.workunit.client.0.smithi088.stderr: -99> 2024-03-09T14:42:32.699+0000 7fbe31587640 0 -- 172.21.15.88:0/1417449907 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fbe2005e040 msgr2=0x7fbe200552e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:33.279 INFO:tasks.workunit.client.0.smithi088.stderr: -98> 2024-03-09T14:42:32.900+0000 7fbe31587640 10 monclient: get_auth_request con 0x7fbe2005e040 auth_method 0 2024-03-09T14:42:33.279 INFO:tasks.workunit.client.0.smithi088.stderr: -97> 2024-03-09T14:42:32.902+0000 7fbe30d86640 10 monclient: get_auth_request con 0x7fbe200cbbc0 auth_method 0 2024-03-09T14:42:33.279 INFO:tasks.workunit.client.0.smithi088.stderr: -96> 2024-03-09T14:42:32.905+0000 7fbe30585640 10 monclient: get_auth_request con 0x7fbe200d6040 auth_method 0 2024-03-09T14:42:33.279 INFO:tasks.workunit.client.0.smithi088.stderr: -95> 2024-03-09T14:42:32.905+0000 7fbe30585640 0 -- 172.21.15.88:0/1417449907 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fbe200d6040 msgr2=0x7fbe2004c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:33.279 INFO:tasks.workunit.client.0.smithi088.stderr: -94> 2024-03-09T14:42:33.106+0000 7fbe30585640 10 monclient: get_auth_request con 0x7fbe200d6040 auth_method 0 2024-03-09T14:42:33.279 INFO:tasks.workunit.client.0.smithi088.stderr: -93> 2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:42:33.279 INFO:tasks.workunit.client.0.smithi088.stderr: -92> 2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:42:33.279 INFO:tasks.workunit.client.0.smithi088.stderr: -91> 2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:42:33.279 INFO:tasks.workunit.client.0.smithi088.stderr: -90> 2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:42:33.279 INFO:tasks.workunit.client.0.smithi088.stderr: -89> 2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:42:33.279 INFO:tasks.workunit.client.0.smithi088.stderr: -88> 2024-03-09T14:42:33.111+0000 7fbe3328a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:42:33.279 INFO:tasks.workunit.client.0.smithi088.stderr: -87> 2024-03-09T14:42:33.111+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.280 INFO:tasks.workunit.client.0.smithi088.stderr: -86> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.280 INFO:tasks.workunit.client.0.smithi088.stderr: -85> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.280 INFO:tasks.workunit.client.0.smithi088.stderr: -84> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:33.280 INFO:tasks.workunit.client.0.smithi088.stderr: -83> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.280 INFO:tasks.workunit.client.0.smithi088.stderr: -82> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:42:33.280 INFO:tasks.workunit.client.0.smithi088.stderr: -81> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 zone default found 2024-03-09T14:42:33.280 INFO:tasks.workunit.client.0.smithi088.stderr: -80> 2024-03-09T14:42:33.112+0000 7fbe3328a800 4 Realm: () 2024-03-09T14:42:33.280 INFO:tasks.workunit.client.0.smithi088.stderr: -79> 2024-03-09T14:42:33.112+0000 7fbe3328a800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:42:33.280 INFO:tasks.workunit.client.0.smithi088.stderr: -78> 2024-03-09T14:42:33.112+0000 7fbe3328a800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:42:33.280 INFO:tasks.workunit.client.0.smithi088.stderr: -77> 2024-03-09T14:42:33.112+0000 7fbe3328a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:42:33.280 INFO:tasks.workunit.client.0.smithi088.stderr: -76> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 zonegroup default 2024-03-09T14:42:33.280 INFO:tasks.workunit.client.0.smithi088.stderr: -75> 2024-03-09T14:42:33.112+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.280 INFO:tasks.workunit.client.0.smithi088.stderr: -74> 2024-03-09T14:42:33.113+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.280 INFO:tasks.workunit.client.0.smithi088.stderr: -73> 2024-03-09T14:42:33.113+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.280 INFO:tasks.workunit.client.0.smithi088.stderr: -72> 2024-03-09T14:42:33.113+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.281 INFO:tasks.workunit.client.0.smithi088.stderr: -71> 2024-03-09T14:42:33.113+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.281 INFO:tasks.workunit.client.0.smithi088.stderr: -70> 2024-03-09T14:42:33.113+0000 7fbe3328a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.281 INFO:tasks.workunit.client.0.smithi088.stderr: -69> 2024-03-09T14:42:33.113+0000 7fbe3328a800 20 started sync module instance, tier type = 2024-03-09T14:42:33.281 INFO:tasks.workunit.client.0.smithi088.stderr: -68> 2024-03-09T14:42:33.113+0000 7fbe3328a800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:42:33.281 INFO:tasks.workunit.client.0.smithi088.stderr: -67> 2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=0 2024-03-09T14:42:33.281 INFO:tasks.workunit.client.0.smithi088.stderr: -66> 2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=1 2024-03-09T14:42:33.281 INFO:tasks.workunit.client.0.smithi088.stderr: -65> 2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=2 2024-03-09T14:42:33.281 INFO:tasks.workunit.client.0.smithi088.stderr: -64> 2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=3 2024-03-09T14:42:33.281 INFO:tasks.workunit.client.0.smithi088.stderr: -63> 2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=4 2024-03-09T14:42:33.281 INFO:tasks.workunit.client.0.smithi088.stderr: -62> 2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=5 2024-03-09T14:42:33.281 INFO:tasks.workunit.client.0.smithi088.stderr: -61> 2024-03-09T14:42:33.123+0000 7fbe3328a800 20 add_watcher() i=6 2024-03-09T14:42:33.281 INFO:tasks.workunit.client.0.smithi088.stderr: -60> 2024-03-09T14:42:33.124+0000 7fbe3328a800 20 add_watcher() i=7 2024-03-09T14:42:33.281 INFO:tasks.workunit.client.0.smithi088.stderr: -59> 2024-03-09T14:42:33.124+0000 7fbe3328a800 2 all 8 watchers are set, enabling cache 2024-03-09T14:42:33.281 INFO:tasks.workunit.client.0.smithi088.stderr: -58> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding auth protocol: cephx 2024-03-09T14:42:33.281 INFO:tasks.workunit.client.0.smithi088.stderr: -57> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding auth protocol: cephx 2024-03-09T14:42:33.282 INFO:tasks.workunit.client.0.smithi088.stderr: -56> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding auth protocol: cephx 2024-03-09T14:42:33.282 INFO:tasks.workunit.client.0.smithi088.stderr: -55> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: secure 2024-03-09T14:42:33.282 INFO:tasks.workunit.client.0.smithi088.stderr: -54> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: crc 2024-03-09T14:42:33.282 INFO:tasks.workunit.client.0.smithi088.stderr: -53> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: secure 2024-03-09T14:42:33.282 INFO:tasks.workunit.client.0.smithi088.stderr: -52> 2024-03-09T14:42:33.125+0000 7fbce77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:33.282 INFO:tasks.workunit.client.0.smithi088.stderr: -51> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: crc 2024-03-09T14:42:33.282 INFO:tasks.workunit.client.0.smithi088.stderr: -50> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: secure 2024-03-09T14:42:33.282 INFO:tasks.workunit.client.0.smithi088.stderr: -49> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: crc 2024-03-09T14:42:33.282 INFO:tasks.workunit.client.0.smithi088.stderr: -48> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: crc 2024-03-09T14:42:33.282 INFO:tasks.workunit.client.0.smithi088.stderr: -47> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: secure 2024-03-09T14:42:33.282 INFO:tasks.workunit.client.0.smithi088.stderr: -46> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: crc 2024-03-09T14:42:33.282 INFO:tasks.workunit.client.0.smithi088.stderr: -45> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: secure 2024-03-09T14:42:33.282 INFO:tasks.workunit.client.0.smithi088.stderr: -44> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: crc 2024-03-09T14:42:33.282 INFO:tasks.workunit.client.0.smithi088.stderr: -43> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 AuthRegistry(0x7ffd9dea6200) adding con mode: secure 2024-03-09T14:42:33.282 INFO:tasks.workunit.client.0.smithi088.stderr: -42> 2024-03-09T14:42:33.126+0000 7fbe3328a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:42:33.283 INFO:tasks.workunit.client.0.smithi088.stderr: -41> 2024-03-09T14:42:33.126+0000 7fbe3328a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:42:33.283 INFO:tasks.workunit.client.0.smithi088.stderr: -40> 2024-03-09T14:42:33.126+0000 7fbe3328a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:42:33.283 INFO:tasks.workunit.client.0.smithi088.stderr: -39> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command cache list hook 0x564c4a1755e0 2024-03-09T14:42:33.283 INFO:tasks.workunit.client.0.smithi088.stderr: -38> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command cache inspect hook 0x564c4a1755e0 2024-03-09T14:42:33.283 INFO:tasks.workunit.client.0.smithi088.stderr: -37> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command cache erase hook 0x564c4a1755e0 2024-03-09T14:42:33.283 INFO:tasks.workunit.client.0.smithi088.stderr: -36> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command cache zap hook 0x564c4a1755e0 2024-03-09T14:42:33.283 INFO:tasks.workunit.client.0.smithi088.stderr: -35> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 note: GC not initialized 2024-03-09T14:42:33.283 INFO:tasks.workunit.client.0.smithi088.stderr: -34> 2024-03-09T14:42:33.126+0000 7fbce67e4640 20 reqs_thread_entry: start 2024-03-09T14:42:33.283 INFO:tasks.workunit.client.0.smithi088.stderr: -33> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command sync trace show hook 0x7fbe2800e9e0 2024-03-09T14:42:33.283 INFO:tasks.workunit.client.0.smithi088.stderr: -32> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command sync trace history hook 0x7fbe2800e9e0 2024-03-09T14:42:33.283 INFO:tasks.workunit.client.0.smithi088.stderr: -31> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command sync trace active hook 0x7fbe2800e9e0 2024-03-09T14:42:33.283 INFO:tasks.workunit.client.0.smithi088.stderr: -30> 2024-03-09T14:42:33.126+0000 7fbe3328a800 5 asok(0x564c49e8a780) register_command sync trace active_short hook 0x7fbe2800e9e0 2024-03-09T14:42:33.283 INFO:tasks.workunit.client.0.smithi088.stderr: -29> 2024-03-09T14:42:33.126+0000 7fbe3328a800 20 init_complete bucket index max shards: 11 2024-03-09T14:42:33.283 INFO:tasks.workunit.client.0.smithi088.stderr: -28> 2024-03-09T14:42:33.126+0000 7fbe3328a800 20 Filter name: none 2024-03-09T14:42:33.284 INFO:tasks.workunit.client.0.smithi088.stderr: -27> 2024-03-09T14:42:33.126+0000 7fbcdf7fe640 20 reqs_thread_entry: start 2024-03-09T14:42:33.284 INFO:tasks.workunit.client.0.smithi088.stderr: -26> 2024-03-09T14:42:33.126+0000 7fbe3328a800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-09T14:42:33.284 INFO:tasks.workunit.client.0.smithi088.stderr: -25> 2024-03-09T14:42:33.126+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.284 INFO:tasks.workunit.client.0.smithi088.stderr: -24> 2024-03-09T14:42:33.127+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:42:33.284 INFO:tasks.workunit.client.0.smithi088.stderr: -23> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-09T14:42:33.284 INFO:tasks.workunit.client.0.smithi088.stderr: -22> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-09T14:42:33.284 INFO:tasks.workunit.client.0.smithi088.stderr: -21> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 : miss 2024-03-09T14:42:33.284 INFO:tasks.workunit.client.0.smithi088.stderr: -20> 2024-03-09T14:42:33.127+0000 7fbe3328a800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.284 INFO:tasks.workunit.client.0.smithi088.stderr: -19> 2024-03-09T14:42:33.127+0000 7fbe3328a800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:42:33.284 INFO:tasks.workunit.client.0.smithi088.stderr: -18> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 info.flags=0x17 2024-03-09T14:42:33.284 INFO:tasks.workunit.client.0.smithi088.stderr: -17> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 to cache LRU end 2024-03-09T14:42:33.284 INFO:tasks.workunit.client.0.smithi088.stderr: -16> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:33.284 INFO:tasks.workunit.client.0.smithi088.stderr: -15> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:33.284 INFO:tasks.workunit.client.0.smithi088.stderr: -14> 2024-03-09T14:42:33.127+0000 7fbe3328a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 2024-03-09T14:42:33.285 INFO:tasks.workunit.client.0.smithi088.stderr: -13> 2024-03-09T14:42:33.133+0000 7fbe3328a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 info.flags=0x17 2024-03-09T14:42:33.285 INFO:tasks.workunit.client.0.smithi088.stderr: -12> 2024-03-09T14:42:33.133+0000 7fbe3328a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 to cache LRU end 2024-03-09T14:42:33.285 INFO:tasks.workunit.client.0.smithi088.stderr: -11> 2024-03-09T14:42:33.133+0000 7fbe3328a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:33.285 INFO:tasks.workunit.client.0.smithi088.stderr: -10> 2024-03-09T14:42:33.133+0000 7fbe3328a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28, ofs0, ns] 2024-03-09T14:42:33.285 INFO:tasks.workunit.client.0.smithi088.stderr: -9> 2024-03-09T14:42:33.133+0000 7fbd077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464261 cookie 94885660778960 notifier 6617 bl.length()=903 2024-03-09T14:42:33.285 INFO:tasks.workunit.client.0.smithi088.stderr: -8> 2024-03-09T14:42:33.133+0000 7fbd077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 info.flags=0x17 2024-03-09T14:42:33.285 INFO:tasks.workunit.client.0.smithi088.stderr: -7> 2024-03-09T14:42:33.133+0000 7fbd077fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 to cache LRU end 2024-03-09T14:42:33.285 INFO:tasks.workunit.client.0.smithi088.stderr: -6> 2024-03-09T14:42:33.133+0000 7fbd077fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:42:33.285 INFO:tasks.workunit.client.0.smithi088.stderr: -5> 2024-03-09T14:42:33.135+0000 7fbe3328a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): orig_sources= new_sources= 2024-03-09T14:42:33.285 INFO:tasks.workunit.client.0.smithi088.stderr: -4> 2024-03-09T14:42:33.135+0000 7fbe3328a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): potential sources added=[] removed=[] 2024-03-09T14:42:33.285 INFO:tasks.workunit.client.0.smithi088.stderr: -3> 2024-03-09T14:42:33.135+0000 7fbe3328a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): orig_dests= new_dests= 2024-03-09T14:42:33.285 INFO:tasks.workunit.client.0.smithi088.stderr: -2> 2024-03-09T14:42:33.135+0000 7fbe3328a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): potential dests added=[] removed=[] 2024-03-09T14:42:33.285 INFO:tasks.workunit.client.0.smithi088.stderr: -1> 2024-03-09T14:42:33.139+0000 7fbe3328a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbe3328a800 time 2024-03-09T14:42:33.138849+0000 2024-03-09T14:42:33.285 INFO:tasks.workunit.client.0.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:42:33.285 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.286 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:42:33.286 INFO:tasks.workunit.client.0.smithi088.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbe36580e86] 2024-03-09T14:42:33.286 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fbe36581044] 2024-03-09T14:42:33.286 INFO:tasks.workunit.client.0.smithi088.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c48953f91] 2024-03-09T14:42:33.286 INFO:tasks.workunit.client.0.smithi088.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x564c4896eed4] 2024-03-09T14:42:33.286 INFO:tasks.workunit.client.0.smithi088.stderr: 5: main() 2024-03-09T14:42:33.286 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fbe3543feb0] 2024-03-09T14:42:33.286 INFO:tasks.workunit.client.0.smithi088.stderr: 7: __libc_start_main() 2024-03-09T14:42:33.286 INFO:tasks.workunit.client.0.smithi088.stderr: 8: _start() 2024-03-09T14:42:33.286 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.286 INFO:tasks.workunit.client.0.smithi088.stderr: 0> 2024-03-09T14:42:33.140+0000 7fbe3328a800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:42:33.286 INFO:tasks.workunit.client.0.smithi088.stderr: in thread 7fbe3328a800 thread_name:radosgw-admin 2024-03-09T14:42:33.286 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.287 INFO:tasks.workunit.client.0.smithi088.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:42:33.287 INFO:tasks.workunit.client.0.smithi088.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fbe35454db0] 2024-03-09T14:42:33.287 INFO:tasks.workunit.client.0.smithi088.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fbe354a154c] 2024-03-09T14:42:33.287 INFO:tasks.workunit.client.0.smithi088.stderr: 3: raise() 2024-03-09T14:42:33.287 INFO:tasks.workunit.client.0.smithi088.stderr: 4: abort() 2024-03-09T14:42:33.287 INFO:tasks.workunit.client.0.smithi088.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbe36580ee0] 2024-03-09T14:42:33.287 INFO:tasks.workunit.client.0.smithi088.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fbe36581044] 2024-03-09T14:42:33.287 INFO:tasks.workunit.client.0.smithi088.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c48953f91] 2024-03-09T14:42:33.287 INFO:tasks.workunit.client.0.smithi088.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x564c4896eed4] 2024-03-09T14:42:33.287 INFO:tasks.workunit.client.0.smithi088.stderr: 9: main() 2024-03-09T14:42:33.287 INFO:tasks.workunit.client.0.smithi088.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fbe3543feb0] 2024-03-09T14:42:33.287 INFO:tasks.workunit.client.0.smithi088.stderr: 11: __libc_start_main() 2024-03-09T14:42:33.287 INFO:tasks.workunit.client.0.smithi088.stderr: 12: _start() 2024-03-09T14:42:33.287 INFO:tasks.workunit.client.0.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:42:33.287 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.288 INFO:tasks.workunit.client.0.smithi088.stderr:--- logging levels --- 2024-03-09T14:42:33.288 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 none 2024-03-09T14:42:33.288 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 lockdep 2024-03-09T14:42:33.288 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 context 2024-03-09T14:42:33.288 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 crush 2024-03-09T14:42:33.288 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds 2024-03-09T14:42:33.288 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_balancer 2024-03-09T14:42:33.288 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_locker 2024-03-09T14:42:33.288 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log 2024-03-09T14:42:33.288 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_log_expire 2024-03-09T14:42:33.288 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mds_migrator 2024-03-09T14:42:33.288 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 buffer 2024-03-09T14:42:33.288 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 timer 2024-03-09T14:42:33.288 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 filer 2024-03-09T14:42:33.289 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 striper 2024-03-09T14:42:33.289 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 1 objecter 2024-03-09T14:42:33.289 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rados 2024-03-09T14:42:33.289 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd 2024-03-09T14:42:33.289 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_mirror 2024-03-09T14:42:33.289 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_replay 2024-03-09T14:42:33.289 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 rbd_pwl 2024-03-09T14:42:33.289 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 journaler 2024-03-09T14:42:33.289 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objectcacher 2024-03-09T14:42:33.289 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:42:33.289 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 client 2024-03-09T14:42:33.289 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 osd 2024-03-09T14:42:33.289 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 optracker 2024-03-09T14:42:33.289 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 objclass 2024-03-09T14:42:33.289 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 filestore 2024-03-09T14:42:33.290 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 journal 2024-03-09T14:42:33.290 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 ms 2024-03-09T14:42:33.290 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mon 2024-03-09T14:42:33.290 INFO:tasks.workunit.client.0.smithi088.stderr: 0/10 monc 2024-03-09T14:42:33.290 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 paxos 2024-03-09T14:42:33.290 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 tp 2024-03-09T14:42:33.290 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 auth 2024-03-09T14:42:33.290 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 crypto 2024-03-09T14:42:33.290 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 finisher 2024-03-09T14:42:33.290 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 reserver 2024-03-09T14:42:33.290 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 heartbeatmap 2024-03-09T14:42:33.290 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 perfcounter 2024-03-09T14:42:33.290 INFO:tasks.workunit.client.0.smithi088.stderr: 20/20 rgw 2024-03-09T14:42:33.290 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_sync 2024-03-09T14:42:33.290 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_datacache 2024-03-09T14:42:33.291 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_access 2024-03-09T14:42:33.291 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:42:33.291 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_flight 2024-03-09T14:42:33.291 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:42:33.291 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 javaclient 2024-03-09T14:42:33.291 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 asok 2024-03-09T14:42:33.291 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 1 throttle 2024-03-09T14:42:33.291 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 0 refs 2024-03-09T14:42:33.291 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 compressor 2024-03-09T14:42:33.291 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluestore 2024-03-09T14:42:33.291 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 bluefs 2024-03-09T14:42:33.291 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 3 bdev 2024-03-09T14:42:33.291 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 kstore 2024-03-09T14:42:33.291 INFO:tasks.workunit.client.0.smithi088.stderr: 4/ 5 rocksdb 2024-03-09T14:42:33.292 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 fuse 2024-03-09T14:42:33.292 INFO:tasks.workunit.client.0.smithi088.stderr: 2/ 5 mgr 2024-03-09T14:42:33.292 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mgrc 2024-03-09T14:42:33.292 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 dpdk 2024-03-09T14:42:33.292 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 eventtrace 2024-03-09T14:42:33.292 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 prioritycache 2024-03-09T14:42:33.292 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 test 2024-03-09T14:42:33.292 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:42:33.292 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cephsqlite 2024-03-09T14:42:33.292 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:42:33.292 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore 2024-03-09T14:42:33.292 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_onode 2024-03-09T14:42:33.292 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_odata 2024-03-09T14:42:33.292 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_omap 2024-03-09T14:42:33.293 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_tm 2024-03-09T14:42:33.293 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_t 2024-03-09T14:42:33.293 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:42:33.293 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_epm 2024-03-09T14:42:33.293 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_lba 2024-03-09T14:42:33.293 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:42:33.293 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_cache 2024-03-09T14:42:33.293 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_journal 2024-03-09T14:42:33.293 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_device 2024-03-09T14:42:33.293 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 seastore_backref 2024-03-09T14:42:33.293 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 alienstore 2024-03-09T14:42:33.293 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 mclock 2024-03-09T14:42:33.293 INFO:tasks.workunit.client.0.smithi088.stderr: 0/ 5 cyanstore 2024-03-09T14:42:33.293 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 ceph_exporter 2024-03-09T14:42:33.293 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 memstore 2024-03-09T14:42:33.294 INFO:tasks.workunit.client.0.smithi088.stderr: 1/ 5 trace 2024-03-09T14:42:33.294 INFO:tasks.workunit.client.0.smithi088.stderr: -2/-2 (syslog threshold) 2024-03-09T14:42:33.294 INFO:tasks.workunit.client.0.smithi088.stderr: 99/99 (stderr threshold) 2024-03-09T14:42:33.294 INFO:tasks.workunit.client.0.smithi088.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:42:33.294 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbcdf7fe640 / http_manager 2024-03-09T14:42:33.294 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbce67e4640 / http_manager 2024-03-09T14:42:33.294 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbce77e6640 / rgw_dt_lg_renew 2024-03-09T14:42:33.294 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbd067fc640 / ms_dispatch 2024-03-09T14:42:33.294 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbd077fe640 / io_context_pool 2024-03-09T14:42:33.294 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbd07fff640 / io_context_pool 2024-03-09T14:42:33.294 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbd167fc640 / ms_dispatch 2024-03-09T14:42:33.294 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbd1d60a640 / ms_dispatch 2024-03-09T14:42:33.294 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbd1ee0d640 / io_context_pool 2024-03-09T14:42:33.294 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbe30585640 / msgr-worker-2 2024-03-09T14:42:33.295 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbe30d86640 / msgr-worker-1 2024-03-09T14:42:33.295 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbe31587640 / msgr-worker-0 2024-03-09T14:42:33.295 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbe31d88640 / io_context_pool 2024-03-09T14:42:33.295 INFO:tasks.workunit.client.0.smithi088.stderr: 7fbe3328a800 / radosgw-admin 2024-03-09T14:42:33.295 INFO:tasks.workunit.client.0.smithi088.stderr: max_recent 500 2024-03-09T14:42:33.295 INFO:tasks.workunit.client.0.smithi088.stderr: max_new 1000 2024-03-09T14:42:33.295 INFO:tasks.workunit.client.0.smithi088.stderr: log_file /var/lib/ceph/crash/2024-03-09T14:42:33.140497Z_fdf4b9f9-df88-4d0c-a979-03eabe2edfce/log 2024-03-09T14:42:33.295 INFO:tasks.workunit.client.0.smithi088.stderr:--- end dump of recent events --- 2024-03-09T14:42:33.295 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-03-09T14:42:33.295 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:42:33.295 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:42:33.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.211+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.212+0000 7f7c22624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.212+0000 7f7c22624800 20 realm 2024-03-09T14:42:33.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.212+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.212+0000 7f7c22624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.212+0000 7f7c22624800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:42:33.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.212+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.213+0000 7f7c22624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.213+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.214+0000 7f7c22624800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:33.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.214+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.297 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.214+0000 7f7c22624800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:42:33.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.214+0000 7f7c22624800 20 searching for the correct realm 2024-03-09T14:42:33.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.216+0000 7f7c20921640 0 -- 172.21.15.88:0/2716759137 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f7c18080030 msgr2=0x7f7c18058d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:33.422 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.422+0000 7f7c1f91f640 0 -- 172.21.15.88:0/2716759137 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f7c1802e450 msgr2=0x7f7c18058420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:33.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.629+0000 7f7c22624800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:42:33.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.629+0000 7f7c22624800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:42:33.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.629+0000 7f7c22624800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:42:33.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.629+0000 7f7c22624800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:42:33.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.629+0000 7f7c22624800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:42:33.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.629+0000 7f7c22624800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:42:33.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.629+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.629+0000 7f7c22624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.629+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.630+0000 7f7c22624800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:33.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.630+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.630+0000 7f7c22624800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:42:33.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.630+0000 7f7c22624800 20 zone default found 2024-03-09T14:42:33.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.630+0000 7f7c22624800 4 Realm: () 2024-03-09T14:42:33.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.630+0000 7f7c22624800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:42:33.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.630+0000 7f7c22624800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:42:33.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.630+0000 7f7c22624800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:42:33.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.630+0000 7f7c22624800 20 zonegroup default 2024-03-09T14:42:33.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.630+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.630+0000 7f7c22624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.630+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.631+0000 7f7c22624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.631+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.631+0000 7f7c22624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.631+0000 7f7c22624800 20 started sync module instance, tier type = 2024-03-09T14:42:33.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.631+0000 7f7c22624800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:42:33.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.640+0000 7f7c22624800 20 add_watcher() i=0 2024-03-09T14:42:33.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.640+0000 7f7c22624800 20 add_watcher() i=1 2024-03-09T14:42:33.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.640+0000 7f7c22624800 20 add_watcher() i=2 2024-03-09T14:42:33.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.640+0000 7f7c22624800 20 add_watcher() i=3 2024-03-09T14:42:33.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.640+0000 7f7c22624800 20 add_watcher() i=4 2024-03-09T14:42:33.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.640+0000 7f7c22624800 20 add_watcher() i=5 2024-03-09T14:42:33.640 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.640+0000 7f7c22624800 20 add_watcher() i=6 2024-03-09T14:42:33.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.641+0000 7f7c22624800 20 add_watcher() i=7 2024-03-09T14:42:33.641 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.641+0000 7f7c22624800 2 all 8 watchers are set, enabling cache 2024-03-09T14:42:33.643 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.643+0000 7f7ad6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:33.643 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.643+0000 7f7c22624800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:42:33.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.643+0000 7f7c22624800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:42:33.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.643+0000 7f7c22624800 5 note: GC not initialized 2024-03-09T14:42:33.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.644+0000 7f7ad5fdb640 20 reqs_thread_entry: start 2024-03-09T14:42:33.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.644+0000 7f7c22624800 20 init_complete bucket index max shards: 11 2024-03-09T14:42:33.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.644+0000 7f7c22624800 20 Filter name: none 2024-03-09T14:42:33.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.644+0000 7f7a477fe640 20 reqs_thread_entry: start 2024-03-09T14:42:33.644 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.644+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.645+0000 7f7c22624800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:42:33.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.645+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.645+0000 7f7c22624800 20 rados_obj.operate() r=0 bl.length=433 2024-03-09T14:42:33.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.645+0000 7f7c22624800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:42:33.645 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.645+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.646+0000 7f7c22624800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:42:33.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.646+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.646+0000 7f7c22624800 20 rados_obj.operate() r=0 bl.length=433 2024-03-09T14:42:33.646 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.646+0000 7f7c22624800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:42:33.647 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.647+0000 7f7c22624800 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.647 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.648+0000 7f7c22624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.648 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.648+0000 7f7ad6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:33.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.651+0000 7f7c22624800 20 remove_watcher() i=0 2024-03-09T14:42:33.650 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.651+0000 7f7c22624800 2 removed watcher, disabling cache 2024-03-09T14:42:33.651 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.652+0000 7f7c22624800 20 remove_watcher() i=1 2024-03-09T14:42:33.652 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.653+0000 7f7c22624800 20 remove_watcher() i=2 2024-03-09T14:42:33.653 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.654+0000 7f7c22624800 20 remove_watcher() i=3 2024-03-09T14:42:33.654 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.655+0000 7f7c22624800 20 remove_watcher() i=4 2024-03-09T14:42:33.655 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.656+0000 7f7c22624800 20 remove_watcher() i=5 2024-03-09T14:42:33.687 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.687+0000 7f7c22624800 20 remove_watcher() i=6 2024-03-09T14:42:33.688 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:42:33.689+0000 7f7c22624800 20 remove_watcher() i=7 2024-03-09T14:42:33.698 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:42:33.698 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:42:33.698 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: abort-at-do-reshard id: 5d93e872-363b-498b-b665-658644296b85.4535.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:42:33.698 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:43:03.870 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:43:03.902 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:03.902 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:03.938 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:03.937+0000 7fb59a016800 20 rados->read ofs=0 len=0 2024-03-09T14:43:03.939 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:03.938+0000 7fb59a016800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:03.939 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:03.938+0000 7fb59a016800 20 realm 2024-03-09T14:43:03.939 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:03.938+0000 7fb59a016800 20 rados->read ofs=0 len=0 2024-03-09T14:43:03.939 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:03.938+0000 7fb59a016800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:03.939 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:03.938+0000 7fb59a016800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:03.939 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:03.938+0000 7fb59a016800 20 rados->read ofs=0 len=0 2024-03-09T14:43:03.939 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:03.938+0000 7fb59a016800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:03.939 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:03.938+0000 7fb59a016800 20 rados->read ofs=0 len=0 2024-03-09T14:43:03.940 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:03.939+0000 7fb59a016800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:03.940 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:03.939+0000 7fb59a016800 20 rados->read ofs=0 len=0 2024-03-09T14:43:03.940 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:03.940+0000 7fb59a016800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:03.941 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:03.940+0000 7fb59a016800 20 searching for the correct realm 2024-03-09T14:43:03.943 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:03.942+0000 7fb595e9b640 0 -- 172.21.15.88:0/1371847334 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fb5900668b0 msgr2=0x7fb59005d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:04.149 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.148+0000 7fb594e99640 0 -- 172.21.15.88:0/1371847334 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fb59005f960 msgr2=0x7fb5900722f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:04.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.355+0000 7fb59a016800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:04.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.355+0000 7fb59a016800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:04.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.355+0000 7fb59a016800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:04.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.355+0000 7fb59a016800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:04.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.355+0000 7fb59a016800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:04.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.355+0000 7fb59a016800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:04.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.355+0000 7fb59a016800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.355+0000 7fb59a016800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:04.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.355+0000 7fb59a016800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.355+0000 7fb59a016800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:04.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.355+0000 7fb59a016800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.357 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.356+0000 7fb59a016800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:04.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.356+0000 7fb59a016800 20 zone default found 2024-03-09T14:43:04.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.356+0000 7fb59a016800 4 Realm: () 2024-03-09T14:43:04.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.356+0000 7fb59a016800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:04.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.356+0000 7fb59a016800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:04.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.356+0000 7fb59a016800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:04.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.356+0000 7fb59a016800 20 zonegroup default 2024-03-09T14:43:04.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.356+0000 7fb59a016800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.356+0000 7fb59a016800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:04.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.356+0000 7fb59a016800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.356+0000 7fb59a016800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:04.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.356+0000 7fb59a016800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.356+0000 7fb59a016800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:04.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.356+0000 7fb59a016800 20 started sync module instance, tier type = 2024-03-09T14:43:04.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.356+0000 7fb59a016800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:04.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.366+0000 7fb59a016800 20 add_watcher() i=0 2024-03-09T14:43:04.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.366+0000 7fb59a016800 20 add_watcher() i=1 2024-03-09T14:43:04.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.366+0000 7fb59a016800 20 add_watcher() i=2 2024-03-09T14:43:04.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.366+0000 7fb59a016800 20 add_watcher() i=3 2024-03-09T14:43:04.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.366+0000 7fb59a016800 20 add_watcher() i=4 2024-03-09T14:43:04.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.366+0000 7fb59a016800 20 add_watcher() i=5 2024-03-09T14:43:04.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.366+0000 7fb59a016800 20 add_watcher() i=6 2024-03-09T14:43:04.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.367+0000 7fb59a016800 20 add_watcher() i=7 2024-03-09T14:43:04.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.367+0000 7fb59a016800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:04.370 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.369+0000 7fb44b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:04.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.370+0000 7fb59a016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:04.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.370+0000 7fb59a016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:04.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.370+0000 7fb59a016800 5 note: GC not initialized 2024-03-09T14:43:04.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.370+0000 7fb44a7e4640 20 reqs_thread_entry: start 2024-03-09T14:43:04.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.370+0000 7fb59a016800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:04.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.370+0000 7fb59a016800 20 Filter name: none 2024-03-09T14:43:04.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.370+0000 7fb3bbfff640 20 reqs_thread_entry: start 2024-03-09T14:43:04.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.370+0000 7fb59a016800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-09T14:43:04.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.370+0000 7fb59a016800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.371+0000 7fb59a016800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:43:04.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.371+0000 7fb59a016800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-09T14:43:04.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.371+0000 7fb59a016800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-09T14:43:04.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.371+0000 7fb59a016800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 : miss 2024-03-09T14:43:04.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.371+0000 7fb59a016800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.371+0000 7fb59a016800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:43:04.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.371+0000 7fb59a016800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 info.flags=0x17 2024-03-09T14:43:04.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.371+0000 7fb59a016800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 to cache LRU end 2024-03-09T14:43:04.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.371+0000 7fb59a016800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:43:04.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.371+0000 7fb59a016800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:43:04.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.372+0000 7fb59a016800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 2024-03-09T14:43:04.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.377+0000 7fb59a016800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 info.flags=0x17 2024-03-09T14:43:04.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.377+0000 7fb59a016800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 to cache LRU end 2024-03-09T14:43:04.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.377+0000 7fb59a016800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:43:04.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.377+0000 7fb59a016800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28, ofs0, ns] 2024-03-09T14:43:04.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.377+0000 7fb467fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464263 cookie 93865190505024 notifier 6653 bl.length()=903 2024-03-09T14:43:04.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.377+0000 7fb467fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 info.flags=0x17 2024-03-09T14:43:04.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.377+0000 7fb467fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 to cache LRU end 2024-03-09T14:43:04.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.377+0000 7fb467fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:43:04.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.379+0000 7fb59a016800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): orig_sources= new_sources= 2024-03-09T14:43:04.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.379+0000 7fb59a016800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): potential sources added=[] removed=[] 2024-03-09T14:43:04.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.379+0000 7fb59a016800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): orig_dests= new_dests= 2024-03-09T14:43:04.380 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.379+0000 7fb59a016800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): potential dests added=[] removed=[] 2024-03-09T14:43:04.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.0 2024-03-09T14:43:04.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.0 2024-03-09T14:43:04.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.1 2024-03-09T14:43:04.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.1 2024-03-09T14:43:04.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.2 2024-03-09T14:43:04.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.2 2024-03-09T14:43:04.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.3 2024-03-09T14:43:04.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.3 2024-03-09T14:43:04.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.4 2024-03-09T14:43:04.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.4 2024-03-09T14:43:04.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.5 2024-03-09T14:43:04.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.5 2024-03-09T14:43:04.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.6 2024-03-09T14:43:04.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.6 2024-03-09T14:43:04.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.7 2024-03-09T14:43:04.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.7 2024-03-09T14:43:04.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.8 2024-03-09T14:43:04.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.8 2024-03-09T14:43:04.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.9 2024-03-09T14:43:04.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.9 2024-03-09T14:43:04.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.10 2024-03-09T14:43:04.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.10 2024-03-09T14:43:04.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.11 2024-03-09T14:43:04.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1.11 2024-03-09T14:43:04.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.382+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.0 2024-03-09T14:43:04.385 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.383+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.1 2024-03-09T14:43:04.385 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.383+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.2 2024-03-09T14:43:04.385 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.384+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.3 2024-03-09T14:43:04.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.385+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.4 2024-03-09T14:43:04.386 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.386+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.5 2024-03-09T14:43:04.387 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.386+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.6 2024-03-09T14:43:04.387 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.387+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.7 2024-03-09T14:43:04.388 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.387+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.8 2024-03-09T14:43:04.388 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.388+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.9 2024-03-09T14:43:04.389 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.388+0000 7fb59a016800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.28.10 2024-03-09T14:43:04.392 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.392+0000 7fb59a016800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 : hit (requested=0x17, cached=0x17) 2024-03-09T14:43:04.392 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.392+0000 7fb59a016800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 2024-03-09T14:43:04.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.393+0000 7fb59a016800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 info.flags=0x17 2024-03-09T14:43:04.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.393+0000 7fb59a016800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 to cache LRU end 2024-03-09T14:43:04.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.393+0000 7fb59a016800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:43:04.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.393+0000 7fb59a016800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28, ofs0, ns] 2024-03-09T14:43:04.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.393+0000 7fb478ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464264 cookie 93865190505024 notifier 6653 bl.length()=871 2024-03-09T14:43:04.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.393+0000 7fb478ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 info.flags=0x17 2024-03-09T14:43:04.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.393+0000 7fb478ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:5d93e872-363b-498b-b665-658644296b85.4535.28 to cache LRU end 2024-03-09T14:43:04.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.393+0000 7fb478ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:43:04.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.395+0000 7fb59a016800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): orig_sources= new_sources= 2024-03-09T14:43:04.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.395+0000 7fb59a016800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): potential sources added=[] removed=[] 2024-03-09T14:43:04.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.395+0000 7fb59a016800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): orig_dests= new_dests= 2024-03-09T14:43:04.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.395+0000 7fb59a016800 20 handle_bi_update(): bucket=:abort-at-do-reshard[5d93e872-363b-498b-b665-658644296b85.4535.28]): potential dests added=[] removed=[] 2024-03-09T14:43:04.400 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.399+0000 7fb59a016800 1 execute INFO: reshard of bucket "abort-at-do-reshard" completed successfully 2024-03-09T14:43:04.401 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.401+0000 7fb44b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:04.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.403+0000 7fb59a016800 20 remove_watcher() i=0 2024-03-09T14:43:04.404 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.403+0000 7fb59a016800 2 removed watcher, disabling cache 2024-03-09T14:43:04.405 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.404+0000 7fb59a016800 20 remove_watcher() i=1 2024-03-09T14:43:04.406 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.405+0000 7fb59a016800 20 remove_watcher() i=2 2024-03-09T14:43:04.407 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.407+0000 7fb59a016800 20 remove_watcher() i=3 2024-03-09T14:43:04.408 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.408+0000 7fb59a016800 20 remove_watcher() i=4 2024-03-09T14:43:04.409 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.408+0000 7fb59a016800 20 remove_watcher() i=5 2024-03-09T14:43:04.410 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.409+0000 7fb59a016800 20 remove_watcher() i=6 2024-03-09T14:43:04.411 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.410+0000 7fb59a016800 20 remove_watcher() i=7 2024-03-09T14:43:04.422 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-03-09T14:43:04.450 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:04.450 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:04.483 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.482+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.483+0000 7fc09f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:04.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.483+0000 7fc09f733800 20 realm 2024-03-09T14:43:04.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.483+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.483+0000 7fc09f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:04.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.483+0000 7fc09f733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:04.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.484+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.484+0000 7fc09f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:04.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.484+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.484+0000 7fc09f733800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:04.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.485+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.486 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.485+0000 7fc09f733800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:04.486 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.485+0000 7fc09f733800 20 searching for the correct realm 2024-03-09T14:43:04.488 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.487+0000 7fc09bc65640 0 -- 172.21.15.88:0/1104211655 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fc094035440 msgr2=0x7fc094035860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:04.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.693+0000 7fc09ac63640 0 -- 172.21.15.88:0/1104211655 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fc0940263d0 msgr2=0x7fc094026850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:04.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.899+0000 7fc09f733800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:04.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.899+0000 7fc09f733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:04.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.899+0000 7fc09f733800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:04.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.899+0000 7fc09f733800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:04.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.899+0000 7fc09f733800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:04.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.899+0000 7fc09f733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:04.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.899+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.900+0000 7fc09f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:04.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.900+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.900+0000 7fc09f733800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:04.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.900+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.901+0000 7fc09f733800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:04.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.901+0000 7fc09f733800 20 zone default found 2024-03-09T14:43:04.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.901+0000 7fc09f733800 4 Realm: () 2024-03-09T14:43:04.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.901+0000 7fc09f733800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:04.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.901+0000 7fc09f733800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:04.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.901+0000 7fc09f733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:04.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.901+0000 7fc09f733800 20 zonegroup default 2024-03-09T14:43:04.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.901+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.901+0000 7fc09f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:04.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.901+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.901+0000 7fc09f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:04.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.901+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.901+0000 7fc09f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:04.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.901+0000 7fc09f733800 20 started sync module instance, tier type = 2024-03-09T14:43:04.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.901+0000 7fc09f733800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:04.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.911+0000 7fc09f733800 20 add_watcher() i=0 2024-03-09T14:43:04.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.911+0000 7fc09f733800 20 add_watcher() i=1 2024-03-09T14:43:04.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.911+0000 7fc09f733800 20 add_watcher() i=2 2024-03-09T14:43:04.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.911+0000 7fc09f733800 20 add_watcher() i=3 2024-03-09T14:43:04.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.911+0000 7fc09f733800 20 add_watcher() i=4 2024-03-09T14:43:04.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.911+0000 7fc09f733800 20 add_watcher() i=5 2024-03-09T14:43:04.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.911+0000 7fc09f733800 20 add_watcher() i=6 2024-03-09T14:43:04.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.912+0000 7fc09f733800 20 add_watcher() i=7 2024-03-09T14:43:04.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.912+0000 7fc09f733800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:04.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.914+0000 7fbf51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:04.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.914+0000 7fc09f733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:04.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.914+0000 7fc09f733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:04.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.914+0000 7fc09f733800 5 note: GC not initialized 2024-03-09T14:43:04.921 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.914+0000 7fbf50fe1640 20 reqs_thread_entry: start 2024-03-09T14:43:04.921 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.915+0000 7fc09f733800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:04.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.915+0000 7fc09f733800 20 Filter name: none 2024-03-09T14:43:04.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.915+0000 7fbeca7fc640 20 reqs_thread_entry: start 2024-03-09T14:43:04.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.915+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.915+0000 7fc09f733800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:43:04.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.915+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.916+0000 7fc09f733800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:43:04.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.916+0000 7fc09f733800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:04.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.916+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.916+0000 7fc09f733800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:43:04.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.916+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.917+0000 7fc09f733800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:43:04.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.917+0000 7fc09f733800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:04.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.918+0000 7fc09f733800 20 rados->read ofs=0 len=0 2024-03-09T14:43:04.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.918+0000 7fc09f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:04.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.919+0000 7fbf51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:04.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.921+0000 7fc09f733800 20 remove_watcher() i=0 2024-03-09T14:43:04.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.921+0000 7fc09f733800 2 removed watcher, disabling cache 2024-03-09T14:43:04.923 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.922+0000 7fc09f733800 20 remove_watcher() i=1 2024-03-09T14:43:04.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.923+0000 7fc09f733800 20 remove_watcher() i=2 2024-03-09T14:43:04.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.924+0000 7fc09f733800 20 remove_watcher() i=3 2024-03-09T14:43:04.926 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.925+0000 7fc09f733800 20 remove_watcher() i=4 2024-03-09T14:43:04.927 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.926+0000 7fc09f733800 20 remove_watcher() i=5 2024-03-09T14:43:04.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.927+0000 7fc09f733800 20 remove_watcher() i=6 2024-03-09T14:43:04.928 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:04.928+0000 7fc09f733800 20 remove_watcher() i=7 2024-03-09T14:43:04.938 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:43:04.938 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:43:04.938 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: abort-at-do-reshard id: 5d93e872-363b-498b-b665-658644296b85.4535.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:43:04.938 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:43:05.268 INFO:tasks.workunit.client.0.smithi088.stderr: test: reshard versioned bucket 2024-03-09T14:43:05.269 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket myver 2024-03-09T14:43:05.295 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:05.295 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:05.329 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.328+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.330 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.329+0000 7f17fef33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:05.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.329+0000 7f17fef33800 20 realm 2024-03-09T14:43:05.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.329+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.329+0000 7f17fef33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:05.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.329+0000 7f17fef33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:05.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.329+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.330+0000 7f17fef33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:05.331 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.330+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.332 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.330+0000 7f17fef33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:05.332 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.330+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.332 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.331+0000 7f17fef33800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:05.332 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.331+0000 7f17fef33800 20 searching for the correct realm 2024-03-09T14:43:05.334 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.333+0000 7f17fb3d4640 0 -- 172.21.15.88:0/811225225 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f17f403fb40 msgr2=0x7f17f4038430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:05.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.539+0000 7f17f23d2640 0 -- 172.21.15.88:0/811225225 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f17f404d3a0 msgr2=0x7f17f404d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:05.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.746+0000 7f17fef33800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:05.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.746+0000 7f17fef33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:05.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.746+0000 7f17fef33800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:05.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.746+0000 7f17fef33800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:05.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.746+0000 7f17fef33800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:05.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.746+0000 7f17fef33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:05.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.746+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.746+0000 7f17fef33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:05.747 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.746+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.746+0000 7f17fef33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:05.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.746+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.747+0000 7f17fef33800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:05.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.747+0000 7f17fef33800 20 zone default found 2024-03-09T14:43:05.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.747+0000 7f17fef33800 4 Realm: () 2024-03-09T14:43:05.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.747+0000 7f17fef33800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:05.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.747+0000 7f17fef33800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:05.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.747+0000 7f17fef33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:05.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.747+0000 7f17fef33800 20 zonegroup default 2024-03-09T14:43:05.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.747+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.747+0000 7f17fef33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:05.749 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.747+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.747+0000 7f17fef33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:05.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.747+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.748+0000 7f17fef33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:05.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.748+0000 7f17fef33800 20 started sync module instance, tier type = 2024-03-09T14:43:05.750 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.748+0000 7f17fef33800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:05.758 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.758+0000 7f17fef33800 20 add_watcher() i=0 2024-03-09T14:43:05.758 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.758+0000 7f17fef33800 20 add_watcher() i=1 2024-03-09T14:43:05.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.758+0000 7f17fef33800 20 add_watcher() i=2 2024-03-09T14:43:05.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.758+0000 7f17fef33800 20 add_watcher() i=3 2024-03-09T14:43:05.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.758+0000 7f17fef33800 20 add_watcher() i=4 2024-03-09T14:43:05.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.758+0000 7f17fef33800 20 add_watcher() i=5 2024-03-09T14:43:05.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.758+0000 7f17fef33800 20 add_watcher() i=6 2024-03-09T14:43:05.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.759+0000 7f17fef33800 20 add_watcher() i=7 2024-03-09T14:43:05.759 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.759+0000 7f17fef33800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:05.761 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.761+0000 7f16b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:05.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.761+0000 7f17fef33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:05.762 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.761+0000 7f17fef33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:05.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.761+0000 7f17fef33800 5 note: GC not initialized 2024-03-09T14:43:05.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.761+0000 7f162bfff640 20 reqs_thread_entry: start 2024-03-09T14:43:05.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.762+0000 7f17fef33800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:05.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.762+0000 7f17fef33800 20 Filter name: none 2024-03-09T14:43:05.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.762+0000 7f1629ffb640 20 reqs_thread_entry: start 2024-03-09T14:43:05.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.762+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.762+0000 7f17fef33800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:43:05.763 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.762+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.764 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.763+0000 7f17fef33800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:43:05.764 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.763+0000 7f17fef33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:05.764 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.763+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.764 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.763+0000 7f17fef33800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:43:05.764 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.763+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.765 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.764+0000 7f17fef33800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:43:05.765 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.764+0000 7f17fef33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:05.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.765+0000 7f17fef33800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.765+0000 7f17fef33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:05.766 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.766+0000 7f16b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:05.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.768+0000 7f17fef33800 20 remove_watcher() i=0 2024-03-09T14:43:05.769 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.768+0000 7f17fef33800 2 removed watcher, disabling cache 2024-03-09T14:43:05.770 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.770+0000 7f17fef33800 20 remove_watcher() i=1 2024-03-09T14:43:05.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.771+0000 7f17fef33800 20 remove_watcher() i=2 2024-03-09T14:43:05.772 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.772+0000 7f17fef33800 20 remove_watcher() i=3 2024-03-09T14:43:05.773 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.773+0000 7f17fef33800 20 remove_watcher() i=4 2024-03-09T14:43:05.774 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.774+0000 7f17fef33800 20 remove_watcher() i=5 2024-03-09T14:43:05.775 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.775+0000 7f17fef33800 20 remove_watcher() i=6 2024-03-09T14:43:05.776 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.776+0000 7f17fef33800 20 remove_watcher() i=7 2024-03-09T14:43:05.787 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:43:05.787 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:43:05.787 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: myver id: 5d93e872-363b-498b-b665-658644296b85.4535.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-03-09T14:43:05.787 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:43:05.789 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-03-09T14:43:05.818 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:05.819 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:05.853 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.852+0000 7f305271f800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.853+0000 7f305271f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:05.854 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.853+0000 7f305271f800 20 realm 2024-03-09T14:43:05.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.853+0000 7f305271f800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.854+0000 7f305271f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:05.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.854+0000 7f305271f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:05.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.854+0000 7f305271f800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.854+0000 7f305271f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:05.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.854+0000 7f305271f800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.855+0000 7f305271f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:05.855 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.855+0000 7f305271f800 20 rados->read ofs=0 len=0 2024-03-09T14:43:05.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.855+0000 7f305271f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:05.856 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.855+0000 7f305271f800 20 searching for the correct realm 2024-03-09T14:43:05.858 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:05.857+0000 7f304ece9640 0 -- 172.21.15.88:0/488314139 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f304004bbe0 msgr2=0x7f3040029400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:06.064 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.063+0000 7f304dce7640 0 -- 172.21.15.88:0/488314139 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f3040010440 msgr2=0x7f30400108c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:06.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.270+0000 7f305271f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:06.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.270+0000 7f305271f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:06.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.270+0000 7f305271f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:06.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.270+0000 7f305271f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:06.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.270+0000 7f305271f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:06.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.270+0000 7f305271f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:06.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.270+0000 7f305271f800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.271+0000 7f305271f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:06.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.271+0000 7f305271f800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.271+0000 7f305271f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:06.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.271+0000 7f305271f800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.271+0000 7f305271f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:06.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.271+0000 7f305271f800 20 zone default found 2024-03-09T14:43:06.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.271+0000 7f305271f800 4 Realm: () 2024-03-09T14:43:06.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.271+0000 7f305271f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:06.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.271+0000 7f305271f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:06.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.271+0000 7f305271f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:06.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.271+0000 7f305271f800 20 zonegroup default 2024-03-09T14:43:06.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.271+0000 7f305271f800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.272+0000 7f305271f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:06.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.272+0000 7f305271f800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.272+0000 7f305271f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:06.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.272+0000 7f305271f800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.272+0000 7f305271f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:06.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.272+0000 7f305271f800 20 started sync module instance, tier type = 2024-03-09T14:43:06.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.272+0000 7f305271f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:06.282 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.282+0000 7f305271f800 20 add_watcher() i=0 2024-03-09T14:43:06.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.282+0000 7f305271f800 20 add_watcher() i=1 2024-03-09T14:43:06.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.282+0000 7f305271f800 20 add_watcher() i=2 2024-03-09T14:43:06.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.282+0000 7f305271f800 20 add_watcher() i=3 2024-03-09T14:43:06.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.282+0000 7f305271f800 20 add_watcher() i=4 2024-03-09T14:43:06.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.282+0000 7f305271f800 20 add_watcher() i=5 2024-03-09T14:43:06.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.282+0000 7f305271f800 20 add_watcher() i=6 2024-03-09T14:43:06.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.283+0000 7f305271f800 20 add_watcher() i=7 2024-03-09T14:43:06.283 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.283+0000 7f305271f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:06.285 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.285+0000 7f2f04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:06.287 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.285+0000 7f305271f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:06.287 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.285+0000 7f305271f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:06.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.285+0000 7f305271f800 5 note: GC not initialized 2024-03-09T14:43:06.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.285+0000 7f2e7f7fe640 20 reqs_thread_entry: start 2024-03-09T14:43:06.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.285+0000 7f305271f800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:06.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.285+0000 7f305271f800 20 Filter name: none 2024-03-09T14:43:06.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.286+0000 7f2e7d7fa640 20 reqs_thread_entry: start 2024-03-09T14:43:06.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.286+0000 7f305271f800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-09T14:43:06.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.286+0000 7f305271f800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.286+0000 7f305271f800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:43:06.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.286+0000 7f305271f800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-09T14:43:06.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.286+0000 7f305271f800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-09T14:43:06.288 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.286+0000 7f305271f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 : miss 2024-03-09T14:43:06.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.286+0000 7f305271f800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.287+0000 7f305271f800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:43:06.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.287+0000 7f305271f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:06.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.287+0000 7f305271f800 10 adding default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:06.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.287+0000 7f305271f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:43:06.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.287+0000 7f305271f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:06.289 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.287+0000 7f305271f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 2024-03-09T14:43:06.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.293+0000 7f305271f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:06.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.293+0000 7f305271f800 10 moving default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:06.293 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.293+0000 7f305271f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:06.294 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.293+0000 7f305271f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18, ofs0, ns] 2024-03-09T14:43:06.294 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.293+0000 7f2f317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464370 cookie 94323570700320 notifier 7032 bl.length()=813 2024-03-09T14:43:06.294 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.293+0000 7f2f317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:06.294 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.293+0000 7f2f317fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:06.294 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.293+0000 7f2f317fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:06.295 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.295+0000 7f305271f800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): orig_sources= new_sources= 2024-03-09T14:43:06.295 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.295+0000 7f305271f800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): potential sources added=[] removed=[] 2024-03-09T14:43:06.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.295+0000 7f305271f800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): orig_dests= new_dests= 2024-03-09T14:43:06.296 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.295+0000 7f305271f800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): potential dests added=[] removed=[] 2024-03-09T14:43:06.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.0 2024-03-09T14:43:06.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.0 2024-03-09T14:43:06.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.1 2024-03-09T14:43:06.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.1 2024-03-09T14:43:06.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.2 2024-03-09T14:43:06.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.2 2024-03-09T14:43:06.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.3 2024-03-09T14:43:06.298 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.3 2024-03-09T14:43:06.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.4 2024-03-09T14:43:06.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.4 2024-03-09T14:43:06.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.5 2024-03-09T14:43:06.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.5 2024-03-09T14:43:06.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.6 2024-03-09T14:43:06.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.6 2024-03-09T14:43:06.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.7 2024-03-09T14:43:06.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.7 2024-03-09T14:43:06.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.8 2024-03-09T14:43:06.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.8 2024-03-09T14:43:06.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.9 2024-03-09T14:43:06.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.9 2024-03-09T14:43:06.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.10 2024-03-09T14:43:06.299 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.10 2024-03-09T14:43:06.300 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.11 2024-03-09T14:43:06.300 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.11 2024-03-09T14:43:06.300 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.297+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.0 2024-03-09T14:43:06.301 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.298+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1 2024-03-09T14:43:06.301 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.298+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2 2024-03-09T14:43:06.301 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.299+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3 2024-03-09T14:43:06.301 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.299+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.4 2024-03-09T14:43:06.301 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.299+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.5 2024-03-09T14:43:06.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.300+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.6 2024-03-09T14:43:06.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.300+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.7 2024-03-09T14:43:06.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.301+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.8 2024-03-09T14:43:06.303 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.301+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.9 2024-03-09T14:43:06.303 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.301+0000 7f305271f800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.10 2024-03-09T14:43:06.303 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.302+0000 7f305271f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 : hit (requested=0x17, cached=0x17) 2024-03-09T14:43:06.303 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.302+0000 7f305271f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 2024-03-09T14:43:06.304 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.304+0000 7f305271f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:06.304 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.304+0000 7f305271f800 10 moving default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:06.304 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.304+0000 7f305271f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:06.304 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.304+0000 7f305271f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18, ofs0, ns] 2024-03-09T14:43:06.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.304+0000 7f2f317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464371 cookie 94323570700320 notifier 7032 bl.length()=781 2024-03-09T14:43:06.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.304+0000 7f2f317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:06.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.304+0000 7f2f317fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:06.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.304+0000 7f2f317fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:06.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.306+0000 7f305271f800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): orig_sources= new_sources= 2024-03-09T14:43:06.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.306+0000 7f305271f800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): potential sources added=[] removed=[] 2024-03-09T14:43:06.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.306+0000 7f305271f800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): orig_dests= new_dests= 2024-03-09T14:43:06.306 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.306+0000 7f305271f800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): potential dests added=[] removed=[] 2024-03-09T14:43:06.309 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.308+0000 7f305271f800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-03-09T14:43:06.310 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.310+0000 7f2f04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:06.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.313+0000 7f305271f800 20 remove_watcher() i=0 2024-03-09T14:43:06.313 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.313+0000 7f305271f800 2 removed watcher, disabling cache 2024-03-09T14:43:06.314 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.314+0000 7f305271f800 20 remove_watcher() i=1 2024-03-09T14:43:06.315 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.315+0000 7f305271f800 20 remove_watcher() i=2 2024-03-09T14:43:06.316 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.316+0000 7f305271f800 20 remove_watcher() i=3 2024-03-09T14:43:06.317 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.317+0000 7f305271f800 20 remove_watcher() i=4 2024-03-09T14:43:06.318 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.318+0000 7f305271f800 20 remove_watcher() i=5 2024-03-09T14:43:06.319 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.319+0000 7f305271f800 20 remove_watcher() i=6 2024-03-09T14:43:06.320 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.320+0000 7f305271f800 20 remove_watcher() i=7 2024-03-09T14:43:06.332 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket myver 2024-03-09T14:43:06.358 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:06.358 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:06.392 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.390+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.393 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.392+0000 7fc3d0c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:06.393 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.392+0000 7fc3d0c15800 20 realm 2024-03-09T14:43:06.393 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.392+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.393 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.392+0000 7fc3d0c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:06.393 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.392+0000 7fc3d0c15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:06.393 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.392+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.393 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.392+0000 7fc3d0c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:06.393 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.392+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.393+0000 7fc3d0c15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:06.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.393+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.394+0000 7fc3d0c15800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:06.395 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.394+0000 7fc3d0c15800 20 searching for the correct realm 2024-03-09T14:43:06.397 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.396+0000 7fc3cc9df640 0 -- 172.21.15.88:0/2706460319 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fc3c4018040 msgr2=0x7fc3c403a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:06.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.602+0000 7fc3c39dd640 0 -- 172.21.15.88:0/2706460319 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fc3c4050960 msgr2=0x7fc3c4038430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:06.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.808+0000 7fc3d0c15800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:06.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.808+0000 7fc3d0c15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:06.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.808+0000 7fc3d0c15800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:06.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.808+0000 7fc3d0c15800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:06.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.808+0000 7fc3d0c15800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:06.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.808+0000 7fc3d0c15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:06.809 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.808+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.808+0000 7fc3d0c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:06.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.808+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.808+0000 7fc3d0c15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:06.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.808+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.809+0000 7fc3d0c15800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:06.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.809+0000 7fc3d0c15800 20 zone default found 2024-03-09T14:43:06.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.809+0000 7fc3d0c15800 4 Realm: () 2024-03-09T14:43:06.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.809+0000 7fc3d0c15800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:06.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.809+0000 7fc3d0c15800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:06.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.809+0000 7fc3d0c15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:06.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.809+0000 7fc3d0c15800 20 zonegroup default 2024-03-09T14:43:06.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.809+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.809+0000 7fc3d0c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:06.811 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.809+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.809+0000 7fc3d0c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:06.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.809+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.810+0000 7fc3d0c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:06.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.810+0000 7fc3d0c15800 20 started sync module instance, tier type = 2024-03-09T14:43:06.812 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.810+0000 7fc3d0c15800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:06.820 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.819+0000 7fc3d0c15800 20 add_watcher() i=0 2024-03-09T14:43:06.820 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.819+0000 7fc3d0c15800 20 add_watcher() i=1 2024-03-09T14:43:06.820 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.819+0000 7fc3d0c15800 20 add_watcher() i=2 2024-03-09T14:43:06.820 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.819+0000 7fc3d0c15800 20 add_watcher() i=3 2024-03-09T14:43:06.820 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.819+0000 7fc3d0c15800 20 add_watcher() i=4 2024-03-09T14:43:06.820 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.819+0000 7fc3d0c15800 20 add_watcher() i=5 2024-03-09T14:43:06.820 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.819+0000 7fc3d0c15800 20 add_watcher() i=6 2024-03-09T14:43:06.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.820+0000 7fc3d0c15800 20 add_watcher() i=7 2024-03-09T14:43:06.821 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.820+0000 7fc3d0c15800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:06.822 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.822+0000 7fc282fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:06.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.822+0000 7fc3d0c15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:06.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.822+0000 7fc3d0c15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:06.823 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.822+0000 7fc3d0c15800 5 note: GC not initialized 2024-03-09T14:43:06.824 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.822+0000 7fc281fdb640 20 reqs_thread_entry: start 2024-03-09T14:43:06.824 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.822+0000 7fc3d0c15800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:06.824 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.822+0000 7fc3d0c15800 20 Filter name: none 2024-03-09T14:43:06.824 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.822+0000 7fc1f37fe640 20 reqs_thread_entry: start 2024-03-09T14:43:06.824 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.822+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.824 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.823+0000 7fc3d0c15800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:43:06.824 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.823+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.823+0000 7fc3d0c15800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:43:06.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.823+0000 7fc3d0c15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:06.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.823+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.824+0000 7fc3d0c15800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:43:06.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.824+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.824+0000 7fc3d0c15800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:43:06.825 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.824+0000 7fc3d0c15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:06.826 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.825+0000 7fc3d0c15800 20 rados->read ofs=0 len=0 2024-03-09T14:43:06.826 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.826+0000 7fc3d0c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:06.827 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.826+0000 7fc282fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:06.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.829+0000 7fc3d0c15800 20 remove_watcher() i=0 2024-03-09T14:43:06.829 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.829+0000 7fc3d0c15800 2 removed watcher, disabling cache 2024-03-09T14:43:06.830 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.830+0000 7fc3d0c15800 20 remove_watcher() i=1 2024-03-09T14:43:06.831 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.831+0000 7fc3d0c15800 20 remove_watcher() i=2 2024-03-09T14:43:06.832 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.832+0000 7fc3d0c15800 20 remove_watcher() i=3 2024-03-09T14:43:06.833 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.833+0000 7fc3d0c15800 20 remove_watcher() i=4 2024-03-09T14:43:06.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.834+0000 7fc3d0c15800 20 remove_watcher() i=5 2024-03-09T14:43:06.835 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.835+0000 7fc3d0c15800 20 remove_watcher() i=6 2024-03-09T14:43:06.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:06.836+0000 7fc3d0c15800 20 remove_watcher() i=7 2024-03-09T14:43:06.846 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:43:06.846 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:43:06.846 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: myver id: 5d93e872-363b-498b-b665-658644296b85.4535.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-03-09T14:43:06.847 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:43:06.921 INFO:tasks.workunit.client.0.smithi088.stderr: test: reshard removes olh entries with empty name 2024-03-09T14:43:07.079 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-09T14:43:07.106 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:07.106 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:07.139 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.138+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.141 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.140+0000 7f9142211800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:07.141 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.140+0000 7f9142211800 20 realm 2024-03-09T14:43:07.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.140+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.140+0000 7f9142211800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:07.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.140+0000 7f9142211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:07.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.140+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.142 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.140+0000 7f9142211800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:07.143 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.140+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.143 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.141+0000 7f9142211800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:07.144 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.141+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.144 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.142+0000 7f9142211800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:07.144 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.142+0000 7f9142211800 20 searching for the correct realm 2024-03-09T14:43:07.145 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.144+0000 7f913e14a640 0 -- 172.21.15.88:0/3915867331 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f9138004040 msgr2=0x7f913805c830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:07.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.148+0000 7f913d148640 0 -- 172.21.15.88:0/3915867331 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f9138065b40 msgr2=0x7f9138062930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:07.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.355+0000 7f9142211800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:07.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.355+0000 7f9142211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:07.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.355+0000 7f9142211800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:07.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.355+0000 7f9142211800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:07.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.355+0000 7f9142211800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:07.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.355+0000 7f9142211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:07.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.355+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.355+0000 7f9142211800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:07.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.355+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.355+0000 7f9142211800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:07.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.355+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.355+0000 7f9142211800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:07.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.356+0000 7f9142211800 20 zone default found 2024-03-09T14:43:07.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.356+0000 7f9142211800 4 Realm: () 2024-03-09T14:43:07.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.356+0000 7f9142211800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:07.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.356+0000 7f9142211800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:07.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.356+0000 7f9142211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:07.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.356+0000 7f9142211800 20 zonegroup default 2024-03-09T14:43:07.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.356+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.356+0000 7f9142211800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:07.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.356+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.356+0000 7f9142211800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:07.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.356+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.356+0000 7f9142211800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:07.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.356+0000 7f9142211800 20 started sync module instance, tier type = 2024-03-09T14:43:07.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.356+0000 7f9142211800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:07.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.366+0000 7f9142211800 20 add_watcher() i=0 2024-03-09T14:43:07.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.366+0000 7f9142211800 20 add_watcher() i=1 2024-03-09T14:43:07.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.366+0000 7f9142211800 20 add_watcher() i=2 2024-03-09T14:43:07.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.366+0000 7f9142211800 20 add_watcher() i=3 2024-03-09T14:43:07.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.366+0000 7f9142211800 20 add_watcher() i=4 2024-03-09T14:43:07.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.366+0000 7f9142211800 20 add_watcher() i=5 2024-03-09T14:43:07.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.366+0000 7f9142211800 20 add_watcher() i=6 2024-03-09T14:43:07.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.367+0000 7f9142211800 20 add_watcher() i=7 2024-03-09T14:43:07.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.367+0000 7f9142211800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:07.369 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.368+0000 7f8fef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:07.370 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.369+0000 7f9142211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:07.370 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.369+0000 7f9142211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:07.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.369+0000 7f9142211800 5 note: GC not initialized 2024-03-09T14:43:07.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.369+0000 7f8fee7fc640 20 reqs_thread_entry: start 2024-03-09T14:43:07.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.369+0000 7f9142211800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:07.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.369+0000 7f9142211800 20 Filter name: none 2024-03-09T14:43:07.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.369+0000 7f8f5ffff640 20 reqs_thread_entry: start 2024-03-09T14:43:07.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.369+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.370+0000 7f9142211800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:43:07.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.370+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.370+0000 7f9142211800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:43:07.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.370+0000 7f9142211800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:07.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.370+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.371+0000 7f9142211800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:43:07.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.371+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.371+0000 7f9142211800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:43:07.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.371+0000 7f9142211800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:07.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.372+0000 7f9142211800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.373+0000 7f9142211800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:07.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.373+0000 7f8fef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:07.376 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.376+0000 7f9142211800 20 remove_watcher() i=0 2024-03-09T14:43:07.376 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.376+0000 7f9142211800 2 removed watcher, disabling cache 2024-03-09T14:43:07.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.377+0000 7f9142211800 20 remove_watcher() i=1 2024-03-09T14:43:07.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.378+0000 7f9142211800 20 remove_watcher() i=2 2024-03-09T14:43:07.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.379+0000 7f9142211800 20 remove_watcher() i=3 2024-03-09T14:43:07.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.380+0000 7f9142211800 20 remove_watcher() i=4 2024-03-09T14:43:07.382 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.381+0000 7f9142211800 20 remove_watcher() i=5 2024-03-09T14:43:07.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.382+0000 7f9142211800 20 remove_watcher() i=6 2024-03-09T14:43:07.384 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.383+0000 7f9142211800 20 remove_watcher() i=7 2024-03-09T14:43:07.394 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:43:07.394 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:43:07.394 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: a-bucket id: 5d93e872-363b-498b-b665-658644296b85.4535.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-03-09T14:43:07.394 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:43:07.395 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-03-09T14:43:07.423 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:07.423 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:07.456 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.455+0000 7f6493e24800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.457 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.456+0000 7f6493e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:07.457 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.456+0000 7f6493e24800 20 realm 2024-03-09T14:43:07.458 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.456+0000 7f6493e24800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.458 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.457+0000 7f6493e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:07.458 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.457+0000 7f6493e24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:07.458 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.457+0000 7f6493e24800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.458 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.457+0000 7f6493e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:07.458 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.457+0000 7f6493e24800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.459 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.458+0000 7f6493e24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:07.459 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.458+0000 7f6493e24800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.459 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.458+0000 7f6493e24800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:07.459 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.458+0000 7f6493e24800 20 searching for the correct realm 2024-03-09T14:43:07.461 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.460+0000 7f6492128640 0 -- 172.21.15.88:0/2806620912 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f648c074040 msgr2=0x7f648c05dfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:43:07.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.465+0000 7f6491126640 0 -- 172.21.15.88:0/2806620912 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f648c088b00 msgr2=0x7f648c05d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:07.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.671+0000 7f6493e24800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:07.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.671+0000 7f6493e24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:07.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.671+0000 7f6493e24800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:07.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.671+0000 7f6493e24800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:07.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.671+0000 7f6493e24800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:07.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.671+0000 7f6493e24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:07.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.671+0000 7f6493e24800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.671+0000 7f6493e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:07.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.671+0000 7f6493e24800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.673 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.672+0000 7f6493e24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:07.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.672+0000 7f6493e24800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.672+0000 7f6493e24800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:07.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.672+0000 7f6493e24800 20 zone default found 2024-03-09T14:43:07.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.672+0000 7f6493e24800 4 Realm: () 2024-03-09T14:43:07.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.672+0000 7f6493e24800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:07.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.672+0000 7f6493e24800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:07.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.672+0000 7f6493e24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:07.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.672+0000 7f6493e24800 20 zonegroup default 2024-03-09T14:43:07.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.672+0000 7f6493e24800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.672+0000 7f6493e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:07.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.672+0000 7f6493e24800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.673+0000 7f6493e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:07.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.673+0000 7f6493e24800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.673+0000 7f6493e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:07.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.673+0000 7f6493e24800 20 started sync module instance, tier type = 2024-03-09T14:43:07.675 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.673+0000 7f6493e24800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:07.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.682+0000 7f6493e24800 20 add_watcher() i=0 2024-03-09T14:43:07.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.682+0000 7f6493e24800 20 add_watcher() i=1 2024-03-09T14:43:07.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.682+0000 7f6493e24800 20 add_watcher() i=2 2024-03-09T14:43:07.683 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.682+0000 7f6493e24800 20 add_watcher() i=3 2024-03-09T14:43:07.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.682+0000 7f6493e24800 20 add_watcher() i=4 2024-03-09T14:43:07.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.682+0000 7f6493e24800 20 add_watcher() i=5 2024-03-09T14:43:07.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.682+0000 7f6493e24800 20 add_watcher() i=6 2024-03-09T14:43:07.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.683+0000 7f6493e24800 20 add_watcher() i=7 2024-03-09T14:43:07.684 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.683+0000 7f6493e24800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:07.687 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.685+0000 7f63437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:07.687 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.685+0000 7f6493e24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:07.687 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.685+0000 7f6493e24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:07.687 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.685+0000 7f6493e24800 5 note: GC not initialized 2024-03-09T14:43:07.687 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.685+0000 7f63427fc640 20 reqs_thread_entry: start 2024-03-09T14:43:07.687 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.685+0000 7f6493e24800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:07.688 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.685+0000 7f6493e24800 20 Filter name: none 2024-03-09T14:43:07.688 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.686+0000 7f62b3fff640 20 reqs_thread_entry: start 2024-03-09T14:43:07.688 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.686+0000 7f6493e24800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.688 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.687+0000 7f6493e24800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:43:07.688 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.687+0000 7f6493e24800 20 rados->read ofs=0 len=0 2024-03-09T14:43:07.689 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.687+0000 7f6493e24800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:43:07.689 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.687+0000 7f6493e24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:07.689 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.688+0000 7f63437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:07.691 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.690+0000 7f6493e24800 20 remove_watcher() i=0 2024-03-09T14:43:07.691 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.690+0000 7f6493e24800 2 removed watcher, disabling cache 2024-03-09T14:43:07.692 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.691+0000 7f6493e24800 20 remove_watcher() i=1 2024-03-09T14:43:07.693 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.693+0000 7f6493e24800 20 remove_watcher() i=2 2024-03-09T14:43:07.694 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.694+0000 7f6493e24800 20 remove_watcher() i=3 2024-03-09T14:43:07.695 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.695+0000 7f6493e24800 20 remove_watcher() i=4 2024-03-09T14:43:07.696 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.696+0000 7f6493e24800 20 remove_watcher() i=5 2024-03-09T14:43:07.697 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.697+0000 7f6493e24800 20 remove_watcher() i=6 2024-03-09T14:43:07.698 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:07.698+0000 7f6493e24800 20 remove_watcher() i=7 2024-03-09T14:43:07.710 INFO:tasks.workunit.client.0.smithi088.stderr:rados -p default.rgw.buckets.index setomapval .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-03-09T14:43:07.734 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:07.735 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:07.750 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket a-bucket 2024-03-09T14:43:07.777 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:07.777 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:08.011 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.010+0000 7fb9d9b2d800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.012+0000 7fb9d9b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.012+0000 7fb9d9b2d800 20 realm 2024-03-09T14:43:08.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.012+0000 7fb9d9b2d800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.012+0000 7fb9d9b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.012+0000 7fb9d9b2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:08.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.012+0000 7fb9d9b2d800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.013 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.012+0000 7fb9d9b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.012+0000 7fb9d9b2d800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.013+0000 7fb9d9b2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:08.014 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.013+0000 7fb9d9b2d800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.014+0000 7fb9d9b2d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:08.015 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.014+0000 7fb9d9b2d800 20 searching for the correct realm 2024-03-09T14:43:08.016 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.016+0000 7fb9d4f79640 0 -- 172.21.15.88:0/3137086207 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7fb9c80d5040 msgr2=0x7fb9c809a5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:08.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.019+0000 7fb9d5f7b640 0 -- 172.21.15.88:0/3137086207 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x55bb88add5e0 msgr2=0x55bb88adf9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:08.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.025+0000 7fb9d9b2d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:08.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.025+0000 7fb9d9b2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:08.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.025+0000 7fb9d9b2d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:08.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.025+0000 7fb9d9b2d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:08.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.025+0000 7fb9d9b2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:08.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.025+0000 7fb9d9b2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:08.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.025+0000 7fb9d9b2d800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.025+0000 7fb9d9b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.025+0000 7fb9d9b2d800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.026+0000 7fb9d9b2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:08.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.026+0000 7fb9d9b2d800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.026+0000 7fb9d9b2d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:08.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.026+0000 7fb9d9b2d800 20 zone default found 2024-03-09T14:43:08.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.026+0000 7fb9d9b2d800 4 Realm: () 2024-03-09T14:43:08.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.026+0000 7fb9d9b2d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:08.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.026+0000 7fb9d9b2d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:08.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.026+0000 7fb9d9b2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:08.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.026+0000 7fb9d9b2d800 20 zonegroup default 2024-03-09T14:43:08.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.026+0000 7fb9d9b2d800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.026+0000 7fb9d9b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.026+0000 7fb9d9b2d800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.027+0000 7fb9d9b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.027+0000 7fb9d9b2d800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.027+0000 7fb9d9b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.027+0000 7fb9d9b2d800 20 started sync module instance, tier type = 2024-03-09T14:43:08.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.027+0000 7fb9d9b2d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:08.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.036+0000 7fb9d9b2d800 20 add_watcher() i=0 2024-03-09T14:43:08.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.036+0000 7fb9d9b2d800 20 add_watcher() i=1 2024-03-09T14:43:08.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.036+0000 7fb9d9b2d800 20 add_watcher() i=2 2024-03-09T14:43:08.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.036+0000 7fb9d9b2d800 20 add_watcher() i=3 2024-03-09T14:43:08.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.036+0000 7fb9d9b2d800 20 add_watcher() i=4 2024-03-09T14:43:08.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.036+0000 7fb9d9b2d800 20 add_watcher() i=5 2024-03-09T14:43:08.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.036+0000 7fb9d9b2d800 20 add_watcher() i=6 2024-03-09T14:43:08.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.037+0000 7fb9d9b2d800 20 add_watcher() i=7 2024-03-09T14:43:08.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.037+0000 7fb9d9b2d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:08.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.039+0000 7fb88b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:08.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.039+0000 7fb9d9b2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:08.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.039+0000 7fb9d9b2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:08.040 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.039+0000 7fb9d9b2d800 5 note: GC not initialized 2024-03-09T14:43:08.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.039+0000 7fb88a7e4640 20 reqs_thread_entry: start 2024-03-09T14:43:08.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.039+0000 7fb9d9b2d800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:08.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.039+0000 7fb9d9b2d800 20 Filter name: none 2024-03-09T14:43:08.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.040+0000 7fb7fbfff640 20 reqs_thread_entry: start 2024-03-09T14:43:08.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.040+0000 7fb9d9b2d800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.040+0000 7fb9d9b2d800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:43:08.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.040+0000 7fb9d9b2d800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.040+0000 7fb9d9b2d800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:43:08.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.040+0000 7fb9d9b2d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:08.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.040+0000 7fb9d9b2d800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-09T14:43:08.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.040+0000 7fb9d9b2d800 20 INFO: main: starting shard=0 2024-03-09T14:43:08.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.040+0000 7fb9d9b2d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.0 2024-03-09T14:43:08.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.040+0000 7fb9d9b2d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.0 2024-03-09T14:43:08.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.041+0000 7fb9d9b2d800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:43:08.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.041+0000 7fb9d9b2d800 20 INFO: main: starting shard=1 2024-03-09T14:43:08.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.041+0000 7fb9d9b2d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.1 2024-03-09T14:43:08.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.041+0000 7fb9d9b2d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.1 2024-03-09T14:43:08.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.042+0000 7fb9d9b2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:08.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.042+0000 7fb9d9b2d800 20 INFO: main: starting shard=2 2024-03-09T14:43:08.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.042+0000 7fb9d9b2d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.2 2024-03-09T14:43:08.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.042+0000 7fb9d9b2d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.2 2024-03-09T14:43:08.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.042+0000 7fb9d9b2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:08.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.042+0000 7fb9d9b2d800 20 INFO: main: starting shard=3 2024-03-09T14:43:08.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.042+0000 7fb9d9b2d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.3 2024-03-09T14:43:08.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.042+0000 7fb9d9b2d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.3 2024-03-09T14:43:08.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.042+0000 7fb9d9b2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:08.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.042+0000 7fb9d9b2d800 20 INFO: main: starting shard=4 2024-03-09T14:43:08.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.042+0000 7fb9d9b2d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.4 2024-03-09T14:43:08.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.042+0000 7fb9d9b2d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.4 2024-03-09T14:43:08.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.043+0000 7fb9d9b2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:08.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.043+0000 7fb9d9b2d800 20 INFO: main: starting shard=5 2024-03-09T14:43:08.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.043+0000 7fb9d9b2d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.5 2024-03-09T14:43:08.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.043+0000 7fb9d9b2d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.5 2024-03-09T14:43:08.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.043+0000 7fb9d9b2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:08.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.043+0000 7fb9d9b2d800 20 INFO: main: starting shard=6 2024-03-09T14:43:08.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.043+0000 7fb9d9b2d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.6 2024-03-09T14:43:08.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.043+0000 7fb9d9b2d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.6 2024-03-09T14:43:08.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.044+0000 7fb9d9b2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:08.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.044+0000 7fb9d9b2d800 20 INFO: main: starting shard=7 2024-03-09T14:43:08.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.044+0000 7fb9d9b2d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.7 2024-03-09T14:43:08.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.044+0000 7fb9d9b2d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.7 2024-03-09T14:43:08.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.044+0000 7fb9d9b2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:08.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.044+0000 7fb9d9b2d800 20 INFO: main: starting shard=8 2024-03-09T14:43:08.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.044+0000 7fb9d9b2d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.8 2024-03-09T14:43:08.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.044+0000 7fb9d9b2d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.8 2024-03-09T14:43:08.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.045+0000 7fb9d9b2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:08.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.045+0000 7fb9d9b2d800 20 INFO: main: starting shard=9 2024-03-09T14:43:08.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.045+0000 7fb9d9b2d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.9 2024-03-09T14:43:08.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.045+0000 7fb9d9b2d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.9 2024-03-09T14:43:08.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.045+0000 7fb9d9b2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:08.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.045+0000 7fb9d9b2d800 20 INFO: main: starting shard=10 2024-03-09T14:43:08.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.045+0000 7fb9d9b2d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.10 2024-03-09T14:43:08.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.045+0000 7fb9d9b2d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.10 2024-03-09T14:43:08.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.046+0000 7fb9d9b2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:08.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.046+0000 7fb9d9b2d800 20 INFO: main: starting shard=11 2024-03-09T14:43:08.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.046+0000 7fb9d9b2d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.11 2024-03-09T14:43:08.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.046+0000 7fb9d9b2d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.11 2024-03-09T14:43:08.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.046+0000 7fb9d9b2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:08.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.046+0000 7fb9d9b2d800 20 INFO: main: starting shard=12 2024-03-09T14:43:08.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.046+0000 7fb9d9b2d800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.12 2024-03-09T14:43:08.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.046+0000 7fb9d9b2d800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.12 2024-03-09T14:43:08.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.047+0000 7fb9d9b2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:08.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.047+0000 7fb9d9b2d800 20 INFO: main: done 2024-03-09T14:43:08.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.047+0000 7fb88b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:08.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.050+0000 7fb9d9b2d800 20 remove_watcher() i=0 2024-03-09T14:43:08.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.050+0000 7fb9d9b2d800 2 removed watcher, disabling cache 2024-03-09T14:43:08.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.051+0000 7fb9d9b2d800 20 remove_watcher() i=1 2024-03-09T14:43:08.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.052+0000 7fb9d9b2d800 20 remove_watcher() i=2 2024-03-09T14:43:08.053 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.053+0000 7fb9d9b2d800 20 remove_watcher() i=3 2024-03-09T14:43:08.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.054+0000 7fb9d9b2d800 20 remove_watcher() i=4 2024-03-09T14:43:08.055 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.055+0000 7fb9d9b2d800 20 remove_watcher() i=5 2024-03-09T14:43:08.056 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.055+0000 7fb9d9b2d800 20 remove_watcher() i=6 2024-03-09T14:43:08.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.056+0000 7fb9d9b2d800 20 remove_watcher() i=7 2024-03-09T14:43:08.068 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-03-09T14:43:08.098 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:08.098 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:08.132 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.131+0000 7f29491a2800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.133 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.132+0000 7f29491a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.133 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.132+0000 7f29491a2800 20 realm 2024-03-09T14:43:08.133 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.132+0000 7f29491a2800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.133 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.132+0000 7f29491a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.133 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.132+0000 7f29491a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:08.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.132+0000 7f29491a2800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.132+0000 7f29491a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.132+0000 7f29491a2800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.133+0000 7f29491a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:08.134 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.133+0000 7f29491a2800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.336 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.335+0000 7f29491a2800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:08.336 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.335+0000 7f29491a2800 20 searching for the correct realm 2024-03-09T14:43:08.337 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.337+0000 7f29474a6640 0 -- 172.21.15.88:0/3260530710 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x55633a346470 msgr2=0x55633a348860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:08.341 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.341+0000 7f293ffff640 0 -- 172.21.15.88:0/3260530710 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f293807c400 msgr2=0x7f293807c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:08.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.346+0000 7f29491a2800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:08.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.346+0000 7f29491a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:08.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.346+0000 7f29491a2800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:08.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.346+0000 7f29491a2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:08.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.346+0000 7f29491a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:08.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.346+0000 7f29491a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:08.349 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.346+0000 7f29491a2800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.347+0000 7f29491a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.347+0000 7f29491a2800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.347+0000 7f29491a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:08.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.347+0000 7f29491a2800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.347+0000 7f29491a2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:08.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.347+0000 7f29491a2800 20 zone default found 2024-03-09T14:43:08.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.347+0000 7f29491a2800 4 Realm: () 2024-03-09T14:43:08.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.347+0000 7f29491a2800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:08.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.347+0000 7f29491a2800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:08.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.347+0000 7f29491a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:08.350 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.347+0000 7f29491a2800 20 zonegroup default 2024-03-09T14:43:08.351 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.347+0000 7f29491a2800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.351 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.347+0000 7f29491a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.351 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.347+0000 7f29491a2800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.351 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.348+0000 7f29491a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.351 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.348+0000 7f29491a2800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.351 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.348+0000 7f29491a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.351 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.348+0000 7f29491a2800 20 started sync module instance, tier type = 2024-03-09T14:43:08.351 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.348+0000 7f29491a2800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:08.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.357+0000 7f29491a2800 20 add_watcher() i=0 2024-03-09T14:43:08.358 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.357+0000 7f29491a2800 20 add_watcher() i=1 2024-03-09T14:43:08.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.357+0000 7f29491a2800 20 add_watcher() i=2 2024-03-09T14:43:08.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.357+0000 7f29491a2800 20 add_watcher() i=3 2024-03-09T14:43:08.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.357+0000 7f29491a2800 20 add_watcher() i=4 2024-03-09T14:43:08.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.357+0000 7f29491a2800 20 add_watcher() i=5 2024-03-09T14:43:08.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.357+0000 7f29491a2800 20 add_watcher() i=6 2024-03-09T14:43:08.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.359+0000 7f29491a2800 20 add_watcher() i=7 2024-03-09T14:43:08.359 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.359+0000 7f29491a2800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:08.361 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.360+0000 7f27fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:08.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.361+0000 7f29491a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:08.362 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.361+0000 7f29491a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:08.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.361+0000 7f29491a2800 5 note: GC not initialized 2024-03-09T14:43:08.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.361+0000 7f2777fff640 20 reqs_thread_entry: start 2024-03-09T14:43:08.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.361+0000 7f29491a2800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:08.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.361+0000 7f29491a2800 20 Filter name: none 2024-03-09T14:43:08.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.361+0000 7f2775ffb640 20 reqs_thread_entry: start 2024-03-09T14:43:08.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.361+0000 7f29491a2800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-09T14:43:08.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.361+0000 7f29491a2800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.362+0000 7f29491a2800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:43:08.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.362+0000 7f29491a2800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-03-09T14:43:08.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.362+0000 7f29491a2800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-09T14:43:08.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.362+0000 7f29491a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 : miss 2024-03-09T14:43:08.363 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.362+0000 7f29491a2800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.362+0000 7f29491a2800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:43:08.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.362+0000 7f29491a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:43:08.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.362+0000 7f29491a2800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:43:08.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.362+0000 7f29491a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:43:08.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.362+0000 7f29491a2800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:08.364 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.362+0000 7f29491a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 2024-03-09T14:43:08.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.366+0000 7f29491a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:43:08.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.366+0000 7f29491a2800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:43:08.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.366+0000 7f29491a2800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:08.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.366+0000 7f29491a2800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17, ofs0, ns] 2024-03-09T14:43:08.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.366+0000 7f2829ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464295 cookie 93884666671712 notifier 7140 bl.length()=819 2024-03-09T14:43:08.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.366+0000 7f2829ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:43:08.367 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.366+0000 7f2829ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:43:08.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.366+0000 7f2829ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:08.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.368+0000 7f29491a2800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): orig_sources= new_sources= 2024-03-09T14:43:08.368 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.368+0000 7f29491a2800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): potential sources added=[] removed=[] 2024-03-09T14:43:08.369 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.368+0000 7f29491a2800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): orig_dests= new_dests= 2024-03-09T14:43:08.369 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.368+0000 7f29491a2800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): potential dests added=[] removed=[] 2024-03-09T14:43:08.371 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.371+0000 7f29491a2800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.3.0 2024-03-09T14:43:08.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.371+0000 7f29491a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.3.0 2024-03-09T14:43:08.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.371+0000 7f29491a2800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.0 2024-03-09T14:43:08.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.371+0000 7f29491a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.0 2024-03-09T14:43:08.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.371+0000 7f29491a2800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-03-09T14:43:08.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.371+0000 7f29491a2800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.1 2024-03-09T14:43:08.372 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.371+0000 7f29491a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.1 2024-03-09T14:43:08.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.372+0000 7f29491a2800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.2 2024-03-09T14:43:08.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.372+0000 7f29491a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.2 2024-03-09T14:43:08.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.372+0000 7f29491a2800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.3 2024-03-09T14:43:08.373 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.372+0000 7f29491a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.3 2024-03-09T14:43:08.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.373+0000 7f29491a2800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.4 2024-03-09T14:43:08.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.373+0000 7f29491a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.4 2024-03-09T14:43:08.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.373+0000 7f29491a2800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.5 2024-03-09T14:43:08.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.373+0000 7f29491a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.5 2024-03-09T14:43:08.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.374+0000 7f29491a2800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.6 2024-03-09T14:43:08.374 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.374+0000 7f29491a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.6 2024-03-09T14:43:08.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.374+0000 7f29491a2800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.7 2024-03-09T14:43:08.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.374+0000 7f29491a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.7 2024-03-09T14:43:08.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.375+0000 7f29491a2800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.8 2024-03-09T14:43:08.375 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.375+0000 7f29491a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.8 2024-03-09T14:43:08.376 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.375+0000 7f29491a2800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.9 2024-03-09T14:43:08.376 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.375+0000 7f29491a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.9 2024-03-09T14:43:08.376 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.375+0000 7f29491a2800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.10 2024-03-09T14:43:08.376 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.375+0000 7f29491a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.10 2024-03-09T14:43:08.377 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.376+0000 7f29491a2800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.11 2024-03-09T14:43:08.377 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.376+0000 7f29491a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.11 2024-03-09T14:43:08.377 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.377+0000 7f29491a2800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.12 2024-03-09T14:43:08.377 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.377+0000 7f29491a2800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.2.12 2024-03-09T14:43:08.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.377+0000 7f29491a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 : hit (requested=0x17, cached=0x17) 2024-03-09T14:43:08.378 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.377+0000 7f29491a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 2024-03-09T14:43:08.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.378+0000 7f29491a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:43:08.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.378+0000 7f29491a2800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:43:08.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.378+0000 7f29491a2800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:08.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.378+0000 7f29491a2800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17, ofs0, ns] 2024-03-09T14:43:08.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.379+0000 7f282a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464296 cookie 93884666671712 notifier 7140 bl.length()=787 2024-03-09T14:43:08.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.379+0000 7f282a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 info.flags=0x17 2024-03-09T14:43:08.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.379+0000 7f282a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:5d93e872-363b-498b-b665-658644296b85.4535.17 to cache LRU end 2024-03-09T14:43:08.379 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.379+0000 7f282a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:08.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.380+0000 7f29491a2800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): orig_sources= new_sources= 2024-03-09T14:43:08.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.380+0000 7f29491a2800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): potential sources added=[] removed=[] 2024-03-09T14:43:08.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.380+0000 7f29491a2800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): orig_dests= new_dests= 2024-03-09T14:43:08.381 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.380+0000 7f29491a2800 20 handle_bi_update(): bucket=:a-bucket[5d93e872-363b-498b-b665-658644296b85.4535.17]): potential dests added=[] removed=[] 2024-03-09T14:43:08.383 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.383+0000 7f29491a2800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-03-09T14:43:08.385 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.384+0000 7f27fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:08.387 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.386+0000 7f29491a2800 20 remove_watcher() i=0 2024-03-09T14:43:08.387 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.387+0000 7f29491a2800 2 removed watcher, disabling cache 2024-03-09T14:43:08.388 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.387+0000 7f29491a2800 20 remove_watcher() i=1 2024-03-09T14:43:08.389 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.388+0000 7f29491a2800 20 remove_watcher() i=2 2024-03-09T14:43:08.390 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.390+0000 7f29491a2800 20 remove_watcher() i=3 2024-03-09T14:43:08.391 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.391+0000 7f29491a2800 20 remove_watcher() i=4 2024-03-09T14:43:08.392 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.392+0000 7f29491a2800 20 remove_watcher() i=5 2024-03-09T14:43:08.393 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.392+0000 7f29491a2800 20 remove_watcher() i=6 2024-03-09T14:43:08.394 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.393+0000 7f29491a2800 20 remove_watcher() i=7 2024-03-09T14:43:08.405 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket a-bucket 2024-03-09T14:43:08.432 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:08.432 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:08.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.464+0000 7f23ada16800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.466+0000 7f23ada16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.466+0000 7f23ada16800 20 realm 2024-03-09T14:43:08.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.466+0000 7f23ada16800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.466+0000 7f23ada16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.466+0000 7f23ada16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:08.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.466+0000 7f23ada16800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.466+0000 7f23ada16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.467 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.466+0000 7f23ada16800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.468 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.467+0000 7f23ada16800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:08.468 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.467+0000 7f23ada16800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.468 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.468+0000 7f23ada16800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:08.469 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.468+0000 7f23ada16800 20 searching for the correct realm 2024-03-09T14:43:08.470 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.470+0000 7f23a995f640 0 -- 172.21.15.88:0/2269936809 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f23a403f070 msgr2=0x7f23a404e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:08.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.676+0000 7f23a895d640 0 -- 172.21.15.88:0/2269936809 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f23a405f930 msgr2=0x7f23a40323f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:08.883 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.882+0000 7f23ada16800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:08.883 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.882+0000 7f23ada16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:08.884 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.882+0000 7f23ada16800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:08.884 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.882+0000 7f23ada16800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:08.884 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.882+0000 7f23ada16800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:08.884 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.882+0000 7f23ada16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:08.884 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.882+0000 7f23ada16800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.884 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.883+0000 7f23ada16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.884 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.883+0000 7f23ada16800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.885 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.883+0000 7f23ada16800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:08.885 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.883+0000 7f23ada16800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.883+0000 7f23ada16800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:08.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.883+0000 7f23ada16800 20 zone default found 2024-03-09T14:43:08.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.883+0000 7f23ada16800 4 Realm: () 2024-03-09T14:43:08.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.883+0000 7f23ada16800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:08.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.883+0000 7f23ada16800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:08.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.883+0000 7f23ada16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:08.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.883+0000 7f23ada16800 20 zonegroup default 2024-03-09T14:43:08.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.883+0000 7f23ada16800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.884+0000 7f23ada16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.884+0000 7f23ada16800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.884+0000 7f23ada16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.884+0000 7f23ada16800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.884+0000 7f23ada16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.886 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.884+0000 7f23ada16800 20 started sync module instance, tier type = 2024-03-09T14:43:08.887 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.884+0000 7f23ada16800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:08.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.894+0000 7f23ada16800 20 add_watcher() i=0 2024-03-09T14:43:08.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.894+0000 7f23ada16800 20 add_watcher() i=1 2024-03-09T14:43:08.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.894+0000 7f23ada16800 20 add_watcher() i=2 2024-03-09T14:43:08.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.894+0000 7f23ada16800 20 add_watcher() i=3 2024-03-09T14:43:08.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.894+0000 7f23ada16800 20 add_watcher() i=4 2024-03-09T14:43:08.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.894+0000 7f23ada16800 20 add_watcher() i=5 2024-03-09T14:43:08.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.894+0000 7f23ada16800 20 add_watcher() i=6 2024-03-09T14:43:08.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.894+0000 7f23ada16800 20 add_watcher() i=7 2024-03-09T14:43:08.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.894+0000 7f23ada16800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:08.897 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.896+0000 7f225f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:08.897 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.896+0000 7f23ada16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:08.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.896+0000 7f23ada16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:08.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.896+0000 7f23ada16800 5 note: GC not initialized 2024-03-09T14:43:08.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.897+0000 7f225e7e4640 20 reqs_thread_entry: start 2024-03-09T14:43:08.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.897+0000 7f23ada16800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:08.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.897+0000 7f23ada16800 20 Filter name: none 2024-03-09T14:43:08.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.897+0000 7f21cffff640 20 reqs_thread_entry: start 2024-03-09T14:43:08.898 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.897+0000 7f23ada16800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.897+0000 7f23ada16800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:43:08.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.897+0000 7f23ada16800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.898+0000 7f23ada16800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:43:08.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.898+0000 7f23ada16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:08.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.898+0000 7f23ada16800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-03-09T14:43:08.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.898+0000 7f23ada16800 20 INFO: main: starting shard=0 2024-03-09T14:43:08.899 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.898+0000 7f23ada16800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.17.3.0 2024-03-09T14:43:08.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.898+0000 7f23ada16800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.17.3.0 2024-03-09T14:43:08.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.898+0000 7f23ada16800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:08.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.898+0000 7f23ada16800 20 INFO: main: done 2024-03-09T14:43:08.900 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.899+0000 7f225f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:08.902 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.901+0000 7f23ada16800 20 remove_watcher() i=0 2024-03-09T14:43:08.902 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.901+0000 7f23ada16800 2 removed watcher, disabling cache 2024-03-09T14:43:08.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.902+0000 7f23ada16800 20 remove_watcher() i=1 2024-03-09T14:43:08.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.903+0000 7f23ada16800 20 remove_watcher() i=2 2024-03-09T14:43:08.905 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.904+0000 7f23ada16800 20 remove_watcher() i=3 2024-03-09T14:43:08.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.905+0000 7f23ada16800 20 remove_watcher() i=4 2024-03-09T14:43:08.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.906+0000 7f23ada16800 20 remove_watcher() i=5 2024-03-09T14:43:08.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.907+0000 7f23ada16800 20 remove_watcher() i=6 2024-03-09T14:43:08.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.908+0000 7f23ada16800 20 remove_watcher() i=7 2024-03-09T14:43:08.919 INFO:tasks.workunit.client.0.smithi088.stderr: test: PUT succeeds during reshard 2024-03-09T14:43:08.920 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket myver 2024-03-09T14:43:08.947 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:08.948 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:08.980 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.980+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.981+0000 7f9935216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.981+0000 7f9935216800 20 realm 2024-03-09T14:43:08.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.981+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.981+0000 7f9935216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.981+0000 7f9935216800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:08.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.981+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.982 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.981+0000 7f9935216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:08.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.981+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.982+0000 7f9935216800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:08.983 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.982+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:08.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.983+0000 7f9935216800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:08.984 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.983+0000 7f9935216800 20 searching for the correct realm 2024-03-09T14:43:08.986 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.986+0000 7f993109b640 0 -- 172.21.15.88:0/4006898446 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f992005e040 msgr2=0x7f992008bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:08.990 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:08.990+0000 7f9930099640 0 -- 172.21.15.88:0/4006898446 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f992009a410 msgr2=0x7f992009a870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:09.197 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.195+0000 7f9935216800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:09.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.195+0000 7f9935216800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:09.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.195+0000 7f9935216800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:09.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.195+0000 7f9935216800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:09.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.195+0000 7f9935216800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:09.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.195+0000 7f9935216800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:09.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.195+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.196+0000 7f9935216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:09.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.196+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.196+0000 7f9935216800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:09.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.196+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.196+0000 7f9935216800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:09.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.196+0000 7f9935216800 20 zone default found 2024-03-09T14:43:09.198 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.196+0000 7f9935216800 4 Realm: () 2024-03-09T14:43:09.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.196+0000 7f9935216800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:09.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.196+0000 7f9935216800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:09.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.196+0000 7f9935216800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:09.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.196+0000 7f9935216800 20 zonegroup default 2024-03-09T14:43:09.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.196+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.196+0000 7f9935216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:09.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.196+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.197+0000 7f9935216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:09.199 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.197+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.197+0000 7f9935216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:09.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.197+0000 7f9935216800 20 started sync module instance, tier type = 2024-03-09T14:43:09.200 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.197+0000 7f9935216800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:09.207 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.206+0000 7f9935216800 20 add_watcher() i=0 2024-03-09T14:43:09.207 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.206+0000 7f9935216800 20 add_watcher() i=1 2024-03-09T14:43:09.207 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.206+0000 7f9935216800 20 add_watcher() i=2 2024-03-09T14:43:09.207 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.206+0000 7f9935216800 20 add_watcher() i=3 2024-03-09T14:43:09.207 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.206+0000 7f9935216800 20 add_watcher() i=4 2024-03-09T14:43:09.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.206+0000 7f9935216800 20 add_watcher() i=5 2024-03-09T14:43:09.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.206+0000 7f9935216800 20 add_watcher() i=6 2024-03-09T14:43:09.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.207+0000 7f9935216800 20 add_watcher() i=7 2024-03-09T14:43:09.208 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.207+0000 7f9935216800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:09.209 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.209+0000 7f97e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:09.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.209+0000 7f9935216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:09.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.209+0000 7f9935216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:09.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.209+0000 7f9935216800 5 note: GC not initialized 2024-03-09T14:43:09.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.209+0000 7f97e5fe3640 20 reqs_thread_entry: start 2024-03-09T14:43:09.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.209+0000 7f9935216800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:09.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.210+0000 7f9935216800 20 Filter name: none 2024-03-09T14:43:09.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.210+0000 7f97577fe640 20 reqs_thread_entry: start 2024-03-09T14:43:09.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.210+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.210+0000 7f9935216800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:43:09.211 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.210+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.211+0000 7f9935216800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:43:09.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.211+0000 7f9935216800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:09.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.211+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.211+0000 7f9935216800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:43:09.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.211+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.211+0000 7f9935216800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:43:09.212 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.211+0000 7f9935216800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:09.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.212+0000 7f9935216800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.213 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.213+0000 7f9935216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:09.214 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.213+0000 7f97e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:09.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.216+0000 7f9935216800 20 remove_watcher() i=0 2024-03-09T14:43:09.216 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.216+0000 7f9935216800 2 removed watcher, disabling cache 2024-03-09T14:43:09.218 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.217+0000 7f9935216800 20 remove_watcher() i=1 2024-03-09T14:43:09.219 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.218+0000 7f9935216800 20 remove_watcher() i=2 2024-03-09T14:43:09.220 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.219+0000 7f9935216800 20 remove_watcher() i=3 2024-03-09T14:43:09.221 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.221+0000 7f9935216800 20 remove_watcher() i=4 2024-03-09T14:43:09.222 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.222+0000 7f9935216800 20 remove_watcher() i=5 2024-03-09T14:43:09.223 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.222+0000 7f9935216800 20 remove_watcher() i=6 2024-03-09T14:43:09.224 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.223+0000 7f9935216800 20 remove_watcher() i=7 2024-03-09T14:43:09.234 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:43:09.234 INFO:tasks.workunit.client.0.smithi088.stderr:BUCKET_STATS: 2024-03-09T14:43:09.234 INFO:tasks.workunit.client.0.smithi088.stderr:bucket: myver id: 5d93e872-363b-498b-b665-658644296b85.4535.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-03-09T14:43:09.234 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:43:09.235 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-03-09T14:43:09.266 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:09.266 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:09.300 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.299+0000 7f4d31333800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.301 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.300+0000 7f4d31333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:09.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.300+0000 7f4d31333800 20 realm 2024-03-09T14:43:09.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.300+0000 7f4d31333800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.301+0000 7f4d31333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:09.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.301+0000 7f4d31333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:09.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.301+0000 7f4d31333800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.301+0000 7f4d31333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:09.302 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.301+0000 7f4d31333800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.303 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.302+0000 7f4d31333800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:09.303 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.302+0000 7f4d31333800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.303 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.302+0000 7f4d31333800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:09.303 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.302+0000 7f4d31333800 20 searching for the correct realm 2024-03-09T14:43:09.305 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.304+0000 7f4d2d865640 0 -- 172.21.15.88:0/2473536984 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f4d28058e20 msgr2=0x7f4d28057a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:43:09.510 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.510+0000 7f4d2d865640 0 -- 172.21.15.88:0/2473536984 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x55dadcb94570 msgr2=0x55dadcb96980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:09.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.515+0000 7f4d31333800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:09.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.515+0000 7f4d31333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:09.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.515+0000 7f4d31333800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:09.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.515+0000 7f4d31333800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:09.516 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.515+0000 7f4d31333800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:09.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.515+0000 7f4d31333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:09.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.515+0000 7f4d31333800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.516+0000 7f4d31333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:09.517 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.516+0000 7f4d31333800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.516+0000 7f4d31333800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:09.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.516+0000 7f4d31333800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.516+0000 7f4d31333800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:09.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.516+0000 7f4d31333800 20 zone default found 2024-03-09T14:43:09.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.516+0000 7f4d31333800 4 Realm: () 2024-03-09T14:43:09.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.516+0000 7f4d31333800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:09.518 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.516+0000 7f4d31333800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:09.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.516+0000 7f4d31333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:09.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.516+0000 7f4d31333800 20 zonegroup default 2024-03-09T14:43:09.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.516+0000 7f4d31333800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.517+0000 7f4d31333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:09.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.517+0000 7f4d31333800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.517+0000 7f4d31333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:09.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.517+0000 7f4d31333800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.517+0000 7f4d31333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:09.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.517+0000 7f4d31333800 20 started sync module instance, tier type = 2024-03-09T14:43:09.519 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.517+0000 7f4d31333800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:09.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.527+0000 7f4d31333800 20 add_watcher() i=0 2024-03-09T14:43:09.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.527+0000 7f4d31333800 20 add_watcher() i=1 2024-03-09T14:43:09.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.527+0000 7f4d31333800 20 add_watcher() i=2 2024-03-09T14:43:09.527 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.527+0000 7f4d31333800 20 add_watcher() i=3 2024-03-09T14:43:09.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.527+0000 7f4d31333800 20 add_watcher() i=4 2024-03-09T14:43:09.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.527+0000 7f4d31333800 20 add_watcher() i=5 2024-03-09T14:43:09.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.527+0000 7f4d31333800 20 add_watcher() i=6 2024-03-09T14:43:09.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.527+0000 7f4d31333800 20 add_watcher() i=7 2024-03-09T14:43:09.528 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.527+0000 7f4d31333800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:09.530 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.530+0000 7f4be3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:09.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.530+0000 7f4d31333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:09.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.530+0000 7f4d31333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:09.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.530+0000 7f4d31333800 5 note: GC not initialized 2024-03-09T14:43:09.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.530+0000 7f4be2fe5640 20 reqs_thread_entry: start 2024-03-09T14:43:09.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.530+0000 7f4d31333800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:09.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.530+0000 7f4d31333800 20 Filter name: none 2024-03-09T14:43:09.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.530+0000 7f4be0fe1640 20 reqs_thread_entry: start 2024-03-09T14:43:09.531 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.530+0000 7f4d31333800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-09T14:43:09.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.530+0000 7f4d31333800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.531+0000 7f4d31333800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:43:09.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.531+0000 7f4d31333800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-09T14:43:09.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.531+0000 7f4d31333800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-09T14:43:09.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.531+0000 7f4d31333800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 : miss 2024-03-09T14:43:09.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.531+0000 7f4d31333800 20 rados->read ofs=0 len=0 2024-03-09T14:43:09.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.531+0000 7f4d31333800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:43:09.532 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.531+0000 7f4d31333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:09.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.531+0000 7f4d31333800 10 adding default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:09.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.531+0000 7f4d31333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:43:09.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.531+0000 7f4d31333800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:09.533 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.531+0000 7f4d31333800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 2024-03-09T14:43:09.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.537+0000 7f4d31333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:09.538 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.537+0000 7f4d31333800 10 moving default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:09.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.537+0000 7f4d31333800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:09.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.537+0000 7f4d31333800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18, ofs0, ns] 2024-03-09T14:43:09.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.538+0000 7f4bfffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464372 cookie 94398494402848 notifier 6851 bl.length()=813 2024-03-09T14:43:09.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.538+0000 7f4bfffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:09.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.538+0000 7f4bfffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:09.539 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.538+0000 7f4bfffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:09.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.540+0000 7f4d31333800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): orig_sources= new_sources= 2024-03-09T14:43:09.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.540+0000 7f4d31333800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): potential sources added=[] removed=[] 2024-03-09T14:43:09.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.540+0000 7f4d31333800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): orig_dests= new_dests= 2024-03-09T14:43:09.540 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.540+0000 7f4d31333800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): potential dests added=[] removed=[] 2024-03-09T14:43:09.543 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:09.542+0000 7f4d31333800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-03-09T14:43:14.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.0 2024-03-09T14:43:14.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.0 2024-03-09T14:43:14.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.1 2024-03-09T14:43:14.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.1 2024-03-09T14:43:14.544 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.2 2024-03-09T14:43:14.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.2 2024-03-09T14:43:14.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.3 2024-03-09T14:43:14.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.3 2024-03-09T14:43:14.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.4 2024-03-09T14:43:14.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.4 2024-03-09T14:43:14.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.5 2024-03-09T14:43:14.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.5 2024-03-09T14:43:14.545 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.6 2024-03-09T14:43:14.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.6 2024-03-09T14:43:14.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.7 2024-03-09T14:43:14.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.7 2024-03-09T14:43:14.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.8 2024-03-09T14:43:14.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.8 2024-03-09T14:43:14.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.9 2024-03-09T14:43:14.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.9 2024-03-09T14:43:14.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.10 2024-03-09T14:43:14.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.10 2024-03-09T14:43:14.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.11 2024-03-09T14:43:14.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.11 2024-03-09T14:43:14.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.12 2024-03-09T14:43:14.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.12 2024-03-09T14:43:14.546 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.0 2024-03-09T14:43:14.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.0 2024-03-09T14:43:14.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.1 2024-03-09T14:43:14.547 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.543+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.1 2024-03-09T14:43:14.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.544+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.2 2024-03-09T14:43:14.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.544+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.2 2024-03-09T14:43:14.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.545+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.3 2024-03-09T14:43:14.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.545+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.3 2024-03-09T14:43:14.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.545+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.4 2024-03-09T14:43:14.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.545+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.4 2024-03-09T14:43:14.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.546+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.5 2024-03-09T14:43:14.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.546+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.5 2024-03-09T14:43:14.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.546+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.6 2024-03-09T14:43:14.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.546+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.6 2024-03-09T14:43:14.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.547+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.7 2024-03-09T14:43:14.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.547+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.7 2024-03-09T14:43:14.548 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.547+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.8 2024-03-09T14:43:14.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.547+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.8 2024-03-09T14:43:14.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.548+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.9 2024-03-09T14:43:14.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.548+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.9 2024-03-09T14:43:14.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.549+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.10 2024-03-09T14:43:14.549 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.549+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.10 2024-03-09T14:43:14.550 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.549+0000 7f4d31333800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.11 2024-03-09T14:43:14.550 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.549+0000 7f4d31333800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.1.11 2024-03-09T14:43:14.550 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.550+0000 7f4d31333800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 : hit (requested=0x17, cached=0x17) 2024-03-09T14:43:14.551 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.550+0000 7f4d31333800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 2024-03-09T14:43:14.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.552+0000 7f4d31333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:14.552 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.552+0000 7f4d31333800 10 moving default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:14.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.552+0000 7f4d31333800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:14.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.552+0000 7f4d31333800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18, ofs0, ns] 2024-03-09T14:43:14.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.552+0000 7f4c10ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464373 cookie 94398494402848 notifier 6851 bl.length()=781 2024-03-09T14:43:14.553 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.552+0000 7f4c10ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:14.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.552+0000 7f4c10ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:14.554 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.552+0000 7f4c10ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:14.555 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.554+0000 7f4d31333800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): orig_sources= new_sources= 2024-03-09T14:43:14.555 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.554+0000 7f4d31333800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): potential sources added=[] removed=[] 2024-03-09T14:43:14.555 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.554+0000 7f4d31333800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): orig_dests= new_dests= 2024-03-09T14:43:14.555 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.554+0000 7f4d31333800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): potential dests added=[] removed=[] 2024-03-09T14:43:14.558 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.558+0000 7f4d31333800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-03-09T14:43:14.561 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.560+0000 7f4be3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:14.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.563+0000 7f4d31333800 20 remove_watcher() i=0 2024-03-09T14:43:14.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.563+0000 7f4d31333800 2 removed watcher, disabling cache 2024-03-09T14:43:14.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.564+0000 7f4d31333800 20 remove_watcher() i=1 2024-03-09T14:43:14.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.566+0000 7f4d31333800 20 remove_watcher() i=2 2024-03-09T14:43:14.567 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.567+0000 7f4d31333800 20 remove_watcher() i=3 2024-03-09T14:43:14.568 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.568+0000 7f4d31333800 20 remove_watcher() i=4 2024-03-09T14:43:14.570 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.569+0000 7f4d31333800 20 remove_watcher() i=5 2024-03-09T14:43:14.571 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.570+0000 7f4d31333800 20 remove_watcher() i=6 2024-03-09T14:43:14.572 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:14.571+0000 7f4d31333800 20 remove_watcher() i=7 2024-03-09T14:43:15.326 INFO:tasks.workunit.client.0.smithi088.stderr:put object successful 2024-03-09T14:43:15.326 INFO:tasks.workunit.client.0.smithi088.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-03-09T14:43:15.326 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-03-09T14:43:15.677 INFO:tasks.workunit.client.0.smithi088.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-03-09T14:43:16.062 INFO:tasks.workunit.client.0.smithi088.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-03-09T14:43:17.536 INFO:tasks.workunit.client.0.smithi088.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:43:17.537 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket myver --object x 2024-03-09T14:43:17.568 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:17.568 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:17.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:17.603+0000 7ffb93010800 20 rados->read ofs=0 len=0 2024-03-09T14:43:17.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:17.605+0000 7ffb93010800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:17.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:17.605+0000 7ffb93010800 20 realm 2024-03-09T14:43:17.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:17.605+0000 7ffb93010800 20 rados->read ofs=0 len=0 2024-03-09T14:43:17.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:17.605+0000 7ffb93010800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:17.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:17.605+0000 7ffb93010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:17.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:17.605+0000 7ffb93010800 20 rados->read ofs=0 len=0 2024-03-09T14:43:17.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:17.605+0000 7ffb93010800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:17.606 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:17.605+0000 7ffb93010800 20 rados->read ofs=0 len=0 2024-03-09T14:43:17.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:17.606+0000 7ffb93010800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:17.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:17.606+0000 7ffb93010800 20 rados->read ofs=0 len=0 2024-03-09T14:43:17.607 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:17.607+0000 7ffb93010800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:17.608 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:17.607+0000 7ffb93010800 20 searching for the correct realm 2024-03-09T14:43:17.610 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:17.609+0000 7ffb8edf1640 0 -- 172.21.15.88:0/420044214 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7ffb8803a030 msgr2=0x7ffb88092040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:43:17.817 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:17.816+0000 7ffb87fff640 0 -- 172.21.15.88:0/420044214 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7ffb880600b0 msgr2=0x7ffb880607e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:18.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.024+0000 7ffb93010800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:18.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.024+0000 7ffb93010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:18.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.024+0000 7ffb93010800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:18.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.024+0000 7ffb93010800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:18.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.024+0000 7ffb93010800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:18.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.024+0000 7ffb93010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:18.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.024+0000 7ffb93010800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.024+0000 7ffb93010800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.025 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.024+0000 7ffb93010800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.024+0000 7ffb93010800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:18.026 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.024+0000 7ffb93010800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.025+0000 7ffb93010800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:18.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.025+0000 7ffb93010800 20 zone default found 2024-03-09T14:43:18.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.025+0000 7ffb93010800 4 Realm: () 2024-03-09T14:43:18.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.025+0000 7ffb93010800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:18.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.025+0000 7ffb93010800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:18.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.025+0000 7ffb93010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:18.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.025+0000 7ffb93010800 20 zonegroup default 2024-03-09T14:43:18.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.025+0000 7ffb93010800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.025+0000 7ffb93010800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.025+0000 7ffb93010800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.026+0000 7ffb93010800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.026+0000 7ffb93010800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.026+0000 7ffb93010800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.026+0000 7ffb93010800 20 started sync module instance, tier type = 2024-03-09T14:43:18.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.026+0000 7ffb93010800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:18.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.038+0000 7ffb93010800 20 add_watcher() i=0 2024-03-09T14:43:18.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.038+0000 7ffb93010800 20 add_watcher() i=1 2024-03-09T14:43:18.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.038+0000 7ffb93010800 20 add_watcher() i=2 2024-03-09T14:43:18.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.038+0000 7ffb93010800 20 add_watcher() i=3 2024-03-09T14:43:18.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.038+0000 7ffb93010800 20 add_watcher() i=4 2024-03-09T14:43:18.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.038+0000 7ffb93010800 20 add_watcher() i=5 2024-03-09T14:43:18.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.038+0000 7ffb93010800 20 add_watcher() i=6 2024-03-09T14:43:18.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.039+0000 7ffb93010800 20 add_watcher() i=7 2024-03-09T14:43:18.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.039+0000 7ffb93010800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:18.041 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.041+0000 7ffa44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:18.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.041+0000 7ffb93010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:18.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.041+0000 7ffb93010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:18.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.041+0000 7ffb93010800 5 note: GC not initialized 2024-03-09T14:43:18.042 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.041+0000 7ff9bf7fe640 20 reqs_thread_entry: start 2024-03-09T14:43:18.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.041+0000 7ffb93010800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:18.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.041+0000 7ffb93010800 20 Filter name: none 2024-03-09T14:43:18.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.042+0000 7ff9bd7fa640 20 reqs_thread_entry: start 2024-03-09T14:43:18.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.042+0000 7ffb93010800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.042+0000 7ffb93010800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:43:18.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.042+0000 7ffb93010800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.043+0000 7ffb93010800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:43:18.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.043+0000 7ffb93010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:18.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.043+0000 7ffb93010800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-09T14:43:18.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.043+0000 7ffb93010800 20 INFO: main: starting shard=0 2024-03-09T14:43:18.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.043+0000 7ffb93010800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.0 2024-03-09T14:43:18.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.043+0000 7ffb93010800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.0 2024-03-09T14:43:18.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.043+0000 7ffb93010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.043+0000 7ffb93010800 20 INFO: main: starting shard=1 2024-03-09T14:43:18.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.043+0000 7ffb93010800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.1 2024-03-09T14:43:18.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.043+0000 7ffb93010800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.1 2024-03-09T14:43:18.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.044+0000 7ffb93010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.044+0000 7ffb93010800 20 INFO: main: starting shard=2 2024-03-09T14:43:18.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.044+0000 7ffb93010800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.2 2024-03-09T14:43:18.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.044+0000 7ffb93010800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.2 2024-03-09T14:43:18.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.045+0000 7ffb93010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.045+0000 7ffb93010800 20 INFO: main: starting shard=3 2024-03-09T14:43:18.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.045+0000 7ffb93010800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.3 2024-03-09T14:43:18.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.045+0000 7ffb93010800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.3 2024-03-09T14:43:18.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.045+0000 7ffb93010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.045+0000 7ffb93010800 20 INFO: main: starting shard=4 2024-03-09T14:43:18.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.045+0000 7ffb93010800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.4 2024-03-09T14:43:18.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.045+0000 7ffb93010800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.4 2024-03-09T14:43:18.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.046+0000 7ffb93010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.046+0000 7ffb93010800 20 INFO: main: starting shard=5 2024-03-09T14:43:18.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.046+0000 7ffb93010800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.5 2024-03-09T14:43:18.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.046+0000 7ffb93010800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.5 2024-03-09T14:43:18.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.046+0000 7ffb93010800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:43:18.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.046+0000 7ffb93010800 20 INFO: main: starting shard=6 2024-03-09T14:43:18.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.046+0000 7ffb93010800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.6 2024-03-09T14:43:18.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.046+0000 7ffb93010800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.6 2024-03-09T14:43:18.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.047+0000 7ffb93010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.047+0000 7ffb93010800 20 INFO: main: starting shard=7 2024-03-09T14:43:18.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.047+0000 7ffb93010800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.7 2024-03-09T14:43:18.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.047+0000 7ffb93010800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.7 2024-03-09T14:43:18.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.047+0000 7ffb93010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.047+0000 7ffb93010800 20 INFO: main: starting shard=8 2024-03-09T14:43:18.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.047+0000 7ffb93010800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.8 2024-03-09T14:43:18.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.047+0000 7ffb93010800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.8 2024-03-09T14:43:18.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.048+0000 7ffb93010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.048+0000 7ffb93010800 20 INFO: main: starting shard=9 2024-03-09T14:43:18.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.048+0000 7ffb93010800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.9 2024-03-09T14:43:18.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.048+0000 7ffb93010800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.9 2024-03-09T14:43:18.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.048+0000 7ffb93010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.048+0000 7ffb93010800 20 INFO: main: starting shard=10 2024-03-09T14:43:18.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.048+0000 7ffb93010800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.10 2024-03-09T14:43:18.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.048+0000 7ffb93010800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.10 2024-03-09T14:43:18.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.049+0000 7ffb93010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.049+0000 7ffb93010800 20 INFO: main: starting shard=11 2024-03-09T14:43:18.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.049+0000 7ffb93010800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.11 2024-03-09T14:43:18.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.049+0000 7ffb93010800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.11 2024-03-09T14:43:18.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.049+0000 7ffb93010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.049+0000 7ffb93010800 20 INFO: main: starting shard=12 2024-03-09T14:43:18.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.049+0000 7ffb93010800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.12 2024-03-09T14:43:18.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.049+0000 7ffb93010800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.12 2024-03-09T14:43:18.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.050+0000 7ffb93010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.050+0000 7ffb93010800 20 INFO: main: done 2024-03-09T14:43:18.051 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.051+0000 7ffa44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:18.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.053+0000 7ffb93010800 20 remove_watcher() i=0 2024-03-09T14:43:18.054 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.053+0000 7ffb93010800 2 removed watcher, disabling cache 2024-03-09T14:43:18.055 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.055+0000 7ffb93010800 20 remove_watcher() i=1 2024-03-09T14:43:18.057 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.056+0000 7ffb93010800 20 remove_watcher() i=2 2024-03-09T14:43:18.058 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.057+0000 7ffb93010800 20 remove_watcher() i=3 2024-03-09T14:43:18.059 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.059+0000 7ffb93010800 20 remove_watcher() i=4 2024-03-09T14:43:18.061 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.060+0000 7ffb93010800 20 remove_watcher() i=5 2024-03-09T14:43:18.062 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.061+0000 7ffb93010800 20 remove_watcher() i=6 2024-03-09T14:43:18.063 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.063+0000 7ffb93010800 20 remove_watcher() i=7 2024-03-09T14:43:18.180 INFO:tasks.workunit.client.0.smithi088.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:43:18.181 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket myver --object y 2024-03-09T14:43:18.211 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:18.211 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:18.245 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.244+0000 7f90e3d2a800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.246+0000 7f90e3d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.246+0000 7f90e3d2a800 20 realm 2024-03-09T14:43:18.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.246+0000 7f90e3d2a800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.246+0000 7f90e3d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.246+0000 7f90e3d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:18.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.246+0000 7f90e3d2a800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.246+0000 7f90e3d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.247 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.246+0000 7f90e3d2a800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.247+0000 7f90e3d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:18.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.247+0000 7f90e3d2a800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.248 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.248+0000 7f90e3d2a800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:18.249 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.248+0000 7f90e3d2a800 20 searching for the correct realm 2024-03-09T14:43:18.251 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.251+0000 7f90e022f640 0 -- 172.21.15.88:0/4140263457 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f90d80771b0 msgr2=0x7f90d8057450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:18.256 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.255+0000 7f90d722d640 0 -- 172.21.15.88:0/4140263457 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f90d8077740 msgr2=0x7f90d8056b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:43:18.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.462+0000 7f90e3d2a800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:18.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.462+0000 7f90e3d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:18.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.462+0000 7f90e3d2a800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:18.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.462+0000 7f90e3d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:18.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.462+0000 7f90e3d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:18.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.462+0000 7f90e3d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:18.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.462+0000 7f90e3d2a800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.462+0000 7f90e3d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.463 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.462+0000 7f90e3d2a800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.463+0000 7f90e3d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:18.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.463+0000 7f90e3d2a800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.463+0000 7f90e3d2a800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:18.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.463+0000 7f90e3d2a800 20 zone default found 2024-03-09T14:43:18.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.463+0000 7f90e3d2a800 4 Realm: () 2024-03-09T14:43:18.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.463+0000 7f90e3d2a800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:18.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.463+0000 7f90e3d2a800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:18.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.463+0000 7f90e3d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:18.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.463+0000 7f90e3d2a800 20 zonegroup default 2024-03-09T14:43:18.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.463+0000 7f90e3d2a800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.463+0000 7f90e3d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.463+0000 7f90e3d2a800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.465 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.464+0000 7f90e3d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.464+0000 7f90e3d2a800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.464+0000 7f90e3d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.464+0000 7f90e3d2a800 20 started sync module instance, tier type = 2024-03-09T14:43:18.466 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.464+0000 7f90e3d2a800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:18.475 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.474+0000 7f90e3d2a800 20 add_watcher() i=0 2024-03-09T14:43:18.475 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.474+0000 7f90e3d2a800 20 add_watcher() i=1 2024-03-09T14:43:18.475 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.474+0000 7f90e3d2a800 20 add_watcher() i=2 2024-03-09T14:43:18.475 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.474+0000 7f90e3d2a800 20 add_watcher() i=3 2024-03-09T14:43:18.475 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.474+0000 7f90e3d2a800 20 add_watcher() i=4 2024-03-09T14:43:18.475 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.474+0000 7f90e3d2a800 20 add_watcher() i=5 2024-03-09T14:43:18.475 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.474+0000 7f90e3d2a800 20 add_watcher() i=6 2024-03-09T14:43:18.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.475+0000 7f90e3d2a800 20 add_watcher() i=7 2024-03-09T14:43:18.476 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.475+0000 7f90e3d2a800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:18.477 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.477+0000 7f8f95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:18.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.477+0000 7f90e3d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:18.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.477+0000 7f90e3d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:18.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.477+0000 7f90e3d2a800 5 note: GC not initialized 2024-03-09T14:43:18.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.477+0000 7f8f94fe1640 20 reqs_thread_entry: start 2024-03-09T14:43:18.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.478+0000 7f90e3d2a800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:18.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.478+0000 7f90e3d2a800 20 Filter name: none 2024-03-09T14:43:18.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.478+0000 7f8f0e7fc640 20 reqs_thread_entry: start 2024-03-09T14:43:18.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.478+0000 7f90e3d2a800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.478+0000 7f90e3d2a800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:43:18.479 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.478+0000 7f90e3d2a800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.480 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.479+0000 7f90e3d2a800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:43:18.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.479+0000 7f90e3d2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:18.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.479+0000 7f90e3d2a800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-09T14:43:18.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.479+0000 7f90e3d2a800 20 INFO: main: starting shard=0 2024-03-09T14:43:18.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.479+0000 7f90e3d2a800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.0 2024-03-09T14:43:18.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.479+0000 7f90e3d2a800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.0 2024-03-09T14:43:18.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.479+0000 7f90e3d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.479+0000 7f90e3d2a800 20 INFO: main: starting shard=1 2024-03-09T14:43:18.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.479+0000 7f90e3d2a800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.1 2024-03-09T14:43:18.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.479+0000 7f90e3d2a800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.1 2024-03-09T14:43:18.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.480+0000 7f90e3d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.480+0000 7f90e3d2a800 20 INFO: main: starting shard=2 2024-03-09T14:43:18.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.480+0000 7f90e3d2a800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.2 2024-03-09T14:43:18.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.480+0000 7f90e3d2a800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.2 2024-03-09T14:43:18.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.480+0000 7f90e3d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.481 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.480+0000 7f90e3d2a800 20 INFO: main: starting shard=3 2024-03-09T14:43:18.482 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.480+0000 7f90e3d2a800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.3 2024-03-09T14:43:18.482 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.480+0000 7f90e3d2a800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.3 2024-03-09T14:43:18.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.480+0000 7f90e3d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.480+0000 7f90e3d2a800 20 INFO: main: starting shard=4 2024-03-09T14:43:18.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.480+0000 7f90e3d2a800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.4 2024-03-09T14:43:18.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.480+0000 7f90e3d2a800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.4 2024-03-09T14:43:18.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.481+0000 7f90e3d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.481+0000 7f90e3d2a800 20 INFO: main: starting shard=5 2024-03-09T14:43:18.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.481+0000 7f90e3d2a800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.5 2024-03-09T14:43:18.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.481+0000 7f90e3d2a800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.5 2024-03-09T14:43:18.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.481+0000 7f90e3d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.481+0000 7f90e3d2a800 20 INFO: main: starting shard=6 2024-03-09T14:43:18.484 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.481+0000 7f90e3d2a800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.6 2024-03-09T14:43:18.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.481+0000 7f90e3d2a800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.6 2024-03-09T14:43:18.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.482+0000 7f90e3d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.482+0000 7f90e3d2a800 20 INFO: main: starting shard=7 2024-03-09T14:43:18.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.482+0000 7f90e3d2a800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.7 2024-03-09T14:43:18.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.482+0000 7f90e3d2a800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.7 2024-03-09T14:43:18.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.482+0000 7f90e3d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.482+0000 7f90e3d2a800 20 INFO: main: starting shard=8 2024-03-09T14:43:18.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.482+0000 7f90e3d2a800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.8 2024-03-09T14:43:18.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.482+0000 7f90e3d2a800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.8 2024-03-09T14:43:18.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.483+0000 7f90e3d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.483+0000 7f90e3d2a800 20 INFO: main: starting shard=9 2024-03-09T14:43:18.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.483+0000 7f90e3d2a800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.9 2024-03-09T14:43:18.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.483+0000 7f90e3d2a800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.9 2024-03-09T14:43:18.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.483+0000 7f90e3d2a800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:43:18.485 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.483+0000 7f90e3d2a800 20 INFO: main: starting shard=10 2024-03-09T14:43:18.486 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.483+0000 7f90e3d2a800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.10 2024-03-09T14:43:18.486 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.483+0000 7f90e3d2a800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.10 2024-03-09T14:43:18.486 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.484+0000 7f90e3d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.486 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.484+0000 7f90e3d2a800 20 INFO: main: starting shard=11 2024-03-09T14:43:18.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.484+0000 7f90e3d2a800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.11 2024-03-09T14:43:18.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.484+0000 7f90e3d2a800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.11 2024-03-09T14:43:18.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.484+0000 7f90e3d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.484+0000 7f90e3d2a800 20 INFO: main: starting shard=12 2024-03-09T14:43:18.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.484+0000 7f90e3d2a800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.12 2024-03-09T14:43:18.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.484+0000 7f90e3d2a800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.12 2024-03-09T14:43:18.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.485+0000 7f90e3d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.485+0000 7f90e3d2a800 20 INFO: main: done 2024-03-09T14:43:18.487 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.485+0000 7f8f95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:18.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.488+0000 7f90e3d2a800 20 remove_watcher() i=0 2024-03-09T14:43:18.489 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.488+0000 7f90e3d2a800 2 removed watcher, disabling cache 2024-03-09T14:43:18.490 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.489+0000 7f90e3d2a800 20 remove_watcher() i=1 2024-03-09T14:43:18.491 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.490+0000 7f90e3d2a800 20 remove_watcher() i=2 2024-03-09T14:43:18.492 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.492+0000 7f90e3d2a800 20 remove_watcher() i=3 2024-03-09T14:43:18.493 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.493+0000 7f90e3d2a800 20 remove_watcher() i=4 2024-03-09T14:43:18.494 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.494+0000 7f90e3d2a800 20 remove_watcher() i=5 2024-03-09T14:43:18.495 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.495+0000 7f90e3d2a800 20 remove_watcher() i=6 2024-03-09T14:43:18.496 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.496+0000 7f90e3d2a800 20 remove_watcher() i=7 2024-03-09T14:43:18.610 INFO:tasks.workunit.client.0.smithi088.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:43:18.611 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bi list --bucket myver --object z 2024-03-09T14:43:18.640 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:18.640 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:18.674 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.673+0000 7f6a4913b800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.675+0000 7f6a4913b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.675+0000 7f6a4913b800 20 realm 2024-03-09T14:43:18.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.675+0000 7f6a4913b800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.675+0000 7f6a4913b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.675+0000 7f6a4913b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:18.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.675+0000 7f6a4913b800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.675+0000 7f6a4913b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.676 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.675+0000 7f6a4913b800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.677 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.676+0000 7f6a4913b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:18.677 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.676+0000 7f6a4913b800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.678 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.677+0000 7f6a4913b800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:18.678 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.677+0000 7f6a4913b800 20 searching for the correct realm 2024-03-09T14:43:18.681 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.680+0000 7f6a3c6cc640 0 -- 172.21.15.88:0/2123693855 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f6a3401d450 msgr2=0x7f6a3401d8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:18.685 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.685+0000 7f6a3c6cc640 0 -- 172.21.15.88:0/2123693855 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f6a400a53f0 msgr2=0x7f6a400b3660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:18.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.891+0000 7f6a4913b800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:18.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.891+0000 7f6a4913b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:18.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.891+0000 7f6a4913b800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:18.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.891+0000 7f6a4913b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:18.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.891+0000 7f6a4913b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:18.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.891+0000 7f6a4913b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:18.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.891+0000 7f6a4913b800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.891+0000 7f6a4913b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.892 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.891+0000 7f6a4913b800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.893 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.891+0000 7f6a4913b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:18.893 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.891+0000 7f6a4913b800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.892+0000 7f6a4913b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:18.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.892+0000 7f6a4913b800 20 zone default found 2024-03-09T14:43:18.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.892+0000 7f6a4913b800 4 Realm: () 2024-03-09T14:43:18.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.892+0000 7f6a4913b800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:18.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.892+0000 7f6a4913b800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:18.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.892+0000 7f6a4913b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:18.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.892+0000 7f6a4913b800 20 zonegroup default 2024-03-09T14:43:18.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.892+0000 7f6a4913b800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.892+0000 7f6a4913b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.894 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.892+0000 7f6a4913b800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.892+0000 7f6a4913b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.892+0000 7f6a4913b800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.893+0000 7f6a4913b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:18.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.893+0000 7f6a4913b800 20 started sync module instance, tier type = 2024-03-09T14:43:18.895 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.893+0000 7f6a4913b800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:18.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.902+0000 7f6a4913b800 20 add_watcher() i=0 2024-03-09T14:43:18.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.902+0000 7f6a4913b800 20 add_watcher() i=1 2024-03-09T14:43:18.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.902+0000 7f6a4913b800 20 add_watcher() i=2 2024-03-09T14:43:18.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.902+0000 7f6a4913b800 20 add_watcher() i=3 2024-03-09T14:43:18.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.902+0000 7f6a4913b800 20 add_watcher() i=4 2024-03-09T14:43:18.903 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.902+0000 7f6a4913b800 20 add_watcher() i=5 2024-03-09T14:43:18.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.902+0000 7f6a4913b800 20 add_watcher() i=6 2024-03-09T14:43:18.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.903+0000 7f6a4913b800 20 add_watcher() i=7 2024-03-09T14:43:18.904 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.903+0000 7f6a4913b800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:18.906 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.905+0000 7f68fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:18.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.905+0000 7f6a4913b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:18.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.905+0000 7f6a4913b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:18.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.905+0000 7f6a4913b800 5 note: GC not initialized 2024-03-09T14:43:18.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.906+0000 7f68f9fe3640 20 reqs_thread_entry: start 2024-03-09T14:43:18.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.906+0000 7f6a4913b800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:18.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.906+0000 7f6a4913b800 20 Filter name: none 2024-03-09T14:43:18.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.906+0000 7f686b7fe640 20 reqs_thread_entry: start 2024-03-09T14:43:18.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.906+0000 7f6a4913b800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.907 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.906+0000 7f6a4913b800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:43:18.908 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.906+0000 7f6a4913b800 20 rados->read ofs=0 len=0 2024-03-09T14:43:18.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.907+0000 7f6a4913b800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:43:18.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.907+0000 7f6a4913b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:18.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.907+0000 7f6a4913b800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-09T14:43:18.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.907+0000 7f6a4913b800 20 INFO: main: starting shard=0 2024-03-09T14:43:18.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.907+0000 7f6a4913b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.0 2024-03-09T14:43:18.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.907+0000 7f6a4913b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.0 2024-03-09T14:43:18.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.907+0000 7f6a4913b800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:43:18.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.907+0000 7f6a4913b800 20 INFO: main: starting shard=1 2024-03-09T14:43:18.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.907+0000 7f6a4913b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.1 2024-03-09T14:43:18.909 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.907+0000 7f6a4913b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.1 2024-03-09T14:43:18.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.908+0000 7f6a4913b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.909+0000 7f6a4913b800 20 INFO: main: starting shard=2 2024-03-09T14:43:18.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.909+0000 7f6a4913b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.2 2024-03-09T14:43:18.911 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.909+0000 7f6a4913b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.2 2024-03-09T14:43:18.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.909+0000 7f6a4913b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.909+0000 7f6a4913b800 20 INFO: main: starting shard=3 2024-03-09T14:43:18.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.909+0000 7f6a4913b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.3 2024-03-09T14:43:18.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.909+0000 7f6a4913b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.3 2024-03-09T14:43:18.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.909+0000 7f6a4913b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.909+0000 7f6a4913b800 20 INFO: main: starting shard=4 2024-03-09T14:43:18.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.909+0000 7f6a4913b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.4 2024-03-09T14:43:18.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.909+0000 7f6a4913b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.4 2024-03-09T14:43:18.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.910+0000 7f6a4913b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.910+0000 7f6a4913b800 20 INFO: main: starting shard=5 2024-03-09T14:43:18.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.910+0000 7f6a4913b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.5 2024-03-09T14:43:18.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.910+0000 7f6a4913b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.5 2024-03-09T14:43:18.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.910+0000 7f6a4913b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.910+0000 7f6a4913b800 20 INFO: main: starting shard=6 2024-03-09T14:43:18.912 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.910+0000 7f6a4913b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.6 2024-03-09T14:43:18.913 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.910+0000 7f6a4913b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.6 2024-03-09T14:43:18.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.911+0000 7f6a4913b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.911+0000 7f6a4913b800 20 INFO: main: starting shard=7 2024-03-09T14:43:18.914 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.911+0000 7f6a4913b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.7 2024-03-09T14:43:18.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.911+0000 7f6a4913b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.7 2024-03-09T14:43:18.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.912+0000 7f6a4913b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.912+0000 7f6a4913b800 20 INFO: main: starting shard=8 2024-03-09T14:43:18.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.912+0000 7f6a4913b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.8 2024-03-09T14:43:18.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.912+0000 7f6a4913b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.8 2024-03-09T14:43:18.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.912+0000 7f6a4913b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.912+0000 7f6a4913b800 20 INFO: main: starting shard=9 2024-03-09T14:43:18.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.912+0000 7f6a4913b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.9 2024-03-09T14:43:18.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.912+0000 7f6a4913b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.9 2024-03-09T14:43:18.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.913+0000 7f6a4913b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.913+0000 7f6a4913b800 20 INFO: main: starting shard=10 2024-03-09T14:43:18.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.913+0000 7f6a4913b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.10 2024-03-09T14:43:18.915 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.913+0000 7f6a4913b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.10 2024-03-09T14:43:18.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.913+0000 7f6a4913b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.913+0000 7f6a4913b800 20 INFO: main: starting shard=11 2024-03-09T14:43:18.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.913+0000 7f6a4913b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.11 2024-03-09T14:43:18.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.913+0000 7f6a4913b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.11 2024-03-09T14:43:18.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.914+0000 7f6a4913b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.914+0000 7f6a4913b800 20 INFO: main: starting shard=12 2024-03-09T14:43:18.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.914+0000 7f6a4913b800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.12 2024-03-09T14:43:18.916 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.914+0000 7f6a4913b800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.12 2024-03-09T14:43:18.917 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.914+0000 7f6a4913b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:43:18.917 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.914+0000 7f6a4913b800 20 INFO: main: done 2024-03-09T14:43:18.917 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.915+0000 7f68fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:18.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.917+0000 7f6a4913b800 20 remove_watcher() i=0 2024-03-09T14:43:18.918 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.917+0000 7f6a4913b800 2 removed watcher, disabling cache 2024-03-09T14:43:18.919 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.919+0000 7f6a4913b800 20 remove_watcher() i=1 2024-03-09T14:43:18.920 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.920+0000 7f6a4913b800 20 remove_watcher() i=2 2024-03-09T14:43:18.921 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.921+0000 7f6a4913b800 20 remove_watcher() i=3 2024-03-09T14:43:18.922 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.922+0000 7f6a4913b800 20 remove_watcher() i=4 2024-03-09T14:43:18.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.923+0000 7f6a4913b800 20 remove_watcher() i=5 2024-03-09T14:43:18.924 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.924+0000 7f6a4913b800 20 remove_watcher() i=6 2024-03-09T14:43:18.925 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:18.925+0000 7f6a4913b800 20 remove_watcher() i=7 2024-03-09T14:43:18.960 INFO:tasks.workunit.client.0.smithi088.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-03-09T14:43:19.339 INFO:tasks.workunit.client.0.smithi088.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-03-09T14:43:19.735 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-03-09T14:43:19.765 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:19.765 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:19.800 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:19.800+0000 7f3bbf53c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:19.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:19.801+0000 7f3bbf53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:19.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:19.801+0000 7f3bbf53c800 20 realm 2024-03-09T14:43:19.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:19.801+0000 7f3bbf53c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:19.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:19.801+0000 7f3bbf53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:19.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:19.801+0000 7f3bbf53c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:19.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:19.801+0000 7f3bbf53c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:19.801 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:19.801+0000 7f3bbf53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:19.802 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:19.801+0000 7f3bbf53c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:19.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:19.802+0000 7f3bbf53c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:19.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:19.802+0000 7f3bbf53c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:19.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:19.803+0000 7f3bbf53c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:19.803 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:19.803+0000 7f3bbf53c800 20 searching for the correct realm 2024-03-09T14:43:19.805 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:19.805+0000 7f3bbbafb640 0 -- 172.21.15.88:0/4265278079 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f3bb4062c20 msgr2=0x7f3bb4009d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:19.810 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:19.810+0000 7f3bb3fff640 0 -- 172.21.15.88:0/4265278079 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f3bb40022d0 msgr2=0x7f3bb4053030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:20.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.016+0000 7f3bbf53c800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:20.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.016+0000 7f3bbf53c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:20.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.016+0000 7f3bbf53c800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:20.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.016+0000 7f3bbf53c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:20.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.016+0000 7f3bbf53c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:20.018 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.016+0000 7f3bbf53c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:20.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.016+0000 7f3bbf53c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.016+0000 7f3bbf53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:20.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.016+0000 7f3bbf53c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.017+0000 7f3bbf53c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:20.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.017+0000 7f3bbf53c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.017+0000 7f3bbf53c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:20.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.017+0000 7f3bbf53c800 20 zone default found 2024-03-09T14:43:20.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.017+0000 7f3bbf53c800 4 Realm: () 2024-03-09T14:43:20.019 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.017+0000 7f3bbf53c800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:20.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.017+0000 7f3bbf53c800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:20.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.017+0000 7f3bbf53c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:20.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.017+0000 7f3bbf53c800 20 zonegroup default 2024-03-09T14:43:20.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.017+0000 7f3bbf53c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.017+0000 7f3bbf53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:20.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.017+0000 7f3bbf53c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.017+0000 7f3bbf53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:20.020 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.017+0000 7f3bbf53c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.018+0000 7f3bbf53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:20.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.018+0000 7f3bbf53c800 20 started sync module instance, tier type = 2024-03-09T14:43:20.021 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.018+0000 7f3bbf53c800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:20.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.027+0000 7f3bbf53c800 20 add_watcher() i=0 2024-03-09T14:43:20.027 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.027+0000 7f3bbf53c800 20 add_watcher() i=1 2024-03-09T14:43:20.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.027+0000 7f3bbf53c800 20 add_watcher() i=2 2024-03-09T14:43:20.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.027+0000 7f3bbf53c800 20 add_watcher() i=3 2024-03-09T14:43:20.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.027+0000 7f3bbf53c800 20 add_watcher() i=4 2024-03-09T14:43:20.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.027+0000 7f3bbf53c800 20 add_watcher() i=5 2024-03-09T14:43:20.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.027+0000 7f3bbf53c800 20 add_watcher() i=6 2024-03-09T14:43:20.028 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.028+0000 7f3bbf53c800 20 add_watcher() i=7 2024-03-09T14:43:20.029 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.028+0000 7f3bbf53c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:20.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.030+0000 7f3a71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:20.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.030+0000 7f3bbf53c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:20.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.030+0000 7f3bbf53c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:20.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.030+0000 7f3bbf53c800 5 note: GC not initialized 2024-03-09T14:43:20.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.030+0000 7f3a70fe1640 20 reqs_thread_entry: start 2024-03-09T14:43:20.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.031+0000 7f3bbf53c800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:20.032 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.031+0000 7f3bbf53c800 20 Filter name: none 2024-03-09T14:43:20.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.031+0000 7f39ea7fc640 20 reqs_thread_entry: start 2024-03-09T14:43:20.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.031+0000 7f3bbf53c800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-09T14:43:20.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.031+0000 7f3bbf53c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.031+0000 7f3bbf53c800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:43:20.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.031+0000 7f3bbf53c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-09T14:43:20.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.031+0000 7f3bbf53c800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-09T14:43:20.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.031+0000 7f3bbf53c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 : miss 2024-03-09T14:43:20.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.031+0000 7f3bbf53c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.032+0000 7f3bbf53c800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:43:20.033 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.032+0000 7f3bbf53c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:20.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.032+0000 7f3bbf53c800 10 adding default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:20.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.032+0000 7f3bbf53c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:43:20.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.032+0000 7f3bbf53c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:20.034 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.032+0000 7f3bbf53c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 2024-03-09T14:43:20.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.038+0000 7f3bbf53c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:20.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.038+0000 7f3bbf53c800 10 moving default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:20.037 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.038+0000 7f3bbf53c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:20.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.038+0000 7f3bbf53c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18, ofs0, ns] 2024-03-09T14:43:20.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.038+0000 7f3a9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464374 cookie 94306216303120 notifier 7299 bl.length()=813 2024-03-09T14:43:20.038 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.038+0000 7f3a9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:20.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.038+0000 7f3a9e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:20.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.038+0000 7f3a9e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:20.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.040+0000 7f3bbf53c800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): orig_sources= new_sources= 2024-03-09T14:43:20.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.040+0000 7f3bbf53c800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): potential sources added=[] removed=[] 2024-03-09T14:43:20.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.040+0000 7f3bbf53c800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): orig_dests= new_dests= 2024-03-09T14:43:20.039 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.040+0000 7f3bbf53c800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): potential dests added=[] removed=[] 2024-03-09T14:43:20.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.0 2024-03-09T14:43:20.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.0 2024-03-09T14:43:20.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.1 2024-03-09T14:43:20.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.1 2024-03-09T14:43:20.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.2 2024-03-09T14:43:20.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.2 2024-03-09T14:43:20.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.3 2024-03-09T14:43:20.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.3 2024-03-09T14:43:20.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.4 2024-03-09T14:43:20.043 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.4 2024-03-09T14:43:20.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.5 2024-03-09T14:43:20.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.5 2024-03-09T14:43:20.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.6 2024-03-09T14:43:20.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.6 2024-03-09T14:43:20.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.7 2024-03-09T14:43:20.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.7 2024-03-09T14:43:20.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.8 2024-03-09T14:43:20.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.8 2024-03-09T14:43:20.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.10 2024-03-09T14:43:20.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.10 2024-03-09T14:43:20.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.11 2024-03-09T14:43:20.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.11 2024-03-09T14:43:20.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.12 2024-03-09T14:43:20.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.12 2024-03-09T14:43:20.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.13 2024-03-09T14:43:20.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.13 2024-03-09T14:43:20.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.14 2024-03-09T14:43:20.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.14 2024-03-09T14:43:20.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.15 2024-03-09T14:43:20.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.15 2024-03-09T14:43:20.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.16 2024-03-09T14:43:20.045 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.16 2024-03-09T14:43:20.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.0 2024-03-09T14:43:20.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.0 2024-03-09T14:43:20.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.1 2024-03-09T14:43:20.046 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.043+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.1 2024-03-09T14:43:20.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.044+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.2 2024-03-09T14:43:20.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.044+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.2 2024-03-09T14:43:20.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.044+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.3 2024-03-09T14:43:20.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.044+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.3 2024-03-09T14:43:20.047 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.045+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.4 2024-03-09T14:43:20.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.045+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.4 2024-03-09T14:43:20.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.045+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.5 2024-03-09T14:43:20.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.045+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.5 2024-03-09T14:43:20.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.045+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.6 2024-03-09T14:43:20.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.045+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.6 2024-03-09T14:43:20.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.046+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.7 2024-03-09T14:43:20.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.046+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.7 2024-03-09T14:43:20.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.046+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.8 2024-03-09T14:43:20.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.046+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.8 2024-03-09T14:43:20.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.047+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.9 2024-03-09T14:43:20.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.047+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.9 2024-03-09T14:43:20.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.047+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.10 2024-03-09T14:43:20.048 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.047+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.10 2024-03-09T14:43:20.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.048+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.11 2024-03-09T14:43:20.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.048+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.11 2024-03-09T14:43:20.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.048+0000 7f3bbf53c800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.12 2024-03-09T14:43:20.049 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.048+0000 7f3bbf53c800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.2.12 2024-03-09T14:43:20.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.051+0000 7f3bbf53c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 : hit (requested=0x17, cached=0x17) 2024-03-09T14:43:20.050 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.051+0000 7f3bbf53c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 2024-03-09T14:43:20.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.052+0000 7f3bbf53c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:20.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.052+0000 7f3bbf53c800 10 moving default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:20.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.052+0000 7f3bbf53c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:20.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.052+0000 7f3bbf53c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18, ofs0, ns] 2024-03-09T14:43:20.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.052+0000 7f3a9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464375 cookie 94306216303120 notifier 7299 bl.length()=781 2024-03-09T14:43:20.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.052+0000 7f3a9effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:20.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.052+0000 7f3a9effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:20.052 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.052+0000 7f3a9effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:20.053 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.054+0000 7f3bbf53c800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): orig_sources= new_sources= 2024-03-09T14:43:20.053 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.054+0000 7f3bbf53c800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): potential sources added=[] removed=[] 2024-03-09T14:43:20.053 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.054+0000 7f3bbf53c800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): orig_dests= new_dests= 2024-03-09T14:43:20.053 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.054+0000 7f3bbf53c800 20 handle_bi_update(): bucket=:myver[5d93e872-363b-498b-b665-658644296b85.4535.18]): potential dests added=[] removed=[] 2024-03-09T14:43:20.056 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.056+0000 7f3bbf53c800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-03-09T14:43:20.058 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.058+0000 7f3a71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:20.060 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.060+0000 7f3bbf53c800 20 remove_watcher() i=0 2024-03-09T14:43:20.060 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.060+0000 7f3bbf53c800 2 removed watcher, disabling cache 2024-03-09T14:43:20.061 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.061+0000 7f3bbf53c800 20 remove_watcher() i=1 2024-03-09T14:43:20.062 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.062+0000 7f3bbf53c800 20 remove_watcher() i=2 2024-03-09T14:43:20.063 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.064+0000 7f3bbf53c800 20 remove_watcher() i=3 2024-03-09T14:43:20.064 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.065+0000 7f3bbf53c800 20 remove_watcher() i=4 2024-03-09T14:43:20.065 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.066+0000 7f3bbf53c800 20 remove_watcher() i=5 2024-03-09T14:43:20.066 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.067+0000 7f3bbf53c800 20 remove_watcher() i=6 2024-03-09T14:43:20.067 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.067+0000 7f3bbf53c800 20 remove_watcher() i=7 2024-03-09T14:43:20.078 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-09T14:43:20.111 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:20.111 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:20.145 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.145+0000 7f605c62e800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.146+0000 7f605c62e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:20.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.146+0000 7f605c62e800 20 realm 2024-03-09T14:43:20.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.146+0000 7f605c62e800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.146+0000 7f605c62e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:20.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.146+0000 7f605c62e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:20.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.146+0000 7f605c62e800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.146 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.146+0000 7f605c62e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:20.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.146+0000 7f605c62e800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.147+0000 7f605c62e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:20.147 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.147+0000 7f605c62e800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.148+0000 7f605c62e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:20.148 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.148+0000 7f605c62e800 20 searching for the correct realm 2024-03-09T14:43:20.150 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.150+0000 7f60581a3640 0 -- 172.21.15.88:0/1599329375 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f6050034040 msgr2=0x7f6050035430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:20.356 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.357+0000 7f604f1a1640 0 -- 172.21.15.88:0/1599329375 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f6050017400 msgr2=0x7f6050017880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:20.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.563+0000 7f605c62e800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:20.563 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.563+0000 7f605c62e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:20.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.563+0000 7f605c62e800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:20.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.563+0000 7f605c62e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:20.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.563+0000 7f605c62e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:20.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.563+0000 7f605c62e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:20.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.563+0000 7f605c62e800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.564+0000 7f605c62e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:20.564 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.564+0000 7f605c62e800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.564+0000 7f605c62e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:20.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.564+0000 7f605c62e800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.565 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.564+0000 7f605c62e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:20.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.564+0000 7f605c62e800 20 zone default found 2024-03-09T14:43:20.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.564+0000 7f605c62e800 4 Realm: () 2024-03-09T14:43:20.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.564+0000 7f605c62e800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:20.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.564+0000 7f605c62e800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:20.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.564+0000 7f605c62e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:20.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.564+0000 7f605c62e800 20 zonegroup default 2024-03-09T14:43:20.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.564+0000 7f605c62e800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.565+0000 7f605c62e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:20.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.565+0000 7f605c62e800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.565+0000 7f605c62e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:20.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.565+0000 7f605c62e800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.565+0000 7f605c62e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:20.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.565+0000 7f605c62e800 20 started sync module instance, tier type = 2024-03-09T14:43:20.566 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.565+0000 7f605c62e800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:20.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.575+0000 7f605c62e800 20 add_watcher() i=0 2024-03-09T14:43:20.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.575+0000 7f605c62e800 20 add_watcher() i=1 2024-03-09T14:43:20.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.575+0000 7f605c62e800 20 add_watcher() i=2 2024-03-09T14:43:20.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.575+0000 7f605c62e800 20 add_watcher() i=3 2024-03-09T14:43:20.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.575+0000 7f605c62e800 20 add_watcher() i=4 2024-03-09T14:43:20.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.575+0000 7f605c62e800 20 add_watcher() i=5 2024-03-09T14:43:20.575 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.575+0000 7f605c62e800 20 add_watcher() i=6 2024-03-09T14:43:20.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.576+0000 7f605c62e800 20 add_watcher() i=7 2024-03-09T14:43:20.576 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.576+0000 7f605c62e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:20.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.578+0000 7f5f0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:20.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.578+0000 7f605c62e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:20.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.578+0000 7f605c62e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:20.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.578+0000 7f605c62e800 5 note: GC not initialized 2024-03-09T14:43:20.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.578+0000 7f5f0cfe1640 20 reqs_thread_entry: start 2024-03-09T14:43:20.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.578+0000 7f605c62e800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:20.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.578+0000 7f605c62e800 20 Filter name: none 2024-03-09T14:43:20.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.579+0000 7f5e867fc640 20 reqs_thread_entry: start 2024-03-09T14:43:20.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.579+0000 7f605c62e800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-09T14:43:20.579 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.579+0000 7f605c62e800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.579+0000 7f605c62e800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:43:20.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.579+0000 7f605c62e800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-09T14:43:20.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.579+0000 7f605c62e800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-09T14:43:20.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.579+0000 7f605c62e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 : miss 2024-03-09T14:43:20.580 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.579+0000 7f605c62e800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.580+0000 7f605c62e800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:43:20.581 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.580+0000 7f605c62e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 info.flags=0x17 2024-03-09T14:43:20.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.580+0000 7f605c62e800 10 adding default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 to cache LRU end 2024-03-09T14:43:20.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.580+0000 7f605c62e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:43:20.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.580+0000 7f605c62e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:43:20.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.580+0000 7f605c62e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:5d93e872-363b-498b-b665-658644296b85.4535.18 2024-03-09T14:43:20.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.580+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.0 2024-03-09T14:43:20.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.580+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.0 2024-03-09T14:43:20.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.580+0000 7f605c62e800 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-09T14:43:20.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.580+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.1 2024-03-09T14:43:20.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.580+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.1 2024-03-09T14:43:20.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.581+0000 7f605c62e800 1 NOTICE: finished shard 1 (0 entries removed) 2024-03-09T14:43:20.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.581+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.2 2024-03-09T14:43:20.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.581+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.2 2024-03-09T14:43:20.582 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.581+0000 7f605c62e800 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-09T14:43:20.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.581+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.3 2024-03-09T14:43:20.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.581+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.3 2024-03-09T14:43:20.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.582+0000 7f605c62e800 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-09T14:43:20.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.582+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.4 2024-03-09T14:43:20.583 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.582+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.4 2024-03-09T14:43:20.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.582+0000 7f605c62e800 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-09T14:43:20.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.582+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.5 2024-03-09T14:43:20.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.582+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.5 2024-03-09T14:43:20.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.583+0000 7f605c62e800 1 NOTICE: finished shard 5 (0 entries removed) 2024-03-09T14:43:20.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.583+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.6 2024-03-09T14:43:20.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.583+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.6 2024-03-09T14:43:20.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.583+0000 7f605c62e800 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-09T14:43:20.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.583+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.7 2024-03-09T14:43:20.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.583+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.7 2024-03-09T14:43:20.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.584+0000 7f605c62e800 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-09T14:43:20.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.584+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.8 2024-03-09T14:43:20.584 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.584+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.8 2024-03-09T14:43:20.585 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.584+0000 7f605c62e800 1 NOTICE: finished shard 8 (0 entries removed) 2024-03-09T14:43:20.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.584+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.584+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.585+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.10 2024-03-09T14:43:20.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.585+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.10 2024-03-09T14:43:20.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.585+0000 7f605c62e800 1 NOTICE: finished shard 10 (0 entries removed) 2024-03-09T14:43:20.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.585+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.11 2024-03-09T14:43:20.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.585+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.11 2024-03-09T14:43:20.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.586+0000 7f605c62e800 1 NOTICE: finished shard 11 (0 entries removed) 2024-03-09T14:43:20.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.586+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.12 2024-03-09T14:43:20.586 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.586+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.12 2024-03-09T14:43:20.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.586+0000 7f605c62e800 1 NOTICE: finished shard 12 (0 entries removed) 2024-03-09T14:43:20.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.586+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.13 2024-03-09T14:43:20.587 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.586+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.13 2024-03-09T14:43:20.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.587+0000 7f605c62e800 1 NOTICE: finished shard 13 (0 entries removed) 2024-03-09T14:43:20.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.587+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.14 2024-03-09T14:43:20.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.587+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.14 2024-03-09T14:43:20.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.587+0000 7f605c62e800 1 NOTICE: finished shard 14 (0 entries removed) 2024-03-09T14:43:20.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.587+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.15 2024-03-09T14:43:20.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.587+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.15 2024-03-09T14:43:20.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.588+0000 7f605c62e800 1 NOTICE: finished shard 15 (0 entries removed) 2024-03-09T14:43:20.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.588+0000 7f605c62e800 10 bucket_obj is .dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.16 2024-03-09T14:43:20.588 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.588+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.16 2024-03-09T14:43:20.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.588+0000 7f605c62e800 1 NOTICE: finished shard 16 (0 entries removed) 2024-03-09T14:43:20.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.588+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.589+0000 7f605c62e800 20 get_obj_state: octx=0x56242716d540 obj=myver:x state=0x562427438ee8 s->prefetch_data=0 2024-03-09T14:43:20.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.589+0000 7f605c62e800 20 get_obj_state: setting s->obj_tag to xzvecx7e6i9fye0rj44p9opf4zcvfljy 2024-03-09T14:43:20.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.589+0000 7f605c62e800 20 get_obj_state_impl: setting s->olh_tag to mvftcyc81dpd9a3fjbxybkk78br63st7 2024-03-09T14:43:20.589 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.589+0000 7f605c62e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mvftcyc81dpd9a3fjbxybkk78br63st7 2024-03-09T14:43:20.590 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.590+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.591 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.592+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.592+0000 7f605c62e800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-03-09T14:43:20.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.592+0000 7f605c62e800 20 olh_log_entry: epoch=2 op=3 key=x[-wf4atGATH84RIvW.YSNCJa2pDfDCTo] 2024-03-09T14:43:20.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.592+0000 7f605c62e800 20 get_obj_state: octx=0x56242716d540 obj=myver:_:-wf4atGATH84RIvW.YSNCJa2pDfDCTo_x state=0x56242747d628 s->prefetch_data=0 2024-03-09T14:43:20.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.592+0000 7f605c62e800 10 manifest: total_size = 11 2024-03-09T14:43:20.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.592+0000 7f605c62e800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.2294514026267019860 2024-03-09T14:43:20.592 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.592+0000 7f605c62e800 20 get_obj_state: octx=0x56242716d540 obj=myver:_:-wf4atGATH84RIvW.YSNCJa2pDfDCTo_x state=0x56242747d628 s->prefetch_data=0 2024-03-09T14:43:20.593 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.592+0000 7f605c62e800 20 prepare_atomic_modification: state is not atomic. state=0x56242747d628 2024-03-09T14:43:20.593 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.592+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.596+0000 7f605c62e800 20 get_obj_state: octx=0x56242716d540 obj=myver:x state=0x562427438ee8 s->prefetch_data=0 2024-03-09T14:43:20.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.596+0000 7f605c62e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mvftcyc81dpd9a3fjbxybkk78br63st7 2024-03-09T14:43:20.596 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.596+0000 7f5f367fc640 20 handle_completion(): completion ok for obj=x[-wf4atGATH84RIvW.YSNCJa2pDfDCTo] 2024-03-09T14:43:20.599 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.600+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.600 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.601+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.601+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.601 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.602+0000 7f605c62e800 20 get_obj_state: octx=0x56242716d540 obj=myver:y state=0x562427438ee8 s->prefetch_data=0 2024-03-09T14:43:20.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.602+0000 7f605c62e800 20 get_obj_state: setting s->obj_tag to r75moz3t3yzuz0zgf5agegxams3oeli1 2024-03-09T14:43:20.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.602+0000 7f605c62e800 20 get_obj_state_impl: setting s->olh_tag to 874z24la1ik4inipv38z43klp8a48rtf 2024-03-09T14:43:20.602 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.602+0000 7f605c62e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=874z24la1ik4inipv38z43klp8a48rtf 2024-03-09T14:43:20.603 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.603+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.604 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.605+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.605+0000 7f605c62e800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-03-09T14:43:20.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.605+0000 7f605c62e800 20 olh_log_entry: epoch=2 op=3 key=y[law9CU2PMiR6oKa6BiFutCMQIQzGuxF] 2024-03-09T14:43:20.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.605+0000 7f605c62e800 20 get_obj_state: octx=0x56242716d540 obj=myver:_:law9CU2PMiR6oKa6BiFutCMQIQzGuxF_y state=0x56242747d628 s->prefetch_data=0 2024-03-09T14:43:20.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.605+0000 7f605c62e800 10 manifest: total_size = 9 2024-03-09T14:43:20.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.605+0000 7f605c62e800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.437540630825400537 2024-03-09T14:43:20.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.605+0000 7f605c62e800 20 get_obj_state: octx=0x56242716d540 obj=myver:_:law9CU2PMiR6oKa6BiFutCMQIQzGuxF_y state=0x56242747d628 s->prefetch_data=0 2024-03-09T14:43:20.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.605+0000 7f605c62e800 20 prepare_atomic_modification: state is not atomic. state=0x56242747d628 2024-03-09T14:43:20.605 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.605+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.609+0000 7f5f367fc640 20 handle_completion(): completion ok for obj=y[law9CU2PMiR6oKa6BiFutCMQIQzGuxF] 2024-03-09T14:43:20.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.610+0000 7f605c62e800 20 get_obj_state: octx=0x56242716d540 obj=myver:y state=0x562427438ee8 s->prefetch_data=0 2024-03-09T14:43:20.609 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.610+0000 7f605c62e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=874z24la1ik4inipv38z43klp8a48rtf 2024-03-09T14:43:20.612 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.612+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.613 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.614+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.614+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.614+0000 7f605c62e800 20 get_obj_state: octx=0x56242716d540 obj=myver:z state=0x5624274835d8 s->prefetch_data=0 2024-03-09T14:43:20.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.615+0000 7f605c62e800 20 get_obj_state: setting s->obj_tag to 98q2nhb0h7xjsxkq79d48hh0u3g4l62c 2024-03-09T14:43:20.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.615+0000 7f605c62e800 20 get_obj_state_impl: setting s->olh_tag to sre1wyh7u8215o648loeebhtqed4snr3 2024-03-09T14:43:20.614 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.615+0000 7f605c62e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=sre1wyh7u8215o648loeebhtqed4snr3 2024-03-09T14:43:20.615 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.616+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.617+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.617+0000 7f605c62e800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-03-09T14:43:20.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.617+0000 7f605c62e800 20 olh_log_entry: epoch=2 op=3 key=z[1Sr8KqLvyRn4Y8okiJNa4TSiFrd3hwr] 2024-03-09T14:43:20.617 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.617+0000 7f605c62e800 20 get_obj_state: octx=0x56242716d540 obj=myver:_:1Sr8KqLvyRn4Y8okiJNa4TSiFrd3hwr_z state=0x5624274795e8 s->prefetch_data=0 2024-03-09T14:43:20.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.618+0000 7f605c62e800 10 manifest: total_size = 12 2024-03-09T14:43:20.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.618+0000 7f605c62e800 20 get_obj_state: setting s->obj_tag to 5d93e872-363b-498b-b665-658644296b85.4535.7420221382992610771 2024-03-09T14:43:20.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.618+0000 7f605c62e800 20 get_obj_state: octx=0x56242716d540 obj=myver:_:1Sr8KqLvyRn4Y8okiJNa4TSiFrd3hwr_z state=0x5624274795e8 s->prefetch_data=0 2024-03-09T14:43:20.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.618+0000 7f605c62e800 20 prepare_atomic_modification: state is not atomic. state=0x5624274795e8 2024-03-09T14:43:20.618 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.618+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.621+0000 7f5f36ffd640 20 handle_completion(): completion ok for obj=z[1Sr8KqLvyRn4Y8okiJNa4TSiFrd3hwr] 2024-03-09T14:43:20.621 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.622+0000 7f605c62e800 20 get_obj_state: octx=0x56242716d540 obj=myver:z state=0x5624274835d8 s->prefetch_data=0 2024-03-09T14:43:20.622 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.622+0000 7f605c62e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=sre1wyh7u8215o648loeebhtqed4snr3 2024-03-09T14:43:20.625 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.624+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.625 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.625+0000 7f605c62e800 20 bucket index object: :.dir.5d93e872-363b-498b-b665-658644296b85.4535.18.3.9 2024-03-09T14:43:20.625 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.625+0000 7f605c62e800 1 NOTICE: finished shard 9 (3 entries removed) 2024-03-09T14:43:20.625 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.625+0000 7f605c62e800 1 NOTICE: finished all shards (3 entries removed) 2024-03-09T14:43:20.626 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.626+0000 7f5f0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:20.628 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.628+0000 7f605c62e800 20 remove_watcher() i=0 2024-03-09T14:43:20.628 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.628+0000 7f605c62e800 2 removed watcher, disabling cache 2024-03-09T14:43:20.629 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.629+0000 7f605c62e800 20 remove_watcher() i=1 2024-03-09T14:43:20.630 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.631+0000 7f605c62e800 20 remove_watcher() i=2 2024-03-09T14:43:20.631 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.632+0000 7f605c62e800 20 remove_watcher() i=3 2024-03-09T14:43:20.632 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.633+0000 7f605c62e800 20 remove_watcher() i=4 2024-03-09T14:43:20.633 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.634+0000 7f605c62e800 20 remove_watcher() i=5 2024-03-09T14:43:20.634 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.634+0000 7f605c62e800 20 remove_watcher() i=6 2024-03-09T14:43:20.635 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.635+0000 7f605c62e800 20 remove_watcher() i=7 2024-03-09T14:43:20.774 INFO:tasks.workunit.client.0.smithi088.stderr:radosgw-admin bucket stats --bucket myver 2024-03-09T14:43:20.801 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:20.801 INFO:tasks.workunit.client.0.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:20.834 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.834+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.836 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.836+0000 7f07420c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:20.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.836+0000 7f07420c0800 20 realm 2024-03-09T14:43:20.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.836+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.836+0000 7f07420c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:20.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.836+0000 7f07420c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:20.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.836+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.836+0000 7f07420c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:20.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.836+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.837+0000 7f07420c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:20.837 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.837+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:20.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.837+0000 7f07420c0800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:20.838 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.837+0000 7f07420c0800 20 searching for the correct realm 2024-03-09T14:43:20.839 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:20.839+0000 7f07403bd640 0 -- 172.21.15.88:0/1094158266 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f0730081040 msgr2=0x7f07300814c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:43:21.044 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.044+0000 7f073f3bb640 0 -- 172.21.15.88:0/1094158266 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f07300b46d0 msgr2=0x7f07300513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:43:21.252 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.250+0000 7f07420c0800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:21.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.250+0000 7f07420c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:21.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.250+0000 7f07420c0800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:21.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.250+0000 7f07420c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:21.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.250+0000 7f07420c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:21.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.250+0000 7f07420c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:21.253 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.250+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:21.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.251+0000 7f07420c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:21.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.251+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:21.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.251+0000 7f07420c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:21.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.251+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:21.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.251+0000 7f07420c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:21.254 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.251+0000 7f07420c0800 20 zone default found 2024-03-09T14:43:21.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.251+0000 7f07420c0800 4 Realm: () 2024-03-09T14:43:21.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.251+0000 7f07420c0800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:21.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.251+0000 7f07420c0800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:21.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.251+0000 7f07420c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:21.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.251+0000 7f07420c0800 20 zonegroup default 2024-03-09T14:43:21.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.251+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:21.255 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.252+0000 7f07420c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:21.256 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.252+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:21.256 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.252+0000 7f07420c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:21.256 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.252+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:21.256 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.252+0000 7f07420c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:21.256 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.252+0000 7f07420c0800 20 started sync module instance, tier type = 2024-03-09T14:43:21.256 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.252+0000 7f07420c0800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:21.262 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.262+0000 7f07420c0800 20 add_watcher() i=0 2024-03-09T14:43:21.262 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.262+0000 7f07420c0800 20 add_watcher() i=1 2024-03-09T14:43:21.263 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.262+0000 7f07420c0800 20 add_watcher() i=2 2024-03-09T14:43:21.263 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.262+0000 7f07420c0800 20 add_watcher() i=3 2024-03-09T14:43:21.263 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.262+0000 7f07420c0800 20 add_watcher() i=4 2024-03-09T14:43:21.263 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.262+0000 7f07420c0800 20 add_watcher() i=5 2024-03-09T14:43:21.263 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.262+0000 7f07420c0800 20 add_watcher() i=6 2024-03-09T14:43:21.264 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.263+0000 7f07420c0800 20 add_watcher() i=7 2024-03-09T14:43:21.264 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.263+0000 7f07420c0800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:21.264 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.265+0000 7f05f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:21.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.265+0000 7f07420c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:21.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.265+0000 7f07420c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:21.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.265+0000 7f07420c0800 5 note: GC not initialized 2024-03-09T14:43:21.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.265+0000 7f05f4fe1640 20 reqs_thread_entry: start 2024-03-09T14:43:21.265 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.265+0000 7f07420c0800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:21.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.265+0000 7f07420c0800 20 Filter name: none 2024-03-09T14:43:21.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.265+0000 7f056e7fc640 20 reqs_thread_entry: start 2024-03-09T14:43:21.266 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.266+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:21.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.266+0000 7f07420c0800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:43:21.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.266+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:21.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.266+0000 7f07420c0800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:43:21.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.266+0000 7f07420c0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:21.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.266+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:21.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.267+0000 7f07420c0800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:43:21.267 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.267+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:21.268 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.267+0000 7f07420c0800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:43:21.268 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.267+0000 7f07420c0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:43:21.268 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.269+0000 7f07420c0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:21.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.269+0000 7f07420c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:21.269 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.270+0000 7f05f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:21.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.272+0000 7f07420c0800 20 remove_watcher() i=0 2024-03-09T14:43:21.272 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.272+0000 7f07420c0800 2 removed watcher, disabling cache 2024-03-09T14:43:21.273 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.273+0000 7f07420c0800 20 remove_watcher() i=1 2024-03-09T14:43:21.274 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.274+0000 7f07420c0800 20 remove_watcher() i=2 2024-03-09T14:43:21.275 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.275+0000 7f07420c0800 20 remove_watcher() i=3 2024-03-09T14:43:21.276 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.276+0000 7f07420c0800 20 remove_watcher() i=4 2024-03-09T14:43:21.277 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.277+0000 7f07420c0800 20 remove_watcher() i=5 2024-03-09T14:43:21.278 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.278+0000 7f07420c0800 20 remove_watcher() i=6 2024-03-09T14:43:21.279 INFO:tasks.workunit.client.0.smithi088.stderr:2024-03-09T14:43:21.279+0000 7f07420c0800 20 remove_watcher() i=7 2024-03-09T14:43:21.289 INFO:tasks.workunit.client.0.smithi088.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-03-09T14:43:21.289 INFO:tasks.workunit.client.0.smithi088.stderr:Deleting bucket a-bucket 2024-03-09T14:43:21.364 INFO:tasks.workunit.client.0.smithi088.stderr:Deleting bucket myver 2024-03-09T14:43:21.594 INFO:tasks.workunit.client.0.smithi088.stderr:Completed resharding tests 2024-03-09T14:43:21.594 INFO:tasks.workunit.client.0.smithi088.stdout:connected to http://localhost:80 2024-03-09T14:43:21.659 INFO:tasks.workunit.client.0.smithi088.stderr:+ deactivate 2024-03-09T14:43:21.659 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-03-09T14:43:21.659 INFO:tasks.workunit.client.0.smithi088.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-09T14:43:21.659 INFO:tasks.workunit.client.0.smithi088.stderr:+ export PATH 2024-03-09T14:43:21.659 INFO:tasks.workunit.client.0.smithi088.stderr:+ unset _OLD_VIRTUAL_PATH 2024-03-09T14:43:21.659 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' -n '' ']' 2024-03-09T14:43:21.659 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:43:21.659 INFO:tasks.workunit.client.0.smithi088.stderr:+ hash -r 2024-03-09T14:43:21.659 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' -n '' ']' 2024-03-09T14:43:21.659 INFO:tasks.workunit.client.0.smithi088.stderr:+ unset VIRTUAL_ENV 2024-03-09T14:43:21.660 INFO:tasks.workunit.client.0.smithi088.stderr:+ '[' '!' '' = nondestructive ']' 2024-03-09T14:43:21.660 INFO:tasks.workunit.client.0.smithi088.stderr:+ unset -f deactivate 2024-03-09T14:43:21.660 INFO:tasks.workunit.client.0.smithi088.stderr:+ echo OK. 2024-03-09T14:43:21.660 INFO:tasks.workunit.client.0.smithi088.stdout:OK. 2024-03-09T14:43:21.661 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:43:21.661 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:43:21.741 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-03-09T14:43:21.742 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-09T14:43:22.130 DEBUG:teuthology.parallel:result is None 2024-03-09T14:43:22.131 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:43:22.171 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:43:22.171 DEBUG:teuthology.orchestra.run.smithi088:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:43:22.237 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:43:22.237 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-03-09T14:43:22.252 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-03-09T14:43:22.253 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-03-09T14:43:22.253 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-03-09T14:43:22.253 DEBUG:teuthology.orchestra.run.smithi088:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-03-09T14:43:22.305 INFO:teuthology.orchestra.run.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-03-09T14:43:26.806 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-03-09T14:43:26.807 DEBUG:teuthology.orchestra.run.smithi088:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-03-09T14:43:29.812 INFO:teuthology.orchestra.run.smithi088.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-03-09T14:43:30.374 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:19:59 ago on Sat 09 Mar 2024 02:23:31 PM UTC. 2024-03-09T14:43:30.532 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-03-09T14:43:30.533 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-03-09T14:43:30.533 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-03-09T14:43:30.533 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-03-09T14:43:30.533 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-03-09T14:43:30.533 INFO:teuthology.orchestra.run.smithi088.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 424 k 2024-03-09T14:43:30.533 INFO:teuthology.orchestra.run.smithi088.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 9.3 M 2024-03-09T14:43:30.533 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-03-09T14:43:30.533 INFO:teuthology.orchestra.run.smithi088.stdout: java-1.8.0-openjdk-headless 2024-03-09T14:43:30.533 INFO:teuthology.orchestra.run.smithi088.stdout: x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 32 M 2024-03-09T14:43:30.534 INFO:teuthology.orchestra.run.smithi088.stdout:Installing weak dependencies: 2024-03-09T14:43:30.534 INFO:teuthology.orchestra.run.smithi088.stdout: gtk2 x86_64 2.24.33-8.el9 CentOS-AppStream 3.5 M 2024-03-09T14:43:30.534 INFO:teuthology.orchestra.run.smithi088.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 CentOS-AppStream 25 k 2024-03-09T14:43:30.534 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:43:30.534 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-03-09T14:43:30.534 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-03-09T14:43:30.534 INFO:teuthology.orchestra.run.smithi088.stdout:Install 5 Packages 2024-03-09T14:43:30.534 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:43:30.535 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 45 M 2024-03-09T14:43:30.535 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 166 M 2024-03-09T14:43:30.535 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-03-09T14:43:30.774 INFO:teuthology.orchestra.run.smithi088.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.7 MB/s | 424 kB 00:00 2024-03-09T14:43:30.891 INFO:teuthology.orchestra.run.smithi088.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 9.7 MB/s | 3.5 MB 00:00 2024-03-09T14:43:31.058 INFO:teuthology.orchestra.run.smithi088.stdout:(3/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 18 MB/s | 9.3 MB 00:00 2024-03-09T14:43:31.116 INFO:teuthology.orchestra.run.smithi088.stdout:(4/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 112 kB/s | 25 kB 00:00 2024-03-09T14:43:31.575 INFO:teuthology.orchestra.run.smithi088.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 40 MB/s | 32 MB 00:00 2024-03-09T14:43:31.578 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-03-09T14:43:31.579 INFO:teuthology.orchestra.run.smithi088.stdout:Total 44 MB/s | 45 MB 00:01 2024-03-09T14:43:31.579 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-03-09T14:43:31.598 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-03-09T14:43:31.598 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-03-09T14:43:31.968 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-03-09T14:43:31.968 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-03-09T14:43:32.394 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-03-09T14:43:32.532 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-03-09T14:43:32.719 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-03-09T14:43:33.328 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-03-09T14:43:33.369 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-03-09T14:43:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-03-09T14:43:33.645 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-03-09T14:43:33.875 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-03-09T14:43:33.908 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-03-09T14:43:33.915 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-03-09T14:43:33.924 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-03-09T14:43:33.960 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-03-09T14:43:36.727 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-03-09T14:43:36.727 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-03-09T14:43:36.727 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-03-09T14:43:36.727 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-03-09T14:43:36.727 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-03-09T14:43:37.112 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-03-09T14:43:37.112 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:43:37.112 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-03-09T14:43:37.112 INFO:teuthology.orchestra.run.smithi088.stdout: gtk2-2.24.33-8.el9.x86_64 2024-03-09T14:43:37.112 INFO:teuthology.orchestra.run.smithi088.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-03-09T14:43:37.113 INFO:teuthology.orchestra.run.smithi088.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-03-09T14:43:37.113 INFO:teuthology.orchestra.run.smithi088.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-03-09T14:43:37.113 INFO:teuthology.orchestra.run.smithi088.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-03-09T14:43:37.113 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:43:37.113 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-03-09T14:43:37.590 INFO:teuthology.orchestra.run.smithi088.stdout: Gradle will be installed under /opt/gradle 2024-03-09T14:43:37.662 INFO:teuthology.orchestra.run.smithi088.stderr:--2024-03-09 14:43:37-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-03-09T14:43:38.007 INFO:teuthology.orchestra.run.smithi088.stderr:Resolving services.gradle.org (services.gradle.org)... 104.17.129.37, 104.17.128.37, 2606:4700::6811:8025, ... 2024-03-09T14:43:38.017 INFO:teuthology.orchestra.run.smithi088.stderr:Connecting to services.gradle.org (services.gradle.org)|104.17.129.37|:443... connected. 2024-03-09T14:43:38.076 INFO:teuthology.orchestra.run.smithi088.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-03-09T14:43:38.076 INFO:teuthology.orchestra.run.smithi088.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-03-09T14:43:38.076 INFO:teuthology.orchestra.run.smithi088.stderr:--2024-03-09 14:43:38-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-03-09T14:43:38.076 INFO:teuthology.orchestra.run.smithi088.stderr:Resolving github.com (github.com)... 140.82.114.3 2024-03-09T14:43:38.087 INFO:teuthology.orchestra.run.smithi088.stderr:Connecting to github.com (github.com)|140.82.114.3|:443... connected. 2024-03-09T14:43:38.179 INFO:teuthology.orchestra.run.smithi088.stderr:HTTP request sent, awaiting response... 302 Found 2024-03-09T14:43:38.179 INFO:teuthology.orchestra.run.smithi088.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240309%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240309T144146Z&X-Amz-Expires=300&X-Amz-Signature=4c04b4e2685760064415de31803e424af07728be495795e8af82f271e24ca128&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-03-09T14:43:38.179 INFO:teuthology.orchestra.run.smithi088.stderr:--2024-03-09 14:43:38-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240309%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240309T144146Z&X-Amz-Expires=300&X-Amz-Signature=4c04b4e2685760064415de31803e424af07728be495795e8af82f271e24ca128&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-03-09T14:43:38.179 INFO:teuthology.orchestra.run.smithi088.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.110.133, 185.199.108.133, ... 2024-03-09T14:43:38.194 INFO:teuthology.orchestra.run.smithi088.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-03-09T14:43:38.315 INFO:teuthology.orchestra.run.smithi088.stderr:HTTP request sent, awaiting response... 200 OK 2024-03-09T14:43:38.315 INFO:teuthology.orchestra.run.smithi088.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-03-09T14:43:38.316 INFO:teuthology.orchestra.run.smithi088.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-03-09T14:43:38.316 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-03-09T14:43:38.344 INFO:teuthology.orchestra.run.smithi088.stderr: 0K .......... .......... .......... .......... .......... 0% 1.62M 56s 2024-03-09T14:43:38.349 INFO:teuthology.orchestra.run.smithi088.stderr: 50K .......... .......... .......... .......... .......... 0% 11.3M 32s 2024-03-09T14:43:38.360 INFO:teuthology.orchestra.run.smithi088.stderr: 100K .......... .......... .......... .......... .......... 0% 4.25M 28s 2024-03-09T14:43:38.364 INFO:teuthology.orchestra.run.smithi088.stderr: 150K .......... .......... .......... .......... .......... 0% 14.7M 23s 2024-03-09T14:43:38.366 INFO:teuthology.orchestra.run.smithi088.stderr: 200K .......... .......... .......... .......... .......... 0% 20.0M 19s 2024-03-09T14:43:38.368 INFO:teuthology.orchestra.run.smithi088.stderr: 250K .......... .......... .......... .......... .......... 0% 24.8M 17s 2024-03-09T14:43:38.376 INFO:teuthology.orchestra.run.smithi088.stderr: 300K .......... .......... .......... .......... .......... 0% 6.44M 16s 2024-03-09T14:43:38.380 INFO:teuthology.orchestra.run.smithi088.stderr: 350K .......... .......... .......... .......... .......... 0% 15.3M 15s 2024-03-09T14:43:38.381 INFO:teuthology.orchestra.run.smithi088.stderr: 400K .......... .......... .......... .......... .......... 0% 48.9M 13s 2024-03-09T14:43:38.381 INFO:teuthology.orchestra.run.smithi088.stderr: 450K .......... .......... .......... .......... .......... 0% 45.7M 12s 2024-03-09T14:43:38.384 INFO:teuthology.orchestra.run.smithi088.stderr: 500K .......... .......... .......... .......... .......... 0% 40.7M 11s 2024-03-09T14:43:38.384 INFO:teuthology.orchestra.run.smithi088.stderr: 550K .......... .......... .......... .......... .......... 0% 42.3M 11s 2024-03-09T14:43:38.390 INFO:teuthology.orchestra.run.smithi088.stderr: 600K .......... .......... .......... .......... .......... 0% 7.15M 11s 2024-03-09T14:43:38.393 INFO:teuthology.orchestra.run.smithi088.stderr: 650K .......... .......... .......... .......... .......... 0% 57.4M 10s 2024-03-09T14:43:38.393 INFO:teuthology.orchestra.run.smithi088.stderr: 700K .......... .......... .......... .......... .......... 0% 101M 9s 2024-03-09T14:43:38.404 INFO:teuthology.orchestra.run.smithi088.stderr: 750K .......... .......... .......... .......... .......... 0% 20.6M 9s 2024-03-09T14:43:38.404 INFO:teuthology.orchestra.run.smithi088.stderr: 800K .......... .......... .......... .......... .......... 0% 97.1M 9s 2024-03-09T14:43:38.404 INFO:teuthology.orchestra.run.smithi088.stderr: 850K .......... .......... .......... .......... .......... 0% 33.3M 8s 2024-03-09T14:43:38.404 INFO:teuthology.orchestra.run.smithi088.stderr: 900K .......... .......... .......... .......... .......... 1% 113M 8s 2024-03-09T14:43:38.405 INFO:teuthology.orchestra.run.smithi088.stderr: 950K .......... .......... .......... .......... .......... 1% 106M 8s 2024-03-09T14:43:38.405 INFO:teuthology.orchestra.run.smithi088.stderr: 1000K .......... .......... .......... .......... .......... 1% 50.6M 7s 2024-03-09T14:43:38.405 INFO:teuthology.orchestra.run.smithi088.stderr: 1050K .......... .......... .......... .......... .......... 1% 118M 7s 2024-03-09T14:43:38.405 INFO:teuthology.orchestra.run.smithi088.stderr: 1100K .......... .......... .......... .......... .......... 1% 108M 7s 2024-03-09T14:43:38.405 INFO:teuthology.orchestra.run.smithi088.stderr: 1150K .......... .......... .......... .......... .......... 1% 45.6M 7s 2024-03-09T14:43:38.405 INFO:teuthology.orchestra.run.smithi088.stderr: 1200K .......... .......... .......... .......... .......... 1% 50.7M 6s 2024-03-09T14:43:39.634 INFO:teuthology.orchestra.run.smithi088.stderr: 1250K .......... .......... .......... .......... .......... 1% 11.0M 6s 2024-03-09T14:43:39.634 INFO:teuthology.orchestra.run.smithi088.stderr: 1300K .......... .......... .......... .......... .......... 1% 49.9M 6s 2024-03-09T14:43:39.634 INFO:teuthology.orchestra.run.smithi088.stderr: 1350K .......... .......... .......... .......... .......... 1% 110M 6s 2024-03-09T14:43:39.634 INFO:teuthology.orchestra.run.smithi088.stderr: 1400K .......... .......... .......... .......... .......... 1% 51.0M 6s 2024-03-09T14:43:39.634 INFO:teuthology.orchestra.run.smithi088.stderr: 1450K .......... .......... .......... .......... .......... 1% 113M 6s 2024-03-09T14:43:39.634 INFO:teuthology.orchestra.run.smithi088.stderr: 1500K .......... .......... .......... .......... .......... 1% 31.9M 6s 2024-03-09T14:43:39.634 INFO:teuthology.orchestra.run.smithi088.stderr: 1550K .......... .......... .......... .......... .......... 1% 73.8M 5s 2024-03-09T14:43:39.634 INFO:teuthology.orchestra.run.smithi088.stderr: 1600K .......... .......... .......... .......... .......... 1% 136M 5s 2024-03-09T14:43:39.635 INFO:teuthology.orchestra.run.smithi088.stderr: 1650K .......... .......... .......... .......... .......... 1% 60.8M 5s 2024-03-09T14:43:39.635 INFO:teuthology.orchestra.run.smithi088.stderr: 1700K .......... .......... .......... .......... .......... 1% 76.4M 5s 2024-03-09T14:43:39.635 INFO:teuthology.orchestra.run.smithi088.stderr: 1750K .......... .......... .......... .......... .......... 1% 50.2M 5s 2024-03-09T14:43:39.635 INFO:teuthology.orchestra.run.smithi088.stderr: 1800K .......... .......... .......... .......... .......... 1% 114M 5s 2024-03-09T14:43:39.635 INFO:teuthology.orchestra.run.smithi088.stderr: 1850K .......... .......... .......... .......... .......... 2% 105M 5s 2024-03-09T14:43:39.635 INFO:teuthology.orchestra.run.smithi088.stderr: 1900K .......... .......... .......... .......... .......... 2% 102M 5s 2024-03-09T14:43:39.635 INFO:teuthology.orchestra.run.smithi088.stderr: 1950K .......... .......... .......... .......... .......... 2% 48.6M 5s 2024-03-09T14:43:39.635 INFO:teuthology.orchestra.run.smithi088.stderr: 2000K .......... .......... .......... .......... .......... 2% 128M 4s 2024-03-09T14:43:39.635 INFO:teuthology.orchestra.run.smithi088.stderr: 2050K .......... .......... .......... .......... .......... 2% 108M 4s 2024-03-09T14:43:39.635 INFO:teuthology.orchestra.run.smithi088.stderr: 2100K .......... .......... .......... .......... .......... 2% 52.0M 4s 2024-03-09T14:43:39.635 INFO:teuthology.orchestra.run.smithi088.stderr: 2150K .......... .......... .......... .......... .......... 2% 100M 4s 2024-03-09T14:43:39.635 INFO:teuthology.orchestra.run.smithi088.stderr: 2200K .......... .......... .......... .......... .......... 2% 49.4M 4s 2024-03-09T14:43:39.635 INFO:teuthology.orchestra.run.smithi088.stderr: 2250K .......... .......... .......... .......... .......... 2% 129M 4s 2024-03-09T14:43:39.635 INFO:teuthology.orchestra.run.smithi088.stderr: 2300K .......... .......... .......... .......... .......... 2% 120M 4s 2024-03-09T14:43:39.635 INFO:teuthology.orchestra.run.smithi088.stderr: 2350K .......... .......... .......... .......... .......... 2% 89.5M 4s 2024-03-09T14:43:39.636 INFO:teuthology.orchestra.run.smithi088.stderr: 2400K .......... .......... .......... .......... .......... 2% 100M 4s 2024-03-09T14:43:39.636 INFO:teuthology.orchestra.run.smithi088.stderr: 2450K .......... .......... .......... .......... .......... 2% 126M 4s 2024-03-09T14:43:39.636 INFO:teuthology.orchestra.run.smithi088.stderr: 2500K .......... .......... .......... .......... .......... 2% 112M 4s 2024-03-09T14:43:39.636 INFO:teuthology.orchestra.run.smithi088.stderr: 2550K .......... .......... .......... .......... .......... 2% 15.3M 4s 2024-03-09T14:43:39.636 INFO:teuthology.orchestra.run.smithi088.stderr: 2600K .......... .......... .......... .......... .......... 2% 107M 4s 2024-03-09T14:43:39.636 INFO:teuthology.orchestra.run.smithi088.stderr: 2650K .......... .......... .......... .......... .......... 2% 54.8M 4s 2024-03-09T14:43:39.636 INFO:teuthology.orchestra.run.smithi088.stderr: 2700K .......... .......... .......... .......... .......... 2% 109M 4s 2024-03-09T14:43:39.636 INFO:teuthology.orchestra.run.smithi088.stderr: 2750K .......... .......... .......... .......... .......... 3% 42.7M 4s 2024-03-09T14:43:39.636 INFO:teuthology.orchestra.run.smithi088.stderr: 2800K .......... .......... .......... .......... .......... 3% 48.9M 4s 2024-03-09T14:43:39.636 INFO:teuthology.orchestra.run.smithi088.stderr: 2850K .......... .......... .......... .......... .......... 3% 120M 4s 2024-03-09T14:43:39.636 INFO:teuthology.orchestra.run.smithi088.stderr: 2900K .......... .......... .......... .......... .......... 3% 118M 3s 2024-03-09T14:43:39.636 INFO:teuthology.orchestra.run.smithi088.stderr: 2950K .......... .......... .......... .......... .......... 3% 109M 3s 2024-03-09T14:43:39.636 INFO:teuthology.orchestra.run.smithi088.stderr: 3000K .......... .......... .......... .......... .......... 3% 117M 3s 2024-03-09T14:43:39.636 INFO:teuthology.orchestra.run.smithi088.stderr: 3050K .......... .......... .......... .......... .......... 3% 49.4M 3s 2024-03-09T14:43:39.636 INFO:teuthology.orchestra.run.smithi088.stderr: 3100K .......... .......... .......... .......... .......... 3% 117M 3s 2024-03-09T14:43:39.637 INFO:teuthology.orchestra.run.smithi088.stderr: 3150K .......... .......... .......... .......... .......... 3% 80.9M 3s 2024-03-09T14:43:39.637 INFO:teuthology.orchestra.run.smithi088.stderr: 3200K .......... .......... .......... .......... .......... 3% 52.4M 3s 2024-03-09T14:43:39.637 INFO:teuthology.orchestra.run.smithi088.stderr: 3250K .......... .......... .......... .......... .......... 3% 116M 3s 2024-03-09T14:43:39.637 INFO:teuthology.orchestra.run.smithi088.stderr: 3300K .......... .......... .......... .......... .......... 3% 47.0M 3s 2024-03-09T14:43:39.637 INFO:teuthology.orchestra.run.smithi088.stderr: 3350K .......... .......... .......... .......... .......... 3% 111M 3s 2024-03-09T14:43:39.637 INFO:teuthology.orchestra.run.smithi088.stderr: 3400K .......... .......... .......... .......... .......... 3% 96.6M 3s 2024-03-09T14:43:39.637 INFO:teuthology.orchestra.run.smithi088.stderr: 3450K .......... .......... .......... .......... .......... 3% 131M 3s 2024-03-09T14:43:39.637 INFO:teuthology.orchestra.run.smithi088.stderr: 3500K .......... .......... .......... .......... .......... 3% 49.5M 3s 2024-03-09T14:43:39.637 INFO:teuthology.orchestra.run.smithi088.stderr: 3550K .......... .......... .......... .......... .......... 3% 81.6M 3s 2024-03-09T14:43:39.637 INFO:teuthology.orchestra.run.smithi088.stderr: 3600K .......... .......... .......... .......... .......... 3% 132M 3s 2024-03-09T14:43:39.637 INFO:teuthology.orchestra.run.smithi088.stderr: 3650K .......... .......... .......... .......... .......... 3% 114M 3s 2024-03-09T14:43:39.637 INFO:teuthology.orchestra.run.smithi088.stderr: 3700K .......... .......... .......... .......... .......... 4% 118M 3s 2024-03-09T14:43:39.637 INFO:teuthology.orchestra.run.smithi088.stderr: 3750K .......... .......... .......... .......... .......... 4% 44.3M 3s 2024-03-09T14:43:39.637 INFO:teuthology.orchestra.run.smithi088.stderr: 3800K .......... .......... .......... .......... .......... 4% 152M 3s 2024-03-09T14:43:39.637 INFO:teuthology.orchestra.run.smithi088.stderr: 3850K .......... .......... .......... .......... .......... 4% 116M 3s 2024-03-09T14:43:39.638 INFO:teuthology.orchestra.run.smithi088.stderr: 3900K .......... .......... .......... .......... .......... 4% 104M 3s 2024-03-09T14:43:39.638 INFO:teuthology.orchestra.run.smithi088.stderr: 3950K .......... .......... .......... .......... .......... 4% 106M 3s 2024-03-09T14:43:39.638 INFO:teuthology.orchestra.run.smithi088.stderr: 4000K .......... .......... .......... .......... .......... 4% 124M 3s 2024-03-09T14:43:39.638 INFO:teuthology.orchestra.run.smithi088.stderr: 4050K .......... .......... .......... .......... .......... 4% 90.9M 3s 2024-03-09T14:43:39.638 INFO:teuthology.orchestra.run.smithi088.stderr: 4100K .......... .......... .......... .......... .......... 4% 119M 3s 2024-03-09T14:43:39.638 INFO:teuthology.orchestra.run.smithi088.stderr: 4150K .......... .......... .......... .......... .......... 4% 113M 3s 2024-03-09T14:43:39.638 INFO:teuthology.orchestra.run.smithi088.stderr: 4200K .......... .......... .......... .......... .......... 4% 108M 3s 2024-03-09T14:43:39.638 INFO:teuthology.orchestra.run.smithi088.stderr: 4250K .......... .......... .......... .......... .......... 4% 23.5M 3s 2024-03-09T14:43:39.638 INFO:teuthology.orchestra.run.smithi088.stderr: 4300K .......... .......... .......... .......... .......... 4% 94.8M 3s 2024-03-09T14:43:39.638 INFO:teuthology.orchestra.run.smithi088.stderr: 4350K .......... .......... .......... .......... .......... 4% 62.6M 3s 2024-03-09T14:43:39.638 INFO:teuthology.orchestra.run.smithi088.stderr: 4400K .......... .......... .......... .......... .......... 4% 98.3M 3s 2024-03-09T14:43:39.638 INFO:teuthology.orchestra.run.smithi088.stderr: 4450K .......... .......... .......... .......... .......... 4% 44.0M 3s 2024-03-09T14:43:39.638 INFO:teuthology.orchestra.run.smithi088.stderr: 4500K .......... .......... .......... .......... .......... 4% 115M 3s 2024-03-09T14:43:39.638 INFO:teuthology.orchestra.run.smithi088.stderr: 4550K .......... .......... .......... .......... .......... 4% 114M 3s 2024-03-09T14:43:39.638 INFO:teuthology.orchestra.run.smithi088.stderr: 4600K .......... .......... .......... .......... .......... 5% 122M 3s 2024-03-09T14:43:39.639 INFO:teuthology.orchestra.run.smithi088.stderr: 4650K .......... .......... .......... .......... .......... 5% 49.6M 3s 2024-03-09T14:43:39.639 INFO:teuthology.orchestra.run.smithi088.stderr: 4700K .......... .......... .......... .......... .......... 5% 120M 3s 2024-03-09T14:43:39.639 INFO:teuthology.orchestra.run.smithi088.stderr: 4750K .......... .......... .......... .......... .......... 5% 116M 3s 2024-03-09T14:43:39.641 INFO:teuthology.orchestra.run.smithi088.stderr: 4800K .......... .......... .......... .......... .......... 5% 106M 2s 2024-03-09T14:43:39.642 INFO:teuthology.orchestra.run.smithi088.stderr: 4850K .......... .......... .......... .......... .......... 5% 94.9M 2s 2024-03-09T14:43:39.642 INFO:teuthology.orchestra.run.smithi088.stderr: 4900K .......... .......... .......... .......... .......... 5% 120M 2s 2024-03-09T14:43:39.642 INFO:teuthology.orchestra.run.smithi088.stderr: 4950K .......... .......... .......... .......... .......... 5% 76.9M 2s 2024-03-09T14:43:39.642 INFO:teuthology.orchestra.run.smithi088.stderr: 5000K .......... .......... .......... .......... .......... 5% 19.7M 2s 2024-03-09T14:43:39.642 INFO:teuthology.orchestra.run.smithi088.stderr: 5050K .......... .......... .......... .......... .......... 5% 99.6M 2s 2024-03-09T14:43:39.642 INFO:teuthology.orchestra.run.smithi088.stderr: 5100K .......... .......... .......... .......... .......... 5% 122M 2s 2024-03-09T14:43:39.642 INFO:teuthology.orchestra.run.smithi088.stderr: 5150K .......... .......... .......... .......... .......... 5% 120M 2s 2024-03-09T14:43:39.642 INFO:teuthology.orchestra.run.smithi088.stderr: 5200K .......... .......... .......... .......... .......... 5% 31.4M 2s 2024-03-09T14:43:39.642 INFO:teuthology.orchestra.run.smithi088.stderr: 5250K .......... .......... .......... .......... .......... 5% 88.8M 2s 2024-03-09T14:43:39.642 INFO:teuthology.orchestra.run.smithi088.stderr: 5300K .......... .......... .......... .......... .......... 5% 31.1M 2s 2024-03-09T14:43:39.642 INFO:teuthology.orchestra.run.smithi088.stderr: 5350K .......... .......... .......... .......... .......... 5% 145M 2s 2024-03-09T14:43:39.643 INFO:teuthology.orchestra.run.smithi088.stderr: 5400K .......... .......... .......... .......... .......... 5% 113M 2s 2024-03-09T14:43:39.643 INFO:teuthology.orchestra.run.smithi088.stderr: 5450K .......... .......... .......... .......... .......... 5% 41.2M 2s 2024-03-09T14:43:39.643 INFO:teuthology.orchestra.run.smithi088.stderr: 5500K .......... .......... .......... .......... .......... 5% 110M 2s 2024-03-09T14:43:39.643 INFO:teuthology.orchestra.run.smithi088.stderr: 5550K .......... .......... .......... .......... .......... 6% 121M 2s 2024-03-09T14:43:39.643 INFO:teuthology.orchestra.run.smithi088.stderr: 5600K .......... .......... .......... .......... .......... 6% 111M 2s 2024-03-09T14:43:39.643 INFO:teuthology.orchestra.run.smithi088.stderr: 5650K .......... .......... .......... .......... .......... 6% 54.8M 2s 2024-03-09T14:43:39.643 INFO:teuthology.orchestra.run.smithi088.stderr: 5700K .......... .......... .......... .......... .......... 6% 49.9M 2s 2024-03-09T14:43:39.643 INFO:teuthology.orchestra.run.smithi088.stderr: 5750K .......... .......... .......... .......... .......... 6% 112M 2s 2024-03-09T14:43:39.643 INFO:teuthology.orchestra.run.smithi088.stderr: 5800K .......... .......... .......... .......... .......... 6% 114M 2s 2024-03-09T14:43:39.643 INFO:teuthology.orchestra.run.smithi088.stderr: 5850K .......... .......... .......... .......... .......... 6% 29.9M 2s 2024-03-09T14:43:39.643 INFO:teuthology.orchestra.run.smithi088.stderr: 5900K .......... .......... .......... .......... .......... 6% 96.8M 2s 2024-03-09T14:43:39.643 INFO:teuthology.orchestra.run.smithi088.stderr: 5950K .......... .......... .......... .......... .......... 6% 109M 2s 2024-03-09T14:43:39.643 INFO:teuthology.orchestra.run.smithi088.stderr: 6000K .......... .......... .......... .......... .......... 6% 159M 2s 2024-03-09T14:43:39.643 INFO:teuthology.orchestra.run.smithi088.stderr: 6050K .......... .......... .......... .......... .......... 6% 84.8M 2s 2024-03-09T14:43:39.643 INFO:teuthology.orchestra.run.smithi088.stderr: 6100K .......... .......... .......... .......... .......... 6% 111M 2s 2024-03-09T14:43:39.644 INFO:teuthology.orchestra.run.smithi088.stderr: 6150K .......... .......... .......... .......... .......... 6% 108M 2s 2024-03-09T14:43:39.644 INFO:teuthology.orchestra.run.smithi088.stderr: 6200K .......... .......... .......... .......... .......... 6% 119M 2s 2024-03-09T14:43:39.644 INFO:teuthology.orchestra.run.smithi088.stderr: 6250K .......... .......... .......... .......... .......... 6% 117M 2s 2024-03-09T14:43:39.644 INFO:teuthology.orchestra.run.smithi088.stderr: 6300K .......... .......... .......... .......... .......... 6% 105M 2s 2024-03-09T14:43:39.644 INFO:teuthology.orchestra.run.smithi088.stderr: 6350K .......... .......... .......... .......... .......... 6% 15.6M 2s 2024-03-09T14:43:39.644 INFO:teuthology.orchestra.run.smithi088.stderr: 6400K .......... .......... .......... .......... .......... 6% 114M 2s 2024-03-09T14:43:39.644 INFO:teuthology.orchestra.run.smithi088.stderr: 6450K .......... .......... .......... .......... .......... 6% 45.2M 2s 2024-03-09T14:43:39.644 INFO:teuthology.orchestra.run.smithi088.stderr: 6500K .......... .......... .......... .......... .......... 7% 119M 2s 2024-03-09T14:43:39.644 INFO:teuthology.orchestra.run.smithi088.stderr: 6550K .......... .......... .......... .......... .......... 7% 78.4M 2s 2024-03-09T14:43:39.644 INFO:teuthology.orchestra.run.smithi088.stderr: 6600K .......... .......... .......... .......... .......... 7% 58.1M 2s 2024-03-09T14:43:39.644 INFO:teuthology.orchestra.run.smithi088.stderr: 6650K .......... .......... .......... .......... .......... 7% 115M 2s 2024-03-09T14:43:39.644 INFO:teuthology.orchestra.run.smithi088.stderr: 6700K .......... .......... .......... .......... .......... 7% 118M 2s 2024-03-09T14:43:39.644 INFO:teuthology.orchestra.run.smithi088.stderr: 6750K .......... .......... .......... .......... .......... 7% 46.9M 2s 2024-03-09T14:43:39.644 INFO:teuthology.orchestra.run.smithi088.stderr: 6800K .......... .......... .......... .......... .......... 7% 49.4M 2s 2024-03-09T14:43:39.644 INFO:teuthology.orchestra.run.smithi088.stderr: 6850K .......... .......... .......... .......... .......... 7% 44.1M 2s 2024-03-09T14:43:39.645 INFO:teuthology.orchestra.run.smithi088.stderr: 6900K .......... .......... .......... .......... .......... 7% 106M 2s 2024-03-09T14:43:39.645 INFO:teuthology.orchestra.run.smithi088.stderr: 6950K .......... .......... .......... .......... .......... 7% 127M 2s 2024-03-09T14:43:39.645 INFO:teuthology.orchestra.run.smithi088.stderr: 7000K .......... .......... .......... .......... .......... 7% 117M 2s 2024-03-09T14:43:39.645 INFO:teuthology.orchestra.run.smithi088.stderr: 7050K .......... .......... .......... .......... .......... 7% 110M 2s 2024-03-09T14:43:39.645 INFO:teuthology.orchestra.run.smithi088.stderr: 7100K .......... .......... .......... .......... .......... 7% 114M 2s 2024-03-09T14:43:39.645 INFO:teuthology.orchestra.run.smithi088.stderr: 7150K .......... .......... .......... .......... .......... 7% 117M 2s 2024-03-09T14:43:39.645 INFO:teuthology.orchestra.run.smithi088.stderr: 7200K .......... .......... .......... .......... .......... 7% 50.8M 2s 2024-03-09T14:43:39.645 INFO:teuthology.orchestra.run.smithi088.stderr: 7250K .......... .......... .......... .......... .......... 7% 44.4M 2s 2024-03-09T14:43:39.645 INFO:teuthology.orchestra.run.smithi088.stderr: 7300K .......... .......... .......... .......... .......... 7% 51.0M 2s 2024-03-09T14:43:39.645 INFO:teuthology.orchestra.run.smithi088.stderr: 7350K .......... .......... .......... .......... .......... 7% 49.8M 2s 2024-03-09T14:43:39.645 INFO:teuthology.orchestra.run.smithi088.stderr: 7400K .......... .......... .......... .......... .......... 8% 122M 2s 2024-03-09T14:43:39.645 INFO:teuthology.orchestra.run.smithi088.stderr: 7450K .......... .......... .......... .......... .......... 8% 99.9M 2s 2024-03-09T14:43:39.645 INFO:teuthology.orchestra.run.smithi088.stderr: 7500K .......... .......... .......... .......... .......... 8% 135M 2s 2024-03-09T14:43:39.645 INFO:teuthology.orchestra.run.smithi088.stderr: 7550K .......... .......... .......... .......... .......... 8% 52.0M 2s 2024-03-09T14:43:39.646 INFO:teuthology.orchestra.run.smithi088.stderr: 7600K .......... .......... .......... .......... .......... 8% 102M 2s 2024-03-09T14:43:39.646 INFO:teuthology.orchestra.run.smithi088.stderr: 7650K .......... .......... .......... .......... .......... 8% 21.9M 2s 2024-03-09T14:43:39.646 INFO:teuthology.orchestra.run.smithi088.stderr: 7700K .......... .......... .......... .......... .......... 8% 105M 2s 2024-03-09T14:43:39.646 INFO:teuthology.orchestra.run.smithi088.stderr: 7750K .......... .......... .......... .......... .......... 8% 110M 2s 2024-03-09T14:43:39.646 INFO:teuthology.orchestra.run.smithi088.stderr: 7800K .......... .......... .......... .......... .......... 8% 30.0M 2s 2024-03-09T14:43:39.646 INFO:teuthology.orchestra.run.smithi088.stderr: 7850K .......... .......... .......... .......... .......... 8% 134M 2s 2024-03-09T14:43:39.646 INFO:teuthology.orchestra.run.smithi088.stderr: 7900K .......... .......... .......... .......... .......... 8% 106M 2s 2024-03-09T14:43:39.646 INFO:teuthology.orchestra.run.smithi088.stderr: 7950K .......... .......... .......... .......... .......... 8% 49.9M 2s 2024-03-09T14:43:39.646 INFO:teuthology.orchestra.run.smithi088.stderr: 8000K .......... .......... .......... .......... .......... 8% 110M 2s 2024-03-09T14:43:39.646 INFO:teuthology.orchestra.run.smithi088.stderr: 8050K .......... .......... .......... .......... .......... 8% 38.8M 2s 2024-03-09T14:43:39.646 INFO:teuthology.orchestra.run.smithi088.stderr: 8100K .......... .......... .......... .......... .......... 8% 93.5M 2s 2024-03-09T14:43:39.646 INFO:teuthology.orchestra.run.smithi088.stderr: 8150K .......... .......... .......... .......... .......... 8% 117M 2s 2024-03-09T14:43:39.646 INFO:teuthology.orchestra.run.smithi088.stderr: 8200K .......... .......... .......... .......... .......... 8% 31.4M 2s 2024-03-09T14:43:39.646 INFO:teuthology.orchestra.run.smithi088.stderr: 8250K .......... .......... .......... .......... .......... 8% 92.6M 2s 2024-03-09T14:43:39.647 INFO:teuthology.orchestra.run.smithi088.stderr: 8300K .......... .......... .......... .......... .......... 8% 128M 2s 2024-03-09T14:43:39.647 INFO:teuthology.orchestra.run.smithi088.stderr: 8350K .......... .......... .......... .......... .......... 9% 112M 2s 2024-03-09T14:43:39.647 INFO:teuthology.orchestra.run.smithi088.stderr: 8400K .......... .......... .......... .......... .......... 9% 115M 2s 2024-03-09T14:43:39.647 INFO:teuthology.orchestra.run.smithi088.stderr: 8450K .......... .......... .......... .......... .......... 9% 84.2M 2s 2024-03-09T14:43:39.647 INFO:teuthology.orchestra.run.smithi088.stderr: 8500K .......... .......... .......... .......... .......... 9% 82.0M 2s 2024-03-09T14:43:39.647 INFO:teuthology.orchestra.run.smithi088.stderr: 8550K .......... .......... .......... .......... .......... 9% 96.5M 2s 2024-03-09T14:43:39.647 INFO:teuthology.orchestra.run.smithi088.stderr: 8600K .......... .......... .......... .......... .......... 9% 98.2M 2s 2024-03-09T14:43:39.647 INFO:teuthology.orchestra.run.smithi088.stderr: 8650K .......... .......... .......... .......... .......... 9% 39.7M 2s 2024-03-09T14:43:39.647 INFO:teuthology.orchestra.run.smithi088.stderr: 8700K .......... .......... .......... .......... .......... 9% 50.3M 2s 2024-03-09T14:43:39.647 INFO:teuthology.orchestra.run.smithi088.stderr: 8750K .......... .......... .......... .......... .......... 9% 50.6M 2s 2024-03-09T14:43:39.647 INFO:teuthology.orchestra.run.smithi088.stderr: 8800K .......... .......... .......... .......... .......... 9% 112M 2s 2024-03-09T14:43:39.647 INFO:teuthology.orchestra.run.smithi088.stderr: 8850K .......... .......... .......... .......... .......... 9% 44.9M 2s 2024-03-09T14:43:39.647 INFO:teuthology.orchestra.run.smithi088.stderr: 8900K .......... .......... .......... .......... .......... 9% 120M 2s 2024-03-09T14:43:39.647 INFO:teuthology.orchestra.run.smithi088.stderr: 8950K .......... .......... .......... .......... .......... 9% 47.9M 2s 2024-03-09T14:43:39.647 INFO:teuthology.orchestra.run.smithi088.stderr: 9000K .......... .......... .......... .......... .......... 9% 50.9M 2s 2024-03-09T14:43:39.648 INFO:teuthology.orchestra.run.smithi088.stderr: 9050K .......... .......... .......... .......... .......... 9% 25.7M 2s 2024-03-09T14:43:39.648 INFO:teuthology.orchestra.run.smithi088.stderr: 9100K .......... .......... .......... .......... .......... 9% 115M 2s 2024-03-09T14:43:39.648 INFO:teuthology.orchestra.run.smithi088.stderr: 9150K .......... .......... .......... .......... .......... 9% 115M 2s 2024-03-09T14:43:39.648 INFO:teuthology.orchestra.run.smithi088.stderr: 9200K .......... .......... .......... .......... .......... 9% 72.4M 2s 2024-03-09T14:43:39.648 INFO:teuthology.orchestra.run.smithi088.stderr: 9250K .......... .......... .......... .......... .......... 10% 92.4M 2s 2024-03-09T14:43:39.648 INFO:teuthology.orchestra.run.smithi088.stderr: 9300K .......... .......... .......... .......... .......... 10% 118M 2s 2024-03-09T14:43:39.648 INFO:teuthology.orchestra.run.smithi088.stderr: 9350K .......... .......... .......... .......... .......... 10% 107M 2s 2024-03-09T14:43:39.648 INFO:teuthology.orchestra.run.smithi088.stderr: 9400K .......... .......... .......... .......... .......... 10% 110M 2s 2024-03-09T14:43:39.648 INFO:teuthology.orchestra.run.smithi088.stderr: 9450K .......... .......... .......... .......... .......... 10% 50.4M 2s 2024-03-09T14:43:39.648 INFO:teuthology.orchestra.run.smithi088.stderr: 9500K .......... .......... .......... .......... .......... 10% 110M 2s 2024-03-09T14:43:39.648 INFO:teuthology.orchestra.run.smithi088.stderr: 9550K .......... .......... .......... .......... .......... 10% 134M 2s 2024-03-09T14:43:39.648 INFO:teuthology.orchestra.run.smithi088.stderr: 9600K .......... .......... .......... .......... .......... 10% 49.9M 2s 2024-03-09T14:43:39.648 INFO:teuthology.orchestra.run.smithi088.stderr: 9650K .......... .......... .......... .......... .......... 10% 45.1M 2s 2024-03-09T14:43:39.648 INFO:teuthology.orchestra.run.smithi088.stderr: 9700K .......... .......... .......... .......... .......... 10% 44.6M 2s 2024-03-09T14:43:39.649 INFO:teuthology.orchestra.run.smithi088.stderr: 9750K .......... .......... .......... .......... .......... 10% 114M 2s 2024-03-09T14:43:39.649 INFO:teuthology.orchestra.run.smithi088.stderr: 9800K .......... .......... .......... .......... .......... 10% 54.4M 2s 2024-03-09T14:43:39.649 INFO:teuthology.orchestra.run.smithi088.stderr: 9850K .......... .......... .......... .......... .......... 10% 111M 2s 2024-03-09T14:43:39.649 INFO:teuthology.orchestra.run.smithi088.stderr: 9900K .......... .......... .......... .......... .......... 10% 94.9M 2s 2024-03-09T14:43:39.649 INFO:teuthology.orchestra.run.smithi088.stderr: 9950K .......... .......... .......... .......... .......... 10% 120M 2s 2024-03-09T14:43:39.649 INFO:teuthology.orchestra.run.smithi088.stderr: 10000K .......... .......... .......... .......... .......... 10% 55.8M 2s 2024-03-09T14:43:39.649 INFO:teuthology.orchestra.run.smithi088.stderr: 10050K .......... .......... .......... .......... .......... 10% 41.0M 2s 2024-03-09T14:43:39.649 INFO:teuthology.orchestra.run.smithi088.stderr: 10100K .......... .......... .......... .......... .......... 10% 49.8M 2s 2024-03-09T14:43:39.649 INFO:teuthology.orchestra.run.smithi088.stderr: 10150K .......... .......... .......... .......... .......... 10% 51.0M 2s 2024-03-09T14:43:39.649 INFO:teuthology.orchestra.run.smithi088.stderr: 10200K .......... .......... .......... .......... .......... 11% 117M 2s 2024-03-09T14:43:39.649 INFO:teuthology.orchestra.run.smithi088.stderr: 10250K .......... .......... .......... .......... .......... 11% 114M 2s 2024-03-09T14:43:39.649 INFO:teuthology.orchestra.run.smithi088.stderr: 10300K .......... .......... .......... .......... .......... 11% 87.8M 2s 2024-03-09T14:43:39.649 INFO:teuthology.orchestra.run.smithi088.stderr: 10350K .......... .......... .......... .......... .......... 11% 34.9M 2s 2024-03-09T14:43:39.649 INFO:teuthology.orchestra.run.smithi088.stderr: 10400K .......... .......... .......... .......... .......... 11% 48.5M 2s 2024-03-09T14:43:39.649 INFO:teuthology.orchestra.run.smithi088.stderr: 10450K .......... .......... .......... .......... .......... 11% 94.0M 2s 2024-03-09T14:43:39.650 INFO:teuthology.orchestra.run.smithi088.stderr: 10500K .......... .......... .......... .......... .......... 11% 129M 2s 2024-03-09T14:43:39.650 INFO:teuthology.orchestra.run.smithi088.stderr: 10550K .......... .......... .......... .......... .......... 11% 49.1M 2s 2024-03-09T14:43:39.650 INFO:teuthology.orchestra.run.smithi088.stderr: 10600K .......... .......... .......... .......... .......... 11% 70.0M 2s 2024-03-09T14:43:39.650 INFO:teuthology.orchestra.run.smithi088.stderr: 10650K .......... .......... .......... .......... .......... 11% 40.9M 2s 2024-03-09T14:43:39.650 INFO:teuthology.orchestra.run.smithi088.stderr: 10700K .......... .......... .......... .......... .......... 11% 122M 2s 2024-03-09T14:43:39.650 INFO:teuthology.orchestra.run.smithi088.stderr: 10750K .......... .......... .......... .......... .......... 11% 96.5M 2s 2024-03-09T14:43:39.650 INFO:teuthology.orchestra.run.smithi088.stderr: 10800K .......... .......... .......... .......... .......... 11% 118M 2s 2024-03-09T14:43:39.650 INFO:teuthology.orchestra.run.smithi088.stderr: 10850K .......... .......... .......... .......... .......... 11% 84.6M 2s 2024-03-09T14:43:39.650 INFO:teuthology.orchestra.run.smithi088.stderr: 10900K .......... .......... .......... .......... .......... 11% 71.6M 2s 2024-03-09T14:43:39.650 INFO:teuthology.orchestra.run.smithi088.stderr: 10950K .......... .......... .......... .......... .......... 11% 129M 2s 2024-03-09T14:43:39.650 INFO:teuthology.orchestra.run.smithi088.stderr: 11000K .......... .......... .......... .......... .......... 11% 39.4M 2s 2024-03-09T14:43:39.650 INFO:teuthology.orchestra.run.smithi088.stderr: 11050K .......... .......... .......... .......... .......... 11% 96.5M 2s 2024-03-09T14:43:39.650 INFO:teuthology.orchestra.run.smithi088.stderr: 11100K .......... .......... .......... .......... .......... 12% 51.1M 2s 2024-03-09T14:43:39.650 INFO:teuthology.orchestra.run.smithi088.stderr: 11150K .......... .......... .......... .......... .......... 12% 96.3M 2s 2024-03-09T14:43:39.650 INFO:teuthology.orchestra.run.smithi088.stderr: 11200K .......... .......... .......... .......... .......... 12% 126M 2s 2024-03-09T14:43:39.651 INFO:teuthology.orchestra.run.smithi088.stderr: 11250K .......... .......... .......... .......... .......... 12% 41.9M 2s 2024-03-09T14:43:39.651 INFO:teuthology.orchestra.run.smithi088.stderr: 11300K .......... .......... .......... .......... .......... 12% 119M 2s 2024-03-09T14:43:39.651 INFO:teuthology.orchestra.run.smithi088.stderr: 11350K .......... .......... .......... .......... .......... 12% 49.2M 2s 2024-03-09T14:43:39.651 INFO:teuthology.orchestra.run.smithi088.stderr: 11400K .......... .......... .......... .......... .......... 12% 119M 2s 2024-03-09T14:43:39.651 INFO:teuthology.orchestra.run.smithi088.stderr: 11450K .......... .......... .......... .......... .......... 12% 53.0M 2s 2024-03-09T14:43:39.651 INFO:teuthology.orchestra.run.smithi088.stderr: 11500K .......... .......... .......... .......... .......... 12% 70.7M 2s 2024-03-09T14:43:39.651 INFO:teuthology.orchestra.run.smithi088.stderr: 11550K .......... .......... .......... .......... .......... 12% 38.4M 2s 2024-03-09T14:43:39.651 INFO:teuthology.orchestra.run.smithi088.stderr: 11600K .......... .......... .......... .......... .......... 12% 113M 2s 2024-03-09T14:43:39.651 INFO:teuthology.orchestra.run.smithi088.stderr: 11650K .......... .......... .......... .......... .......... 12% 42.5M 2s 2024-03-09T14:43:39.651 INFO:teuthology.orchestra.run.smithi088.stderr: 11700K .......... .......... .......... .......... .......... 12% 50.0M 2s 2024-03-09T14:43:39.651 INFO:teuthology.orchestra.run.smithi088.stderr: 11750K .......... .......... .......... .......... .......... 12% 71.9M 2s 2024-03-09T14:43:39.651 INFO:teuthology.orchestra.run.smithi088.stderr: 11800K .......... .......... .......... .......... .......... 12% 57.0M 2s 2024-03-09T14:43:39.651 INFO:teuthology.orchestra.run.smithi088.stderr: 11850K .......... .......... .......... .......... .......... 12% 137M 2s 2024-03-09T14:43:39.651 INFO:teuthology.orchestra.run.smithi088.stderr: 11900K .......... .......... .......... .......... .......... 12% 91.5M 2s 2024-03-09T14:43:39.651 INFO:teuthology.orchestra.run.smithi088.stderr: 11950K .......... .......... .......... .......... .......... 12% 56.0M 2s 2024-03-09T14:43:39.652 INFO:teuthology.orchestra.run.smithi088.stderr: 12000K .......... .......... .......... .......... .......... 12% 95.9M 2s 2024-03-09T14:43:39.652 INFO:teuthology.orchestra.run.smithi088.stderr: 12050K .......... .......... .......... .......... .......... 13% 48.9M 2s 2024-03-09T14:43:39.652 INFO:teuthology.orchestra.run.smithi088.stderr: 12100K .......... .......... .......... .......... .......... 13% 119M 2s 2024-03-09T14:43:39.652 INFO:teuthology.orchestra.run.smithi088.stderr: 12150K .......... .......... .......... .......... .......... 13% 92.0M 2s 2024-03-09T14:43:39.652 INFO:teuthology.orchestra.run.smithi088.stderr: 12200K .......... .......... .......... .......... .......... 13% 50.2M 2s 2024-03-09T14:43:39.652 INFO:teuthology.orchestra.run.smithi088.stderr: 12250K .......... .......... .......... .......... .......... 13% 51.1M 2s 2024-03-09T14:43:39.652 INFO:teuthology.orchestra.run.smithi088.stderr: 12300K .......... .......... .......... .......... .......... 13% 106M 2s 2024-03-09T14:43:39.652 INFO:teuthology.orchestra.run.smithi088.stderr: 12350K .......... .......... .......... .......... .......... 13% 121M 2s 2024-03-09T14:43:39.652 INFO:teuthology.orchestra.run.smithi088.stderr: 12400K .......... .......... .......... .......... .......... 13% 55.9M 2s 2024-03-09T14:43:39.652 INFO:teuthology.orchestra.run.smithi088.stderr: 12450K .......... .......... .......... .......... .......... 13% 76.7M 2s 2024-03-09T14:43:39.652 INFO:teuthology.orchestra.run.smithi088.stderr: 12500K .......... .......... .......... .......... .......... 13% 50.3M 2s 2024-03-09T14:43:39.652 INFO:teuthology.orchestra.run.smithi088.stderr: 12550K .......... .......... .......... .......... .......... 13% 118M 2s 2024-03-09T14:43:39.652 INFO:teuthology.orchestra.run.smithi088.stderr: 12600K .......... .......... .......... .......... .......... 13% 49.4M 2s 2024-03-09T14:43:39.652 INFO:teuthology.orchestra.run.smithi088.stderr: 12650K .......... .......... .......... .......... .......... 13% 42.2M 2s 2024-03-09T14:43:39.653 INFO:teuthology.orchestra.run.smithi088.stderr: 12700K .......... .......... .......... .......... .......... 13% 117M 2s 2024-03-09T14:43:39.653 INFO:teuthology.orchestra.run.smithi088.stderr: 12750K .......... .......... .......... .......... .......... 13% 120M 2s 2024-03-09T14:43:39.653 INFO:teuthology.orchestra.run.smithi088.stderr: 12800K .......... .......... .......... .......... .......... 13% 54.2M 2s 2024-03-09T14:43:39.653 INFO:teuthology.orchestra.run.smithi088.stderr: 12850K .......... .......... .......... .......... .......... 13% 82.2M 2s 2024-03-09T14:43:39.653 INFO:teuthology.orchestra.run.smithi088.stderr: 12900K .......... .......... .......... .......... .......... 13% 52.1M 2s 2024-03-09T14:43:39.653 INFO:teuthology.orchestra.run.smithi088.stderr: 12950K .......... .......... .......... .......... .......... 13% 41.0M 2s 2024-03-09T14:43:39.653 INFO:teuthology.orchestra.run.smithi088.stderr: 13000K .......... .......... .......... .......... .......... 14% 115M 2s 2024-03-09T14:43:39.653 INFO:teuthology.orchestra.run.smithi088.stderr: 13050K .......... .......... .......... .......... .......... 14% 64.4M 2s 2024-03-09T14:43:39.653 INFO:teuthology.orchestra.run.smithi088.stderr: 13100K .......... .......... .......... .......... .......... 14% 115M 2s 2024-03-09T14:43:39.653 INFO:teuthology.orchestra.run.smithi088.stderr: 13150K .......... .......... .......... .......... .......... 14% 50.5M 2s 2024-03-09T14:43:39.653 INFO:teuthology.orchestra.run.smithi088.stderr: 13200K .......... .......... .......... .......... .......... 14% 47.0M 2s 2024-03-09T14:43:39.653 INFO:teuthology.orchestra.run.smithi088.stderr: 13250K .......... .......... .......... .......... .......... 14% 46.5M 2s 2024-03-09T14:43:39.653 INFO:teuthology.orchestra.run.smithi088.stderr: 13300K .......... .......... .......... .......... .......... 14% 121M 2s 2024-03-09T14:43:39.653 INFO:teuthology.orchestra.run.smithi088.stderr: 13350K .......... .......... .......... .......... .......... 14% 121M 2s 2024-03-09T14:43:39.653 INFO:teuthology.orchestra.run.smithi088.stderr: 13400K .......... .......... .......... .......... .......... 14% 111M 2s 2024-03-09T14:43:39.654 INFO:teuthology.orchestra.run.smithi088.stderr: 13450K .......... .......... .......... .......... .......... 14% 48.5M 2s 2024-03-09T14:43:39.654 INFO:teuthology.orchestra.run.smithi088.stderr: 13500K .......... .......... .......... .......... .......... 14% 121M 2s 2024-03-09T14:43:39.654 INFO:teuthology.orchestra.run.smithi088.stderr: 13550K .......... .......... .......... .......... .......... 14% 101M 2s 2024-03-09T14:43:39.654 INFO:teuthology.orchestra.run.smithi088.stderr: 13600K .......... .......... .......... .......... .......... 14% 53.7M 2s 2024-03-09T14:43:39.654 INFO:teuthology.orchestra.run.smithi088.stderr: 13650K .......... .......... .......... .......... .......... 14% 45.0M 2s 2024-03-09T14:43:39.654 INFO:teuthology.orchestra.run.smithi088.stderr: 13700K .......... .......... .......... .......... .......... 14% 113M 2s 2024-03-09T14:43:39.654 INFO:teuthology.orchestra.run.smithi088.stderr: 13750K .......... .......... .......... .......... .......... 14% 108M 2s 2024-03-09T14:43:39.654 INFO:teuthology.orchestra.run.smithi088.stderr: 13800K .......... .......... .......... .......... .......... 14% 130M 2s 2024-03-09T14:43:39.654 INFO:teuthology.orchestra.run.smithi088.stderr: 13850K .......... .......... .......... .......... .......... 14% 38.6M 2s 2024-03-09T14:43:39.654 INFO:teuthology.orchestra.run.smithi088.stderr: 13900K .......... .......... .......... .......... .......... 15% 100M 2s 2024-03-09T14:43:39.654 INFO:teuthology.orchestra.run.smithi088.stderr: 13950K .......... .......... .......... .......... .......... 15% 103M 2s 2024-03-09T14:43:39.654 INFO:teuthology.orchestra.run.smithi088.stderr: 14000K .......... .......... .......... .......... .......... 15% 44.5M 2s 2024-03-09T14:43:39.654 INFO:teuthology.orchestra.run.smithi088.stderr: 14050K .......... .......... .......... .......... .......... 15% 71.4M 2s 2024-03-09T14:43:39.654 INFO:teuthology.orchestra.run.smithi088.stderr: 14100K .......... .......... .......... .......... .......... 15% 110M 2s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14150K .......... .......... .......... .......... .......... 15% 44.5M 2s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14200K .......... .......... .......... .......... .......... 15% 109M 2s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14250K .......... .......... .......... .......... .......... 15% 59.5M 2s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14300K .......... .......... .......... .......... .......... 15% 32.5M 2s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14350K .......... .......... .......... .......... .......... 15% 50.1M 2s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14400K .......... .......... .......... .......... .......... 15% 100M 2s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14450K .......... .......... .......... .......... .......... 15% 96.6M 2s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14500K .......... .......... .......... .......... .......... 15% 49.8M 2s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14550K .......... .......... .......... .......... .......... 15% 50.3M 2s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14600K .......... .......... .......... .......... .......... 15% 120M 1s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14650K .......... .......... .......... .......... .......... 15% 114M 1s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14700K .......... .......... .......... .......... .......... 15% 49.1M 1s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14750K .......... .......... .......... .......... .......... 15% 123M 1s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14800K .......... .......... .......... .......... .......... 15% 50.2M 1s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14850K .......... .......... .......... .......... .......... 16% 85.6M 1s 2024-03-09T14:43:39.655 INFO:teuthology.orchestra.run.smithi088.stderr: 14900K .......... .......... .......... .......... .......... 16% 121M 1s 2024-03-09T14:43:39.656 INFO:teuthology.orchestra.run.smithi088.stderr: 14950K .......... .......... .......... .......... .......... 16% 49.3M 1s 2024-03-09T14:43:39.656 INFO:teuthology.orchestra.run.smithi088.stderr: 15000K .......... .......... .......... .......... .......... 16% 97.0M 1s 2024-03-09T14:43:39.656 INFO:teuthology.orchestra.run.smithi088.stderr: 15050K .......... .......... .......... .......... .......... 16% 47.8M 1s 2024-03-09T14:43:39.656 INFO:teuthology.orchestra.run.smithi088.stderr: 15100K .......... .......... .......... .......... .......... 16% 129M 1s 2024-03-09T14:43:39.656 INFO:teuthology.orchestra.run.smithi088.stderr: 15150K .......... .......... .......... .......... .......... 16% 127M 1s 2024-03-09T14:43:39.656 INFO:teuthology.orchestra.run.smithi088.stderr: 15200K .......... .......... .......... .......... .......... 16% 49.2M 1s 2024-03-09T14:43:39.656 INFO:teuthology.orchestra.run.smithi088.stderr: 15250K .......... .......... .......... .......... .......... 16% 46.1M 1s 2024-03-09T14:43:39.656 INFO:teuthology.orchestra.run.smithi088.stderr: 15300K .......... .......... .......... .......... .......... 16% 59.7M 1s 2024-03-09T14:43:39.656 INFO:teuthology.orchestra.run.smithi088.stderr: 15350K .......... .......... .......... .......... .......... 16% 105M 1s 2024-03-09T14:43:39.656 INFO:teuthology.orchestra.run.smithi088.stderr: 15400K .......... .......... .......... .......... .......... 16% 88.1M 1s 2024-03-09T14:43:39.656 INFO:teuthology.orchestra.run.smithi088.stderr: 15450K .......... .......... .......... .......... .......... 16% 102M 1s 2024-03-09T14:43:39.656 INFO:teuthology.orchestra.run.smithi088.stderr: 15500K .......... .......... .......... .......... .......... 16% 49.8M 1s 2024-03-09T14:43:39.656 INFO:teuthology.orchestra.run.smithi088.stderr: 15550K .......... .......... .......... .......... .......... 16% 119M 1s 2024-03-09T14:43:39.656 INFO:teuthology.orchestra.run.smithi088.stderr: 15600K .......... .......... .......... .......... .......... 16% 49.2M 1s 2024-03-09T14:43:39.656 INFO:teuthology.orchestra.run.smithi088.stderr: 15650K .......... .......... .......... .......... .......... 16% 28.8M 1s 2024-03-09T14:43:39.657 INFO:teuthology.orchestra.run.smithi088.stderr: 15700K .......... .......... .......... .......... .......... 16% 102M 1s 2024-03-09T14:43:39.657 INFO:teuthology.orchestra.run.smithi088.stderr: 15750K .......... .......... .......... .......... .......... 17% 111M 1s 2024-03-09T14:43:39.657 INFO:teuthology.orchestra.run.smithi088.stderr: 15800K .......... .......... .......... .......... .......... 17% 104M 1s 2024-03-09T14:43:39.657 INFO:teuthology.orchestra.run.smithi088.stderr: 15850K .......... .......... .......... .......... .......... 17% 110M 1s 2024-03-09T14:43:39.657 INFO:teuthology.orchestra.run.smithi088.stderr: 15900K .......... .......... .......... .......... .......... 17% 44.1M 1s 2024-03-09T14:43:39.657 INFO:teuthology.orchestra.run.smithi088.stderr: 15950K .......... .......... .......... .......... .......... 17% 31.5M 1s 2024-03-09T14:43:39.657 INFO:teuthology.orchestra.run.smithi088.stderr: 16000K .......... .......... .......... .......... .......... 17% 57.3M 1s 2024-03-09T14:43:39.657 INFO:teuthology.orchestra.run.smithi088.stderr: 16050K .......... .......... .......... .......... .......... 17% 85.0M 1s 2024-03-09T14:43:39.657 INFO:teuthology.orchestra.run.smithi088.stderr: 16100K .......... .......... .......... .......... .......... 17% 115M 1s 2024-03-09T14:43:39.657 INFO:teuthology.orchestra.run.smithi088.stderr: 16150K .......... .......... .......... .......... .......... 17% 88.9M 1s 2024-03-09T14:43:39.657 INFO:teuthology.orchestra.run.smithi088.stderr: 16200K .......... .......... .......... .......... .......... 17% 51.8M 1s 2024-03-09T14:43:39.657 INFO:teuthology.orchestra.run.smithi088.stderr: 16250K .......... .......... .......... .......... .......... 17% 88.1M 1s 2024-03-09T14:43:39.657 INFO:teuthology.orchestra.run.smithi088.stderr: 16300K .......... .......... .......... .......... .......... 17% 118M 1s 2024-03-09T14:43:39.657 INFO:teuthology.orchestra.run.smithi088.stderr: 16350K .......... .......... .......... .......... .......... 17% 48.3M 1s 2024-03-09T14:43:39.657 INFO:teuthology.orchestra.run.smithi088.stderr: 16400K .......... .......... .......... .......... .......... 17% 48.1M 1s 2024-03-09T14:43:39.658 INFO:teuthology.orchestra.run.smithi088.stderr: 16450K .......... .......... .......... .......... .......... 17% 88.9M 1s 2024-03-09T14:43:39.658 INFO:teuthology.orchestra.run.smithi088.stderr: 16500K .......... .......... .......... .......... .......... 17% 85.9M 1s 2024-03-09T14:43:39.658 INFO:teuthology.orchestra.run.smithi088.stderr: 16550K .......... .......... .......... .......... .......... 17% 126M 1s 2024-03-09T14:43:39.658 INFO:teuthology.orchestra.run.smithi088.stderr: 16600K .......... .......... .......... .......... .......... 17% 51.4M 1s 2024-03-09T14:43:39.658 INFO:teuthology.orchestra.run.smithi088.stderr: 16650K .......... .......... .......... .......... .......... 17% 129M 1s 2024-03-09T14:43:39.658 INFO:teuthology.orchestra.run.smithi088.stderr: 16700K .......... .......... .......... .......... .......... 18% 31.9M 1s 2024-03-09T14:43:39.658 INFO:teuthology.orchestra.run.smithi088.stderr: 16750K .......... .......... .......... .......... .......... 18% 119M 1s 2024-03-09T14:43:39.658 INFO:teuthology.orchestra.run.smithi088.stderr: 16800K .......... .......... .......... .......... .......... 18% 80.5M 1s 2024-03-09T14:43:39.658 INFO:teuthology.orchestra.run.smithi088.stderr: 16850K .......... .......... .......... .......... .......... 18% 81.4M 1s 2024-03-09T14:43:39.658 INFO:teuthology.orchestra.run.smithi088.stderr: 16900K .......... .......... .......... .......... .......... 18% 55.8M 1s 2024-03-09T14:43:39.658 INFO:teuthology.orchestra.run.smithi088.stderr: 16950K .......... .......... .......... .......... .......... 18% 121M 1s 2024-03-09T14:43:39.658 INFO:teuthology.orchestra.run.smithi088.stderr: 17000K .......... .......... .......... .......... .......... 18% 82.0M 1s 2024-03-09T14:43:39.658 INFO:teuthology.orchestra.run.smithi088.stderr: 17050K .......... .......... .......... .......... .......... 18% 35.3M 1s 2024-03-09T14:43:39.658 INFO:teuthology.orchestra.run.smithi088.stderr: 17100K .......... .......... .......... .......... .......... 18% 51.0M 1s 2024-03-09T14:43:39.658 INFO:teuthology.orchestra.run.smithi088.stderr: 17150K .......... .......... .......... .......... .......... 18% 106M 1s 2024-03-09T14:43:39.659 INFO:teuthology.orchestra.run.smithi088.stderr: 17200K .......... .......... .......... .......... .......... 18% 117M 1s 2024-03-09T14:43:39.659 INFO:teuthology.orchestra.run.smithi088.stderr: 17250K .......... .......... .......... .......... .......... 18% 43.7M 1s 2024-03-09T14:43:39.659 INFO:teuthology.orchestra.run.smithi088.stderr: 17300K .......... .......... .......... .......... .......... 18% 49.7M 1s 2024-03-09T14:43:39.659 INFO:teuthology.orchestra.run.smithi088.stderr: 17350K .......... .......... .......... .......... .......... 18% 49.8M 1s 2024-03-09T14:43:39.659 INFO:teuthology.orchestra.run.smithi088.stderr: 17400K .......... .......... .......... .......... .......... 18% 117M 1s 2024-03-09T14:43:39.659 INFO:teuthology.orchestra.run.smithi088.stderr: 17450K .......... .......... .......... .......... .......... 18% 110M 1s 2024-03-09T14:43:39.659 INFO:teuthology.orchestra.run.smithi088.stderr: 17500K .......... .......... .......... .......... .......... 18% 50.7M 1s 2024-03-09T14:43:39.659 INFO:teuthology.orchestra.run.smithi088.stderr: 17550K .......... .......... .......... .......... .......... 18% 119M 1s 2024-03-09T14:43:39.659 INFO:teuthology.orchestra.run.smithi088.stderr: 17600K .......... .......... .......... .......... .......... 18% 44.1M 1s 2024-03-09T14:43:39.659 INFO:teuthology.orchestra.run.smithi088.stderr: 17650K .......... .......... .......... .......... .......... 19% 48.4M 1s 2024-03-09T14:43:39.659 INFO:teuthology.orchestra.run.smithi088.stderr: 17700K .......... .......... .......... .......... .......... 19% 110M 1s 2024-03-09T14:43:39.659 INFO:teuthology.orchestra.run.smithi088.stderr: 17750K .......... .......... .......... .......... .......... 19% 111M 1s 2024-03-09T14:43:39.659 INFO:teuthology.orchestra.run.smithi088.stderr: 17800K .......... .......... .......... .......... .......... 19% 51.0M 1s 2024-03-09T14:43:39.659 INFO:teuthology.orchestra.run.smithi088.stderr: 17850K .......... .......... .......... .......... .......... 19% 107M 1s 2024-03-09T14:43:39.659 INFO:teuthology.orchestra.run.smithi088.stderr: 17900K .......... .......... .......... .......... .......... 19% 119M 1s 2024-03-09T14:43:39.660 INFO:teuthology.orchestra.run.smithi088.stderr: 17950K .......... .......... .......... .......... .......... 19% 47.7M 1s 2024-03-09T14:43:39.660 INFO:teuthology.orchestra.run.smithi088.stderr: 18000K .......... .......... .......... .......... .......... 19% 132M 1s 2024-03-09T14:43:39.660 INFO:teuthology.orchestra.run.smithi088.stderr: 18050K .......... .......... .......... .......... .......... 19% 31.1M 1s 2024-03-09T14:43:39.660 INFO:teuthology.orchestra.run.smithi088.stderr: 18100K .......... .......... .......... .......... .......... 19% 97.5M 1s 2024-03-09T14:43:39.660 INFO:teuthology.orchestra.run.smithi088.stderr: 18150K .......... .......... .......... .......... .......... 19% 119M 1s 2024-03-09T14:43:39.660 INFO:teuthology.orchestra.run.smithi088.stderr: 18200K .......... .......... .......... .......... .......... 19% 57.4M 1s 2024-03-09T14:43:39.660 INFO:teuthology.orchestra.run.smithi088.stderr: 18250K .......... .......... .......... .......... .......... 19% 110M 1s 2024-03-09T14:43:39.660 INFO:teuthology.orchestra.run.smithi088.stderr: 18300K .......... .......... .......... .......... .......... 19% 46.3M 1s 2024-03-09T14:43:39.660 INFO:teuthology.orchestra.run.smithi088.stderr: 18350K .......... .......... .......... .......... .......... 19% 108M 1s 2024-03-09T14:43:39.660 INFO:teuthology.orchestra.run.smithi088.stderr: 18400K .......... .......... .......... .......... .......... 19% 46.3M 1s 2024-03-09T14:43:39.660 INFO:teuthology.orchestra.run.smithi088.stderr: 18450K .......... .......... .......... .......... .......... 19% 84.8M 1s 2024-03-09T14:43:39.660 INFO:teuthology.orchestra.run.smithi088.stderr: 18500K .......... .......... .......... .......... .......... 19% 34.5M 1s 2024-03-09T14:43:39.660 INFO:teuthology.orchestra.run.smithi088.stderr: 18550K .......... .......... .......... .......... .......... 20% 94.6M 1s 2024-03-09T14:43:39.660 INFO:teuthology.orchestra.run.smithi088.stderr: 18600K .......... .......... .......... .......... .......... 20% 93.1M 1s 2024-03-09T14:43:39.661 INFO:teuthology.orchestra.run.smithi088.stderr: 18650K .......... .......... .......... .......... .......... 20% 104M 1s 2024-03-09T14:43:39.661 INFO:teuthology.orchestra.run.smithi088.stderr: 18700K .......... .......... .......... .......... .......... 20% 120M 1s 2024-03-09T14:43:39.661 INFO:teuthology.orchestra.run.smithi088.stderr: 18750K .......... .......... .......... .......... .......... 20% 50.3M 1s 2024-03-09T14:43:39.661 INFO:teuthology.orchestra.run.smithi088.stderr: 18800K .......... .......... .......... .......... .......... 20% 32.1M 1s 2024-03-09T14:43:39.661 INFO:teuthology.orchestra.run.smithi088.stderr: 18850K .......... .......... .......... .......... .......... 20% 44.3M 1s 2024-03-09T14:43:39.661 INFO:teuthology.orchestra.run.smithi088.stderr: 18900K .......... .......... .......... .......... .......... 20% 117M 1s 2024-03-09T14:43:39.661 INFO:teuthology.orchestra.run.smithi088.stderr: 18950K .......... .......... .......... .......... .......... 20% 121M 1s 2024-03-09T14:43:39.661 INFO:teuthology.orchestra.run.smithi088.stderr: 19000K .......... .......... .......... .......... .......... 20% 115M 1s 2024-03-09T14:43:39.661 INFO:teuthology.orchestra.run.smithi088.stderr: 19050K .......... .......... .......... .......... .......... 20% 73.3M 1s 2024-03-09T14:43:39.661 INFO:teuthology.orchestra.run.smithi088.stderr: 19100K .......... .......... .......... .......... .......... 20% 114M 1s 2024-03-09T14:43:39.661 INFO:teuthology.orchestra.run.smithi088.stderr: 19150K .......... .......... .......... .......... .......... 20% 36.6M 1s 2024-03-09T14:43:39.661 INFO:teuthology.orchestra.run.smithi088.stderr: 19200K .......... .......... .......... .......... .......... 20% 120M 1s 2024-03-09T14:43:39.661 INFO:teuthology.orchestra.run.smithi088.stderr: 19250K .......... .......... .......... .......... .......... 20% 44.9M 1s 2024-03-09T14:43:39.661 INFO:teuthology.orchestra.run.smithi088.stderr: 19300K .......... .......... .......... .......... .......... 20% 64.5M 1s 2024-03-09T14:43:39.661 INFO:teuthology.orchestra.run.smithi088.stderr: 19350K .......... .......... .......... .......... .......... 20% 75.6M 1s 2024-03-09T14:43:39.662 INFO:teuthology.orchestra.run.smithi088.stderr: 19400K .......... .......... .......... .......... .......... 20% 116M 1s 2024-03-09T14:43:39.662 INFO:teuthology.orchestra.run.smithi088.stderr: 19450K .......... .......... .......... .......... .......... 20% 108M 1s 2024-03-09T14:43:39.662 INFO:teuthology.orchestra.run.smithi088.stderr: 19500K .......... .......... .......... .......... .......... 21% 50.1M 1s 2024-03-09T14:43:39.662 INFO:teuthology.orchestra.run.smithi088.stderr: 19550K .......... .......... .......... .......... .......... 21% 109M 1s 2024-03-09T14:43:39.662 INFO:teuthology.orchestra.run.smithi088.stderr: 19600K .......... .......... .......... .......... .......... 21% 40.7M 1s 2024-03-09T14:43:39.662 INFO:teuthology.orchestra.run.smithi088.stderr: 19650K .......... .......... .......... .......... .......... 21% 102M 1s 2024-03-09T14:43:39.662 INFO:teuthology.orchestra.run.smithi088.stderr: 19700K .......... .......... .......... .......... .......... 21% 114M 1s 2024-03-09T14:43:39.662 INFO:teuthology.orchestra.run.smithi088.stderr: 19750K .......... .......... .......... .......... .......... 21% 60.7M 1s 2024-03-09T14:43:39.662 INFO:teuthology.orchestra.run.smithi088.stderr: 19800K .......... .......... .......... .......... .......... 21% 83.1M 1s 2024-03-09T14:43:39.662 INFO:teuthology.orchestra.run.smithi088.stderr: 19850K .......... .......... .......... .......... .......... 21% 169M 1s 2024-03-09T14:43:39.662 INFO:teuthology.orchestra.run.smithi088.stderr: 19900K .......... .......... .......... .......... .......... 21% 31.3M 1s 2024-03-09T14:43:39.662 INFO:teuthology.orchestra.run.smithi088.stderr: 19950K .......... .......... .......... .......... .......... 21% 106M 1s 2024-03-09T14:43:39.662 INFO:teuthology.orchestra.run.smithi088.stderr: 20000K .......... .......... .......... .......... .......... 21% 113M 1s 2024-03-09T14:43:39.662 INFO:teuthology.orchestra.run.smithi088.stderr: 20050K .......... .......... .......... .......... .......... 21% 44.8M 1s 2024-03-09T14:43:39.662 INFO:teuthology.orchestra.run.smithi088.stderr: 20100K .......... .......... .......... .......... .......... 21% 112M 1s 2024-03-09T14:43:39.663 INFO:teuthology.orchestra.run.smithi088.stderr: 20150K .......... .......... .......... .......... .......... 21% 51.2M 1s 2024-03-09T14:43:39.663 INFO:teuthology.orchestra.run.smithi088.stderr: 20200K .......... .......... .......... .......... .......... 21% 57.1M 1s 2024-03-09T14:43:39.663 INFO:teuthology.orchestra.run.smithi088.stderr: 20250K .......... .......... .......... .......... .......... 21% 109M 1s 2024-03-09T14:43:39.663 INFO:teuthology.orchestra.run.smithi088.stderr: 20300K .......... .......... .......... .......... .......... 21% 45.3M 1s 2024-03-09T14:43:39.663 INFO:teuthology.orchestra.run.smithi088.stderr: 20350K .......... .......... .......... .......... .......... 21% 53.5M 1s 2024-03-09T14:43:39.663 INFO:teuthology.orchestra.run.smithi088.stderr: 20400K .......... .......... .......... .......... .......... 22% 98.3M 1s 2024-03-09T14:43:39.663 INFO:teuthology.orchestra.run.smithi088.stderr: 20450K .......... .......... .......... .......... .......... 22% 44.1M 1s 2024-03-09T14:43:39.663 INFO:teuthology.orchestra.run.smithi088.stderr: 20500K .......... .......... .......... .......... .......... 22% 114M 1s 2024-03-09T14:43:39.663 INFO:teuthology.orchestra.run.smithi088.stderr: 20550K .......... .......... .......... .......... .......... 22% 51.0M 1s 2024-03-09T14:43:39.663 INFO:teuthology.orchestra.run.smithi088.stderr: 20600K .......... .......... .......... .......... .......... 22% 53.9M 1s 2024-03-09T14:43:39.663 INFO:teuthology.orchestra.run.smithi088.stderr: 20650K .......... .......... .......... .......... .......... 22% 93.2M 1s 2024-03-09T14:43:39.663 INFO:teuthology.orchestra.run.smithi088.stderr: 20700K .......... .......... .......... .......... .......... 22% 118M 1s 2024-03-09T14:43:39.663 INFO:teuthology.orchestra.run.smithi088.stderr: 20750K .......... .......... .......... .......... .......... 22% 107M 1s 2024-03-09T14:43:39.663 INFO:teuthology.orchestra.run.smithi088.stderr: 20800K .......... .......... .......... .......... .......... 22% 52.0M 1s 2024-03-09T14:43:39.663 INFO:teuthology.orchestra.run.smithi088.stderr: 20850K .......... .......... .......... .......... .......... 22% 45.0M 1s 2024-03-09T14:43:39.664 INFO:teuthology.orchestra.run.smithi088.stderr: 20900K .......... .......... .......... .......... .......... 22% 114M 1s 2024-03-09T14:43:39.664 INFO:teuthology.orchestra.run.smithi088.stderr: 20950K .......... .......... .......... .......... .......... 22% 116M 1s 2024-03-09T14:43:39.664 INFO:teuthology.orchestra.run.smithi088.stderr: 21000K .......... .......... .......... .......... .......... 22% 107M 1s 2024-03-09T14:43:39.664 INFO:teuthology.orchestra.run.smithi088.stderr: 21050K .......... .......... .......... .......... .......... 22% 31.4M 1s 2024-03-09T14:43:39.664 INFO:teuthology.orchestra.run.smithi088.stderr: 21100K .......... .......... .......... .......... .......... 22% 87.5M 1s 2024-03-09T14:43:39.664 INFO:teuthology.orchestra.run.smithi088.stderr: 21150K .......... .......... .......... .......... .......... 22% 62.3M 1s 2024-03-09T14:43:39.664 INFO:teuthology.orchestra.run.smithi088.stderr: 21200K .......... .......... .......... .......... .......... 22% 113M 1s 2024-03-09T14:43:39.664 INFO:teuthology.orchestra.run.smithi088.stderr: 21250K .......... .......... .......... .......... .......... 22% 84.3M 1s 2024-03-09T14:43:39.664 INFO:teuthology.orchestra.run.smithi088.stderr: 21300K .......... .......... .......... .......... .......... 22% 50.7M 1s 2024-03-09T14:43:39.664 INFO:teuthology.orchestra.run.smithi088.stderr: 21350K .......... .......... .......... .......... .......... 23% 49.0M 1s 2024-03-09T14:43:39.664 INFO:teuthology.orchestra.run.smithi088.stderr: 21400K .......... .......... .......... .......... .......... 23% 111M 1s 2024-03-09T14:43:39.664 INFO:teuthology.orchestra.run.smithi088.stderr: 21450K .......... .......... .......... .......... .......... 23% 120M 1s 2024-03-09T14:43:39.664 INFO:teuthology.orchestra.run.smithi088.stderr: 21500K .......... .......... .......... .......... .......... 23% 50.2M 1s 2024-03-09T14:43:39.664 INFO:teuthology.orchestra.run.smithi088.stderr: 21550K .......... .......... .......... .......... .......... 23% 49.8M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 21600K .......... .......... .......... .......... .......... 23% 115M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 21650K .......... .......... .......... .......... .......... 23% 53.4M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 21700K .......... .......... .......... .......... .......... 23% 123M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 21750K .......... .......... .......... .......... .......... 23% 74.0M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 21800K .......... .......... .......... .......... .......... 23% 32.8M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 21850K .......... .......... .......... .......... .......... 23% 53.4M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 21900K .......... .......... .......... .......... .......... 23% 117M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 21950K .......... .......... .......... .......... .......... 23% 97.0M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 22000K .......... .......... .......... .......... .......... 23% 111M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 22050K .......... .......... .......... .......... .......... 23% 85.9M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 22100K .......... .......... .......... .......... .......... 23% 34.2M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 22150K .......... .......... .......... .......... .......... 23% 101M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 22200K .......... .......... .......... .......... .......... 23% 48.8M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 22250K .......... .......... .......... .......... .......... 24% 58.8M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 22300K .......... .......... .......... .......... .......... 24% 80.6M 1s 2024-03-09T14:43:39.665 INFO:teuthology.orchestra.run.smithi088.stderr: 22350K .......... .......... .......... .......... .......... 24% 121M 1s 2024-03-09T14:43:39.666 INFO:teuthology.orchestra.run.smithi088.stderr: 22400K .......... .......... .......... .......... .......... 24% 62.9M 1s 2024-03-09T14:43:39.666 INFO:teuthology.orchestra.run.smithi088.stderr: 22450K .......... .......... .......... .......... .......... 24% 74.2M 1s 2024-03-09T14:43:39.666 INFO:teuthology.orchestra.run.smithi088.stderr: 22500K .......... .......... .......... .......... .......... 24% 101M 1s 2024-03-09T14:43:39.666 INFO:teuthology.orchestra.run.smithi088.stderr: 22550K .......... .......... .......... .......... .......... 24% 32.2M 1s 2024-03-09T14:43:39.666 INFO:teuthology.orchestra.run.smithi088.stderr: 22600K .......... .......... .......... .......... .......... 24% 118M 1s 2024-03-09T14:43:39.666 INFO:teuthology.orchestra.run.smithi088.stderr: 22650K .......... .......... .......... .......... .......... 24% 111M 1s 2024-03-09T14:43:39.666 INFO:teuthology.orchestra.run.smithi088.stderr: 22700K .......... .......... .......... .......... .......... 24% 114M 1s 2024-03-09T14:43:39.666 INFO:teuthology.orchestra.run.smithi088.stderr: 22750K .......... .......... .......... .......... .......... 24% 109M 1s 2024-03-09T14:43:39.666 INFO:teuthology.orchestra.run.smithi088.stderr: 22800K .......... .......... .......... .......... .......... 24% 127M 1s 2024-03-09T14:43:39.666 INFO:teuthology.orchestra.run.smithi088.stderr: 22850K .......... .......... .......... .......... .......... 24% 84.2M 1s 2024-03-09T14:43:39.666 INFO:teuthology.orchestra.run.smithi088.stderr: 22900K .......... .......... .......... .......... .......... 24% 49.8M 1s 2024-03-09T14:43:39.666 INFO:teuthology.orchestra.run.smithi088.stderr: 22950K .......... .......... .......... .......... .......... 24% 32.6M 1s 2024-03-09T14:43:39.666 INFO:teuthology.orchestra.run.smithi088.stderr: 23000K .......... .......... .......... .......... .......... 24% 113M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23050K .......... .......... .......... .......... .......... 24% 115M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23100K .......... .......... .......... .......... .......... 24% 54.4M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23150K .......... .......... .......... .......... .......... 24% 95.7M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23200K .......... .......... .......... .......... .......... 25% 119M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23250K .......... .......... .......... .......... .......... 25% 29.4M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23300K .......... .......... .......... .......... .......... 25% 123M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23350K .......... .......... .......... .......... .......... 25% 115M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23400K .......... .......... .......... .......... .......... 25% 39.6M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23450K .......... .......... .......... .......... .......... 25% 58.1M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23500K .......... .......... .......... .......... .......... 25% 117M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23550K .......... .......... .......... .......... .......... 25% 85.3M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23600K .......... .......... .......... .......... .......... 25% 58.7M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23650K .......... .......... .......... .......... .......... 25% 45.0M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23700K .......... .......... .......... .......... .......... 25% 51.0M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23750K .......... .......... .......... .......... .......... 25% 121M 1s 2024-03-09T14:43:39.667 INFO:teuthology.orchestra.run.smithi088.stderr: 23800K .......... .......... .......... .......... .......... 25% 106M 1s 2024-03-09T14:43:39.668 INFO:teuthology.orchestra.run.smithi088.stderr: 23850K .......... .......... .......... .......... .......... 25% 49.4M 1s 2024-03-09T14:43:39.668 INFO:teuthology.orchestra.run.smithi088.stderr: 23900K .......... .......... .......... .......... .......... 25% 50.5M 1s 2024-03-09T14:43:39.668 INFO:teuthology.orchestra.run.smithi088.stderr: 23950K .......... .......... .......... .......... .......... 25% 106M 1s 2024-03-09T14:43:39.668 INFO:teuthology.orchestra.run.smithi088.stderr: 24000K .......... .......... .......... .......... .......... 25% 126M 1s 2024-03-09T14:43:39.668 INFO:teuthology.orchestra.run.smithi088.stderr: 24050K .......... .......... .......... .......... .......... 25% 80.5M 1s 2024-03-09T14:43:39.668 INFO:teuthology.orchestra.run.smithi088.stderr: 24100K .......... .......... .......... .......... .......... 25% 53.2M 1s 2024-03-09T14:43:39.668 INFO:teuthology.orchestra.run.smithi088.stderr: 24150K .......... .......... .......... .......... .......... 26% 47.3M 1s 2024-03-09T14:43:39.668 INFO:teuthology.orchestra.run.smithi088.stderr: 24200K .......... .......... .......... .......... .......... 26% 49.3M 1s 2024-03-09T14:43:39.668 INFO:teuthology.orchestra.run.smithi088.stderr: 24250K .......... .......... .......... .......... .......... 26% 105M 1s 2024-03-09T14:43:39.668 INFO:teuthology.orchestra.run.smithi088.stderr: 24300K .......... .......... .......... .......... .......... 26% 91.9M 1s 2024-03-09T14:43:39.668 INFO:teuthology.orchestra.run.smithi088.stderr: 24350K .......... .......... .......... .......... .......... 26% 112M 1s 2024-03-09T14:43:39.668 INFO:teuthology.orchestra.run.smithi088.stderr: 24400K .......... .......... .......... .......... .......... 26% 58.7M 1s 2024-03-09T14:43:39.668 INFO:teuthology.orchestra.run.smithi088.stderr: 24450K .......... .......... .......... .......... .......... 26% 30.6M 1s 2024-03-09T14:43:39.668 INFO:teuthology.orchestra.run.smithi088.stderr: 24500K .......... .......... .......... .......... .......... 26% 114M 1s 2024-03-09T14:43:39.668 INFO:teuthology.orchestra.run.smithi088.stderr: 24550K .......... .......... .......... .......... .......... 26% 119M 1s 2024-03-09T14:43:39.669 INFO:teuthology.orchestra.run.smithi088.stderr: 24600K .......... .......... .......... .......... .......... 26% 45.8M 1s 2024-03-09T14:43:39.669 INFO:teuthology.orchestra.run.smithi088.stderr: 24650K .......... .......... .......... .......... .......... 26% 106M 1s 2024-03-09T14:43:39.669 INFO:teuthology.orchestra.run.smithi088.stderr: 24700K .......... .......... .......... .......... .......... 26% 119M 1s 2024-03-09T14:43:39.669 INFO:teuthology.orchestra.run.smithi088.stderr: 24750K .......... .......... .......... .......... .......... 26% 50.9M 1s 2024-03-09T14:43:39.669 INFO:teuthology.orchestra.run.smithi088.stderr: 24800K .......... .......... .......... .......... .......... 26% 100M 1s 2024-03-09T14:43:39.669 INFO:teuthology.orchestra.run.smithi088.stderr: 24850K .......... .......... .......... .......... .......... 26% 43.9M 1s 2024-03-09T14:43:39.669 INFO:teuthology.orchestra.run.smithi088.stderr: 24900K .......... .......... .......... .......... .......... 26% 50.6M 1s 2024-03-09T14:43:39.669 INFO:teuthology.orchestra.run.smithi088.stderr: 24950K .......... .......... .......... .......... .......... 26% 114M 1s 2024-03-09T14:43:39.669 INFO:teuthology.orchestra.run.smithi088.stderr: 25000K .......... .......... .......... .......... .......... 26% 49.7M 1s 2024-03-09T14:43:39.669 INFO:teuthology.orchestra.run.smithi088.stderr: 25050K .......... .......... .......... .......... .......... 27% 47.6M 1s 2024-03-09T14:43:39.669 INFO:teuthology.orchestra.run.smithi088.stderr: 25100K .......... .......... .......... .......... .......... 27% 99.0M 1s 2024-03-09T14:43:39.669 INFO:teuthology.orchestra.run.smithi088.stderr: 25150K .......... .......... .......... .......... .......... 27% 126M 1s 2024-03-09T14:43:39.669 INFO:teuthology.orchestra.run.smithi088.stderr: 25200K .......... .......... .......... .......... .......... 27% 109M 1s 2024-03-09T14:43:39.669 INFO:teuthology.orchestra.run.smithi088.stderr: 25250K .......... .......... .......... .......... .......... 27% 28.8M 1s 2024-03-09T14:43:39.670 INFO:teuthology.orchestra.run.smithi088.stderr: 25300K .......... .......... .......... .......... .......... 27% 50.3M 1s 2024-03-09T14:43:39.670 INFO:teuthology.orchestra.run.smithi088.stderr: 25350K .......... .......... .......... .......... .......... 27% 71.2M 1s 2024-03-09T14:43:39.670 INFO:teuthology.orchestra.run.smithi088.stderr: 25400K .......... .......... .......... .......... .......... 27% 110M 1s 2024-03-09T14:43:39.670 INFO:teuthology.orchestra.run.smithi088.stderr: 25450K .......... .......... .......... .......... .......... 27% 96.6M 1s 2024-03-09T14:43:39.670 INFO:teuthology.orchestra.run.smithi088.stderr: 25500K .......... .......... .......... .......... .......... 27% 62.3M 1s 2024-03-09T14:43:39.670 INFO:teuthology.orchestra.run.smithi088.stderr: 25550K .......... .......... .......... .......... .......... 27% 165M 1s 2024-03-09T14:43:39.670 INFO:teuthology.orchestra.run.smithi088.stderr: 25600K .......... .......... .......... .......... .......... 27% 103M 1s 2024-03-09T14:43:39.670 INFO:teuthology.orchestra.run.smithi088.stderr: 25650K .......... .......... .......... .......... .......... 27% 45.4M 1s 2024-03-09T14:43:39.670 INFO:teuthology.orchestra.run.smithi088.stderr: 25700K .......... .......... .......... .......... .......... 27% 42.9M 1s 2024-03-09T14:43:39.670 INFO:teuthology.orchestra.run.smithi088.stderr: 25750K .......... .......... .......... .......... .......... 27% 44.5M 1s 2024-03-09T14:43:39.670 INFO:teuthology.orchestra.run.smithi088.stderr: 25800K .......... .......... .......... .......... .......... 27% 118M 1s 2024-03-09T14:43:39.670 INFO:teuthology.orchestra.run.smithi088.stderr: 25850K .......... .......... .......... .......... .......... 27% 113M 1s 2024-03-09T14:43:39.670 INFO:teuthology.orchestra.run.smithi088.stderr: 25900K .......... .......... .......... .......... .......... 27% 108M 1s 2024-03-09T14:43:39.670 INFO:teuthology.orchestra.run.smithi088.stderr: 25950K .......... .......... .......... .......... .......... 27% 99.3M 1s 2024-03-09T14:43:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 26000K .......... .......... .......... .......... .......... 28% 65.3M 1s 2024-03-09T14:43:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 26050K .......... .......... .......... .......... .......... 28% 25.6M 1s 2024-03-09T14:43:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 26100K .......... .......... .......... .......... .......... 28% 100M 1s 2024-03-09T14:43:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 26150K .......... .......... .......... .......... .......... 28% 116M 1s 2024-03-09T14:43:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 26200K .......... .......... .......... .......... .......... 28% 106M 1s 2024-03-09T14:43:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 26250K .......... .......... .......... .......... .......... 28% 44.4M 1s 2024-03-09T14:43:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 26300K .......... .......... .......... .......... .......... 28% 116M 1s 2024-03-09T14:43:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 26350K .......... .......... .......... .......... .......... 28% 68.4M 1s 2024-03-09T14:43:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 26400K .......... .......... .......... .......... .......... 28% 87.3M 1s 2024-03-09T14:43:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 26450K .......... .......... .......... .......... .......... 28% 27.2M 1s 2024-03-09T14:43:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 26500K .......... .......... .......... .......... .......... 28% 110M 1s 2024-03-09T14:43:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 26550K .......... .......... .......... .......... .......... 28% 81.9M 1s 2024-03-09T14:43:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 26600K .......... .......... .......... .......... .......... 28% 115M 1s 2024-03-09T14:43:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 26650K .......... .......... .......... .......... .......... 28% 53.0M 1s 2024-03-09T14:43:39.671 INFO:teuthology.orchestra.run.smithi088.stderr: 26700K .......... .......... .......... .......... .......... 28% 48.4M 1s 2024-03-09T14:43:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 26750K .......... .......... .......... .......... .......... 28% 97.2M 1s 2024-03-09T14:43:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 26800K .......... .......... .......... .......... .......... 28% 119M 1s 2024-03-09T14:43:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 26850K .......... .......... .......... .......... .......... 28% 43.3M 1s 2024-03-09T14:43:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 26900K .......... .......... .......... .......... .......... 29% 58.4M 1s 2024-03-09T14:43:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 26950K .......... .......... .......... .......... .......... 29% 43.0M 1s 2024-03-09T14:43:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 27000K .......... .......... .......... .......... .......... 29% 109M 1s 2024-03-09T14:43:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 27050K .......... .......... .......... .......... .......... 29% 118M 1s 2024-03-09T14:43:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 27100K .......... .......... .......... .......... .......... 29% 48.3M 1s 2024-03-09T14:43:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 27150K .......... .......... .......... .......... .......... 29% 48.1M 1s 2024-03-09T14:43:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 27200K .......... .......... .......... .......... .......... 29% 98.2M 1s 2024-03-09T14:43:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 27250K .......... .......... .......... .......... .......... 29% 80.4M 1s 2024-03-09T14:43:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 27300K .......... .......... .......... .......... .......... 29% 142M 1s 2024-03-09T14:43:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 27350K .......... .......... .......... .......... .......... 29% 50.3M 1s 2024-03-09T14:43:39.672 INFO:teuthology.orchestra.run.smithi088.stderr: 27400K .......... .......... .......... .......... .......... 29% 50.8M 1s 2024-03-09T14:43:39.673 INFO:teuthology.orchestra.run.smithi088.stderr: 27450K .......... .......... .......... .......... .......... 29% 48.6M 1s 2024-03-09T14:43:39.673 INFO:teuthology.orchestra.run.smithi088.stderr: 27500K .......... .......... .......... .......... .......... 29% 115M 1s 2024-03-09T14:43:39.673 INFO:teuthology.orchestra.run.smithi088.stderr: 27550K .......... .......... .......... .......... .......... 29% 118M 1s 2024-03-09T14:43:39.673 INFO:teuthology.orchestra.run.smithi088.stderr: 27600K .......... .......... .......... .......... .......... 29% 115M 1s 2024-03-09T14:43:39.673 INFO:teuthology.orchestra.run.smithi088.stderr: 27650K .......... .......... .......... .......... .......... 29% 42.7M 1s 2024-03-09T14:43:39.673 INFO:teuthology.orchestra.run.smithi088.stderr: 27700K .......... .......... .......... .......... .......... 29% 47.5M 1s 2024-03-09T14:43:39.673 INFO:teuthology.orchestra.run.smithi088.stderr: 27750K .......... .......... .......... .......... .......... 29% 121M 1s 2024-03-09T14:43:39.673 INFO:teuthology.orchestra.run.smithi088.stderr: 27800K .......... .......... .......... .......... .......... 29% 53.0M 1s 2024-03-09T14:43:39.673 INFO:teuthology.orchestra.run.smithi088.stderr: 27850K .......... .......... .......... .......... .......... 30% 109M 1s 2024-03-09T14:43:39.673 INFO:teuthology.orchestra.run.smithi088.stderr: 27900K .......... .......... .......... .......... .......... 30% 50.0M 1s 2024-03-09T14:43:39.673 INFO:teuthology.orchestra.run.smithi088.stderr: 27950K .......... .......... .......... .......... .......... 30% 111M 1s 2024-03-09T14:43:39.673 INFO:teuthology.orchestra.run.smithi088.stderr: 28000K .......... .......... .......... .......... .......... 30% 116M 1s 2024-03-09T14:43:39.673 INFO:teuthology.orchestra.run.smithi088.stderr: 28050K .......... .......... .......... .......... .......... 30% 37.4M 1s 2024-03-09T14:43:39.673 INFO:teuthology.orchestra.run.smithi088.stderr: 28100K .......... .......... .......... .......... .......... 30% 67.2M 1s 2024-03-09T14:43:39.673 INFO:teuthology.orchestra.run.smithi088.stderr: 28150K .......... .......... .......... .......... .......... 30% 114M 1s 2024-03-09T14:43:39.674 INFO:teuthology.orchestra.run.smithi088.stderr: 28200K .......... .......... .......... .......... .......... 30% 114M 1s 2024-03-09T14:43:39.674 INFO:teuthology.orchestra.run.smithi088.stderr: 28250K .......... .......... .......... .......... .......... 30% 48.9M 1s 2024-03-09T14:43:39.674 INFO:teuthology.orchestra.run.smithi088.stderr: 28300K .......... .......... .......... .......... .......... 30% 51.4M 1s 2024-03-09T14:43:39.674 INFO:teuthology.orchestra.run.smithi088.stderr: 28350K .......... .......... .......... .......... .......... 30% 49.6M 1s 2024-03-09T14:43:39.674 INFO:teuthology.orchestra.run.smithi088.stderr: 28400K .......... .......... .......... .......... .......... 30% 116M 1s 2024-03-09T14:43:39.674 INFO:teuthology.orchestra.run.smithi088.stderr: 28450K .......... .......... .......... .......... .......... 30% 41.6M 1s 2024-03-09T14:43:39.674 INFO:teuthology.orchestra.run.smithi088.stderr: 28500K .......... .......... .......... .......... .......... 30% 116M 1s 2024-03-09T14:43:39.674 INFO:teuthology.orchestra.run.smithi088.stderr: 28550K .......... .......... .......... .......... .......... 30% 48.1M 1s 2024-03-09T14:43:39.674 INFO:teuthology.orchestra.run.smithi088.stderr: 28600K .......... .......... .......... .......... .......... 30% 48.9M 1s 2024-03-09T14:43:39.674 INFO:teuthology.orchestra.run.smithi088.stderr: 28650K .......... .......... .......... .......... .......... 30% 121M 1s 2024-03-09T14:43:39.674 INFO:teuthology.orchestra.run.smithi088.stderr: 28700K .......... .......... .......... .......... .......... 30% 50.9M 1s 2024-03-09T14:43:39.674 INFO:teuthology.orchestra.run.smithi088.stderr: 28750K .......... .......... .......... .......... .......... 31% 117M 1s 2024-03-09T14:43:39.674 INFO:teuthology.orchestra.run.smithi088.stderr: 28800K .......... .......... .......... .......... .......... 31% 108M 1s 2024-03-09T14:43:39.674 INFO:teuthology.orchestra.run.smithi088.stderr: 28850K .......... .......... .......... .......... .......... 31% 43.0M 1s 2024-03-09T14:43:39.674 INFO:teuthology.orchestra.run.smithi088.stderr: 28900K .......... .......... .......... .......... .......... 31% 115M 1s 2024-03-09T14:43:39.675 INFO:teuthology.orchestra.run.smithi088.stderr: 28950K .......... .......... .......... .......... .......... 31% 53.5M 1s 2024-03-09T14:43:39.675 INFO:teuthology.orchestra.run.smithi088.stderr: 29000K .......... .......... .......... .......... .......... 31% 49.3M 1s 2024-03-09T14:43:39.675 INFO:teuthology.orchestra.run.smithi088.stderr: 29050K .......... .......... .......... .......... .......... 31% 114M 1s 2024-03-09T14:43:39.675 INFO:teuthology.orchestra.run.smithi088.stderr: 29100K .......... .......... .......... .......... .......... 31% 101M 1s 2024-03-09T14:43:39.675 INFO:teuthology.orchestra.run.smithi088.stderr: 29150K .......... .......... .......... .......... .......... 31% 53.1M 1s 2024-03-09T14:43:39.675 INFO:teuthology.orchestra.run.smithi088.stderr: 29200K .......... .......... .......... .......... .......... 31% 117M 1s 2024-03-09T14:43:39.675 INFO:teuthology.orchestra.run.smithi088.stderr: 29250K .......... .......... .......... .......... .......... 31% 74.8M 1s 2024-03-09T14:43:39.675 INFO:teuthology.orchestra.run.smithi088.stderr: 29300K .......... .......... .......... .......... .......... 31% 79.4M 1s 2024-03-09T14:43:39.675 INFO:teuthology.orchestra.run.smithi088.stderr: 29350K .......... .......... .......... .......... .......... 31% 27.7M 1s 2024-03-09T14:43:39.675 INFO:teuthology.orchestra.run.smithi088.stderr: 29400K .......... .......... .......... .......... .......... 31% 125M 1s 2024-03-09T14:43:39.675 INFO:teuthology.orchestra.run.smithi088.stderr: 29450K .......... .......... .......... .......... .......... 31% 81.0M 1s 2024-03-09T14:43:39.675 INFO:teuthology.orchestra.run.smithi088.stderr: 29500K .......... .......... .......... .......... .......... 31% 113M 1s 2024-03-09T14:43:39.675 INFO:teuthology.orchestra.run.smithi088.stderr: 29550K .......... .......... .......... .......... .......... 31% 115M 1s 2024-03-09T14:43:39.675 INFO:teuthology.orchestra.run.smithi088.stderr: 29600K .......... .......... .......... .......... .......... 31% 113M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 29650K .......... .......... .......... .......... .......... 31% 44.7M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 29700K .......... .......... .......... .......... .......... 32% 116M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 29750K .......... .......... .......... .......... .......... 32% 50.2M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 29800K .......... .......... .......... .......... .......... 32% 49.8M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 29850K .......... .......... .......... .......... .......... 32% 112M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 29900K .......... .......... .......... .......... .......... 32% 49.8M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 29950K .......... .......... .......... .......... .......... 32% 121M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 30000K .......... .......... .......... .......... .......... 32% 46.9M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 30050K .......... .......... .......... .......... .......... 32% 90.1M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 30100K .......... .......... .......... .......... .......... 32% 113M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 30150K .......... .......... .......... .......... .......... 32% 50.2M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 30200K .......... .......... .......... .......... .......... 32% 51.1M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 30250K .......... .......... .......... .......... .......... 32% 111M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 30300K .......... .......... .......... .......... .......... 32% 118M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 30350K .......... .......... .......... .......... .......... 32% 50.0M 1s 2024-03-09T14:43:39.676 INFO:teuthology.orchestra.run.smithi088.stderr: 30400K .......... .......... .......... .......... .......... 32% 48.6M 1s 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi088.stderr: 30450K .......... .......... .......... .......... .......... 32% 85.8M 1s 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi088.stderr: 30500K .......... .......... .......... .......... .......... 32% 35.1M 1s 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi088.stderr: 30550K .......... .......... .......... .......... .......... 32% 119M 1s 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi088.stderr: 30600K .......... .......... .......... .......... .......... 32% 62.5M 1s 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi088.stderr: 30650K .......... .......... .......... .......... .......... 33% 107M 1s 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi088.stderr: 30700K .......... .......... .......... .......... .......... 33% 53.4M 1s 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi088.stderr: 30750K .......... .......... .......... .......... .......... 33% 120M 1s 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi088.stderr: 30800K .......... .......... .......... .......... .......... 33% 55.6M 1s 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi088.stderr: 30850K .......... .......... .......... .......... .......... 33% 41.8M 1s 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi088.stderr: 30900K .......... .......... .......... .......... .......... 33% 48.2M 1s 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi088.stderr: 30950K .......... .......... .......... .......... .......... 33% 124M 1s 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi088.stderr: 31000K .......... .......... .......... .......... .......... 33% 117M 1s 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi088.stderr: 31050K .......... .......... .......... .......... .......... 33% 113M 1s 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi088.stderr: 31100K .......... .......... .......... .......... .......... 33% 50.1M 1s 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi088.stderr: 31150K .......... .......... .......... .......... .......... 33% 49.0M 1s 2024-03-09T14:43:39.678 INFO:teuthology.orchestra.run.smithi088.stderr: 31200K .......... .......... .......... .......... .......... 33% 116M 1s 2024-03-09T14:43:39.678 INFO:teuthology.orchestra.run.smithi088.stderr: 31250K .......... .......... .......... .......... .......... 33% 44.6M 1s 2024-03-09T14:43:39.678 INFO:teuthology.orchestra.run.smithi088.stderr: 31300K .......... .......... .......... .......... .......... 33% 114M 1s 2024-03-09T14:43:39.678 INFO:teuthology.orchestra.run.smithi088.stderr: 31350K .......... .......... .......... .......... .......... 33% 117M 1s 2024-03-09T14:43:39.678 INFO:teuthology.orchestra.run.smithi088.stderr: 31400K .......... .......... .......... .......... .......... 33% 45.3M 1s 2024-03-09T14:43:39.678 INFO:teuthology.orchestra.run.smithi088.stderr: 31450K .......... .......... .......... .......... .......... 33% 108M 1s 2024-03-09T14:43:39.678 INFO:teuthology.orchestra.run.smithi088.stderr: 31500K .......... .......... .......... .......... .......... 33% 48.4M 1s 2024-03-09T14:43:39.678 INFO:teuthology.orchestra.run.smithi088.stderr: 31550K .......... .......... .......... .......... .......... 34% 53.3M 1s 2024-03-09T14:43:39.678 INFO:teuthology.orchestra.run.smithi088.stderr: 31600K .......... .......... .......... .......... .......... 34% 108M 1s 2024-03-09T14:43:39.678 INFO:teuthology.orchestra.run.smithi088.stderr: 31650K .......... .......... .......... .......... .......... 34% 44.8M 1s 2024-03-09T14:43:39.678 INFO:teuthology.orchestra.run.smithi088.stderr: 31700K .......... .......... .......... .......... .......... 34% 117M 1s 2024-03-09T14:43:39.678 INFO:teuthology.orchestra.run.smithi088.stderr: 31750K .......... .......... .......... .......... .......... 34% 113M 1s 2024-03-09T14:43:39.678 INFO:teuthology.orchestra.run.smithi088.stderr: 31800K .......... .......... .......... .......... .......... 34% 31.8M 1s 2024-03-09T14:43:39.678 INFO:teuthology.orchestra.run.smithi088.stderr: 31850K .......... .......... .......... .......... .......... 34% 107M 1s 2024-03-09T14:43:39.678 INFO:teuthology.orchestra.run.smithi088.stderr: 31900K .......... .......... .......... .......... .......... 34% 136M 1s 2024-03-09T14:43:39.679 INFO:teuthology.orchestra.run.smithi088.stderr: 31950K .......... .......... .......... .......... .......... 34% 49.6M 1s 2024-03-09T14:43:39.679 INFO:teuthology.orchestra.run.smithi088.stderr: 32000K .......... .......... .......... .......... .......... 34% 113M 1s 2024-03-09T14:43:39.679 INFO:teuthology.orchestra.run.smithi088.stderr: 32050K .......... .......... .......... .......... .......... 34% 44.8M 1s 2024-03-09T14:43:39.679 INFO:teuthology.orchestra.run.smithi088.stderr: 32100K .......... .......... .......... .......... .......... 34% 48.9M 1s 2024-03-09T14:43:39.679 INFO:teuthology.orchestra.run.smithi088.stderr: 32150K .......... .......... .......... .......... .......... 34% 49.9M 1s 2024-03-09T14:43:39.679 INFO:teuthology.orchestra.run.smithi088.stderr: 32200K .......... .......... .......... .......... .......... 34% 129M 1s 2024-03-09T14:43:39.679 INFO:teuthology.orchestra.run.smithi088.stderr: 32250K .......... .......... .......... .......... .......... 34% 109M 1s 2024-03-09T14:43:39.679 INFO:teuthology.orchestra.run.smithi088.stderr: 32300K .......... .......... .......... .......... .......... 34% 118M 1s 2024-03-09T14:43:39.679 INFO:teuthology.orchestra.run.smithi088.stderr: 32350K .......... .......... .......... .......... .......... 34% 50.1M 1s 2024-03-09T14:43:39.679 INFO:teuthology.orchestra.run.smithi088.stderr: 32400K .......... .......... .......... .......... .......... 34% 120M 1s 2024-03-09T14:43:39.679 INFO:teuthology.orchestra.run.smithi088.stderr: 32450K .......... .......... .......... .......... .......... 34% 44.5M 1s 2024-03-09T14:43:39.679 INFO:teuthology.orchestra.run.smithi088.stderr: 32500K .......... .......... .......... .......... .......... 35% 34.1M 1s 2024-03-09T14:43:39.679 INFO:teuthology.orchestra.run.smithi088.stderr: 32550K .......... .......... .......... .......... .......... 35% 111M 1s 2024-03-09T14:43:39.679 INFO:teuthology.orchestra.run.smithi088.stderr: 32600K .......... .......... .......... .......... .......... 35% 89.2M 1s 2024-03-09T14:43:39.679 INFO:teuthology.orchestra.run.smithi088.stderr: 32650K .......... .......... .......... .......... .......... 35% 121M 1s 2024-03-09T14:43:39.680 INFO:teuthology.orchestra.run.smithi088.stderr: 32700K .......... .......... .......... .......... .......... 35% 46.6M 1s 2024-03-09T14:43:39.680 INFO:teuthology.orchestra.run.smithi088.stderr: 32750K .......... .......... .......... .......... .......... 35% 134M 1s 2024-03-09T14:43:39.680 INFO:teuthology.orchestra.run.smithi088.stderr: 32800K .......... .......... .......... .......... .......... 35% 118M 1s 2024-03-09T14:43:39.680 INFO:teuthology.orchestra.run.smithi088.stderr: 32850K .......... .......... .......... .......... .......... 35% 29.5M 1s 2024-03-09T14:43:39.680 INFO:teuthology.orchestra.run.smithi088.stderr: 32900K .......... .......... .......... .......... .......... 35% 117M 1s 2024-03-09T14:43:39.680 INFO:teuthology.orchestra.run.smithi088.stderr: 32950K .......... .......... .......... .......... .......... 35% 48.0M 1s 2024-03-09T14:43:39.680 INFO:teuthology.orchestra.run.smithi088.stderr: 33000K .......... .......... .......... .......... .......... 35% 110M 1s 2024-03-09T14:43:39.680 INFO:teuthology.orchestra.run.smithi088.stderr: 33050K .......... .......... .......... .......... .......... 35% 104M 1s 2024-03-09T14:43:39.680 INFO:teuthology.orchestra.run.smithi088.stderr: 33100K .......... .......... .......... .......... .......... 35% 135M 1s 2024-03-09T14:43:39.680 INFO:teuthology.orchestra.run.smithi088.stderr: 33150K .......... .......... .......... .......... .......... 35% 121M 1s 2024-03-09T14:43:39.680 INFO:teuthology.orchestra.run.smithi088.stderr: 33200K .......... .......... .......... .......... .......... 35% 45.0M 1s 2024-03-09T14:43:39.680 INFO:teuthology.orchestra.run.smithi088.stderr: 33250K .......... .......... .......... .......... .......... 35% 48.8M 1s 2024-03-09T14:43:39.680 INFO:teuthology.orchestra.run.smithi088.stderr: 33300K .......... .......... .......... .......... .......... 35% 51.4M 1s 2024-03-09T14:43:39.680 INFO:teuthology.orchestra.run.smithi088.stderr: 33350K .......... .......... .......... .......... .......... 35% 114M 1s 2024-03-09T14:43:39.680 INFO:teuthology.orchestra.run.smithi088.stderr: 33400K .......... .......... .......... .......... .......... 36% 112M 1s 2024-03-09T14:43:39.681 INFO:teuthology.orchestra.run.smithi088.stderr: 33450K .......... .......... .......... .......... .......... 36% 49.4M 1s 2024-03-09T14:43:39.681 INFO:teuthology.orchestra.run.smithi088.stderr: 33500K .......... .......... .......... .......... .......... 36% 115M 1s 2024-03-09T14:43:39.681 INFO:teuthology.orchestra.run.smithi088.stderr: 33550K .......... .......... .......... .......... .......... 36% 112M 1s 2024-03-09T14:43:39.681 INFO:teuthology.orchestra.run.smithi088.stderr: 33600K .......... .......... .......... .......... .......... 36% 50.5M 1s 2024-03-09T14:43:39.681 INFO:teuthology.orchestra.run.smithi088.stderr: 33650K .......... .......... .......... .......... .......... 36% 88.7M 1s 2024-03-09T14:43:39.681 INFO:teuthology.orchestra.run.smithi088.stderr: 33700K .......... .......... .......... .......... .......... 36% 49.2M 1s 2024-03-09T14:43:39.681 INFO:teuthology.orchestra.run.smithi088.stderr: 33750K .......... .......... .......... .......... .......... 36% 48.5M 1s 2024-03-09T14:43:39.681 INFO:teuthology.orchestra.run.smithi088.stderr: 33800K .......... .......... .......... .......... .......... 36% 110M 1s 2024-03-09T14:43:39.681 INFO:teuthology.orchestra.run.smithi088.stderr: 33850K .......... .......... .......... .......... .......... 36% 118M 1s 2024-03-09T14:43:39.681 INFO:teuthology.orchestra.run.smithi088.stderr: 33900K .......... .......... .......... .......... .......... 36% 49.9M 1s 2024-03-09T14:43:39.681 INFO:teuthology.orchestra.run.smithi088.stderr: 33950K .......... .......... .......... .......... .......... 36% 120M 1s 2024-03-09T14:43:39.681 INFO:teuthology.orchestra.run.smithi088.stderr: 34000K .......... .......... .......... .......... .......... 36% 113M 1s 2024-03-09T14:43:39.682 INFO:teuthology.orchestra.run.smithi088.stderr: 34050K .......... .......... .......... .......... .......... 36% 43.6M 1s 2024-03-09T14:43:39.682 INFO:teuthology.orchestra.run.smithi088.stderr: 34100K .......... .......... .......... .......... .......... 36% 31.9M 1s 2024-03-09T14:43:39.682 INFO:teuthology.orchestra.run.smithi088.stderr: 34150K .......... .......... .......... .......... .......... 36% 119M 1s 2024-03-09T14:43:39.682 INFO:teuthology.orchestra.run.smithi088.stderr: 34200K .......... .......... .......... .......... .......... 36% 49.1M 1s 2024-03-09T14:43:39.682 INFO:teuthology.orchestra.run.smithi088.stderr: 34250K .......... .......... .......... .......... .......... 36% 114M 1s 2024-03-09T14:43:39.682 INFO:teuthology.orchestra.run.smithi088.stderr: 34300K .......... .......... .......... .......... .......... 36% 48.6M 1s 2024-03-09T14:43:39.682 INFO:teuthology.orchestra.run.smithi088.stderr: 34350K .......... .......... .......... .......... .......... 37% 113M 1s 2024-03-09T14:43:39.682 INFO:teuthology.orchestra.run.smithi088.stderr: 34400K .......... .......... .......... .......... .......... 37% 50.6M 1s 2024-03-09T14:43:39.682 INFO:teuthology.orchestra.run.smithi088.stderr: 34450K .......... .......... .......... .......... .......... 37% 43.0M 1s 2024-03-09T14:43:39.682 INFO:teuthology.orchestra.run.smithi088.stderr: 34500K .......... .......... .......... .......... .......... 37% 118M 1s 2024-03-09T14:43:39.682 INFO:teuthology.orchestra.run.smithi088.stderr: 34550K .......... .......... .......... .......... .......... 37% 94.8M 1s 2024-03-09T14:43:39.682 INFO:teuthology.orchestra.run.smithi088.stderr: 34600K .......... .......... .......... .......... .......... 37% 114M 1s 2024-03-09T14:43:39.682 INFO:teuthology.orchestra.run.smithi088.stderr: 34650K .......... .......... .......... .......... .......... 37% 48.9M 1s 2024-03-09T14:43:39.682 INFO:teuthology.orchestra.run.smithi088.stderr: 34700K .......... .......... .......... .......... .......... 37% 52.7M 1s 2024-03-09T14:43:39.683 INFO:teuthology.orchestra.run.smithi088.stderr: 34750K .......... .......... .......... .......... .......... 37% 118M 1s 2024-03-09T14:43:39.683 INFO:teuthology.orchestra.run.smithi088.stderr: 34800K .......... .......... .......... .......... .......... 37% 49.2M 1s 2024-03-09T14:43:39.683 INFO:teuthology.orchestra.run.smithi088.stderr: 34850K .......... .......... .......... .......... .......... 37% 44.3M 1s 2024-03-09T14:43:39.683 INFO:teuthology.orchestra.run.smithi088.stderr: 34900K .......... .......... .......... .......... .......... 37% 108M 1s 2024-03-09T14:43:39.683 INFO:teuthology.orchestra.run.smithi088.stderr: 34950K .......... .......... .......... .......... .......... 37% 116M 1s 2024-03-09T14:43:39.683 INFO:teuthology.orchestra.run.smithi088.stderr: 35000K .......... .......... .......... .......... .......... 37% 112M 1s 2024-03-09T14:43:39.683 INFO:teuthology.orchestra.run.smithi088.stderr: 35050K .......... .......... .......... .......... .......... 37% 37.4M 1s 2024-03-09T14:43:39.683 INFO:teuthology.orchestra.run.smithi088.stderr: 35100K .......... .......... .......... .......... .......... 37% 55.8M 1s 2024-03-09T14:43:39.683 INFO:teuthology.orchestra.run.smithi088.stderr: 35150K .......... .......... .......... .......... .......... 37% 44.2M 1s 2024-03-09T14:43:39.683 INFO:teuthology.orchestra.run.smithi088.stderr: 35200K .......... .......... .......... .......... .......... 37% 117M 1s 2024-03-09T14:43:39.683 INFO:teuthology.orchestra.run.smithi088.stderr: 35250K .......... .......... .......... .......... .......... 37% 86.9M 1s 2024-03-09T14:43:39.683 INFO:teuthology.orchestra.run.smithi088.stderr: 35300K .......... .......... .......... .......... .......... 38% 122M 1s 2024-03-09T14:43:39.683 INFO:teuthology.orchestra.run.smithi088.stderr: 35350K .......... .......... .......... .......... .......... 38% 49.7M 1s 2024-03-09T14:43:39.683 INFO:teuthology.orchestra.run.smithi088.stderr: 35400K .......... .......... .......... .......... .......... 38% 45.9M 1s 2024-03-09T14:43:39.683 INFO:teuthology.orchestra.run.smithi088.stderr: 35450K .......... .......... .......... .......... .......... 38% 122M 1s 2024-03-09T14:43:39.684 INFO:teuthology.orchestra.run.smithi088.stderr: 35500K .......... .......... .......... .......... .......... 38% 50.2M 1s 2024-03-09T14:43:39.684 INFO:teuthology.orchestra.run.smithi088.stderr: 35550K .......... .......... .......... .......... .......... 38% 108M 1s 2024-03-09T14:43:39.684 INFO:teuthology.orchestra.run.smithi088.stderr: 35600K .......... .......... .......... .......... .......... 38% 47.8M 1s 2024-03-09T14:43:39.684 INFO:teuthology.orchestra.run.smithi088.stderr: 35650K .......... .......... .......... .......... .......... 38% 92.4M 1s 2024-03-09T14:43:39.684 INFO:teuthology.orchestra.run.smithi088.stderr: 35700K .......... .......... .......... .......... .......... 38% 115M 1s 2024-03-09T14:43:39.684 INFO:teuthology.orchestra.run.smithi088.stderr: 35750K .......... .......... .......... .......... .......... 38% 32.2M 1s 2024-03-09T14:43:39.684 INFO:teuthology.orchestra.run.smithi088.stderr: 35800K .......... .......... .......... .......... .......... 38% 108M 1s 2024-03-09T14:43:39.684 INFO:teuthology.orchestra.run.smithi088.stderr: 35850K .......... .......... .......... .......... .......... 38% 49.7M 1s 2024-03-09T14:43:39.684 INFO:teuthology.orchestra.run.smithi088.stderr: 35900K .......... .......... .......... .......... .......... 38% 117M 1s 2024-03-09T14:43:39.684 INFO:teuthology.orchestra.run.smithi088.stderr: 35950K .......... .......... .......... .......... .......... 38% 99.1M 1s 2024-03-09T14:43:39.684 INFO:teuthology.orchestra.run.smithi088.stderr: 36000K .......... .......... .......... .......... .......... 38% 51.7M 1s 2024-03-09T14:43:39.684 INFO:teuthology.orchestra.run.smithi088.stderr: 36050K .......... .......... .......... .......... .......... 38% 45.0M 1s 2024-03-09T14:43:39.684 INFO:teuthology.orchestra.run.smithi088.stderr: 36100K .......... .......... .......... .......... .......... 38% 50.5M 1s 2024-03-09T14:43:39.684 INFO:teuthology.orchestra.run.smithi088.stderr: 36150K .......... .......... .......... .......... .......... 38% 115M 1s 2024-03-09T14:43:39.684 INFO:teuthology.orchestra.run.smithi088.stderr: 36200K .......... .......... .......... .......... .......... 39% 50.9M 1s 2024-03-09T14:43:39.685 INFO:teuthology.orchestra.run.smithi088.stderr: 36250K .......... .......... .......... .......... .......... 39% 105M 1s 2024-03-09T14:43:39.685 INFO:teuthology.orchestra.run.smithi088.stderr: 36300K .......... .......... .......... .......... .......... 39% 60.8M 1s 2024-03-09T14:43:39.685 INFO:teuthology.orchestra.run.smithi088.stderr: 36350K .......... .......... .......... .......... .......... 39% 118M 1s 2024-03-09T14:43:39.685 INFO:teuthology.orchestra.run.smithi088.stderr: 36400K .......... .......... .......... .......... .......... 39% 81.2M 1s 2024-03-09T14:43:39.685 INFO:teuthology.orchestra.run.smithi088.stderr: 36450K .......... .......... .......... .......... .......... 39% 45.0M 1s 2024-03-09T14:43:39.685 INFO:teuthology.orchestra.run.smithi088.stderr: 36500K .......... .......... .......... .......... .......... 39% 49.3M 1s 2024-03-09T14:43:39.685 INFO:teuthology.orchestra.run.smithi088.stderr: 36550K .......... .......... .......... .......... .......... 39% 54.3M 1s 2024-03-09T14:43:39.685 INFO:teuthology.orchestra.run.smithi088.stderr: 36600K .......... .......... .......... .......... .......... 39% 101M 1s 2024-03-09T14:43:39.685 INFO:teuthology.orchestra.run.smithi088.stderr: 36650K .......... .......... .......... .......... .......... 39% 49.8M 1s 2024-03-09T14:43:39.685 INFO:teuthology.orchestra.run.smithi088.stderr: 36700K .......... .......... .......... .......... .......... 39% 137M 1s 2024-03-09T14:43:39.685 INFO:teuthology.orchestra.run.smithi088.stderr: 36750K .......... .......... .......... .......... .......... 39% 112M 1s 2024-03-09T14:43:39.685 INFO:teuthology.orchestra.run.smithi088.stderr: 36800K .......... .......... .......... .......... .......... 39% 118M 1s 2024-03-09T14:43:39.685 INFO:teuthology.orchestra.run.smithi088.stderr: 36850K .......... .......... .......... .......... .......... 39% 39.5M 1s 2024-03-09T14:43:39.685 INFO:teuthology.orchestra.run.smithi088.stderr: 36900K .......... .......... .......... .......... .......... 39% 54.8M 1s 2024-03-09T14:43:39.685 INFO:teuthology.orchestra.run.smithi088.stderr: 36950K .......... .......... .......... .......... .......... 39% 49.7M 1s 2024-03-09T14:43:39.686 INFO:teuthology.orchestra.run.smithi088.stderr: 37000K .......... .......... .......... .......... .......... 39% 119M 1s 2024-03-09T14:43:39.686 INFO:teuthology.orchestra.run.smithi088.stderr: 37050K .......... .......... .......... .......... .......... 39% 115M 1s 2024-03-09T14:43:39.686 INFO:teuthology.orchestra.run.smithi088.stderr: 37100K .......... .......... .......... .......... .......... 39% 114M 1s 2024-03-09T14:43:39.686 INFO:teuthology.orchestra.run.smithi088.stderr: 37150K .......... .......... .......... .......... .......... 40% 49.8M 1s 2024-03-09T14:43:39.686 INFO:teuthology.orchestra.run.smithi088.stderr: 37200K .......... .......... .......... .......... .......... 40% 48.7M 1s 2024-03-09T14:43:39.686 INFO:teuthology.orchestra.run.smithi088.stderr: 37250K .......... .......... .......... .......... .......... 40% 87.0M 1s 2024-03-09T14:43:39.686 INFO:teuthology.orchestra.run.smithi088.stderr: 37300K .......... .......... .......... .......... .......... 40% 59.1M 1s 2024-03-09T14:43:39.686 INFO:teuthology.orchestra.run.smithi088.stderr: 37350K .......... .......... .......... .......... .......... 40% 90.3M 1s 2024-03-09T14:43:39.686 INFO:teuthology.orchestra.run.smithi088.stderr: 37400K .......... .......... .......... .......... .......... 40% 50.0M 1s 2024-03-09T14:43:39.686 INFO:teuthology.orchestra.run.smithi088.stderr: 37450K .......... .......... .......... .......... .......... 40% 110M 1s 2024-03-09T14:43:39.686 INFO:teuthology.orchestra.run.smithi088.stderr: 37500K .......... .......... .......... .......... .......... 40% 49.2M 1s 2024-03-09T14:43:39.686 INFO:teuthology.orchestra.run.smithi088.stderr: 37550K .......... .......... .......... .......... .......... 40% 124M 1s 2024-03-09T14:43:39.686 INFO:teuthology.orchestra.run.smithi088.stderr: 37600K .......... .......... .......... .......... .......... 40% 112M 1s 2024-03-09T14:43:39.686 INFO:teuthology.orchestra.run.smithi088.stderr: 37650K .......... .......... .......... .......... .......... 40% 44.4M 1s 2024-03-09T14:43:39.687 INFO:teuthology.orchestra.run.smithi088.stderr: 37700K .......... .......... .......... .......... .......... 40% 50.2M 1s 2024-03-09T14:43:39.687 INFO:teuthology.orchestra.run.smithi088.stderr: 37750K .......... .......... .......... .......... .......... 40% 50.6M 1s 2024-03-09T14:43:39.687 INFO:teuthology.orchestra.run.smithi088.stderr: 37800K .......... .......... .......... .......... .......... 40% 112M 1s 2024-03-09T14:43:39.687 INFO:teuthology.orchestra.run.smithi088.stderr: 37850K .......... .......... .......... .......... .......... 40% 119M 1s 2024-03-09T14:43:39.687 INFO:teuthology.orchestra.run.smithi088.stderr: 37900K .......... .......... .......... .......... .......... 40% 49.2M 1s 2024-03-09T14:43:39.687 INFO:teuthology.orchestra.run.smithi088.stderr: 37950K .......... .......... .......... .......... .......... 40% 50.4M 1s 2024-03-09T14:43:39.687 INFO:teuthology.orchestra.run.smithi088.stderr: 38000K .......... .......... .......... .......... .......... 40% 118M 1s 2024-03-09T14:43:39.687 INFO:teuthology.orchestra.run.smithi088.stderr: 38050K .......... .......... .......... .......... .......... 41% 44.0M 1s 2024-03-09T14:43:39.687 INFO:teuthology.orchestra.run.smithi088.stderr: 38100K .......... .......... .......... .......... .......... 41% 38.1M 1s 2024-03-09T14:43:39.687 INFO:teuthology.orchestra.run.smithi088.stderr: 38150K .......... .......... .......... .......... .......... 41% 364M 1s 2024-03-09T14:43:39.687 INFO:teuthology.orchestra.run.smithi088.stderr: 38200K .......... .......... .......... .......... .......... 41% 108M 1s 2024-03-09T14:43:39.687 INFO:teuthology.orchestra.run.smithi088.stderr: 38250K .......... .......... .......... .......... .......... 41% 113M 1s 2024-03-09T14:43:39.687 INFO:teuthology.orchestra.run.smithi088.stderr: 38300K .......... .......... .......... .......... .......... 41% 118M 1s 2024-03-09T14:43:39.687 INFO:teuthology.orchestra.run.smithi088.stderr: 38350K .......... .......... .......... .......... .......... 41% 49.8M 1s 2024-03-09T14:43:39.687 INFO:teuthology.orchestra.run.smithi088.stderr: 38400K .......... .......... .......... .......... .......... 41% 32.2M 1s 2024-03-09T14:43:39.688 INFO:teuthology.orchestra.run.smithi088.stderr: 38450K .......... .......... .......... .......... .......... 41% 81.6M 1s 2024-03-09T14:43:39.688 INFO:teuthology.orchestra.run.smithi088.stderr: 38500K .......... .......... .......... .......... .......... 41% 66.7M 1s 2024-03-09T14:43:39.688 INFO:teuthology.orchestra.run.smithi088.stderr: 38550K .......... .......... .......... .......... .......... 41% 55.3M 1s 2024-03-09T14:43:39.688 INFO:teuthology.orchestra.run.smithi088.stderr: 38600K .......... .......... .......... .......... .......... 41% 71.2M 1s 2024-03-09T14:43:39.688 INFO:teuthology.orchestra.run.smithi088.stderr: 38650K .......... .......... .......... .......... .......... 41% 62.3M 1s 2024-03-09T14:43:39.688 INFO:teuthology.orchestra.run.smithi088.stderr: 38700K .......... .......... .......... .......... .......... 41% 113M 1s 2024-03-09T14:43:39.688 INFO:teuthology.orchestra.run.smithi088.stderr: 38750K .......... .......... .......... .......... .......... 41% 47.1M 1s 2024-03-09T14:43:39.688 INFO:teuthology.orchestra.run.smithi088.stderr: 38800K .......... .......... .......... .......... .......... 41% 54.1M 1s 2024-03-09T14:43:39.688 INFO:teuthology.orchestra.run.smithi088.stderr: 38850K .......... .......... .......... .......... .......... 41% 49.0M 1s 2024-03-09T14:43:39.688 INFO:teuthology.orchestra.run.smithi088.stderr: 38900K .......... .......... .......... .......... .......... 41% 116M 1s 2024-03-09T14:43:39.688 INFO:teuthology.orchestra.run.smithi088.stderr: 38950K .......... .......... .......... .......... .......... 41% 112M 1s 2024-03-09T14:43:39.689 INFO:teuthology.orchestra.run.smithi088.stderr: 39000K .......... .......... .......... .......... .......... 42% 46.1M 1s 2024-03-09T14:43:39.689 INFO:teuthology.orchestra.run.smithi088.stderr: 39050K .......... .......... .......... .......... .......... 42% 70.8M 1s 2024-03-09T14:43:39.689 INFO:teuthology.orchestra.run.smithi088.stderr: 39100K .......... .......... .......... .......... .......... 42% 35.9M 1s 2024-03-09T14:43:39.689 INFO:teuthology.orchestra.run.smithi088.stderr: 39150K .......... .......... .......... .......... .......... 42% 133M 1s 2024-03-09T14:43:39.689 INFO:teuthology.orchestra.run.smithi088.stderr: 39200K .......... .......... .......... .......... .......... 42% 116M 1s 2024-03-09T14:43:39.689 INFO:teuthology.orchestra.run.smithi088.stderr: 39250K .......... .......... .......... .......... .......... 42% 89.9M 1s 2024-03-09T14:43:39.689 INFO:teuthology.orchestra.run.smithi088.stderr: 39300K .......... .......... .......... .......... .......... 42% 49.7M 1s 2024-03-09T14:43:39.689 INFO:teuthology.orchestra.run.smithi088.stderr: 39350K .......... .......... .......... .......... .......... 42% 50.4M 1s 2024-03-09T14:43:39.689 INFO:teuthology.orchestra.run.smithi088.stderr: 39400K .......... .......... .......... .......... .......... 42% 112M 1s 2024-03-09T14:43:39.689 INFO:teuthology.orchestra.run.smithi088.stderr: 39450K .......... .......... .......... .......... .......... 42% 49.9M 1s 2024-03-09T14:43:39.689 INFO:teuthology.orchestra.run.smithi088.stderr: 39500K .......... .......... .......... .......... .......... 42% 117M 1s 2024-03-09T14:43:39.690 INFO:teuthology.orchestra.run.smithi088.stderr: 39550K .......... .......... .......... .......... .......... 42% 50.2M 1s 2024-03-09T14:43:39.690 INFO:teuthology.orchestra.run.smithi088.stderr: 39600K .......... .......... .......... .......... .......... 42% 116M 1s 2024-03-09T14:43:39.690 INFO:teuthology.orchestra.run.smithi088.stderr: 39650K .......... .......... .......... .......... .......... 42% 65.0M 1s 2024-03-09T14:43:39.690 INFO:teuthology.orchestra.run.smithi088.stderr: 39700K .......... .......... .......... .......... .......... 42% 36.6M 1s 2024-03-09T14:43:39.690 INFO:teuthology.orchestra.run.smithi088.stderr: 39750K .......... .......... .......... .......... .......... 42% 116M 1s 2024-03-09T14:43:39.690 INFO:teuthology.orchestra.run.smithi088.stderr: 39800K .......... .......... .......... .......... .......... 42% 49.5M 1s 2024-03-09T14:43:39.690 INFO:teuthology.orchestra.run.smithi088.stderr: 39850K .......... .......... .......... .......... .......... 42% 105M 1s 2024-03-09T14:43:39.690 INFO:teuthology.orchestra.run.smithi088.stderr: 39900K .......... .......... .......... .......... .......... 43% 40.4M 1s 2024-03-09T14:43:39.690 INFO:teuthology.orchestra.run.smithi088.stderr: 39950K .......... .......... .......... .......... .......... 43% 86.3M 1s 2024-03-09T14:43:39.690 INFO:teuthology.orchestra.run.smithi088.stderr: 40000K .......... .......... .......... .......... .......... 43% 74.9M 1s 2024-03-09T14:43:39.690 INFO:teuthology.orchestra.run.smithi088.stderr: 40050K .......... .......... .......... .......... .......... 43% 39.8M 1s 2024-03-09T14:43:39.690 INFO:teuthology.orchestra.run.smithi088.stderr: 40100K .......... .......... .......... .......... .......... 43% 49.4M 1s 2024-03-09T14:43:39.690 INFO:teuthology.orchestra.run.smithi088.stderr: 40150K .......... .......... .......... .......... .......... 43% 113M 1s 2024-03-09T14:43:39.691 INFO:teuthology.orchestra.run.smithi088.stderr: 40200K .......... .......... .......... .......... .......... 43% 52.1M 1s 2024-03-09T14:43:39.691 INFO:teuthology.orchestra.run.smithi088.stderr: 40250K .......... .......... .......... .......... .......... 43% 84.4M 1s 2024-03-09T14:43:39.691 INFO:teuthology.orchestra.run.smithi088.stderr: 40300K .......... .......... .......... .......... .......... 43% 55.2M 1s 2024-03-09T14:43:39.691 INFO:teuthology.orchestra.run.smithi088.stderr: 40350K .......... .......... .......... .......... .......... 43% 122M 1s 2024-03-09T14:43:39.691 INFO:teuthology.orchestra.run.smithi088.stderr: 40400K .......... .......... .......... .......... .......... 43% 112M 1s 2024-03-09T14:43:39.691 INFO:teuthology.orchestra.run.smithi088.stderr: 40450K .......... .......... .......... .......... .......... 43% 31.0M 1s 2024-03-09T14:43:39.691 INFO:teuthology.orchestra.run.smithi088.stderr: 40500K .......... .......... .......... .......... .......... 43% 98.6M 1s 2024-03-09T14:43:39.691 INFO:teuthology.orchestra.run.smithi088.stderr: 40550K .......... .......... .......... .......... .......... 43% 34.5M 1s 2024-03-09T14:43:39.691 INFO:teuthology.orchestra.run.smithi088.stderr: 40600K .......... .......... .......... .......... .......... 43% 114M 1s 2024-03-09T14:43:39.691 INFO:teuthology.orchestra.run.smithi088.stderr: 40650K .......... .......... .......... .......... .......... 43% 112M 1s 2024-03-09T14:43:39.691 INFO:teuthology.orchestra.run.smithi088.stderr: 40700K .......... .......... .......... .......... .......... 43% 113M 1s 2024-03-09T14:43:39.691 INFO:teuthology.orchestra.run.smithi088.stderr: 40750K .......... .......... .......... .......... .......... 43% 51.3M 1s 2024-03-09T14:43:39.691 INFO:teuthology.orchestra.run.smithi088.stderr: 40800K .......... .......... .......... .......... .......... 43% 117M 1s 2024-03-09T14:43:39.691 INFO:teuthology.orchestra.run.smithi088.stderr: 40850K .......... .......... .......... .......... .......... 44% 41.2M 1s 2024-03-09T14:43:39.691 INFO:teuthology.orchestra.run.smithi088.stderr: 40900K .......... .......... .......... .......... .......... 44% 114M 1s 2024-03-09T14:43:39.692 INFO:teuthology.orchestra.run.smithi088.stderr: 40950K .......... .......... .......... .......... .......... 44% 64.9M 1s 2024-03-09T14:43:39.692 INFO:teuthology.orchestra.run.smithi088.stderr: 41000K .......... .......... .......... .......... .......... 44% 75.0M 1s 2024-03-09T14:43:39.692 INFO:teuthology.orchestra.run.smithi088.stderr: 41050K .......... .......... .......... .......... .......... 44% 116M 1s 2024-03-09T14:43:39.692 INFO:teuthology.orchestra.run.smithi088.stderr: 41100K .......... .......... .......... .......... .......... 44% 49.3M 1s 2024-03-09T14:43:39.692 INFO:teuthology.orchestra.run.smithi088.stderr: 41150K .......... .......... .......... .......... .......... 44% 50.7M 1s 2024-03-09T14:43:39.692 INFO:teuthology.orchestra.run.smithi088.stderr: 41200K .......... .......... .......... .......... .......... 44% 111M 1s 2024-03-09T14:43:39.692 INFO:teuthology.orchestra.run.smithi088.stderr: 41250K .......... .......... .......... .......... .......... 44% 44.9M 1s 2024-03-09T14:43:39.692 INFO:teuthology.orchestra.run.smithi088.stderr: 41300K .......... .......... .......... .......... .......... 44% 115M 1s 2024-03-09T14:43:39.692 INFO:teuthology.orchestra.run.smithi088.stderr: 41350K .......... .......... .......... .......... .......... 44% 49.2M 1s 2024-03-09T14:43:39.692 INFO:teuthology.orchestra.run.smithi088.stderr: 41400K .......... .......... .......... .......... .......... 44% 131M 1s 2024-03-09T14:43:39.692 INFO:teuthology.orchestra.run.smithi088.stderr: 41450K .......... .......... .......... .......... .......... 44% 48.4M 1s 2024-03-09T14:43:39.692 INFO:teuthology.orchestra.run.smithi088.stderr: 41500K .......... .......... .......... .......... .......... 44% 114M 1s 2024-03-09T14:43:39.692 INFO:teuthology.orchestra.run.smithi088.stderr: 41550K .......... .......... .......... .......... .......... 44% 79.5M 1s 2024-03-09T14:43:39.692 INFO:teuthology.orchestra.run.smithi088.stderr: 41600K .......... .......... .......... .......... .......... 44% 63.6M 1s 2024-03-09T14:43:39.692 INFO:teuthology.orchestra.run.smithi088.stderr: 41650K .......... .......... .......... .......... .......... 44% 44.2M 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 41700K .......... .......... .......... .......... .......... 44% 47.8M 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 41750K .......... .......... .......... .......... .......... 44% 126M 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 41800K .......... .......... .......... .......... .......... 45% 51.5M 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 41850K .......... .......... .......... .......... .......... 45% 827K 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 41900K .......... .......... .......... .......... .......... 45% 261M 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 41950K .......... .......... .......... .......... .......... 45% 301M 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 42000K .......... .......... .......... .......... .......... 45% 296M 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 42050K .......... .......... .......... .......... .......... 45% 245M 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 42100K .......... .......... .......... .......... .......... 45% 251M 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 42150K .......... .......... .......... .......... .......... 45% 284M 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 42200K .......... .......... .......... .......... .......... 45% 292M 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 42250K .......... .......... .......... .......... .......... 45% 224M 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 42300K .......... .......... .......... .......... .......... 45% 260M 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 42350K .......... .......... .......... .......... .......... 45% 308M 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 42400K .......... .......... .......... .......... .......... 45% 254M 1s 2024-03-09T14:43:39.693 INFO:teuthology.orchestra.run.smithi088.stderr: 42450K .......... .......... .......... .......... .......... 45% 208M 1s 2024-03-09T14:43:39.694 INFO:teuthology.orchestra.run.smithi088.stderr: 42500K .......... .......... .......... .......... .......... 45% 287M 1s 2024-03-09T14:43:39.694 INFO:teuthology.orchestra.run.smithi088.stderr: 42550K .......... .......... .......... .......... .......... 45% 279M 1s 2024-03-09T14:43:39.694 INFO:teuthology.orchestra.run.smithi088.stderr: 42600K .......... .......... .......... .......... .......... 45% 270M 1s 2024-03-09T14:43:39.694 INFO:teuthology.orchestra.run.smithi088.stderr: 42650K .......... .......... .......... .......... .......... 45% 223M 1s 2024-03-09T14:43:39.694 INFO:teuthology.orchestra.run.smithi088.stderr: 42700K .......... .......... .......... .......... .......... 46% 296M 1s 2024-03-09T14:43:39.694 INFO:teuthology.orchestra.run.smithi088.stderr: 42750K .......... .......... .......... .......... .......... 46% 269M 1s 2024-03-09T14:43:39.694 INFO:teuthology.orchestra.run.smithi088.stderr: 42800K .......... .......... .......... .......... .......... 46% 293M 1s 2024-03-09T14:43:39.694 INFO:teuthology.orchestra.run.smithi088.stderr: 42850K .......... .......... .......... .......... .......... 46% 255M 1s 2024-03-09T14:43:39.694 INFO:teuthology.orchestra.run.smithi088.stderr: 42900K .......... .......... .......... .......... .......... 46% 237M 1s 2024-03-09T14:43:39.694 INFO:teuthology.orchestra.run.smithi088.stderr: 42950K .......... .......... .......... .......... .......... 46% 291M 1s 2024-03-09T14:43:39.694 INFO:teuthology.orchestra.run.smithi088.stderr: 43000K .......... .......... .......... .......... .......... 46% 272M 1s 2024-03-09T14:43:39.694 INFO:teuthology.orchestra.run.smithi088.stderr: 43050K .......... .......... .......... .......... .......... 46% 265M 1s 2024-03-09T14:43:39.694 INFO:teuthology.orchestra.run.smithi088.stderr: 43100K .......... .......... .......... .......... .......... 46% 304M 1s 2024-03-09T14:43:39.695 INFO:teuthology.orchestra.run.smithi088.stderr: 43150K .......... .......... .......... .......... .......... 46% 311M 1s 2024-03-09T14:43:39.695 INFO:teuthology.orchestra.run.smithi088.stderr: 43200K .......... .......... .......... .......... .......... 46% 263M 1s 2024-03-09T14:43:39.695 INFO:teuthology.orchestra.run.smithi088.stderr: 43250K .......... .......... .......... .......... .......... 46% 222M 1s 2024-03-09T14:43:39.695 INFO:teuthology.orchestra.run.smithi088.stderr: 43300K .......... .......... .......... .......... .......... 46% 292M 1s 2024-03-09T14:43:39.695 INFO:teuthology.orchestra.run.smithi088.stderr: 43350K .......... .......... .......... .......... .......... 46% 303M 1s 2024-03-09T14:43:39.695 INFO:teuthology.orchestra.run.smithi088.stderr: 43400K .......... .......... .......... .......... .......... 46% 299M 1s 2024-03-09T14:43:39.695 INFO:teuthology.orchestra.run.smithi088.stderr: 43450K .......... .......... .......... .......... .......... 46% 273M 1s 2024-03-09T14:43:39.695 INFO:teuthology.orchestra.run.smithi088.stderr: 43500K .......... .......... .......... .......... .......... 46% 295M 1s 2024-03-09T14:43:39.695 INFO:teuthology.orchestra.run.smithi088.stderr: 43550K .......... .......... .......... .......... .......... 46% 286M 1s 2024-03-09T14:43:39.695 INFO:teuthology.orchestra.run.smithi088.stderr: 43600K .......... .......... .......... .......... .......... 46% 305M 1s 2024-03-09T14:43:39.695 INFO:teuthology.orchestra.run.smithi088.stderr: 43650K .......... .......... .......... .......... .......... 47% 252M 1s 2024-03-09T14:43:39.695 INFO:teuthology.orchestra.run.smithi088.stderr: 43700K .......... .......... .......... .......... .......... 47% 305M 1s 2024-03-09T14:43:39.695 INFO:teuthology.orchestra.run.smithi088.stderr: 43750K .......... .......... .......... .......... .......... 47% 296M 1s 2024-03-09T14:43:39.695 INFO:teuthology.orchestra.run.smithi088.stderr: 43800K .......... .......... .......... .......... .......... 47% 240M 1s 2024-03-09T14:43:39.695 INFO:teuthology.orchestra.run.smithi088.stderr: 43850K .......... .......... .......... .......... .......... 47% 243M 1s 2024-03-09T14:43:39.696 INFO:teuthology.orchestra.run.smithi088.stderr: 43900K .......... .......... .......... .......... .......... 47% 305M 1s 2024-03-09T14:43:39.696 INFO:teuthology.orchestra.run.smithi088.stderr: 43950K .......... .......... .......... .......... .......... 47% 301M 1s 2024-03-09T14:43:39.696 INFO:teuthology.orchestra.run.smithi088.stderr: 44000K .......... .......... .......... .......... .......... 47% 286M 1s 2024-03-09T14:43:39.696 INFO:teuthology.orchestra.run.smithi088.stderr: 44050K .......... .......... .......... .......... .......... 47% 215M 1s 2024-03-09T14:43:39.696 INFO:teuthology.orchestra.run.smithi088.stderr: 44100K .......... .......... .......... .......... .......... 47% 272M 1s 2024-03-09T14:43:39.696 INFO:teuthology.orchestra.run.smithi088.stderr: 44150K .......... .......... .......... .......... .......... 47% 306M 1s 2024-03-09T14:43:39.696 INFO:teuthology.orchestra.run.smithi088.stderr: 44200K .......... .......... .......... .......... .......... 47% 296M 1s 2024-03-09T14:43:39.696 INFO:teuthology.orchestra.run.smithi088.stderr: 44250K .......... .......... .......... .......... .......... 47% 275M 1s 2024-03-09T14:43:39.696 INFO:teuthology.orchestra.run.smithi088.stderr: 44300K .......... .......... .......... .......... .......... 47% 299M 1s 2024-03-09T14:43:39.696 INFO:teuthology.orchestra.run.smithi088.stderr: 44350K .......... .......... .......... .......... .......... 47% 296M 1s 2024-03-09T14:43:39.696 INFO:teuthology.orchestra.run.smithi088.stderr: 44400K .......... .......... .......... .......... .......... 47% 310M 1s 2024-03-09T14:43:39.696 INFO:teuthology.orchestra.run.smithi088.stderr: 44450K .......... .......... .......... .......... .......... 47% 255M 1s 2024-03-09T14:43:39.696 INFO:teuthology.orchestra.run.smithi088.stderr: 44500K .......... .......... .......... .......... .......... 47% 295M 1s 2024-03-09T14:43:39.696 INFO:teuthology.orchestra.run.smithi088.stderr: 44550K .......... .......... .......... .......... .......... 48% 297M 1s 2024-03-09T14:43:39.696 INFO:teuthology.orchestra.run.smithi088.stderr: 44600K .......... .......... .......... .......... .......... 48% 298M 1s 2024-03-09T14:43:39.697 INFO:teuthology.orchestra.run.smithi088.stderr: 44650K .......... .......... .......... .......... .......... 48% 236M 1s 2024-03-09T14:43:39.697 INFO:teuthology.orchestra.run.smithi088.stderr: 44700K .......... .......... .......... .......... .......... 48% 276M 1s 2024-03-09T14:43:39.697 INFO:teuthology.orchestra.run.smithi088.stderr: 44750K .......... .......... .......... .......... .......... 48% 266M 1s 2024-03-09T14:43:39.697 INFO:teuthology.orchestra.run.smithi088.stderr: 44800K .......... .......... .......... .......... .......... 48% 290M 1s 2024-03-09T14:43:39.697 INFO:teuthology.orchestra.run.smithi088.stderr: 44850K .......... .......... .......... .......... .......... 48% 251M 1s 2024-03-09T14:43:39.697 INFO:teuthology.orchestra.run.smithi088.stderr: 44900K .......... .......... .......... .......... .......... 48% 293M 1s 2024-03-09T14:43:39.697 INFO:teuthology.orchestra.run.smithi088.stderr: 44950K .......... .......... .......... .......... .......... 48% 236M 1s 2024-03-09T14:43:39.697 INFO:teuthology.orchestra.run.smithi088.stderr: 45000K .......... .......... .......... .......... .......... 48% 265M 1s 2024-03-09T14:43:39.697 INFO:teuthology.orchestra.run.smithi088.stderr: 45050K .......... .......... .......... .......... .......... 48% 237M 1s 2024-03-09T14:43:39.697 INFO:teuthology.orchestra.run.smithi088.stderr: 45100K .......... .......... .......... .......... .......... 48% 306M 1s 2024-03-09T14:43:39.697 INFO:teuthology.orchestra.run.smithi088.stderr: 45150K .......... .......... .......... .......... .......... 48% 298M 1s 2024-03-09T14:43:39.697 INFO:teuthology.orchestra.run.smithi088.stderr: 45200K .......... .......... .......... .......... .......... 48% 266M 1s 2024-03-09T14:43:39.697 INFO:teuthology.orchestra.run.smithi088.stderr: 45250K .......... .......... .......... .......... .......... 48% 245M 1s 2024-03-09T14:43:39.697 INFO:teuthology.orchestra.run.smithi088.stderr: 45300K .......... .......... .......... .......... .......... 48% 268M 1s 2024-03-09T14:43:39.697 INFO:teuthology.orchestra.run.smithi088.stderr: 45350K .......... .......... .......... .......... .......... 48% 309M 1s 2024-03-09T14:43:39.698 INFO:teuthology.orchestra.run.smithi088.stderr: 45400K .......... .......... .......... .......... .......... 48% 289M 1s 2024-03-09T14:43:39.698 INFO:teuthology.orchestra.run.smithi088.stderr: 45450K .......... .......... .......... .......... .......... 48% 268M 1s 2024-03-09T14:43:39.698 INFO:teuthology.orchestra.run.smithi088.stderr: 45500K .......... .......... .......... .......... .......... 49% 306M 1s 2024-03-09T14:43:39.698 INFO:teuthology.orchestra.run.smithi088.stderr: 45550K .......... .......... .......... .......... .......... 49% 296M 1s 2024-03-09T14:43:39.698 INFO:teuthology.orchestra.run.smithi088.stderr: 45600K .......... .......... .......... .......... .......... 49% 133M 1s 2024-03-09T14:43:39.698 INFO:teuthology.orchestra.run.smithi088.stderr: 45650K .......... .......... .......... .......... .......... 49% 218M 1s 2024-03-09T14:43:39.698 INFO:teuthology.orchestra.run.smithi088.stderr: 45700K .......... .......... .......... .......... .......... 49% 295M 1s 2024-03-09T14:43:39.698 INFO:teuthology.orchestra.run.smithi088.stderr: 45750K .......... .......... .......... .......... .......... 49% 296M 1s 2024-03-09T14:43:39.698 INFO:teuthology.orchestra.run.smithi088.stderr: 45800K .......... .......... .......... .......... .......... 49% 4.60M 1s 2024-03-09T14:43:39.698 INFO:teuthology.orchestra.run.smithi088.stderr: 45850K .......... .......... .......... .......... .......... 49% 172M 1s 2024-03-09T14:43:39.698 INFO:teuthology.orchestra.run.smithi088.stderr: 45900K .......... .......... .......... .......... .......... 49% 120M 1s 2024-03-09T14:43:39.698 INFO:teuthology.orchestra.run.smithi088.stderr: 45950K .......... .......... .......... .......... .......... 49% 117M 1s 2024-03-09T14:43:39.698 INFO:teuthology.orchestra.run.smithi088.stderr: 46000K .......... .......... .......... .......... .......... 49% 112M 1s 2024-03-09T14:43:39.698 INFO:teuthology.orchestra.run.smithi088.stderr: 46050K .......... .......... .......... .......... .......... 49% 88.8M 1s 2024-03-09T14:43:39.698 INFO:teuthology.orchestra.run.smithi088.stderr: 46100K .......... .......... .......... .......... .......... 49% 99.6M 1s 2024-03-09T14:43:39.699 INFO:teuthology.orchestra.run.smithi088.stderr: 46150K .......... .......... .......... .......... .......... 49% 64.7M 1s 2024-03-09T14:43:39.699 INFO:teuthology.orchestra.run.smithi088.stderr: 46200K .......... .......... .......... .......... .......... 49% 118M 1s 2024-03-09T14:43:39.699 INFO:teuthology.orchestra.run.smithi088.stderr: 46250K .......... .......... .......... .......... .......... 49% 107M 1s 2024-03-09T14:43:39.699 INFO:teuthology.orchestra.run.smithi088.stderr: 46300K .......... .......... .......... .......... .......... 49% 120M 1s 2024-03-09T14:43:39.699 INFO:teuthology.orchestra.run.smithi088.stderr: 46350K .......... .......... .......... .......... .......... 49% 97.0M 1s 2024-03-09T14:43:39.699 INFO:teuthology.orchestra.run.smithi088.stderr: 46400K .......... .......... .......... .......... .......... 49% 106M 1s 2024-03-09T14:43:39.699 INFO:teuthology.orchestra.run.smithi088.stderr: 46450K .......... .......... .......... .......... .......... 50% 27.0M 1s 2024-03-09T14:43:39.699 INFO:teuthology.orchestra.run.smithi088.stderr: 46500K .......... .......... .......... .......... .......... 50% 110M 1s 2024-03-09T14:43:39.699 INFO:teuthology.orchestra.run.smithi088.stderr: 46550K .......... .......... .......... .......... .......... 50% 117M 1s 2024-03-09T14:43:39.699 INFO:teuthology.orchestra.run.smithi088.stderr: 46600K .......... .......... .......... .......... .......... 50% 50.1M 1s 2024-03-09T14:43:39.699 INFO:teuthology.orchestra.run.smithi088.stderr: 46650K .......... .......... .......... .......... .......... 50% 109M 1s 2024-03-09T14:43:39.699 INFO:teuthology.orchestra.run.smithi088.stderr: 46700K .......... .......... .......... .......... .......... 50% 108M 1s 2024-03-09T14:43:39.699 INFO:teuthology.orchestra.run.smithi088.stderr: 46750K .......... .......... .......... .......... .......... 50% 49.5M 1s 2024-03-09T14:43:39.699 INFO:teuthology.orchestra.run.smithi088.stderr: 46800K .......... .......... .......... .......... .......... 50% 52.9M 1s 2024-03-09T14:43:39.699 INFO:teuthology.orchestra.run.smithi088.stderr: 46850K .......... .......... .......... .......... .......... 50% 87.3M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 46900K .......... .......... .......... .......... .......... 50% 114M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 46950K .......... .......... .......... .......... .......... 50% 120M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 47000K .......... .......... .......... .......... .......... 50% 50.7M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 47050K .......... .......... .......... .......... .......... 50% 111M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 47100K .......... .......... .......... .......... .......... 50% 117M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 47150K .......... .......... .......... .......... .......... 50% 113M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 47200K .......... .......... .......... .......... .......... 50% 51.9M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 47250K .......... .......... .......... .......... .......... 50% 81.5M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 47300K .......... .......... .......... .......... .......... 50% 111M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 47350K .......... .......... .......... .......... .......... 51% 116M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 47400K .......... .......... .......... .......... .......... 51% 51.6M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 47450K .......... .......... .......... .......... .......... 51% 107M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 47500K .......... .......... .......... .......... .......... 51% 116M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 47550K .......... .......... .......... .......... .......... 51% 117M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 47600K .......... .......... .......... .......... .......... 51% 50.8M 1s 2024-03-09T14:43:39.700 INFO:teuthology.orchestra.run.smithi088.stderr: 47650K .......... .......... .......... .......... .......... 51% 89.0M 1s 2024-03-09T14:43:39.701 INFO:teuthology.orchestra.run.smithi088.stderr: 47700K .......... .......... .......... .......... .......... 51% 104M 1s 2024-03-09T14:43:39.701 INFO:teuthology.orchestra.run.smithi088.stderr: 47750K .......... .......... .......... .......... .......... 51% 67.1M 1s 2024-03-09T14:43:39.701 INFO:teuthology.orchestra.run.smithi088.stderr: 47800K .......... .......... .......... .......... .......... 51% 121M 1s 2024-03-09T14:43:39.701 INFO:teuthology.orchestra.run.smithi088.stderr: 47850K .......... .......... .......... .......... .......... 51% 75.4M 1s 2024-03-09T14:43:39.701 INFO:teuthology.orchestra.run.smithi088.stderr: 47900K .......... .......... .......... .......... .......... 51% 117M 1s 2024-03-09T14:43:39.701 INFO:teuthology.orchestra.run.smithi088.stderr: 47950K .......... .......... .......... .......... .......... 51% 114M 1s 2024-03-09T14:43:39.701 INFO:teuthology.orchestra.run.smithi088.stderr: 48000K .......... .......... .......... .......... .......... 51% 111M 1s 2024-03-09T14:43:39.701 INFO:teuthology.orchestra.run.smithi088.stderr: 48050K .......... .......... .......... .......... .......... 51% 43.8M 1s 2024-03-09T14:43:39.701 INFO:teuthology.orchestra.run.smithi088.stderr: 48100K .......... .......... .......... .......... .......... 51% 128M 1s 2024-03-09T14:43:39.701 INFO:teuthology.orchestra.run.smithi088.stderr: 48150K .......... .......... .......... .......... .......... 51% 116M 1s 2024-03-09T14:43:39.701 INFO:teuthology.orchestra.run.smithi088.stderr: 48200K .......... .......... .......... .......... .......... 51% 115M 1s 2024-03-09T14:43:39.701 INFO:teuthology.orchestra.run.smithi088.stderr: 48250K .......... .......... .......... .......... .......... 51% 48.5M 1s 2024-03-09T14:43:39.701 INFO:teuthology.orchestra.run.smithi088.stderr: 48300K .......... .......... .......... .......... .......... 52% 127M 1s 2024-03-09T14:43:39.701 INFO:teuthology.orchestra.run.smithi088.stderr: 48350K .......... .......... .......... .......... .......... 52% 107M 1s 2024-03-09T14:43:39.701 INFO:teuthology.orchestra.run.smithi088.stderr: 48400K .......... .......... .......... .......... .......... 52% 50.0M 1s 2024-03-09T14:43:39.702 INFO:teuthology.orchestra.run.smithi088.stderr: 48450K .......... .......... .......... .......... .......... 52% 83.4M 1s 2024-03-09T14:43:39.702 INFO:teuthology.orchestra.run.smithi088.stderr: 48500K .......... .......... .......... .......... .......... 52% 72.5M 1s 2024-03-09T14:43:39.702 INFO:teuthology.orchestra.run.smithi088.stderr: 48550K .......... .......... .......... .......... .......... 52% 122M 1s 2024-03-09T14:43:39.702 INFO:teuthology.orchestra.run.smithi088.stderr: 48600K .......... .......... .......... .......... .......... 52% 117M 1s 2024-03-09T14:43:39.702 INFO:teuthology.orchestra.run.smithi088.stderr: 48650K .......... .......... .......... .......... .......... 52% 105M 1s 2024-03-09T14:43:39.702 INFO:teuthology.orchestra.run.smithi088.stderr: 48700K .......... .......... .......... .......... .......... 52% 63.0M 1s 2024-03-09T14:43:39.702 INFO:teuthology.orchestra.run.smithi088.stderr: 48750K .......... .......... .......... .......... .......... 52% 78.2M 1s 2024-03-09T14:43:39.702 INFO:teuthology.orchestra.run.smithi088.stderr: 48800K .......... .......... .......... .......... .......... 52% 113M 1s 2024-03-09T14:43:39.702 INFO:teuthology.orchestra.run.smithi088.stderr: 48850K .......... .......... .......... .......... .......... 52% 75.6M 1s 2024-03-09T14:43:39.702 INFO:teuthology.orchestra.run.smithi088.stderr: 48900K .......... .......... .......... .......... .......... 52% 20.7M 1s 2024-03-09T14:43:39.702 INFO:teuthology.orchestra.run.smithi088.stderr: 48950K .......... .......... .......... .......... .......... 52% 108M 1s 2024-03-09T14:43:39.702 INFO:teuthology.orchestra.run.smithi088.stderr: 49000K .......... .......... .......... .......... .......... 52% 85.7M 1s 2024-03-09T14:43:39.702 INFO:teuthology.orchestra.run.smithi088.stderr: 49050K .......... .......... .......... .......... .......... 52% 73.5M 1s 2024-03-09T14:43:39.702 INFO:teuthology.orchestra.run.smithi088.stderr: 49100K .......... .......... .......... .......... .......... 52% 106M 1s 2024-03-09T14:43:39.703 INFO:teuthology.orchestra.run.smithi088.stderr: 49150K .......... .......... .......... .......... .......... 52% 48.1M 1s 2024-03-09T14:43:39.703 INFO:teuthology.orchestra.run.smithi088.stderr: 49200K .......... .......... .......... .......... .......... 53% 142M 1s 2024-03-09T14:43:39.703 INFO:teuthology.orchestra.run.smithi088.stderr: 49250K .......... .......... .......... .......... .......... 53% 86.4M 1s 2024-03-09T14:43:39.703 INFO:teuthology.orchestra.run.smithi088.stderr: 49300K .......... .......... .......... .......... .......... 53% 32.1M 1s 2024-03-09T14:43:39.703 INFO:teuthology.orchestra.run.smithi088.stderr: 49350K .......... .......... .......... .......... .......... 53% 51.8M 1s 2024-03-09T14:43:39.703 INFO:teuthology.orchestra.run.smithi088.stderr: 49400K .......... .......... .......... .......... .......... 53% 108M 1s 2024-03-09T14:43:39.703 INFO:teuthology.orchestra.run.smithi088.stderr: 49450K .......... .......... .......... .......... .......... 53% 111M 1s 2024-03-09T14:43:39.703 INFO:teuthology.orchestra.run.smithi088.stderr: 49500K .......... .......... .......... .......... .......... 53% 122M 1s 2024-03-09T14:43:39.703 INFO:teuthology.orchestra.run.smithi088.stderr: 49550K .......... .......... .......... .......... .......... 53% 50.2M 1s 2024-03-09T14:43:39.703 INFO:teuthology.orchestra.run.smithi088.stderr: 49600K .......... .......... .......... .......... .......... 53% 112M 1s 2024-03-09T14:43:39.703 INFO:teuthology.orchestra.run.smithi088.stderr: 49650K .......... .......... .......... .......... .......... 53% 43.7M 1s 2024-03-09T14:43:39.703 INFO:teuthology.orchestra.run.smithi088.stderr: 49700K .......... .......... .......... .......... .......... 53% 118M 1s 2024-03-09T14:43:39.703 INFO:teuthology.orchestra.run.smithi088.stderr: 49750K .......... .......... .......... .......... .......... 53% 51.0M 1s 2024-03-09T14:43:39.703 INFO:teuthology.orchestra.run.smithi088.stderr: 49800K .......... .......... .......... .......... .......... 53% 104M 1s 2024-03-09T14:43:39.703 INFO:teuthology.orchestra.run.smithi088.stderr: 49850K .......... .......... .......... .......... .......... 53% 48.6M 1s 2024-03-09T14:43:39.704 INFO:teuthology.orchestra.run.smithi088.stderr: 49900K .......... .......... .......... .......... .......... 53% 126M 1s 2024-03-09T14:43:39.704 INFO:teuthology.orchestra.run.smithi088.stderr: 49950K .......... .......... .......... .......... .......... 53% 129M 1s 2024-03-09T14:43:39.704 INFO:teuthology.orchestra.run.smithi088.stderr: 50000K .......... .......... .......... .......... .......... 53% 114M 1s 2024-03-09T14:43:39.704 INFO:teuthology.orchestra.run.smithi088.stderr: 50050K .......... .......... .......... .......... .......... 53% 44.8M 1s 2024-03-09T14:43:39.704 INFO:teuthology.orchestra.run.smithi088.stderr: 50100K .......... .......... .......... .......... .......... 53% 112M 1s 2024-03-09T14:43:39.704 INFO:teuthology.orchestra.run.smithi088.stderr: 50150K .......... .......... .......... .......... .......... 54% 125M 1s 2024-03-09T14:43:39.704 INFO:teuthology.orchestra.run.smithi088.stderr: 50200K .......... .......... .......... .......... .......... 54% 114M 1s 2024-03-09T14:43:39.704 INFO:teuthology.orchestra.run.smithi088.stderr: 50250K .......... .......... .......... .......... .......... 54% 45.9M 1s 2024-03-09T14:43:39.704 INFO:teuthology.orchestra.run.smithi088.stderr: 50300K .......... .......... .......... .......... .......... 54% 58.1M 1s 2024-03-09T14:43:39.704 INFO:teuthology.orchestra.run.smithi088.stderr: 50350K .......... .......... .......... .......... .......... 54% 114M 1s 2024-03-09T14:43:39.704 INFO:teuthology.orchestra.run.smithi088.stderr: 50400K .......... .......... .......... .......... .......... 54% 92.0M 1s 2024-03-09T14:43:39.704 INFO:teuthology.orchestra.run.smithi088.stderr: 50450K .......... .......... .......... .......... .......... 54% 87.0M 1s 2024-03-09T14:43:39.704 INFO:teuthology.orchestra.run.smithi088.stderr: 50500K .......... .......... .......... .......... .......... 54% 118M 1s 2024-03-09T14:43:39.704 INFO:teuthology.orchestra.run.smithi088.stderr: 50550K .......... .......... .......... .......... .......... 54% 32.3M 1s 2024-03-09T14:43:39.704 INFO:teuthology.orchestra.run.smithi088.stderr: 50600K .......... .......... .......... .......... .......... 54% 110M 1s 2024-03-09T14:43:39.705 INFO:teuthology.orchestra.run.smithi088.stderr: 50650K .......... .......... .......... .......... .......... 54% 121M 1s 2024-03-09T14:43:39.705 INFO:teuthology.orchestra.run.smithi088.stderr: 50700K .......... .......... .......... .......... .......... 54% 114M 1s 2024-03-09T14:43:39.705 INFO:teuthology.orchestra.run.smithi088.stderr: 50750K .......... .......... .......... .......... .......... 54% 50.6M 1s 2024-03-09T14:43:39.705 INFO:teuthology.orchestra.run.smithi088.stderr: 50800K .......... .......... .......... .......... .......... 54% 110M 1s 2024-03-09T14:43:39.705 INFO:teuthology.orchestra.run.smithi088.stderr: 50850K .......... .......... .......... .......... .......... 54% 92.1M 1s 2024-03-09T14:43:39.705 INFO:teuthology.orchestra.run.smithi088.stderr: 50900K .......... .......... .......... .......... .......... 54% 112M 1s 2024-03-09T14:43:39.705 INFO:teuthology.orchestra.run.smithi088.stderr: 50950K .......... .......... .......... .......... .......... 54% 32.7M 1s 2024-03-09T14:43:39.705 INFO:teuthology.orchestra.run.smithi088.stderr: 51000K .......... .......... .......... .......... .......... 54% 107M 1s 2024-03-09T14:43:39.705 INFO:teuthology.orchestra.run.smithi088.stderr: 51050K .......... .......... .......... .......... .......... 55% 46.8M 1s 2024-03-09T14:43:39.705 INFO:teuthology.orchestra.run.smithi088.stderr: 51100K .......... .......... .......... .......... .......... 55% 123M 1s 2024-03-09T14:43:39.705 INFO:teuthology.orchestra.run.smithi088.stderr: 51150K .......... .......... .......... .......... .......... 55% 130M 1s 2024-03-09T14:43:39.705 INFO:teuthology.orchestra.run.smithi088.stderr: 51200K .......... .......... .......... .......... .......... 55% 112M 1s 2024-03-09T14:43:39.705 INFO:teuthology.orchestra.run.smithi088.stderr: 51250K .......... .......... .......... .......... .......... 55% 58.2M 1s 2024-03-09T14:43:39.705 INFO:teuthology.orchestra.run.smithi088.stderr: 51300K .......... .......... .......... .......... .......... 55% 77.2M 1s 2024-03-09T14:43:39.705 INFO:teuthology.orchestra.run.smithi088.stderr: 51350K .......... .......... .......... .......... .......... 55% 125M 1s 2024-03-09T14:43:39.706 INFO:teuthology.orchestra.run.smithi088.stderr: 51400K .......... .......... .......... .......... .......... 55% 32.1M 1s 2024-03-09T14:43:39.706 INFO:teuthology.orchestra.run.smithi088.stderr: 51450K .......... .......... .......... .......... .......... 55% 57.8M 1s 2024-03-09T14:43:39.706 INFO:teuthology.orchestra.run.smithi088.stderr: 51500K .......... .......... .......... .......... .......... 55% 86.3M 1s 2024-03-09T14:43:39.706 INFO:teuthology.orchestra.run.smithi088.stderr: 51550K .......... .......... .......... .......... .......... 55% 118M 1s 2024-03-09T14:43:39.706 INFO:teuthology.orchestra.run.smithi088.stderr: 51600K .......... .......... .......... .......... .......... 55% 112M 1s 2024-03-09T14:43:39.706 INFO:teuthology.orchestra.run.smithi088.stderr: 51650K .......... .......... .......... .......... .......... 55% 44.9M 1s 2024-03-09T14:43:39.706 INFO:teuthology.orchestra.run.smithi088.stderr: 51700K .......... .......... .......... .......... .......... 55% 53.2M 1s 2024-03-09T14:43:39.706 INFO:teuthology.orchestra.run.smithi088.stderr: 51750K .......... .......... .......... .......... .......... 55% 109M 1s 2024-03-09T14:43:39.706 INFO:teuthology.orchestra.run.smithi088.stderr: 51800K .......... .......... .......... .......... .......... 55% 129M 1s 2024-03-09T14:43:39.706 INFO:teuthology.orchestra.run.smithi088.stderr: 51850K .......... .......... .......... .......... .......... 55% 30.9M 1s 2024-03-09T14:43:39.706 INFO:teuthology.orchestra.run.smithi088.stderr: 51900K .......... .......... .......... .......... .......... 55% 51.5M 1s 2024-03-09T14:43:39.706 INFO:teuthology.orchestra.run.smithi088.stderr: 51950K .......... .......... .......... .......... .......... 55% 101M 1s 2024-03-09T14:43:39.706 INFO:teuthology.orchestra.run.smithi088.stderr: 52000K .......... .......... .......... .......... .......... 56% 115M 1s 2024-03-09T14:43:39.706 INFO:teuthology.orchestra.run.smithi088.stderr: 52050K .......... .......... .......... .......... .......... 56% 85.5M 1s 2024-03-09T14:43:39.706 INFO:teuthology.orchestra.run.smithi088.stderr: 52100K .......... .......... .......... .......... .......... 56% 116M 1s 2024-03-09T14:43:39.707 INFO:teuthology.orchestra.run.smithi088.stderr: 52150K .......... .......... .......... .......... .......... 56% 51.4M 1s 2024-03-09T14:43:39.707 INFO:teuthology.orchestra.run.smithi088.stderr: 52200K .......... .......... .......... .......... .......... 56% 31.2M 1s 2024-03-09T14:43:39.707 INFO:teuthology.orchestra.run.smithi088.stderr: 52250K .......... .......... .......... .......... .......... 56% 116M 1s 2024-03-09T14:43:39.707 INFO:teuthology.orchestra.run.smithi088.stderr: 52300K .......... .......... .......... .......... .......... 56% 99.4M 1s 2024-03-09T14:43:39.707 INFO:teuthology.orchestra.run.smithi088.stderr: 52350K .......... .......... .......... .......... .......... 56% 49.7M 1s 2024-03-09T14:43:39.707 INFO:teuthology.orchestra.run.smithi088.stderr: 52400K .......... .......... .......... .......... .......... 56% 108M 1s 2024-03-09T14:43:39.707 INFO:teuthology.orchestra.run.smithi088.stderr: 52450K .......... .......... .......... .......... .......... 56% 31.7M 1s 2024-03-09T14:43:39.707 INFO:teuthology.orchestra.run.smithi088.stderr: 52500K .......... .......... .......... .......... .......... 56% 113M 1s 2024-03-09T14:43:39.707 INFO:teuthology.orchestra.run.smithi088.stderr: 52550K .......... .......... .......... .......... .......... 56% 114M 1s 2024-03-09T14:43:39.707 INFO:teuthology.orchestra.run.smithi088.stderr: 52600K .......... .......... .......... .......... .......... 56% 45.4M 1s 2024-03-09T14:43:39.707 INFO:teuthology.orchestra.run.smithi088.stderr: 52650K .......... .......... .......... .......... .......... 56% 100M 1s 2024-03-09T14:43:39.707 INFO:teuthology.orchestra.run.smithi088.stderr: 52700K .......... .......... .......... .......... .......... 56% 117M 1s 2024-03-09T14:43:39.707 INFO:teuthology.orchestra.run.smithi088.stderr: 52750K .......... .......... .......... .......... .......... 56% 93.7M 1s 2024-03-09T14:43:39.707 INFO:teuthology.orchestra.run.smithi088.stderr: 52800K .......... .......... .......... .......... .......... 56% 25.1M 1s 2024-03-09T14:43:39.708 INFO:teuthology.orchestra.run.smithi088.stderr: 52850K .......... .......... .......... .......... .......... 56% 85.3M 1s 2024-03-09T14:43:39.708 INFO:teuthology.orchestra.run.smithi088.stderr: 52900K .......... .......... .......... .......... .......... 56% 47.6M 1s 2024-03-09T14:43:39.708 INFO:teuthology.orchestra.run.smithi088.stderr: 52950K .......... .......... .......... .......... .......... 57% 118M 1s 2024-03-09T14:43:39.708 INFO:teuthology.orchestra.run.smithi088.stderr: 53000K .......... .......... .......... .......... .......... 57% 117M 1s 2024-03-09T14:43:39.708 INFO:teuthology.orchestra.run.smithi088.stderr: 53050K .......... .......... .......... .......... .......... 57% 111M 1s 2024-03-09T14:43:39.708 INFO:teuthology.orchestra.run.smithi088.stderr: 53100K .......... .......... .......... .......... .......... 57% 31.5M 1s 2024-03-09T14:43:39.708 INFO:teuthology.orchestra.run.smithi088.stderr: 53150K .......... .......... .......... .......... .......... 57% 116M 1s 2024-03-09T14:43:39.708 INFO:teuthology.orchestra.run.smithi088.stderr: 53200K .......... .......... .......... .......... .......... 57% 46.1M 1s 2024-03-09T14:43:39.708 INFO:teuthology.orchestra.run.smithi088.stderr: 53250K .......... .......... .......... .......... .......... 57% 81.4M 1s 2024-03-09T14:43:39.708 INFO:teuthology.orchestra.run.smithi088.stderr: 53300K .......... .......... .......... .......... .......... 57% 49.7M 1s 2024-03-09T14:43:39.708 INFO:teuthology.orchestra.run.smithi088.stderr: 53350K .......... .......... .......... .......... .......... 57% 48.5M 1s 2024-03-09T14:43:39.708 INFO:teuthology.orchestra.run.smithi088.stderr: 53400K .......... .......... .......... .......... .......... 57% 110M 1s 2024-03-09T14:43:39.708 INFO:teuthology.orchestra.run.smithi088.stderr: 53450K .......... .......... .......... .......... .......... 57% 111M 1s 2024-03-09T14:43:39.708 INFO:teuthology.orchestra.run.smithi088.stderr: 53500K .......... .......... .......... .......... .......... 57% 31.5M 1s 2024-03-09T14:43:39.708 INFO:teuthology.orchestra.run.smithi088.stderr: 53550K .......... .......... .......... .......... .......... 57% 117M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 53600K .......... .......... .......... .......... .......... 57% 109M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 53650K .......... .......... .......... .......... .......... 57% 28.9M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 53700K .......... .......... .......... .......... .......... 57% 130M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 53750K .......... .......... .......... .......... .......... 57% 124M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 53800K .......... .......... .......... .......... .......... 57% 90.6M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 53850K .......... .......... .......... .......... .......... 58% 52.2M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 53900K .......... .......... .......... .......... .......... 58% 121M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 53950K .......... .......... .......... .......... .......... 58% 32.4M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 54000K .......... .......... .......... .......... .......... 58% 48.4M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 54050K .......... .......... .......... .......... .......... 58% 51.6M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 54100K .......... .......... .......... .......... .......... 58% 91.7M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 54150K .......... .......... .......... .......... .......... 58% 116M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 54200K .......... .......... .......... .......... .......... 58% 115M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 54250K .......... .......... .......... .......... .......... 58% 106M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 54300K .......... .......... .......... .......... .......... 58% 30.6M 1s 2024-03-09T14:43:39.709 INFO:teuthology.orchestra.run.smithi088.stderr: 54350K .......... .......... .......... .......... .......... 58% 131M 1s 2024-03-09T14:43:39.710 INFO:teuthology.orchestra.run.smithi088.stderr: 54400K .......... .......... .......... .......... .......... 58% 44.8M 1s 2024-03-09T14:43:39.710 INFO:teuthology.orchestra.run.smithi088.stderr: 54450K .......... .......... .......... .......... .......... 58% 43.1M 1s 2024-03-09T14:43:39.710 INFO:teuthology.orchestra.run.smithi088.stderr: 54500K .......... .......... .......... .......... .......... 58% 164M 1s 2024-03-09T14:43:39.710 INFO:teuthology.orchestra.run.smithi088.stderr: 54550K .......... .......... .......... .......... .......... 58% 49.2M 1s 2024-03-09T14:43:39.710 INFO:teuthology.orchestra.run.smithi088.stderr: 54600K .......... .......... .......... .......... .......... 58% 112M 1s 2024-03-09T14:43:39.710 INFO:teuthology.orchestra.run.smithi088.stderr: 54650K .......... .......... .......... .......... .......... 58% 110M 1s 2024-03-09T14:43:39.710 INFO:teuthology.orchestra.run.smithi088.stderr: 54700K .......... .......... .......... .......... .......... 58% 114M 1s 2024-03-09T14:43:39.710 INFO:teuthology.orchestra.run.smithi088.stderr: 54750K .......... .......... .......... .......... .......... 58% 50.0M 1s 2024-03-09T14:43:39.710 INFO:teuthology.orchestra.run.smithi088.stderr: 54800K .......... .......... .......... .......... .......... 59% 113M 1s 2024-03-09T14:43:39.710 INFO:teuthology.orchestra.run.smithi088.stderr: 54850K .......... .......... .......... .......... .......... 59% 44.3M 1s 2024-03-09T14:43:39.710 INFO:teuthology.orchestra.run.smithi088.stderr: 54900K .......... .......... .......... .......... .......... 59% 51.1M 1s 2024-03-09T14:43:39.710 INFO:teuthology.orchestra.run.smithi088.stderr: 54950K .......... .......... .......... .......... .......... 59% 51.5M 1s 2024-03-09T14:43:39.710 INFO:teuthology.orchestra.run.smithi088.stderr: 55000K .......... .......... .......... .......... .......... 59% 108M 1s 2024-03-09T14:43:39.710 INFO:teuthology.orchestra.run.smithi088.stderr: 55050K .......... .......... .......... .......... .......... 59% 116M 1s 2024-03-09T14:43:39.711 INFO:teuthology.orchestra.run.smithi088.stderr: 55100K .......... .......... .......... .......... .......... 59% 31.6M 1s 2024-03-09T14:43:39.711 INFO:teuthology.orchestra.run.smithi088.stderr: 55150K .......... .......... .......... .......... .......... 59% 113M 1s 2024-03-09T14:43:39.711 INFO:teuthology.orchestra.run.smithi088.stderr: 55200K .......... .......... .......... .......... .......... 59% 51.0M 1s 2024-03-09T14:43:39.711 INFO:teuthology.orchestra.run.smithi088.stderr: 55250K .......... .......... .......... .......... .......... 59% 85.6M 1s 2024-03-09T14:43:39.711 INFO:teuthology.orchestra.run.smithi088.stderr: 55300K .......... .......... .......... .......... .......... 59% 116M 1s 2024-03-09T14:43:39.711 INFO:teuthology.orchestra.run.smithi088.stderr: 55350K .......... .......... .......... .......... .......... 59% 111M 1s 2024-03-09T14:43:39.711 INFO:teuthology.orchestra.run.smithi088.stderr: 55400K .......... .......... .......... .......... .......... 59% 32.3M 1s 2024-03-09T14:43:39.711 INFO:teuthology.orchestra.run.smithi088.stderr: 55450K .......... .......... .......... .......... .......... 59% 50.1M 1s 2024-03-09T14:43:39.711 INFO:teuthology.orchestra.run.smithi088.stderr: 55500K .......... .......... .......... .......... .......... 59% 110M 1s 2024-03-09T14:43:39.711 INFO:teuthology.orchestra.run.smithi088.stderr: 55550K .......... .......... .......... .......... .......... 59% 51.2M 1s 2024-03-09T14:43:39.711 INFO:teuthology.orchestra.run.smithi088.stderr: 55600K .......... .......... .......... .......... .......... 59% 110M 1s 2024-03-09T14:43:39.711 INFO:teuthology.orchestra.run.smithi088.stderr: 55650K .......... .......... .......... .......... .......... 59% 46.7M 1s 2024-03-09T14:43:39.711 INFO:teuthology.orchestra.run.smithi088.stderr: 55700K .......... .......... .......... .......... .......... 60% 49.0M 1s 2024-03-09T14:43:39.711 INFO:teuthology.orchestra.run.smithi088.stderr: 55750K .......... .......... .......... .......... .......... 60% 31.9M 1s 2024-03-09T14:43:39.711 INFO:teuthology.orchestra.run.smithi088.stderr: 55800K .......... .......... .......... .......... .......... 60% 117M 1s 2024-03-09T14:43:39.712 INFO:teuthology.orchestra.run.smithi088.stderr: 55850K .......... .......... .......... .......... .......... 60% 80.4M 1s 2024-03-09T14:43:39.712 INFO:teuthology.orchestra.run.smithi088.stderr: 55900K .......... .......... .......... .......... .......... 60% 58.0M 1s 2024-03-09T14:43:39.712 INFO:teuthology.orchestra.run.smithi088.stderr: 55950K .......... .......... .......... .......... .......... 60% 124M 1s 2024-03-09T14:43:39.712 INFO:teuthology.orchestra.run.smithi088.stderr: 56000K .......... .......... .......... .......... .......... 60% 111M 1s 2024-03-09T14:43:39.712 INFO:teuthology.orchestra.run.smithi088.stderr: 56050K .......... .......... .......... .......... .......... 60% 45.5M 1s 2024-03-09T14:43:39.712 INFO:teuthology.orchestra.run.smithi088.stderr: 56100K .......... .......... .......... .......... .......... 60% 52.4M 1s 2024-03-09T14:43:39.712 INFO:teuthology.orchestra.run.smithi088.stderr: 56150K .......... .......... .......... .......... .......... 60% 46.2M 1s 2024-03-09T14:43:39.712 INFO:teuthology.orchestra.run.smithi088.stderr: 56200K .......... .......... .......... .......... .......... 60% 110M 1s 2024-03-09T14:43:39.712 INFO:teuthology.orchestra.run.smithi088.stderr: 56250K .......... .......... .......... .......... .......... 60% 124M 1s 2024-03-09T14:43:39.712 INFO:teuthology.orchestra.run.smithi088.stderr: 56300K .......... .......... .......... .......... .......... 60% 50.4M 1s 2024-03-09T14:43:39.712 INFO:teuthology.orchestra.run.smithi088.stderr: 56350K .......... .......... .......... .......... .......... 60% 45.4M 1s 2024-03-09T14:43:39.712 INFO:teuthology.orchestra.run.smithi088.stderr: 56400K .......... .......... .......... .......... .......... 60% 56.3M 1s 2024-03-09T14:43:39.712 INFO:teuthology.orchestra.run.smithi088.stderr: 56450K .......... .......... .......... .......... .......... 60% 79.2M 1s 2024-03-09T14:43:39.712 INFO:teuthology.orchestra.run.smithi088.stderr: 56500K .......... .......... .......... .......... .......... 60% 135M 1s 2024-03-09T14:43:39.712 INFO:teuthology.orchestra.run.smithi088.stderr: 56550K .......... .......... .......... .......... .......... 60% 96.1M 1s 2024-03-09T14:43:39.713 INFO:teuthology.orchestra.run.smithi088.stderr: 56600K .......... .......... .......... .......... .......... 60% 33.6M 1s 2024-03-09T14:43:39.713 INFO:teuthology.orchestra.run.smithi088.stderr: 56650K .......... .......... .......... .......... .......... 61% 50.4M 1s 2024-03-09T14:43:39.713 INFO:teuthology.orchestra.run.smithi088.stderr: 56700K .......... .......... .......... .......... .......... 61% 117M 1s 2024-03-09T14:43:39.713 INFO:teuthology.orchestra.run.smithi088.stderr: 56750K .......... .......... .......... .......... .......... 61% 83.0M 1s 2024-03-09T14:43:39.713 INFO:teuthology.orchestra.run.smithi088.stderr: 56800K .......... .......... .......... .......... .......... 61% 60.6M 1s 2024-03-09T14:43:39.713 INFO:teuthology.orchestra.run.smithi088.stderr: 56850K .......... .......... .......... .......... .......... 61% 87.1M 1s 2024-03-09T14:43:39.713 INFO:teuthology.orchestra.run.smithi088.stderr: 56900K .......... .......... .......... .......... .......... 61% 8.90M 1s 2024-03-09T14:43:39.713 INFO:teuthology.orchestra.run.smithi088.stderr: 56950K .......... .......... .......... .......... .......... 61% 324M 1s 2024-03-09T14:43:39.713 INFO:teuthology.orchestra.run.smithi088.stderr: 57000K .......... .......... .......... .......... .......... 61% 429M 1s 2024-03-09T14:43:39.713 INFO:teuthology.orchestra.run.smithi088.stderr: 57050K .......... .......... .......... .......... .......... 61% 281M 1s 2024-03-09T14:43:39.713 INFO:teuthology.orchestra.run.smithi088.stderr: 57100K .......... .......... .......... .......... .......... 61% 282M 1s 2024-03-09T14:43:39.713 INFO:teuthology.orchestra.run.smithi088.stderr: 57150K .......... .......... .......... .......... .......... 61% 429M 1s 2024-03-09T14:43:39.713 INFO:teuthology.orchestra.run.smithi088.stderr: 57200K .......... .......... .......... .......... .......... 61% 344M 1s 2024-03-09T14:43:39.713 INFO:teuthology.orchestra.run.smithi088.stderr: 57250K .......... .......... .......... .......... .......... 61% 123M 1s 2024-03-09T14:43:39.713 INFO:teuthology.orchestra.run.smithi088.stderr: 57300K .......... .......... .......... .......... .......... 61% 358M 1s 2024-03-09T14:43:39.714 INFO:teuthology.orchestra.run.smithi088.stderr: 57350K .......... .......... .......... .......... .......... 61% 56.0M 1s 2024-03-09T14:43:39.714 INFO:teuthology.orchestra.run.smithi088.stderr: 57400K .......... .......... .......... .......... .......... 61% 125M 1s 2024-03-09T14:43:39.714 INFO:teuthology.orchestra.run.smithi088.stderr: 57450K .......... .......... .......... .......... .......... 61% 44.6M 1s 2024-03-09T14:43:39.714 INFO:teuthology.orchestra.run.smithi088.stderr: 57500K .......... .......... .......... .......... .......... 61% 54.1M 1s 2024-03-09T14:43:39.714 INFO:teuthology.orchestra.run.smithi088.stderr: 57550K .......... .......... .......... .......... .......... 62% 110M 1s 2024-03-09T14:43:39.714 INFO:teuthology.orchestra.run.smithi088.stderr: 57600K .......... .......... .......... .......... .......... 62% 113M 1s 2024-03-09T14:43:39.714 INFO:teuthology.orchestra.run.smithi088.stderr: 57650K .......... .......... .......... .......... .......... 62% 45.6M 1s 2024-03-09T14:43:39.714 INFO:teuthology.orchestra.run.smithi088.stderr: 57700K .......... .......... .......... .......... .......... 62% 121M 1s 2024-03-09T14:43:39.714 INFO:teuthology.orchestra.run.smithi088.stderr: 57750K .......... .......... .......... .......... .......... 62% 31.0M 1s 2024-03-09T14:43:39.714 INFO:teuthology.orchestra.run.smithi088.stderr: 57800K .......... .......... .......... .......... .......... 62% 94.1M 1s 2024-03-09T14:43:39.714 INFO:teuthology.orchestra.run.smithi088.stderr: 57850K .......... .......... .......... .......... .......... 62% 98.9M 1s 2024-03-09T14:43:39.714 INFO:teuthology.orchestra.run.smithi088.stderr: 57900K .......... .......... .......... .......... .......... 62% 59.7M 1s 2024-03-09T14:43:39.714 INFO:teuthology.orchestra.run.smithi088.stderr: 57950K .......... .......... .......... .......... .......... 62% 123M 1s 2024-03-09T14:43:39.714 INFO:teuthology.orchestra.run.smithi088.stderr: 58000K .......... .......... .......... .......... .......... 62% 31.7M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58050K .......... .......... .......... .......... .......... 62% 90.5M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58100K .......... .......... .......... .......... .......... 62% 105M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58150K .......... .......... .......... .......... .......... 62% 46.9M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58200K .......... .......... .......... .......... .......... 62% 52.7M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58250K .......... .......... .......... .......... .......... 62% 102M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58300K .......... .......... .......... .......... .......... 62% 134M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58350K .......... .......... .......... .......... .......... 62% 51.0M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58400K .......... .......... .......... .......... .......... 62% 42.6M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58450K .......... .......... .......... .......... .......... 62% 31.9M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58500K .......... .......... .......... .......... .......... 63% 104M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58550K .......... .......... .......... .......... .......... 63% 119M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58600K .......... .......... .......... .......... .......... 63% 52.1M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58650K .......... .......... .......... .......... .......... 63% 48.7M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58700K .......... .......... .......... .......... .......... 63% 50.8M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58750K .......... .......... .......... .......... .......... 63% 118M 1s 2024-03-09T14:43:39.715 INFO:teuthology.orchestra.run.smithi088.stderr: 58800K .......... .......... .......... .......... .......... 63% 76.4M 1s 2024-03-09T14:43:39.716 INFO:teuthology.orchestra.run.smithi088.stderr: 58850K .......... .......... .......... .......... .......... 63% 53.7M 1s 2024-03-09T14:43:39.716 INFO:teuthology.orchestra.run.smithi088.stderr: 58900K .......... .......... .......... .......... .......... 63% 123M 1s 2024-03-09T14:43:39.716 INFO:teuthology.orchestra.run.smithi088.stderr: 58950K .......... .......... .......... .......... .......... 63% 49.2M 1s 2024-03-09T14:43:39.716 INFO:teuthology.orchestra.run.smithi088.stderr: 59000K .......... .......... .......... .......... .......... 63% 33.7M 1s 2024-03-09T14:43:39.716 INFO:teuthology.orchestra.run.smithi088.stderr: 59050K .......... .......... .......... .......... .......... 63% 104M 1s 2024-03-09T14:43:39.716 INFO:teuthology.orchestra.run.smithi088.stderr: 59100K .......... .......... .......... .......... .......... 63% 112M 1s 2024-03-09T14:43:39.716 INFO:teuthology.orchestra.run.smithi088.stderr: 59150K .......... .......... .......... .......... .......... 63% 84.5M 1s 2024-03-09T14:43:39.716 INFO:teuthology.orchestra.run.smithi088.stderr: 59200K .......... .......... .......... .......... .......... 63% 58.2M 1s 2024-03-09T14:43:39.716 INFO:teuthology.orchestra.run.smithi088.stderr: 59250K .......... .......... .......... .......... .......... 63% 45.5M 1s 2024-03-09T14:43:39.716 INFO:teuthology.orchestra.run.smithi088.stderr: 59300K .......... .......... .......... .......... .......... 63% 108M 1s 2024-03-09T14:43:39.716 INFO:teuthology.orchestra.run.smithi088.stderr: 59350K .......... .......... .......... .......... .......... 63% 51.6M 1s 2024-03-09T14:43:39.716 INFO:teuthology.orchestra.run.smithi088.stderr: 59400K .......... .......... .......... .......... .......... 63% 116M 1s 2024-03-09T14:43:39.716 INFO:teuthology.orchestra.run.smithi088.stderr: 59450K .......... .......... .......... .......... .......... 64% 50.0M 1s 2024-03-09T14:43:39.716 INFO:teuthology.orchestra.run.smithi088.stderr: 59500K .......... .......... .......... .......... .......... 64% 115M 1s 2024-03-09T14:43:39.717 INFO:teuthology.orchestra.run.smithi088.stderr: 59550K .......... .......... .......... .......... .......... 64% 110M 1s 2024-03-09T14:43:39.717 INFO:teuthology.orchestra.run.smithi088.stderr: 59600K .......... .......... .......... .......... .......... 64% 113M 1s 2024-03-09T14:43:39.717 INFO:teuthology.orchestra.run.smithi088.stderr: 59650K .......... .......... .......... .......... .......... 64% 94.6M 1s 2024-03-09T14:43:39.717 INFO:teuthology.orchestra.run.smithi088.stderr: 59700K .......... .......... .......... .......... .......... 64% 113M 1s 2024-03-09T14:43:39.717 INFO:teuthology.orchestra.run.smithi088.stderr: 59750K .......... .......... .......... .......... .......... 64% 116M 1s 2024-03-09T14:43:39.717 INFO:teuthology.orchestra.run.smithi088.stderr: 59800K .......... .......... .......... .......... .......... 64% 120M 1s 2024-03-09T14:43:39.717 INFO:teuthology.orchestra.run.smithi088.stderr: 59850K .......... .......... .......... .......... .......... 64% 10.0M 1s 2024-03-09T14:43:39.717 INFO:teuthology.orchestra.run.smithi088.stderr: 59900K .......... .......... .......... .......... .......... 64% 107M 1s 2024-03-09T14:43:39.717 INFO:teuthology.orchestra.run.smithi088.stderr: 59950K .......... .......... .......... .......... .......... 64% 115M 1s 2024-03-09T14:43:39.717 INFO:teuthology.orchestra.run.smithi088.stderr: 60000K .......... .......... .......... .......... .......... 64% 51.4M 1s 2024-03-09T14:43:39.717 INFO:teuthology.orchestra.run.smithi088.stderr: 60050K .......... .......... .......... .......... .......... 64% 89.0M 1s 2024-03-09T14:43:39.717 INFO:teuthology.orchestra.run.smithi088.stderr: 60100K .......... .......... .......... .......... .......... 64% 37.7M 1s 2024-03-09T14:43:39.717 INFO:teuthology.orchestra.run.smithi088.stderr: 60150K .......... .......... .......... .......... .......... 64% 75.8M 1s 2024-03-09T14:43:39.717 INFO:teuthology.orchestra.run.smithi088.stderr: 60200K .......... .......... .......... .......... .......... 64% 113M 1s 2024-03-09T14:43:39.717 INFO:teuthology.orchestra.run.smithi088.stderr: 60250K .......... .......... .......... .......... .......... 64% 109M 1s 2024-03-09T14:43:39.718 INFO:teuthology.orchestra.run.smithi088.stderr: 60300K .......... .......... .......... .......... .......... 64% 48.8M 1s 2024-03-09T14:43:39.718 INFO:teuthology.orchestra.run.smithi088.stderr: 60350K .......... .......... .......... .......... .......... 65% 114M 1s 2024-03-09T14:43:39.718 INFO:teuthology.orchestra.run.smithi088.stderr: 60400K .......... .......... .......... .......... .......... 65% 116M 1s 2024-03-09T14:43:39.718 INFO:teuthology.orchestra.run.smithi088.stderr: 60450K .......... .......... .......... .......... .......... 65% 30.3M 1s 2024-03-09T14:43:39.718 INFO:teuthology.orchestra.run.smithi088.stderr: 60500K .......... .......... .......... .......... .......... 65% 86.3M 1s 2024-03-09T14:43:39.718 INFO:teuthology.orchestra.run.smithi088.stderr: 60550K .......... .......... .......... .......... .......... 65% 116M 1s 2024-03-09T14:43:39.718 INFO:teuthology.orchestra.run.smithi088.stderr: 60600K .......... .......... .......... .......... .......... 65% 51.7M 1s 2024-03-09T14:43:39.718 INFO:teuthology.orchestra.run.smithi088.stderr: 60650K .......... .......... .......... .......... .......... 65% 110M 1s 2024-03-09T14:43:39.718 INFO:teuthology.orchestra.run.smithi088.stderr: 60700K .......... .......... .......... .......... .......... 65% 51.0M 1s 2024-03-09T14:43:39.718 INFO:teuthology.orchestra.run.smithi088.stderr: 60750K .......... .......... .......... .......... .......... 65% 111M 1s 2024-03-09T14:43:39.718 INFO:teuthology.orchestra.run.smithi088.stderr: 60800K .......... .......... .......... .......... .......... 65% 50.2M 1s 2024-03-09T14:43:39.718 INFO:teuthology.orchestra.run.smithi088.stderr: 60850K .......... .......... .......... .......... .......... 65% 46.7M 1s 2024-03-09T14:43:39.718 INFO:teuthology.orchestra.run.smithi088.stderr: 60900K .......... .......... .......... .......... .......... 65% 118M 1s 2024-03-09T14:43:39.718 INFO:teuthology.orchestra.run.smithi088.stderr: 60950K .......... .......... .......... .......... .......... 65% 98.2M 1s 2024-03-09T14:43:39.718 INFO:teuthology.orchestra.run.smithi088.stderr: 61000K .......... .......... .......... .......... .......... 65% 48.6M 1s 2024-03-09T14:43:39.719 INFO:teuthology.orchestra.run.smithi088.stderr: 61050K .......... .......... .......... .......... .......... 65% 39.6M 1s 2024-03-09T14:43:39.719 INFO:teuthology.orchestra.run.smithi088.stderr: 61100K .......... .......... .......... .......... .......... 65% 112M 1s 2024-03-09T14:43:39.719 INFO:teuthology.orchestra.run.smithi088.stderr: 61150K .......... .......... .......... .......... .......... 65% 117M 1s 2024-03-09T14:43:39.719 INFO:teuthology.orchestra.run.smithi088.stderr: 61200K .......... .......... .......... .......... .......... 65% 60.0M 1s 2024-03-09T14:43:39.719 INFO:teuthology.orchestra.run.smithi088.stderr: 61250K .......... .......... .......... .......... .......... 65% 44.9M 1s 2024-03-09T14:43:39.719 INFO:teuthology.orchestra.run.smithi088.stderr: 61300K .......... .......... .......... .......... .......... 66% 108M 1s 2024-03-09T14:43:39.719 INFO:teuthology.orchestra.run.smithi088.stderr: 61350K .......... .......... .......... .......... .......... 66% 119M 1s 2024-03-09T14:43:39.719 INFO:teuthology.orchestra.run.smithi088.stderr: 61400K .......... .......... .......... .......... .......... 66% 40.5M 1s 2024-03-09T14:43:39.719 INFO:teuthology.orchestra.run.smithi088.stderr: 61450K .......... .......... .......... .......... .......... 66% 101M 1s 2024-03-09T14:43:39.719 INFO:teuthology.orchestra.run.smithi088.stderr: 61500K .......... .......... .......... .......... .......... 66% 63.3M 1s 2024-03-09T14:43:39.719 INFO:teuthology.orchestra.run.smithi088.stderr: 61550K .......... .......... .......... .......... .......... 66% 45.4M 1s 2024-03-09T14:43:39.719 INFO:teuthology.orchestra.run.smithi088.stderr: 61600K .......... .......... .......... .......... .......... 66% 121M 1s 2024-03-09T14:43:39.719 INFO:teuthology.orchestra.run.smithi088.stderr: 61650K .......... .......... .......... .......... .......... 66% 46.9M 1s 2024-03-09T14:43:39.719 INFO:teuthology.orchestra.run.smithi088.stderr: 61700K .......... .......... .......... .......... .......... 66% 98.0M 1s 2024-03-09T14:43:39.719 INFO:teuthology.orchestra.run.smithi088.stderr: 61750K .......... .......... .......... .......... .......... 66% 48.9M 1s 2024-03-09T14:43:39.720 INFO:teuthology.orchestra.run.smithi088.stderr: 61800K .......... .......... .......... .......... .......... 66% 102M 0s 2024-03-09T14:43:39.720 INFO:teuthology.orchestra.run.smithi088.stderr: 61850K .......... .......... .......... .......... .......... 66% 114M 0s 2024-03-09T14:43:39.720 INFO:teuthology.orchestra.run.smithi088.stderr: 61900K .......... .......... .......... .......... .......... 66% 47.8M 0s 2024-03-09T14:43:39.720 INFO:teuthology.orchestra.run.smithi088.stderr: 61950K .......... .......... .......... .......... .......... 66% 29.0M 0s 2024-03-09T14:43:39.720 INFO:teuthology.orchestra.run.smithi088.stderr: 62000K .......... .......... .......... .......... .......... 66% 116M 0s 2024-03-09T14:43:39.720 INFO:teuthology.orchestra.run.smithi088.stderr: 62050K .......... .......... .......... .......... .......... 66% 115M 0s 2024-03-09T14:43:39.720 INFO:teuthology.orchestra.run.smithi088.stderr: 62100K .......... .......... .......... .......... .......... 66% 120M 0s 2024-03-09T14:43:39.720 INFO:teuthology.orchestra.run.smithi088.stderr: 62150K .......... .......... .......... .......... .......... 66% 47.3M 0s 2024-03-09T14:43:39.720 INFO:teuthology.orchestra.run.smithi088.stderr: 62200K .......... .......... .......... .......... .......... 67% 115M 0s 2024-03-09T14:43:39.720 INFO:teuthology.orchestra.run.smithi088.stderr: 62250K .......... .......... .......... .......... .......... 67% 106M 0s 2024-03-09T14:43:39.720 INFO:teuthology.orchestra.run.smithi088.stderr: 62300K .......... .......... .......... .......... .......... 67% 118M 0s 2024-03-09T14:43:39.720 INFO:teuthology.orchestra.run.smithi088.stderr: 62350K .......... .......... .......... .......... .......... 67% 105M 0s 2024-03-09T14:43:39.720 INFO:teuthology.orchestra.run.smithi088.stderr: 62400K .......... .......... .......... .......... .......... 67% 32.2M 0s 2024-03-09T14:43:39.720 INFO:teuthology.orchestra.run.smithi088.stderr: 62450K .......... .......... .......... .......... .......... 67% 45.2M 0s 2024-03-09T14:43:39.721 INFO:teuthology.orchestra.run.smithi088.stderr: 62500K .......... .......... .......... .......... .......... 67% 37.6M 0s 2024-03-09T14:43:39.721 INFO:teuthology.orchestra.run.smithi088.stderr: 62550K .......... .......... .......... .......... .......... 67% 115M 0s 2024-03-09T14:43:39.721 INFO:teuthology.orchestra.run.smithi088.stderr: 62600K .......... .......... .......... .......... .......... 67% 62.6M 0s 2024-03-09T14:43:39.721 INFO:teuthology.orchestra.run.smithi088.stderr: 62650K .......... .......... .......... .......... .......... 67% 31.3M 0s 2024-03-09T14:43:39.721 INFO:teuthology.orchestra.run.smithi088.stderr: 62700K .......... .......... .......... .......... .......... 67% 51.4M 0s 2024-03-09T14:43:39.721 INFO:teuthology.orchestra.run.smithi088.stderr: 62750K .......... .......... .......... .......... .......... 67% 119M 0s 2024-03-09T14:43:39.721 INFO:teuthology.orchestra.run.smithi088.stderr: 62800K .......... .......... .......... .......... .......... 67% 48.9M 0s 2024-03-09T14:43:39.721 INFO:teuthology.orchestra.run.smithi088.stderr: 62850K .......... .......... .......... .......... .......... 67% 29.1M 0s 2024-03-09T14:43:39.721 INFO:teuthology.orchestra.run.smithi088.stderr: 62900K .......... .......... .......... .......... .......... 67% 50.1M 0s 2024-03-09T14:43:39.721 INFO:teuthology.orchestra.run.smithi088.stderr: 62950K .......... .......... .......... .......... .......... 67% 118M 0s 2024-03-09T14:43:39.721 INFO:teuthology.orchestra.run.smithi088.stderr: 63000K .......... .......... .......... .......... .......... 67% 115M 0s 2024-03-09T14:43:39.721 INFO:teuthology.orchestra.run.smithi088.stderr: 63050K .......... .......... .......... .......... .......... 67% 41.7M 0s 2024-03-09T14:43:39.721 INFO:teuthology.orchestra.run.smithi088.stderr: 63100K .......... .......... .......... .......... .......... 67% 62.2M 0s 2024-03-09T14:43:39.721 INFO:teuthology.orchestra.run.smithi088.stderr: 63150K .......... .......... .......... .......... .......... 68% 107M 0s 2024-03-09T14:43:39.721 INFO:teuthology.orchestra.run.smithi088.stderr: 63200K .......... .......... .......... .......... .......... 68% 117M 0s 2024-03-09T14:43:39.722 INFO:teuthology.orchestra.run.smithi088.stderr: 63250K .......... .......... .......... .......... .......... 68% 44.0M 0s 2024-03-09T14:43:39.722 INFO:teuthology.orchestra.run.smithi088.stderr: 63300K .......... .......... .......... .......... .......... 68% 115M 0s 2024-03-09T14:43:39.722 INFO:teuthology.orchestra.run.smithi088.stderr: 63350K .......... .......... .......... .......... .......... 68% 50.6M 0s 2024-03-09T14:43:39.722 INFO:teuthology.orchestra.run.smithi088.stderr: 63400K .......... .......... .......... .......... .......... 68% 39.0M 0s 2024-03-09T14:43:39.722 INFO:teuthology.orchestra.run.smithi088.stderr: 63450K .......... .......... .......... .......... .......... 68% 126M 0s 2024-03-09T14:43:39.722 INFO:teuthology.orchestra.run.smithi088.stderr: 63500K .......... .......... .......... .......... .......... 68% 113M 0s 2024-03-09T14:43:39.722 INFO:teuthology.orchestra.run.smithi088.stderr: 63550K .......... .......... .......... .......... .......... 68% 66.2M 0s 2024-03-09T14:43:39.722 INFO:teuthology.orchestra.run.smithi088.stderr: 63600K .......... .......... .......... .......... .......... 68% 49.5M 0s 2024-03-09T14:43:39.722 INFO:teuthology.orchestra.run.smithi088.stderr: 63650K .......... .......... .......... .......... .......... 68% 86.6M 0s 2024-03-09T14:43:39.722 INFO:teuthology.orchestra.run.smithi088.stderr: 63700K .......... .......... .......... .......... .......... 68% 126M 0s 2024-03-09T14:43:39.722 INFO:teuthology.orchestra.run.smithi088.stderr: 63750K .......... .......... .......... .......... .......... 68% 37.2M 0s 2024-03-09T14:43:39.722 INFO:teuthology.orchestra.run.smithi088.stderr: 63800K .......... .......... .......... .......... .......... 68% 73.4M 0s 2024-03-09T14:43:39.722 INFO:teuthology.orchestra.run.smithi088.stderr: 63850K .......... .......... .......... .......... .......... 68% 47.5M 0s 2024-03-09T14:43:39.723 INFO:teuthology.orchestra.run.smithi088.stderr: 63900K .......... .......... .......... .......... .......... 68% 124M 0s 2024-03-09T14:43:39.723 INFO:teuthology.orchestra.run.smithi088.stderr: 63950K .......... .......... .......... .......... .......... 68% 112M 0s 2024-03-09T14:43:39.723 INFO:teuthology.orchestra.run.smithi088.stderr: 64000K .......... .......... .......... .......... .......... 68% 49.7M 0s 2024-03-09T14:43:39.723 INFO:teuthology.orchestra.run.smithi088.stderr: 64050K .......... .......... .......... .......... .......... 68% 47.8M 0s 2024-03-09T14:43:39.723 INFO:teuthology.orchestra.run.smithi088.stderr: 64100K .......... .......... .......... .......... .......... 69% 99.1M 0s 2024-03-09T14:43:39.723 INFO:teuthology.orchestra.run.smithi088.stderr: 64150K .......... .......... .......... .......... .......... 69% 108M 0s 2024-03-09T14:43:39.723 INFO:teuthology.orchestra.run.smithi088.stderr: 64200K .......... .......... .......... .......... .......... 69% 48.2M 0s 2024-03-09T14:43:39.723 INFO:teuthology.orchestra.run.smithi088.stderr: 64250K .......... .......... .......... .......... .......... 69% 123M 0s 2024-03-09T14:43:39.723 INFO:teuthology.orchestra.run.smithi088.stderr: 64300K .......... .......... .......... .......... .......... 69% 50.3M 0s 2024-03-09T14:43:39.723 INFO:teuthology.orchestra.run.smithi088.stderr: 64350K .......... .......... .......... .......... .......... 69% 117M 0s 2024-03-09T14:43:39.723 INFO:teuthology.orchestra.run.smithi088.stderr: 64400K .......... .......... .......... .......... .......... 69% 115M 0s 2024-03-09T14:43:39.723 INFO:teuthology.orchestra.run.smithi088.stderr: 64450K .......... .......... .......... .......... .......... 69% 86.2M 0s 2024-03-09T14:43:39.723 INFO:teuthology.orchestra.run.smithi088.stderr: 64500K .......... .......... .......... .......... .......... 69% 32.4M 0s 2024-03-09T14:43:39.723 INFO:teuthology.orchestra.run.smithi088.stderr: 64550K .......... .......... .......... .......... .......... 69% 65.6M 0s 2024-03-09T14:43:39.723 INFO:teuthology.orchestra.run.smithi088.stderr: 64600K .......... .......... .......... .......... .......... 69% 71.9M 0s 2024-03-09T14:43:39.724 INFO:teuthology.orchestra.run.smithi088.stderr: 64650K .......... .......... .......... .......... .......... 69% 114M 0s 2024-03-09T14:43:39.724 INFO:teuthology.orchestra.run.smithi088.stderr: 64700K .......... .......... .......... .......... .......... 69% 49.9M 0s 2024-03-09T14:43:39.724 INFO:teuthology.orchestra.run.smithi088.stderr: 64750K .......... .......... .......... .......... .......... 69% 116M 0s 2024-03-09T14:43:39.724 INFO:teuthology.orchestra.run.smithi088.stderr: 64800K .......... .......... .......... .......... .......... 69% 49.4M 0s 2024-03-09T14:43:39.724 INFO:teuthology.orchestra.run.smithi088.stderr: 64850K .......... .......... .......... .......... .......... 69% 87.1M 0s 2024-03-09T14:43:39.724 INFO:teuthology.orchestra.run.smithi088.stderr: 64900K .......... .......... .......... .......... .......... 69% 114M 0s 2024-03-09T14:43:39.724 INFO:teuthology.orchestra.run.smithi088.stderr: 64950K .......... .......... .......... .......... .......... 69% 49.6M 0s 2024-03-09T14:43:39.724 INFO:teuthology.orchestra.run.smithi088.stderr: 65000K .......... .......... .......... .......... .......... 70% 49.3M 0s 2024-03-09T14:43:39.724 INFO:teuthology.orchestra.run.smithi088.stderr: 65050K .......... .......... .......... .......... .......... 70% 48.9M 0s 2024-03-09T14:43:39.724 INFO:teuthology.orchestra.run.smithi088.stderr: 65100K .......... .......... .......... .......... .......... 70% 116M 0s 2024-03-09T14:43:39.724 INFO:teuthology.orchestra.run.smithi088.stderr: 65150K .......... .......... .......... .......... .......... 70% 115M 0s 2024-03-09T14:43:39.724 INFO:teuthology.orchestra.run.smithi088.stderr: 65200K .......... .......... .......... .......... .......... 70% 32.4M 0s 2024-03-09T14:43:39.724 INFO:teuthology.orchestra.run.smithi088.stderr: 65250K .......... .......... .......... .......... .......... 70% 87.7M 0s 2024-03-09T14:43:39.724 INFO:teuthology.orchestra.run.smithi088.stderr: 65300K .......... .......... .......... .......... .......... 70% 52.4M 0s 2024-03-09T14:43:39.724 INFO:teuthology.orchestra.run.smithi088.stderr: 65350K .......... .......... .......... .......... .......... 70% 107M 0s 2024-03-09T14:43:39.725 INFO:teuthology.orchestra.run.smithi088.stderr: 65400K .......... .......... .......... .......... .......... 70% 50.6M 0s 2024-03-09T14:43:39.725 INFO:teuthology.orchestra.run.smithi088.stderr: 65450K .......... .......... .......... .......... .......... 70% 48.6M 0s 2024-03-09T14:43:39.725 INFO:teuthology.orchestra.run.smithi088.stderr: 65500K .......... .......... .......... .......... .......... 70% 50.1M 0s 2024-03-09T14:43:39.725 INFO:teuthology.orchestra.run.smithi088.stderr: 65550K .......... .......... .......... .......... .......... 70% 120M 0s 2024-03-09T14:43:39.725 INFO:teuthology.orchestra.run.smithi088.stderr: 65600K .......... .......... .......... .......... .......... 70% 31.3M 0s 2024-03-09T14:43:39.725 INFO:teuthology.orchestra.run.smithi088.stderr: 65650K .......... .......... .......... .......... .......... 70% 46.6M 0s 2024-03-09T14:43:39.725 INFO:teuthology.orchestra.run.smithi088.stderr: 65700K .......... .......... .......... .......... .......... 70% 49.7M 0s 2024-03-09T14:43:39.725 INFO:teuthology.orchestra.run.smithi088.stderr: 65750K .......... .......... .......... .......... .......... 70% 49.1M 0s 2024-03-09T14:43:39.725 INFO:teuthology.orchestra.run.smithi088.stderr: 65800K .......... .......... .......... .......... .......... 70% 125M 0s 2024-03-09T14:43:39.725 INFO:teuthology.orchestra.run.smithi088.stderr: 65850K .......... .......... .......... .......... .......... 70% 49.0M 0s 2024-03-09T14:43:39.725 INFO:teuthology.orchestra.run.smithi088.stderr: 65900K .......... .......... .......... .......... .......... 70% 122M 0s 2024-03-09T14:43:39.725 INFO:teuthology.orchestra.run.smithi088.stderr: 65950K .......... .......... .......... .......... .......... 71% 50.1M 0s 2024-03-09T14:43:39.725 INFO:teuthology.orchestra.run.smithi088.stderr: 66000K .......... .......... .......... .......... .......... 71% 112M 0s 2024-03-09T14:43:39.725 INFO:teuthology.orchestra.run.smithi088.stderr: 66050K .......... .......... .......... .......... .......... 71% 45.6M 0s 2024-03-09T14:43:39.725 INFO:teuthology.orchestra.run.smithi088.stderr: 66100K .......... .......... .......... .......... .......... 71% 49.6M 0s 2024-03-09T14:43:39.726 INFO:teuthology.orchestra.run.smithi088.stderr: 66150K .......... .......... .......... .......... .......... 71% 111M 0s 2024-03-09T14:43:39.726 INFO:teuthology.orchestra.run.smithi088.stderr: 66200K .......... .......... .......... .......... .......... 71% 121M 0s 2024-03-09T14:43:39.726 INFO:teuthology.orchestra.run.smithi088.stderr: 66250K .......... .......... .......... .......... .......... 71% 111M 0s 2024-03-09T14:43:39.726 INFO:teuthology.orchestra.run.smithi088.stderr: 66300K .......... .......... .......... .......... .......... 71% 50.1M 0s 2024-03-09T14:43:39.726 INFO:teuthology.orchestra.run.smithi088.stderr: 66350K .......... .......... .......... .......... .......... 71% 50.2M 0s 2024-03-09T14:43:39.726 INFO:teuthology.orchestra.run.smithi088.stderr: 66400K .......... .......... .......... .......... .......... 71% 51.3M 0s 2024-03-09T14:43:39.726 INFO:teuthology.orchestra.run.smithi088.stderr: 66450K .......... .......... .......... .......... .......... 71% 87.7M 0s 2024-03-09T14:43:39.726 INFO:teuthology.orchestra.run.smithi088.stderr: 66500K .......... .......... .......... .......... .......... 71% 117M 0s 2024-03-09T14:43:39.726 INFO:teuthology.orchestra.run.smithi088.stderr: 66550K .......... .......... .......... .......... .......... 71% 50.0M 0s 2024-03-09T14:43:39.726 INFO:teuthology.orchestra.run.smithi088.stderr: 66600K .......... .......... .......... .......... .......... 71% 120M 0s 2024-03-09T14:43:39.726 INFO:teuthology.orchestra.run.smithi088.stderr: 66650K .......... .......... .......... .......... .......... 71% 48.8M 0s 2024-03-09T14:43:39.726 INFO:teuthology.orchestra.run.smithi088.stderr: 66700K .......... .......... .......... .......... .......... 71% 115M 0s 2024-03-09T14:43:39.726 INFO:teuthology.orchestra.run.smithi088.stderr: 66750K .......... .......... .......... .......... .......... 71% 51.3M 0s 2024-03-09T14:43:39.726 INFO:teuthology.orchestra.run.smithi088.stderr: 66800K .......... .......... .......... .......... .......... 71% 49.3M 0s 2024-03-09T14:43:39.726 INFO:teuthology.orchestra.run.smithi088.stderr: 66850K .......... .......... .......... .......... .......... 72% 83.0M 0s 2024-03-09T14:43:39.727 INFO:teuthology.orchestra.run.smithi088.stderr: 66900K .......... .......... .......... .......... .......... 72% 43.4M 0s 2024-03-09T14:43:39.727 INFO:teuthology.orchestra.run.smithi088.stderr: 66950K .......... .......... .......... .......... .......... 72% 117M 0s 2024-03-09T14:43:39.727 INFO:teuthology.orchestra.run.smithi088.stderr: 67000K .......... .......... .......... .......... .......... 72% 112M 0s 2024-03-09T14:43:39.727 INFO:teuthology.orchestra.run.smithi088.stderr: 67050K .......... .......... .......... .......... .......... 72% 109M 0s 2024-03-09T14:43:39.727 INFO:teuthology.orchestra.run.smithi088.stderr: 67100K .......... .......... .......... .......... .......... 72% 35.7M 0s 2024-03-09T14:43:39.727 INFO:teuthology.orchestra.run.smithi088.stderr: 67150K .......... .......... .......... .......... .......... 72% 115M 0s 2024-03-09T14:43:39.727 INFO:teuthology.orchestra.run.smithi088.stderr: 67200K .......... .......... .......... .......... .......... 72% 120M 0s 2024-03-09T14:43:39.727 INFO:teuthology.orchestra.run.smithi088.stderr: 67250K .......... .......... .......... .......... .......... 72% 44.7M 0s 2024-03-09T14:43:39.727 INFO:teuthology.orchestra.run.smithi088.stderr: 67300K .......... .......... .......... .......... .......... 72% 112M 0s 2024-03-09T14:43:39.727 INFO:teuthology.orchestra.run.smithi088.stderr: 67350K .......... .......... .......... .......... .......... 72% 50.7M 0s 2024-03-09T14:43:39.727 INFO:teuthology.orchestra.run.smithi088.stderr: 67400K .......... .......... .......... .......... .......... 72% 49.5M 0s 2024-03-09T14:43:39.727 INFO:teuthology.orchestra.run.smithi088.stderr: 67450K .......... .......... .......... .......... .......... 72% 115M 0s 2024-03-09T14:43:39.727 INFO:teuthology.orchestra.run.smithi088.stderr: 67500K .......... .......... .......... .......... .......... 72% 113M 0s 2024-03-09T14:43:39.727 INFO:teuthology.orchestra.run.smithi088.stderr: 67550K .......... .......... .......... .......... .......... 72% 51.2M 0s 2024-03-09T14:43:39.727 INFO:teuthology.orchestra.run.smithi088.stderr: 67600K .......... .......... .......... .......... .......... 72% 50.1M 0s 2024-03-09T14:43:39.728 INFO:teuthology.orchestra.run.smithi088.stderr: 67650K .......... .......... .......... .......... .......... 72% 89.7M 0s 2024-03-09T14:43:39.728 INFO:teuthology.orchestra.run.smithi088.stderr: 67700K .......... .......... .......... .......... .......... 72% 117M 0s 2024-03-09T14:43:39.728 INFO:teuthology.orchestra.run.smithi088.stderr: 67750K .......... .......... .......... .......... .......... 72% 48.7M 0s 2024-03-09T14:43:39.728 INFO:teuthology.orchestra.run.smithi088.stderr: 67800K .......... .......... .......... .......... .......... 73% 119M 0s 2024-03-09T14:43:39.728 INFO:teuthology.orchestra.run.smithi088.stderr: 67850K .......... .......... .......... .......... .......... 73% 32.1M 0s 2024-03-09T14:43:39.728 INFO:teuthology.orchestra.run.smithi088.stderr: 67900K .......... .......... .......... .......... .......... 73% 113M 0s 2024-03-09T14:43:39.728 INFO:teuthology.orchestra.run.smithi088.stderr: 67950K .......... .......... .......... .......... .......... 73% 114M 0s 2024-03-09T14:43:39.728 INFO:teuthology.orchestra.run.smithi088.stderr: 68000K .......... .......... .......... .......... .......... 73% 51.0M 0s 2024-03-09T14:43:39.728 INFO:teuthology.orchestra.run.smithi088.stderr: 68050K .......... .......... .......... .......... .......... 73% 44.5M 0s 2024-03-09T14:43:39.728 INFO:teuthology.orchestra.run.smithi088.stderr: 68100K .......... .......... .......... .......... .......... 73% 115M 0s 2024-03-09T14:43:39.728 INFO:teuthology.orchestra.run.smithi088.stderr: 68150K .......... .......... .......... .......... .......... 73% 117M 0s 2024-03-09T14:43:39.728 INFO:teuthology.orchestra.run.smithi088.stderr: 68200K .......... .......... .......... .......... .......... 73% 31.3M 0s 2024-03-09T14:43:39.728 INFO:teuthology.orchestra.run.smithi088.stderr: 68250K .......... .......... .......... .......... .......... 73% 60.5M 0s 2024-03-09T14:43:39.728 INFO:teuthology.orchestra.run.smithi088.stderr: 68300K .......... .......... .......... .......... .......... 73% 41.9M 0s 2024-03-09T14:43:39.728 INFO:teuthology.orchestra.run.smithi088.stderr: 68350K .......... .......... .......... .......... .......... 73% 117M 0s 2024-03-09T14:43:39.729 INFO:teuthology.orchestra.run.smithi088.stderr: 68400K .......... .......... .......... .......... .......... 73% 49.0M 0s 2024-03-09T14:43:39.729 INFO:teuthology.orchestra.run.smithi088.stderr: 68450K .......... .......... .......... .......... .......... 73% 43.6M 0s 2024-03-09T14:43:39.729 INFO:teuthology.orchestra.run.smithi088.stderr: 68500K .......... .......... .......... .......... .......... 73% 50.9M 0s 2024-03-09T14:43:39.729 INFO:teuthology.orchestra.run.smithi088.stderr: 68550K .......... .......... .......... .......... .......... 73% 48.1M 0s 2024-03-09T14:43:39.729 INFO:teuthology.orchestra.run.smithi088.stderr: 68600K .......... .......... .......... .......... .......... 73% 117M 0s 2024-03-09T14:43:39.729 INFO:teuthology.orchestra.run.smithi088.stderr: 68650K .......... .......... .......... .......... .......... 73% 49.3M 0s 2024-03-09T14:43:39.729 INFO:teuthology.orchestra.run.smithi088.stderr: 68700K .......... .......... .......... .......... .......... 74% 47.3M 0s 2024-03-09T14:43:39.729 INFO:teuthology.orchestra.run.smithi088.stderr: 68750K .......... .......... .......... .......... .......... 74% 48.7M 0s 2024-03-09T14:43:39.729 INFO:teuthology.orchestra.run.smithi088.stderr: 68800K .......... .......... .......... .......... .......... 74% 116M 0s 2024-03-09T14:43:39.729 INFO:teuthology.orchestra.run.smithi088.stderr: 68850K .......... .......... .......... .......... .......... 74% 82.0M 0s 2024-03-09T14:43:39.729 INFO:teuthology.orchestra.run.smithi088.stderr: 68900K .......... .......... .......... .......... .......... 74% 96.4M 0s 2024-03-09T14:43:39.729 INFO:teuthology.orchestra.run.smithi088.stderr: 68950K .......... .......... .......... .......... .......... 74% 40.2M 0s 2024-03-09T14:43:39.729 INFO:teuthology.orchestra.run.smithi088.stderr: 69000K .......... .......... .......... .......... .......... 74% 45.7M 0s 2024-03-09T14:43:39.729 INFO:teuthology.orchestra.run.smithi088.stderr: 69050K .......... .......... .......... .......... .......... 74% 71.4M 0s 2024-03-09T14:43:39.729 INFO:teuthology.orchestra.run.smithi088.stderr: 69100K .......... .......... .......... .......... .......... 74% 78.7M 0s 2024-03-09T14:43:39.730 INFO:teuthology.orchestra.run.smithi088.stderr: 69150K .......... .......... .......... .......... .......... 74% 126M 0s 2024-03-09T14:43:39.730 INFO:teuthology.orchestra.run.smithi088.stderr: 69200K .......... .......... .......... .......... .......... 74% 39.1M 0s 2024-03-09T14:43:39.730 INFO:teuthology.orchestra.run.smithi088.stderr: 69250K .......... .......... .......... .......... .......... 74% 83.4M 0s 2024-03-09T14:43:39.730 INFO:teuthology.orchestra.run.smithi088.stderr: 69300K .......... .......... .......... .......... .......... 74% 124M 0s 2024-03-09T14:43:39.730 INFO:teuthology.orchestra.run.smithi088.stderr: 69350K .......... .......... .......... .......... .......... 74% 60.1M 0s 2024-03-09T14:43:39.730 INFO:teuthology.orchestra.run.smithi088.stderr: 69400K .......... .......... .......... .......... .......... 74% 48.8M 0s 2024-03-09T14:43:39.730 INFO:teuthology.orchestra.run.smithi088.stderr: 69450K .......... .......... .......... .......... .......... 74% 47.0M 0s 2024-03-09T14:43:39.730 INFO:teuthology.orchestra.run.smithi088.stderr: 69500K .......... .......... .......... .......... .......... 74% 126M 0s 2024-03-09T14:43:39.730 INFO:teuthology.orchestra.run.smithi088.stderr: 69550K .......... .......... .......... .......... .......... 74% 55.5M 0s 2024-03-09T14:43:39.730 INFO:teuthology.orchestra.run.smithi088.stderr: 69600K .......... .......... .......... .......... .......... 74% 135M 0s 2024-03-09T14:43:39.730 INFO:teuthology.orchestra.run.smithi088.stderr: 69650K .......... .......... .......... .......... .......... 75% 78.5M 0s 2024-03-09T14:43:39.730 INFO:teuthology.orchestra.run.smithi088.stderr: 69700K .......... .......... .......... .......... .......... 75% 56.2M 0s 2024-03-09T14:43:39.730 INFO:teuthology.orchestra.run.smithi088.stderr: 69750K .......... .......... .......... .......... .......... 75% 49.3M 0s 2024-03-09T14:43:39.730 INFO:teuthology.orchestra.run.smithi088.stderr: 69800K .......... .......... .......... .......... .......... 75% 120M 0s 2024-03-09T14:43:39.730 INFO:teuthology.orchestra.run.smithi088.stderr: 69850K .......... .......... .......... .......... .......... 75% 102M 0s 2024-03-09T14:43:39.731 INFO:teuthology.orchestra.run.smithi088.stderr: 69900K .......... .......... .......... .......... .......... 75% 47.4M 0s 2024-03-09T14:43:39.731 INFO:teuthology.orchestra.run.smithi088.stderr: 69950K .......... .......... .......... .......... .......... 75% 110M 0s 2024-03-09T14:43:39.731 INFO:teuthology.orchestra.run.smithi088.stderr: 70000K .......... .......... .......... .......... .......... 75% 121M 0s 2024-03-09T14:43:39.731 INFO:teuthology.orchestra.run.smithi088.stderr: 70050K .......... .......... .......... .......... .......... 75% 44.1M 0s 2024-03-09T14:43:39.731 INFO:teuthology.orchestra.run.smithi088.stderr: 70100K .......... .......... .......... .......... .......... 75% 47.7M 0s 2024-03-09T14:43:39.731 INFO:teuthology.orchestra.run.smithi088.stderr: 70150K .......... .......... .......... .......... .......... 75% 111M 0s 2024-03-09T14:43:39.731 INFO:teuthology.orchestra.run.smithi088.stderr: 70200K .......... .......... .......... .......... .......... 75% 48.8M 0s 2024-03-09T14:43:39.731 INFO:teuthology.orchestra.run.smithi088.stderr: 70250K .......... .......... .......... .......... .......... 75% 108M 0s 2024-03-09T14:43:39.731 INFO:teuthology.orchestra.run.smithi088.stderr: 70300K .......... .......... .......... .......... .......... 75% 49.9M 0s 2024-03-09T14:43:39.731 INFO:teuthology.orchestra.run.smithi088.stderr: 70350K .......... .......... .......... .......... .......... 75% 108M 0s 2024-03-09T14:43:39.731 INFO:teuthology.orchestra.run.smithi088.stderr: 70400K .......... .......... .......... .......... .......... 75% 50.8M 0s 2024-03-09T14:43:39.731 INFO:teuthology.orchestra.run.smithi088.stderr: 70450K .......... .......... .......... .......... .......... 75% 82.1M 0s 2024-03-09T14:43:39.731 INFO:teuthology.orchestra.run.smithi088.stderr: 70500K .......... .......... .......... .......... .......... 75% 118M 0s 2024-03-09T14:43:39.731 INFO:teuthology.orchestra.run.smithi088.stderr: 70550K .......... .......... .......... .......... .......... 75% 32.6M 0s 2024-03-09T14:43:39.731 INFO:teuthology.orchestra.run.smithi088.stderr: 70600K .......... .......... .......... .......... .......... 76% 86.3M 0s 2024-03-09T14:43:39.732 INFO:teuthology.orchestra.run.smithi088.stderr: 70650K .......... .......... .......... .......... .......... 76% 47.7M 0s 2024-03-09T14:43:39.732 INFO:teuthology.orchestra.run.smithi088.stderr: 70700K .......... .......... .......... .......... .......... 76% 110M 0s 2024-03-09T14:43:39.732 INFO:teuthology.orchestra.run.smithi088.stderr: 70750K .......... .......... .......... .......... .......... 76% 50.0M 0s 2024-03-09T14:43:39.732 INFO:teuthology.orchestra.run.smithi088.stderr: 70800K .......... .......... .......... .......... .......... 76% 115M 0s 2024-03-09T14:43:39.732 INFO:teuthology.orchestra.run.smithi088.stderr: 70850K .......... .......... .......... .......... .......... 76% 29.2M 0s 2024-03-09T14:43:39.732 INFO:teuthology.orchestra.run.smithi088.stderr: 70900K .......... .......... .......... .......... .......... 76% 121M 0s 2024-03-09T14:43:39.732 INFO:teuthology.orchestra.run.smithi088.stderr: 70950K .......... .......... .......... .......... .......... 76% 117M 0s 2024-03-09T14:43:39.732 INFO:teuthology.orchestra.run.smithi088.stderr: 71000K .......... .......... .......... .......... .......... 76% 51.4M 0s 2024-03-09T14:43:39.732 INFO:teuthology.orchestra.run.smithi088.stderr: 71050K .......... .......... .......... .......... .......... 76% 48.8M 0s 2024-03-09T14:43:39.732 INFO:teuthology.orchestra.run.smithi088.stderr: 71100K .......... .......... .......... .......... .......... 76% 46.6M 0s 2024-03-09T14:43:39.732 INFO:teuthology.orchestra.run.smithi088.stderr: 71150K .......... .......... .......... .......... .......... 76% 118M 0s 2024-03-09T14:43:39.732 INFO:teuthology.orchestra.run.smithi088.stderr: 71200K .......... .......... .......... .......... .......... 76% 51.9M 0s 2024-03-09T14:43:39.732 INFO:teuthology.orchestra.run.smithi088.stderr: 71250K .......... .......... .......... .......... .......... 76% 44.1M 0s 2024-03-09T14:43:39.732 INFO:teuthology.orchestra.run.smithi088.stderr: 71300K .......... .......... .......... .......... .......... 76% 50.2M 0s 2024-03-09T14:43:39.732 INFO:teuthology.orchestra.run.smithi088.stderr: 71350K .......... .......... .......... .......... .......... 76% 50.1M 0s 2024-03-09T14:43:39.733 INFO:teuthology.orchestra.run.smithi088.stderr: 71400K .......... .......... .......... .......... .......... 76% 112M 0s 2024-03-09T14:43:39.733 INFO:teuthology.orchestra.run.smithi088.stderr: 71450K .......... .......... .......... .......... .......... 76% 33.5M 0s 2024-03-09T14:43:39.733 INFO:teuthology.orchestra.run.smithi088.stderr: 71500K .......... .......... .......... .......... .......... 77% 50.5M 0s 2024-03-09T14:43:39.733 INFO:teuthology.orchestra.run.smithi088.stderr: 71550K .......... .......... .......... .......... .......... 77% 115M 0s 2024-03-09T14:43:39.733 INFO:teuthology.orchestra.run.smithi088.stderr: 71600K .......... .......... .......... .......... .......... 77% 113M 0s 2024-03-09T14:43:39.733 INFO:teuthology.orchestra.run.smithi088.stderr: 71650K .......... .......... .......... .......... .......... 77% 42.6M 0s 2024-03-09T14:43:39.733 INFO:teuthology.orchestra.run.smithi088.stderr: 71700K .......... .......... .......... .......... .......... 77% 50.7M 0s 2024-03-09T14:43:39.733 INFO:teuthology.orchestra.run.smithi088.stderr: 71750K .......... .......... .......... .......... .......... 77% 52.3M 0s 2024-03-09T14:43:39.733 INFO:teuthology.orchestra.run.smithi088.stderr: 71800K .......... .......... .......... .......... .......... 77% 108M 0s 2024-03-09T14:43:39.733 INFO:teuthology.orchestra.run.smithi088.stderr: 71850K .......... .......... .......... .......... .......... 77% 110M 0s 2024-03-09T14:43:39.733 INFO:teuthology.orchestra.run.smithi088.stderr: 71900K .......... .......... .......... .......... .......... 77% 101M 0s 2024-03-09T14:43:39.733 INFO:teuthology.orchestra.run.smithi088.stderr: 71950K .......... .......... .......... .......... .......... 77% 45.3M 0s 2024-03-09T14:43:39.733 INFO:teuthology.orchestra.run.smithi088.stderr: 72000K .......... .......... .......... .......... .......... 77% 49.3M 0s 2024-03-09T14:43:39.733 INFO:teuthology.orchestra.run.smithi088.stderr: 72050K .......... .......... .......... .......... .......... 77% 56.3M 0s 2024-03-09T14:43:39.733 INFO:teuthology.orchestra.run.smithi088.stderr: 72100K .......... .......... .......... .......... .......... 77% 115M 0s 2024-03-09T14:43:39.734 INFO:teuthology.orchestra.run.smithi088.stderr: 72150K .......... .......... .......... .......... .......... 77% 73.3M 0s 2024-03-09T14:43:39.734 INFO:teuthology.orchestra.run.smithi088.stderr: 72200K .......... .......... .......... .......... .......... 77% 48.4M 0s 2024-03-09T14:43:39.734 INFO:teuthology.orchestra.run.smithi088.stderr: 72250K .......... .......... .......... .......... .......... 77% 79.3M 0s 2024-03-09T14:43:39.734 INFO:teuthology.orchestra.run.smithi088.stderr: 72300K .......... .......... .......... .......... .......... 77% 111M 0s 2024-03-09T14:43:39.734 INFO:teuthology.orchestra.run.smithi088.stderr: 72350K .......... .......... .......... .......... .......... 77% 104M 0s 2024-03-09T14:43:39.734 INFO:teuthology.orchestra.run.smithi088.stderr: 72400K .......... .......... .......... .......... .......... 77% 83.9M 0s 2024-03-09T14:43:39.734 INFO:teuthology.orchestra.run.smithi088.stderr: 72450K .......... .......... .......... .......... .......... 78% 34.7M 0s 2024-03-09T14:43:39.734 INFO:teuthology.orchestra.run.smithi088.stderr: 72500K .......... .......... .......... .......... .......... 78% 102M 0s 2024-03-09T14:43:39.734 INFO:teuthology.orchestra.run.smithi088.stderr: 72550K .......... .......... .......... .......... .......... 78% 51.3M 0s 2024-03-09T14:43:39.734 INFO:teuthology.orchestra.run.smithi088.stderr: 72600K .......... .......... .......... .......... .......... 78% 118M 0s 2024-03-09T14:43:39.734 INFO:teuthology.orchestra.run.smithi088.stderr: 72650K .......... .......... .......... .......... .......... 78% 108M 0s 2024-03-09T14:43:39.734 INFO:teuthology.orchestra.run.smithi088.stderr: 72700K .......... .......... .......... .......... .......... 78% 50.4M 0s 2024-03-09T14:43:39.734 INFO:teuthology.orchestra.run.smithi088.stderr: 72750K .......... .......... .......... .......... .......... 78% 48.7M 0s 2024-03-09T14:43:39.734 INFO:teuthology.orchestra.run.smithi088.stderr: 72800K .......... .......... .......... .......... .......... 78% 111M 0s 2024-03-09T14:43:39.734 INFO:teuthology.orchestra.run.smithi088.stderr: 72850K .......... .......... .......... .......... .......... 78% 88.2M 0s 2024-03-09T14:43:39.735 INFO:teuthology.orchestra.run.smithi088.stderr: 72900K .......... .......... .......... .......... .......... 78% 49.7M 0s 2024-03-09T14:43:39.735 INFO:teuthology.orchestra.run.smithi088.stderr: 72950K .......... .......... .......... .......... .......... 78% 97.5M 0s 2024-03-09T14:43:39.735 INFO:teuthology.orchestra.run.smithi088.stderr: 73000K .......... .......... .......... .......... .......... 78% 52.3M 0s 2024-03-09T14:43:39.735 INFO:teuthology.orchestra.run.smithi088.stderr: 73050K .......... .......... .......... .......... .......... 78% 114M 0s 2024-03-09T14:43:39.735 INFO:teuthology.orchestra.run.smithi088.stderr: 73100K .......... .......... .......... .......... .......... 78% 48.8M 0s 2024-03-09T14:43:39.735 INFO:teuthology.orchestra.run.smithi088.stderr: 73150K .......... .......... .......... .......... .......... 78% 118M 0s 2024-03-09T14:43:39.735 INFO:teuthology.orchestra.run.smithi088.stderr: 73200K .......... .......... .......... .......... .......... 78% 46.1M 0s 2024-03-09T14:43:39.735 INFO:teuthology.orchestra.run.smithi088.stderr: 73250K .......... .......... .......... .......... .......... 78% 42.6M 0s 2024-03-09T14:43:39.735 INFO:teuthology.orchestra.run.smithi088.stderr: 73300K .......... .......... .......... .......... .......... 78% 114M 0s 2024-03-09T14:43:39.735 INFO:teuthology.orchestra.run.smithi088.stderr: 73350K .......... .......... .......... .......... .......... 79% 114M 0s 2024-03-09T14:43:39.735 INFO:teuthology.orchestra.run.smithi088.stderr: 73400K .......... .......... .......... .......... .......... 79% 44.3M 0s 2024-03-09T14:43:39.735 INFO:teuthology.orchestra.run.smithi088.stderr: 73450K .......... .......... .......... .......... .......... 79% 118M 0s 2024-03-09T14:43:39.735 INFO:teuthology.orchestra.run.smithi088.stderr: 73500K .......... .......... .......... .......... .......... 79% 120M 0s 2024-03-09T14:43:39.735 INFO:teuthology.orchestra.run.smithi088.stderr: 73550K .......... .......... .......... .......... .......... 79% 32.4M 0s 2024-03-09T14:43:39.735 INFO:teuthology.orchestra.run.smithi088.stderr: 73600K .......... .......... .......... .......... .......... 79% 54.4M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 73650K .......... .......... .......... .......... .......... 79% 70.6M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 73700K .......... .......... .......... .......... .......... 79% 46.9M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 73750K .......... .......... .......... .......... .......... 79% 121M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 73800K .......... .......... .......... .......... .......... 79% 52.1M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 73850K .......... .......... .......... .......... .......... 79% 41.7M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 73900K .......... .......... .......... .......... .......... 79% 57.9M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 73950K .......... .......... .......... .......... .......... 79% 117M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 74000K .......... .......... .......... .......... .......... 79% 72.3M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 74050K .......... .......... .......... .......... .......... 79% 33.2M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 74100K .......... .......... .......... .......... .......... 79% 50.5M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 74150K .......... .......... .......... .......... .......... 79% 48.6M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 74200K .......... .......... .......... .......... .......... 79% 107M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 74250K .......... .......... .......... .......... .......... 79% 49.5M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 74300K .......... .......... .......... .......... .......... 80% 55.6M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 74350K .......... .......... .......... .......... .......... 80% 47.6M 0s 2024-03-09T14:43:39.736 INFO:teuthology.orchestra.run.smithi088.stderr: 74400K .......... .......... .......... .......... .......... 80% 114M 0s 2024-03-09T14:43:39.737 INFO:teuthology.orchestra.run.smithi088.stderr: 74450K .......... .......... .......... .......... .......... 80% 41.8M 0s 2024-03-09T14:43:39.737 INFO:teuthology.orchestra.run.smithi088.stderr: 74500K .......... .......... .......... .......... .......... 80% 57.9M 0s 2024-03-09T14:43:39.737 INFO:teuthology.orchestra.run.smithi088.stderr: 74550K .......... .......... .......... .......... .......... 80% 93.4M 0s 2024-03-09T14:43:39.737 INFO:teuthology.orchestra.run.smithi088.stderr: 74600K .......... .......... .......... .......... .......... 80% 52.6M 0s 2024-03-09T14:43:39.737 INFO:teuthology.orchestra.run.smithi088.stderr: 74650K .......... .......... .......... .......... .......... 80% 114M 0s 2024-03-09T14:43:39.737 INFO:teuthology.orchestra.run.smithi088.stderr: 74700K .......... .......... .......... .......... .......... 80% 63.3M 0s 2024-03-09T14:43:39.737 INFO:teuthology.orchestra.run.smithi088.stderr: 74750K .......... .......... .......... .......... .......... 80% 71.5M 0s 2024-03-09T14:43:39.737 INFO:teuthology.orchestra.run.smithi088.stderr: 74800K .......... .......... .......... .......... .......... 80% 113M 0s 2024-03-09T14:43:39.737 INFO:teuthology.orchestra.run.smithi088.stderr: 74850K .......... .......... .......... .......... .......... 80% 42.3M 0s 2024-03-09T14:43:39.737 INFO:teuthology.orchestra.run.smithi088.stderr: 74900K .......... .......... .......... .......... .......... 80% 127M 0s 2024-03-09T14:43:39.737 INFO:teuthology.orchestra.run.smithi088.stderr: 74950K .......... .......... .......... .......... .......... 80% 44.8M 0s 2024-03-09T14:43:39.737 INFO:teuthology.orchestra.run.smithi088.stderr: 75000K .......... .......... .......... .......... .......... 80% 101M 0s 2024-03-09T14:43:39.737 INFO:teuthology.orchestra.run.smithi088.stderr: 75050K .......... .......... .......... .......... .......... 80% 107M 0s 2024-03-09T14:43:39.737 INFO:teuthology.orchestra.run.smithi088.stderr: 75100K .......... .......... .......... .......... .......... 80% 54.5M 0s 2024-03-09T14:43:39.737 INFO:teuthology.orchestra.run.smithi088.stderr: 75150K .......... .......... .......... .......... .......... 80% 103M 0s 2024-03-09T14:43:39.738 INFO:teuthology.orchestra.run.smithi088.stderr: 75200K .......... .......... .......... .......... .......... 81% 52.7M 0s 2024-03-09T14:43:39.738 INFO:teuthology.orchestra.run.smithi088.stderr: 75250K .......... .......... .......... .......... .......... 81% 83.1M 0s 2024-03-09T14:43:39.738 INFO:teuthology.orchestra.run.smithi088.stderr: 75300K .......... .......... .......... .......... .......... 81% 106M 0s 2024-03-09T14:43:39.738 INFO:teuthology.orchestra.run.smithi088.stderr: 75350K .......... .......... .......... .......... .......... 81% 51.7M 0s 2024-03-09T14:43:39.738 INFO:teuthology.orchestra.run.smithi088.stderr: 75400K .......... .......... .......... .......... .......... 81% 118M 0s 2024-03-09T14:43:39.738 INFO:teuthology.orchestra.run.smithi088.stderr: 75450K .......... .......... .......... .......... .......... 81% 33.7M 0s 2024-03-09T14:43:39.738 INFO:teuthology.orchestra.run.smithi088.stderr: 75500K .......... .......... .......... .......... .......... 81% 129M 0s 2024-03-09T14:43:39.738 INFO:teuthology.orchestra.run.smithi088.stderr: 75550K .......... .......... .......... .......... .......... 81% 50.5M 0s 2024-03-09T14:43:39.738 INFO:teuthology.orchestra.run.smithi088.stderr: 75600K .......... .......... .......... .......... .......... 81% 106M 0s 2024-03-09T14:43:39.738 INFO:teuthology.orchestra.run.smithi088.stderr: 75650K .......... .......... .......... .......... .......... 81% 78.2M 0s 2024-03-09T14:43:39.738 INFO:teuthology.orchestra.run.smithi088.stderr: 75700K .......... .......... .......... .......... .......... 81% 56.2M 0s 2024-03-09T14:43:39.738 INFO:teuthology.orchestra.run.smithi088.stderr: 75750K .......... .......... .......... .......... .......... 81% 56.5M 0s 2024-03-09T14:43:39.738 INFO:teuthology.orchestra.run.smithi088.stderr: 75800K .......... .......... .......... .......... .......... 81% 112M 0s 2024-03-09T14:43:39.738 INFO:teuthology.orchestra.run.smithi088.stderr: 75850K .......... .......... .......... .......... .......... 81% 116M 0s 2024-03-09T14:43:39.738 INFO:teuthology.orchestra.run.smithi088.stderr: 75900K .......... .......... .......... .......... .......... 81% 37.3M 0s 2024-03-09T14:43:39.739 INFO:teuthology.orchestra.run.smithi088.stderr: 75950K .......... .......... .......... .......... .......... 81% 92.4M 0s 2024-03-09T14:43:39.739 INFO:teuthology.orchestra.run.smithi088.stderr: 76000K .......... .......... .......... .......... .......... 81% 54.1M 0s 2024-03-09T14:43:39.739 INFO:teuthology.orchestra.run.smithi088.stderr: 76050K .......... .......... .......... .......... .......... 81% 68.3M 0s 2024-03-09T14:43:39.739 INFO:teuthology.orchestra.run.smithi088.stderr: 76100K .......... .......... .......... .......... .......... 81% 80.6M 0s 2024-03-09T14:43:39.739 INFO:teuthology.orchestra.run.smithi088.stderr: 76150K .......... .......... .......... .......... .......... 82% 73.5M 0s 2024-03-09T14:43:39.739 INFO:teuthology.orchestra.run.smithi088.stderr: 76200K .......... .......... .......... .......... .......... 82% 49.3M 0s 2024-03-09T14:43:39.739 INFO:teuthology.orchestra.run.smithi088.stderr: 76250K .......... .......... .......... .......... .......... 82% 49.3M 0s 2024-03-09T14:43:39.739 INFO:teuthology.orchestra.run.smithi088.stderr: 76300K .......... .......... .......... .......... .......... 82% 121M 0s 2024-03-09T14:43:39.739 INFO:teuthology.orchestra.run.smithi088.stderr: 76350K .......... .......... .......... .......... .......... 82% 55.1M 0s 2024-03-09T14:43:39.739 INFO:teuthology.orchestra.run.smithi088.stderr: 76400K .......... .......... .......... .......... .......... 82% 97.2M 0s 2024-03-09T14:43:39.739 INFO:teuthology.orchestra.run.smithi088.stderr: 76450K .......... .......... .......... .......... .......... 82% 43.6M 0s 2024-03-09T14:43:39.739 INFO:teuthology.orchestra.run.smithi088.stderr: 76500K .......... .......... .......... .......... .......... 82% 50.1M 0s 2024-03-09T14:43:39.739 INFO:teuthology.orchestra.run.smithi088.stderr: 76550K .......... .......... .......... .......... .......... 82% 127M 0s 2024-03-09T14:43:39.739 INFO:teuthology.orchestra.run.smithi088.stderr: 76600K .......... .......... .......... .......... .......... 82% 44.8M 0s 2024-03-09T14:43:39.739 INFO:teuthology.orchestra.run.smithi088.stderr: 76650K .......... .......... .......... .......... .......... 82% 68.4M 0s 2024-03-09T14:43:39.740 INFO:teuthology.orchestra.run.smithi088.stderr: 76700K .......... .......... .......... .......... .......... 82% 63.6M 0s 2024-03-09T14:43:39.740 INFO:teuthology.orchestra.run.smithi088.stderr: 76750K .......... .......... .......... .......... .......... 82% 104M 0s 2024-03-09T14:43:39.740 INFO:teuthology.orchestra.run.smithi088.stderr: 76800K .......... .......... .......... .......... .......... 82% 32.7M 0s 2024-03-09T14:43:39.740 INFO:teuthology.orchestra.run.smithi088.stderr: 76850K .......... .......... .......... .......... .......... 82% 44.6M 0s 2024-03-09T14:43:39.740 INFO:teuthology.orchestra.run.smithi088.stderr: 76900K .......... .......... .......... .......... .......... 82% 46.6M 0s 2024-03-09T14:43:39.740 INFO:teuthology.orchestra.run.smithi088.stderr: 76950K .......... .......... .......... .......... .......... 82% 117M 0s 2024-03-09T14:43:39.740 INFO:teuthology.orchestra.run.smithi088.stderr: 77000K .......... .......... .......... .......... .......... 82% 118M 0s 2024-03-09T14:43:39.740 INFO:teuthology.orchestra.run.smithi088.stderr: 77050K .......... .......... .......... .......... .......... 82% 29.8M 0s 2024-03-09T14:43:39.740 INFO:teuthology.orchestra.run.smithi088.stderr: 77100K .......... .......... .......... .......... .......... 83% 43.7M 0s 2024-03-09T14:43:39.740 INFO:teuthology.orchestra.run.smithi088.stderr: 77150K .......... .......... .......... .......... .......... 83% 48.8M 0s 2024-03-09T14:43:39.740 INFO:teuthology.orchestra.run.smithi088.stderr: 77200K .......... .......... .......... .......... .......... 83% 113M 0s 2024-03-09T14:43:39.740 INFO:teuthology.orchestra.run.smithi088.stderr: 77250K .......... .......... .......... .......... .......... 83% 43.5M 0s 2024-03-09T14:43:39.740 INFO:teuthology.orchestra.run.smithi088.stderr: 77300K .......... .......... .......... .......... .......... 83% 109M 0s 2024-03-09T14:43:39.740 INFO:teuthology.orchestra.run.smithi088.stderr: 77350K .......... .......... .......... .......... .......... 83% 45.0M 0s 2024-03-09T14:43:39.740 INFO:teuthology.orchestra.run.smithi088.stderr: 77400K .......... .......... .......... .......... .......... 83% 43.0M 0s 2024-03-09T14:43:39.741 INFO:teuthology.orchestra.run.smithi088.stderr: 77450K .......... .......... .......... .......... .......... 83% 94.4M 0s 2024-03-09T14:43:39.741 INFO:teuthology.orchestra.run.smithi088.stderr: 77500K .......... .......... .......... .......... .......... 83% 115M 0s 2024-03-09T14:43:39.741 INFO:teuthology.orchestra.run.smithi088.stderr: 77550K .......... .......... .......... .......... .......... 83% 46.9M 0s 2024-03-09T14:43:39.741 INFO:teuthology.orchestra.run.smithi088.stderr: 77600K .......... .......... .......... .......... .......... 83% 97.7M 0s 2024-03-09T14:43:39.741 INFO:teuthology.orchestra.run.smithi088.stderr: 77650K .......... .......... .......... .......... .......... 83% 42.9M 0s 2024-03-09T14:43:39.741 INFO:teuthology.orchestra.run.smithi088.stderr: 77700K .......... .......... .......... .......... .......... 83% 97.0M 0s 2024-03-09T14:43:39.741 INFO:teuthology.orchestra.run.smithi088.stderr: 77750K .......... .......... .......... .......... .......... 83% 118M 0s 2024-03-09T14:43:39.741 INFO:teuthology.orchestra.run.smithi088.stderr: 77800K .......... .......... .......... .......... .......... 83% 45.8M 0s 2024-03-09T14:43:39.741 INFO:teuthology.orchestra.run.smithi088.stderr: 77850K .......... .......... .......... .......... .......... 83% 63.1M 0s 2024-03-09T14:43:39.741 INFO:teuthology.orchestra.run.smithi088.stderr: 77900K .......... .......... .......... .......... .......... 83% 68.9M 0s 2024-03-09T14:43:39.741 INFO:teuthology.orchestra.run.smithi088.stderr: 77950K .......... .......... .......... .......... .......... 83% 117M 0s 2024-03-09T14:43:39.741 INFO:teuthology.orchestra.run.smithi088.stderr: 78000K .......... .......... .......... .......... .......... 84% 110M 0s 2024-03-09T14:43:39.741 INFO:teuthology.orchestra.run.smithi088.stderr: 78050K .......... .......... .......... .......... .......... 84% 42.8M 0s 2024-03-09T14:43:39.741 INFO:teuthology.orchestra.run.smithi088.stderr: 78100K .......... .......... .......... .......... .......... 84% 45.6M 0s 2024-03-09T14:43:39.741 INFO:teuthology.orchestra.run.smithi088.stderr: 78150K .......... .......... .......... .......... .......... 84% 47.8M 0s 2024-03-09T14:43:39.742 INFO:teuthology.orchestra.run.smithi088.stderr: 78200K .......... .......... .......... .......... .......... 84% 119M 0s 2024-03-09T14:43:39.742 INFO:teuthology.orchestra.run.smithi088.stderr: 78250K .......... .......... .......... .......... .......... 84% 95.6M 0s 2024-03-09T14:43:39.742 INFO:teuthology.orchestra.run.smithi088.stderr: 78300K .......... .......... .......... .......... .......... 84% 48.3M 0s 2024-03-09T14:43:39.742 INFO:teuthology.orchestra.run.smithi088.stderr: 78350K .......... .......... .......... .......... .......... 84% 91.5M 0s 2024-03-09T14:43:39.742 INFO:teuthology.orchestra.run.smithi088.stderr: 78400K .......... .......... .......... .......... .......... 84% 117M 0s 2024-03-09T14:43:39.742 INFO:teuthology.orchestra.run.smithi088.stderr: 78450K .......... .......... .......... .......... .......... 84% 29.3M 0s 2024-03-09T14:43:39.742 INFO:teuthology.orchestra.run.smithi088.stderr: 78500K .......... .......... .......... .......... .......... 84% 115M 0s 2024-03-09T14:43:39.742 INFO:teuthology.orchestra.run.smithi088.stderr: 78550K .......... .......... .......... .......... .......... 84% 100M 0s 2024-03-09T14:43:39.742 INFO:teuthology.orchestra.run.smithi088.stderr: 78600K .......... .......... .......... .......... .......... 84% 32.5M 0s 2024-03-09T14:43:39.742 INFO:teuthology.orchestra.run.smithi088.stderr: 78650K .......... .......... .......... .......... .......... 84% 119M 0s 2024-03-09T14:43:39.742 INFO:teuthology.orchestra.run.smithi088.stderr: 78700K .......... .......... .......... .......... .......... 84% 71.3M 0s 2024-03-09T14:43:39.742 INFO:teuthology.orchestra.run.smithi088.stderr: 78750K .......... .......... .......... .......... .......... 84% 58.5M 0s 2024-03-09T14:43:39.742 INFO:teuthology.orchestra.run.smithi088.stderr: 78800K .......... .......... .......... .......... .......... 84% 84.2M 0s 2024-03-09T14:43:39.742 INFO:teuthology.orchestra.run.smithi088.stderr: 78850K .......... .......... .......... .......... .......... 84% 28.4M 0s 2024-03-09T14:43:39.742 INFO:teuthology.orchestra.run.smithi088.stderr: 78900K .......... .......... .......... .......... .......... 84% 113M 0s 2024-03-09T14:43:39.743 INFO:teuthology.orchestra.run.smithi088.stderr: 78950K .......... .......... .......... .......... .......... 85% 83.4M 0s 2024-03-09T14:43:39.743 INFO:teuthology.orchestra.run.smithi088.stderr: 79000K .......... .......... .......... .......... .......... 85% 58.2M 0s 2024-03-09T14:43:39.743 INFO:teuthology.orchestra.run.smithi088.stderr: 79050K .......... .......... .......... .......... .......... 85% 41.6M 0s 2024-03-09T14:43:39.743 INFO:teuthology.orchestra.run.smithi088.stderr: 79100K .......... .......... .......... .......... .......... 85% 118M 0s 2024-03-09T14:43:39.743 INFO:teuthology.orchestra.run.smithi088.stderr: 79150K .......... .......... .......... .......... .......... 85% 89.1M 0s 2024-03-09T14:43:39.743 INFO:teuthology.orchestra.run.smithi088.stderr: 79200K .......... .......... .......... .......... .......... 85% 35.4M 0s 2024-03-09T14:43:39.743 INFO:teuthology.orchestra.run.smithi088.stderr: 79250K .......... .......... .......... .......... .......... 85% 46.1M 0s 2024-03-09T14:43:39.743 INFO:teuthology.orchestra.run.smithi088.stderr: 79300K .......... .......... .......... .......... .......... 85% 47.3M 0s 2024-03-09T14:43:39.743 INFO:teuthology.orchestra.run.smithi088.stderr: 79350K .......... .......... .......... .......... .......... 85% 134M 0s 2024-03-09T14:43:39.743 INFO:teuthology.orchestra.run.smithi088.stderr: 79400K .......... .......... .......... .......... .......... 85% 105M 0s 2024-03-09T14:43:39.743 INFO:teuthology.orchestra.run.smithi088.stderr: 79450K .......... .......... .......... .......... .......... 85% 43.4M 0s 2024-03-09T14:43:39.743 INFO:teuthology.orchestra.run.smithi088.stderr: 79500K .......... .......... .......... .......... .......... 85% 44.8M 0s 2024-03-09T14:43:39.743 INFO:teuthology.orchestra.run.smithi088.stderr: 79550K .......... .......... .......... .......... .......... 85% 107M 0s 2024-03-09T14:43:39.743 INFO:teuthology.orchestra.run.smithi088.stderr: 79600K .......... .......... .......... .......... .......... 85% 30.6M 0s 2024-03-09T14:43:39.743 INFO:teuthology.orchestra.run.smithi088.stderr: 79650K .......... .......... .......... .......... .......... 85% 80.6M 0s 2024-03-09T14:43:39.744 INFO:teuthology.orchestra.run.smithi088.stderr: 79700K .......... .......... .......... .......... .......... 85% 48.5M 0s 2024-03-09T14:43:39.744 INFO:teuthology.orchestra.run.smithi088.stderr: 79750K .......... .......... .......... .......... .......... 85% 45.2M 0s 2024-03-09T14:43:39.744 INFO:teuthology.orchestra.run.smithi088.stderr: 79800K .......... .......... .......... .......... .......... 85% 49.1M 0s 2024-03-09T14:43:39.744 INFO:teuthology.orchestra.run.smithi088.stderr: 79850K .......... .......... .......... .......... .......... 86% 107M 0s 2024-03-09T14:43:39.744 INFO:teuthology.orchestra.run.smithi088.stderr: 79900K .......... .......... .......... .......... .......... 86% 43.2M 0s 2024-03-09T14:43:39.744 INFO:teuthology.orchestra.run.smithi088.stderr: 79950K .......... .......... .......... .......... .......... 86% 48.3M 0s 2024-03-09T14:43:39.744 INFO:teuthology.orchestra.run.smithi088.stderr: 80000K .......... .......... .......... .......... .......... 86% 122M 0s 2024-03-09T14:43:39.744 INFO:teuthology.orchestra.run.smithi088.stderr: 80050K .......... .......... .......... .......... .......... 86% 42.2M 0s 2024-03-09T14:43:39.744 INFO:teuthology.orchestra.run.smithi088.stderr: 80100K .......... .......... .......... .......... .......... 86% 50.3M 0s 2024-03-09T14:43:39.744 INFO:teuthology.orchestra.run.smithi088.stderr: 80150K .......... .......... .......... .......... .......... 86% 46.1M 0s 2024-03-09T14:43:39.744 INFO:teuthology.orchestra.run.smithi088.stderr: 80200K .......... .......... .......... .......... .......... 86% 109M 0s 2024-03-09T14:43:39.744 INFO:teuthology.orchestra.run.smithi088.stderr: 80250K .......... .......... .......... .......... .......... 86% 111M 0s 2024-03-09T14:43:39.744 INFO:teuthology.orchestra.run.smithi088.stderr: 80300K .......... .......... .......... .......... .......... 86% 50.0M 0s 2024-03-09T14:43:39.744 INFO:teuthology.orchestra.run.smithi088.stderr: 80350K .......... .......... .......... .......... .......... 86% 53.0M 0s 2024-03-09T14:43:39.744 INFO:teuthology.orchestra.run.smithi088.stderr: 80400K .......... .......... .......... .......... .......... 86% 81.2M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 80450K .......... .......... .......... .......... .......... 86% 87.8M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 80500K .......... .......... .......... .......... .......... 86% 52.1M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 80550K .......... .......... .......... .......... .......... 86% 121M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 80600K .......... .......... .......... .......... .......... 86% 114M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 80650K .......... .......... .......... .......... .......... 86% 47.7M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 80700K .......... .......... .......... .......... .......... 86% 78.7M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 80750K .......... .......... .......... .......... .......... 86% 116M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 80800K .......... .......... .......... .......... .......... 87% 36.0M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 80850K .......... .......... .......... .......... .......... 87% 82.7M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 80900K .......... .......... .......... .......... .......... 87% 51.0M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 80950K .......... .......... .......... .......... .......... 87% 118M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 81000K .......... .......... .......... .......... .......... 87% 109M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 81050K .......... .......... .......... .......... .......... 87% 48.7M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 81100K .......... .......... .......... .......... .......... 87% 46.0M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 81150K .......... .......... .......... .......... .......... 87% 43.7M 0s 2024-03-09T14:43:39.745 INFO:teuthology.orchestra.run.smithi088.stderr: 81200K .......... .......... .......... .......... .......... 87% 115M 0s 2024-03-09T14:43:39.746 INFO:teuthology.orchestra.run.smithi088.stderr: 81250K .......... .......... .......... .......... .......... 87% 91.3M 0s 2024-03-09T14:43:39.746 INFO:teuthology.orchestra.run.smithi088.stderr: 81300K .......... .......... .......... .......... .......... 87% 84.3M 0s 2024-03-09T14:43:39.746 INFO:teuthology.orchestra.run.smithi088.stderr: 81350K .......... .......... .......... .......... .......... 87% 56.8M 0s 2024-03-09T14:43:39.746 INFO:teuthology.orchestra.run.smithi088.stderr: 81400K .......... .......... .......... .......... .......... 87% 50.3M 0s 2024-03-09T14:43:39.746 INFO:teuthology.orchestra.run.smithi088.stderr: 81450K .......... .......... .......... .......... .......... 87% 112M 0s 2024-03-09T14:43:39.746 INFO:teuthology.orchestra.run.smithi088.stderr: 81500K .......... .......... .......... .......... .......... 87% 118M 0s 2024-03-09T14:43:39.746 INFO:teuthology.orchestra.run.smithi088.stderr: 81550K .......... .......... .......... .......... .......... 87% 111M 0s 2024-03-09T14:43:39.746 INFO:teuthology.orchestra.run.smithi088.stderr: 81600K .......... .......... .......... .......... .......... 87% 32.3M 0s 2024-03-09T14:43:39.746 INFO:teuthology.orchestra.run.smithi088.stderr: 81650K .......... .......... .......... .......... .......... 87% 88.4M 0s 2024-03-09T14:43:39.746 INFO:teuthology.orchestra.run.smithi088.stderr: 81700K .......... .......... .......... .......... .......... 87% 107M 0s 2024-03-09T14:43:39.746 INFO:teuthology.orchestra.run.smithi088.stderr: 81750K .......... .......... .......... .......... .......... 88% 51.0M 0s 2024-03-09T14:43:39.746 INFO:teuthology.orchestra.run.smithi088.stderr: 81800K .......... .......... .......... .......... .......... 88% 114M 0s 2024-03-09T14:43:39.746 INFO:teuthology.orchestra.run.smithi088.stderr: 81850K .......... .......... .......... .......... .......... 88% 44.2M 0s 2024-03-09T14:43:39.746 INFO:teuthology.orchestra.run.smithi088.stderr: 81900K .......... .......... .......... .......... .......... 88% 105M 0s 2024-03-09T14:43:39.746 INFO:teuthology.orchestra.run.smithi088.stderr: 81950K .......... .......... .......... .......... .......... 88% 36.9M 0s 2024-03-09T14:43:39.747 INFO:teuthology.orchestra.run.smithi088.stderr: 82000K .......... .......... .......... .......... .......... 88% 71.2M 0s 2024-03-09T14:43:39.747 INFO:teuthology.orchestra.run.smithi088.stderr: 82050K .......... .......... .......... .......... .......... 88% 43.0M 0s 2024-03-09T14:43:39.747 INFO:teuthology.orchestra.run.smithi088.stderr: 82100K .......... .......... .......... .......... .......... 88% 117M 0s 2024-03-09T14:43:39.747 INFO:teuthology.orchestra.run.smithi088.stderr: 82150K .......... .......... .......... .......... .......... 88% 118M 0s 2024-03-09T14:43:39.747 INFO:teuthology.orchestra.run.smithi088.stderr: 82200K .......... .......... .......... .......... .......... 88% 42.5M 0s 2024-03-09T14:43:39.747 INFO:teuthology.orchestra.run.smithi088.stderr: 82250K .......... .......... .......... .......... .......... 88% 54.7M 0s 2024-03-09T14:43:39.747 INFO:teuthology.orchestra.run.smithi088.stderr: 82300K .......... .......... .......... .......... .......... 88% 50.8M 0s 2024-03-09T14:43:39.747 INFO:teuthology.orchestra.run.smithi088.stderr: 82350K .......... .......... .......... .......... .......... 88% 117M 0s 2024-03-09T14:43:39.747 INFO:teuthology.orchestra.run.smithi088.stderr: 82400K .......... .......... .......... .......... .......... 88% 51.4M 0s 2024-03-09T14:43:39.747 INFO:teuthology.orchestra.run.smithi088.stderr: 82450K .......... .......... .......... .......... .......... 88% 56.4M 0s 2024-03-09T14:43:39.747 INFO:teuthology.orchestra.run.smithi088.stderr: 82500K .......... .......... .......... .......... .......... 88% 72.9M 0s 2024-03-09T14:43:39.747 INFO:teuthology.orchestra.run.smithi088.stderr: 82550K .......... .......... .......... .......... .......... 88% 28.2M 0s 2024-03-09T14:43:39.747 INFO:teuthology.orchestra.run.smithi088.stderr: 82600K .......... .......... .......... .......... .......... 88% 111M 0s 2024-03-09T14:43:39.747 INFO:teuthology.orchestra.run.smithi088.stderr: 82650K .......... .......... .......... .......... .......... 89% 71.0M 0s 2024-03-09T14:43:39.747 INFO:teuthology.orchestra.run.smithi088.stderr: 82700K .......... .......... .......... .......... .......... 89% 67.5M 0s 2024-03-09T14:43:39.891 INFO:teuthology.orchestra.run.smithi088.stderr: 82750K .......... .......... .......... .......... .......... 89% 48.1M 0s 2024-03-09T14:43:39.891 INFO:teuthology.orchestra.run.smithi088.stderr: 82800K .......... .......... .......... .......... .......... 89% 122M 0s 2024-03-09T14:43:39.891 INFO:teuthology.orchestra.run.smithi088.stderr: 82850K .......... .......... .......... .......... .......... 89% 29.2M 0s 2024-03-09T14:43:39.891 INFO:teuthology.orchestra.run.smithi088.stderr: 82900K .......... .......... .......... .......... .......... 89% 48.6M 0s 2024-03-09T14:43:39.891 INFO:teuthology.orchestra.run.smithi088.stderr: 82950K .......... .......... .......... .......... .......... 89% 113M 0s 2024-03-09T14:43:39.891 INFO:teuthology.orchestra.run.smithi088.stderr: 83000K .......... .......... .......... .......... .......... 89% 49.5M 0s 2024-03-09T14:43:39.891 INFO:teuthology.orchestra.run.smithi088.stderr: 83050K .......... .......... .......... .......... .......... 89% 45.5M 0s 2024-03-09T14:43:39.891 INFO:teuthology.orchestra.run.smithi088.stderr: 83100K .......... .......... .......... .......... .......... 89% 135M 0s 2024-03-09T14:43:39.891 INFO:teuthology.orchestra.run.smithi088.stderr: 83150K .......... .......... .......... .......... .......... 89% 80.7M 0s 2024-03-09T14:43:39.891 INFO:teuthology.orchestra.run.smithi088.stderr: 83200K .......... .......... .......... .......... .......... 89% 106M 0s 2024-03-09T14:43:39.892 INFO:teuthology.orchestra.run.smithi088.stderr: 83250K .......... .......... .......... .......... .......... 89% 54.5M 0s 2024-03-09T14:43:39.892 INFO:teuthology.orchestra.run.smithi088.stderr: 83300K .......... .......... .......... .......... .......... 89% 48.7M 0s 2024-03-09T14:43:39.892 INFO:teuthology.orchestra.run.smithi088.stderr: 83350K .......... .......... .......... .......... .......... 89% 113M 0s 2024-03-09T14:43:39.892 INFO:teuthology.orchestra.run.smithi088.stderr: 83400K .......... .......... .......... .......... .......... 89% 66.7M 0s 2024-03-09T14:43:39.892 INFO:teuthology.orchestra.run.smithi088.stderr: 83450K .......... .......... .......... .......... .......... 89% 68.0M 0s 2024-03-09T14:43:39.892 INFO:teuthology.orchestra.run.smithi088.stderr: 83500K .......... .......... .......... .......... .......... 89% 50.0M 0s 2024-03-09T14:43:39.892 INFO:teuthology.orchestra.run.smithi088.stderr: 83550K .......... .......... .......... .......... .......... 89% 118M 0s 2024-03-09T14:43:39.892 INFO:teuthology.orchestra.run.smithi088.stderr: 83600K .......... .......... .......... .......... .......... 90% 97.5M 0s 2024-03-09T14:43:39.892 INFO:teuthology.orchestra.run.smithi088.stderr: 83650K .......... .......... .......... .......... .......... 90% 46.5M 0s 2024-03-09T14:43:39.892 INFO:teuthology.orchestra.run.smithi088.stderr: 83700K .......... .......... .......... .......... .......... 90% 111M 0s 2024-03-09T14:43:39.892 INFO:teuthology.orchestra.run.smithi088.stderr: 83750K .......... .......... .......... .......... .......... 90% 35.8M 0s 2024-03-09T14:43:39.892 INFO:teuthology.orchestra.run.smithi088.stderr: 83800K .......... .......... .......... .......... .......... 90% 124M 0s 2024-03-09T14:43:39.892 INFO:teuthology.orchestra.run.smithi088.stderr: 83850K .......... .......... .......... .......... .......... 90% 47.8M 0s 2024-03-09T14:43:39.892 INFO:teuthology.orchestra.run.smithi088.stderr: 83900K .......... .......... .......... .......... .......... 90% 117M 0s 2024-03-09T14:43:39.893 INFO:teuthology.orchestra.run.smithi088.stderr: 83950K .......... .......... .......... .......... .......... 90% 41.3M 0s 2024-03-09T14:43:39.893 INFO:teuthology.orchestra.run.smithi088.stderr: 84000K .......... .......... .......... .......... .......... 90% 118M 0s 2024-03-09T14:43:39.893 INFO:teuthology.orchestra.run.smithi088.stderr: 84050K .......... .......... .......... .......... .......... 90% 89.2M 0s 2024-03-09T14:43:39.893 INFO:teuthology.orchestra.run.smithi088.stderr: 84100K .......... .......... .......... .......... .......... 90% 57.8M 0s 2024-03-09T14:43:39.893 INFO:teuthology.orchestra.run.smithi088.stderr: 84150K .......... .......... .......... .......... .......... 90% 48.3M 0s 2024-03-09T14:43:39.893 INFO:teuthology.orchestra.run.smithi088.stderr: 84200K .......... .......... .......... .......... .......... 90% 108M 0s 2024-03-09T14:43:39.893 INFO:teuthology.orchestra.run.smithi088.stderr: 84250K .......... .......... .......... .......... .......... 90% 120M 0s 2024-03-09T14:43:39.893 INFO:teuthology.orchestra.run.smithi088.stderr: 84300K .......... .......... .......... .......... .......... 90% 69.3M 0s 2024-03-09T14:43:39.893 INFO:teuthology.orchestra.run.smithi088.stderr: 84350K .......... .......... .......... .......... .......... 90% 39.9M 0s 2024-03-09T14:43:39.893 INFO:teuthology.orchestra.run.smithi088.stderr: 84400K .......... .......... .......... .......... .......... 90% 103M 0s 2024-03-09T14:43:39.893 INFO:teuthology.orchestra.run.smithi088.stderr: 84450K .......... .......... .......... .......... .......... 90% 41.7M 0s 2024-03-09T14:43:39.893 INFO:teuthology.orchestra.run.smithi088.stderr: 84500K .......... .......... .......... .......... .......... 91% 115M 0s 2024-03-09T14:43:39.893 INFO:teuthology.orchestra.run.smithi088.stderr: 84550K .......... .......... .......... .......... .......... 91% 72.0M 0s 2024-03-09T14:43:39.893 INFO:teuthology.orchestra.run.smithi088.stderr: 84600K .......... .......... .......... .......... .......... 91% 60.4M 0s 2024-03-09T14:43:39.894 INFO:teuthology.orchestra.run.smithi088.stderr: 84650K .......... .......... .......... .......... .......... 91% 40.2M 0s 2024-03-09T14:43:39.894 INFO:teuthology.orchestra.run.smithi088.stderr: 84700K .......... .......... .......... .......... .......... 91% 84.0M 0s 2024-03-09T14:43:39.894 INFO:teuthology.orchestra.run.smithi088.stderr: 84750K .......... .......... .......... .......... .......... 91% 62.8M 0s 2024-03-09T14:43:39.894 INFO:teuthology.orchestra.run.smithi088.stderr: 84800K .......... .......... .......... .......... .......... 91% 74.9M 0s 2024-03-09T14:43:39.894 INFO:teuthology.orchestra.run.smithi088.stderr: 84850K .......... .......... .......... .......... .......... 91% 49.3M 0s 2024-03-09T14:43:39.894 INFO:teuthology.orchestra.run.smithi088.stderr: 84900K .......... .......... .......... .......... .......... 91% 72.4M 0s 2024-03-09T14:43:39.894 INFO:teuthology.orchestra.run.smithi088.stderr: 84950K .......... .......... .......... .......... .......... 91% 77.7M 0s 2024-03-09T14:43:39.894 INFO:teuthology.orchestra.run.smithi088.stderr: 85000K .......... .......... .......... .......... .......... 91% 35.3M 0s 2024-03-09T14:43:39.894 INFO:teuthology.orchestra.run.smithi088.stderr: 85050K .......... .......... .......... .......... .......... 91% 59.5M 0s 2024-03-09T14:43:39.894 INFO:teuthology.orchestra.run.smithi088.stderr: 85100K .......... .......... .......... .......... .......... 91% 66.0M 0s 2024-03-09T14:43:39.894 INFO:teuthology.orchestra.run.smithi088.stderr: 85150K .......... .......... .......... .......... .......... 91% 85.9M 0s 2024-03-09T14:43:39.894 INFO:teuthology.orchestra.run.smithi088.stderr: 85200K .......... .......... .......... .......... .......... 91% 74.8M 0s 2024-03-09T14:43:39.894 INFO:teuthology.orchestra.run.smithi088.stderr: 85250K .......... .......... .......... .......... .......... 91% 42.7M 0s 2024-03-09T14:43:39.894 INFO:teuthology.orchestra.run.smithi088.stderr: 85300K .......... .......... .......... .......... .......... 91% 48.3M 0s 2024-03-09T14:43:39.894 INFO:teuthology.orchestra.run.smithi088.stderr: 85350K .......... .......... .......... .......... .......... 91% 45.7M 0s 2024-03-09T14:43:39.895 INFO:teuthology.orchestra.run.smithi088.stderr: 85400K .......... .......... .......... .......... .......... 91% 116M 0s 2024-03-09T14:43:39.895 INFO:teuthology.orchestra.run.smithi088.stderr: 85450K .......... .......... .......... .......... .......... 92% 48.7M 0s 2024-03-09T14:43:39.895 INFO:teuthology.orchestra.run.smithi088.stderr: 85500K .......... .......... .......... .......... .......... 92% 92.8M 0s 2024-03-09T14:43:39.895 INFO:teuthology.orchestra.run.smithi088.stderr: 85550K .......... .......... .......... .......... .......... 92% 49.8M 0s 2024-03-09T14:43:39.895 INFO:teuthology.orchestra.run.smithi088.stderr: 85600K .......... .......... .......... .......... .......... 92% 119M 0s 2024-03-09T14:43:39.895 INFO:teuthology.orchestra.run.smithi088.stderr: 85650K .......... .......... .......... .......... .......... 92% 28.6M 0s 2024-03-09T14:43:39.895 INFO:teuthology.orchestra.run.smithi088.stderr: 85700K .......... .......... .......... .......... .......... 92% 49.6M 0s 2024-03-09T14:43:39.895 INFO:teuthology.orchestra.run.smithi088.stderr: 85750K .......... .......... .......... .......... .......... 92% 104M 0s 2024-03-09T14:43:39.895 INFO:teuthology.orchestra.run.smithi088.stderr: 85800K .......... .......... .......... .......... .......... 92% 48.0M 0s 2024-03-09T14:43:39.895 INFO:teuthology.orchestra.run.smithi088.stderr: 85850K .......... .......... .......... .......... .......... 92% 47.1M 0s 2024-03-09T14:43:39.895 INFO:teuthology.orchestra.run.smithi088.stderr: 85900K .......... .......... .......... .......... .......... 92% 115M 0s 2024-03-09T14:43:39.895 INFO:teuthology.orchestra.run.smithi088.stderr: 85950K .......... .......... .......... .......... .......... 92% 55.1M 0s 2024-03-09T14:43:39.895 INFO:teuthology.orchestra.run.smithi088.stderr: 86000K .......... .......... .......... .......... .......... 92% 91.2M 0s 2024-03-09T14:43:39.895 INFO:teuthology.orchestra.run.smithi088.stderr: 86050K .......... .......... .......... .......... .......... 92% 41.1M 0s 2024-03-09T14:43:39.895 INFO:teuthology.orchestra.run.smithi088.stderr: 86100K .......... .......... .......... .......... .......... 92% 51.1M 0s 2024-03-09T14:43:39.896 INFO:teuthology.orchestra.run.smithi088.stderr: 86150K .......... .......... .......... .......... .......... 92% 117M 0s 2024-03-09T14:43:39.896 INFO:teuthology.orchestra.run.smithi088.stderr: 86200K .......... .......... .......... .......... .......... 92% 105M 0s 2024-03-09T14:43:39.896 INFO:teuthology.orchestra.run.smithi088.stderr: 86250K .......... .......... .......... .......... .......... 92% 49.7M 0s 2024-03-09T14:43:39.896 INFO:teuthology.orchestra.run.smithi088.stderr: 86300K .......... .......... .......... .......... .......... 92% 107M 0s 2024-03-09T14:43:39.896 INFO:teuthology.orchestra.run.smithi088.stderr: 86350K .......... .......... .......... .......... .......... 93% 117M 0s 2024-03-09T14:43:39.896 INFO:teuthology.orchestra.run.smithi088.stderr: 86400K .......... .......... .......... .......... .......... 93% 38.9M 0s 2024-03-09T14:43:39.896 INFO:teuthology.orchestra.run.smithi088.stderr: 86450K .......... .......... .......... .......... .......... 93% 48.6M 0s 2024-03-09T14:43:39.896 INFO:teuthology.orchestra.run.smithi088.stderr: 86500K .......... .......... .......... .......... .......... 93% 45.4M 0s 2024-03-09T14:43:39.896 INFO:teuthology.orchestra.run.smithi088.stderr: 86550K .......... .......... .......... .......... .......... 93% 122M 0s 2024-03-09T14:43:39.896 INFO:teuthology.orchestra.run.smithi088.stderr: 86600K .......... .......... .......... .......... .......... 93% 89.3M 0s 2024-03-09T14:43:39.896 INFO:teuthology.orchestra.run.smithi088.stderr: 86650K .......... .......... .......... .......... .......... 93% 61.2M 0s 2024-03-09T14:43:39.896 INFO:teuthology.orchestra.run.smithi088.stderr: 86700K .......... .......... .......... .......... .......... 93% 48.8M 0s 2024-03-09T14:43:39.896 INFO:teuthology.orchestra.run.smithi088.stderr: 86750K .......... .......... .......... .......... .......... 93% 54.9M 0s 2024-03-09T14:43:39.896 INFO:teuthology.orchestra.run.smithi088.stderr: 86800K .......... .......... .......... .......... .......... 93% 111M 0s 2024-03-09T14:43:39.896 INFO:teuthology.orchestra.run.smithi088.stderr: 86850K .......... .......... .......... .......... .......... 93% 76.3M 0s 2024-03-09T14:43:39.897 INFO:teuthology.orchestra.run.smithi088.stderr: 86900K .......... .......... .......... .......... .......... 93% 49.5M 0s 2024-03-09T14:43:39.897 INFO:teuthology.orchestra.run.smithi088.stderr: 86950K .......... .......... .......... .......... .......... 93% 94.7M 0s 2024-03-09T14:43:39.897 INFO:teuthology.orchestra.run.smithi088.stderr: 87000K .......... .......... .......... .......... .......... 93% 49.1M 0s 2024-03-09T14:43:39.897 INFO:teuthology.orchestra.run.smithi088.stderr: 87050K .......... .......... .......... .......... .......... 93% 109M 0s 2024-03-09T14:43:39.897 INFO:teuthology.orchestra.run.smithi088.stderr: 87100K .......... .......... .......... .......... .......... 93% 49.6M 0s 2024-03-09T14:43:39.897 INFO:teuthology.orchestra.run.smithi088.stderr: 87150K .......... .......... .......... .......... .......... 93% 111M 0s 2024-03-09T14:43:39.897 INFO:teuthology.orchestra.run.smithi088.stderr: 87200K .......... .......... .......... .......... .......... 93% 48.5M 0s 2024-03-09T14:43:39.897 INFO:teuthology.orchestra.run.smithi088.stderr: 87250K .......... .......... .......... .......... .......... 93% 90.6M 0s 2024-03-09T14:43:39.897 INFO:teuthology.orchestra.run.smithi088.stderr: 87300K .......... .......... .......... .......... .......... 94% 117M 0s 2024-03-09T14:43:39.897 INFO:teuthology.orchestra.run.smithi088.stderr: 87350K .......... .......... .......... .......... .......... 94% 42.9M 0s 2024-03-09T14:43:39.897 INFO:teuthology.orchestra.run.smithi088.stderr: 87400K .......... .......... .......... .......... .......... 94% 54.8M 0s 2024-03-09T14:43:39.897 INFO:teuthology.orchestra.run.smithi088.stderr: 87450K .......... .......... .......... .......... .......... 94% 50.2M 0s 2024-03-09T14:43:39.897 INFO:teuthology.orchestra.run.smithi088.stderr: 87500K .......... .......... .......... .......... .......... 94% 117M 0s 2024-03-09T14:43:39.897 INFO:teuthology.orchestra.run.smithi088.stderr: 87550K .......... .......... .......... .......... .......... 94% 109M 0s 2024-03-09T14:43:39.897 INFO:teuthology.orchestra.run.smithi088.stderr: 87600K .......... .......... .......... .......... .......... 94% 48.9M 0s 2024-03-09T14:43:39.898 INFO:teuthology.orchestra.run.smithi088.stderr: 87650K .......... .......... .......... .......... .......... 94% 85.8M 0s 2024-03-09T14:43:39.898 INFO:teuthology.orchestra.run.smithi088.stderr: 87700K .......... .......... .......... .......... .......... 94% 31.6M 0s 2024-03-09T14:43:39.898 INFO:teuthology.orchestra.run.smithi088.stderr: 87750K .......... .......... .......... .......... .......... 94% 81.3M 0s 2024-03-09T14:43:39.898 INFO:teuthology.orchestra.run.smithi088.stderr: 87800K .......... .......... .......... .......... .......... 94% 49.7M 0s 2024-03-09T14:43:39.898 INFO:teuthology.orchestra.run.smithi088.stderr: 87850K .......... .......... .......... .......... .......... 94% 62.4M 0s 2024-03-09T14:43:39.898 INFO:teuthology.orchestra.run.smithi088.stderr: 87900K .......... .......... .......... .......... .......... 94% 71.5M 0s 2024-03-09T14:43:39.898 INFO:teuthology.orchestra.run.smithi088.stderr: 87950K .......... .......... .......... .......... .......... 94% 120M 0s 2024-03-09T14:43:39.898 INFO:teuthology.orchestra.run.smithi088.stderr: 88000K .......... .......... .......... .......... .......... 94% 112M 0s 2024-03-09T14:43:39.898 INFO:teuthology.orchestra.run.smithi088.stderr: 88050K .......... .......... .......... .......... .......... 94% 29.7M 0s 2024-03-09T14:43:39.898 INFO:teuthology.orchestra.run.smithi088.stderr: 88100K .......... .......... .......... .......... .......... 94% 65.6M 0s 2024-03-09T14:43:39.898 INFO:teuthology.orchestra.run.smithi088.stderr: 88150K .......... .......... .......... .......... .......... 94% 72.1M 0s 2024-03-09T14:43:39.898 INFO:teuthology.orchestra.run.smithi088.stderr: 88200K .......... .......... .......... .......... .......... 94% 116M 0s 2024-03-09T14:43:39.898 INFO:teuthology.orchestra.run.smithi088.stderr: 88250K .......... .......... .......... .......... .......... 95% 46.4M 0s 2024-03-09T14:43:39.898 INFO:teuthology.orchestra.run.smithi088.stderr: 88300K .......... .......... .......... .......... .......... 95% 112M 0s 2024-03-09T14:43:39.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88350K .......... .......... .......... .......... .......... 95% 40.5M 0s 2024-03-09T14:43:39.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88400K .......... .......... .......... .......... .......... 95% 118M 0s 2024-03-09T14:43:39.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88450K .......... .......... .......... .......... .......... 95% 24.1M 0s 2024-03-09T14:43:39.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88500K .......... .......... .......... .......... .......... 95% 116M 0s 2024-03-09T14:43:39.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88550K .......... .......... .......... .......... .......... 95% 112M 0s 2024-03-09T14:43:39.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88600K .......... .......... .......... .......... .......... 95% 50.6M 0s 2024-03-09T14:43:39.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88650K .......... .......... .......... .......... .......... 95% 43.6M 0s 2024-03-09T14:43:39.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88700K .......... .......... .......... .......... .......... 95% 46.7M 0s 2024-03-09T14:43:39.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88750K .......... .......... .......... .......... .......... 95% 94.8M 0s 2024-03-09T14:43:39.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88800K .......... .......... .......... .......... .......... 95% 80.8M 0s 2024-03-09T14:43:39.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88850K .......... .......... .......... .......... .......... 95% 51.8M 0s 2024-03-09T14:43:39.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88900K .......... .......... .......... .......... .......... 95% 49.1M 0s 2024-03-09T14:43:39.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88950K .......... .......... .......... .......... .......... 95% 114M 0s 2024-03-09T14:43:39.899 INFO:teuthology.orchestra.run.smithi088.stderr: 89000K .......... .......... .......... .......... .......... 95% 47.8M 0s 2024-03-09T14:43:39.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89050K .......... .......... .......... .......... .......... 95% 117M 0s 2024-03-09T14:43:39.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89100K .......... .......... .......... .......... .......... 95% 20.1M 0s 2024-03-09T14:43:39.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89150K .......... .......... .......... .......... .......... 96% 114M 0s 2024-03-09T14:43:39.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89200K .......... .......... .......... .......... .......... 96% 120M 0s 2024-03-09T14:43:39.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89250K .......... .......... .......... .......... .......... 96% 56.9M 0s 2024-03-09T14:43:39.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89300K .......... .......... .......... .......... .......... 96% 40.7M 0s 2024-03-09T14:43:39.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89350K .......... .......... .......... .......... .......... 96% 101M 0s 2024-03-09T14:43:39.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89400K .......... .......... .......... .......... .......... 96% 114M 0s 2024-03-09T14:43:39.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89450K .......... .......... .......... .......... .......... 96% 48.6M 0s 2024-03-09T14:43:39.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89500K .......... .......... .......... .......... .......... 96% 112M 0s 2024-03-09T14:43:39.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89550K .......... .......... .......... .......... .......... 96% 36.5M 0s 2024-03-09T14:43:39.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89600K .......... .......... .......... .......... .......... 96% 121M 0s 2024-03-09T14:43:39.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89650K .......... .......... .......... .......... .......... 96% 64.4M 0s 2024-03-09T14:43:39.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89700K .......... .......... .......... .......... .......... 96% 109M 0s 2024-03-09T14:43:39.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89750K .......... .......... .......... .......... .......... 96% 49.0M 0s 2024-03-09T14:43:39.901 INFO:teuthology.orchestra.run.smithi088.stderr: 89800K .......... .......... .......... .......... .......... 96% 43.7M 0s 2024-03-09T14:43:39.901 INFO:teuthology.orchestra.run.smithi088.stderr: 89850K .......... .......... .......... .......... .......... 96% 119M 0s 2024-03-09T14:43:39.901 INFO:teuthology.orchestra.run.smithi088.stderr: 89900K .......... .......... .......... .......... .......... 96% 116M 0s 2024-03-09T14:43:39.901 INFO:teuthology.orchestra.run.smithi088.stderr: 89950K .......... .......... .......... .......... .......... 96% 49.0M 0s 2024-03-09T14:43:39.901 INFO:teuthology.orchestra.run.smithi088.stderr: 90000K .......... .......... .......... .......... .......... 96% 120M 0s 2024-03-09T14:43:39.901 INFO:teuthology.orchestra.run.smithi088.stderr: 90050K .......... .......... .......... .......... .......... 96% 31.7M 0s 2024-03-09T14:43:39.901 INFO:teuthology.orchestra.run.smithi088.stderr: 90100K .......... .......... .......... .......... .......... 97% 104M 0s 2024-03-09T14:43:39.901 INFO:teuthology.orchestra.run.smithi088.stderr: 90150K .......... .......... .......... .......... .......... 97% 82.2M 0s 2024-03-09T14:43:39.901 INFO:teuthology.orchestra.run.smithi088.stderr: 90200K .......... .......... .......... .......... .......... 97% 55.5M 0s 2024-03-09T14:43:39.901 INFO:teuthology.orchestra.run.smithi088.stderr: 90250K .......... .......... .......... .......... .......... 97% 91.2M 0s 2024-03-09T14:43:39.901 INFO:teuthology.orchestra.run.smithi088.stderr: 90300K .......... .......... .......... .......... .......... 97% 117M 0s 2024-03-09T14:43:39.901 INFO:teuthology.orchestra.run.smithi088.stderr: 90350K .......... .......... .......... .......... .......... 97% 49.7M 0s 2024-03-09T14:43:39.901 INFO:teuthology.orchestra.run.smithi088.stderr: 90400K .......... .......... .......... .......... .......... 97% 112M 0s 2024-03-09T14:43:39.901 INFO:teuthology.orchestra.run.smithi088.stderr: 90450K .......... .......... .......... .......... .......... 97% 43.0M 0s 2024-03-09T14:43:39.901 INFO:teuthology.orchestra.run.smithi088.stderr: 90500K .......... .......... .......... .......... .......... 97% 50.2M 0s 2024-03-09T14:43:39.902 INFO:teuthology.orchestra.run.smithi088.stderr: 90550K .......... .......... .......... .......... .......... 97% 96.9M 0s 2024-03-09T14:43:39.902 INFO:teuthology.orchestra.run.smithi088.stderr: 90600K .......... .......... .......... .......... .......... 97% 53.1M 0s 2024-03-09T14:43:39.902 INFO:teuthology.orchestra.run.smithi088.stderr: 90650K .......... .......... .......... .......... .......... 97% 48.3M 0s 2024-03-09T14:43:39.902 INFO:teuthology.orchestra.run.smithi088.stderr: 90700K .......... .......... .......... .......... .......... 97% 106M 0s 2024-03-09T14:43:39.902 INFO:teuthology.orchestra.run.smithi088.stderr: 90750K .......... .......... .......... .......... .......... 97% 113M 0s 2024-03-09T14:43:39.902 INFO:teuthology.orchestra.run.smithi088.stderr: 90800K .......... .......... .......... .......... .......... 97% 52.2M 0s 2024-03-09T14:43:39.902 INFO:teuthology.orchestra.run.smithi088.stderr: 90850K .......... .......... .......... .......... .......... 97% 30.6M 0s 2024-03-09T14:43:39.902 INFO:teuthology.orchestra.run.smithi088.stderr: 90900K .......... .......... .......... .......... .......... 97% 71.0M 0s 2024-03-09T14:43:39.902 INFO:teuthology.orchestra.run.smithi088.stderr: 90950K .......... .......... .......... .......... .......... 97% 115M 0s 2024-03-09T14:43:39.902 INFO:teuthology.orchestra.run.smithi088.stderr: 91000K .......... .......... .......... .......... .......... 98% 93.8M 0s 2024-03-09T14:43:39.902 INFO:teuthology.orchestra.run.smithi088.stderr: 91050K .......... .......... .......... .......... .......... 98% 66.5M 0s 2024-03-09T14:43:39.902 INFO:teuthology.orchestra.run.smithi088.stderr: 91100K .......... .......... .......... .......... .......... 98% 31.5M 0s 2024-03-09T14:43:39.902 INFO:teuthology.orchestra.run.smithi088.stderr: 91150K .......... .......... .......... .......... .......... 98% 82.1M 0s 2024-03-09T14:43:39.902 INFO:teuthology.orchestra.run.smithi088.stderr: 91200K .......... .......... .......... .......... .......... 98% 59.0M 0s 2024-03-09T14:43:39.903 INFO:teuthology.orchestra.run.smithi088.stderr: 91250K .......... .......... .......... .......... .......... 98% 42.4M 0s 2024-03-09T14:43:39.903 INFO:teuthology.orchestra.run.smithi088.stderr: 91300K .......... .......... .......... .......... .......... 98% 123M 0s 2024-03-09T14:43:39.903 INFO:teuthology.orchestra.run.smithi088.stderr: 91350K .......... .......... .......... .......... .......... 98% 109M 0s 2024-03-09T14:43:39.903 INFO:teuthology.orchestra.run.smithi088.stderr: 91400K .......... .......... .......... .......... .......... 98% 36.8M 0s 2024-03-09T14:43:39.903 INFO:teuthology.orchestra.run.smithi088.stderr: 91450K .......... .......... .......... .......... .......... 98% 30.7M 0s 2024-03-09T14:43:39.903 INFO:teuthology.orchestra.run.smithi088.stderr: 91500K .......... .......... .......... .......... .......... 98% 114M 0s 2024-03-09T14:43:39.903 INFO:teuthology.orchestra.run.smithi088.stderr: 91550K .......... .......... .......... .......... .......... 98% 118M 0s 2024-03-09T14:43:39.903 INFO:teuthology.orchestra.run.smithi088.stderr: 91600K .......... .......... .......... .......... .......... 98% 50.2M 0s 2024-03-09T14:43:39.903 INFO:teuthology.orchestra.run.smithi088.stderr: 91650K .......... .......... .......... .......... .......... 98% 70.8M 0s 2024-03-09T14:43:39.903 INFO:teuthology.orchestra.run.smithi088.stderr: 91700K .......... .......... .......... .......... .......... 98% 57.3M 0s 2024-03-09T14:43:39.903 INFO:teuthology.orchestra.run.smithi088.stderr: 91750K .......... .......... .......... .......... .......... 98% 119M 0s 2024-03-09T14:43:39.903 INFO:teuthology.orchestra.run.smithi088.stderr: 91800K .......... .......... .......... .......... .......... 98% 27.7M 0s 2024-03-09T14:43:39.903 INFO:teuthology.orchestra.run.smithi088.stderr: 91850K .......... .......... .......... .......... .......... 98% 54.5M 0s 2024-03-09T14:43:39.903 INFO:teuthology.orchestra.run.smithi088.stderr: 91900K .......... .......... .......... .......... .......... 98% 20.6M 0s 2024-03-09T14:43:39.904 INFO:teuthology.orchestra.run.smithi088.stderr: 91950K .......... .......... .......... .......... .......... 99% 111M 0s 2024-03-09T14:43:39.904 INFO:teuthology.orchestra.run.smithi088.stderr: 92000K .......... .......... .......... .......... .......... 99% 111M 0s 2024-03-09T14:43:39.904 INFO:teuthology.orchestra.run.smithi088.stderr: 92050K .......... .......... .......... .......... .......... 99% 45.0M 0s 2024-03-09T14:43:39.904 INFO:teuthology.orchestra.run.smithi088.stderr: 92100K .......... .......... .......... .......... .......... 99% 111M 0s 2024-03-09T14:43:39.904 INFO:teuthology.orchestra.run.smithi088.stderr: 92150K .......... .......... .......... .......... .......... 99% 31.6M 0s 2024-03-09T14:43:39.904 INFO:teuthology.orchestra.run.smithi088.stderr: 92200K .......... .......... .......... .......... .......... 99% 54.4M 0s 2024-03-09T14:43:39.904 INFO:teuthology.orchestra.run.smithi088.stderr: 92250K .......... .......... .......... .......... .......... 99% 114M 0s 2024-03-09T14:43:39.904 INFO:teuthology.orchestra.run.smithi088.stderr: 92300K .......... .......... .......... .......... .......... 99% 89.6M 0s 2024-03-09T14:43:39.904 INFO:teuthology.orchestra.run.smithi088.stderr: 92350K .......... .......... .......... .......... .......... 99% 46.2M 0s 2024-03-09T14:43:39.904 INFO:teuthology.orchestra.run.smithi088.stderr: 92400K .......... .......... .......... .......... .......... 99% 111M 0s 2024-03-09T14:43:39.904 INFO:teuthology.orchestra.run.smithi088.stderr: 92450K .......... .......... .......... .......... .......... 99% 51.9M 0s 2024-03-09T14:43:39.904 INFO:teuthology.orchestra.run.smithi088.stderr: 92500K .......... .......... .......... .......... .......... 99% 49.4M 0s 2024-03-09T14:43:39.904 INFO:teuthology.orchestra.run.smithi088.stderr: 92550K .......... .......... .......... .......... .......... 99% 92.7M 0s 2024-03-09T14:43:39.904 INFO:teuthology.orchestra.run.smithi088.stderr: 92600K .......... .......... .......... .......... .......... 99% 38.7M 0s 2024-03-09T14:43:39.904 INFO:teuthology.orchestra.run.smithi088.stderr: 92650K .......... .......... .......... .......... .......... 99% 114M 0s 2024-03-09T14:43:39.905 INFO:teuthology.orchestra.run.smithi088.stderr: 92700K .......... .......... .......... .......... .......... 99% 53.1M 0s 2024-03-09T14:43:39.905 INFO:teuthology.orchestra.run.smithi088.stderr: 92750K .......... .......... .......... .......... .......... 99% 109M 0s 2024-03-09T14:43:39.905 INFO:teuthology.orchestra.run.smithi088.stderr: 92800K .......... .......... .......... .......... .......... 99% 80.2M 0s 2024-03-09T14:43:39.905 INFO:teuthology.orchestra.run.smithi088.stderr: 92850K .......... .......... .......... .......... .......... 99% 119M 0s 2024-03-09T14:43:39.905 INFO:teuthology.orchestra.run.smithi088.stderr: 92900K 100% 134G=1.5s 2024-03-09T14:43:39.905 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-03-09T14:43:39.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09 14:43:39 (61.3 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-03-09T14:43:39.905 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-03-09T14:43:39.911 INFO:teuthology.orchestra.run.smithi088.stdout:Archive: gradle-6.0.1-bin.zip 2024-03-09T14:43:39.911 INFO:teuthology.orchestra.run.smithi088.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-03-09T14:43:39.912 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-03-09T14:43:39.912 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-03-09T14:43:39.912 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-03-09T14:43:39.912 INFO:teuthology.orchestra.run.smithi088.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-03-09T14:43:39.912 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-03-09T14:43:39.912 INFO:teuthology.orchestra.run.smithi088.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-03-09T14:43:39.912 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-03-09T14:43:39.912 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-03-09T14:43:39.912 INFO:teuthology.orchestra.run.smithi088.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-03-09T14:43:39.912 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-03-09T14:43:39.912 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-03-09T14:43:39.912 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-03-09T14:43:39.912 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-03-09T14:43:39.912 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-03-09T14:43:39.912 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-03-09T14:43:39.913 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-03-09T14:43:39.913 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-03-09T14:43:39.913 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-03-09T14:43:39.913 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-03-09T14:43:39.913 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-03-09T14:43:39.913 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-03-09T14:43:39.913 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-03-09T14:43:39.913 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-03-09T14:43:39.913 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-03-09T14:43:39.913 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-03-09T14:43:39.913 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-03-09T14:43:39.913 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-03-09T14:43:39.913 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-03-09T14:43:39.913 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-03-09T14:43:39.914 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-03-09T14:43:39.914 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-03-09T14:43:39.914 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-03-09T14:43:39.914 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-03-09T14:43:39.914 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-03-09T14:43:39.914 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-03-09T14:43:39.914 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-03-09T14:43:39.914 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-03-09T14:43:39.914 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-03-09T14:43:39.914 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-03-09T14:43:39.914 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-03-09T14:43:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-03-09T14:43:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-03-09T14:43:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-03-09T14:43:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-03-09T14:43:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-03-09T14:43:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-03-09T14:43:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-03-09T14:43:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-03-09T14:43:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-03-09T14:43:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-03-09T14:43:40.166 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-03-09T14:43:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-03-09T14:43:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-03-09T14:43:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-03-09T14:43:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-03-09T14:43:40.170 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-03-09T14:43:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-03-09T14:43:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-03-09T14:43:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-03-09T14:43:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-03-09T14:43:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-03-09T14:43:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-03-09T14:43:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-03-09T14:43:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-03-09T14:43:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-03-09T14:43:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-03-09T14:43:40.210 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-03-09T14:43:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-03-09T14:43:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-03-09T14:43:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-03-09T14:43:40.217 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-03-09T14:43:40.218 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-03-09T14:43:40.218 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-03-09T14:43:40.222 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-03-09T14:43:40.223 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-03-09T14:43:40.243 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-03-09T14:43:40.243 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-03-09T14:43:40.250 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-03-09T14:43:40.250 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-03-09T14:43:40.250 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-03-09T14:43:40.250 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-03-09T14:43:40.251 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-03-09T14:43:40.258 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-03-09T14:43:40.259 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-03-09T14:43:40.267 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-03-09T14:43:40.267 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-03-09T14:43:40.268 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-03-09T14:43:40.268 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-03-09T14:43:40.268 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-03-09T14:43:40.268 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-03-09T14:43:40.268 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-03-09T14:43:40.268 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-03-09T14:43:40.268 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-03-09T14:43:40.268 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-03-09T14:43:40.269 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-03-09T14:43:40.269 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-03-09T14:43:40.269 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-03-09T14:43:40.269 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-03-09T14:43:40.269 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-03-09T14:43:40.269 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-03-09T14:43:40.269 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-03-09T14:43:40.269 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-03-09T14:43:40.269 INFO:teuthology.orchestra.run.smithi088.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-03-09T14:43:40.270 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-03-09T14:43:40.270 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-03-09T14:43:40.270 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-03-09T14:43:40.270 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-03-09T14:43:40.270 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-03-09T14:43:40.270 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-03-09T14:43:40.270 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-03-09T14:43:40.271 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-03-09T14:43:40.271 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-03-09T14:43:40.273 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-03-09T14:43:40.273 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-03-09T14:43:40.275 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-03-09T14:43:40.276 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-03-09T14:43:40.276 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-03-09T14:43:40.277 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-03-09T14:43:40.278 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-03-09T14:43:40.279 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-03-09T14:43:40.279 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-03-09T14:43:40.281 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-03-09T14:43:40.282 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-03-09T14:43:40.284 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-03-09T14:43:40.284 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-03-09T14:43:40.284 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-03-09T14:43:40.285 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-03-09T14:43:40.285 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-03-09T14:43:40.286 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-03-09T14:43:40.287 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-03-09T14:43:40.289 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-03-09T14:43:40.289 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-03-09T14:43:40.290 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-03-09T14:43:40.293 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-03-09T14:43:40.295 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-03-09T14:43:40.296 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-03-09T14:43:40.297 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-03-09T14:43:40.298 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-03-09T14:43:40.299 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-03-09T14:43:40.305 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-03-09T14:43:40.305 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-03-09T14:43:40.319 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-03-09T14:43:40.322 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-03-09T14:43:40.322 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-03-09T14:43:40.322 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-03-09T14:43:40.322 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-03-09T14:43:40.322 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-03-09T14:43:40.322 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-03-09T14:43:40.322 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-03-09T14:43:40.323 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-03-09T14:43:40.323 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-03-09T14:43:40.341 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-03-09T14:43:40.341 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-03-09T14:43:40.341 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-03-09T14:43:40.341 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-03-09T14:43:40.342 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-03-09T14:43:40.342 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-03-09T14:43:40.350 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-03-09T14:43:40.352 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-03-09T14:43:40.356 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-03-09T14:43:40.356 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-03-09T14:43:40.357 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-03-09T14:43:40.357 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-03-09T14:43:40.359 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-03-09T14:43:40.359 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-03-09T14:43:40.361 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-03-09T14:43:40.368 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-03-09T14:43:40.370 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-03-09T14:43:40.372 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-03-09T14:43:40.372 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-03-09T14:43:40.372 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-03-09T14:43:40.373 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-03-09T14:43:40.373 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-03-09T14:43:40.375 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-03-09T14:43:40.379 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-03-09T14:43:40.381 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-03-09T14:43:40.381 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-03-09T14:43:40.384 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-03-09T14:43:40.386 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-03-09T14:43:40.387 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-03-09T14:43:40.393 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-03-09T14:43:40.396 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-03-09T14:43:40.402 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-03-09T14:43:40.407 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-03-09T14:43:40.410 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-03-09T14:43:40.411 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-03-09T14:43:40.419 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-03-09T14:43:40.421 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-03-09T14:43:40.428 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-03-09T14:43:40.428 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-03-09T14:43:40.436 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-03-09T14:43:40.438 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-03-09T14:43:40.439 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-03-09T14:43:40.443 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-03-09T14:43:40.448 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-03-09T14:43:40.477 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-03-09T14:43:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-03-09T14:43:40.479 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-03-09T14:43:40.480 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-03-09T14:43:40.481 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-03-09T14:43:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-03-09T14:43:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-03-09T14:43:40.482 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-03-09T14:43:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-03-09T14:43:40.485 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-03-09T14:43:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-03-09T14:43:40.486 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-03-09T14:43:40.487 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-03-09T14:43:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-03-09T14:43:40.489 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-03-09T14:43:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-03-09T14:43:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-03-09T14:43:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-03-09T14:43:40.490 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-03-09T14:43:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-03-09T14:43:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-03-09T14:43:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-03-09T14:43:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-03-09T14:43:40.493 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-03-09T14:43:40.494 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-03-09T14:43:40.497 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-03-09T14:43:40.498 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-03-09T14:43:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-03-09T14:43:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-03-09T14:43:40.499 INFO:teuthology.orchestra.run.smithi088.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-03-09T14:43:40.538 INFO:teuthology.orchestra.run.smithi088.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-03-09T14:43:40.902 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:43:40.903 INFO:teuthology.orchestra.run.smithi088.stdout:Welcome to Gradle 6.0.1! 2024-03-09T14:43:40.903 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:43:40.903 INFO:teuthology.orchestra.run.smithi088.stdout:Here are the highlights of this release: 2024-03-09T14:43:40.903 INFO:teuthology.orchestra.run.smithi088.stdout: - Substantial improvements in dependency management, including 2024-03-09T14:43:40.903 INFO:teuthology.orchestra.run.smithi088.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-03-09T14:43:40.903 INFO:teuthology.orchestra.run.smithi088.stdout: - Advanced control of transitive versions 2024-03-09T14:43:40.903 INFO:teuthology.orchestra.run.smithi088.stdout: - Support for optional features and dependencies 2024-03-09T14:43:40.903 INFO:teuthology.orchestra.run.smithi088.stdout: - Rules to tweak published metadata 2024-03-09T14:43:40.903 INFO:teuthology.orchestra.run.smithi088.stdout: - Support for Java 13 2024-03-09T14:43:40.903 INFO:teuthology.orchestra.run.smithi088.stdout: - Faster incremental Java and Groovy compilation 2024-03-09T14:43:40.903 INFO:teuthology.orchestra.run.smithi088.stdout: - New Zinc compiler for Scala 2024-03-09T14:43:40.903 INFO:teuthology.orchestra.run.smithi088.stdout: - VS2019 support 2024-03-09T14:43:40.903 INFO:teuthology.orchestra.run.smithi088.stdout: - Support for Gradle Enterprise plugin 3.0 2024-03-09T14:43:40.904 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:43:40.904 INFO:teuthology.orchestra.run.smithi088.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-03-09T14:43:40.904 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:43:40.904 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:43:40.904 INFO:teuthology.orchestra.run.smithi088.stdout:------------------------------------------------------------ 2024-03-09T14:43:40.904 INFO:teuthology.orchestra.run.smithi088.stdout:Gradle 6.0.1 2024-03-09T14:43:40.904 INFO:teuthology.orchestra.run.smithi088.stdout:------------------------------------------------------------ 2024-03-09T14:43:40.904 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:43:40.904 INFO:teuthology.orchestra.run.smithi088.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-03-09T14:43:40.904 INFO:teuthology.orchestra.run.smithi088.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-03-09T14:43:40.904 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:43:40.904 INFO:teuthology.orchestra.run.smithi088.stdout:Kotlin: 1.3.50 2024-03-09T14:43:40.904 INFO:teuthology.orchestra.run.smithi088.stdout:Groovy: 2.5.8 2024-03-09T14:43:40.904 INFO:teuthology.orchestra.run.smithi088.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-03-09T14:43:40.904 INFO:teuthology.orchestra.run.smithi088.stdout:JVM: 11.0.18 (Red Hat, Inc. 11.0.18+10-LTS) 2024-03-09T14:43:40.905 INFO:teuthology.orchestra.run.smithi088.stdout:OS: Linux 5.14.0-427.el9.x86_64 amd64 2024-03-09T14:43:40.905 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:43:40.906 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-03-09T14:43:40.906 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-03-09T14:43:40.906 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi088.front.sepia.ceph.com 2024-03-09T14:43:40.907 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-03-09T14:43:40.907 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi132.front.sepia.ceph.com 2024-03-09T14:43:40.907 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-03-09T14:43:41.128 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-03-09T14:43:41.128 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-03-09T14:43:41.128 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'UXRJQEQHXSFOFQZAYRAJ', 'access_secret': 'iimQba0Uv1UTsosIADThGWpPLBnqQJbjsgaxOGtl1W3h+d2r2FgLnA==', 'region': 'mexico', 'endpoint': 'smithi088.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi088.front.sepia.ceph.com'} 2024-03-09T14:43:41.128 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-03-09T14:43:41.128 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'UXRJQEQHXSFOFQZAYRAJ', '--secret', 'iimQba0Uv1UTsosIADThGWpPLBnqQJbjsgaxOGtl1W3h+d2r2FgLnA==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-03-09T14:43:41.128 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key UXRJQEQHXSFOFQZAYRAJ --secret iimQba0Uv1UTsosIADThGWpPLBnqQJbjsgaxOGtl1W3h+d2r2FgLnA== --email tester.client.0_test@test.test --cluster ceph 2024-03-09T14:43:41.189 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:41.189 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:41.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.219+0000 7f0d077af800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.220+0000 7f0d077af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.220+0000 7f0d077af800 20 realm 2024-03-09T14:43:41.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.220+0000 7f0d077af800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.220+0000 7f0d077af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.220+0000 7f0d077af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:41.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.220+0000 7f0d077af800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.220+0000 7f0d077af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.220+0000 7f0d077af800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.221+0000 7f0d077af800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:41.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.221+0000 7f0d077af800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.222+0000 7f0d077af800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:41.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.222+0000 7f0d077af800 20 searching for the correct realm 2024-03-09T14:43:41.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.225+0000 7f0d05aac640 0 -- 172.21.15.88:0/2815989908 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f0d00029060 msgr2=0x7f0d00015ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:41.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.229+0000 7f0d04aaa640 0 -- 172.21.15.88:0/2815989908 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f0d000093a0 msgr2=0x7f0d00072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:41.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.435+0000 7f0d077af800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:41.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.435+0000 7f0d077af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:41.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.435+0000 7f0d077af800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:41.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.435+0000 7f0d077af800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:41.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.435+0000 7f0d077af800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:41.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.435+0000 7f0d077af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:41.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.436+0000 7f0d077af800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.436+0000 7f0d077af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.436+0000 7f0d077af800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.436+0000 7f0d077af800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:41.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.436+0000 7f0d077af800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.437+0000 7f0d077af800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.437+0000 7f0d077af800 20 zone default found 2024-03-09T14:43:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.437+0000 7f0d077af800 4 Realm: () 2024-03-09T14:43:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.437+0000 7f0d077af800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.437+0000 7f0d077af800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.437+0000 7f0d077af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.437+0000 7f0d077af800 20 zonegroup default 2024-03-09T14:43:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.437+0000 7f0d077af800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.437+0000 7f0d077af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.437+0000 7f0d077af800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.437+0000 7f0d077af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.437+0000 7f0d077af800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.437+0000 7f0d077af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.437+0000 7f0d077af800 20 started sync module instance, tier type = 2024-03-09T14:43:41.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.437+0000 7f0d077af800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.448+0000 7f0d077af800 20 add_watcher() i=0 2024-03-09T14:43:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.448+0000 7f0d077af800 20 add_watcher() i=1 2024-03-09T14:43:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.448+0000 7f0d077af800 20 add_watcher() i=2 2024-03-09T14:43:41.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.448+0000 7f0d077af800 20 add_watcher() i=3 2024-03-09T14:43:41.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.448+0000 7f0d077af800 20 add_watcher() i=4 2024-03-09T14:43:41.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.448+0000 7f0d077af800 20 add_watcher() i=5 2024-03-09T14:43:41.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.448+0000 7f0d077af800 20 add_watcher() i=6 2024-03-09T14:43:41.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.448+0000 7f0d077af800 20 add_watcher() i=7 2024-03-09T14:43:41.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.448+0000 7f0d077af800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.450+0000 7f0bbb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.450+0000 7f0d077af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.450+0000 7f0d077af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.450+0000 7f0d077af800 5 note: GC not initialized 2024-03-09T14:43:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.451+0000 7f0bba7e4640 20 reqs_thread_entry: start 2024-03-09T14:43:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.451+0000 7f0d077af800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.451+0000 7f0d077af800 20 Filter name: none 2024-03-09T14:43:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.451+0000 7f0b2bfff640 20 reqs_thread_entry: start 2024-03-09T14:43:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.451+0000 7f0d077af800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-03-09T14:43:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.451+0000 7f0d077af800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.451+0000 7f0d077af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.451+0000 7f0d077af800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-03-09T14:43:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.451+0000 7f0d077af800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-09T14:43:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.451+0000 7f0d077af800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-03-09T14:43:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.451+0000 7f0d077af800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.452+0000 7f0d077af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.452+0000 7f0d077af800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-03-09T14:43:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.452+0000 7f0d077af800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-03-09T14:43:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.452+0000 7f0d077af800 10 cache get: name=default.rgw.meta+users.keys+UXRJQEQHXSFOFQZAYRAJ : miss 2024-03-09T14:43:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.452+0000 7f0d077af800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.452+0000 7f0d077af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.452+0000 7f0d077af800 10 cache put: name=default.rgw.meta+users.keys+UXRJQEQHXSFOFQZAYRAJ info.flags=0x0 2024-03-09T14:43:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.452+0000 7f0d077af800 10 adding default.rgw.meta+users.keys+UXRJQEQHXSFOFQZAYRAJ to cache LRU end 2024-03-09T14:43:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.452+0000 7f0d077af800 10 cache get: name=default.rgw.meta+users.keys+UXRJQEQHXSFOFQZAYRAJ : hit (negative entry) 2024-03-09T14:43:41.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.452+0000 7f0d077af800 10 cache get: name=default.rgw.meta+users.keys+UXRJQEQHXSFOFQZAYRAJ : hit (negative entry) 2024-03-09T14:43:41.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.453+0000 7f0d077af800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-03-09T14:43:41.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.453+0000 7f0d077af800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-09T14:43:41.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.453+0000 7f0d077af800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-03-09T14:43:41.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.454+0000 7f0be8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464304 cookie 94187040017392 notifier 7359 bl.length()=670 2024-03-09T14:43:41.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.454+0000 7f0be8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-03-09T14:43:41.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.454+0000 7f0be8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-09T14:43:41.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.456+0000 7f0d077af800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-03-09T14:43:41.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.456+0000 7f0d077af800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-03-09T14:43:41.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.456+0000 7f0d077af800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-03-09T14:43:41.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.457+0000 7f0be8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 94187040012640 notifier 7359 bl.length()=200 2024-03-09T14:43:41.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.457+0000 7f0be8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-03-09T14:43:41.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.457+0000 7f0be8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-03-09T14:43:41.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.459+0000 7f0d077af800 10 cache put: name=default.rgw.meta+users.keys+UXRJQEQHXSFOFQZAYRAJ info.flags=0x7 2024-03-09T14:43:41.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.459+0000 7f0d077af800 10 moving default.rgw.meta+users.keys+UXRJQEQHXSFOFQZAYRAJ to cache LRU end 2024-03-09T14:43:41.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.459+0000 7f0d077af800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:UXRJQEQHXSFOFQZAYRAJ, ofs0, ns] 2024-03-09T14:43:41.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.459+0000 7f0be8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464378 cookie 94187040002672 notifier 7359 bl.length()=189 2024-03-09T14:43:41.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.459+0000 7f0be8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+UXRJQEQHXSFOFQZAYRAJ info.flags=0x7 2024-03-09T14:43:41.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.459+0000 7f0be8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+UXRJQEQHXSFOFQZAYRAJ to cache LRU end 2024-03-09T14:43:41.462 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T14:43:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "user_id": "tester.client.0", 2024-03-09T14:43:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "display_name": "Ms. tester.client.0", 2024-03-09T14:43:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "email": "tester.client.0_test@test.test", 2024-03-09T14:43:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "suspended": 0, 2024-03-09T14:43:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:43:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "subusers": [], 2024-03-09T14:43:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "keys": [ 2024-03-09T14:43:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-03-09T14:43:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "user": "tester.client.0", 2024-03-09T14:43:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "access_key": "UXRJQEQHXSFOFQZAYRAJ", 2024-03-09T14:43:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "secret_key": "iimQba0Uv1UTsosIADThGWpPLBnqQJbjsgaxOGtl1W3h+d2r2FgLnA==", 2024-03-09T14:43:41.462 INFO:teuthology.orchestra.run.smithi088.stdout: "active": true, 2024-03-09T14:43:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:43:41.453696Z" 2024-03-09T14:43:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-03-09T14:43:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T14:43:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "swift_keys": [], 2024-03-09T14:43:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": [], 2024-03-09T14:43:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "op_mask": "read, write, delete", 2024-03-09T14:43:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "default_placement": "", 2024-03-09T14:43:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "default_storage_class": "", 2024-03-09T14:43:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "placement_tags": [], 2024-03-09T14:43:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "bucket_quota": { 2024-03-09T14:43:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:43:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:43:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:43:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:43:41.463 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:43:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:43:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "user_quota": { 2024-03-09T14:43:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:43:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:43:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:43:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:43:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:43:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:43:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "temp_url_keys": [], 2024-03-09T14:43:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "rgw", 2024-03-09T14:43:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "mfa_ids": [], 2024-03-09T14:43:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "account_id": "", 2024-03-09T14:43:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "path": "/", 2024-03-09T14:43:41.464 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:43:41.453685Z", 2024-03-09T14:43:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: "tags": [], 2024-03-09T14:43:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: "group_ids": [] 2024-03-09T14:43:41.465 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T14:43:41.465 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:43:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.461+0000 7f0bbb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.464+0000 7f0d077af800 20 remove_watcher() i=0 2024-03-09T14:43:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.464+0000 7f0d077af800 2 removed watcher, disabling cache 2024-03-09T14:43:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.465+0000 7f0d077af800 20 remove_watcher() i=1 2024-03-09T14:43:41.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.466+0000 7f0d077af800 20 remove_watcher() i=2 2024-03-09T14:43:41.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.467+0000 7f0d077af800 20 remove_watcher() i=3 2024-03-09T14:43:41.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.469+0000 7f0d077af800 20 remove_watcher() i=4 2024-03-09T14:43:41.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.470+0000 7f0d077af800 20 remove_watcher() i=5 2024-03-09T14:43:41.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.471+0000 7f0d077af800 20 remove_watcher() i=6 2024-03-09T14:43:41.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.472+0000 7f0d077af800 20 remove_watcher() i=7 2024-03-09T14:43:41.483 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:43:41.484 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-03-09T14:43:41.513 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-03-09T14:43:41.513 DEBUG:teuthology.orchestra.run.smithi088:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-03-09T14:43:41.579 DEBUG:teuthology.orchestra.run.smithi088:> radosgw-admin gc process --include-all 2024-03-09T14:43:41.668 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:41.668 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:41.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.700+0000 7f1588cc0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.701+0000 7f1588cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.701+0000 7f1588cc0800 20 realm 2024-03-09T14:43:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.701+0000 7f1588cc0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.701+0000 7f1588cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.701+0000 7f1588cc0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.701+0000 7f1588cc0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.702+0000 7f1588cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.702+0000 7f1588cc0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.702+0000 7f1588cc0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.702+0000 7f1588cc0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.703+0000 7f1588cc0800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.703+0000 7f1588cc0800 20 searching for the correct realm 2024-03-09T14:43:41.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.706+0000 7f1586fc4640 0 -- 172.21.15.88:0/432889937 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f1578029040 msgr2=0x7f157804c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:41.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.709+0000 7f1585fc2640 0 -- 172.21.15.88:0/432889937 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f157803e910 msgr2=0x7f1578062400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:41.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.915+0000 7f1588cc0800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:41.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.915+0000 7f1588cc0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:41.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.915+0000 7f1588cc0800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:41.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.915+0000 7f1588cc0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:41.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.915+0000 7f1588cc0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:41.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.915+0000 7f1588cc0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:41.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.915+0000 7f1588cc0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.916+0000 7f1588cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.916+0000 7f1588cc0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.916+0000 7f1588cc0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.916+0000 7f1588cc0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.916+0000 7f1588cc0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.916+0000 7f1588cc0800 20 zone default found 2024-03-09T14:43:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.916+0000 7f1588cc0800 4 Realm: () 2024-03-09T14:43:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.916+0000 7f1588cc0800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.916+0000 7f1588cc0800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.916+0000 7f1588cc0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.916+0000 7f1588cc0800 20 zonegroup default 2024-03-09T14:43:41.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.916+0000 7f1588cc0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.917+0000 7f1588cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.917+0000 7f1588cc0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.917+0000 7f1588cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.917+0000 7f1588cc0800 20 rados->read ofs=0 len=0 2024-03-09T14:43:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.917+0000 7f1588cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.917+0000 7f1588cc0800 20 started sync module instance, tier type = 2024-03-09T14:43:41.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.917+0000 7f1588cc0800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:41.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.927+0000 7f1588cc0800 20 add_watcher() i=0 2024-03-09T14:43:41.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.927+0000 7f1588cc0800 20 add_watcher() i=1 2024-03-09T14:43:41.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.927+0000 7f1588cc0800 20 add_watcher() i=2 2024-03-09T14:43:41.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.927+0000 7f1588cc0800 20 add_watcher() i=3 2024-03-09T14:43:41.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.927+0000 7f1588cc0800 20 add_watcher() i=4 2024-03-09T14:43:41.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.927+0000 7f1588cc0800 20 add_watcher() i=5 2024-03-09T14:43:41.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.927+0000 7f1588cc0800 20 add_watcher() i=6 2024-03-09T14:43:41.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.928+0000 7f1588cc0800 20 add_watcher() i=7 2024-03-09T14:43:41.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.928+0000 7f1588cc0800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:41.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.930+0000 7f143cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:41.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.930+0000 7f1588cc0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:41.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.930+0000 7f1588cc0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:41.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.969+0000 7f13b77fe640 20 reqs_thread_entry: start 2024-03-09T14:43:41.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.969+0000 7f1588cc0800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.969+0000 7f1588cc0800 20 Filter name: none 2024-03-09T14:43:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.970+0000 7f13b57fa640 20 reqs_thread_entry: start 2024-03-09T14:43:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.970+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:43:41.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.972+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:41.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.972+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:41.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.973+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:41.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.974+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:43:41.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.976+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:41.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.976+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:41.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.976+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:43:41.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.976+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='_KcrFsIgr7SaND15OeRYdTlPAi9r-sM9', time=2024-03-09T16:38:58.429493+0000, chain.objs.size()=1 2024-03-09T14:43:41.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.976+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.F4KfXIuWZqxsfemaROlaLqa55ODa3Kv_0 2024-03-09T14:43:41.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.976+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='_6qxzxfSE2zqFM3iZQoLYAI21-lghLFP', time=2024-03-09T16:38:58.433689+0000, chain.objs.size()=2 2024-03-09T14:43:41.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.976+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.maRkvruhOmaP4WnLgb6lK_hQGvYArDD_1 2024-03-09T14:43:41.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.976+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.maRkvruhOmaP4WnLgb6lK_hQGvYArDD_2 2024-03-09T14:43:41.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.978+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:41.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.980+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:43:41.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.982+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:41.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.982+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.983+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:43:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.983+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.499911422795892007', time=2024-03-09T16:38:58.268106+0000, chain.objs.size()=7 2024-03-09T14:43:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.983+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.11__multipart_foo.2~EufE9xLS4ez1NslZT-CgGPKdROx24TO.1 2024-03-09T14:43:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.983+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.11__shadow_foo.2~EufE9xLS4ez1NslZT-CgGPKdROx24TO.1_1 2024-03-09T14:43:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.983+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.11__multipart_foo.2~EufE9xLS4ez1NslZT-CgGPKdROx24TO.2 2024-03-09T14:43:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.983+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.11__shadow_foo.2~EufE9xLS4ez1NslZT-CgGPKdROx24TO.2_1 2024-03-09T14:43:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.983+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.11__multipart_foo.2~EufE9xLS4ez1NslZT-CgGPKdROx24TO.3 2024-03-09T14:43:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.983+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.11__shadow_foo.2~EufE9xLS4ez1NslZT-CgGPKdROx24TO.3_1 2024-03-09T14:43:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.983+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.11__multipart_foo.2~EufE9xLS4ez1NslZT-CgGPKdROx24TO.4 2024-03-09T14:43:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.983+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='_NXS0qq8_ijFIZt_-sRFJIQ7jg6MqI-C', time=2024-03-09T16:38:58.366273+0000, chain.objs.size()=1 2024-03-09T14:43:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.983+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.AEz6QF8TQDvQAVeLbX1oxUSGqrIWrb7_0 2024-03-09T14:43:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.983+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.4807286568122487429', time=2024-03-09T16:38:58.450559+0000, chain.objs.size()=3 2024-03-09T14:43:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.983+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.1 2024-03-09T14:43:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.983+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.2 2024-03-09T14:43:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.983+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.3 2024-03-09T14:43:41.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.987+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:41.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.992+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:43:41.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.994+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:41.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.994+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:41.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.994+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:41.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.995+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:43:41.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.997+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:41.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.997+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:41.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.997+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:43:41.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.997+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='_aKbgNUMMe0Ry89v1DsTMd00u2J5w6Z2', time=2024-03-09T16:38:58.470126+0000, chain.objs.size()=1 2024-03-09T14:43:41.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.997+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.vC8U2_S69GWmGtCB-y-P1wuNPbTCvV4_0 2024-03-09T14:43:41.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:41.999+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:42.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.001+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:43:42.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.002+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.003+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.003+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.004+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:43:42.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.005+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.006+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.006+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.007+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:43:42.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.008+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.009+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.009+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.010+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:43:42.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.012+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.012+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.012+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.014+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:43:42.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.015+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.015+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.016+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.016+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:43:42.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.018+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.018+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.019+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:43:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.019+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.5585965323241947299', time=2024-03-09T16:38:58.345021+0000, chain.objs.size()=4 2024-03-09T14:43:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.019+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.9__multipart_foo.2~gUW_pyiJrHWCBVi4kJe1ca8GpI5EKV2.1 2024-03-09T14:43:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.019+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.9__multipart_foo.2~gUW_pyiJrHWCBVi4kJe1ca8GpI5EKV2.2 2024-03-09T14:43:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.019+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.9__multipart_foo.2~gUW_pyiJrHWCBVi4kJe1ca8GpI5EKV2.3 2024-03-09T14:43:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.019+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.9__multipart_foo.2~gUW_pyiJrHWCBVi4kJe1ca8GpI5EKV2.4 2024-03-09T14:43:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.019+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='_ToFkVamBo-wzMmTXbuCwfMNuSp7pbii', time=2024-03-09T16:38:58.370074+0000, chain.objs.size()=1 2024-03-09T14:43:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.019+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.B5E0LEDV-HAy3fYIzXh6DNoNUT7MkKI_1 2024-03-09T14:43:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.019+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.15123367768708589405', time=2024-03-09T16:38:58.533638+0000, chain.objs.size()=3 2024-03-09T14:43:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.019+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.a9aMjPetOmC0gK8oi7P6SHZF8maJ56x_0 2024-03-09T14:43:42.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.019+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.a9aMjPetOmC0gK8oi7P6SHZF8maJ56x_1 2024-03-09T14:43:42.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.019+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.a9aMjPetOmC0gK8oi7P6SHZF8maJ56x_2 2024-03-09T14:43:42.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.022+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:42.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.025+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:43:42.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.026+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.027+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.027+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.028+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:43:42.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.030+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.030+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.031+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:43:42.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.031+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.2660220837802682174', time=2024-03-09T16:38:58.291239+0000, chain.objs.size()=4 2024-03-09T14:43:42.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.031+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.12__multipart_foo.2~8MS8pGFK7fS6GSn_ehGHEzPX1ye_UcG.1 2024-03-09T14:43:42.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.031+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.12__multipart_foo.2~8MS8pGFK7fS6GSn_ehGHEzPX1ye_UcG.2 2024-03-09T14:43:42.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.031+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.12__multipart_foo.2~8MS8pGFK7fS6GSn_ehGHEzPX1ye_UcG.3 2024-03-09T14:43:42.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.031+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.12__multipart_foo.2~8MS8pGFK7fS6GSn_ehGHEzPX1ye_UcG.4 2024-03-09T14:43:42.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.031+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.5900966760691061218', time=2024-03-09T16:38:58.374018+0000, chain.objs.size()=2 2024-03-09T14:43:42.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.031+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.jtWI45HiMo7lXBzZFFlXiRJNXKwNyZ6_0 2024-03-09T14:43:42.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.031+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.jtWI45HiMo7lXBzZFFlXiRJNXKwNyZ6_1 2024-03-09T14:43:42.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.031+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='_i0TpZXnGlLlChfMoCDrTZ0sRIYJqlGL', time=2024-03-09T16:38:58.382830+0000, chain.objs.size()=2 2024-03-09T14:43:42.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.031+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.dA_zXQLvmZScSd00gj3wC96QMkEXPxB_0 2024-03-09T14:43:42.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.031+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.dA_zXQLvmZScSd00gj3wC96QMkEXPxB_1 2024-03-09T14:43:42.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.033+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:42.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.035+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:43:42.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.037+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.037+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.037+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:43:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.037+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='_HlXaIHoAT2Nk50weNyt7PD8JA16hfDl', time=2024-03-09T16:38:58.454333+0000, chain.objs.size()=2 2024-03-09T14:43:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.037+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.qN3TIL_-AQ2gW95li3KjdcpN-5gqquQ_1 2024-03-09T14:43:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.037+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.qN3TIL_-AQ2gW95li3KjdcpN-5gqquQ_2 2024-03-09T14:43:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.038+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.3502696965148644538', time=2024-03-09T16:38:58.500722+0000, chain.objs.size()=5 2024-03-09T14:43:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.038+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-STANDARD.2~R-eNn3OKzO6qalVZ_HqEbwoXWozSboB.1 2024-03-09T14:43:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.038+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.14__shadow_foo-STANDARD.2~R-eNn3OKzO6qalVZ_HqEbwoXWozSboB.1_1 2024-03-09T14:43:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.038+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-STANDARD.2~R-eNn3OKzO6qalVZ_HqEbwoXWozSboB.2 2024-03-09T14:43:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.038+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.14__shadow_foo-STANDARD.2~R-eNn3OKzO6qalVZ_HqEbwoXWozSboB.2_1 2024-03-09T14:43:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.038+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-STANDARD.2~R-eNn3OKzO6qalVZ_HqEbwoXWozSboB.3 2024-03-09T14:43:42.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.042+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:42.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.045+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:43:42.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.046+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.046+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.047+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.048+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:43:42.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.049+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.049+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.049+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:43:42.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.049+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='_-Avkg243ljd_p-KnIRp9onCMgernPWP', time=2024-03-09T16:38:58.389948+0000, chain.objs.size()=1 2024-03-09T14:43:42.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.049+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.6kYG1TJini1PsCBHGQaKxSJ-7ZsTSYu_1 2024-03-09T14:43:42.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.049+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.1207189700594557683', time=2024-03-09T16:38:58.394083+0000, chain.objs.size()=2 2024-03-09T14:43:42.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.049+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.bRGqiXmEiruuv0SsyijSOyVt66G4K9D_0 2024-03-09T14:43:42.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.049+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.bRGqiXmEiruuv0SsyijSOyVt66G4K9D_1 2024-03-09T14:43:42.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.049+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='_h1eJbveyQBh3m5574UmZJ6Vb3_5g57C', time=2024-03-09T16:38:58.442347+0000, chain.objs.size()=3 2024-03-09T14:43:42.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.049+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.jAPjlIeTembttvTmA6tJ9Zk8X48Nk7n_0 2024-03-09T14:43:42.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.050+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.jAPjlIeTembttvTmA6tJ9Zk8X48Nk7n_1 2024-03-09T14:43:42.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.050+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.jAPjlIeTembttvTmA6tJ9Zk8X48Nk7n_2 2024-03-09T14:43:42.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.052+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:42.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.054+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:43:42.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.056+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.056+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.056+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.057+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:43:42.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.059+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.059+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.060+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.061+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:43:42.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.062+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.063+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.063+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:43:42.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.063+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.1_1_233607a54e92919d7d9a8e02002add61', time=2024-03-09T16:38:58.466195+0000, chain.objs.size()=5 2024-03-09T14:43:42.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.063+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.1 2024-03-09T14:43:42.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.063+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.1_1 2024-03-09T14:43:42.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.063+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.2 2024-03-09T14:43:42.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.063+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.2_1 2024-03-09T14:43:42.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.063+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.3 2024-03-09T14:43:42.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.063+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.5153703377380384062', time=2024-03-09T16:38:58.529647+0000, chain.objs.size()=2 2024-03-09T14:43:42.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.063+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.TNZT6MuDSE3tapn7hMctqorwckuGqRj_1 2024-03-09T14:43:42.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.063+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.TNZT6MuDSE3tapn7hMctqorwckuGqRj_2 2024-03-09T14:43:42.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.066+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:42.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.068+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:43:42.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.069+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.069+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.070+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:43:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.070+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.14008001577541680239', time=2024-03-09T16:38:58.438152+0000, chain.objs.size()=5 2024-03-09T14:43:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.070+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.1 2024-03-09T14:43:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.070+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.1_1 2024-03-09T14:43:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.070+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.2 2024-03-09T14:43:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.070+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.2_1 2024-03-09T14:43:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.070+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.3 2024-03-09T14:43:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.070+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.16062835292307631892', time=2024-03-09T16:38:58.525751+0000, chain.objs.size()=3 2024-03-09T14:43:42.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.070+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.nTpmeLXLygr9527KvbIUCpoVARisJWg_0 2024-03-09T14:43:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.070+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.nTpmeLXLygr9527KvbIUCpoVARisJWg_1 2024-03-09T14:43:42.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.070+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.13__shadow_.nTpmeLXLygr9527KvbIUCpoVARisJWg_2 2024-03-09T14:43:42.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.072+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:42.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.074+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:43:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.075+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.076+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.076+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:43:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.076+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.12576964596656894812', time=2024-03-09T16:38:58.504406+0000, chain.objs.size()=5 2024-03-09T14:43:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.076+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-LUKEWARM.2~So04ybmlWiaOlXP-lrgAhmdS5OWZTBj.1 2024-03-09T14:43:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.076+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.14__shadow_foo-LUKEWARM.2~So04ybmlWiaOlXP-lrgAhmdS5OWZTBj.1_1 2024-03-09T14:43:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.076+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-LUKEWARM.2~So04ybmlWiaOlXP-lrgAhmdS5OWZTBj.2 2024-03-09T14:43:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.076+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.14__shadow_foo-LUKEWARM.2~So04ybmlWiaOlXP-lrgAhmdS5OWZTBj.2_1 2024-03-09T14:43:42.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.076+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-LUKEWARM.2~So04ybmlWiaOlXP-lrgAhmdS5OWZTBj.3 2024-03-09T14:43:42.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.078+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:42.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.080+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:43:42.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.082+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.082+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.082+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.083+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:43:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.085+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.086+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.086+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.087+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:43:42.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.088+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.089+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.089+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:43:42.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.089+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.12962140939360709960', time=2024-03-09T16:38:58.319214+0000, chain.objs.size()=4 2024-03-09T14:43:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.089+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.10__multipart_foo.2~SCv3RcY2iKUR_zepid1qU8MifKpmeTL.1 2024-03-09T14:43:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.089+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.10__multipart_foo.2~SCv3RcY2iKUR_zepid1qU8MifKpmeTL.2 2024-03-09T14:43:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.089+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.10__multipart_foo.2~SCv3RcY2iKUR_zepid1qU8MifKpmeTL.3 2024-03-09T14:43:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.089+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.10__multipart_foo.2~SCv3RcY2iKUR_zepid1qU8MifKpmeTL.4 2024-03-09T14:43:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.089+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='_s-44dG5yqeVyUV2q27NP-6VbDGQUSux', time=2024-03-09T16:38:58.446261+0000, chain.objs.size()=3 2024-03-09T14:43:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.089+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.T5u9FIkU6_KYdljQL81Pmhjgz964BRZ_0 2024-03-09T14:43:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.089+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.T5u9FIkU6_KYdljQL81Pmhjgz964BRZ_1 2024-03-09T14:43:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.089+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_.T5u9FIkU6_KYdljQL81Pmhjgz964BRZ_2 2024-03-09T14:43:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.092+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:42.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.094+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:43:42.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.095+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.096+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.096+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.097+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:43:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.098+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.098+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.098+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:43:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.098+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.bRGqiXmEiruuv0SsyijSOyVt66G4K9D_1_79dbdc839ee4f65f864eef0f937b3fb9', time=2024-03-09T16:38:58.400457+0000, chain.objs.size()=2 2024-03-09T14:43:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.098+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.bRGqiXmEiruuv0SsyijSOyVt66G4K9D_0 2024-03-09T14:43:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.098+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.bRGqiXmEiruuv0SsyijSOyVt66G4K9D_1 2024-03-09T14:43:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.100+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.102+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:43:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.103+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.103+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.104+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:43:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.104+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.6007763366985585920', time=2024-03-09T16:38:58.496436+0000, chain.objs.size()=5 2024-03-09T14:43:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.104+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-FROZEN.2~DTk8hRuSzK_UfTkEk4laHlrW1P0Ew56.1 2024-03-09T14:43:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.104+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.14__shadow_foo-FROZEN.2~DTk8hRuSzK_UfTkEk4laHlrW1P0Ew56.1_1 2024-03-09T14:43:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.104+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-FROZEN.2~DTk8hRuSzK_UfTkEk4laHlrW1P0Ew56.2 2024-03-09T14:43:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.104+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.14__shadow_foo-FROZEN.2~DTk8hRuSzK_UfTkEk4laHlrW1P0Ew56.2_1 2024-03-09T14:43:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.104+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.14__multipart_foo-FROZEN.2~DTk8hRuSzK_UfTkEk4laHlrW1P0Ew56.3 2024-03-09T14:43:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.106+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.108+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:43:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.109+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.110+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.110+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.111+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:43:42.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.112+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.113+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.113+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:43:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.113+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.1_1_5f3857a75db6caf06c290bbc31919872', time=2024-03-09T16:38:58.474303+0000, chain.objs.size()=5 2024-03-09T14:43:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.113+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.1 2024-03-09T14:43:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.113+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.1_1 2024-03-09T14:43:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.113+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.2 2024-03-09T14:43:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.113+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.2_1 2024-03-09T14:43:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.113+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-FROZEN.2~t0InmUnPQdL8zopWnV1B6H0HDDd8-CU.3 2024-03-09T14:43:42.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.115+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.116+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:43:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.118+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.118+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.118+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:43:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.118+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.2_d11d09c0760f96b2ef3154947dd73449', time=2024-03-09T16:38:58.462174+0000, chain.objs.size()=3 2024-03-09T14:43:42.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.118+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.1 2024-03-09T14:43:42.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.118+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.2 2024-03-09T14:43:42.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.118+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-STANDARD.2~g1Kpn0PLvh3TAkzeEvN8Ft6Qsec1FOT.3 2024-03-09T14:43:42.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.120+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:42.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.122+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:43:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.123+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.124+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.124+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T14:43:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.124+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='_kOA6h9WCN3wrn1hVR4pSdBx12PqsELS', time=2024-03-09T16:38:58.378828+0000, chain.objs.size()=2 2024-03-09T14:43:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.124+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.8xJbHkn8SxR-qQauhBu32d53BIBK2g7_0 2024-03-09T14:43:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.124+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.8xJbHkn8SxR-qQauhBu32d53BIBK2g7_1 2024-03-09T14:43:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.124+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='_XmUW5owa_8MwFWsEf08KrMRjhpUXWYX', time=2024-03-09T16:38:58.404416+0000, chain.objs.size()=1 2024-03-09T14:43:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.124+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.9wYyLMElR3ZuKlECbJS8zCnG96DfrKD_0 2024-03-09T14:43:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.124+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.jtWI45HiMo7lXBzZFFlXiRJNXKwNyZ6_1_c8a14ad8555acce6468ff6f7f897b947', time=2024-03-09T16:38:58.408253+0000, chain.objs.size()=2 2024-03-09T14:43:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.124+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.jtWI45HiMo7lXBzZFFlXiRJNXKwNyZ6_0 2024-03-09T14:43:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.125+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.15__shadow_.jtWI45HiMo7lXBzZFFlXiRJNXKwNyZ6_1 2024-03-09T14:43:42.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.125+0000 7f1588cc0800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.3463609096063432335', time=2024-03-09T16:38:58.458159+0000, chain.objs.size()=5 2024-03-09T14:43:42.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.125+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.1 2024-03-09T14:43:42.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.125+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.1_1 2024-03-09T14:43:42.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.125+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.2 2024-03-09T14:43:42.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.125+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.16__shadow_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.2_1 2024-03-09T14:43:42.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.125+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.16__multipart_foo-LUKEWARM.2~RHpSleC3-n8bn4_Uvw1dkOnVayTXVBA.3 2024-03-09T14:43:42.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.127+0000 7f1588cc0800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:43:42.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.129+0000 7f1588cc0800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:43:42.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.130+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.131+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.131+0000 7f1588cc0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.133+0000 7f143cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:42.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.135+0000 7f1588cc0800 20 remove_watcher() i=0 2024-03-09T14:43:42.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.135+0000 7f1588cc0800 2 removed watcher, disabling cache 2024-03-09T14:43:42.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.136+0000 7f1588cc0800 20 remove_watcher() i=1 2024-03-09T14:43:42.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.137+0000 7f1588cc0800 20 remove_watcher() i=2 2024-03-09T14:43:42.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.138+0000 7f1588cc0800 20 remove_watcher() i=3 2024-03-09T14:43:42.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.139+0000 7f1588cc0800 20 remove_watcher() i=4 2024-03-09T14:43:42.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.140+0000 7f1588cc0800 20 remove_watcher() i=5 2024-03-09T14:43:42.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.141+0000 7f1588cc0800 20 remove_watcher() i=6 2024-03-09T14:43:42.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.142+0000 7f1588cc0800 20 remove_watcher() i=7 2024-03-09T14:43:42.153 DEBUG:teuthology.orchestra.run.smithi088:> radosgw-admin gc process --include-all 2024-03-09T14:43:42.201 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:42.201 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:42.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.234+0000 7f87a893c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:42.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.235+0000 7f87a893c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:42.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.235+0000 7f87a893c800 20 realm 2024-03-09T14:43:42.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.235+0000 7f87a893c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:42.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.235+0000 7f87a893c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:42.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.235+0000 7f87a893c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:42.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.235+0000 7f87a893c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.235+0000 7f87a893c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.236+0000 7f87a893c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.236+0000 7f87a893c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.236+0000 7f87a893c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.237+0000 7f87a893c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.237+0000 7f87a893c800 20 searching for the correct realm 2024-03-09T14:43:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.239+0000 7f87a4efb640 0 -- 172.21.15.88:0/1946074831 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f879c08e040 msgr2=0x7f879c081440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.243+0000 7f87a3ef9640 0 -- 172.21.15.88:0/1946074831 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f879c067070 msgr2=0x7f879c08e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:43:42.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.449+0000 7f87a893c800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:43:42.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.449+0000 7f87a893c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:42.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.449+0000 7f87a893c800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:43:42.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.449+0000 7f87a893c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:42.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.449+0000 7f87a893c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:42.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.449+0000 7f87a893c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:42.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.449+0000 7f87a893c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:42.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.449+0000 7f87a893c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:42.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.449+0000 7f87a893c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:42.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.449+0000 7f87a893c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:42.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.449+0000 7f87a893c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:42.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.449+0000 7f87a893c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:42.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.450+0000 7f87a893c800 20 zone default found 2024-03-09T14:43:42.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.450+0000 7f87a893c800 4 Realm: () 2024-03-09T14:43:42.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.450+0000 7f87a893c800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:43:42.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.450+0000 7f87a893c800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:43:42.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.450+0000 7f87a893c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:42.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.450+0000 7f87a893c800 20 zonegroup default 2024-03-09T14:43:42.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.450+0000 7f87a893c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:42.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.450+0000 7f87a893c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:42.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.450+0000 7f87a893c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:42.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.450+0000 7f87a893c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:42.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.450+0000 7f87a893c800 20 rados->read ofs=0 len=0 2024-03-09T14:43:42.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.450+0000 7f87a893c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:42.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.450+0000 7f87a893c800 20 started sync module instance, tier type = 2024-03-09T14:43:42.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.450+0000 7f87a893c800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:43:42.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.459+0000 7f87a893c800 20 add_watcher() i=0 2024-03-09T14:43:42.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.459+0000 7f87a893c800 20 add_watcher() i=1 2024-03-09T14:43:42.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.459+0000 7f87a893c800 20 add_watcher() i=2 2024-03-09T14:43:42.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.459+0000 7f87a893c800 20 add_watcher() i=3 2024-03-09T14:43:42.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.459+0000 7f87a893c800 20 add_watcher() i=4 2024-03-09T14:43:42.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.459+0000 7f87a893c800 20 add_watcher() i=5 2024-03-09T14:43:42.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.459+0000 7f87a893c800 20 add_watcher() i=6 2024-03-09T14:43:42.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.460+0000 7f87a893c800 20 add_watcher() i=7 2024-03-09T14:43:42.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.460+0000 7f87a893c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:42.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.462+0000 7f865afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:42.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.462+0000 7f87a893c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:42.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.462+0000 7f87a893c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:42.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.496+0000 7f8659fdb640 20 reqs_thread_entry: start 2024-03-09T14:43:42.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.496+0000 7f87a893c800 20 init_complete bucket index max shards: 11 2024-03-09T14:43:42.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.496+0000 7f87a893c800 20 Filter name: none 2024-03-09T14:43:42.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.496+0000 7f85cb7fe640 20 reqs_thread_entry: start 2024-03-09T14:43:42.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.496+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:43:42.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.497+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.498+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.498+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.499+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:43:42.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.500+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.501+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.502+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.503+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:43:42.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.504+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.505+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.505+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.506+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:43:42.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.508+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.508+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.508+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.510+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:43:42.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.511+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.511+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.512+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.512+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:43:42.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.514+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.514+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.514+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.515+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:43:42.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.516+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.517+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.517+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.518+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:43:42.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.519+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.520+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.520+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.521+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:43:42.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.522+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.522+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.522+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.523+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:43:42.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.525+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.525+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.526+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.526+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:43:42.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.528+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.528+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.528+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.529+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:43:42.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.531+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.531+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.531+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.532+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:43:42.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.533+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.534+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.534+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.535+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:43:42.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.537+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.537+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.537+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.538+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:43:42.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.540+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.540+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.541+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.541+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:43:42.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.543+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.543+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.543+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.544+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:43:42.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.546+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.546+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.546+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.547+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:43:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.549+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.549+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.549+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.550+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:43:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.551+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.552+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.552+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.553+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:43:42.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.555+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.555+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.555+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.556+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:43:42.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.558+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.558+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.559+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.560+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:43:42.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.561+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.562+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.562+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.563+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:43:42.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.565+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.565+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.565+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.566+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:43:42.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.567+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.568+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.568+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.569+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:43:42.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.570+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.571+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.571+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.572+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:43:42.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.573+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.574+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.574+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.575+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:43:42.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.576+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.576+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.577+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.578+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:43:42.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.579+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.579+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.580+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.581+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:43:42.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.582+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.582+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.582+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.583+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:43:42.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.584+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.585+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.585+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.586+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:43:42.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.587+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.588+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.588+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.589+0000 7f87a893c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:43:42.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.590+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.591+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:43:42.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.591+0000 7f87a893c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:43:42.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.593+0000 7f865afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:42.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.595+0000 7f87a893c800 20 remove_watcher() i=0 2024-03-09T14:43:42.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.595+0000 7f87a893c800 2 removed watcher, disabling cache 2024-03-09T14:43:42.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.596+0000 7f87a893c800 20 remove_watcher() i=1 2024-03-09T14:43:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.597+0000 7f87a893c800 20 remove_watcher() i=2 2024-03-09T14:43:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.598+0000 7f87a893c800 20 remove_watcher() i=3 2024-03-09T14:43:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.599+0000 7f87a893c800 20 remove_watcher() i=4 2024-03-09T14:43:42.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.600+0000 7f87a893c800 20 remove_watcher() i=5 2024-03-09T14:43:42.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.602+0000 7f87a893c800 20 remove_watcher() i=6 2024-03-09T14:43:42.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:43:42.603+0000 7f87a893c800 20 remove_watcher() i=7 2024-03-09T14:43:42.613 DEBUG:teuthology.orchestra.run.smithi088:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-03-09T14:43:43.092 INFO:teuthology.orchestra.run.smithi088.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-03-09T14:43:46.692 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :clean UP-TO-DATE 2024-03-09T14:44:05.491 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :compileJava 2024-03-09T14:44:05.491 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :processResources 2024-03-09T14:44:05.491 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :classes 2024-03-09T14:44:06.091 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:06.091 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :compileTestJava 2024-03-09T14:44:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-03-09T14:44:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-03-09T14:44:06.093 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:06.093 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :processTestResources NO-SOURCE 2024-03-09T14:44:06.093 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :testClasses 2024-03-09T14:44:11.991 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:11.991 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :test 2024-03-09T14:44:11.991 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:11.991 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-03-09T14:44:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:15.691 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-03-09T14:44:16.091 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:16.091 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-03-09T14:44:16.191 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:16.191 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-03-09T14:44:16.591 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:16.591 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-03-09T14:44:21.791 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:21.791 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-03-09T14:44:22.191 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:22.191 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-03-09T14:44:22.191 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:22.191 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-03-09T14:44:22.290 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:22.291 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-03-09T14:44:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:22.391 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-03-09T14:44:22.790 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:22.791 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-03-09T14:44:27.191 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:27.191 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-03-09T14:44:27.891 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:27.891 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-03-09T14:44:28.191 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:44:28.191 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-03-09T14:44:28.191 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09 14:44:28,105 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-03-09T14:45:10.391 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:10.392 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-03-09T14:45:11.090 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:11.091 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-03-09T14:45:11.191 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:11.191 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-03-09T14:45:11.590 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:11.591 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-03-09T14:45:11.691 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:11.691 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-03-09T14:45:12.391 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:12.391 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-03-09T14:45:16.091 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:16.091 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-03-09T14:45:16.491 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:16.491 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-03-09T14:45:16.491 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:16.491 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-03-09T14:45:16.690 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:16.691 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-03-09T14:45:22.491 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:22.491 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-03-09T14:45:22.890 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:22.891 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-03-09T14:45:39.591 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:39.591 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-03-09T14:45:40.091 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:40.091 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-03-09T14:45:42.091 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:42.091 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-03-09T14:45:42.491 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:45:42.491 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-03-09T14:46:51.591 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:46:51.591 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-03-09T14:46:52.091 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:46:52.091 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-03-09T14:46:56.891 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:46:56.891 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-03-09T14:46:57.291 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:46:57.291 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-03-09T14:47:10.391 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:10.391 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-03-09T14:47:10.790 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:10.791 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-03-09T14:47:12.190 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:12.191 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-03-09T14:47:17.291 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:17.291 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-03-09T14:47:17.490 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:17.491 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-03-09T14:47:18.290 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:18.291 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-03-09T14:47:18.390 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:18.391 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-03-09T14:47:18.790 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:18.791 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-03-09T14:47:18.890 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:18.891 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-03-09T14:47:19.291 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:19.291 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-03-09T14:47:19.391 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:19.391 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-03-09T14:47:19.790 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:19.791 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-03-09T14:47:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:19.891 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-03-09T14:47:20.290 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:20.291 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-03-09T14:47:20.390 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:20.391 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-03-09T14:47:20.790 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:20.791 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-03-09T14:47:20.890 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:20.891 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-03-09T14:47:21.290 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:21.291 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-03-09T14:47:30.591 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:30.592 INFO:teuthology.orchestra.run.smithi088.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-03-09T14:47:30.991 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:30.991 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------------------------------------------------- 2024-03-09T14:47:30.991 INFO:teuthology.orchestra.run.smithi088.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-03-09T14:47:30.991 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------------------------------------------------- 2024-03-09T14:47:31.035 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:31.035 INFO:teuthology.orchestra.run.smithi088.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-03-09T14:47:31.035 INFO:teuthology.orchestra.run.smithi088.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-03-09T14:47:31.035 INFO:teuthology.orchestra.run.smithi088.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-03-09T14:47:31.035 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:31.035 INFO:teuthology.orchestra.run.smithi088.stdout:BUILD SUCCESSFUL in 3m 48s 2024-03-09T14:47:31.035 INFO:teuthology.orchestra.run.smithi088.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-03-09T14:47:31.354 DEBUG:teuthology.orchestra.run.smithi088:> radosgw-admin gc process --include-all 2024-03-09T14:47:31.403 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:47:31.404 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:47:31.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.437+0000 7f430961b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.438+0000 7f430961b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.438+0000 7f430961b800 20 realm 2024-03-09T14:47:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.438+0000 7f430961b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.438+0000 7f430961b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:31.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.438+0000 7f430961b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:47:31.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.438+0000 7f430961b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:31.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.438+0000 7f430961b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:31.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.438+0000 7f430961b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:31.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.439+0000 7f430961b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:31.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.439+0000 7f430961b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:31.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.440+0000 7f430961b800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:47:31.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.440+0000 7f430961b800 20 searching for the correct realm 2024-03-09T14:47:31.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.443+0000 7f4307918640 0 -- 172.21.15.88:0/2819942975 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f4300093b40 msgr2=0x7f430008c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:47:31.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.447+0000 7f42fe916640 0 -- 172.21.15.88:0/2819942975 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f430007f900 msgr2=0x7f430006c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.653+0000 7f430961b800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.653+0000 7f430961b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.653+0000 7f430961b800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.653+0000 7f430961b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.653+0000 7f430961b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.653+0000 7f430961b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.654+0000 7f430961b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.654+0000 7f430961b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.654+0000 7f430961b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.654+0000 7f430961b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.654+0000 7f430961b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.654+0000 7f430961b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.654+0000 7f430961b800 20 zone default found 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.654+0000 7f430961b800 4 Realm: () 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.654+0000 7f430961b800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.654+0000 7f430961b800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.654+0000 7f430961b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.654+0000 7f430961b800 20 zonegroup default 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.654+0000 7f430961b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.655+0000 7f430961b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.655+0000 7f430961b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.655+0000 7f430961b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.655+0000 7f430961b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.655+0000 7f430961b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.655+0000 7f430961b800 20 started sync module instance, tier type = 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.655+0000 7f430961b800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:47:31.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.665+0000 7f430961b800 20 add_watcher() i=0 2024-03-09T14:47:31.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.665+0000 7f430961b800 20 add_watcher() i=1 2024-03-09T14:47:31.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.665+0000 7f430961b800 20 add_watcher() i=2 2024-03-09T14:47:31.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.665+0000 7f430961b800 20 add_watcher() i=3 2024-03-09T14:47:31.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.665+0000 7f430961b800 20 add_watcher() i=4 2024-03-09T14:47:31.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.665+0000 7f430961b800 20 add_watcher() i=5 2024-03-09T14:47:31.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.665+0000 7f430961b800 20 add_watcher() i=6 2024-03-09T14:47:31.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.666+0000 7f430961b800 20 add_watcher() i=7 2024-03-09T14:47:31.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.666+0000 7f430961b800 2 all 8 watchers are set, enabling cache 2024-03-09T14:47:31.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.667+0000 7f41bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:31.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.668+0000 7f430961b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:47:31.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.668+0000 7f430961b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:47:31.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.705+0000 7f41bcfe1640 20 reqs_thread_entry: start 2024-03-09T14:47:31.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.705+0000 7f430961b800 20 init_complete bucket index max shards: 11 2024-03-09T14:47:31.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.705+0000 7f430961b800 20 Filter name: none 2024-03-09T14:47:31.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.705+0000 7f41367fc640 20 reqs_thread_entry: start 2024-03-09T14:47:31.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.705+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:47:31.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.708+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.708+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.708+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:47:31.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.708+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.4479296354290176502', time=2024-03-09T16:47:10.455973+0000, chain.objs.size()=9 2024-03-09T14:47:31.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.708+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.46__multipart_key1.2~it3lplI_cnr-gLA4oLlbIfbSGwPxDac.1 2024-03-09T14:47:31.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.708+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.46__shadow_key1.2~it3lplI_cnr-gLA4oLlbIfbSGwPxDac.1_1 2024-03-09T14:47:31.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.708+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.46__multipart_key1.2~it3lplI_cnr-gLA4oLlbIfbSGwPxDac.2 2024-03-09T14:47:31.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.708+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.46__shadow_key1.2~it3lplI_cnr-gLA4oLlbIfbSGwPxDac.2_1 2024-03-09T14:47:31.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.708+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.46__multipart_key1.2~it3lplI_cnr-gLA4oLlbIfbSGwPxDac.3 2024-03-09T14:47:31.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.708+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.46__shadow_key1.2~it3lplI_cnr-gLA4oLlbIfbSGwPxDac.3_1 2024-03-09T14:47:31.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.708+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.46__multipart_key1.2~it3lplI_cnr-gLA4oLlbIfbSGwPxDac.4 2024-03-09T14:47:31.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.708+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.46__shadow_key1.2~it3lplI_cnr-gLA4oLlbIfbSGwPxDac.4_1 2024-03-09T14:47:31.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.709+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.46__multipart_key1.2~it3lplI_cnr-gLA4oLlbIfbSGwPxDac.5 2024-03-09T14:47:31.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.713+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.717+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:47:31.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.719+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.720+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.720+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:47:31.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.720+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.7819144715769596342', time=2024-03-09T16:46:14.929548+0000, chain.objs.size()=19 2024-03-09T14:47:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.720+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.1 2024-03-09T14:47:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.720+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.1_1 2024-03-09T14:47:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.720+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.2 2024-03-09T14:47:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.720+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.2_1 2024-03-09T14:47:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.720+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.3 2024-03-09T14:47:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.720+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.3_1 2024-03-09T14:47:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.720+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.4 2024-03-09T14:47:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.720+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.4_1 2024-03-09T14:47:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.720+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.5 2024-03-09T14:47:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.720+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.5_1 2024-03-09T14:47:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.720+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.6 2024-03-09T14:47:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.720+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.6_1 2024-03-09T14:47:31.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.724+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.7 2024-03-09T14:47:31.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.726+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.7_1 2024-03-09T14:47:31.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.726+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.8 2024-03-09T14:47:31.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.726+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.8_1 2024-03-09T14:47:31.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.727+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.9 2024-03-09T14:47:31.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.727+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.9_1 2024-03-09T14:47:31.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.727+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~hvMDY0LlUAp9ykO4A7GJolAq-1uxtTZ.10 2024-03-09T14:47:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.727+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.8440542732447169340', time=2024-03-09T16:46:56.932637+0000, chain.objs.size()=9 2024-03-09T14:47:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.727+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.45__multipart_key1.2~RE6JgShWXTIGVHZXMxZBEZBrrD59s8r.1 2024-03-09T14:47:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.727+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.45__shadow_key1.2~RE6JgShWXTIGVHZXMxZBEZBrrD59s8r.1_1 2024-03-09T14:47:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.727+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.45__multipart_key1.2~RE6JgShWXTIGVHZXMxZBEZBrrD59s8r.2 2024-03-09T14:47:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.727+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.45__shadow_key1.2~RE6JgShWXTIGVHZXMxZBEZBrrD59s8r.2_1 2024-03-09T14:47:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.728+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.45__multipart_key1.2~RE6JgShWXTIGVHZXMxZBEZBrrD59s8r.3 2024-03-09T14:47:31.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.730+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.45__shadow_key1.2~RE6JgShWXTIGVHZXMxZBEZBrrD59s8r.3_1 2024-03-09T14:47:31.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.730+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.45__multipart_key1.2~RE6JgShWXTIGVHZXMxZBEZBrrD59s8r.4 2024-03-09T14:47:31.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.730+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.45__shadow_key1.2~RE6JgShWXTIGVHZXMxZBEZBrrD59s8r.4_1 2024-03-09T14:47:31.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.730+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.45__multipart_key1.2~RE6JgShWXTIGVHZXMxZBEZBrrD59s8r.5 2024-03-09T14:47:31.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.736+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.741+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:47:31.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:47:31.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.9535175017194147451', time=2024-03-09T16:45:39.669186+0000, chain.objs.size()=9 2024-03-09T14:47:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__multipart_file.mpg.2~eOtSxEcprUOl1UYN5WCjuNoUQRnX2k2.1 2024-03-09T14:47:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__shadow_file.mpg.2~eOtSxEcprUOl1UYN5WCjuNoUQRnX2k2.1_1 2024-03-09T14:47:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__multipart_file.mpg.2~eOtSxEcprUOl1UYN5WCjuNoUQRnX2k2.2 2024-03-09T14:47:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__shadow_file.mpg.2~eOtSxEcprUOl1UYN5WCjuNoUQRnX2k2.2_1 2024-03-09T14:47:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__multipart_file.mpg.2~eOtSxEcprUOl1UYN5WCjuNoUQRnX2k2.3 2024-03-09T14:47:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__shadow_file.mpg.2~eOtSxEcprUOl1UYN5WCjuNoUQRnX2k2.3_1 2024-03-09T14:47:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__multipart_file.mpg.2~eOtSxEcprUOl1UYN5WCjuNoUQRnX2k2.4 2024-03-09T14:47:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__shadow_file.mpg.2~eOtSxEcprUOl1UYN5WCjuNoUQRnX2k2.4_1 2024-03-09T14:47:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__multipart_file.mpg.2~eOtSxEcprUOl1UYN5WCjuNoUQRnX2k2.5 2024-03-09T14:47:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.4665917457260520368', time=2024-03-09T16:46:51.516273+0000, chain.objs.size()=16 2024-03-09T14:47:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.1 2024-03-09T14:47:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.743+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.1_1 2024-03-09T14:47:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.744+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.1_2 2024-03-09T14:47:31.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.746+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.2 2024-03-09T14:47:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.748+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.2_1 2024-03-09T14:47:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.748+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.2_2 2024-03-09T14:47:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.748+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.3 2024-03-09T14:47:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.748+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.3_1 2024-03-09T14:47:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.748+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.3_2 2024-03-09T14:47:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.748+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.4 2024-03-09T14:47:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.748+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.4_1 2024-03-09T14:47:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.750+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.4_2 2024-03-09T14:47:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.750+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.5 2024-03-09T14:47:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.750+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.5_1 2024-03-09T14:47:31.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.751+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.5_2 2024-03-09T14:47:31.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.756+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~FjTwlO5ejkY-06iwZ1ibVoKT3e4CIfz.6 2024-03-09T14:47:31.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.759+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.761+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:47:31.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.762+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.762+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.763+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.764+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:47:31.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.765+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.765+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.765+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.766+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:47:31.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.768+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.768+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.768+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.769+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:47:31.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.770+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.771+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.771+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:47:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.771+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.14699340378974534794', time=2024-03-09T16:45:01.371002+0000, chain.objs.size()=9 2024-03-09T14:47:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.771+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~cQVCTfxpGeIE52oXiinZiGBg-LlCCGC.1 2024-03-09T14:47:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.771+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~cQVCTfxpGeIE52oXiinZiGBg-LlCCGC.1_1 2024-03-09T14:47:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.771+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~cQVCTfxpGeIE52oXiinZiGBg-LlCCGC.2 2024-03-09T14:47:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.771+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~cQVCTfxpGeIE52oXiinZiGBg-LlCCGC.2_1 2024-03-09T14:47:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.771+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~cQVCTfxpGeIE52oXiinZiGBg-LlCCGC.3 2024-03-09T14:47:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.771+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~cQVCTfxpGeIE52oXiinZiGBg-LlCCGC.3_1 2024-03-09T14:47:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.772+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~cQVCTfxpGeIE52oXiinZiGBg-LlCCGC.4 2024-03-09T14:47:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.772+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~cQVCTfxpGeIE52oXiinZiGBg-LlCCGC.4_1 2024-03-09T14:47:31.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.772+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~cQVCTfxpGeIE52oXiinZiGBg-LlCCGC.5 2024-03-09T14:47:31.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.777+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.780+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:47:31.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.781+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.782+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.782+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:47:31.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.782+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.11095273450981413647', time=2024-03-09T16:44:27.596029+0000, chain.objs.size()=9 2024-03-09T14:47:31.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.782+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__multipart_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.1 2024-03-09T14:47:31.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.783+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__shadow_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.1_1 2024-03-09T14:47:31.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.783+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__multipart_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.2 2024-03-09T14:47:31.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.783+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__shadow_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.2_1 2024-03-09T14:47:31.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.783+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__multipart_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.3 2024-03-09T14:47:31.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.783+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__shadow_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.3_1 2024-03-09T14:47:31.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.783+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__multipart_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.4 2024-03-09T14:47:31.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.783+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__shadow_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.4_1 2024-03-09T14:47:31.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.783+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__multipart_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.5 2024-03-09T14:47:31.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.786+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.788+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:47:31.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.790+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.790+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.790+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:47:31.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.790+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='2~o0YjSajdBMwBdMdBqp3RZgb09Bb0kqW', time=2024-03-09T16:44:15.617230+0000, chain.objs.size()=9 2024-03-09T14:47:31.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.790+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.29__multipart_key1.2~o0YjSajdBMwBdMdBqp3RZgb09Bb0kqW.1 2024-03-09T14:47:31.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.791+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.29__shadow_key1.2~o0YjSajdBMwBdMdBqp3RZgb09Bb0kqW.1_1 2024-03-09T14:47:31.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.791+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.29__multipart_key1.2~o0YjSajdBMwBdMdBqp3RZgb09Bb0kqW.2 2024-03-09T14:47:31.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.791+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.29__shadow_key1.2~o0YjSajdBMwBdMdBqp3RZgb09Bb0kqW.2_1 2024-03-09T14:47:31.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.791+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.29__multipart_key1.2~o0YjSajdBMwBdMdBqp3RZgb09Bb0kqW.3 2024-03-09T14:47:31.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.791+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.29__shadow_key1.2~o0YjSajdBMwBdMdBqp3RZgb09Bb0kqW.3_1 2024-03-09T14:47:31.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.791+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.29__multipart_key1.2~o0YjSajdBMwBdMdBqp3RZgb09Bb0kqW.4 2024-03-09T14:47:31.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.791+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.29__shadow_key1.2~o0YjSajdBMwBdMdBqp3RZgb09Bb0kqW.4_1 2024-03-09T14:47:31.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.791+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.29__multipart_key1.2~o0YjSajdBMwBdMdBqp3RZgb09Bb0kqW.5 2024-03-09T14:47:31.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.794+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.797+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:47:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.798+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.799+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.799+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:47:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.799+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.11059729004888879888', time=2024-03-09T16:45:39.740655+0000, chain.objs.size()=9 2024-03-09T14:47:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.799+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__multipart_file2.mpg.2~TDEorNeTz7LaDvzRCQ4-itn2suVahq6.1 2024-03-09T14:47:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.799+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__shadow_file2.mpg.2~TDEorNeTz7LaDvzRCQ4-itn2suVahq6.1_1 2024-03-09T14:47:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.799+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__multipart_file2.mpg.2~TDEorNeTz7LaDvzRCQ4-itn2suVahq6.2 2024-03-09T14:47:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.799+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__shadow_file2.mpg.2~TDEorNeTz7LaDvzRCQ4-itn2suVahq6.2_1 2024-03-09T14:47:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.799+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__multipart_file2.mpg.2~TDEorNeTz7LaDvzRCQ4-itn2suVahq6.3 2024-03-09T14:47:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.799+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__shadow_file2.mpg.2~TDEorNeTz7LaDvzRCQ4-itn2suVahq6.3_1 2024-03-09T14:47:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.799+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__multipart_file2.mpg.2~TDEorNeTz7LaDvzRCQ4-itn2suVahq6.4 2024-03-09T14:47:31.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.799+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__shadow_file2.mpg.2~TDEorNeTz7LaDvzRCQ4-itn2suVahq6.4_1 2024-03-09T14:47:31.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.799+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.42__multipart_file2.mpg.2~TDEorNeTz7LaDvzRCQ4-itn2suVahq6.5 2024-03-09T14:47:31.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.803+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.806+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:47:31.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.807+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:47:31.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.10635146593662730621', time=2024-03-09T16:45:07.388089+0000, chain.objs.size()=7 2024-03-09T14:47:31.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~x-RZAnj7pNBr6gQ_VdTE83tSbJsNIPW.1 2024-03-09T14:47:31.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~x-RZAnj7pNBr6gQ_VdTE83tSbJsNIPW.1_1 2024-03-09T14:47:31.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~x-RZAnj7pNBr6gQ_VdTE83tSbJsNIPW.1_2 2024-03-09T14:47:31.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~x-RZAnj7pNBr6gQ_VdTE83tSbJsNIPW.2 2024-03-09T14:47:31.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~x-RZAnj7pNBr6gQ_VdTE83tSbJsNIPW.2_1 2024-03-09T14:47:31.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~x-RZAnj7pNBr6gQ_VdTE83tSbJsNIPW.2_2 2024-03-09T14:47:31.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~x-RZAnj7pNBr6gQ_VdTE83tSbJsNIPW.3 2024-03-09T14:47:31.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.1660953670838148240', time=2024-03-09T16:45:16.161917+0000, chain.objs.size()=9 2024-03-09T14:47:31.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.40__multipart_key1.2~Kk-Y3wIElJDhnsAP8wllHC-0kCez3I2.1 2024-03-09T14:47:31.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.40__shadow_key1.2~Kk-Y3wIElJDhnsAP8wllHC-0kCez3I2.1_1 2024-03-09T14:47:31.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.40__multipart_key1.2~Kk-Y3wIElJDhnsAP8wllHC-0kCez3I2.2 2024-03-09T14:47:31.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.40__shadow_key1.2~Kk-Y3wIElJDhnsAP8wllHC-0kCez3I2.2_1 2024-03-09T14:47:31.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.808+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.40__multipart_key1.2~Kk-Y3wIElJDhnsAP8wllHC-0kCez3I2.3 2024-03-09T14:47:31.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.811+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.40__shadow_key1.2~Kk-Y3wIElJDhnsAP8wllHC-0kCez3I2.3_1 2024-03-09T14:47:31.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.812+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.40__multipart_key1.2~Kk-Y3wIElJDhnsAP8wllHC-0kCez3I2.4 2024-03-09T14:47:31.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.812+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.40__shadow_key1.2~Kk-Y3wIElJDhnsAP8wllHC-0kCez3I2.4_1 2024-03-09T14:47:31.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.812+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.40__multipart_key1.2~Kk-Y3wIElJDhnsAP8wllHC-0kCez3I2.5 2024-03-09T14:47:31.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.815+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.818+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:47:31.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.819+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.819+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.819+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.821+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:47:31.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.822+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.822+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.823+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.824+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:47:31.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.825+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.826+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.826+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:47:31.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.826+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.10236861126502831893', time=2024-03-09T16:45:10.807917+0000, chain.objs.size()=5 2024-03-09T14:47:31.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.826+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.35__shadow_.mebpN5jpetZus_NYp4G7bYiKCy46-sV_1 2024-03-09T14:47:31.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.826+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.35__shadow_.mebpN5jpetZus_NYp4G7bYiKCy46-sV_2 2024-03-09T14:47:31.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.826+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.35__shadow_.mebpN5jpetZus_NYp4G7bYiKCy46-sV_3 2024-03-09T14:47:31.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.826+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.35__shadow_.mebpN5jpetZus_NYp4G7bYiKCy46-sV_4 2024-03-09T14:47:31.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.826+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.35__shadow_.mebpN5jpetZus_NYp4G7bYiKCy46-sV_5 2024-03-09T14:47:31.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.828+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.831+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:47:31.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.832+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.832+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.833+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.833+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:47:31.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.835+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.835+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.835+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:47:31.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.835+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.10876160122837582065', time=2024-03-09T16:45:10.278679+0000, chain.objs.size()=7 2024-03-09T14:47:31.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.835+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~RM9XHoPJqnWQ4tLTal54QAE3_3DAl3e.1 2024-03-09T14:47:31.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.835+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~RM9XHoPJqnWQ4tLTal54QAE3_3DAl3e.1_1 2024-03-09T14:47:31.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.835+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~RM9XHoPJqnWQ4tLTal54QAE3_3DAl3e.1_2 2024-03-09T14:47:31.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.835+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~RM9XHoPJqnWQ4tLTal54QAE3_3DAl3e.2 2024-03-09T14:47:31.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.835+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~RM9XHoPJqnWQ4tLTal54QAE3_3DAl3e.2_1 2024-03-09T14:47:31.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.835+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~RM9XHoPJqnWQ4tLTal54QAE3_3DAl3e.2_2 2024-03-09T14:47:31.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.835+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~RM9XHoPJqnWQ4tLTal54QAE3_3DAl3e.3 2024-03-09T14:47:31.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.839+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.841+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:47:31.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.842+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.842+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.843+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:47:31.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.843+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.4653057752097066826', time=2024-03-09T16:44:21.875225+0000, chain.objs.size()=9 2024-03-09T14:47:31.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.843+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.31__multipart_key1.2~3sIRxty7ZCpam0rj3KKdYPxQTBz0qTl.1 2024-03-09T14:47:31.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.843+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.31__shadow_key1.2~3sIRxty7ZCpam0rj3KKdYPxQTBz0qTl.1_1 2024-03-09T14:47:31.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.843+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.31__multipart_key1.2~3sIRxty7ZCpam0rj3KKdYPxQTBz0qTl.2 2024-03-09T14:47:31.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.843+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.31__shadow_key1.2~3sIRxty7ZCpam0rj3KKdYPxQTBz0qTl.2_1 2024-03-09T14:47:31.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.843+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.31__multipart_key1.2~3sIRxty7ZCpam0rj3KKdYPxQTBz0qTl.3 2024-03-09T14:47:31.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.843+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.31__shadow_key1.2~3sIRxty7ZCpam0rj3KKdYPxQTBz0qTl.3_1 2024-03-09T14:47:31.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.843+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.31__multipart_key1.2~3sIRxty7ZCpam0rj3KKdYPxQTBz0qTl.4 2024-03-09T14:47:31.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.843+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.31__shadow_key1.2~3sIRxty7ZCpam0rj3KKdYPxQTBz0qTl.4_1 2024-03-09T14:47:31.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.843+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.31__multipart_key1.2~3sIRxty7ZCpam0rj3KKdYPxQTBz0qTl.5 2024-03-09T14:47:31.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.846+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.849+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:47:31.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.850+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.850+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.850+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.851+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:47:31.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.853+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.853+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.853+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.854+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:47:31.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.856+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.856+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.857+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-09T14:47:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.857+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.17192092512845612356', time=2024-03-09T16:46:51.742279+0000, chain.objs.size()=16 2024-03-09T14:47:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.857+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.1 2024-03-09T14:47:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.857+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.1_1 2024-03-09T14:47:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.857+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.1_2 2024-03-09T14:47:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.857+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.2 2024-03-09T14:47:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.857+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.2_1 2024-03-09T14:47:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.857+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.2_2 2024-03-09T14:47:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.857+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.3 2024-03-09T14:47:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.857+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.3_1 2024-03-09T14:47:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.857+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.3_2 2024-03-09T14:47:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.857+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.4 2024-03-09T14:47:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.857+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.4_1 2024-03-09T14:47:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.857+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.4_2 2024-03-09T14:47:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.859+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.5 2024-03-09T14:47:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.859+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.5_1 2024-03-09T14:47:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.860+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.5_2 2024-03-09T14:47:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.860+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~WFMoiuD1rsD865z7TIsZMzh7guLTwNy.6 2024-03-09T14:47:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.860+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl', time=2024-03-09T16:47:16.033811+0000, chain.objs.size()=1 2024-03-09T14:47:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.860+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.18 2024-03-09T14:47:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.862+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl', time=2024-03-09T16:47:16.099634+0000, chain.objs.size()=1 2024-03-09T14:47:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.862+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.19 2024-03-09T14:47:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.862+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl', time=2024-03-09T16:47:16.116487+0000, chain.objs.size()=1 2024-03-09T14:47:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.862+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.20 2024-03-09T14:47:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.862+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl', time=2024-03-09T16:47:16.249149+0000, chain.objs.size()=56 2024-03-09T14:47:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.862+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.1 2024-03-09T14:47:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.862+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.2 2024-03-09T14:47:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.862+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.3 2024-03-09T14:47:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.862+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.4 2024-03-09T14:47:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.864+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.5 2024-03-09T14:47:31.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.865+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.6 2024-03-09T14:47:31.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.865+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.7 2024-03-09T14:47:31.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.865+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.8 2024-03-09T14:47:31.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.865+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.9 2024-03-09T14:47:31.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.866+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.10 2024-03-09T14:47:31.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.866+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.11 2024-03-09T14:47:31.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.866+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.12 2024-03-09T14:47:31.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.866+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.13 2024-03-09T14:47:31.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.866+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.14 2024-03-09T14:47:31.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.866+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.15 2024-03-09T14:47:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.867+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.16 2024-03-09T14:47:31.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.868+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.17 2024-03-09T14:47:31.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.869+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.ZjguihsyXGZm0beTwcFk59K_UxE2Si1F.18 2024-03-09T14:47:31.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.870+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.U_neerhdmFqe8UjREmWKPH1GRe66P_A6.19 2024-03-09T14:47:31.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.870+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.wXnelg19R0BchGuxVMI81tQb7pJd7E3c.20 2024-03-09T14:47:31.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.870+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.21 2024-03-09T14:47:31.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.871+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.22 2024-03-09T14:47:31.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.871+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.23 2024-03-09T14:47:31.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.871+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.24 2024-03-09T14:47:31.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.871+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.25 2024-03-09T14:47:31.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.871+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.26 2024-03-09T14:47:31.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.871+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.27 2024-03-09T14:47:31.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.872+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.28 2024-03-09T14:47:31.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.872+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.29 2024-03-09T14:47:31.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.873+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.30 2024-03-09T14:47:31.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.874+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.31 2024-03-09T14:47:31.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.874+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.32 2024-03-09T14:47:31.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.875+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.33 2024-03-09T14:47:31.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.875+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.34 2024-03-09T14:47:31.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.875+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.35 2024-03-09T14:47:31.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.875+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.36 2024-03-09T14:47:31.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.875+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.37 2024-03-09T14:47:31.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.876+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.38 2024-03-09T14:47:31.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.876+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.39 2024-03-09T14:47:31.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.876+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.40 2024-03-09T14:47:31.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.879+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.41 2024-03-09T14:47:31.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.879+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.42 2024-03-09T14:47:31.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.879+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.43 2024-03-09T14:47:31.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.879+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.44 2024-03-09T14:47:31.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.879+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.45 2024-03-09T14:47:31.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.880+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.46 2024-03-09T14:47:31.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.880+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.47 2024-03-09T14:47:31.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.880+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.48 2024-03-09T14:47:31.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.881+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.49 2024-03-09T14:47:31.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.881+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.50 2024-03-09T14:47:31.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.881+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.51 2024-03-09T14:47:31.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.883+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.52 2024-03-09T14:47:31.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.883+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.53 2024-03-09T14:47:31.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.883+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.54 2024-03-09T14:47:31.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.884+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.55 2024-03-09T14:47:31.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.884+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.47__multipart_key1.2~Sb8d7sAeo4dSPQEW8ryDA12RLnXo7sl.56 2024-03-09T14:47:31.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.887+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.889+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:47:31.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.890+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.891+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.891+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:47:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.891+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.16294314409100695216', time=2024-03-09T16:47:30.674360+0000, chain.objs.size()=21 2024-03-09T14:47:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.891+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__multipart_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.1 2024-03-09T14:47:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.891+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__shadow_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.1_1 2024-03-09T14:47:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.891+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__multipart_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.2 2024-03-09T14:47:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.891+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__shadow_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.2_1 2024-03-09T14:47:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.891+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__multipart_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.3 2024-03-09T14:47:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.891+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__shadow_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.3_1 2024-03-09T14:47:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.891+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__multipart_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.4 2024-03-09T14:47:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.891+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__shadow_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.4_1 2024-03-09T14:47:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.892+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__multipart_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.5 2024-03-09T14:47:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.892+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__shadow_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.5_1 2024-03-09T14:47:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.892+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__multipart_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.6 2024-03-09T14:47:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.892+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__shadow_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.6_1 2024-03-09T14:47:31.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.894+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__multipart_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.7 2024-03-09T14:47:31.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.895+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__shadow_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.7_1 2024-03-09T14:47:31.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.895+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__multipart_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.8 2024-03-09T14:47:31.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.895+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__shadow_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.8_1 2024-03-09T14:47:31.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.895+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__multipart_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.9 2024-03-09T14:47:31.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.895+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__shadow_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.9_1 2024-03-09T14:47:31.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.895+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__multipart_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.10 2024-03-09T14:47:31.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.895+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__shadow_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.10_1 2024-03-09T14:47:31.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.895+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.55__multipart_key1.2~wINHnY9YeraTmC2BJHazB-4W06frxLI.11 2024-03-09T14:47:31.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.900+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.902+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:47:31.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.903+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.904+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.904+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:47:31.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.904+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.12028726006201271454', time=2024-03-09T16:46:22.472619+0000, chain.objs.size()=16 2024-03-09T14:47:31.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.904+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.1 2024-03-09T14:47:31.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.904+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.1_1 2024-03-09T14:47:31.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.904+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.1_2 2024-03-09T14:47:31.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.904+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.2 2024-03-09T14:47:31.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.904+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.2_1 2024-03-09T14:47:31.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.904+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.2_2 2024-03-09T14:47:31.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.904+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.3 2024-03-09T14:47:31.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.904+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.3_1 2024-03-09T14:47:31.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.904+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.3_2 2024-03-09T14:47:31.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.904+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.4 2024-03-09T14:47:31.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.904+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.4_1 2024-03-09T14:47:31.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.904+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.4_2 2024-03-09T14:47:31.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.907+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.5 2024-03-09T14:47:31.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.910+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.5_1 2024-03-09T14:47:31.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.910+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.5_2 2024-03-09T14:47:31.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.910+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~d1DePx4ng0o_04vQmhRqirkB2NQnK0i.6 2024-03-09T14:47:31.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.913+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.915+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:47:31.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.917+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.917+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.918+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:47:31.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.918+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.10506428755865233022', time=2024-03-09T16:44:57.260076+0000, chain.objs.size()=9 2024-03-09T14:47:31.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.918+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~aFlgh4C981aQM6FJqn0y0B5AnRsnycZ.1 2024-03-09T14:47:31.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.918+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~aFlgh4C981aQM6FJqn0y0B5AnRsnycZ.1_1 2024-03-09T14:47:31.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.918+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~aFlgh4C981aQM6FJqn0y0B5AnRsnycZ.2 2024-03-09T14:47:31.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.918+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~aFlgh4C981aQM6FJqn0y0B5AnRsnycZ.2_1 2024-03-09T14:47:31.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.918+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~aFlgh4C981aQM6FJqn0y0B5AnRsnycZ.3 2024-03-09T14:47:31.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.918+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~aFlgh4C981aQM6FJqn0y0B5AnRsnycZ.3_1 2024-03-09T14:47:31.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.918+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~aFlgh4C981aQM6FJqn0y0B5AnRsnycZ.4 2024-03-09T14:47:31.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.918+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~aFlgh4C981aQM6FJqn0y0B5AnRsnycZ.4_1 2024-03-09T14:47:31.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.918+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~aFlgh4C981aQM6FJqn0y0B5AnRsnycZ.5 2024-03-09T14:47:31.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.918+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.14568331304223582551', time=2024-03-09T16:45:10.504575+0000, chain.objs.size()=7 2024-03-09T14:47:31.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.918+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~0ugUJd2wAj2b8OUOWrKRVfGlfICmukT.1 2024-03-09T14:47:31.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.918+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~0ugUJd2wAj2b8OUOWrKRVfGlfICmukT.1_1 2024-03-09T14:47:31.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.918+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~0ugUJd2wAj2b8OUOWrKRVfGlfICmukT.1_2 2024-03-09T14:47:31.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.920+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~0ugUJd2wAj2b8OUOWrKRVfGlfICmukT.2 2024-03-09T14:47:31.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.920+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~0ugUJd2wAj2b8OUOWrKRVfGlfICmukT.2_1 2024-03-09T14:47:31.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.921+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~0ugUJd2wAj2b8OUOWrKRVfGlfICmukT.2_2 2024-03-09T14:47:31.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.921+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~0ugUJd2wAj2b8OUOWrKRVfGlfICmukT.3 2024-03-09T14:47:31.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.921+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.2272668607972539222', time=2024-03-09T16:45:22.582053+0000, chain.objs.size()=9 2024-03-09T14:47:31.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.921+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.41__multipart_key1.2~0OTuilAvWlJzLCP-V6OHFTj9PgftG3D.1 2024-03-09T14:47:31.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.924+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.41__shadow_key1.2~0OTuilAvWlJzLCP-V6OHFTj9PgftG3D.1_1 2024-03-09T14:47:31.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.924+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.41__multipart_key1.2~0OTuilAvWlJzLCP-V6OHFTj9PgftG3D.2 2024-03-09T14:47:31.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.924+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.41__shadow_key1.2~0OTuilAvWlJzLCP-V6OHFTj9PgftG3D.2_1 2024-03-09T14:47:31.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.924+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.41__multipart_key1.2~0OTuilAvWlJzLCP-V6OHFTj9PgftG3D.3 2024-03-09T14:47:31.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.924+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.41__shadow_key1.2~0OTuilAvWlJzLCP-V6OHFTj9PgftG3D.3_1 2024-03-09T14:47:31.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.924+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.41__multipart_key1.2~0OTuilAvWlJzLCP-V6OHFTj9PgftG3D.4 2024-03-09T14:47:31.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.924+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.41__shadow_key1.2~0OTuilAvWlJzLCP-V6OHFTj9PgftG3D.4_1 2024-03-09T14:47:31.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.924+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.41__multipart_key1.2~0OTuilAvWlJzLCP-V6OHFTj9PgftG3D.5 2024-03-09T14:47:31.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.929+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.931+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:47:31.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.933+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.933+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.934+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:47:31.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.934+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.15433001728492635833', time=2024-03-09T16:45:59.109978+0000, chain.objs.size()=21 2024-03-09T14:47:31.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.934+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.1 2024-03-09T14:47:31.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.934+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.1_1 2024-03-09T14:47:31.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.934+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.2 2024-03-09T14:47:31.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.934+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.2_1 2024-03-09T14:47:31.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.934+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.3 2024-03-09T14:47:31.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.934+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.3_1 2024-03-09T14:47:31.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.934+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.4 2024-03-09T14:47:31.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.934+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.4_1 2024-03-09T14:47:31.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.934+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.5 2024-03-09T14:47:31.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.934+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.5_1 2024-03-09T14:47:31.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.934+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.6 2024-03-09T14:47:31.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.934+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.6_1 2024-03-09T14:47:31.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.937+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.7 2024-03-09T14:47:31.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.937+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.7_1 2024-03-09T14:47:31.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.939+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.8 2024-03-09T14:47:31.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.939+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.8_1 2024-03-09T14:47:31.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.939+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.9 2024-03-09T14:47:31.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.939+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.9_1 2024-03-09T14:47:31.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.939+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.10 2024-03-09T14:47:31.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.939+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.10_1 2024-03-09T14:47:31.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.940+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~mZ2NwOrrLKJQLu3DMNGsNXrYgPTGT0y.11 2024-03-09T14:47:31.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.943+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.946+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:47:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.947+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.947+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.948+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:47:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.948+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.33__shadow_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.1_1_fd1b8d3d364ec55f96ec64757cffd0cd', time=2024-03-09T16:44:27.296083+0000, chain.objs.size()=9 2024-03-09T14:47:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.948+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__multipart_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.1 2024-03-09T14:47:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.948+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__shadow_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.1_1 2024-03-09T14:47:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.948+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__multipart_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.2 2024-03-09T14:47:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.948+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__shadow_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.2_1 2024-03-09T14:47:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.948+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__multipart_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.3 2024-03-09T14:47:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.948+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__shadow_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.3_1 2024-03-09T14:47:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.948+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__multipart_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.4 2024-03-09T14:47:31.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.948+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__shadow_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.4_1 2024-03-09T14:47:31.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.948+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.33__multipart_key1.2~__YEfrfuZwfssLDPEHo1EDrnfTcoWlz.5 2024-03-09T14:47:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.950+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.952+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:47:31.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.953+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.954+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.954+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.955+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:47:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.956+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.957+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.957+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:47:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.957+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.7378005411059862577', time=2024-03-09T16:45:04.372124+0000, chain.objs.size()=9 2024-03-09T14:47:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.957+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~TE-ItfdEaeWMRTit3DklXKHiG9Gu1KD.1 2024-03-09T14:47:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.957+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~TE-ItfdEaeWMRTit3DklXKHiG9Gu1KD.1_1 2024-03-09T14:47:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.957+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~TE-ItfdEaeWMRTit3DklXKHiG9Gu1KD.2 2024-03-09T14:47:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.957+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~TE-ItfdEaeWMRTit3DklXKHiG9Gu1KD.2_1 2024-03-09T14:47:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.957+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~TE-ItfdEaeWMRTit3DklXKHiG9Gu1KD.3 2024-03-09T14:47:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.957+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~TE-ItfdEaeWMRTit3DklXKHiG9Gu1KD.3_1 2024-03-09T14:47:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.957+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~TE-ItfdEaeWMRTit3DklXKHiG9Gu1KD.4 2024-03-09T14:47:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.957+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__shadow_key1.2~TE-ItfdEaeWMRTit3DklXKHiG9Gu1KD.4_1 2024-03-09T14:47:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.957+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.36__multipart_key1.2~TE-ItfdEaeWMRTit3DklXKHiG9Gu1KD.5 2024-03-09T14:47:31.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.961+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.963+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:47:31.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.965+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.965+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.965+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.966+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:47:31.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.967+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.968+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.968+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.969+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:47:31.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.970+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.971+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.971+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.972+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:47:31.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.973+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.973+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.974+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:47:31.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.974+0000 7f430961b800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.9440367802849422663', time=2024-03-09T16:46:07.329166+0000, chain.objs.size()=21 2024-03-09T14:47:31.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.974+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.1 2024-03-09T14:47:31.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.974+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.1_1 2024-03-09T14:47:31.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.974+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.2 2024-03-09T14:47:31.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.974+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.2_1 2024-03-09T14:47:31.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.974+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.3 2024-03-09T14:47:31.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.974+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.3_1 2024-03-09T14:47:31.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.974+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.4 2024-03-09T14:47:31.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.974+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.4_1 2024-03-09T14:47:31.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.974+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.5 2024-03-09T14:47:31.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.974+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.5_1 2024-03-09T14:47:31.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.974+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.6 2024-03-09T14:47:31.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.974+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.6_1 2024-03-09T14:47:31.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.977+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.7 2024-03-09T14:47:31.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.977+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.7_1 2024-03-09T14:47:31.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.977+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.8 2024-03-09T14:47:31.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.977+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.8_1 2024-03-09T14:47:31.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.978+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.9 2024-03-09T14:47:31.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.978+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.9_1 2024-03-09T14:47:31.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.978+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.10 2024-03-09T14:47:31.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.978+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__shadow_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.10_1 2024-03-09T14:47:31.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.978+0000 7f430961b800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.44__multipart_key1.2~tNn6XMsGSboFWuzuRLC5ckxaeeYWaLD.11 2024-03-09T14:47:31.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.983+0000 7f430961b800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:31.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.985+0000 7f430961b800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:47:31.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.987+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.987+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:31.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.987+0000 7f430961b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:31.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.989+0000 7f41bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:31.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.991+0000 7f430961b800 20 remove_watcher() i=0 2024-03-09T14:47:31.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.991+0000 7f430961b800 2 removed watcher, disabling cache 2024-03-09T14:47:31.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.992+0000 7f430961b800 20 remove_watcher() i=1 2024-03-09T14:47:31.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.993+0000 7f430961b800 20 remove_watcher() i=2 2024-03-09T14:47:31.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.994+0000 7f430961b800 20 remove_watcher() i=3 2024-03-09T14:47:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.995+0000 7f430961b800 20 remove_watcher() i=4 2024-03-09T14:47:31.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.996+0000 7f430961b800 20 remove_watcher() i=5 2024-03-09T14:47:31.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.997+0000 7f430961b800 20 remove_watcher() i=6 2024-03-09T14:47:31.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:31.998+0000 7f430961b800 20 remove_watcher() i=7 2024-03-09T14:47:32.008 DEBUG:teuthology.orchestra.run.smithi088:> radosgw-admin gc process --include-all 2024-03-09T14:47:32.056 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:47:32.056 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:47:32.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.090+0000 7f141382e800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.092+0000 7f141382e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:32.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.092+0000 7f141382e800 20 realm 2024-03-09T14:47:32.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.092+0000 7f141382e800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.092+0000 7f141382e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:32.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.092+0000 7f141382e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:47:32.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.092+0000 7f141382e800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.092+0000 7f141382e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:32.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.092+0000 7f141382e800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.093+0000 7f141382e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:32.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.093+0000 7f141382e800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.094+0000 7f141382e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:47:32.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.094+0000 7f141382e800 20 searching for the correct realm 2024-03-09T14:47:32.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.095+0000 7f140f290640 0 -- 172.21.15.88:0/1849498310 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f1408020050 msgr2=0x7f140802e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:47:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.301+0000 7f140e28e640 0 -- 172.21.15.88:0/1849498310 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f14080029a0 msgr2=0x7f1408030740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:47:32.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.507+0000 7f141382e800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:47:32.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.507+0000 7f141382e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:47:32.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.507+0000 7f141382e800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:47:32.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.507+0000 7f141382e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:47:32.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.507+0000 7f141382e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:47:32.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.507+0000 7f141382e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:47:32.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.507+0000 7f141382e800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.507+0000 7f141382e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:32.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.508+0000 7f141382e800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.508+0000 7f141382e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.508+0000 7f141382e800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.508+0000 7f141382e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.508+0000 7f141382e800 20 zone default found 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.508+0000 7f141382e800 4 Realm: () 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.508+0000 7f141382e800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.508+0000 7f141382e800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.508+0000 7f141382e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.508+0000 7f141382e800 20 zonegroup default 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.508+0000 7f141382e800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.508+0000 7f141382e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.508+0000 7f141382e800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.509+0000 7f141382e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.509+0000 7f141382e800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.509+0000 7f141382e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.509+0000 7f141382e800 20 started sync module instance, tier type = 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.509+0000 7f141382e800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:47:32.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.519+0000 7f141382e800 20 add_watcher() i=0 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.519+0000 7f141382e800 20 add_watcher() i=1 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.519+0000 7f141382e800 20 add_watcher() i=2 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.519+0000 7f141382e800 20 add_watcher() i=3 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.519+0000 7f141382e800 20 add_watcher() i=4 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.519+0000 7f141382e800 20 add_watcher() i=5 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.519+0000 7f141382e800 20 add_watcher() i=6 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.520+0000 7f141382e800 20 add_watcher() i=7 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.520+0000 7f141382e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.521+0000 7f12c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.522+0000 7f141382e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.522+0000 7f141382e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.557+0000 7f123ffff640 20 reqs_thread_entry: start 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.557+0000 7f141382e800 20 init_complete bucket index max shards: 11 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.557+0000 7f141382e800 20 Filter name: none 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.557+0000 7f123dffb640 20 reqs_thread_entry: start 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.557+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.558+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.559+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.559+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.560+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.561+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.562+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.562+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.563+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:47:32.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.565+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.565+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.566+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.567+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.568+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.569+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.569+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.570+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.571+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.572+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.572+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.573+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.574+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.575+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.575+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.576+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:47:32.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.577+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.578+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.578+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.579+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.581+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.581+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.581+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.582+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.584+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.584+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.584+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.585+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.587+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.587+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.588+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.589+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.590+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.590+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.591+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.592+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.593+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.593+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.594+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.595+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:47:32.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.596+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.597+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.597+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.598+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:47:32.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.599+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.600+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.600+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.601+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:47:32.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.602+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.603+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.603+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.604+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:47:32.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.605+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.605+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.606+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.606+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:47:32.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.608+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.608+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.609+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.609+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:47:32.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.611+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.611+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.611+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.613+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:47:32.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.614+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.614+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.615+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.616+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:47:32.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.617+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.617+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.618+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.619+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:47:32.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.620+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.621+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.621+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.622+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:47:32.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.623+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.623+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.623+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.624+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:47:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.625+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.626+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.626+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.627+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:47:32.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.628+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.629+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.629+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.631+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:47:32.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.632+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.632+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.632+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.633+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:47:32.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.635+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.635+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.636+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.637+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:47:32.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.638+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.638+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.638+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.639+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:47:32.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.641+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.641+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.641+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.643+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:47:32.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.644+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.644+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.644+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.645+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:47:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.647+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.647+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.647+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.648+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:47:32.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.650+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.650+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.650+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.651+0000 7f141382e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:47:32.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.652+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.653+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.653+0000 7f141382e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.655+0000 7f12c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:32.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.657+0000 7f141382e800 20 remove_watcher() i=0 2024-03-09T14:47:32.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.657+0000 7f141382e800 2 removed watcher, disabling cache 2024-03-09T14:47:32.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.658+0000 7f141382e800 20 remove_watcher() i=1 2024-03-09T14:47:32.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.659+0000 7f141382e800 20 remove_watcher() i=2 2024-03-09T14:47:32.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.660+0000 7f141382e800 20 remove_watcher() i=3 2024-03-09T14:47:32.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.661+0000 7f141382e800 20 remove_watcher() i=4 2024-03-09T14:47:32.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.662+0000 7f141382e800 20 remove_watcher() i=5 2024-03-09T14:47:32.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.664+0000 7f141382e800 20 remove_watcher() i=6 2024-03-09T14:47:32.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.665+0000 7f141382e800 20 remove_watcher() i=7 2024-03-09T14:47:32.675 DEBUG:teuthology.orchestra.run.smithi088:> radosgw-admin gc process --include-all 2024-03-09T14:47:32.723 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:47:32.723 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:47:32.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.757+0000 7fdac8e16800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.758+0000 7fdac8e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:32.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.758+0000 7fdac8e16800 20 realm 2024-03-09T14:47:32.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.758+0000 7fdac8e16800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.758+0000 7fdac8e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.759+0000 7fdac8e16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:47:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.759+0000 7fdac8e16800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.759+0000 7fdac8e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:32.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.759+0000 7fdac8e16800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.759+0000 7fdac8e16800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:32.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.759+0000 7fdac8e16800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.760+0000 7fdac8e16800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:47:32.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.760+0000 7fdac8e16800 20 searching for the correct realm 2024-03-09T14:47:32.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.762+0000 7fdac4d5f640 0 -- 172.21.15.88:0/2093471517 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x5597566480f0 msgr2=0x55975664a4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:47:32.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.765+0000 7fdac4d5f640 0 -- 172.21.15.88:0/2093471517 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x7fd98c07ace0 msgr2=0x7fd98c07d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:47:32.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.770+0000 7fdac8e16800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:47:32.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.770+0000 7fdac8e16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:47:32.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.770+0000 7fdac8e16800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:47:32.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.770+0000 7fdac8e16800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:47:32.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.770+0000 7fdac8e16800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:47:32.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.770+0000 7fdac8e16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:47:32.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.770+0000 7fdac8e16800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.771+0000 7fdac8e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:32.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.771+0000 7fdac8e16800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.771+0000 7fdac8e16800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.771+0000 7fdac8e16800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.771+0000 7fdac8e16800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:47:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.771+0000 7fdac8e16800 20 zone default found 2024-03-09T14:47:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.771+0000 7fdac8e16800 4 Realm: () 2024-03-09T14:47:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.771+0000 7fdac8e16800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:47:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.771+0000 7fdac8e16800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:47:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.771+0000 7fdac8e16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:47:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.771+0000 7fdac8e16800 20 zonegroup default 2024-03-09T14:47:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.771+0000 7fdac8e16800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.772+0000 7fdac8e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.772+0000 7fdac8e16800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.772+0000 7fdac8e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.772+0000 7fdac8e16800 20 rados->read ofs=0 len=0 2024-03-09T14:47:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.772+0000 7fdac8e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.772+0000 7fdac8e16800 20 started sync module instance, tier type = 2024-03-09T14:47:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.772+0000 7fdac8e16800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:47:32.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.781+0000 7fdac8e16800 20 add_watcher() i=0 2024-03-09T14:47:32.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.781+0000 7fdac8e16800 20 add_watcher() i=1 2024-03-09T14:47:32.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.781+0000 7fdac8e16800 20 add_watcher() i=2 2024-03-09T14:47:32.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.781+0000 7fdac8e16800 20 add_watcher() i=3 2024-03-09T14:47:32.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.781+0000 7fdac8e16800 20 add_watcher() i=4 2024-03-09T14:47:32.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.781+0000 7fdac8e16800 20 add_watcher() i=5 2024-03-09T14:47:32.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.781+0000 7fdac8e16800 20 add_watcher() i=6 2024-03-09T14:47:32.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.781+0000 7fdac8e16800 20 add_watcher() i=7 2024-03-09T14:47:32.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.781+0000 7fdac8e16800 2 all 8 watchers are set, enabling cache 2024-03-09T14:47:32.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.783+0000 7fd97afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:32.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.783+0000 7fdac8e16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:47:32.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.783+0000 7fdac8e16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:47:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.816+0000 7fd979fdb640 20 reqs_thread_entry: start 2024-03-09T14:47:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.816+0000 7fdac8e16800 20 init_complete bucket index max shards: 11 2024-03-09T14:47:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.816+0000 7fdac8e16800 20 Filter name: none 2024-03-09T14:47:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.816+0000 7fd8eb7fe640 20 reqs_thread_entry: start 2024-03-09T14:47:32.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.816+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:47:32.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.817+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.818+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.818+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.819+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:47:32.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.820+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.820+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.821+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.822+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:47:32.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.823+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.824+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.824+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.826+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:47:32.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.827+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.827+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.827+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.828+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:47:32.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.830+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.831+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.831+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.832+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:47:32.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.833+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.833+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.834+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.835+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:47:32.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.836+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.836+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.836+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.837+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:47:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.839+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.839+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.839+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.840+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:47:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.842+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.842+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.842+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.843+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:47:32.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.844+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.845+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.845+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.846+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:47:32.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.847+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.848+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.848+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.850+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:47:32.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.851+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.851+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.852+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.853+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:47:32.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.854+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.854+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.854+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.855+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:47:32.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.857+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.857+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.858+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.859+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:47:32.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.860+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.860+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.861+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.862+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:47:32.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.863+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.863+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.864+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.864+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:47:32.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.866+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.866+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.866+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.867+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:47:32.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.869+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.869+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.869+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.870+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:47:32.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.872+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.872+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.872+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.873+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:47:32.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.875+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.875+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.875+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.876+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:47:32.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.878+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.878+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.878+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.879+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:47:32.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.880+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.881+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.881+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.882+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:47:32.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.883+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.884+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.884+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.885+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:47:32.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.886+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.887+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.887+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.888+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:47:32.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.889+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.890+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.890+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.891+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:47:32.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.892+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.893+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.893+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.894+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:47:32.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.895+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.896+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.896+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.897+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:47:32.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.898+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.898+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.899+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.900+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:47:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.902+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.902+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.902+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.904+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:47:32.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.905+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.905+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.905+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.906+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:47:32.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.908+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.908+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.909+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.910+0000 7fdac8e16800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:47:32.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.911+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.911+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:32.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.912+0000 7fdac8e16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:32.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.913+0000 7fd97afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:32.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.916+0000 7fdac8e16800 20 remove_watcher() i=0 2024-03-09T14:47:32.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.916+0000 7fdac8e16800 2 removed watcher, disabling cache 2024-03-09T14:47:32.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.917+0000 7fdac8e16800 20 remove_watcher() i=1 2024-03-09T14:47:32.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.918+0000 7fdac8e16800 20 remove_watcher() i=2 2024-03-09T14:47:32.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.919+0000 7fdac8e16800 20 remove_watcher() i=3 2024-03-09T14:47:32.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.920+0000 7fdac8e16800 20 remove_watcher() i=4 2024-03-09T14:47:32.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.921+0000 7fdac8e16800 20 remove_watcher() i=5 2024-03-09T14:47:32.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.922+0000 7fdac8e16800 20 remove_watcher() i=6 2024-03-09T14:47:32.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:32.923+0000 7fdac8e16800 20 remove_watcher() i=7 2024-03-09T14:47:32.933 DEBUG:teuthology.orchestra.run.smithi088:> radosgw-admin gc process --include-all 2024-03-09T14:47:32.982 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:47:32.982 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:47:33.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.015+0000 7f0aeeb2a800 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.016+0000 7f0aeeb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:33.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.016+0000 7f0aeeb2a800 20 realm 2024-03-09T14:47:33.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.016+0000 7f0aeeb2a800 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.016+0000 7f0aeeb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:33.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.017+0000 7f0aeeb2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:47:33.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.017+0000 7f0aeeb2a800 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.017+0000 7f0aeeb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:33.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.017+0000 7f0aeeb2a800 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.017+0000 7f0aeeb2a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:33.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.017+0000 7f0aeeb2a800 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.018+0000 7f0aeeb2a800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:47:33.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.018+0000 7f0aeeb2a800 20 searching for the correct realm 2024-03-09T14:47:33.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.020+0000 7f0aeb02f640 0 -- 172.21.15.88:0/3409146497 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f0ae4067070 msgr2=0x7f0ae4082440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:47:33.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.226+0000 7f0aea02d640 0 -- 172.21.15.88:0/3409146497 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f0ae4082b20 msgr2=0x7f0ae405e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:47:33.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.433+0000 7f0aeeb2a800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:47:33.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.433+0000 7f0aeeb2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:47:33.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.433+0000 7f0aeeb2a800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:47:33.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.433+0000 7f0aeeb2a800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:47:33.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.433+0000 7f0aeeb2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:47:33.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.433+0000 7f0aeeb2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:47:33.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.433+0000 7f0aeeb2a800 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.433+0000 7f0aeeb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:33.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.433+0000 7f0aeeb2a800 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.433+0000 7f0aeeb2a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:33.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.433+0000 7f0aeeb2a800 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.434+0000 7f0aeeb2a800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:47:33.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.434+0000 7f0aeeb2a800 20 zone default found 2024-03-09T14:47:33.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.434+0000 7f0aeeb2a800 4 Realm: () 2024-03-09T14:47:33.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.434+0000 7f0aeeb2a800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:47:33.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.434+0000 7f0aeeb2a800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:47:33.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.434+0000 7f0aeeb2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:47:33.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.434+0000 7f0aeeb2a800 20 zonegroup default 2024-03-09T14:47:33.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.434+0000 7f0aeeb2a800 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.434+0000 7f0aeeb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:33.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.434+0000 7f0aeeb2a800 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.434+0000 7f0aeeb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:33.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.434+0000 7f0aeeb2a800 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.435+0000 7f0aeeb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:33.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.435+0000 7f0aeeb2a800 20 started sync module instance, tier type = 2024-03-09T14:47:33.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.435+0000 7f0aeeb2a800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:47:33.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.444+0000 7f0aeeb2a800 20 add_watcher() i=0 2024-03-09T14:47:33.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.444+0000 7f0aeeb2a800 20 add_watcher() i=1 2024-03-09T14:47:33.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.444+0000 7f0aeeb2a800 20 add_watcher() i=2 2024-03-09T14:47:33.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.444+0000 7f0aeeb2a800 20 add_watcher() i=3 2024-03-09T14:47:33.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.444+0000 7f0aeeb2a800 20 add_watcher() i=4 2024-03-09T14:47:33.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.444+0000 7f0aeeb2a800 20 add_watcher() i=5 2024-03-09T14:47:33.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.444+0000 7f0aeeb2a800 20 add_watcher() i=6 2024-03-09T14:47:33.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.445+0000 7f0aeeb2a800 20 add_watcher() i=7 2024-03-09T14:47:33.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.445+0000 7f0aeeb2a800 2 all 8 watchers are set, enabling cache 2024-03-09T14:47:33.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.447+0000 7f09a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:33.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.447+0000 7f0aeeb2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:47:33.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.447+0000 7f0aeeb2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:47:33.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.483+0000 7f091bfff640 20 reqs_thread_entry: start 2024-03-09T14:47:33.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.483+0000 7f0aeeb2a800 20 init_complete bucket index max shards: 11 2024-03-09T14:47:33.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.483+0000 7f0aeeb2a800 20 Filter name: none 2024-03-09T14:47:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.483+0000 7f0919ffb640 20 reqs_thread_entry: start 2024-03-09T14:47:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.483+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:47:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.485+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.485+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.485+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.486+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:47:33.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.488+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.489+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.489+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.490+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:47:33.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.491+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.492+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.492+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.493+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:47:33.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.494+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.495+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.495+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.497+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:47:33.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.498+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.498+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.498+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.499+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:47:33.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.501+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.501+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.501+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.502+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:47:33.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.503+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.504+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.504+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.505+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:47:33.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.507+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.507+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.508+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.509+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:47:33.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.510+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.511+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.511+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.512+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:47:33.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.513+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.513+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.514+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.515+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:47:33.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.516+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.517+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.517+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.518+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:47:33.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.519+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.520+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.520+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.521+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:47:33.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.523+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.523+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.523+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.525+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:47:33.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.526+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.526+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.527+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.528+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:47:33.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.529+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.530+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.530+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.531+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:47:33.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.532+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.533+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.533+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.534+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:47:33.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.536+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.536+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.536+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.537+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:47:33.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.539+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.539+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.539+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.540+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:47:33.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.542+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.543+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.543+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.544+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:47:33.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.545+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.546+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.546+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.547+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:47:33.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.548+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.549+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.549+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.550+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:47:33.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.552+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.552+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.552+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.553+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:47:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.554+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.555+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.555+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.556+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:47:33.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.557+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.558+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.558+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.559+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:47:33.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.560+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.561+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.561+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.562+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:47:33.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.563+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.564+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.564+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.565+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:47:33.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.566+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.567+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.567+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.568+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:47:33.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.569+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.570+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.570+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.571+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:47:33.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.572+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.573+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.573+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.574+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:47:33.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.576+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.576+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.576+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.577+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:47:33.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.578+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.579+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.579+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.580+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:47:33.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.581+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.582+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:33.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.582+0000 7f0aeeb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:33.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.583+0000 7f09a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:33.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.585+0000 7f0aeeb2a800 20 remove_watcher() i=0 2024-03-09T14:47:33.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.585+0000 7f0aeeb2a800 2 removed watcher, disabling cache 2024-03-09T14:47:33.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.587+0000 7f0aeeb2a800 20 remove_watcher() i=1 2024-03-09T14:47:33.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.588+0000 7f0aeeb2a800 20 remove_watcher() i=2 2024-03-09T14:47:33.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.589+0000 7f0aeeb2a800 20 remove_watcher() i=3 2024-03-09T14:47:33.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.590+0000 7f0aeeb2a800 20 remove_watcher() i=4 2024-03-09T14:47:33.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.591+0000 7f0aeeb2a800 20 remove_watcher() i=5 2024-03-09T14:47:33.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.592+0000 7f0aeeb2a800 20 remove_watcher() i=6 2024-03-09T14:47:33.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:33.593+0000 7f0aeeb2a800 20 remove_watcher() i=7 2024-03-09T14:47:33.602 DEBUG:teuthology.orchestra.run.smithi088:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-03-09T14:47:34.097 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :clean 2024-03-09T14:47:34.995 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :compileJava 2024-03-09T14:47:34.995 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :processResources 2024-03-09T14:47:34.995 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :classes 2024-03-09T14:47:35.494 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:35.495 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :compileTestJava 2024-03-09T14:47:35.495 INFO:teuthology.orchestra.run.smithi088.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-03-09T14:47:35.495 INFO:teuthology.orchestra.run.smithi088.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-03-09T14:47:35.496 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:35.496 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :processTestResources NO-SOURCE 2024-03-09T14:47:35.496 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :testClasses 2024-03-09T14:47:37.496 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:37.496 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :test 2024-03-09T14:47:37.496 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:37.496 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests STANDARD_OUT 2024-03-09T14:47:37.497 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09 14:47:36,657 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-03-09T14:47:37.497 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:37.497 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-03-09T14:47:37.497 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:37.497 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-03-09T14:47:37.497 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:37.497 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-03-09T14:47:37.497 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:37.497 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-03-09T14:47:37.695 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:37.695 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-03-09T14:47:37.695 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:37.695 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-03-09T14:47:37.994 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:37.994 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-03-09T14:47:38.195 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:38.195 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-03-09T14:47:38.294 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:38.298 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-03-09T14:47:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:38.494 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-03-09T14:47:38.894 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:38.895 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-03-09T14:47:38.895 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:38.895 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-03-09T14:47:38.994 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:38.994 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-03-09T14:47:39.194 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:39.195 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-03-09T14:47:39.794 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:39.795 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-03-09T14:47:39.894 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:39.894 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-03-09T14:47:40.295 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:40.295 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-03-09T14:47:40.295 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:40.295 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-03-09T14:47:40.396 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:40.396 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------- 2024-03-09T14:47:40.396 INFO:teuthology.orchestra.run.smithi088.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-03-09T14:47:40.396 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------- 2024-03-09T14:47:40.396 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:40.396 INFO:teuthology.orchestra.run.smithi088.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-03-09T14:47:40.396 INFO:teuthology.orchestra.run.smithi088.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-03-09T14:47:40.396 INFO:teuthology.orchestra.run.smithi088.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-03-09T14:47:40.397 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:40.397 INFO:teuthology.orchestra.run.smithi088.stdout:BUILD SUCCESSFUL in 6s 2024-03-09T14:47:40.397 INFO:teuthology.orchestra.run.smithi088.stdout:5 actionable tasks: 5 executed 2024-03-09T14:47:40.407 DEBUG:teuthology.orchestra.run.smithi088:> radosgw-admin gc process --include-all 2024-03-09T14:47:40.456 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:47:40.457 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:47:40.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.489+0000 7fad9613b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:40.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.491+0000 7fad9613b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:40.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.491+0000 7fad9613b800 20 realm 2024-03-09T14:47:40.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.491+0000 7fad9613b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:40.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.491+0000 7fad9613b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:40.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.491+0000 7fad9613b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:47:40.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.491+0000 7fad9613b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:40.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.491+0000 7fad9613b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:40.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.491+0000 7fad9613b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:40.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.492+0000 7fad9613b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:40.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.492+0000 7fad9613b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:40.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.492+0000 7fad9613b800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:47:40.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.492+0000 7fad9613b800 20 searching for the correct realm 2024-03-09T14:47:40.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.494+0000 7fad926ce640 0 -- 172.21.15.88:0/3932759864 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fad8c05e040 msgr2=0x7fad8c08b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:47:40.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.699+0000 7fad916cc640 0 -- 172.21.15.88:0/3932759864 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fad8c0ad920 msgr2=0x7fad8c05f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:47:40.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:47:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:47:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:47:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:47:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:47:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:47:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:47:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 20 zone default found 2024-03-09T14:47:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 4 Realm: () 2024-03-09T14:47:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:47:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:47:40.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:47:40.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 20 zonegroup default 2024-03-09T14:47:40.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.906+0000 7fad9613b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:40.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.907+0000 7fad9613b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:40.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.907+0000 7fad9613b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:40.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.907+0000 7fad9613b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:40.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.907+0000 7fad9613b800 20 rados->read ofs=0 len=0 2024-03-09T14:47:40.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.907+0000 7fad9613b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:40.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.907+0000 7fad9613b800 20 started sync module instance, tier type = 2024-03-09T14:47:40.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.907+0000 7fad9613b800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:47:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.916+0000 7fad9613b800 20 add_watcher() i=0 2024-03-09T14:47:40.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.916+0000 7fad9613b800 20 add_watcher() i=1 2024-03-09T14:47:40.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.916+0000 7fad9613b800 20 add_watcher() i=2 2024-03-09T14:47:40.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.916+0000 7fad9613b800 20 add_watcher() i=3 2024-03-09T14:47:40.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.916+0000 7fad9613b800 20 add_watcher() i=4 2024-03-09T14:47:40.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.916+0000 7fad9613b800 20 add_watcher() i=5 2024-03-09T14:47:40.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.916+0000 7fad9613b800 20 add_watcher() i=6 2024-03-09T14:47:40.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.917+0000 7fad9613b800 20 add_watcher() i=7 2024-03-09T14:47:40.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.917+0000 7fad9613b800 2 all 8 watchers are set, enabling cache 2024-03-09T14:47:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.919+0000 7fac3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.919+0000 7fad9613b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:47:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.919+0000 7fad9613b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:47:40.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.955+0000 7fac3a7fc640 20 reqs_thread_entry: start 2024-03-09T14:47:40.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.955+0000 7fad9613b800 20 init_complete bucket index max shards: 11 2024-03-09T14:47:40.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.955+0000 7fad9613b800 20 Filter name: none 2024-03-09T14:47:40.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.955+0000 7fabb3fff640 20 reqs_thread_entry: start 2024-03-09T14:47:40.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.955+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:47:40.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.956+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.957+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:40.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.957+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.958+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:47:40.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.960+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.960+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:40.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.960+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.961+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:47:40.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.962+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.963+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:40.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.963+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.964+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:47:40.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.965+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.966+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:40.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.966+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.967+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:47:40.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.968+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.969+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:40.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.969+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.970+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:47:40.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.971+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.972+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:40.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.972+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.973+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:47:40.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.975+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.975+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:40.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.975+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.976+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:47:40.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.978+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.978+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:40.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.978+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.979+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:47:40.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.982+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.982+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:40.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.983+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.984+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:47:40.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.985+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.986+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:40.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.986+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.987+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:47:40.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.988+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.989+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:40.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.989+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.990+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:47:40.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.991+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.991+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:40.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.992+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.992+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:47:40.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.994+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.994+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:40.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.995+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.996+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:47:40.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.997+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.997+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:40.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.998+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:40.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:40.998+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:47:40.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.000+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.000+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.001+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.001+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:47:41.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.003+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.003+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.003+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.004+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:47:41.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.006+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.006+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.006+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.007+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:47:41.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.009+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.009+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.009+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.011+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:47:41.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.012+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.013+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.013+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.014+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:47:41.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.015+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.015+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.016+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.017+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:47:41.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.018+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.018+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.018+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.020+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:47:41.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.021+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.022+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.022+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.023+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:47:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.024+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.024+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.025+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.026+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:47:41.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.027+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.027+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.027+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.028+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:47:41.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.030+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.030+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.030+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.031+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:47:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.033+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.033+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.033+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.034+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:47:41.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.035+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.036+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.036+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.037+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:47:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.038+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.039+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.039+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.040+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:47:41.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.041+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.042+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.042+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.043+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:47:41.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.044+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.044+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.045+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.046+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:47:41.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.047+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.048+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.048+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.049+0000 7fad9613b800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:47:41.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.050+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.051+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.051+0000 7fad9613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.053+0000 7fac3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:41.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.055+0000 7fad9613b800 20 remove_watcher() i=0 2024-03-09T14:47:41.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.055+0000 7fad9613b800 2 removed watcher, disabling cache 2024-03-09T14:47:41.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.057+0000 7fad9613b800 20 remove_watcher() i=1 2024-03-09T14:47:41.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.058+0000 7fad9613b800 20 remove_watcher() i=2 2024-03-09T14:47:41.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.059+0000 7fad9613b800 20 remove_watcher() i=3 2024-03-09T14:47:41.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.060+0000 7fad9613b800 20 remove_watcher() i=4 2024-03-09T14:47:41.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.061+0000 7fad9613b800 20 remove_watcher() i=5 2024-03-09T14:47:41.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.062+0000 7fad9613b800 20 remove_watcher() i=6 2024-03-09T14:47:41.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.063+0000 7fad9613b800 20 remove_watcher() i=7 2024-03-09T14:47:41.073 DEBUG:teuthology.orchestra.run.smithi088:> radosgw-admin gc process --include-all 2024-03-09T14:47:41.123 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:47:41.124 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:47:41.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.159+0000 7fa175416800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.360+0000 7fa175416800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.360+0000 7fa175416800 20 realm 2024-03-09T14:47:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.360+0000 7fa175416800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.360+0000 7fa175416800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.360+0000 7fa175416800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:47:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.360+0000 7fa175416800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.361+0000 7fa175416800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.361+0000 7fa175416800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.361+0000 7fa175416800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.361+0000 7fa175416800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.362+0000 7fa175416800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:47:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.362+0000 7fa175416800 20 searching for the correct realm 2024-03-09T14:47:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.364+0000 7fa16bfff640 0 -- 172.21.15.88:0/3763013804 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7fa16404f070 msgr2=0x7fa164071430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:47:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.367+0000 7fa16bfff640 0 -- 172.21.15.88:0/3763013804 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7fa03c07ade0 msgr2=0x7fa03c07d210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:47:41.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:47:41.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:47:41.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:47:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:47:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:47:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:47:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:47:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 20 zone default found 2024-03-09T14:47:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 4 Realm: () 2024-03-09T14:47:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:47:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:47:41.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:47:41.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 20 zonegroup default 2024-03-09T14:47:41.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.373+0000 7fa175416800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.374+0000 7fa175416800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:41.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.374+0000 7fa175416800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.374+0000 7fa175416800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:41.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.374+0000 7fa175416800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.374+0000 7fa175416800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:41.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.374+0000 7fa175416800 20 started sync module instance, tier type = 2024-03-09T14:47:41.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.374+0000 7fa175416800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:47:41.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.382+0000 7fa175416800 20 add_watcher() i=0 2024-03-09T14:47:41.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.382+0000 7fa175416800 20 add_watcher() i=1 2024-03-09T14:47:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.382+0000 7fa175416800 20 add_watcher() i=2 2024-03-09T14:47:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.382+0000 7fa175416800 20 add_watcher() i=3 2024-03-09T14:47:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.382+0000 7fa175416800 20 add_watcher() i=4 2024-03-09T14:47:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.382+0000 7fa175416800 20 add_watcher() i=5 2024-03-09T14:47:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.382+0000 7fa175416800 20 add_watcher() i=6 2024-03-09T14:47:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.383+0000 7fa175416800 20 add_watcher() i=7 2024-03-09T14:47:41.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.383+0000 7fa175416800 2 all 8 watchers are set, enabling cache 2024-03-09T14:47:41.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.385+0000 7fa026fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:41.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.386+0000 7fa175416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:47:41.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.386+0000 7fa175416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:47:41.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.418+0000 7fa025fe3640 20 reqs_thread_entry: start 2024-03-09T14:47:41.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.418+0000 7fa175416800 20 init_complete bucket index max shards: 11 2024-03-09T14:47:41.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.418+0000 7fa175416800 20 Filter name: none 2024-03-09T14:47:41.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.419+0000 7f9f977fe640 20 reqs_thread_entry: start 2024-03-09T14:47:41.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.419+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:47:41.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.420+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.421+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.421+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.422+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:47:41.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.423+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.424+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.424+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.425+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:47:41.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.426+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.427+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.427+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.428+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:47:41.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.429+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.429+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.430+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.431+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:47:41.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.432+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.433+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.433+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.434+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:47:41.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.435+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.436+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.436+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.437+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:47:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.438+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.439+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.439+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.440+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:47:41.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.441+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.442+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.442+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.443+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:47:41.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.445+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.445+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.445+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.446+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:47:41.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.448+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.448+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.448+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.450+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:47:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.451+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.451+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.452+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.453+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:47:41.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.454+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.454+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.454+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.455+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:47:41.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.456+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.457+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.457+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.459+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:47:41.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.460+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.461+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.461+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.462+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:47:41.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.463+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.463+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.464+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.465+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:47:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.466+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.467+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.467+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.468+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:47:41.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.470+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.470+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.470+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.472+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:47:41.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.473+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.474+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.474+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.475+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:47:41.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.476+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.477+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.477+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.478+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:47:41.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.480+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.480+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.481+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.482+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:47:41.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.483+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.483+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.484+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.485+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:47:41.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.486+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.486+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.487+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.488+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:47:41.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.489+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.489+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.490+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.491+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:47:41.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.492+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.492+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.492+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.493+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:47:41.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.495+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.495+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.495+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.496+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:47:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.498+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.498+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.498+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.500+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.501+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.501+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.502+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.503+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:47:41.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.504+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.504+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.505+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.506+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:47:41.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.507+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.508+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.508+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.509+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:47:41.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.510+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.511+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.511+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.512+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:47:41.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.513+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.514+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.514+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.516+0000 7fa175416800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:47:41.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.517+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.517+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:41.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.518+0000 7fa175416800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:41.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.519+0000 7fa026fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:41.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.522+0000 7fa175416800 20 remove_watcher() i=0 2024-03-09T14:47:41.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.522+0000 7fa175416800 2 removed watcher, disabling cache 2024-03-09T14:47:41.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.523+0000 7fa175416800 20 remove_watcher() i=1 2024-03-09T14:47:41.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.524+0000 7fa175416800 20 remove_watcher() i=2 2024-03-09T14:47:41.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.524+0000 7fa175416800 20 remove_watcher() i=3 2024-03-09T14:47:41.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.526+0000 7fa175416800 20 remove_watcher() i=4 2024-03-09T14:47:41.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.527+0000 7fa175416800 20 remove_watcher() i=5 2024-03-09T14:47:41.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.527+0000 7fa175416800 20 remove_watcher() i=6 2024-03-09T14:47:41.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.528+0000 7fa175416800 20 remove_watcher() i=7 2024-03-09T14:47:41.538 DEBUG:teuthology.orchestra.run.smithi088:> radosgw-admin gc process --include-all 2024-03-09T14:47:41.588 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:47:41.588 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:47:41.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.621+0000 7ffa33d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.622+0000 7ffa33d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:41.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.622+0000 7ffa33d2d800 20 realm 2024-03-09T14:47:41.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.622+0000 7ffa33d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.623+0000 7ffa33d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:41.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.623+0000 7ffa33d2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:47:41.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.623+0000 7ffa33d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.623+0000 7ffa33d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:41.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.623+0000 7ffa33d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.624+0000 7ffa33d2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:41.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.624+0000 7ffa33d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:47:41.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.624+0000 7ffa33d2d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:47:41.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.624+0000 7ffa33d2d800 20 searching for the correct realm 2024-03-09T14:47:41.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.626+0000 7ffa3017b640 0 -- 172.21.15.88:0/327018487 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7ffa28092020 msgr2=0x7ffa280cd7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:47:41.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:41.831+0000 7ffa2f179640 0 -- 172.21.15.88:0/327018487 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7ffa280d5340 msgr2=0x7ffa280d15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:47:42.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.037+0000 7ffa33d2d800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:47:42.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.037+0000 7ffa33d2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:47:42.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.037+0000 7ffa33d2d800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:47:42.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.037+0000 7ffa33d2d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:47:42.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.037+0000 7ffa33d2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:47:42.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.037+0000 7ffa33d2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:47:42.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.037+0000 7ffa33d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.037+0000 7ffa33d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:42.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.037+0000 7ffa33d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.038+0000 7ffa33d2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.038+0000 7ffa33d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.038+0000 7ffa33d2d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:47:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.038+0000 7ffa33d2d800 20 zone default found 2024-03-09T14:47:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.038+0000 7ffa33d2d800 4 Realm: () 2024-03-09T14:47:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.038+0000 7ffa33d2d800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:47:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.038+0000 7ffa33d2d800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:47:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.038+0000 7ffa33d2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:47:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.038+0000 7ffa33d2d800 20 zonegroup default 2024-03-09T14:47:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.038+0000 7ffa33d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.038+0000 7ffa33d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:42.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.038+0000 7ffa33d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.038+0000 7ffa33d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:42.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.039+0000 7ffa33d2d800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.039+0000 7ffa33d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:42.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.039+0000 7ffa33d2d800 20 started sync module instance, tier type = 2024-03-09T14:47:42.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.039+0000 7ffa33d2d800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:47:42.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.050+0000 7ffa33d2d800 20 add_watcher() i=0 2024-03-09T14:47:42.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.050+0000 7ffa33d2d800 20 add_watcher() i=1 2024-03-09T14:47:42.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.050+0000 7ffa33d2d800 20 add_watcher() i=2 2024-03-09T14:47:42.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.050+0000 7ffa33d2d800 20 add_watcher() i=3 2024-03-09T14:47:42.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.050+0000 7ffa33d2d800 20 add_watcher() i=4 2024-03-09T14:47:42.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.050+0000 7ffa33d2d800 20 add_watcher() i=5 2024-03-09T14:47:42.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.050+0000 7ffa33d2d800 20 add_watcher() i=6 2024-03-09T14:47:42.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.051+0000 7ffa33d2d800 20 add_watcher() i=7 2024-03-09T14:47:42.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.051+0000 7ffa33d2d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:47:42.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.053+0000 7ff8e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:42.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.053+0000 7ffa33d2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:47:42.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.053+0000 7ffa33d2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:47:42.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.088+0000 7ff8e4fe1640 20 reqs_thread_entry: start 2024-03-09T14:47:42.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.088+0000 7ffa33d2d800 20 init_complete bucket index max shards: 11 2024-03-09T14:47:42.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.088+0000 7ffa33d2d800 20 Filter name: none 2024-03-09T14:47:42.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.088+0000 7ff85e7fc640 20 reqs_thread_entry: start 2024-03-09T14:47:42.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.088+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:47:42.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.089+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.090+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.090+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.091+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:47:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.092+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.092+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.093+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.094+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:47:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.095+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.096+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.096+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.097+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:47:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.098+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.099+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.099+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.100+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:47:42.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.102+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.102+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.102+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.103+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:47:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.105+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.106+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.106+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.107+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:47:42.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.108+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.108+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.109+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.109+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:47:42.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.111+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.111+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.111+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.112+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:47:42.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.114+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.115+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.115+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.116+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:47:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.117+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.118+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.118+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.119+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:47:42.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.120+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.121+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.121+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.122+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:47:42.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.123+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.124+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.124+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.125+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:47:42.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.126+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.126+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.127+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.127+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:47:42.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.129+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.129+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.129+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.130+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:47:42.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.132+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.132+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.132+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.134+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:47:42.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.135+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.135+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.136+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.137+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:47:42.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.139+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.139+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.140+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.141+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:47:42.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.142+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.142+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.143+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.144+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:47:42.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.145+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.145+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.146+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.147+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:47:42.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.148+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.148+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.148+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.150+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:47:42.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.151+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.151+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.152+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.152+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:47:42.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.154+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.154+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.155+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.155+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:47:42.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.157+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.157+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.157+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.158+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:47:42.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.159+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.160+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.160+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.161+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:47:42.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.162+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.163+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.163+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.164+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:47:42.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.165+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.166+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.166+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.167+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:47:42.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.168+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.169+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.169+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.170+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:47:42.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.171+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.172+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.172+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.173+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:47:42.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.175+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.175+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.175+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.176+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:47:42.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.177+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.178+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.178+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.179+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:47:42.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.180+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.180+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.181+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.181+0000 7ffa33d2d800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:47:42.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.183+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.184+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.184+0000 7ffa33d2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.186+0000 7ff8e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:42.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.188+0000 7ffa33d2d800 20 remove_watcher() i=0 2024-03-09T14:47:42.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.188+0000 7ffa33d2d800 2 removed watcher, disabling cache 2024-03-09T14:47:42.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.189+0000 7ffa33d2d800 20 remove_watcher() i=1 2024-03-09T14:47:42.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.190+0000 7ffa33d2d800 20 remove_watcher() i=2 2024-03-09T14:47:42.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.191+0000 7ffa33d2d800 20 remove_watcher() i=3 2024-03-09T14:47:42.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.192+0000 7ffa33d2d800 20 remove_watcher() i=4 2024-03-09T14:47:42.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.193+0000 7ffa33d2d800 20 remove_watcher() i=5 2024-03-09T14:47:42.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.194+0000 7ffa33d2d800 20 remove_watcher() i=6 2024-03-09T14:47:42.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.195+0000 7ffa33d2d800 20 remove_watcher() i=7 2024-03-09T14:47:42.205 DEBUG:teuthology.orchestra.run.smithi088:> radosgw-admin gc process --include-all 2024-03-09T14:47:42.254 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:47:42.254 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:47:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.288+0000 7fc03b31f800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.289+0000 7fc03b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.289+0000 7fc03b31f800 20 realm 2024-03-09T14:47:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.289+0000 7fc03b31f800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.289+0000 7fc03b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.289+0000 7fc03b31f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:47:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.289+0000 7fc03b31f800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.289+0000 7fc03b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.289+0000 7fc03b31f800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.290+0000 7fc03b31f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:42.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.290+0000 7fc03b31f800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.291+0000 7fc03b31f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:47:42.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.291+0000 7fc03b31f800 20 searching for the correct realm 2024-03-09T14:47:42.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.293+0000 7fc0377ea640 0 -- 172.21.15.88:0/2156830240 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fc03005e5a0 msgr2=0x7fc03005e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:47:42.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.498+0000 7fc0367e8640 0 -- 172.21.15.88:0/2156830240 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fc030090bc0 msgr2=0x7fc030088140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:47:42.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.704+0000 7fc03b31f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:47:42.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.704+0000 7fc03b31f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:47:42.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.704+0000 7fc03b31f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:47:42.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.704+0000 7fc03b31f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:47:42.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.704+0000 7fc03b31f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:47:42.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.704+0000 7fc03b31f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:47:42.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.704+0000 7fc03b31f800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.705+0000 7fc03b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:42.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.705+0000 7fc03b31f800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.705+0000 7fc03b31f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:42.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.705+0000 7fc03b31f800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.705+0000 7fc03b31f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:47:42.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.705+0000 7fc03b31f800 20 zone default found 2024-03-09T14:47:42.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.705+0000 7fc03b31f800 4 Realm: () 2024-03-09T14:47:42.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.705+0000 7fc03b31f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:47:42.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.705+0000 7fc03b31f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:47:42.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.705+0000 7fc03b31f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:47:42.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.705+0000 7fc03b31f800 20 zonegroup default 2024-03-09T14:47:42.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.705+0000 7fc03b31f800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.705+0000 7fc03b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:42.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.705+0000 7fc03b31f800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.706+0000 7fc03b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:42.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.706+0000 7fc03b31f800 20 rados->read ofs=0 len=0 2024-03-09T14:47:42.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.706+0000 7fc03b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:42.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.706+0000 7fc03b31f800 20 started sync module instance, tier type = 2024-03-09T14:47:42.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.706+0000 7fc03b31f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:47:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.716+0000 7fc03b31f800 20 add_watcher() i=0 2024-03-09T14:47:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.716+0000 7fc03b31f800 20 add_watcher() i=1 2024-03-09T14:47:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.716+0000 7fc03b31f800 20 add_watcher() i=2 2024-03-09T14:47:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.716+0000 7fc03b31f800 20 add_watcher() i=3 2024-03-09T14:47:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.716+0000 7fc03b31f800 20 add_watcher() i=4 2024-03-09T14:47:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.716+0000 7fc03b31f800 20 add_watcher() i=5 2024-03-09T14:47:42.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.716+0000 7fc03b31f800 20 add_watcher() i=6 2024-03-09T14:47:42.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.717+0000 7fc03b31f800 20 add_watcher() i=7 2024-03-09T14:47:42.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.717+0000 7fc03b31f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:47:42.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.719+0000 7fbeed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:42.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.719+0000 7fc03b31f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:47:42.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.719+0000 7fc03b31f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:47:42.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.758+0000 7fbe67fff640 20 reqs_thread_entry: start 2024-03-09T14:47:42.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.758+0000 7fc03b31f800 20 init_complete bucket index max shards: 11 2024-03-09T14:47:42.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.758+0000 7fc03b31f800 20 Filter name: none 2024-03-09T14:47:42.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.758+0000 7fbe65ffb640 20 reqs_thread_entry: start 2024-03-09T14:47:42.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.758+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:47:42.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.760+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.760+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.760+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.762+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:47:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.763+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.763+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.763+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.764+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:47:42.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.766+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.766+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.767+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.768+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:47:42.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.769+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.769+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.770+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.771+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:47:42.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.772+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.772+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.773+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.774+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:47:42.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.775+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.776+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.776+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.777+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:47:42.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.778+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.779+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.779+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.780+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:47:42.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.781+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.782+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.782+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.783+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:47:42.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.784+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.785+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.785+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.786+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:47:42.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.787+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.787+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.788+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.789+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:47:42.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.790+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.790+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.790+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.791+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:47:42.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.793+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.793+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.793+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.794+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:47:42.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.795+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.796+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.796+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.797+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:47:42.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.798+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.799+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.799+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.800+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:47:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.801+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.802+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.802+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.803+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:47:42.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.804+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.805+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.805+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.806+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:47:42.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.807+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.807+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.808+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.809+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:47:42.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.810+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.811+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.811+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.812+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:47:42.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.813+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.814+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.814+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.815+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:47:42.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.816+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.817+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.817+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.818+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:47:42.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.819+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.820+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.820+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.821+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:47:42.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.822+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.823+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.823+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.824+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:47:42.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.825+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.826+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.826+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.827+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:47:42.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.828+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.829+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.829+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.830+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:47:42.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.831+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.831+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.832+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.833+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:47:42.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.834+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.835+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.835+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.836+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:47:42.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.837+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.838+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.838+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.839+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:47:42.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.840+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.841+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.841+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.842+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:47:42.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.844+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.844+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.844+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.845+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:47:42.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.847+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.847+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.848+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.848+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:47:42.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.850+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.850+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.850+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.851+0000 7fc03b31f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:47:42.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.852+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.853+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:42.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.853+0000 7fc03b31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:42.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.855+0000 7fbeed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:42.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.857+0000 7fc03b31f800 20 remove_watcher() i=0 2024-03-09T14:47:42.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.857+0000 7fc03b31f800 2 removed watcher, disabling cache 2024-03-09T14:47:42.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.858+0000 7fc03b31f800 20 remove_watcher() i=1 2024-03-09T14:47:42.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.859+0000 7fc03b31f800 20 remove_watcher() i=2 2024-03-09T14:47:42.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.860+0000 7fc03b31f800 20 remove_watcher() i=3 2024-03-09T14:47:42.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.860+0000 7fc03b31f800 20 remove_watcher() i=4 2024-03-09T14:47:42.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.861+0000 7fc03b31f800 20 remove_watcher() i=5 2024-03-09T14:47:42.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.862+0000 7fc03b31f800 20 remove_watcher() i=6 2024-03-09T14:47:42.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:47:42.863+0000 7fc03b31f800 20 remove_watcher() i=7 2024-03-09T14:47:42.873 DEBUG:teuthology.orchestra.run.smithi088:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-03-09T14:47:43.358 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :clean 2024-03-09T14:47:44.255 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :compileJava 2024-03-09T14:47:44.255 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :processResources 2024-03-09T14:47:44.255 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :classes 2024-03-09T14:47:44.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:44.655 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :compileTestJava 2024-03-09T14:47:44.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:44.655 INFO:teuthology.orchestra.run.smithi088.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-03-09T14:47:44.655 INFO:teuthology.orchestra.run.smithi088.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-03-09T14:47:44.656 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :processTestResources NO-SOURCE 2024-03-09T14:47:44.656 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :testClasses 2024-03-09T14:47:46.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:46.655 INFO:teuthology.orchestra.run.smithi088.stdout:> Task :test 2024-03-09T14:47:46.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:46.656 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests STANDARD_OUT 2024-03-09T14:47:46.656 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09 14:47:45,850 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-03-09T14:47:46.656 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:46.656 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-03-09T14:47:46.656 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:46.656 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-03-09T14:47:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:46.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-03-09T14:47:46.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:46.854 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-03-09T14:47:47.155 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:47.155 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-03-09T14:47:47.255 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:47.255 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-03-09T14:47:47.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:47.655 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-03-09T14:47:49.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:49.655 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-03-09T14:47:50.054 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:50.054 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-03-09T14:47:50.154 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:50.154 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-03-09T14:47:50.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:50.554 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-03-09T14:47:50.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:50.654 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-03-09T14:47:51.055 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:51.055 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-03-09T14:47:51.055 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:51.055 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-03-09T14:47:51.154 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:51.154 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-03-09T14:47:51.254 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:51.254 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-03-09T14:47:51.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:51.554 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-03-09T14:47:53.154 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:53.154 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-03-09T14:47:53.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:53.554 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-03-09T14:47:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:53.654 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-03-09T14:47:54.054 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:54.054 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-03-09T14:47:54.054 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:54.054 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-03-09T14:47:54.454 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:54.454 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-03-09T14:47:54.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:54.554 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-03-09T14:47:54.954 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:54.954 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-03-09T14:47:55.054 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:55.054 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-03-09T14:47:55.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:55.354 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-03-09T14:47:55.454 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:55.454 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-03-09T14:47:55.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:55.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-03-09T14:47:55.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:55.854 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-03-09T14:47:56.254 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:56.254 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-03-09T14:47:56.454 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:56.454 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-03-09T14:47:56.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:56.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-03-09T14:47:59.054 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:59.054 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-03-09T14:47:59.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:47:59.654 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-03-09T14:48:30.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:30.655 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-03-09T14:48:31.254 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:31.254 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-03-09T14:48:31.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:31.354 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-03-09T14:48:31.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:31.654 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-03-09T14:48:31.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:31.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-03-09T14:48:32.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:32.354 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-03-09T14:48:34.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:34.354 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-03-09T14:48:34.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:34.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-03-09T14:48:34.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:34.854 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-03-09T14:48:34.954 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:34.955 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-03-09T14:48:37.454 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:37.454 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-03-09T14:48:37.857 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:37.857 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-03-09T14:48:51.054 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:51.054 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-03-09T14:48:51.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:51.554 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-03-09T14:48:53.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:53.355 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-03-09T14:48:53.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:48:53.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-03-09T14:49:24.155 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:24.155 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-03-09T14:49:24.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:24.554 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-03-09T14:49:27.954 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:27.954 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-03-09T14:49:28.254 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:28.254 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-03-09T14:49:39.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:39.555 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-03-09T14:49:39.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:39.855 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-03-09T14:49:42.154 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:42.154 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-03-09T14:49:52.454 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:52.455 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-03-09T14:49:52.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:52.554 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-03-09T14:49:52.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:52.654 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-03-09T14:49:52.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:52.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-03-09T14:49:54.254 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:54.255 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-03-09T14:49:54.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:54.354 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-03-09T14:49:54.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:54.654 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-03-09T14:49:54.755 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:55.240 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-03-09T14:49:55.241 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:55.241 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-03-09T14:49:55.254 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:55.254 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-03-09T14:49:55.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:55.554 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-03-09T14:49:55.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:55.654 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-03-09T14:49:56.054 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:56.054 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-03-09T14:49:56.154 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:56.154 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-03-09T14:49:56.454 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:56.454 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-03-09T14:49:56.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:56.654 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-03-09T14:49:57.154 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:57.154 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-03-09T14:49:57.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:57.354 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-03-09T14:49:57.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:57.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-03-09T14:49:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:57.954 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-03-09T14:49:58.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:58.354 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-03-09T14:49:58.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:58.654 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-03-09T14:49:59.054 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:59.054 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-03-09T14:49:59.254 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:59.255 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-03-09T14:49:59.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:59.654 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-03-09T14:49:59.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:49:59.854 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-03-09T14:50:00.355 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:00.355 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-03-09T14:50:00.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:00.555 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-03-09T14:50:00.954 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:00.954 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-03-09T14:50:01.155 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:01.155 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-03-09T14:50:01.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:01.654 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-03-09T14:50:01.855 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:01.855 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-03-09T14:50:02.254 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:02.254 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-03-09T14:50:02.455 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:02.455 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-03-09T14:50:02.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:02.854 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-03-09T14:50:03.154 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:03.154 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-03-09T14:50:03.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:03.558 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-03-09T14:50:03.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:03.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-03-09T14:50:04.154 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:04.154 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-03-09T14:50:04.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:04.354 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-03-09T14:50:04.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:04.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-03-09T14:50:04.954 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:04.954 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-03-09T14:50:05.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:05.354 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-03-09T14:50:05.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:05.554 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-03-09T14:50:06.054 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:06.054 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-03-09T14:50:06.254 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:06.254 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-03-09T14:50:06.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:06.654 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-03-09T14:50:06.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:06.854 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-03-09T14:50:07.254 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:07.254 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-03-09T14:50:07.454 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:07.454 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-03-09T14:50:07.954 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:07.954 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-03-09T14:50:08.154 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:08.154 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-03-09T14:50:08.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:08.554 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-03-09T14:50:08.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:08.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-03-09T14:50:09.154 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:09.154 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-03-09T14:50:09.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:09.354 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-03-09T14:50:09.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:09.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-03-09T14:50:09.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:09.854 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-03-09T14:50:10.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:10.354 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-03-09T14:50:10.454 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:10.454 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-03-09T14:50:10.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:10.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-03-09T14:50:10.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:10.854 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-03-09T14:50:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:11.254 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-03-09T14:50:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:11.255 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-03-09T14:50:11.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:11.654 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-03-09T14:50:11.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:11.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-03-09T14:50:12.054 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:12.054 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-03-09T14:50:12.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:12.354 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-03-09T14:50:12.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:12.654 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-03-09T14:50:12.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:12.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-03-09T14:50:12.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:12.854 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-03-09T14:50:12.954 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:12.954 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-03-09T14:50:13.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:13.354 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-03-09T14:50:13.454 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:13.454 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-03-09T14:50:13.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:13.854 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-03-09T14:50:13.954 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:13.954 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-03-09T14:50:14.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:14.354 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-03-09T14:50:14.454 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:14.454 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-03-09T14:50:14.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:14.754 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-03-09T14:50:16.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:16.854 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-03-09T14:50:17.254 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:17.254 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-03-09T14:50:28.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:28.654 INFO:teuthology.orchestra.run.smithi088.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-03-09T14:50:29.008 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:29.009 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------------------------------------------------- 2024-03-09T14:50:29.009 INFO:teuthology.orchestra.run.smithi088.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-03-09T14:50:29.009 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------------------------------------------------- 2024-03-09T14:50:29.009 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:29.009 INFO:teuthology.orchestra.run.smithi088.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-03-09T14:50:29.009 INFO:teuthology.orchestra.run.smithi088.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-03-09T14:50:29.009 INFO:teuthology.orchestra.run.smithi088.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-03-09T14:50:29.009 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:29.009 INFO:teuthology.orchestra.run.smithi088.stdout:BUILD SUCCESSFUL in 2m 46s 2024-03-09T14:50:29.009 INFO:teuthology.orchestra.run.smithi088.stdout:5 actionable tasks: 5 executed 2024-03-09T14:50:29.023 DEBUG:teuthology.orchestra.run.smithi088:> radosgw-admin gc process --include-all 2024-03-09T14:50:29.073 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:29.073 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:29.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.106+0000 7fe4ac62e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.107+0000 7fe4ac62e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:29.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.107+0000 7fe4ac62e800 20 realm 2024-03-09T14:50:29.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.107+0000 7fe4ac62e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.107+0000 7fe4ac62e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:29.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.107+0000 7fe4ac62e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.107+0000 7fe4ac62e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.107+0000 7fe4ac62e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.107+0000 7fe4ac62e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.108+0000 7fe4ac62e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:29.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.108+0000 7fe4ac62e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.109+0000 7fe4ac62e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:29.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.109+0000 7fe4ac62e800 20 searching for the correct realm 2024-03-09T14:50:29.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.111+0000 7fe4a8058640 0 -- 172.21.15.88:0/4007026840 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fe4a0089b40 msgr2=0x7fe4a0082460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:29.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.318+0000 7fe4a7056640 0 -- 172.21.15.88:0/4007026840 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fe4a009a940 msgr2=0x7fe4a006c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:29.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.524+0000 7fe4ac62e800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:29.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.524+0000 7fe4ac62e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:29.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.524+0000 7fe4ac62e800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:29.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.524+0000 7fe4ac62e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:29.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.524+0000 7fe4ac62e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:29.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.524+0000 7fe4ac62e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:29.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.524+0000 7fe4ac62e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.525+0000 7fe4ac62e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:29.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.525+0000 7fe4ac62e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.525+0000 7fe4ac62e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:29.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.525+0000 7fe4ac62e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.525+0000 7fe4ac62e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:29.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.525+0000 7fe4ac62e800 20 zone default found 2024-03-09T14:50:29.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.525+0000 7fe4ac62e800 4 Realm: () 2024-03-09T14:50:29.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.525+0000 7fe4ac62e800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:29.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.525+0000 7fe4ac62e800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:29.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.525+0000 7fe4ac62e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:29.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.525+0000 7fe4ac62e800 20 zonegroup default 2024-03-09T14:50:29.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.525+0000 7fe4ac62e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.526+0000 7fe4ac62e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:29.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.526+0000 7fe4ac62e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.526+0000 7fe4ac62e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:29.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.526+0000 7fe4ac62e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.526+0000 7fe4ac62e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:29.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.526+0000 7fe4ac62e800 20 started sync module instance, tier type = 2024-03-09T14:50:29.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.526+0000 7fe4ac62e800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:29.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.535+0000 7fe4ac62e800 20 add_watcher() i=0 2024-03-09T14:50:29.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.535+0000 7fe4ac62e800 20 add_watcher() i=1 2024-03-09T14:50:29.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.535+0000 7fe4ac62e800 20 add_watcher() i=2 2024-03-09T14:50:29.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.535+0000 7fe4ac62e800 20 add_watcher() i=3 2024-03-09T14:50:29.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.535+0000 7fe4ac62e800 20 add_watcher() i=4 2024-03-09T14:50:29.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.535+0000 7fe4ac62e800 20 add_watcher() i=5 2024-03-09T14:50:29.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.535+0000 7fe4ac62e800 20 add_watcher() i=6 2024-03-09T14:50:29.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.536+0000 7fe4ac62e800 20 add_watcher() i=7 2024-03-09T14:50:29.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.536+0000 7fe4ac62e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:29.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.538+0000 7fe35dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:29.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.539+0000 7fe4ac62e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:29.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.539+0000 7fe4ac62e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:29.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.576+0000 7fe35cfe1640 20 reqs_thread_entry: start 2024-03-09T14:50:29.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.576+0000 7fe4ac62e800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:29.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.576+0000 7fe4ac62e800 20 Filter name: none 2024-03-09T14:50:29.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.576+0000 7fe2d67fc640 20 reqs_thread_entry: start 2024-03-09T14:50:29.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.576+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:50:29.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.578+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.578+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.579+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:50:29.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.579+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.14868501186560677515', time=2024-03-09T16:48:09.177629+0000, chain.objs.size()=9 2024-03-09T14:50:29.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.579+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~wvPLSD7FGTLkx798hLGIYyVdF4F2N97.1 2024-03-09T14:50:29.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.579+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~wvPLSD7FGTLkx798hLGIYyVdF4F2N97.1_1 2024-03-09T14:50:29.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.579+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~wvPLSD7FGTLkx798hLGIYyVdF4F2N97.2 2024-03-09T14:50:29.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.579+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~wvPLSD7FGTLkx798hLGIYyVdF4F2N97.2_1 2024-03-09T14:50:29.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.579+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~wvPLSD7FGTLkx798hLGIYyVdF4F2N97.3 2024-03-09T14:50:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.579+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~wvPLSD7FGTLkx798hLGIYyVdF4F2N97.3_1 2024-03-09T14:50:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.579+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~wvPLSD7FGTLkx798hLGIYyVdF4F2N97.4 2024-03-09T14:50:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.579+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~wvPLSD7FGTLkx798hLGIYyVdF4F2N97.4_1 2024-03-09T14:50:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.579+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~wvPLSD7FGTLkx798hLGIYyVdF4F2N97.5 2024-03-09T14:50:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.579+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.17347996694907040386', time=2024-03-09T16:48:51.159211+0000, chain.objs.size()=9 2024-03-09T14:50:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.579+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__multipart_file.mpg.2~RoFzjOygdjlPztLLxuVVcM_VStCtfj_.1 2024-03-09T14:50:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.579+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__shadow_file.mpg.2~RoFzjOygdjlPztLLxuVVcM_VStCtfj_.1_1 2024-03-09T14:50:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.579+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__multipart_file.mpg.2~RoFzjOygdjlPztLLxuVVcM_VStCtfj_.2 2024-03-09T14:50:29.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.582+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__shadow_file.mpg.2~RoFzjOygdjlPztLLxuVVcM_VStCtfj_.2_1 2024-03-09T14:50:29.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.582+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__multipart_file.mpg.2~RoFzjOygdjlPztLLxuVVcM_VStCtfj_.3 2024-03-09T14:50:29.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.582+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__shadow_file.mpg.2~RoFzjOygdjlPztLLxuVVcM_VStCtfj_.3_1 2024-03-09T14:50:29.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.584+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__multipart_file.mpg.2~RoFzjOygdjlPztLLxuVVcM_VStCtfj_.4 2024-03-09T14:50:29.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.584+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__shadow_file.mpg.2~RoFzjOygdjlPztLLxuVVcM_VStCtfj_.4_1 2024-03-09T14:50:29.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.584+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__multipart_file.mpg.2~RoFzjOygdjlPztLLxuVVcM_VStCtfj_.5 2024-03-09T14:50:29.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.584+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.919131364328046985', time=2024-03-09T16:49:24.061821+0000, chain.objs.size()=7 2024-03-09T14:50:29.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.584+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~bQL9wnjOErZLrB6bCEcd0XROD1HMH7L.1 2024-03-09T14:50:29.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.584+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~bQL9wnjOErZLrB6bCEcd0XROD1HMH7L.1_1 2024-03-09T14:50:29.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.584+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~bQL9wnjOErZLrB6bCEcd0XROD1HMH7L.1_2 2024-03-09T14:50:29.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.584+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~bQL9wnjOErZLrB6bCEcd0XROD1HMH7L.2 2024-03-09T14:50:29.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.585+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~bQL9wnjOErZLrB6bCEcd0XROD1HMH7L.2_1 2024-03-09T14:50:29.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.587+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~bQL9wnjOErZLrB6bCEcd0XROD1HMH7L.2_2 2024-03-09T14:50:29.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.587+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~bQL9wnjOErZLrB6bCEcd0XROD1HMH7L.3 2024-03-09T14:50:29.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.590+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.593+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:50:29.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.594+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.595+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.595+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:29.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.595+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.11207228179416826970', time=2024-03-09T16:49:39.608995+0000, chain.objs.size()=9 2024-03-09T14:50:29.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.595+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.93__multipart_key1.2~C_bDDPIOBfE22useAbKF5_JdM-WD3QZ.1 2024-03-09T14:50:29.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.595+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.93__shadow_key1.2~C_bDDPIOBfE22useAbKF5_JdM-WD3QZ.1_1 2024-03-09T14:50:29.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.595+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.93__multipart_key1.2~C_bDDPIOBfE22useAbKF5_JdM-WD3QZ.2 2024-03-09T14:50:29.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.595+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.93__shadow_key1.2~C_bDDPIOBfE22useAbKF5_JdM-WD3QZ.2_1 2024-03-09T14:50:29.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.596+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.93__multipart_key1.2~C_bDDPIOBfE22useAbKF5_JdM-WD3QZ.3 2024-03-09T14:50:29.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.596+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.93__shadow_key1.2~C_bDDPIOBfE22useAbKF5_JdM-WD3QZ.3_1 2024-03-09T14:50:29.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.596+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.93__multipart_key1.2~C_bDDPIOBfE22useAbKF5_JdM-WD3QZ.4 2024-03-09T14:50:29.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.596+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.93__shadow_key1.2~C_bDDPIOBfE22useAbKF5_JdM-WD3QZ.4_1 2024-03-09T14:50:29.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.596+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.93__multipart_key1.2~C_bDDPIOBfE22useAbKF5_JdM-WD3QZ.5 2024-03-09T14:50:29.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.599+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.601+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:50:29.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.603+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.603+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.604+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.604+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:50:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.606+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.606+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.607+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.607+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:50:29.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.609+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.609+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.610+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.611+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:50:29.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.612+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.612+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.613+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.614+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:50:29.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.615+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.616+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.616+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.617+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:50:29.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.618+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.619+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.619+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.620+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:50:29.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.621+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.621+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.622+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.623+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:50:29.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.624+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.624+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.625+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:29.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.625+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.3328173428020952715', time=2024-03-09T16:50:16.952749+0000, chain.objs.size()=9 2024-03-09T14:50:29.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.625+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.132__multipart_key1.2~hJUx6tRatqEa5WtJHY1MgeSThvjqP6u.1 2024-03-09T14:50:29.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.625+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.132__shadow_key1.2~hJUx6tRatqEa5WtJHY1MgeSThvjqP6u.1_1 2024-03-09T14:50:29.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.625+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.132__multipart_key1.2~hJUx6tRatqEa5WtJHY1MgeSThvjqP6u.2 2024-03-09T14:50:29.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.625+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.132__shadow_key1.2~hJUx6tRatqEa5WtJHY1MgeSThvjqP6u.2_1 2024-03-09T14:50:29.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.625+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.132__multipart_key1.2~hJUx6tRatqEa5WtJHY1MgeSThvjqP6u.3 2024-03-09T14:50:29.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.625+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.132__shadow_key1.2~hJUx6tRatqEa5WtJHY1MgeSThvjqP6u.3_1 2024-03-09T14:50:29.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.625+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.132__multipart_key1.2~hJUx6tRatqEa5WtJHY1MgeSThvjqP6u.4 2024-03-09T14:50:29.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.625+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.132__shadow_key1.2~hJUx6tRatqEa5WtJHY1MgeSThvjqP6u.4_1 2024-03-09T14:50:29.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.625+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.132__multipart_key1.2~hJUx6tRatqEa5WtJHY1MgeSThvjqP6u.5 2024-03-09T14:50:29.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.629+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.632+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:50:29.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.633+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.634+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.634+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.634+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.15769917946353361837', time=2024-03-09T16:48:34.482776+0000, chain.objs.size()=9 2024-03-09T14:50:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.634+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.87__multipart_key1.2~fOHX3N60tTy6NheQbtodjU9Dlfm9KOQ.1 2024-03-09T14:50:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.634+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.87__shadow_key1.2~fOHX3N60tTy6NheQbtodjU9Dlfm9KOQ.1_1 2024-03-09T14:50:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.634+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.87__multipart_key1.2~fOHX3N60tTy6NheQbtodjU9Dlfm9KOQ.2 2024-03-09T14:50:29.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.634+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.87__shadow_key1.2~fOHX3N60tTy6NheQbtodjU9Dlfm9KOQ.2_1 2024-03-09T14:50:29.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.634+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.87__multipart_key1.2~fOHX3N60tTy6NheQbtodjU9Dlfm9KOQ.3 2024-03-09T14:50:29.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.634+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.87__shadow_key1.2~fOHX3N60tTy6NheQbtodjU9Dlfm9KOQ.3_1 2024-03-09T14:50:29.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.634+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.87__multipart_key1.2~fOHX3N60tTy6NheQbtodjU9Dlfm9KOQ.4 2024-03-09T14:50:29.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.634+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.87__shadow_key1.2~fOHX3N60tTy6NheQbtodjU9Dlfm9KOQ.4_1 2024-03-09T14:50:29.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.634+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.87__multipart_key1.2~fOHX3N60tTy6NheQbtodjU9Dlfm9KOQ.5 2024-03-09T14:50:29.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.638+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.641+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:50:29.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.642+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.642+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.643+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.643+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.7837510779599913338', time=2024-03-09T16:47:53.252547+0000, chain.objs.size()=2 2024-03-09T14:50:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.643+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.72__shadow_.t8ZqfhKAYh_K0oSdpFaNsatNaPVADBu_1 2024-03-09T14:50:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.643+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.72__shadow_.t8ZqfhKAYh_K0oSdpFaNsatNaPVADBu_2 2024-03-09T14:50:29.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.644+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.646+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:50:29.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.648+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.648+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.648+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:29.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.648+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.5935951606820517719', time=2024-03-09T16:48:37.574257+0000, chain.objs.size()=9 2024-03-09T14:50:29.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.648+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.88__multipart_key1.2~poRswSIMRxEay-vTxavozoK_1CJWUsU.1 2024-03-09T14:50:29.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.649+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.88__shadow_key1.2~poRswSIMRxEay-vTxavozoK_1CJWUsU.1_1 2024-03-09T14:50:29.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.649+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.88__multipart_key1.2~poRswSIMRxEay-vTxavozoK_1CJWUsU.2 2024-03-09T14:50:29.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.649+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.88__shadow_key1.2~poRswSIMRxEay-vTxavozoK_1CJWUsU.2_1 2024-03-09T14:50:29.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.649+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.88__multipart_key1.2~poRswSIMRxEay-vTxavozoK_1CJWUsU.3 2024-03-09T14:50:29.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.649+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.88__shadow_key1.2~poRswSIMRxEay-vTxavozoK_1CJWUsU.3_1 2024-03-09T14:50:29.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.649+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.88__multipart_key1.2~poRswSIMRxEay-vTxavozoK_1CJWUsU.4 2024-03-09T14:50:29.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.649+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.88__shadow_key1.2~poRswSIMRxEay-vTxavozoK_1CJWUsU.4_1 2024-03-09T14:50:29.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.649+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.88__multipart_key1.2~poRswSIMRxEay-vTxavozoK_1CJWUsU.5 2024-03-09T14:50:29.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.653+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.655+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:50:29.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.656+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.657+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.657+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.657+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.11468588704149976560', time=2024-03-09T16:50:28.697671+0000, chain.objs.size()=9 2024-03-09T14:50:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.657+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.133__multipart_key1/data/file.mpg.2~1CPlncERTv3WRn5VUdNju3D06iu0eBb.1 2024-03-09T14:50:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.657+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.133__shadow_key1/data/file.mpg.2~1CPlncERTv3WRn5VUdNju3D06iu0eBb.1_1 2024-03-09T14:50:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.657+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.133__multipart_key1/data/file.mpg.2~1CPlncERTv3WRn5VUdNju3D06iu0eBb.2 2024-03-09T14:50:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.657+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.133__shadow_key1/data/file.mpg.2~1CPlncERTv3WRn5VUdNju3D06iu0eBb.2_1 2024-03-09T14:50:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.657+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.133__multipart_key1/data/file.mpg.2~1CPlncERTv3WRn5VUdNju3D06iu0eBb.3 2024-03-09T14:50:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.657+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.133__shadow_key1/data/file.mpg.2~1CPlncERTv3WRn5VUdNju3D06iu0eBb.3_1 2024-03-09T14:50:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.657+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.133__multipart_key1/data/file.mpg.2~1CPlncERTv3WRn5VUdNju3D06iu0eBb.4 2024-03-09T14:50:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.657+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.133__shadow_key1/data/file.mpg.2~1CPlncERTv3WRn5VUdNju3D06iu0eBb.4_1 2024-03-09T14:50:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.657+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.133__multipart_key1/data/file.mpg.2~1CPlncERTv3WRn5VUdNju3D06iu0eBb.5 2024-03-09T14:50:29.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.662+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.664+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:50:29.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.665+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.666+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.666+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:29.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.666+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.80__shadow_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.1_1_1c8dae19e82cd2cfce0f551995c499bb', time=2024-03-09T16:47:59.097577+0000, chain.objs.size()=9 2024-03-09T14:50:29.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.666+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__multipart_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.1 2024-03-09T14:50:29.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.666+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__shadow_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.1_1 2024-03-09T14:50:29.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.666+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__multipart_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.2 2024-03-09T14:50:29.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.666+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__shadow_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.2_1 2024-03-09T14:50:29.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.666+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__multipart_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.3 2024-03-09T14:50:29.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.666+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__shadow_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.3_1 2024-03-09T14:50:29.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.666+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__multipart_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.4 2024-03-09T14:50:29.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.666+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__shadow_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.4_1 2024-03-09T14:50:29.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.666+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__multipart_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.5 2024-03-09T14:50:29.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.670+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.672+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:50:29.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.673+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.674+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.675+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.676+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:50:29.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.677+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:50:29.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='2~kb66VRKQNnHK8SvBeWofnbtcuMU6dwQ', time=2024-03-09T16:47:49.635696+0000, chain.objs.size()=9 2024-03-09T14:50:29.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.68__multipart_key1.2~kb66VRKQNnHK8SvBeWofnbtcuMU6dwQ.1 2024-03-09T14:50:29.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.68__shadow_key1.2~kb66VRKQNnHK8SvBeWofnbtcuMU6dwQ.1_1 2024-03-09T14:50:29.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.68__multipart_key1.2~kb66VRKQNnHK8SvBeWofnbtcuMU6dwQ.2 2024-03-09T14:50:29.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.68__shadow_key1.2~kb66VRKQNnHK8SvBeWofnbtcuMU6dwQ.2_1 2024-03-09T14:50:29.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.68__multipart_key1.2~kb66VRKQNnHK8SvBeWofnbtcuMU6dwQ.3 2024-03-09T14:50:29.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.68__shadow_key1.2~kb66VRKQNnHK8SvBeWofnbtcuMU6dwQ.3_1 2024-03-09T14:50:29.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.68__multipart_key1.2~kb66VRKQNnHK8SvBeWofnbtcuMU6dwQ.4 2024-03-09T14:50:29.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.68__shadow_key1.2~kb66VRKQNnHK8SvBeWofnbtcuMU6dwQ.4_1 2024-03-09T14:50:29.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.68__multipart_key1.2~kb66VRKQNnHK8SvBeWofnbtcuMU6dwQ.5 2024-03-09T14:50:29.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.6142746895987673208', time=2024-03-09T16:48:24.762187+0000, chain.objs.size()=9 2024-03-09T14:50:29.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~nMTLttNZb1UcSdftvvm11onV3oTMcNA.1 2024-03-09T14:50:29.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~nMTLttNZb1UcSdftvvm11onV3oTMcNA.1_1 2024-03-09T14:50:29.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.678+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~nMTLttNZb1UcSdftvvm11onV3oTMcNA.2 2024-03-09T14:50:29.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.680+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~nMTLttNZb1UcSdftvvm11onV3oTMcNA.2_1 2024-03-09T14:50:29.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.681+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~nMTLttNZb1UcSdftvvm11onV3oTMcNA.3 2024-03-09T14:50:29.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.682+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~nMTLttNZb1UcSdftvvm11onV3oTMcNA.3_1 2024-03-09T14:50:29.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.683+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~nMTLttNZb1UcSdftvvm11onV3oTMcNA.4 2024-03-09T14:50:29.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.683+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~nMTLttNZb1UcSdftvvm11onV3oTMcNA.4_1 2024-03-09T14:50:29.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.683+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~nMTLttNZb1UcSdftvvm11onV3oTMcNA.5 2024-03-09T14:50:29.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.683+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.13772026657812473447', time=2024-03-09T16:49:22.111287+0000, chain.objs.size()=7 2024-03-09T14:50:29.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.683+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~M_a-NKTIzaYDWRzwAmdblcku0kndl8P.1 2024-03-09T14:50:29.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.683+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~M_a-NKTIzaYDWRzwAmdblcku0kndl8P.1_1 2024-03-09T14:50:29.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.683+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~M_a-NKTIzaYDWRzwAmdblcku0kndl8P.1_2 2024-03-09T14:50:29.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.683+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~M_a-NKTIzaYDWRzwAmdblcku0kndl8P.2 2024-03-09T14:50:29.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.683+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~M_a-NKTIzaYDWRzwAmdblcku0kndl8P.2_1 2024-03-09T14:50:29.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.686+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~M_a-NKTIzaYDWRzwAmdblcku0kndl8P.2_2 2024-03-09T14:50:29.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.687+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~M_a-NKTIzaYDWRzwAmdblcku0kndl8P.3 2024-03-09T14:50:29.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.691+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.693+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:50:29.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.694+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.695+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.695+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:29.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.695+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.16465491854904851118', time=2024-03-09T16:48:30.998115+0000, chain.objs.size()=7 2024-03-09T14:50:29.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.695+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~QL3abp8d1EWujNbqk9XT1oTKl93P3_m.1 2024-03-09T14:50:29.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.695+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~QL3abp8d1EWujNbqk9XT1oTKl93P3_m.1_1 2024-03-09T14:50:29.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.695+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~QL3abp8d1EWujNbqk9XT1oTKl93P3_m.1_2 2024-03-09T14:50:29.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.695+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~QL3abp8d1EWujNbqk9XT1oTKl93P3_m.2 2024-03-09T14:50:29.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.695+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~QL3abp8d1EWujNbqk9XT1oTKl93P3_m.2_1 2024-03-09T14:50:29.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.695+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~QL3abp8d1EWujNbqk9XT1oTKl93P3_m.2_2 2024-03-09T14:50:29.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.695+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~QL3abp8d1EWujNbqk9XT1oTKl93P3_m.3 2024-03-09T14:50:29.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.698+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.701+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:50:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.702+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.702+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.703+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.704+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:50:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.705+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:50:29.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.12160654385093711614', time=2024-03-09T16:49:24.259909+0000, chain.objs.size()=7 2024-03-09T14:50:29.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~yPYWHz3H5y8vIzRUO_DhFPXHfScnetW.1 2024-03-09T14:50:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~yPYWHz3H5y8vIzRUO_DhFPXHfScnetW.1_1 2024-03-09T14:50:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~yPYWHz3H5y8vIzRUO_DhFPXHfScnetW.1_2 2024-03-09T14:50:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~yPYWHz3H5y8vIzRUO_DhFPXHfScnetW.2 2024-03-09T14:50:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~yPYWHz3H5y8vIzRUO_DhFPXHfScnetW.2_1 2024-03-09T14:50:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~yPYWHz3H5y8vIzRUO_DhFPXHfScnetW.2_2 2024-03-09T14:50:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~yPYWHz3H5y8vIzRUO_DhFPXHfScnetW.3 2024-03-09T14:50:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.17166730199631565989', time=2024-03-09T16:49:27.987491+0000, chain.objs.size()=9 2024-03-09T14:50:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.92__multipart_key1.2~eN45SHUOqjJIMX46GLkNFcUl8EVXpcd.1 2024-03-09T14:50:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.92__shadow_key1.2~eN45SHUOqjJIMX46GLkNFcUl8EVXpcd.1_1 2024-03-09T14:50:29.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.92__multipart_key1.2~eN45SHUOqjJIMX46GLkNFcUl8EVXpcd.2 2024-03-09T14:50:29.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.92__shadow_key1.2~eN45SHUOqjJIMX46GLkNFcUl8EVXpcd.2_1 2024-03-09T14:50:29.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.706+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.92__multipart_key1.2~eN45SHUOqjJIMX46GLkNFcUl8EVXpcd.3 2024-03-09T14:50:29.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.709+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.92__shadow_key1.2~eN45SHUOqjJIMX46GLkNFcUl8EVXpcd.3_1 2024-03-09T14:50:29.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.710+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.92__multipart_key1.2~eN45SHUOqjJIMX46GLkNFcUl8EVXpcd.4 2024-03-09T14:50:29.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.710+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.92__shadow_key1.2~eN45SHUOqjJIMX46GLkNFcUl8EVXpcd.4_1 2024-03-09T14:50:29.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.710+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.92__multipart_key1.2~eN45SHUOqjJIMX46GLkNFcUl8EVXpcd.5 2024-03-09T14:50:29.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.713+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.715+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:50:29.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.717+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.717+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.717+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.718+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:50:29.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.719+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.720+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.720+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:29.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.720+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.9375132941064607905', time=2024-03-09T16:47:59.371138+0000, chain.objs.size()=9 2024-03-09T14:50:29.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.720+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__multipart_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.1 2024-03-09T14:50:29.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.720+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__shadow_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.1_1 2024-03-09T14:50:29.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.720+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__multipart_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.2 2024-03-09T14:50:29.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.720+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__shadow_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.2_1 2024-03-09T14:50:29.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.720+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__multipart_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.3 2024-03-09T14:50:29.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.720+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__shadow_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.3_1 2024-03-09T14:50:29.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.720+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__multipart_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.4 2024-03-09T14:50:29.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.720+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__shadow_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.4_1 2024-03-09T14:50:29.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.720+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.80__multipart_key1.2~IhSlx25ZshR3Dsink3DCLDg4ozOhtzT.5 2024-03-09T14:50:29.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.723+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.725+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:50:29.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.726+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.726+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.726+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:50:29.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.726+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.5714044094969604828', time=2024-03-09T16:48:30.728223+0000, chain.objs.size()=5 2024-03-09T14:50:29.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.726+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.82__shadow_.4yeWqLajwfsxiNiDh19HnNGinfY4oKh_1 2024-03-09T14:50:29.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.727+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.82__shadow_.4yeWqLajwfsxiNiDh19HnNGinfY4oKh_2 2024-03-09T14:50:29.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.727+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.82__shadow_.4yeWqLajwfsxiNiDh19HnNGinfY4oKh_3 2024-03-09T14:50:29.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.727+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.82__shadow_.4yeWqLajwfsxiNiDh19HnNGinfY4oKh_4 2024-03-09T14:50:29.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.727+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.82__shadow_.4yeWqLajwfsxiNiDh19HnNGinfY4oKh_5 2024-03-09T14:50:29.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.727+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.2433448273197718378', time=2024-03-09T16:49:06.702779+0000, chain.objs.size()=9 2024-03-09T14:50:29.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.727+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~u3xj75oIBYlJhwS-73yDK3zPIZa9Kby.1 2024-03-09T14:50:29.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.727+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~u3xj75oIBYlJhwS-73yDK3zPIZa9Kby.1_1 2024-03-09T14:50:29.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.727+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~u3xj75oIBYlJhwS-73yDK3zPIZa9Kby.2 2024-03-09T14:50:29.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.727+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~u3xj75oIBYlJhwS-73yDK3zPIZa9Kby.2_1 2024-03-09T14:50:29.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.727+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~u3xj75oIBYlJhwS-73yDK3zPIZa9Kby.3 2024-03-09T14:50:29.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.727+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~u3xj75oIBYlJhwS-73yDK3zPIZa9Kby.3_1 2024-03-09T14:50:29.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.727+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~u3xj75oIBYlJhwS-73yDK3zPIZa9Kby.4 2024-03-09T14:50:29.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.729+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~u3xj75oIBYlJhwS-73yDK3zPIZa9Kby.4_1 2024-03-09T14:50:29.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.730+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~u3xj75oIBYlJhwS-73yDK3zPIZa9Kby.5 2024-03-09T14:50:29.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.733+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.735+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:50:29.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.737+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.737+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.738+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:29.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.738+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0', time=2024-03-09T16:49:50.768797+0000, chain.objs.size()=68 2024-03-09T14:50:29.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.738+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.1 2024-03-09T14:50:29.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.738+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.2 2024-03-09T14:50:29.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.738+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.3 2024-03-09T14:50:29.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.738+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.4 2024-03-09T14:50:29.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.738+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.5 2024-03-09T14:50:29.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.738+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.6 2024-03-09T14:50:29.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.738+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.7 2024-03-09T14:50:29.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.738+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.8 2024-03-09T14:50:29.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.738+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.9 2024-03-09T14:50:29.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.738+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.10 2024-03-09T14:50:29.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.738+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.11 2024-03-09T14:50:29.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.738+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.12 2024-03-09T14:50:29.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.740+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.13 2024-03-09T14:50:29.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.741+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.14 2024-03-09T14:50:29.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.741+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.15 2024-03-09T14:50:29.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.741+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.16 2024-03-09T14:50:29.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.741+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.17 2024-03-09T14:50:29.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.741+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.18 2024-03-09T14:50:29.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.741+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.19 2024-03-09T14:50:29.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.741+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.20 2024-03-09T14:50:29.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.741+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.21 2024-03-09T14:50:29.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.741+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.22 2024-03-09T14:50:29.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.741+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.23 2024-03-09T14:50:29.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.743+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.24 2024-03-09T14:50:29.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.744+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.25 2024-03-09T14:50:29.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.744+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.26 2024-03-09T14:50:29.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.746+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.27 2024-03-09T14:50:29.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.746+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.28 2024-03-09T14:50:29.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.746+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.29 2024-03-09T14:50:29.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.746+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.30 2024-03-09T14:50:29.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.746+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.31 2024-03-09T14:50:29.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.746+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.32 2024-03-09T14:50:29.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.746+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.33 2024-03-09T14:50:29.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.747+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.34 2024-03-09T14:50:29.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.748+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.35 2024-03-09T14:50:29.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.748+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.36 2024-03-09T14:50:29.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.748+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.37 2024-03-09T14:50:29.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.749+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.38 2024-03-09T14:50:29.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.750+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.39 2024-03-09T14:50:29.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.750+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.40 2024-03-09T14:50:29.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.750+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.41 2024-03-09T14:50:29.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.750+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.42 2024-03-09T14:50:29.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.750+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.43 2024-03-09T14:50:29.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.750+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.44 2024-03-09T14:50:29.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.750+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.45 2024-03-09T14:50:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.751+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.46 2024-03-09T14:50:29.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.753+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.47 2024-03-09T14:50:29.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.753+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.48 2024-03-09T14:50:29.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.754+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.49 2024-03-09T14:50:29.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.755+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.50 2024-03-09T14:50:29.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.755+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.51 2024-03-09T14:50:29.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.755+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.52 2024-03-09T14:50:29.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.755+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.53 2024-03-09T14:50:29.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.755+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.54 2024-03-09T14:50:29.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.756+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.55 2024-03-09T14:50:29.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.756+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.56 2024-03-09T14:50:29.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.756+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.57 2024-03-09T14:50:29.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.757+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.58 2024-03-09T14:50:29.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.757+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.59 2024-03-09T14:50:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.758+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.60 2024-03-09T14:50:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.758+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.61 2024-03-09T14:50:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.758+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.62 2024-03-09T14:50:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.758+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.63 2024-03-09T14:50:29.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.759+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.65 2024-03-09T14:50:29.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.759+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.66 2024-03-09T14:50:29.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.762+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.67 2024-03-09T14:50:29.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.762+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.68 2024-03-09T14:50:29.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.762+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.94__multipart_key1.2~ElzUg-wOCZ4bkjWdAsm5JZFxMHIbNo0.69 2024-03-09T14:50:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.764+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.767+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:50:29.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.768+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:50:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.10415457503467412503', time=2024-03-09T16:48:21.808589+0000, chain.objs.size()=9 2024-03-09T14:50:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~snN5ZqY-FMzfcChVU8sI6rDkd7D2GiN.1 2024-03-09T14:50:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~snN5ZqY-FMzfcChVU8sI6rDkd7D2GiN.1_1 2024-03-09T14:50:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~snN5ZqY-FMzfcChVU8sI6rDkd7D2GiN.2 2024-03-09T14:50:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~snN5ZqY-FMzfcChVU8sI6rDkd7D2GiN.2_1 2024-03-09T14:50:29.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~snN5ZqY-FMzfcChVU8sI6rDkd7D2GiN.3 2024-03-09T14:50:29.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~snN5ZqY-FMzfcChVU8sI6rDkd7D2GiN.3_1 2024-03-09T14:50:29.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~snN5ZqY-FMzfcChVU8sI6rDkd7D2GiN.4 2024-03-09T14:50:29.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~snN5ZqY-FMzfcChVU8sI6rDkd7D2GiN.4_1 2024-03-09T14:50:29.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~snN5ZqY-FMzfcChVU8sI6rDkd7D2GiN.5 2024-03-09T14:50:29.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.4922495298767011127', time=2024-03-09T16:48:51.214036+0000, chain.objs.size()=9 2024-03-09T14:50:29.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__multipart_file2.mpg.2~eWAHFJjZIayK4lyFWIGeIgapLTFQhhE.1 2024-03-09T14:50:29.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__shadow_file2.mpg.2~eWAHFJjZIayK4lyFWIGeIgapLTFQhhE.1_1 2024-03-09T14:50:29.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.769+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__multipart_file2.mpg.2~eWAHFJjZIayK4lyFWIGeIgapLTFQhhE.2 2024-03-09T14:50:29.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.772+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__shadow_file2.mpg.2~eWAHFJjZIayK4lyFWIGeIgapLTFQhhE.2_1 2024-03-09T14:50:29.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.772+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__multipart_file2.mpg.2~eWAHFJjZIayK4lyFWIGeIgapLTFQhhE.3 2024-03-09T14:50:29.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.773+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__shadow_file2.mpg.2~eWAHFJjZIayK4lyFWIGeIgapLTFQhhE.3_1 2024-03-09T14:50:29.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.773+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__multipart_file2.mpg.2~eWAHFJjZIayK4lyFWIGeIgapLTFQhhE.4 2024-03-09T14:50:29.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.773+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__shadow_file2.mpg.2~eWAHFJjZIayK4lyFWIGeIgapLTFQhhE.4_1 2024-03-09T14:50:29.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.773+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.89__multipart_file2.mpg.2~eWAHFJjZIayK4lyFWIGeIgapLTFQhhE.5 2024-03-09T14:50:29.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.773+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.9452463178241595839', time=2024-03-09T16:49:11.048409+0000, chain.objs.size()=9 2024-03-09T14:50:29.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.773+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~SMzeEUaBAhA1tMng1TJee8hG0-B43QW.1 2024-03-09T14:50:29.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.773+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~SMzeEUaBAhA1tMng1TJee8hG0-B43QW.1_1 2024-03-09T14:50:29.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.773+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~SMzeEUaBAhA1tMng1TJee8hG0-B43QW.2 2024-03-09T14:50:29.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.773+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~SMzeEUaBAhA1tMng1TJee8hG0-B43QW.2_1 2024-03-09T14:50:29.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.773+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~SMzeEUaBAhA1tMng1TJee8hG0-B43QW.3 2024-03-09T14:50:29.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.775+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~SMzeEUaBAhA1tMng1TJee8hG0-B43QW.3_1 2024-03-09T14:50:29.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.779+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~SMzeEUaBAhA1tMng1TJee8hG0-B43QW.4 2024-03-09T14:50:29.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.779+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~SMzeEUaBAhA1tMng1TJee8hG0-B43QW.4_1 2024-03-09T14:50:29.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.779+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~SMzeEUaBAhA1tMng1TJee8hG0-B43QW.5 2024-03-09T14:50:29.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.782+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.784+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:50:29.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.785+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.786+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.786+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:29.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.786+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.9603773959913809717', time=2024-03-09T16:49:08.746485+0000, chain.objs.size()=9 2024-03-09T14:50:29.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.786+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~x0psRQOxPGz5tLXR9WpF9AUQClvIzPx.1 2024-03-09T14:50:29.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.786+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~x0psRQOxPGz5tLXR9WpF9AUQClvIzPx.1_1 2024-03-09T14:50:29.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.786+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~x0psRQOxPGz5tLXR9WpF9AUQClvIzPx.2 2024-03-09T14:50:29.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.786+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~x0psRQOxPGz5tLXR9WpF9AUQClvIzPx.2_1 2024-03-09T14:50:29.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.786+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~x0psRQOxPGz5tLXR9WpF9AUQClvIzPx.3 2024-03-09T14:50:29.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.786+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~x0psRQOxPGz5tLXR9WpF9AUQClvIzPx.3_1 2024-03-09T14:50:29.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.786+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~x0psRQOxPGz5tLXR9WpF9AUQClvIzPx.4 2024-03-09T14:50:29.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.786+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__shadow_key1.2~x0psRQOxPGz5tLXR9WpF9AUQClvIzPx.4_1 2024-03-09T14:50:29.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.786+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.91__multipart_key1.2~x0psRQOxPGz5tLXR9WpF9AUQClvIzPx.5 2024-03-09T14:50:29.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.790+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.792+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:50:29.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.794+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.795+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.795+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.796+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:50:29.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.797+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.798+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.798+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.799+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:50:29.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.801+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.801+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.801+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.802+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:50:29.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.803+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.804+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.804+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.805+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:50:29.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.806+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.807+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.807+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:29.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.807+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.5431292202257786908', time=2024-03-09T16:48:27.676578+0000, chain.objs.size()=7 2024-03-09T14:50:29.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.807+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~5f0w7UiICzwWwQ0uHLltzDvD5iYfPuZ.1 2024-03-09T14:50:29.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.807+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~5f0w7UiICzwWwQ0uHLltzDvD5iYfPuZ.1_1 2024-03-09T14:50:29.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.807+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~5f0w7UiICzwWwQ0uHLltzDvD5iYfPuZ.1_2 2024-03-09T14:50:29.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.807+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~5f0w7UiICzwWwQ0uHLltzDvD5iYfPuZ.2 2024-03-09T14:50:29.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.807+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~5f0w7UiICzwWwQ0uHLltzDvD5iYfPuZ.2_1 2024-03-09T14:50:29.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.807+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~5f0w7UiICzwWwQ0uHLltzDvD5iYfPuZ.2_2 2024-03-09T14:50:29.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.807+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~5f0w7UiICzwWwQ0uHLltzDvD5iYfPuZ.3 2024-03-09T14:50:29.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.810+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.812+0000 7fe4ac62e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:50:29.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.814+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:29.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.814+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:29.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.814+0000 7fe4ac62e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:29.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.814+0000 7fe4ac62e800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.12255178747858754060', time=2024-03-09T16:48:30.534196+0000, chain.objs.size()=7 2024-03-09T14:50:29.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.814+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~alToX0F-hMT2nOt3zSeLkxoqOHVmRB-.1 2024-03-09T14:50:29.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.814+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~alToX0F-hMT2nOt3zSeLkxoqOHVmRB-.1_1 2024-03-09T14:50:29.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.814+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~alToX0F-hMT2nOt3zSeLkxoqOHVmRB-.1_2 2024-03-09T14:50:29.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.814+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~alToX0F-hMT2nOt3zSeLkxoqOHVmRB-.2 2024-03-09T14:50:29.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.814+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~alToX0F-hMT2nOt3zSeLkxoqOHVmRB-.2_1 2024-03-09T14:50:29.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.814+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__shadow_key1.2~alToX0F-hMT2nOt3zSeLkxoqOHVmRB-.2_2 2024-03-09T14:50:29.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.814+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.83__multipart_key1.2~alToX0F-hMT2nOt3zSeLkxoqOHVmRB-.3 2024-03-09T14:50:29.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.817+0000 7fe4ac62e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:29.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.820+0000 7fe35dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:29.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.823+0000 7fe4ac62e800 20 remove_watcher() i=0 2024-03-09T14:50:29.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.823+0000 7fe4ac62e800 2 removed watcher, disabling cache 2024-03-09T14:50:29.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.824+0000 7fe4ac62e800 20 remove_watcher() i=1 2024-03-09T14:50:29.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.825+0000 7fe4ac62e800 20 remove_watcher() i=2 2024-03-09T14:50:29.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.826+0000 7fe4ac62e800 20 remove_watcher() i=3 2024-03-09T14:50:29.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.827+0000 7fe4ac62e800 20 remove_watcher() i=4 2024-03-09T14:50:29.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.828+0000 7fe4ac62e800 20 remove_watcher() i=5 2024-03-09T14:50:29.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.828+0000 7fe4ac62e800 20 remove_watcher() i=6 2024-03-09T14:50:29.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.829+0000 7fe4ac62e800 20 remove_watcher() i=7 2024-03-09T14:50:29.840 DEBUG:teuthology.orchestra.run.smithi088:> radosgw-admin gc process --include-all 2024-03-09T14:50:29.896 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:29.896 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:29.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.929+0000 7fe446239800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.930+0000 7fe446239800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.930+0000 7fe446239800 20 realm 2024-03-09T14:50:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.930+0000 7fe446239800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.930+0000 7fe446239800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.930+0000 7fe446239800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.930+0000 7fe446239800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.931+0000 7fe446239800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.931+0000 7fe446239800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.931+0000 7fe446239800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:29.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.931+0000 7fe446239800 20 rados->read ofs=0 len=0 2024-03-09T14:50:29.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.932+0000 7fe446239800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:29.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.932+0000 7fe446239800 20 searching for the correct realm 2024-03-09T14:50:29.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:29.932+0000 7fe440fa9640 0 -- 172.21.15.88:0/3330442488 >> [v2:172.21.15.88:6800/4216886240,v1:172.21.15.88:6802/4216886240] conn(0x55821a9957a0 msgr2=0x55821a997c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:30.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.137+0000 7fe440fa9640 0 -- 172.21.15.88:0/3330442488 >> [v2:172.21.15.132:6824/731564406,v1:172.21.15.132:6825/731564406] conn(0x55821a74fa60 msgr2=0x7fe43c019900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:30.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.346+0000 7fe446239800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:30.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.346+0000 7fe446239800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:30.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.346+0000 7fe446239800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:30.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.346+0000 7fe446239800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:30.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.346+0000 7fe446239800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:30.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.346+0000 7fe446239800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:30.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.346+0000 7fe446239800 20 rados->read ofs=0 len=0 2024-03-09T14:50:30.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.346+0000 7fe446239800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:30.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.346+0000 7fe446239800 20 rados->read ofs=0 len=0 2024-03-09T14:50:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.347+0000 7fe446239800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.347+0000 7fe446239800 20 rados->read ofs=0 len=0 2024-03-09T14:50:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.347+0000 7fe446239800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.347+0000 7fe446239800 20 zone default found 2024-03-09T14:50:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.347+0000 7fe446239800 4 Realm: () 2024-03-09T14:50:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.347+0000 7fe446239800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.347+0000 7fe446239800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.347+0000 7fe446239800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.347+0000 7fe446239800 20 zonegroup default 2024-03-09T14:50:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.347+0000 7fe446239800 20 rados->read ofs=0 len=0 2024-03-09T14:50:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.347+0000 7fe446239800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.347+0000 7fe446239800 20 rados->read ofs=0 len=0 2024-03-09T14:50:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.348+0000 7fe446239800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.348+0000 7fe446239800 20 rados->read ofs=0 len=0 2024-03-09T14:50:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.348+0000 7fe446239800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.348+0000 7fe446239800 20 started sync module instance, tier type = 2024-03-09T14:50:30.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.348+0000 7fe446239800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.357+0000 7fe446239800 20 add_watcher() i=0 2024-03-09T14:50:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.357+0000 7fe446239800 20 add_watcher() i=1 2024-03-09T14:50:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.357+0000 7fe446239800 20 add_watcher() i=2 2024-03-09T14:50:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.357+0000 7fe446239800 20 add_watcher() i=3 2024-03-09T14:50:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.357+0000 7fe446239800 20 add_watcher() i=4 2024-03-09T14:50:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.357+0000 7fe446239800 20 add_watcher() i=5 2024-03-09T14:50:30.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.357+0000 7fe446239800 20 add_watcher() i=6 2024-03-09T14:50:30.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.358+0000 7fe446239800 20 add_watcher() i=7 2024-03-09T14:50:30.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.358+0000 7fe446239800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:30.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.360+0000 7fe2f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:30.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.360+0000 7fe446239800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:30.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.360+0000 7fe446239800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:30.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.397+0000 7fe2f5fe3640 20 reqs_thread_entry: start 2024-03-09T14:50:30.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.397+0000 7fe446239800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:30.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.397+0000 7fe446239800 20 Filter name: none 2024-03-09T14:50:30.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.397+0000 7fe2677fe640 20 reqs_thread_entry: start 2024-03-09T14:50:30.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.397+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:50:30.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.399+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.400+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.400+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.401+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:50:30.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.402+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.403+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.403+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.404+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:50:30.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.405+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.406+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.406+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.407+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:50:30.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.408+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.409+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.409+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.410+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:50:30.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.412+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.412+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.412+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.413+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:50:30.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.415+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.415+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.415+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.416+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:50:30.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.418+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.418+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.418+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.420+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:50:30.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.421+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.422+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.422+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.423+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:50:30.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.424+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.425+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.425+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.426+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:50:30.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.427+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.428+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.428+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.430+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:50:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.431+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.431+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.432+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.432+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:50:30.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.434+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.434+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.434+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.435+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:50:30.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.436+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.437+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.437+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.438+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:50:30.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.439+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.440+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.440+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.441+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:50:30.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.442+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.442+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.443+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.444+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:50:30.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.445+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.446+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.446+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.447+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:50:30.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.448+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.449+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.449+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.450+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:50:30.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.451+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.452+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.452+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.453+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:50:30.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.454+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.455+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.455+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.456+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:50:30.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.457+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.458+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.458+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.459+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:50:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.460+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.461+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.461+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.462+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:50:30.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.463+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.463+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.464+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.465+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:50:30.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.466+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.466+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.467+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.468+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:50:30.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.469+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.469+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.470+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.471+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:50:30.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.472+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.472+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.472+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.474+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:50:30.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.475+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.475+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.475+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.476+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:50:30.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.478+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.478+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.478+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.479+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:50:30.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.481+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.481+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.482+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.483+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:50:30.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.484+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.484+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.485+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.486+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:50:30.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.487+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.488+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.488+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.489+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:50:30.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.491+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.491+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.491+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.492+0000 7fe446239800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:50:30.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.494+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.494+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:30.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.495+0000 7fe446239800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:30.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.496+0000 7fe2f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:30.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.498+0000 7fe446239800 20 remove_watcher() i=0 2024-03-09T14:50:30.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.498+0000 7fe446239800 2 removed watcher, disabling cache 2024-03-09T14:50:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.499+0000 7fe446239800 20 remove_watcher() i=1 2024-03-09T14:50:30.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.500+0000 7fe446239800 20 remove_watcher() i=2 2024-03-09T14:50:30.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.501+0000 7fe446239800 20 remove_watcher() i=3 2024-03-09T14:50:30.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.502+0000 7fe446239800 20 remove_watcher() i=4 2024-03-09T14:50:30.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.503+0000 7fe446239800 20 remove_watcher() i=5 2024-03-09T14:50:30.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.504+0000 7fe446239800 20 remove_watcher() i=6 2024-03-09T14:50:30.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:30.505+0000 7fe446239800 20 remove_watcher() i=7 2024-03-09T14:50:30.518 INFO:teuthology.run_tasks:Running task s3tests... 2024-03-09T14:50:30.536 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'wip-iam-user-apis', 'git_remote': 'https://github.com/cbodley/', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-03-09T14:50:30.536 INFO:tasks.s3tests:Downloading s3-tests... 2024-03-09T14:50:30.537 INFO:tasks.s3tests:Using branch 'wip-iam-user-apis' for s3tests 2024-03-09T14:50:30.537 DEBUG:teuthology.orchestra.run.smithi088:> git clone -b wip-iam-user-apis https://github.com/cbodley/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-03-09T14:50:30.564 INFO:teuthology.orchestra.run.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-03-09T14:50:32.399 INFO:tasks.s3tests:Creating rgw users... 2024-03-09T14:50:32.399 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name 'Mr. RGW11111111111111111' --email RGW11111111111111111+test@test.test 2024-03-09T14:50:32.507 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:32.507 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:32.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.541+0000 7f7323533800 20 rados->read ofs=0 len=0 2024-03-09T14:50:32.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.542+0000 7f7323533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:32.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.542+0000 7f7323533800 20 realm 2024-03-09T14:50:32.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.542+0000 7f7323533800 20 rados->read ofs=0 len=0 2024-03-09T14:50:32.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.542+0000 7f7323533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:32.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.542+0000 7f7323533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:32.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.542+0000 7f7323533800 20 rados->read ofs=0 len=0 2024-03-09T14:50:32.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.543+0000 7f7323533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:32.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.543+0000 7f7323533800 20 rados->read ofs=0 len=0 2024-03-09T14:50:32.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.544+0000 7f7323533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:32.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.544+0000 7f7323533800 20 rados->read ofs=0 len=0 2024-03-09T14:50:32.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.544+0000 7f7323533800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:32.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.544+0000 7f7323533800 20 searching for the correct realm 2024-03-09T14:50:32.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.547+0000 7f731fa65640 0 -- 172.21.15.88:0/1532728117 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f7318024040 msgr2=0x7f731803c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:32.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.753+0000 7f731ea63640 0 -- 172.21.15.88:0/1532728117 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f731803a400 msgr2=0x7f731803a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:32.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.960+0000 7f7323533800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.960+0000 7f7323533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.960+0000 7f7323533800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.960+0000 7f7323533800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.960+0000 7f7323533800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.960+0000 7f7323533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.960+0000 7f7323533800 20 rados->read ofs=0 len=0 2024-03-09T14:50:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.961+0000 7f7323533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.961+0000 7f7323533800 20 rados->read ofs=0 len=0 2024-03-09T14:50:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.961+0000 7f7323533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:32.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.961+0000 7f7323533800 20 rados->read ofs=0 len=0 2024-03-09T14:50:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.961+0000 7f7323533800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.961+0000 7f7323533800 20 zone default found 2024-03-09T14:50:32.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.961+0000 7f7323533800 4 Realm: () 2024-03-09T14:50:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.961+0000 7f7323533800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.961+0000 7f7323533800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.961+0000 7f7323533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.961+0000 7f7323533800 20 zonegroup default 2024-03-09T14:50:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.961+0000 7f7323533800 20 rados->read ofs=0 len=0 2024-03-09T14:50:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.962+0000 7f7323533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.962+0000 7f7323533800 20 rados->read ofs=0 len=0 2024-03-09T14:50:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.962+0000 7f7323533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.962+0000 7f7323533800 20 rados->read ofs=0 len=0 2024-03-09T14:50:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.962+0000 7f7323533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.962+0000 7f7323533800 20 started sync module instance, tier type = 2024-03-09T14:50:32.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.962+0000 7f7323533800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:32.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.974+0000 7f7323533800 20 add_watcher() i=0 2024-03-09T14:50:32.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.974+0000 7f7323533800 20 add_watcher() i=1 2024-03-09T14:50:32.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.974+0000 7f7323533800 20 add_watcher() i=2 2024-03-09T14:50:32.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.974+0000 7f7323533800 20 add_watcher() i=3 2024-03-09T14:50:32.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.974+0000 7f7323533800 20 add_watcher() i=4 2024-03-09T14:50:32.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.974+0000 7f7323533800 20 add_watcher() i=5 2024-03-09T14:50:32.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.974+0000 7f7323533800 20 add_watcher() i=6 2024-03-09T14:50:32.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.975+0000 7f7323533800 20 add_watcher() i=7 2024-03-09T14:50:32.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.975+0000 7f7323533800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:32.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.977+0000 7f71d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:32.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.977+0000 7f7323533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:32.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.977+0000 7f7323533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:32.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.977+0000 7f7323533800 5 note: GC not initialized 2024-03-09T14:50:32.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.977+0000 7f71d4fe1640 20 reqs_thread_entry: start 2024-03-09T14:50:32.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.978+0000 7f7323533800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:32.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.978+0000 7f7323533800 20 Filter name: none 2024-03-09T14:50:32.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.978+0000 7f714e7fc640 20 reqs_thread_entry: start 2024-03-09T14:50:32.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.978+0000 7f7323533800 10 cache get: name=default.rgw.meta+accounts+name.$Mr. RGW11111111111111111 : miss 2024-03-09T14:50:32.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.978+0000 7f7323533800 20 rados->read ofs=0 len=0 2024-03-09T14:50:32.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.978+0000 7f7323533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:32.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.978+0000 7f7323533800 10 cache put: name=default.rgw.meta+accounts+name.$Mr. RGW11111111111111111 info.flags=0x0 2024-03-09T14:50:32.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.978+0000 7f7323533800 10 adding default.rgw.meta+accounts+name.$Mr. RGW11111111111111111 to cache LRU end 2024-03-09T14:50:32.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.978+0000 7f7323533800 20 failed to read name.$Mr. RGW11111111111111111 with: (2) No such file or directory 2024-03-09T14:50:32.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.978+0000 7f7323533800 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-03-09T14:50:32.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.978+0000 7f7323533800 20 rados->read ofs=0 len=0 2024-03-09T14:50:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.979+0000 7f7323533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.979+0000 7f7323533800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-03-09T14:50:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.979+0000 7f7323533800 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-03-09T14:50:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.979+0000 7f7323533800 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-03-09T14:50:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.980+0000 7f7323533800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-03-09T14:50:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.980+0000 7f7323533800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-03-09T14:50:32.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.980+0000 7f7323533800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-03-09T14:50:32.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.980+0000 7f7202ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464371 cookie 94103297475936 notifier 7605 bl.length()=353 2024-03-09T14:50:32.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.980+0000 7f7202ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-03-09T14:50:32.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.980+0000 7f7202ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-03-09T14:50:32.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.984+0000 7f7323533800 10 cache put: name=default.rgw.meta+accounts+name.$Mr. RGW11111111111111111 info.flags=0x17 2024-03-09T14:50:32.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.984+0000 7f7323533800 10 moving default.rgw.meta+accounts+name.$Mr. RGW11111111111111111 to cache LRU end 2024-03-09T14:50:32.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.984+0000 7f7323533800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr. RGW11111111111111111, ofs0, ns] 2024-03-09T14:50:32.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.984+0000 7f7202ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464482 cookie 94103297490464 notifier 7605 bl.length()=226 2024-03-09T14:50:32.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.984+0000 7f7202ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr. RGW11111111111111111 info.flags=0x17 2024-03-09T14:50:32.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.984+0000 7f7202ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr. RGW11111111111111111 to cache LRU end 2024-03-09T14:50:32.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.987+0000 7f7323533800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-03-09T14:50:32.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.987+0000 7f7323533800 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-03-09T14:50:32.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.987+0000 7f7323533800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-03-09T14:50:32.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.988+0000 7f72027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464367 cookie 94103297485280 notifier 7605 bl.length()=234 2024-03-09T14:50:32.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.988+0000 7f72027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-03-09T14:50:32.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.988+0000 7f72027fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-03-09T14:50:32.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.990+0000 7f71d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:32.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.992+0000 7f7323533800 20 remove_watcher() i=0 2024-03-09T14:50:32.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.992+0000 7f7323533800 2 removed watcher, disabling cache 2024-03-09T14:50:32.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.993+0000 7f7323533800 20 remove_watcher() i=1 2024-03-09T14:50:32.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.995+0000 7f7323533800 20 remove_watcher() i=2 2024-03-09T14:50:32.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.996+0000 7f7323533800 20 remove_watcher() i=3 2024-03-09T14:50:32.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.997+0000 7f7323533800 20 remove_watcher() i=4 2024-03-09T14:50:32.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:32.999+0000 7f7323533800 20 remove_watcher() i=5 2024-03-09T14:50:33.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.000+0000 7f7323533800 20 remove_watcher() i=6 2024-03-09T14:50:33.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.001+0000 7f7323533800 20 remove_watcher() i=7 2024-03-09T14:50:33.011 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T14:50:33.011 INFO:teuthology.orchestra.run.smithi088.stdout: "id": "RGW11111111111111111", 2024-03-09T14:50:33.011 INFO:teuthology.orchestra.run.smithi088.stdout: "tenant": "", 2024-03-09T14:50:33.011 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "Mr. RGW11111111111111111", 2024-03-09T14:50:33.011 INFO:teuthology.orchestra.run.smithi088.stdout: "email": "RGW11111111111111111+test@test.test", 2024-03-09T14:50:33.011 INFO:teuthology.orchestra.run.smithi088.stdout: "quota": { 2024-03-09T14:50:33.011 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:33.011 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:33.011 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:33.011 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:33.011 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:33.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:33.012 INFO:teuthology.orchestra.run.smithi088.stdout: "max_users": 1000, 2024-03-09T14:50:33.012 INFO:teuthology.orchestra.run.smithi088.stdout: "max_roles": 1000, 2024-03-09T14:50:33.012 INFO:teuthology.orchestra.run.smithi088.stdout: "max_groups": 1000, 2024-03-09T14:50:33.012 INFO:teuthology.orchestra.run.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:50:33.012 INFO:teuthology.orchestra.run.smithi088.stdout: "max_access_keys": 4 2024-03-09T14:50:33.012 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T14:50:33.013 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-03-09T14:50:33.014 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key TKSIHYBPZLEDKJVFGGDE --secret tpzVYCs8BZeyRS1qPu80PphY77/RiPg4mBybIb3cqatcuBFlhEXykQ== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-03-09T14:50:33.081 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:33.081 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:33.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.111+0000 7f549e42e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.113+0000 7f549e42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:33.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.113+0000 7f549e42e800 20 realm 2024-03-09T14:50:33.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.113+0000 7f549e42e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.113+0000 7f549e42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:33.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.113+0000 7f549e42e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:33.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.113+0000 7f549e42e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.113+0000 7f549e42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:33.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.113+0000 7f549e42e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.114+0000 7f549e42e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:33.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.114+0000 7f549e42e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.115+0000 7f549e42e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:33.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.115+0000 7f549e42e800 20 searching for the correct realm 2024-03-09T14:50:33.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.117+0000 7f5499e90640 0 -- 172.21.15.88:0/3083218508 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f549405c040 msgr2=0x7f5494074920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:33.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.323+0000 7f5498e8e640 0 -- 172.21.15.88:0/3083218508 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f54940503f0 msgr2=0x7f5494050870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:33.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.530+0000 7f549e42e800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:33.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.530+0000 7f549e42e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:33.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.530+0000 7f549e42e800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:33.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.530+0000 7f549e42e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:33.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.530+0000 7f549e42e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:33.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.530+0000 7f549e42e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:33.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.530+0000 7f549e42e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.531+0000 7f549e42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:33.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.531+0000 7f549e42e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.531+0000 7f549e42e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:33.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.531+0000 7f549e42e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.531+0000 7f549e42e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:33.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.531+0000 7f549e42e800 20 zone default found 2024-03-09T14:50:33.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.531+0000 7f549e42e800 4 Realm: () 2024-03-09T14:50:33.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.531+0000 7f549e42e800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:33.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.531+0000 7f549e42e800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:33.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.531+0000 7f549e42e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:33.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.531+0000 7f549e42e800 20 zonegroup default 2024-03-09T14:50:33.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.532+0000 7f549e42e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.532+0000 7f549e42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:33.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.532+0000 7f549e42e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.532+0000 7f549e42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:33.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.532+0000 7f549e42e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.532+0000 7f549e42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:33.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.532+0000 7f549e42e800 20 started sync module instance, tier type = 2024-03-09T14:50:33.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.532+0000 7f549e42e800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.542+0000 7f549e42e800 20 add_watcher() i=0 2024-03-09T14:50:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.542+0000 7f549e42e800 20 add_watcher() i=1 2024-03-09T14:50:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.542+0000 7f549e42e800 20 add_watcher() i=2 2024-03-09T14:50:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.542+0000 7f549e42e800 20 add_watcher() i=3 2024-03-09T14:50:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.542+0000 7f549e42e800 20 add_watcher() i=4 2024-03-09T14:50:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.542+0000 7f549e42e800 20 add_watcher() i=5 2024-03-09T14:50:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.542+0000 7f549e42e800 20 add_watcher() i=6 2024-03-09T14:50:33.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.543+0000 7f549e42e800 20 add_watcher() i=7 2024-03-09T14:50:33.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.543+0000 7f549e42e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:33.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.545+0000 7f534f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:33.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.545+0000 7f549e42e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:33.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.545+0000 7f549e42e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:33.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.545+0000 7f549e42e800 5 note: GC not initialized 2024-03-09T14:50:33.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.546+0000 7f534e7e4640 20 reqs_thread_entry: start 2024-03-09T14:50:33.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.546+0000 7f549e42e800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:33.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.546+0000 7f549e42e800 20 Filter name: none 2024-03-09T14:50:33.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.546+0000 7f52bffff640 20 reqs_thread_entry: start 2024-03-09T14:50:33.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.546+0000 7f549e42e800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-03-09T14:50:33.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.546+0000 7f549e42e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.546+0000 7f549e42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:33.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.546+0000 7f549e42e800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-03-09T14:50:33.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.546+0000 7f549e42e800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:50:33.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.546+0000 7f549e42e800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-03-09T14:50:33.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.546+0000 7f549e42e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.546+0000 7f549e42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.546+0000 7f549e42e800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-03-09T14:50:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.546+0000 7f549e42e800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-03-09T14:50:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.547+0000 7f549e42e800 10 cache get: name=default.rgw.meta+users.keys+TKSIHYBPZLEDKJVFGGDE : miss 2024-03-09T14:50:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.547+0000 7f549e42e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.547+0000 7f549e42e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.547+0000 7f549e42e800 10 cache put: name=default.rgw.meta+users.keys+TKSIHYBPZLEDKJVFGGDE info.flags=0x0 2024-03-09T14:50:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.547+0000 7f549e42e800 10 adding default.rgw.meta+users.keys+TKSIHYBPZLEDKJVFGGDE to cache LRU end 2024-03-09T14:50:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.547+0000 7f549e42e800 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-03-09T14:50:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.547+0000 7f549e42e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.547+0000 7f549e42e800 20 rados_obj.operate() r=0 bl.length=153 2024-03-09T14:50:33.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.547+0000 7f549e42e800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-03-09T14:50:33.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.547+0000 7f549e42e800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-03-09T14:50:33.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.547+0000 7f549e42e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:33.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.547+0000 7f549e42e800 10 cache get: name=default.rgw.meta+users.keys+TKSIHYBPZLEDKJVFGGDE : hit (negative entry) 2024-03-09T14:50:33.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.547+0000 7f549e42e800 10 cache get: name=default.rgw.meta+users.keys+TKSIHYBPZLEDKJVFGGDE : hit (negative entry) 2024-03-09T14:50:33.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.549+0000 7f549e42e800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-09T14:50:33.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.549+0000 7f549e42e800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:50:33.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.549+0000 7f549e42e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-03-09T14:50:33.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.549+0000 7f537cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464483 cookie 94873460780208 notifier 7626 bl.length()=673 2024-03-09T14:50:33.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.549+0000 7f537cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-09T14:50:33.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.549+0000 7f537cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:50:33.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.552+0000 7f549e42e800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-03-09T14:50:33.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.552+0000 7f549e42e800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-03-09T14:50:33.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.552+0000 7f549e42e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-03-09T14:50:33.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.553+0000 7f537cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464484 cookie 94873460793088 notifier 7626 bl.length()=185 2024-03-09T14:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.553+0000 7f537cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-03-09T14:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.553+0000 7f537cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-03-09T14:50:33.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.555+0000 7f549e42e800 10 cache put: name=default.rgw.meta+users.keys+TKSIHYBPZLEDKJVFGGDE info.flags=0x7 2024-03-09T14:50:33.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.555+0000 7f549e42e800 10 moving default.rgw.meta+users.keys+TKSIHYBPZLEDKJVFGGDE to cache LRU end 2024-03-09T14:50:33.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.555+0000 7f549e42e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:TKSIHYBPZLEDKJVFGGDE, ofs0, ns] 2024-03-09T14:50:33.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.556+0000 7f537cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464298 cookie 94873460794208 notifier 7626 bl.length()=186 2024-03-09T14:50:33.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.556+0000 7f537cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TKSIHYBPZLEDKJVFGGDE info.flags=0x7 2024-03-09T14:50:33.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.556+0000 7f537cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TKSIHYBPZLEDKJVFGGDE to cache LRU end 2024-03-09T14:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.558+0000 7f549e42e800 20 linked user foo.client.0 to account RGW11111111111111111 2024-03-09T14:50:33.560 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T14:50:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "user_id": "foo.client.0", 2024-03-09T14:50:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "display_name": "Mr.RGW11111111111111111", 2024-03-09T14:50:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "email": "foo+test@test.test", 2024-03-09T14:50:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "suspended": 0, 2024-03-09T14:50:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:50:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "subusers": [], 2024-03-09T14:50:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "keys": [ 2024-03-09T14:50:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-03-09T14:50:33.560 INFO:teuthology.orchestra.run.smithi088.stdout: "user": "foo.client.0", 2024-03-09T14:50:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "access_key": "TKSIHYBPZLEDKJVFGGDE", 2024-03-09T14:50:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "secret_key": "tpzVYCs8BZeyRS1qPu80PphY77/RiPg4mBybIb3cqatcuBFlhEXykQ==", 2024-03-09T14:50:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "active": true, 2024-03-09T14:50:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:50:33.549143Z" 2024-03-09T14:50:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-03-09T14:50:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T14:50:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "swift_keys": [], 2024-03-09T14:50:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": [], 2024-03-09T14:50:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "op_mask": "read, write, delete", 2024-03-09T14:50:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "default_placement": "", 2024-03-09T14:50:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "default_storage_class": "", 2024-03-09T14:50:33.561 INFO:teuthology.orchestra.run.smithi088.stdout: "placement_tags": [], 2024-03-09T14:50:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "bucket_quota": { 2024-03-09T14:50:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "user_quota": { 2024-03-09T14:50:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:33.562 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "temp_url_keys": [], 2024-03-09T14:50:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "root", 2024-03-09T14:50:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "mfa_ids": [], 2024-03-09T14:50:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "account_id": "RGW11111111111111111", 2024-03-09T14:50:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "path": "/", 2024-03-09T14:50:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:50:33.549130Z", 2024-03-09T14:50:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "tags": [], 2024-03-09T14:50:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: "group_ids": [] 2024-03-09T14:50:33.563 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T14:50:33.563 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:33.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.559+0000 7f534f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:33.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.561+0000 7f549e42e800 20 remove_watcher() i=0 2024-03-09T14:50:33.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.561+0000 7f549e42e800 2 removed watcher, disabling cache 2024-03-09T14:50:33.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.563+0000 7f549e42e800 20 remove_watcher() i=1 2024-03-09T14:50:33.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.564+0000 7f549e42e800 20 remove_watcher() i=2 2024-03-09T14:50:33.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.565+0000 7f549e42e800 20 remove_watcher() i=3 2024-03-09T14:50:33.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.566+0000 7f549e42e800 20 remove_watcher() i=4 2024-03-09T14:50:33.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.567+0000 7f549e42e800 20 remove_watcher() i=5 2024-03-09T14:50:33.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.568+0000 7f549e42e800 20 remove_watcher() i=6 2024-03-09T14:50:33.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.569+0000 7f549e42e800 20 remove_watcher() i=7 2024-03-09T14:50:33.581 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 8822651381 --totp-seed JZV3MS4F3OKA4QBIKPBMUFNQGJWBNEPOERAMBI72FODULILDUE3BUHHJED4S6XGQ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:50:33.644 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:33.644 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:33.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.673+0000 7f99acf22800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.674+0000 7f99acf22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:33.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.674+0000 7f99acf22800 20 realm 2024-03-09T14:50:33.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.674+0000 7f99acf22800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.675+0000 7f99acf22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.675+0000 7f99acf22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.675+0000 7f99acf22800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.675+0000 7f99acf22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.675+0000 7f99acf22800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.676+0000 7f99acf22800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:33.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.676+0000 7f99acf22800 20 rados->read ofs=0 len=0 2024-03-09T14:50:33.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.677+0000 7f99acf22800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:33.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.677+0000 7f99acf22800 20 searching for the correct realm 2024-03-09T14:50:33.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.679+0000 7f99a9424640 0 -- 172.21.15.88:0/1389414906 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f9998058040 msgr2=0x7f99980510d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:50:33.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:33.885+0000 7f99a8422640 0 -- 172.21.15.88:0/1389414906 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f9998085120 msgr2=0x7f99980a6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:50:34.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.091+0000 7f99acf22800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:34.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.091+0000 7f99acf22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:34.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.091+0000 7f99acf22800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:34.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.091+0000 7f99acf22800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:34.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.091+0000 7f99acf22800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:34.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.091+0000 7f99acf22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:34.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.091+0000 7f99acf22800 20 rados->read ofs=0 len=0 2024-03-09T14:50:34.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.091+0000 7f99acf22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:34.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.091+0000 7f99acf22800 20 rados->read ofs=0 len=0 2024-03-09T14:50:34.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.092+0000 7f99acf22800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:34.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.092+0000 7f99acf22800 20 rados->read ofs=0 len=0 2024-03-09T14:50:34.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.092+0000 7f99acf22800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:34.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.092+0000 7f99acf22800 20 zone default found 2024-03-09T14:50:34.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.092+0000 7f99acf22800 4 Realm: () 2024-03-09T14:50:34.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.092+0000 7f99acf22800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:34.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.092+0000 7f99acf22800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:34.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.092+0000 7f99acf22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:34.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.092+0000 7f99acf22800 20 zonegroup default 2024-03-09T14:50:34.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.092+0000 7f99acf22800 20 rados->read ofs=0 len=0 2024-03-09T14:50:34.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.092+0000 7f99acf22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:34.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.092+0000 7f99acf22800 20 rados->read ofs=0 len=0 2024-03-09T14:50:34.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.093+0000 7f99acf22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:34.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.093+0000 7f99acf22800 20 rados->read ofs=0 len=0 2024-03-09T14:50:34.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.093+0000 7f99acf22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:34.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.093+0000 7f99acf22800 20 started sync module instance, tier type = 2024-03-09T14:50:34.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.093+0000 7f99acf22800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:34.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.103+0000 7f99acf22800 20 add_watcher() i=0 2024-03-09T14:50:34.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.103+0000 7f99acf22800 20 add_watcher() i=1 2024-03-09T14:50:34.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.103+0000 7f99acf22800 20 add_watcher() i=2 2024-03-09T14:50:34.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.103+0000 7f99acf22800 20 add_watcher() i=3 2024-03-09T14:50:34.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.103+0000 7f99acf22800 20 add_watcher() i=4 2024-03-09T14:50:34.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.103+0000 7f99acf22800 20 add_watcher() i=5 2024-03-09T14:50:34.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.103+0000 7f99acf22800 20 add_watcher() i=6 2024-03-09T14:50:34.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.104+0000 7f99acf22800 20 add_watcher() i=7 2024-03-09T14:50:34.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.104+0000 7f99acf22800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:34.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.106+0000 7f985efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:34.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.106+0000 7f99acf22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:34.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.106+0000 7f99acf22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:34.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.106+0000 7f99acf22800 5 note: GC not initialized 2024-03-09T14:50:34.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.106+0000 7f985dfe3640 20 reqs_thread_entry: start 2024-03-09T14:50:34.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.106+0000 7f99acf22800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:34.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.106+0000 7f99acf22800 20 Filter name: none 2024-03-09T14:50:34.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.106+0000 7f97cf7fe640 20 reqs_thread_entry: start 2024-03-09T14:50:34.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.106+0000 7f99acf22800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-03-09T14:50:34.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.106+0000 7f99acf22800 20 rados->read ofs=0 len=0 2024-03-09T14:50:34.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.107+0000 7f99acf22800 20 rados_obj.operate() r=0 bl.length=488 2024-03-09T14:50:34.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.107+0000 7f99acf22800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-03-09T14:50:34.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.107+0000 7f99acf22800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:50:34.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:34.107+0000 7f99acf22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:35.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.512+0000 7f99acf22800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-09T14:50:37.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.512+0000 7f99acf22800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:50:37.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.513+0000 7f99acf22800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-03-09T14:50:37.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.513+0000 7f987f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399077 cookie 94423507706032 notifier 7647 bl.length()=687 2024-03-09T14:50:37.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.513+0000 7f987f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-09T14:50:37.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.513+0000 7f987f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:50:37.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.516+0000 7f985efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:37.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.519+0000 7f99acf22800 20 remove_watcher() i=0 2024-03-09T14:50:37.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.519+0000 7f99acf22800 2 removed watcher, disabling cache 2024-03-09T14:50:37.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.520+0000 7f99acf22800 20 remove_watcher() i=1 2024-03-09T14:50:37.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.521+0000 7f99acf22800 20 remove_watcher() i=2 2024-03-09T14:50:37.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.522+0000 7f99acf22800 20 remove_watcher() i=3 2024-03-09T14:50:37.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.524+0000 7f99acf22800 20 remove_watcher() i=4 2024-03-09T14:50:37.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.525+0000 7f99acf22800 20 remove_watcher() i=5 2024-03-09T14:50:37.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.526+0000 7f99acf22800 20 remove_watcher() i=6 2024-03-09T14:50:37.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:35.527+0000 7f99acf22800 20 remove_watcher() i=7 2024-03-09T14:50:37.517 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-03-09T14:50:37.517 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key IHZPLUHADCFSYETMWTJJ --secret 89uoUNCjM+seT1fkehjaz0Hv0lBjYRPnZhlno7M+PJJE7cHixOIZmA== --cluster ceph 2024-03-09T14:50:37.586 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:37.586 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:37.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.618+0000 7f98b2f3b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:37.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.619+0000 7f98b2f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:37.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.619+0000 7f98b2f3b800 20 realm 2024-03-09T14:50:37.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.619+0000 7f98b2f3b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:37.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.620+0000 7f98b2f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:37.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.620+0000 7f98b2f3b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:37.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.620+0000 7f98b2f3b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:37.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.620+0000 7f98b2f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:37.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.620+0000 7f98b2f3b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:37.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.621+0000 7f98b2f3b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:37.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.621+0000 7f98b2f3b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:37.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.621+0000 7f98b2f3b800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:37.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.621+0000 7f98b2f3b800 20 searching for the correct realm 2024-03-09T14:50:37.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.622+0000 7f98aeccd640 0 -- 172.21.15.88:0/2197670389 >> [v2:172.21.15.88:6800/4216886240,v1:172.21.15.88:6802/4216886240] conn(0x5604247317e0 msgr2=0x560424733ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:37.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.826+0000 7f98af4ce640 0 -- 172.21.15.88:0/2197670389 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x5604245d6820 msgr2=0x7f98a8060880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.836+0000 7f98b2f3b800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.836+0000 7f98b2f3b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.836+0000 7f98b2f3b800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.836+0000 7f98b2f3b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.836+0000 7f98b2f3b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.836+0000 7f98b2f3b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.836+0000 7f98b2f3b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.836+0000 7f98b2f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.836+0000 7f98b2f3b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.837+0000 7f98b2f3b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:37.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.837+0000 7f98b2f3b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.837+0000 7f98b2f3b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.837+0000 7f98b2f3b800 20 zone default found 2024-03-09T14:50:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.837+0000 7f98b2f3b800 4 Realm: () 2024-03-09T14:50:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.837+0000 7f98b2f3b800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.837+0000 7f98b2f3b800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.837+0000 7f98b2f3b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.837+0000 7f98b2f3b800 20 zonegroup default 2024-03-09T14:50:37.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.837+0000 7f98b2f3b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:37.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.837+0000 7f98b2f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:37.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.837+0000 7f98b2f3b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:37.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.838+0000 7f98b2f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:37.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.838+0000 7f98b2f3b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:37.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.838+0000 7f98b2f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:37.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.838+0000 7f98b2f3b800 20 started sync module instance, tier type = 2024-03-09T14:50:37.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.838+0000 7f98b2f3b800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:37.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.848+0000 7f98b2f3b800 20 add_watcher() i=0 2024-03-09T14:50:37.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.848+0000 7f98b2f3b800 20 add_watcher() i=1 2024-03-09T14:50:37.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.848+0000 7f98b2f3b800 20 add_watcher() i=2 2024-03-09T14:50:37.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.848+0000 7f98b2f3b800 20 add_watcher() i=3 2024-03-09T14:50:37.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.848+0000 7f98b2f3b800 20 add_watcher() i=4 2024-03-09T14:50:37.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.848+0000 7f98b2f3b800 20 add_watcher() i=5 2024-03-09T14:50:37.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.848+0000 7f98b2f3b800 20 add_watcher() i=6 2024-03-09T14:50:37.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.849+0000 7f98b2f3b800 20 add_watcher() i=7 2024-03-09T14:50:37.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.849+0000 7f98b2f3b800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:37.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.851+0000 7f97657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.851+0000 7f98b2f3b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.851+0000 7f98b2f3b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.851+0000 7f98b2f3b800 5 note: GC not initialized 2024-03-09T14:50:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.852+0000 7f96dffff640 20 reqs_thread_entry: start 2024-03-09T14:50:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.852+0000 7f98b2f3b800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.852+0000 7f98b2f3b800 20 Filter name: none 2024-03-09T14:50:37.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.852+0000 7f96ddffb640 20 reqs_thread_entry: start 2024-03-09T14:50:37.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.852+0000 7f98b2f3b800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-03-09T14:50:37.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.852+0000 7f98b2f3b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:37.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.852+0000 7f98b2f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:37.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.852+0000 7f98b2f3b800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-03-09T14:50:37.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.852+0000 7f98b2f3b800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:50:37.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.852+0000 7f98b2f3b800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-03-09T14:50:37.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.852+0000 7f98b2f3b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:37.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.853+0000 7f98b2f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:37.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.853+0000 7f98b2f3b800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-03-09T14:50:37.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.853+0000 7f98b2f3b800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-03-09T14:50:37.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.853+0000 7f98b2f3b800 10 cache get: name=default.rgw.meta+users.keys+IHZPLUHADCFSYETMWTJJ : miss 2024-03-09T14:50:37.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.853+0000 7f98b2f3b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:37.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.853+0000 7f98b2f3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:37.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.853+0000 7f98b2f3b800 10 cache put: name=default.rgw.meta+users.keys+IHZPLUHADCFSYETMWTJJ info.flags=0x0 2024-03-09T14:50:37.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.853+0000 7f98b2f3b800 10 adding default.rgw.meta+users.keys+IHZPLUHADCFSYETMWTJJ to cache LRU end 2024-03-09T14:50:37.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.853+0000 7f98b2f3b800 10 cache get: name=default.rgw.meta+users.keys+IHZPLUHADCFSYETMWTJJ : hit (negative entry) 2024-03-09T14:50:37.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.853+0000 7f98b2f3b800 10 cache get: name=default.rgw.meta+users.keys+IHZPLUHADCFSYETMWTJJ : hit (negative entry) 2024-03-09T14:50:37.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.855+0000 7f98b2f3b800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-09T14:50:37.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.855+0000 7f98b2f3b800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:50:37.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.855+0000 7f98b2f3b800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-03-09T14:50:37.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.855+0000 7f97927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366260 cookie 94575791386176 notifier 7259 bl.length()=645 2024-03-09T14:50:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.855+0000 7f97927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-09T14:50:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.855+0000 7f97927fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:50:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.858+0000 7f98b2f3b800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-03-09T14:50:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.858+0000 7f98b2f3b800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-03-09T14:50:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.858+0000 7f98b2f3b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-03-09T14:50:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.859+0000 7f97927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366319 cookie 94575791404352 notifier 7259 bl.length()=185 2024-03-09T14:50:37.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.859+0000 7f97927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-03-09T14:50:37.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.859+0000 7f97927fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-03-09T14:50:37.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.861+0000 7f98b2f3b800 10 cache put: name=default.rgw.meta+users.keys+IHZPLUHADCFSYETMWTJJ info.flags=0x7 2024-03-09T14:50:37.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.861+0000 7f98b2f3b800 10 moving default.rgw.meta+users.keys+IHZPLUHADCFSYETMWTJJ to cache LRU end 2024-03-09T14:50:37.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.861+0000 7f98b2f3b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:IHZPLUHADCFSYETMWTJJ, ofs0, ns] 2024-03-09T14:50:37.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.862+0000 7f9791ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366320 cookie 94575791404352 notifier 7259 bl.length()=186 2024-03-09T14:50:37.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.862+0000 7f9791ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+IHZPLUHADCFSYETMWTJJ info.flags=0x7 2024-03-09T14:50:37.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.862+0000 7f9791ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+IHZPLUHADCFSYETMWTJJ to cache LRU end 2024-03-09T14:50:37.864 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T14:50:37.864 INFO:teuthology.orchestra.run.smithi088.stdout: "user_id": "bar.client.0", 2024-03-09T14:50:37.864 INFO:teuthology.orchestra.run.smithi088.stdout: "display_name": "Mr.bar.client.0", 2024-03-09T14:50:37.865 INFO:teuthology.orchestra.run.smithi088.stdout: "email": "bar+test@test.test", 2024-03-09T14:50:37.865 INFO:teuthology.orchestra.run.smithi088.stdout: "suspended": 0, 2024-03-09T14:50:37.865 INFO:teuthology.orchestra.run.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:50:37.865 INFO:teuthology.orchestra.run.smithi088.stdout: "subusers": [], 2024-03-09T14:50:37.865 INFO:teuthology.orchestra.run.smithi088.stdout: "keys": [ 2024-03-09T14:50:37.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-03-09T14:50:37.865 INFO:teuthology.orchestra.run.smithi088.stdout: "user": "bar.client.0", 2024-03-09T14:50:37.866 INFO:teuthology.orchestra.run.smithi088.stdout: "access_key": "IHZPLUHADCFSYETMWTJJ", 2024-03-09T14:50:37.866 INFO:teuthology.orchestra.run.smithi088.stdout: "secret_key": "89uoUNCjM+seT1fkehjaz0Hv0lBjYRPnZhlno7M+PJJE7cHixOIZmA==", 2024-03-09T14:50:37.866 INFO:teuthology.orchestra.run.smithi088.stdout: "active": true, 2024-03-09T14:50:37.866 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:50:37.854897Z" 2024-03-09T14:50:37.866 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-03-09T14:50:37.866 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T14:50:37.866 INFO:teuthology.orchestra.run.smithi088.stdout: "swift_keys": [], 2024-03-09T14:50:37.867 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": [], 2024-03-09T14:50:37.867 INFO:teuthology.orchestra.run.smithi088.stdout: "op_mask": "read, write, delete", 2024-03-09T14:50:37.867 INFO:teuthology.orchestra.run.smithi088.stdout: "default_placement": "", 2024-03-09T14:50:37.867 INFO:teuthology.orchestra.run.smithi088.stdout: "default_storage_class": "", 2024-03-09T14:50:37.867 INFO:teuthology.orchestra.run.smithi088.stdout: "placement_tags": [], 2024-03-09T14:50:37.867 INFO:teuthology.orchestra.run.smithi088.stdout: "bucket_quota": { 2024-03-09T14:50:37.867 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:37.868 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:37.868 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:37.868 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:37.868 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:37.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:37.868 INFO:teuthology.orchestra.run.smithi088.stdout: "user_quota": { 2024-03-09T14:50:37.868 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:37.869 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:37.869 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:37.869 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:37.869 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:37.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:37.869 INFO:teuthology.orchestra.run.smithi088.stdout: "temp_url_keys": [], 2024-03-09T14:50:37.870 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "rgw", 2024-03-09T14:50:37.870 INFO:teuthology.orchestra.run.smithi088.stdout: "mfa_ids": [], 2024-03-09T14:50:37.870 INFO:teuthology.orchestra.run.smithi088.stdout: "account_id": "", 2024-03-09T14:50:37.870 INFO:teuthology.orchestra.run.smithi088.stdout: "path": "/", 2024-03-09T14:50:37.870 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:50:37.854886Z", 2024-03-09T14:50:37.870 INFO:teuthology.orchestra.run.smithi088.stdout: "tags": [], 2024-03-09T14:50:37.870 INFO:teuthology.orchestra.run.smithi088.stdout: "group_ids": [] 2024-03-09T14:50:37.871 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T14:50:37.871 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:37.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.864+0000 7f97657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:37.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.866+0000 7f98b2f3b800 20 remove_watcher() i=0 2024-03-09T14:50:37.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.866+0000 7f98b2f3b800 2 removed watcher, disabling cache 2024-03-09T14:50:37.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.867+0000 7f98b2f3b800 20 remove_watcher() i=1 2024-03-09T14:50:37.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.868+0000 7f98b2f3b800 20 remove_watcher() i=2 2024-03-09T14:50:37.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.870+0000 7f98b2f3b800 20 remove_watcher() i=3 2024-03-09T14:50:37.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.871+0000 7f98b2f3b800 20 remove_watcher() i=4 2024-03-09T14:50:37.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.872+0000 7f98b2f3b800 20 remove_watcher() i=5 2024-03-09T14:50:37.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.873+0000 7f98b2f3b800 20 remove_watcher() i=6 2024-03-09T14:50:37.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:37.874+0000 7f98b2f3b800 20 remove_watcher() i=7 2024-03-09T14:50:37.886 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 3729483009 --totp-seed ELS3TX2FMWZS3XHVVILZ7MTIAFT3RIMSXFNIMEOBIQHYASK7XL72SQVY423OYGFC --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:50:37.950 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:37.950 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:38.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.180+0000 7f9a22f42800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.181+0000 7f9a22f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.181+0000 7f9a22f42800 20 realm 2024-03-09T14:50:38.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.181+0000 7f9a22f42800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.182+0000 7f9a22f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.182+0000 7f9a22f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:38.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.182+0000 7f9a22f42800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.182+0000 7f9a22f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.182+0000 7f9a22f42800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.183+0000 7f9a22f42800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:38.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.183+0000 7f9a22f42800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.183+0000 7f9a22f42800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:38.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.183+0000 7f9a22f42800 20 searching for the correct realm 2024-03-09T14:50:38.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.184+0000 7f9a1e440640 0 -- 172.21.15.88:0/2324948850 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f9a18076410 msgr2=0x7f9a18076890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:38.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.390+0000 7f9a1f442640 0 -- 172.21.15.88:0/2324948850 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x55742d1e6970 msgr2=0x55742d1e8d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:38.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.396+0000 7f9a22f42800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:38.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.396+0000 7f9a22f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:38.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.396+0000 7f9a22f42800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:38.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.396+0000 7f9a22f42800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:38.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.396+0000 7f9a22f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:38.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.396+0000 7f9a22f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:38.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.396+0000 7f9a22f42800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.397+0000 7f9a22f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.397+0000 7f9a22f42800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.397+0000 7f9a22f42800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:38.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.397+0000 7f9a22f42800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.397+0000 7f9a22f42800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:38.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.397+0000 7f9a22f42800 20 zone default found 2024-03-09T14:50:38.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.397+0000 7f9a22f42800 4 Realm: () 2024-03-09T14:50:38.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.397+0000 7f9a22f42800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:38.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.397+0000 7f9a22f42800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:38.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.397+0000 7f9a22f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:38.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.397+0000 7f9a22f42800 20 zonegroup default 2024-03-09T14:50:38.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.397+0000 7f9a22f42800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.398+0000 7f9a22f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.398+0000 7f9a22f42800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.398+0000 7f9a22f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.398+0000 7f9a22f42800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.398+0000 7f9a22f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.398+0000 7f9a22f42800 20 started sync module instance, tier type = 2024-03-09T14:50:38.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.398+0000 7f9a22f42800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:38.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.408+0000 7f9a22f42800 20 add_watcher() i=0 2024-03-09T14:50:38.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.408+0000 7f9a22f42800 20 add_watcher() i=1 2024-03-09T14:50:38.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.408+0000 7f9a22f42800 20 add_watcher() i=2 2024-03-09T14:50:38.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.408+0000 7f9a22f42800 20 add_watcher() i=3 2024-03-09T14:50:38.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.408+0000 7f9a22f42800 20 add_watcher() i=4 2024-03-09T14:50:38.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.408+0000 7f9a22f42800 20 add_watcher() i=5 2024-03-09T14:50:38.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.408+0000 7f9a22f42800 20 add_watcher() i=6 2024-03-09T14:50:38.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.409+0000 7f9a22f42800 20 add_watcher() i=7 2024-03-09T14:50:38.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.409+0000 7f9a22f42800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:38.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.410+0000 7f98d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:38.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.411+0000 7f9a22f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:38.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.411+0000 7f9a22f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:38.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.411+0000 7f9a22f42800 5 note: GC not initialized 2024-03-09T14:50:38.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.411+0000 7f984ffff640 20 reqs_thread_entry: start 2024-03-09T14:50:38.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.411+0000 7f9a22f42800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:38.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.411+0000 7f9a22f42800 20 Filter name: none 2024-03-09T14:50:38.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.411+0000 7f984dffb640 20 reqs_thread_entry: start 2024-03-09T14:50:38.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.411+0000 7f9a22f42800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-03-09T14:50:38.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.411+0000 7f9a22f42800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.412+0000 7f9a22f42800 20 rados_obj.operate() r=0 bl.length=460 2024-03-09T14:50:38.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.412+0000 7f9a22f42800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-03-09T14:50:38.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.412+0000 7f9a22f42800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:50:38.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.412+0000 7f9a22f42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:38.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.415+0000 7f9a22f42800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-09T14:50:38.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.415+0000 7f9a22f42800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:50:38.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.415+0000 7f9a22f42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-03-09T14:50:38.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.415+0000 7f99027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366261 cookie 93957461541872 notifier 7683 bl.length()=659 2024-03-09T14:50:38.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.415+0000 7f99027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-09T14:50:38.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.415+0000 7f99027fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:50:38.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.417+0000 7f98d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:38.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.420+0000 7f9a22f42800 20 remove_watcher() i=0 2024-03-09T14:50:38.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.420+0000 7f9a22f42800 2 removed watcher, disabling cache 2024-03-09T14:50:38.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.421+0000 7f9a22f42800 20 remove_watcher() i=1 2024-03-09T14:50:38.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.422+0000 7f9a22f42800 20 remove_watcher() i=2 2024-03-09T14:50:38.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.423+0000 7f9a22f42800 20 remove_watcher() i=3 2024-03-09T14:50:38.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.424+0000 7f9a22f42800 20 remove_watcher() i=4 2024-03-09T14:50:38.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.425+0000 7f9a22f42800 20 remove_watcher() i=5 2024-03-09T14:50:38.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.426+0000 7f9a22f42800 20 remove_watcher() i=6 2024-03-09T14:50:38.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.427+0000 7f9a22f42800 20 remove_watcher() i=7 2024-03-09T14:50:38.438 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-03-09T14:50:38.438 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key ROVEOBSUCDKRJFSYHKUK --secret 1Qyn7zfhWTyAct+kr2LYHj29qKQuHJnz5Cq5RkrJW51+EGUygP+BRQ== --cluster ceph 2024-03-09T14:50:38.498 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:38.499 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:38.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.529+0000 7ff310810800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.530+0000 7ff310810800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.530+0000 7ff310810800 20 realm 2024-03-09T14:50:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.530+0000 7ff310810800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.530+0000 7ff310810800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.530+0000 7ff310810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.530+0000 7ff310810800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.530+0000 7ff310810800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.530+0000 7ff310810800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.531+0000 7ff310810800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:38.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.531+0000 7ff310810800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.532+0000 7ff310810800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:38.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.532+0000 7ff310810800 20 searching for the correct realm 2024-03-09T14:50:38.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.533+0000 7ff30c5f1640 0 -- 172.21.15.88:0/2075539597 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x55d861879630 msgr2=0x55d86187ba40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:50:38.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.537+0000 7ff3035ef640 0 -- 172.21.15.88:0/2075539597 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7ff2fc023450 msgr2=0x7ff2fc023870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:38.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.543+0000 7ff310810800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:38.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.543+0000 7ff310810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:38.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.543+0000 7ff310810800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:38.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.543+0000 7ff310810800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:38.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.543+0000 7ff310810800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:38.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.543+0000 7ff310810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:38.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.543+0000 7ff310810800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.543+0000 7ff310810800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.543+0000 7ff310810800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.544+0000 7ff310810800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.544+0000 7ff310810800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.544+0000 7ff310810800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.544+0000 7ff310810800 20 zone default found 2024-03-09T14:50:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.544+0000 7ff310810800 4 Realm: () 2024-03-09T14:50:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.544+0000 7ff310810800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.544+0000 7ff310810800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.544+0000 7ff310810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.544+0000 7ff310810800 20 zonegroup default 2024-03-09T14:50:38.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.544+0000 7ff310810800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.544+0000 7ff310810800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.544+0000 7ff310810800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.545+0000 7ff310810800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.545+0000 7ff310810800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.545+0000 7ff310810800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.545+0000 7ff310810800 20 started sync module instance, tier type = 2024-03-09T14:50:38.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.545+0000 7ff310810800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:38.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.554+0000 7ff310810800 20 add_watcher() i=0 2024-03-09T14:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.554+0000 7ff310810800 20 add_watcher() i=1 2024-03-09T14:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.554+0000 7ff310810800 20 add_watcher() i=2 2024-03-09T14:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.554+0000 7ff310810800 20 add_watcher() i=3 2024-03-09T14:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.554+0000 7ff310810800 20 add_watcher() i=4 2024-03-09T14:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.554+0000 7ff310810800 20 add_watcher() i=5 2024-03-09T14:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.554+0000 7ff310810800 20 add_watcher() i=6 2024-03-09T14:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.555+0000 7ff310810800 20 add_watcher() i=7 2024-03-09T14:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.555+0000 7ff310810800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.556+0000 7ff1c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.556+0000 7ff310810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.556+0000 7ff310810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.556+0000 7ff310810800 5 note: GC not initialized 2024-03-09T14:50:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.557+0000 7ff1c0fe1640 20 reqs_thread_entry: start 2024-03-09T14:50:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.557+0000 7ff310810800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.557+0000 7ff310810800 20 Filter name: none 2024-03-09T14:50:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.557+0000 7ff13a7fc640 20 reqs_thread_entry: start 2024-03-09T14:50:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.557+0000 7ff310810800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-03-09T14:50:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.557+0000 7ff310810800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.557+0000 7ff310810800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.557+0000 7ff310810800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-03-09T14:50:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.557+0000 7ff310810800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:50:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.557+0000 7ff310810800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-03-09T14:50:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.557+0000 7ff310810800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.558+0000 7ff310810800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.558+0000 7ff310810800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-03-09T14:50:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.558+0000 7ff310810800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-03-09T14:50:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.558+0000 7ff310810800 10 cache get: name=default.rgw.meta+users.keys+ROVEOBSUCDKRJFSYHKUK : miss 2024-03-09T14:50:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.558+0000 7ff310810800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.558+0000 7ff310810800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.558+0000 7ff310810800 10 cache put: name=default.rgw.meta+users.keys+ROVEOBSUCDKRJFSYHKUK info.flags=0x0 2024-03-09T14:50:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.558+0000 7ff310810800 10 adding default.rgw.meta+users.keys+ROVEOBSUCDKRJFSYHKUK to cache LRU end 2024-03-09T14:50:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.558+0000 7ff310810800 10 cache get: name=default.rgw.meta+users.keys+ROVEOBSUCDKRJFSYHKUK : hit (negative entry) 2024-03-09T14:50:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.558+0000 7ff310810800 10 cache get: name=default.rgw.meta+users.keys+ROVEOBSUCDKRJFSYHKUK : hit (negative entry) 2024-03-09T14:50:38.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.559+0000 7ff310810800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-09T14:50:38.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.559+0000 7ff310810800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:50:38.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.559+0000 7ff310810800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-03-09T14:50:38.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.559+0000 7ff1eaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366321 cookie 94387837617920 notifier 7292 bl.length()=719 2024-03-09T14:50:38.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.559+0000 7ff1eaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-09T14:50:38.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.559+0000 7ff1eaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:50:38.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.562+0000 7ff310810800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-03-09T14:50:38.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.562+0000 7ff310810800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-03-09T14:50:38.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.562+0000 7ff310810800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-03-09T14:50:38.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.563+0000 7ff1eaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366187 cookie 94387837622176 notifier 7292 bl.length()=215 2024-03-09T14:50:38.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.563+0000 7ff1eaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-03-09T14:50:38.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.563+0000 7ff1eaffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-03-09T14:50:38.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.565+0000 7ff310810800 10 cache put: name=default.rgw.meta+users.keys+ROVEOBSUCDKRJFSYHKUK info.flags=0x7 2024-03-09T14:50:38.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.565+0000 7ff310810800 10 moving default.rgw.meta+users.keys+ROVEOBSUCDKRJFSYHKUK to cache LRU end 2024-03-09T14:50:38.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.565+0000 7ff310810800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:ROVEOBSUCDKRJFSYHKUK, ofs0, ns] 2024-03-09T14:50:38.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.566+0000 7ff1ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366256 cookie 94387837605328 notifier 7292 bl.length()=201 2024-03-09T14:50:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.566+0000 7ff1ea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ROVEOBSUCDKRJFSYHKUK info.flags=0x7 2024-03-09T14:50:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.566+0000 7ff1ea7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ROVEOBSUCDKRJFSYHKUK to cache LRU end 2024-03-09T14:50:38.567 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T14:50:38.567 INFO:teuthology.orchestra.run.smithi088.stdout: "user_id": "testx$tenanteduser.client.0", 2024-03-09T14:50:38.567 INFO:teuthology.orchestra.run.smithi088.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-03-09T14:50:38.567 INFO:teuthology.orchestra.run.smithi088.stdout: "email": "testx$tenanteduser+test@test.test", 2024-03-09T14:50:38.568 INFO:teuthology.orchestra.run.smithi088.stdout: "suspended": 0, 2024-03-09T14:50:38.568 INFO:teuthology.orchestra.run.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:50:38.568 INFO:teuthology.orchestra.run.smithi088.stdout: "subusers": [], 2024-03-09T14:50:38.568 INFO:teuthology.orchestra.run.smithi088.stdout: "keys": [ 2024-03-09T14:50:38.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-03-09T14:50:38.568 INFO:teuthology.orchestra.run.smithi088.stdout: "user": "testx$tenanteduser.client.0", 2024-03-09T14:50:38.568 INFO:teuthology.orchestra.run.smithi088.stdout: "access_key": "ROVEOBSUCDKRJFSYHKUK", 2024-03-09T14:50:38.568 INFO:teuthology.orchestra.run.smithi088.stdout: "secret_key": "1Qyn7zfhWTyAct+kr2LYHj29qKQuHJnz5Cq5RkrJW51+EGUygP+BRQ==", 2024-03-09T14:50:38.568 INFO:teuthology.orchestra.run.smithi088.stdout: "active": true, 2024-03-09T14:50:38.568 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:50:38.559722Z" 2024-03-09T14:50:38.568 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-03-09T14:50:38.568 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T14:50:38.568 INFO:teuthology.orchestra.run.smithi088.stdout: "swift_keys": [], 2024-03-09T14:50:38.568 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": [], 2024-03-09T14:50:38.568 INFO:teuthology.orchestra.run.smithi088.stdout: "op_mask": "read, write, delete", 2024-03-09T14:50:38.569 INFO:teuthology.orchestra.run.smithi088.stdout: "default_placement": "", 2024-03-09T14:50:38.569 INFO:teuthology.orchestra.run.smithi088.stdout: "default_storage_class": "", 2024-03-09T14:50:38.569 INFO:teuthology.orchestra.run.smithi088.stdout: "placement_tags": [], 2024-03-09T14:50:38.569 INFO:teuthology.orchestra.run.smithi088.stdout: "bucket_quota": { 2024-03-09T14:50:38.569 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:38.569 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:38.569 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:38.569 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:38.569 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:38.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:38.569 INFO:teuthology.orchestra.run.smithi088.stdout: "user_quota": { 2024-03-09T14:50:38.569 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:38.569 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:38.569 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:38.569 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:38.570 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:38.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:38.570 INFO:teuthology.orchestra.run.smithi088.stdout: "temp_url_keys": [], 2024-03-09T14:50:38.570 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "rgw", 2024-03-09T14:50:38.570 INFO:teuthology.orchestra.run.smithi088.stdout: "mfa_ids": [], 2024-03-09T14:50:38.570 INFO:teuthology.orchestra.run.smithi088.stdout: "account_id": "", 2024-03-09T14:50:38.570 INFO:teuthology.orchestra.run.smithi088.stdout: "path": "/", 2024-03-09T14:50:38.570 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:50:38.559705Z", 2024-03-09T14:50:38.570 INFO:teuthology.orchestra.run.smithi088.stdout: "tags": [], 2024-03-09T14:50:38.570 INFO:teuthology.orchestra.run.smithi088.stdout: "group_ids": [] 2024-03-09T14:50:38.570 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T14:50:38.570 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:38.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.568+0000 7ff1c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:38.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.570+0000 7ff310810800 20 remove_watcher() i=0 2024-03-09T14:50:38.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.570+0000 7ff310810800 2 removed watcher, disabling cache 2024-03-09T14:50:38.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.571+0000 7ff310810800 20 remove_watcher() i=1 2024-03-09T14:50:38.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.572+0000 7ff310810800 20 remove_watcher() i=2 2024-03-09T14:50:38.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.573+0000 7ff310810800 20 remove_watcher() i=3 2024-03-09T14:50:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.574+0000 7ff310810800 20 remove_watcher() i=4 2024-03-09T14:50:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.575+0000 7ff310810800 20 remove_watcher() i=5 2024-03-09T14:50:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.576+0000 7ff310810800 20 remove_watcher() i=6 2024-03-09T14:50:38.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.577+0000 7ff310810800 20 remove_watcher() i=7 2024-03-09T14:50:38.587 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 0403670825 --totp-seed 7LRTMPQEHK2TQ6RPKZT6DZ5IGIMBE5NWDAVDAGYXXDU2NA2KZ7H33TPCLUIBVSMK --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:50:38.651 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:38.652 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:38.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.681+0000 7faaa1e13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.682+0000 7faaa1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.682+0000 7faaa1e13800 20 realm 2024-03-09T14:50:38.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.682+0000 7faaa1e13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.682+0000 7faaa1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.682+0000 7faaa1e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:38.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.682+0000 7faaa1e13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.682+0000 7faaa1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:38.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.682+0000 7faaa1e13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.683+0000 7faaa1e13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:38.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.683+0000 7faaa1e13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:38.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.684+0000 7faaa1e13800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:38.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.684+0000 7faaa1e13800 20 searching for the correct realm 2024-03-09T14:50:38.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.686+0000 7faa9ddcd640 0 -- 172.21.15.88:0/4134598651 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7faa98018040 msgr2=0x7faa98039980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:50:38.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:38.892+0000 7faa9cdcb640 0 -- 172.21.15.88:0/4134598651 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7faa98054420 msgr2=0x7faa980548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:50:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.099+0000 7faaa1e13800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.099+0000 7faaa1e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.099+0000 7faaa1e13800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.099+0000 7faaa1e13800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.099+0000 7faaa1e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.099+0000 7faaa1e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.099+0000 7faaa1e13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.099+0000 7faaa1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.099+0000 7faaa1e13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.099+0000 7faaa1e13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.099+0000 7faaa1e13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.100+0000 7faaa1e13800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.100+0000 7faaa1e13800 20 zone default found 2024-03-09T14:50:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.100+0000 7faaa1e13800 4 Realm: () 2024-03-09T14:50:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.100+0000 7faaa1e13800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.100+0000 7faaa1e13800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.100+0000 7faaa1e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.100+0000 7faaa1e13800 20 zonegroup default 2024-03-09T14:50:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.100+0000 7faaa1e13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.100+0000 7faaa1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.100+0000 7faaa1e13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.100+0000 7faaa1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.100+0000 7faaa1e13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.101+0000 7faaa1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.101+0000 7faaa1e13800 20 started sync module instance, tier type = 2024-03-09T14:50:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.101+0000 7faaa1e13800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:39.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.110+0000 7faaa1e13800 20 add_watcher() i=0 2024-03-09T14:50:39.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.110+0000 7faaa1e13800 20 add_watcher() i=1 2024-03-09T14:50:39.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.110+0000 7faaa1e13800 20 add_watcher() i=2 2024-03-09T14:50:39.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.110+0000 7faaa1e13800 20 add_watcher() i=3 2024-03-09T14:50:39.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.110+0000 7faaa1e13800 20 add_watcher() i=4 2024-03-09T14:50:39.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.110+0000 7faaa1e13800 20 add_watcher() i=5 2024-03-09T14:50:39.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.110+0000 7faaa1e13800 20 add_watcher() i=6 2024-03-09T14:50:39.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.111+0000 7faaa1e13800 20 add_watcher() i=7 2024-03-09T14:50:39.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.111+0000 7faaa1e13800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:39.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.114+0000 7fa9537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:39.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.114+0000 7faaa1e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:39.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.114+0000 7faaa1e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:39.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.114+0000 7faaa1e13800 5 note: GC not initialized 2024-03-09T14:50:39.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.115+0000 7fa9527e4640 20 reqs_thread_entry: start 2024-03-09T14:50:39.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.115+0000 7faaa1e13800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:39.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.115+0000 7faaa1e13800 20 Filter name: none 2024-03-09T14:50:39.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.115+0000 7fa8c3fff640 20 reqs_thread_entry: start 2024-03-09T14:50:39.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.115+0000 7faaa1e13800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-03-09T14:50:39.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.115+0000 7faaa1e13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.115+0000 7faaa1e13800 20 rados_obj.operate() r=0 bl.length=519 2024-03-09T14:50:39.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.115+0000 7faaa1e13800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-03-09T14:50:39.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.115+0000 7faaa1e13800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:50:39.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.115+0000 7faaa1e13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.118+0000 7faaa1e13800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-09T14:50:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.118+0000 7faaa1e13800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:50:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.118+0000 7faaa1e13800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-03-09T14:50:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.118+0000 7fa980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366322 cookie 93827666553744 notifier 7310 bl.length()=733 2024-03-09T14:50:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.118+0000 7fa980ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-09T14:50:39.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.118+0000 7fa980ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:50:39.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.121+0000 7fa9537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:39.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.123+0000 7faaa1e13800 20 remove_watcher() i=0 2024-03-09T14:50:39.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.123+0000 7faaa1e13800 2 removed watcher, disabling cache 2024-03-09T14:50:39.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.125+0000 7faaa1e13800 20 remove_watcher() i=1 2024-03-09T14:50:39.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.126+0000 7faaa1e13800 20 remove_watcher() i=2 2024-03-09T14:50:39.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.127+0000 7faaa1e13800 20 remove_watcher() i=3 2024-03-09T14:50:39.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.128+0000 7faaa1e13800 20 remove_watcher() i=4 2024-03-09T14:50:39.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.129+0000 7faaa1e13800 20 remove_watcher() i=5 2024-03-09T14:50:39.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.130+0000 7faaa1e13800 20 remove_watcher() i=6 2024-03-09T14:50:39.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.131+0000 7faaa1e13800 20 remove_watcher() i=7 2024-03-09T14:50:39.142 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-03-09T14:50:39.142 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key JUCFVEYNLJMCOANGKPKA --secret mJPWzDDwxBz0dw7eyx54BnzklzgtWpkoSCzN4yWZjuKpuETxrkgg9A== --cluster ceph 2024-03-09T14:50:39.203 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:39.203 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:39.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.419+0000 7f5db1972640 0 --2- 172.21.15.88:0/1430075565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563842ecbd60 0x563842fbad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-09T14:50:39.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.433+0000 7f5db6527800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.435+0000 7f5db6527800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.435+0000 7f5db6527800 20 realm 2024-03-09T14:50:39.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.435+0000 7f5db6527800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.435+0000 7f5db6527800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.435+0000 7f5db6527800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:39.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.435+0000 7f5db6527800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.435+0000 7f5db6527800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.435+0000 7f5db6527800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.436+0000 7f5db6527800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:39.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.436+0000 7f5db6527800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.437+0000 7f5db6527800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:39.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.437+0000 7f5db6527800 20 searching for the correct realm 2024-03-09T14:50:39.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.437+0000 7f5db1972640 0 -- 172.21.15.88:0/916240350 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7f5da8028430 msgr2=0x7f5da8028850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:50:39.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.644+0000 7f5db2974640 0 -- 172.21.15.88:0/916240350 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x56384301b390 msgr2=0x56384301d7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:39.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.651+0000 7f5db6527800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:39.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.651+0000 7f5db6527800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:39.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.651+0000 7f5db6527800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:39.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.651+0000 7f5db6527800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:39.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.651+0000 7f5db6527800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:39.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.651+0000 7f5db6527800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:39.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.651+0000 7f5db6527800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.652+0000 7f5db6527800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.652+0000 7f5db6527800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.652+0000 7f5db6527800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:39.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.652+0000 7f5db6527800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.652+0000 7f5db6527800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:39.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.652+0000 7f5db6527800 20 zone default found 2024-03-09T14:50:39.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.652+0000 7f5db6527800 4 Realm: () 2024-03-09T14:50:39.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.652+0000 7f5db6527800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:39.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.652+0000 7f5db6527800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:39.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.652+0000 7f5db6527800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:39.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.652+0000 7f5db6527800 20 zonegroup default 2024-03-09T14:50:39.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.652+0000 7f5db6527800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.653+0000 7f5db6527800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.653+0000 7f5db6527800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.653+0000 7f5db6527800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.653+0000 7f5db6527800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.653+0000 7f5db6527800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.653+0000 7f5db6527800 20 started sync module instance, tier type = 2024-03-09T14:50:39.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.653+0000 7f5db6527800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:39.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.662+0000 7f5db6527800 20 add_watcher() i=0 2024-03-09T14:50:39.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.662+0000 7f5db6527800 20 add_watcher() i=1 2024-03-09T14:50:39.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.662+0000 7f5db6527800 20 add_watcher() i=2 2024-03-09T14:50:39.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.662+0000 7f5db6527800 20 add_watcher() i=3 2024-03-09T14:50:39.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.662+0000 7f5db6527800 20 add_watcher() i=4 2024-03-09T14:50:39.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.662+0000 7f5db6527800 20 add_watcher() i=5 2024-03-09T14:50:39.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.662+0000 7f5db6527800 20 add_watcher() i=6 2024-03-09T14:50:39.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.663+0000 7f5db6527800 20 add_watcher() i=7 2024-03-09T14:50:39.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.663+0000 7f5db6527800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.665+0000 7f5c68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.665+0000 7f5db6527800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.665+0000 7f5db6527800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.665+0000 7f5db6527800 5 note: GC not initialized 2024-03-09T14:50:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.665+0000 7f5be37fe640 20 reqs_thread_entry: start 2024-03-09T14:50:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.666+0000 7f5db6527800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.666+0000 7f5db6527800 20 Filter name: none 2024-03-09T14:50:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.666+0000 7f5be17fa640 20 reqs_thread_entry: start 2024-03-09T14:50:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.666+0000 7f5db6527800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-09T14:50:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.666+0000 7f5db6527800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.666+0000 7f5db6527800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.666+0000 7f5db6527800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-03-09T14:50:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.666+0000 7f5db6527800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.666+0000 7f5db6527800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-03-09T14:50:39.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.666+0000 7f5db6527800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.666+0000 7f5db6527800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.666+0000 7f5db6527800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-03-09T14:50:39.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.666+0000 7f5db6527800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-03-09T14:50:39.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.666+0000 7f5db6527800 10 cache get: name=default.rgw.meta+users.keys+JUCFVEYNLJMCOANGKPKA : miss 2024-03-09T14:50:39.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.666+0000 7f5db6527800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.667+0000 7f5db6527800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.667+0000 7f5db6527800 10 cache put: name=default.rgw.meta+users.keys+JUCFVEYNLJMCOANGKPKA info.flags=0x0 2024-03-09T14:50:39.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.667+0000 7f5db6527800 10 adding default.rgw.meta+users.keys+JUCFVEYNLJMCOANGKPKA to cache LRU end 2024-03-09T14:50:39.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.667+0000 7f5db6527800 10 cache get: name=default.rgw.meta+users.keys+JUCFVEYNLJMCOANGKPKA : hit (negative entry) 2024-03-09T14:50:39.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.667+0000 7f5db6527800 10 cache get: name=default.rgw.meta+users.keys+JUCFVEYNLJMCOANGKPKA : hit (negative entry) 2024-03-09T14:50:39.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.668+0000 7f5db6527800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:50:39.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.668+0000 7f5db6527800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:39.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.668+0000 7f5db6527800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-09T14:50:39.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.668+0000 7f5c95ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366188 cookie 94799642394016 notifier 7743 bl.length()=660 2024-03-09T14:50:39.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.668+0000 7f5c95ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:50:39.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.668+0000 7f5c95ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:39.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.671+0000 7f5db6527800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-03-09T14:50:39.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.671+0000 7f5db6527800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-03-09T14:50:39.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.671+0000 7f5db6527800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-03-09T14:50:39.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.671+0000 7f5c95ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366262 cookie 94799642375472 notifier 7743 bl.length()=191 2024-03-09T14:50:39.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.671+0000 7f5c95ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-03-09T14:50:39.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.671+0000 7f5c95ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-03-09T14:50:39.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.674+0000 7f5db6527800 10 cache put: name=default.rgw.meta+users.keys+JUCFVEYNLJMCOANGKPKA info.flags=0x7 2024-03-09T14:50:39.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.674+0000 7f5db6527800 10 moving default.rgw.meta+users.keys+JUCFVEYNLJMCOANGKPKA to cache LRU end 2024-03-09T14:50:39.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.674+0000 7f5db6527800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:JUCFVEYNLJMCOANGKPKA, ofs0, ns] 2024-03-09T14:50:39.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.674+0000 7f5c957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366323 cookie 94799642387488 notifier 7743 bl.length()=189 2024-03-09T14:50:39.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.674+0000 7f5c957fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JUCFVEYNLJMCOANGKPKA info.flags=0x7 2024-03-09T14:50:39.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.674+0000 7f5c957fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JUCFVEYNLJMCOANGKPKA to cache LRU end 2024-03-09T14:50:39.676 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T14:50:39.676 INFO:teuthology.orchestra.run.smithi088.stdout: "user_id": "foobar.client.0", 2024-03-09T14:50:39.676 INFO:teuthology.orchestra.run.smithi088.stdout: "display_name": "Mr.foobar.client.0", 2024-03-09T14:50:39.676 INFO:teuthology.orchestra.run.smithi088.stdout: "email": "foobar+test@test.test", 2024-03-09T14:50:39.676 INFO:teuthology.orchestra.run.smithi088.stdout: "suspended": 0, 2024-03-09T14:50:39.676 INFO:teuthology.orchestra.run.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:50:39.676 INFO:teuthology.orchestra.run.smithi088.stdout: "subusers": [], 2024-03-09T14:50:39.677 INFO:teuthology.orchestra.run.smithi088.stdout: "keys": [ 2024-03-09T14:50:39.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-03-09T14:50:39.677 INFO:teuthology.orchestra.run.smithi088.stdout: "user": "foobar.client.0", 2024-03-09T14:50:39.677 INFO:teuthology.orchestra.run.smithi088.stdout: "access_key": "JUCFVEYNLJMCOANGKPKA", 2024-03-09T14:50:39.677 INFO:teuthology.orchestra.run.smithi088.stdout: "secret_key": "mJPWzDDwxBz0dw7eyx54BnzklzgtWpkoSCzN4yWZjuKpuETxrkgg9A==", 2024-03-09T14:50:39.677 INFO:teuthology.orchestra.run.smithi088.stdout: "active": true, 2024-03-09T14:50:39.677 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:50:39.668455Z" 2024-03-09T14:50:39.677 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-03-09T14:50:39.677 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T14:50:39.677 INFO:teuthology.orchestra.run.smithi088.stdout: "swift_keys": [], 2024-03-09T14:50:39.677 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": [], 2024-03-09T14:50:39.677 INFO:teuthology.orchestra.run.smithi088.stdout: "op_mask": "read, write, delete", 2024-03-09T14:50:39.677 INFO:teuthology.orchestra.run.smithi088.stdout: "default_placement": "", 2024-03-09T14:50:39.677 INFO:teuthology.orchestra.run.smithi088.stdout: "default_storage_class": "", 2024-03-09T14:50:39.678 INFO:teuthology.orchestra.run.smithi088.stdout: "placement_tags": [], 2024-03-09T14:50:39.678 INFO:teuthology.orchestra.run.smithi088.stdout: "bucket_quota": { 2024-03-09T14:50:39.678 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:39.678 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:39.678 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:39.678 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:39.678 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:39.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:39.678 INFO:teuthology.orchestra.run.smithi088.stdout: "user_quota": { 2024-03-09T14:50:39.678 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:39.678 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:39.678 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:39.678 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:39.678 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:39.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:39.679 INFO:teuthology.orchestra.run.smithi088.stdout: "temp_url_keys": [], 2024-03-09T14:50:39.679 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "rgw", 2024-03-09T14:50:39.679 INFO:teuthology.orchestra.run.smithi088.stdout: "mfa_ids": [], 2024-03-09T14:50:39.679 INFO:teuthology.orchestra.run.smithi088.stdout: "account_id": "", 2024-03-09T14:50:39.679 INFO:teuthology.orchestra.run.smithi088.stdout: "path": "/", 2024-03-09T14:50:39.679 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:50:39.668443Z", 2024-03-09T14:50:39.679 INFO:teuthology.orchestra.run.smithi088.stdout: "tags": [], 2024-03-09T14:50:39.679 INFO:teuthology.orchestra.run.smithi088.stdout: "group_ids": [] 2024-03-09T14:50:39.679 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T14:50:39.679 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:39.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.676+0000 7f5c68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:39.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.679+0000 7f5db6527800 20 remove_watcher() i=0 2024-03-09T14:50:39.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.679+0000 7f5db6527800 2 removed watcher, disabling cache 2024-03-09T14:50:39.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.680+0000 7f5db6527800 20 remove_watcher() i=1 2024-03-09T14:50:39.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.681+0000 7f5db6527800 20 remove_watcher() i=2 2024-03-09T14:50:39.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.682+0000 7f5db6527800 20 remove_watcher() i=3 2024-03-09T14:50:39.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.683+0000 7f5db6527800 20 remove_watcher() i=4 2024-03-09T14:50:39.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.684+0000 7f5db6527800 20 remove_watcher() i=5 2024-03-09T14:50:39.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.685+0000 7f5db6527800 20 remove_watcher() i=6 2024-03-09T14:50:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.686+0000 7f5db6527800 20 remove_watcher() i=7 2024-03-09T14:50:39.697 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 5132894724 --totp-seed WN46QDSPWLG44HPT4KUVFCWOROU5KNFMJ2CVBRSWYI3QO4UZKLU5RZF5PEAAB7BX --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:50:39.759 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:39.760 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:39.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.789+0000 7fe4ebb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.790+0000 7fe4ebb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.790+0000 7fe4ebb31800 20 realm 2024-03-09T14:50:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.790+0000 7fe4ebb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.791+0000 7fe4ebb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.791+0000 7fe4ebb31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.791+0000 7fe4ebb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.791+0000 7fe4ebb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.791+0000 7fe4ebb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.792+0000 7fe4ebb31800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.792+0000 7fe4ebb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.792+0000 7fe4ebb31800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:39.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.792+0000 7fe4ebb31800 20 searching for the correct realm 2024-03-09T14:50:39.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.794+0000 7fe4e7030640 0 -- 172.21.15.88:0/1058955044 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7fe4d8060570 msgr2=0x7fe4d80571b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:39.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.797+0000 7fe4e8032640 0 -- 172.21.15.88:0/1058955044 >> [v2:172.21.15.88:6803/583120953,v1:172.21.15.88:6806/583120953] conn(0x55ec3e36fd60 msgr2=0x55ec3e372150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.803+0000 7fe4ebb31800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.803+0000 7fe4ebb31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.803+0000 7fe4ebb31800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.803+0000 7fe4ebb31800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.803+0000 7fe4ebb31800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.803+0000 7fe4ebb31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.803+0000 7fe4ebb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.803+0000 7fe4ebb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.803+0000 7fe4ebb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.804+0000 7fe4ebb31800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.804+0000 7fe4ebb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.804+0000 7fe4ebb31800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.804+0000 7fe4ebb31800 20 zone default found 2024-03-09T14:50:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.804+0000 7fe4ebb31800 4 Realm: () 2024-03-09T14:50:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.804+0000 7fe4ebb31800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.804+0000 7fe4ebb31800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.804+0000 7fe4ebb31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.804+0000 7fe4ebb31800 20 zonegroup default 2024-03-09T14:50:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.804+0000 7fe4ebb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.804+0000 7fe4ebb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.804+0000 7fe4ebb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.805+0000 7fe4ebb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.805+0000 7fe4ebb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.805+0000 7fe4ebb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.805+0000 7fe4ebb31800 20 started sync module instance, tier type = 2024-03-09T14:50:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.805+0000 7fe4ebb31800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:39.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.814+0000 7fe4ebb31800 20 add_watcher() i=0 2024-03-09T14:50:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.814+0000 7fe4ebb31800 20 add_watcher() i=1 2024-03-09T14:50:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.814+0000 7fe4ebb31800 20 add_watcher() i=2 2024-03-09T14:50:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.814+0000 7fe4ebb31800 20 add_watcher() i=3 2024-03-09T14:50:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.814+0000 7fe4ebb31800 20 add_watcher() i=4 2024-03-09T14:50:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.814+0000 7fe4ebb31800 20 add_watcher() i=5 2024-03-09T14:50:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.814+0000 7fe4ebb31800 20 add_watcher() i=6 2024-03-09T14:50:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.815+0000 7fe4ebb31800 20 add_watcher() i=7 2024-03-09T14:50:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.815+0000 7fe4ebb31800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:39.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.816+0000 7fe39dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:39.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.816+0000 7fe4ebb31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.816+0000 7fe4ebb31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.816+0000 7fe4ebb31800 5 note: GC not initialized 2024-03-09T14:50:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.817+0000 7fe39cfe1640 20 reqs_thread_entry: start 2024-03-09T14:50:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.817+0000 7fe4ebb31800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.817+0000 7fe4ebb31800 20 Filter name: none 2024-03-09T14:50:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.817+0000 7fe3167fc640 20 reqs_thread_entry: start 2024-03-09T14:50:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.817+0000 7fe4ebb31800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-09T14:50:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.817+0000 7fe4ebb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.817+0000 7fe4ebb31800 20 rados_obj.operate() r=0 bl.length=472 2024-03-09T14:50:39.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.817+0000 7fe4ebb31800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-03-09T14:50:39.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.817+0000 7fe4ebb31800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:39.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.817+0000 7fe4ebb31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:39.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.820+0000 7fe4ebb31800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:50:39.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.820+0000 7fe4ebb31800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:39.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.820+0000 7fe4ebb31800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-09T14:50:39.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.820+0000 7fe3c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366189 cookie 94473144484464 notifier 7758 bl.length()=674 2024-03-09T14:50:39.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.820+0000 7fe3c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:50:39.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.820+0000 7fe3c6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:39.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.822+0000 7fe39dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:39.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.825+0000 7fe4ebb31800 20 remove_watcher() i=0 2024-03-09T14:50:39.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.825+0000 7fe4ebb31800 2 removed watcher, disabling cache 2024-03-09T14:50:39.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.826+0000 7fe4ebb31800 20 remove_watcher() i=1 2024-03-09T14:50:39.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.827+0000 7fe4ebb31800 20 remove_watcher() i=2 2024-03-09T14:50:39.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.828+0000 7fe4ebb31800 20 remove_watcher() i=3 2024-03-09T14:50:39.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.829+0000 7fe4ebb31800 20 remove_watcher() i=4 2024-03-09T14:50:39.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.830+0000 7fe4ebb31800 20 remove_watcher() i=5 2024-03-09T14:50:39.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.831+0000 7fe4ebb31800 20 remove_watcher() i=6 2024-03-09T14:50:39.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.832+0000 7fe4ebb31800 20 remove_watcher() i=7 2024-03-09T14:50:39.843 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-03-09T14:50:39.897 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:39.897 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:39.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.926+0000 7f2e9cf2a800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.928+0000 7f2e9cf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.928+0000 7f2e9cf2a800 20 realm 2024-03-09T14:50:39.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.928+0000 7f2e9cf2a800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.928+0000 7f2e9cf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.928+0000 7f2e9cf2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:39.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.928+0000 7f2e9cf2a800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.928+0000 7f2e9cf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:39.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.928+0000 7f2e9cf2a800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.929+0000 7f2e9cf2a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:39.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.929+0000 7f2e9cf2a800 20 rados->read ofs=0 len=0 2024-03-09T14:50:39.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.929+0000 7f2e9cf2a800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:39.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.929+0000 7f2e9cf2a800 20 searching for the correct realm 2024-03-09T14:50:39.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:39.932+0000 7f2e994ed640 0 -- 172.21.15.88:0/1249422778 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f2e94089070 msgr2=0x7f2e9408d290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:40.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.137+0000 7f2e93fff640 0 -- 172.21.15.88:0/1249422778 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f2e9405c040 msgr2=0x7f2e940bd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:40.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.344+0000 7f2e9cf2a800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:40.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.344+0000 7f2e9cf2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:40.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.344+0000 7f2e9cf2a800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:40.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.344+0000 7f2e9cf2a800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:40.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.344+0000 7f2e9cf2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:40.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.344+0000 7f2e9cf2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:40.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.344+0000 7f2e9cf2a800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.344+0000 7f2e9cf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:40.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.344+0000 7f2e9cf2a800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.344+0000 7f2e9cf2a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:40.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.344+0000 7f2e9cf2a800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.345+0000 7f2e9cf2a800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:40.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.345+0000 7f2e9cf2a800 20 zone default found 2024-03-09T14:50:40.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.345+0000 7f2e9cf2a800 4 Realm: () 2024-03-09T14:50:40.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.345+0000 7f2e9cf2a800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:40.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.345+0000 7f2e9cf2a800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:40.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.345+0000 7f2e9cf2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:40.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.345+0000 7f2e9cf2a800 20 zonegroup default 2024-03-09T14:50:40.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.345+0000 7f2e9cf2a800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.345+0000 7f2e9cf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:40.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.345+0000 7f2e9cf2a800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.345+0000 7f2e9cf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:40.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.345+0000 7f2e9cf2a800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.346+0000 7f2e9cf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:40.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.346+0000 7f2e9cf2a800 20 started sync module instance, tier type = 2024-03-09T14:50:40.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.346+0000 7f2e9cf2a800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:40.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.355+0000 7f2e9cf2a800 20 add_watcher() i=0 2024-03-09T14:50:40.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.355+0000 7f2e9cf2a800 20 add_watcher() i=1 2024-03-09T14:50:40.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.355+0000 7f2e9cf2a800 20 add_watcher() i=2 2024-03-09T14:50:40.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.355+0000 7f2e9cf2a800 20 add_watcher() i=3 2024-03-09T14:50:40.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.355+0000 7f2e9cf2a800 20 add_watcher() i=4 2024-03-09T14:50:40.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.355+0000 7f2e9cf2a800 20 add_watcher() i=5 2024-03-09T14:50:40.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.355+0000 7f2e9cf2a800 20 add_watcher() i=6 2024-03-09T14:50:40.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.356+0000 7f2e9cf2a800 20 add_watcher() i=7 2024-03-09T14:50:40.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.356+0000 7f2e9cf2a800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:40.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.358+0000 7f2d4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:40.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.358+0000 7f2e9cf2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:40.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.358+0000 7f2e9cf2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:40.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.358+0000 7f2e9cf2a800 5 note: GC not initialized 2024-03-09T14:50:40.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.358+0000 7f2d4dfe3640 20 reqs_thread_entry: start 2024-03-09T14:50:40.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.358+0000 7f2e9cf2a800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:40.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.358+0000 7f2e9cf2a800 20 Filter name: none 2024-03-09T14:50:40.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.358+0000 7f2cbf7fe640 20 reqs_thread_entry: start 2024-03-09T14:50:40.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.358+0000 7f2e9cf2a800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-09T14:50:40.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.358+0000 7f2e9cf2a800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.359+0000 7f2e9cf2a800 20 rados_obj.operate() r=0 bl.length=486 2024-03-09T14:50:40.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.359+0000 7f2e9cf2a800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-03-09T14:50:40.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.359+0000 7f2e9cf2a800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:40.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.359+0000 7f2e9cf2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:40.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.360+0000 7f2e9cf2a800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:50:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.360+0000 7f2e9cf2a800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.360+0000 7f2e9cf2a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-09T14:50:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.360+0000 7f2d6ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366190 cookie 94570078059360 notifier 7773 bl.length()=727 2024-03-09T14:50:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.360+0000 7f2d6ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:50:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.360+0000 7f2d6ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:40.362 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T14:50:40.362 INFO:teuthology.orchestra.run.smithi088.stdout: "user_id": "foobar.client.0", 2024-03-09T14:50:40.362 INFO:teuthology.orchestra.run.smithi088.stdout: "display_name": "Mr.foobar.client.0", 2024-03-09T14:50:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: "email": "foobar+test@test.test", 2024-03-09T14:50:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: "suspended": 0, 2024-03-09T14:50:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:50:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: "subusers": [], 2024-03-09T14:50:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: "keys": [ 2024-03-09T14:50:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-03-09T14:50:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: "user": "foobar.client.0", 2024-03-09T14:50:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: "access_key": "JUCFVEYNLJMCOANGKPKA", 2024-03-09T14:50:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: "secret_key": "mJPWzDDwxBz0dw7eyx54BnzklzgtWpkoSCzN4yWZjuKpuETxrkgg9A==", 2024-03-09T14:50:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: "active": true, 2024-03-09T14:50:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:50:39.668455Z" 2024-03-09T14:50:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-03-09T14:50:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T14:50:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: "swift_keys": [], 2024-03-09T14:50:40.363 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": [ 2024-03-09T14:50:40.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-03-09T14:50:40.364 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "oidc-provider", 2024-03-09T14:50:40.364 INFO:teuthology.orchestra.run.smithi088.stdout: "perm": "*" 2024-03-09T14:50:40.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:40.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-03-09T14:50:40.364 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "roles", 2024-03-09T14:50:40.364 INFO:teuthology.orchestra.run.smithi088.stdout: "perm": "*" 2024-03-09T14:50:40.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:40.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-03-09T14:50:40.365 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "user-policy", 2024-03-09T14:50:40.365 INFO:teuthology.orchestra.run.smithi088.stdout: "perm": "*" 2024-03-09T14:50:40.365 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-03-09T14:50:40.365 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T14:50:40.365 INFO:teuthology.orchestra.run.smithi088.stdout: "op_mask": "read, write, delete", 2024-03-09T14:50:40.365 INFO:teuthology.orchestra.run.smithi088.stdout: "default_placement": "", 2024-03-09T14:50:40.365 INFO:teuthology.orchestra.run.smithi088.stdout: "default_storage_class": "", 2024-03-09T14:50:40.365 INFO:teuthology.orchestra.run.smithi088.stdout: "placement_tags": [], 2024-03-09T14:50:40.365 INFO:teuthology.orchestra.run.smithi088.stdout: "bucket_quota": { 2024-03-09T14:50:40.365 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:40.365 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:40.365 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:40.366 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:40.366 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:40.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:40.366 INFO:teuthology.orchestra.run.smithi088.stdout: "user_quota": { 2024-03-09T14:50:40.366 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:40.366 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:40.366 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:40.366 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:40.366 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:40.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:40.366 INFO:teuthology.orchestra.run.smithi088.stdout: "temp_url_keys": [], 2024-03-09T14:50:40.366 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "rgw", 2024-03-09T14:50:40.366 INFO:teuthology.orchestra.run.smithi088.stdout: "mfa_ids": [ 2024-03-09T14:50:40.366 INFO:teuthology.orchestra.run.smithi088.stdout: "5132894724" 2024-03-09T14:50:40.366 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T14:50:40.367 INFO:teuthology.orchestra.run.smithi088.stdout: "account_id": "", 2024-03-09T14:50:40.367 INFO:teuthology.orchestra.run.smithi088.stdout: "path": "/", 2024-03-09T14:50:40.367 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:50:39.668443Z", 2024-03-09T14:50:40.367 INFO:teuthology.orchestra.run.smithi088.stdout: "tags": [], 2024-03-09T14:50:40.367 INFO:teuthology.orchestra.run.smithi088.stdout: "group_ids": [] 2024-03-09T14:50:40.368 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T14:50:40.368 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.363+0000 7f2d4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.365+0000 7f2e9cf2a800 20 remove_watcher() i=0 2024-03-09T14:50:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.365+0000 7f2e9cf2a800 2 removed watcher, disabling cache 2024-03-09T14:50:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.366+0000 7f2e9cf2a800 20 remove_watcher() i=1 2024-03-09T14:50:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.367+0000 7f2e9cf2a800 20 remove_watcher() i=2 2024-03-09T14:50:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.369+0000 7f2e9cf2a800 20 remove_watcher() i=3 2024-03-09T14:50:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.370+0000 7f2e9cf2a800 20 remove_watcher() i=4 2024-03-09T14:50:40.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.371+0000 7f2e9cf2a800 20 remove_watcher() i=5 2024-03-09T14:50:40.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.372+0000 7f2e9cf2a800 20 remove_watcher() i=6 2024-03-09T14:50:40.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.373+0000 7f2e9cf2a800 20 remove_watcher() i=7 2024-03-09T14:50:40.384 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name 'Mr. RGW88888888888888888' --email RGW88888888888888888+test@test.test 2024-03-09T14:50:40.441 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:40.442 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:40.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.470+0000 7f44a2d1f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.472+0000 7f44a2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:40.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.472+0000 7f44a2d1f800 20 realm 2024-03-09T14:50:40.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.472+0000 7f44a2d1f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.472+0000 7f44a2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:40.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.472+0000 7f44a2d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:40.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.472+0000 7f44a2d1f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.472+0000 7f44a2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:40.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.472+0000 7f44a2d1f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.473+0000 7f44a2d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:40.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.473+0000 7f44a2d1f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.473+0000 7f44a2d1f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:40.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.473+0000 7f44a2d1f800 20 searching for the correct realm 2024-03-09T14:50:40.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.476+0000 7f449f27b640 0 -- 172.21.15.88:0/535488903 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f449803e040 msgr2=0x7f4498026430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:40.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.682+0000 7f4497fff640 0 -- 172.21.15.88:0/535488903 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f4498033030 msgr2=0x7f449803eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:40.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.888+0000 7f44a2d1f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:40.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.888+0000 7f44a2d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:40.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.888+0000 7f44a2d1f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:40.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.888+0000 7f44a2d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:40.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.888+0000 7f44a2d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:40.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.888+0000 7f44a2d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:40.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.888+0000 7f44a2d1f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.888+0000 7f44a2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:40.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.888+0000 7f44a2d1f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.889+0000 7f44a2d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:40.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.889+0000 7f44a2d1f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.889+0000 7f44a2d1f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:40.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.889+0000 7f44a2d1f800 20 zone default found 2024-03-09T14:50:40.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.889+0000 7f44a2d1f800 4 Realm: () 2024-03-09T14:50:40.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.889+0000 7f44a2d1f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:40.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.889+0000 7f44a2d1f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:40.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.889+0000 7f44a2d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:40.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.889+0000 7f44a2d1f800 20 zonegroup default 2024-03-09T14:50:40.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.889+0000 7f44a2d1f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.889+0000 7f44a2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:40.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.889+0000 7f44a2d1f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.890+0000 7f44a2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:40.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.890+0000 7f44a2d1f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.890+0000 7f44a2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:40.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.890+0000 7f44a2d1f800 20 started sync module instance, tier type = 2024-03-09T14:50:40.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.890+0000 7f44a2d1f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:40.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.899+0000 7f44a2d1f800 20 add_watcher() i=0 2024-03-09T14:50:40.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.899+0000 7f44a2d1f800 20 add_watcher() i=1 2024-03-09T14:50:40.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.899+0000 7f44a2d1f800 20 add_watcher() i=2 2024-03-09T14:50:40.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.899+0000 7f44a2d1f800 20 add_watcher() i=3 2024-03-09T14:50:40.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.899+0000 7f44a2d1f800 20 add_watcher() i=4 2024-03-09T14:50:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.899+0000 7f44a2d1f800 20 add_watcher() i=5 2024-03-09T14:50:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.899+0000 7f44a2d1f800 20 add_watcher() i=6 2024-03-09T14:50:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.900+0000 7f44a2d1f800 20 add_watcher() i=7 2024-03-09T14:50:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.900+0000 7f44a2d1f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.902+0000 7f43557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.902+0000 7f44a2d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.902+0000 7f44a2d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.902+0000 7f44a2d1f800 5 note: GC not initialized 2024-03-09T14:50:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.902+0000 7f42cffff640 20 reqs_thread_entry: start 2024-03-09T14:50:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.902+0000 7f44a2d1f800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.902+0000 7f44a2d1f800 20 Filter name: none 2024-03-09T14:50:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.902+0000 7f42cdffb640 20 reqs_thread_entry: start 2024-03-09T14:50:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.903+0000 7f44a2d1f800 10 cache get: name=default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 : miss 2024-03-09T14:50:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.903+0000 7f44a2d1f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.903+0000 7f44a2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.903+0000 7f44a2d1f800 10 cache put: name=default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 info.flags=0x0 2024-03-09T14:50:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.903+0000 7f44a2d1f800 10 adding default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 to cache LRU end 2024-03-09T14:50:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.903+0000 7f44a2d1f800 20 failed to read name.$Mr. RGW88888888888888888 with: (2) No such file or directory 2024-03-09T14:50:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.903+0000 7f44a2d1f800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-03-09T14:50:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.903+0000 7f44a2d1f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.903+0000 7f44a2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.903+0000 7f44a2d1f800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-03-09T14:50:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.903+0000 7f44a2d1f800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-03-09T14:50:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.903+0000 7f44a2d1f800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-03-09T14:50:40.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.905+0000 7f44a2d1f800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-03-09T14:50:40.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.905+0000 7f44a2d1f800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-03-09T14:50:40.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.905+0000 7f44a2d1f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-03-09T14:50:40.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.906+0000 7f43827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366263 cookie 94004312147312 notifier 7791 bl.length()=353 2024-03-09T14:50:40.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.906+0000 7f43827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-03-09T14:50:40.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.906+0000 7f43827fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-03-09T14:50:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.909+0000 7f44a2d1f800 10 cache put: name=default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 info.flags=0x17 2024-03-09T14:50:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.909+0000 7f44a2d1f800 10 moving default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 to cache LRU end 2024-03-09T14:50:40.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.909+0000 7f44a2d1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr. RGW88888888888888888, ofs0, ns] 2024-03-09T14:50:40.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.909+0000 7f43827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366374 cookie 94004312162560 notifier 7791 bl.length()=226 2024-03-09T14:50:40.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.909+0000 7f43827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 info.flags=0x17 2024-03-09T14:50:40.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.909+0000 7f43827fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 to cache LRU end 2024-03-09T14:50:40.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.912+0000 7f44a2d1f800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-03-09T14:50:40.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.912+0000 7f44a2d1f800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-03-09T14:50:40.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.912+0000 7f44a2d1f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-03-09T14:50:40.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.912+0000 7f4381ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366257 cookie 94004312158048 notifier 7791 bl.length()=234 2024-03-09T14:50:40.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.912+0000 7f4381ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-03-09T14:50:40.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.912+0000 7f4381ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-03-09T14:50:40.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.914+0000 7f43557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:40.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.917+0000 7f44a2d1f800 20 remove_watcher() i=0 2024-03-09T14:50:40.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.917+0000 7f44a2d1f800 2 removed watcher, disabling cache 2024-03-09T14:50:40.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.918+0000 7f44a2d1f800 20 remove_watcher() i=1 2024-03-09T14:50:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.919+0000 7f44a2d1f800 20 remove_watcher() i=2 2024-03-09T14:50:40.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.920+0000 7f44a2d1f800 20 remove_watcher() i=3 2024-03-09T14:50:40.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.921+0000 7f44a2d1f800 20 remove_watcher() i=4 2024-03-09T14:50:40.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.922+0000 7f44a2d1f800 20 remove_watcher() i=5 2024-03-09T14:50:40.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.923+0000 7f44a2d1f800 20 remove_watcher() i=6 2024-03-09T14:50:40.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:40.924+0000 7f44a2d1f800 20 remove_watcher() i=7 2024-03-09T14:50:40.932 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T14:50:40.932 INFO:teuthology.orchestra.run.smithi088.stdout: "id": "RGW88888888888888888", 2024-03-09T14:50:40.933 INFO:teuthology.orchestra.run.smithi088.stdout: "tenant": "", 2024-03-09T14:50:40.933 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "Mr. RGW88888888888888888", 2024-03-09T14:50:40.933 INFO:teuthology.orchestra.run.smithi088.stdout: "email": "RGW88888888888888888+test@test.test", 2024-03-09T14:50:40.933 INFO:teuthology.orchestra.run.smithi088.stdout: "quota": { 2024-03-09T14:50:40.933 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:40.933 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:40.933 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:40.933 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:40.933 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:40.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:40.934 INFO:teuthology.orchestra.run.smithi088.stdout: "max_users": 1000, 2024-03-09T14:50:40.934 INFO:teuthology.orchestra.run.smithi088.stdout: "max_roles": 1000, 2024-03-09T14:50:40.934 INFO:teuthology.orchestra.run.smithi088.stdout: "max_groups": 1000, 2024-03-09T14:50:40.934 INFO:teuthology.orchestra.run.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:50:40.934 INFO:teuthology.orchestra.run.smithi088.stdout: "max_access_keys": 4 2024-03-09T14:50:40.934 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T14:50:40.935 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-03-09T14:50:40.936 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key GOHLIOKJQWQBPUZVKAKQ --secret 4qLY9M/zzztF9prF59z8r9uxhJyP0z2Xhc56JzKhAUfwY6peBbjA7Q== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-03-09T14:50:41.000 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:41.000 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.029+0000 7fa695e30800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.030+0000 7fa695e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.030+0000 7fa695e30800 20 realm 2024-03-09T14:50:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.030+0000 7fa695e30800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.030+0000 7fa695e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.030+0000 7fa695e30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.030+0000 7fa695e30800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.031+0000 7fa695e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.031+0000 7fa695e30800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.031+0000 7fa695e30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.031+0000 7fa695e30800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.032+0000 7fa695e30800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.032+0000 7fa695e30800 20 searching for the correct realm 2024-03-09T14:50:41.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.034+0000 7fa691890640 0 -- 172.21.15.88:0/2145727673 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fa68c066100 msgr2=0x7fa68c0083d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:41.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.240+0000 7fa69088e640 0 -- 172.21.15.88:0/2145727673 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fa68c032700 msgr2=0x7fa68c094a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:50:41.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.446+0000 7fa695e30800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:41.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.446+0000 7fa695e30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.446+0000 7fa695e30800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.446+0000 7fa695e30800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.446+0000 7fa695e30800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.446+0000 7fa695e30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.446+0000 7fa695e30800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.446+0000 7fa695e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.446+0000 7fa695e30800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.447+0000 7fa695e30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.447+0000 7fa695e30800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.447+0000 7fa695e30800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:41.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.447+0000 7fa695e30800 20 zone default found 2024-03-09T14:50:41.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.447+0000 7fa695e30800 4 Realm: () 2024-03-09T14:50:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.447+0000 7fa695e30800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.447+0000 7fa695e30800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.447+0000 7fa695e30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.447+0000 7fa695e30800 20 zonegroup default 2024-03-09T14:50:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.447+0000 7fa695e30800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.447+0000 7fa695e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.447+0000 7fa695e30800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.448+0000 7fa695e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.448+0000 7fa695e30800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.448+0000 7fa695e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.448+0000 7fa695e30800 20 started sync module instance, tier type = 2024-03-09T14:50:41.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.448+0000 7fa695e30800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:41.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.458+0000 7fa695e30800 20 add_watcher() i=0 2024-03-09T14:50:41.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.458+0000 7fa695e30800 20 add_watcher() i=1 2024-03-09T14:50:41.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.458+0000 7fa695e30800 20 add_watcher() i=2 2024-03-09T14:50:41.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.458+0000 7fa695e30800 20 add_watcher() i=3 2024-03-09T14:50:41.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.458+0000 7fa695e30800 20 add_watcher() i=4 2024-03-09T14:50:41.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.458+0000 7fa695e30800 20 add_watcher() i=5 2024-03-09T14:50:41.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.458+0000 7fa695e30800 20 add_watcher() i=6 2024-03-09T14:50:41.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.458+0000 7fa695e30800 20 add_watcher() i=7 2024-03-09T14:50:41.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.458+0000 7fa695e30800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:41.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.460+0000 7fa547fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:41.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.460+0000 7fa695e30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:41.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.460+0000 7fa695e30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:41.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.460+0000 7fa695e30800 5 note: GC not initialized 2024-03-09T14:50:41.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.461+0000 7fa546fe5640 20 reqs_thread_entry: start 2024-03-09T14:50:41.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.461+0000 7fa695e30800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:41.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.461+0000 7fa695e30800 20 Filter name: none 2024-03-09T14:50:41.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.461+0000 7fa544fe1640 20 reqs_thread_entry: start 2024-03-09T14:50:41.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.461+0000 7fa695e30800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-03-09T14:50:41.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.461+0000 7fa695e30800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.461+0000 7fa695e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:41.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.461+0000 7fa695e30800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-03-09T14:50:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.461+0000 7fa695e30800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:50:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.461+0000 7fa695e30800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-03-09T14:50:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.461+0000 7fa695e30800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.462+0000 7fa695e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.462+0000 7fa695e30800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-03-09T14:50:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.462+0000 7fa695e30800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-03-09T14:50:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.462+0000 7fa695e30800 10 cache get: name=default.rgw.meta+users.keys+GOHLIOKJQWQBPUZVKAKQ : miss 2024-03-09T14:50:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.462+0000 7fa695e30800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.462+0000 7fa695e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.462+0000 7fa695e30800 10 cache put: name=default.rgw.meta+users.keys+GOHLIOKJQWQBPUZVKAKQ info.flags=0x0 2024-03-09T14:50:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.462+0000 7fa695e30800 10 adding default.rgw.meta+users.keys+GOHLIOKJQWQBPUZVKAKQ to cache LRU end 2024-03-09T14:50:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.462+0000 7fa695e30800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-03-09T14:50:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.462+0000 7fa695e30800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.463+0000 7fa695e30800 20 rados_obj.operate() r=0 bl.length=153 2024-03-09T14:50:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.463+0000 7fa695e30800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-03-09T14:50:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.463+0000 7fa695e30800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-03-09T14:50:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.463+0000 7fa695e30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.463+0000 7fa695e30800 10 cache get: name=default.rgw.meta+users.keys+GOHLIOKJQWQBPUZVKAKQ : hit (negative entry) 2024-03-09T14:50:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.463+0000 7fa695e30800 10 cache get: name=default.rgw.meta+users.keys+GOHLIOKJQWQBPUZVKAKQ : hit (negative entry) 2024-03-09T14:50:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.464+0000 7fa695e30800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-03-09T14:50:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.464+0000 7fa695e30800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:50:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.464+0000 7fa695e30800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-03-09T14:50:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.464+0000 7fa574ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366264 cookie 94468855469888 notifier 7397 bl.length()=681 2024-03-09T14:50:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.464+0000 7fa574ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-03-09T14:50:41.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.464+0000 7fa574ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:50:41.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.467+0000 7fa695e30800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-03-09T14:50:41.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.467+0000 7fa695e30800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-03-09T14:50:41.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.467+0000 7fa695e30800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-03-09T14:50:41.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.467+0000 7fa563fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366324 cookie 94468855483920 notifier 7397 bl.length()=189 2024-03-09T14:50:41.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.467+0000 7fa563fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-03-09T14:50:41.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.467+0000 7fa563fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-03-09T14:50:41.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.470+0000 7fa695e30800 10 cache put: name=default.rgw.meta+users.keys+GOHLIOKJQWQBPUZVKAKQ info.flags=0x7 2024-03-09T14:50:41.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.470+0000 7fa695e30800 10 moving default.rgw.meta+users.keys+GOHLIOKJQWQBPUZVKAKQ to cache LRU end 2024-03-09T14:50:41.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.470+0000 7fa695e30800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:GOHLIOKJQWQBPUZVKAKQ, ofs0, ns] 2024-03-09T14:50:41.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.470+0000 7fa574ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366325 cookie 94468855483920 notifier 7397 bl.length()=188 2024-03-09T14:50:41.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.470+0000 7fa574ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GOHLIOKJQWQBPUZVKAKQ info.flags=0x7 2024-03-09T14:50:41.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.470+0000 7fa574ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GOHLIOKJQWQBPUZVKAKQ to cache LRU end 2024-03-09T14:50:41.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.473+0000 7fa695e30800 20 linked user root1.client.0 to account RGW88888888888888888 2024-03-09T14:50:41.474 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T14:50:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "user_id": "root1.client.0", 2024-03-09T14:50:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "display_name": "Mr.RGW88888888888888888", 2024-03-09T14:50:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "email": "root1+test@test.test", 2024-03-09T14:50:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "suspended": 0, 2024-03-09T14:50:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:50:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "subusers": [], 2024-03-09T14:50:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "keys": [ 2024-03-09T14:50:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-03-09T14:50:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "user": "root1.client.0", 2024-03-09T14:50:41.474 INFO:teuthology.orchestra.run.smithi088.stdout: "access_key": "GOHLIOKJQWQBPUZVKAKQ", 2024-03-09T14:50:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "secret_key": "4qLY9M/zzztF9prF59z8r9uxhJyP0z2Xhc56JzKhAUfwY6peBbjA7Q==", 2024-03-09T14:50:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "active": true, 2024-03-09T14:50:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:50:41.464383Z" 2024-03-09T14:50:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-03-09T14:50:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T14:50:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "swift_keys": [], 2024-03-09T14:50:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": [], 2024-03-09T14:50:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "op_mask": "read, write, delete", 2024-03-09T14:50:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "default_placement": "", 2024-03-09T14:50:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "default_storage_class": "", 2024-03-09T14:50:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "placement_tags": [], 2024-03-09T14:50:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "bucket_quota": { 2024-03-09T14:50:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:41.475 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "user_quota": { 2024-03-09T14:50:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:41.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "temp_url_keys": [], 2024-03-09T14:50:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "root", 2024-03-09T14:50:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "mfa_ids": [], 2024-03-09T14:50:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "account_id": "RGW88888888888888888", 2024-03-09T14:50:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "path": "/", 2024-03-09T14:50:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:50:41.464370Z", 2024-03-09T14:50:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "tags": [], 2024-03-09T14:50:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: "group_ids": [] 2024-03-09T14:50:41.477 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T14:50:41.477 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:41.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.474+0000 7fa547fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:41.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.476+0000 7fa695e30800 20 remove_watcher() i=0 2024-03-09T14:50:41.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.476+0000 7fa695e30800 2 removed watcher, disabling cache 2024-03-09T14:50:41.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.477+0000 7fa695e30800 20 remove_watcher() i=1 2024-03-09T14:50:41.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.479+0000 7fa695e30800 20 remove_watcher() i=2 2024-03-09T14:50:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.480+0000 7fa695e30800 20 remove_watcher() i=3 2024-03-09T14:50:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.481+0000 7fa695e30800 20 remove_watcher() i=4 2024-03-09T14:50:41.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.482+0000 7fa695e30800 20 remove_watcher() i=5 2024-03-09T14:50:41.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.482+0000 7fa695e30800 20 remove_watcher() i=6 2024-03-09T14:50:41.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.483+0000 7fa695e30800 20 remove_watcher() i=7 2024-03-09T14:50:41.494 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 0368629649 --totp-seed 4II4BUGZXO226BZXCM6P3E6AFXU235E7JZDYZ65OJGGFKFIHP3ENOWYH6ALD3ZJY --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:50:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:41.557 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:41.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.586+0000 7fba3ef3c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.587+0000 7fba3ef3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:41.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.587+0000 7fba3ef3c800 20 realm 2024-03-09T14:50:41.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.587+0000 7fba3ef3c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.588+0000 7fba3ef3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:41.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.588+0000 7fba3ef3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:41.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.588+0000 7fba3ef3c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.588+0000 7fba3ef3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:41.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.588+0000 7fba3ef3c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.589+0000 7fba3ef3c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:41.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.589+0000 7fba3ef3c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:41.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.589+0000 7fba3ef3c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:41.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.589+0000 7fba3ef3c800 20 searching for the correct realm 2024-03-09T14:50:41.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.591+0000 7fba3b4fb640 0 -- 172.21.15.88:0/1900944944 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fba34058040 msgr2=0x7fba3408b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:41.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:41.797+0000 7fba3a4f9640 0 -- 172.21.15.88:0/1900944944 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fba340713e0 msgr2=0x7fba34071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:42.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.003+0000 7fba3ef3c800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:42.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.003+0000 7fba3ef3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:42.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.003+0000 7fba3ef3c800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:42.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.003+0000 7fba3ef3c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:42.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.003+0000 7fba3ef3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:42.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.003+0000 7fba3ef3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:42.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.003+0000 7fba3ef3c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.003+0000 7fba3ef3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.003+0000 7fba3ef3c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.004+0000 7fba3ef3c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:42.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.004+0000 7fba3ef3c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.004+0000 7fba3ef3c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:42.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.004+0000 7fba3ef3c800 20 zone default found 2024-03-09T14:50:42.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.004+0000 7fba3ef3c800 4 Realm: () 2024-03-09T14:50:42.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.004+0000 7fba3ef3c800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:42.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.004+0000 7fba3ef3c800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:42.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.004+0000 7fba3ef3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:42.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.004+0000 7fba3ef3c800 20 zonegroup default 2024-03-09T14:50:42.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.004+0000 7fba3ef3c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.004+0000 7fba3ef3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.004+0000 7fba3ef3c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.005+0000 7fba3ef3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.005+0000 7fba3ef3c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.005+0000 7fba3ef3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.005+0000 7fba3ef3c800 20 started sync module instance, tier type = 2024-03-09T14:50:42.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.005+0000 7fba3ef3c800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:42.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.015+0000 7fba3ef3c800 20 add_watcher() i=0 2024-03-09T14:50:42.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.015+0000 7fba3ef3c800 20 add_watcher() i=1 2024-03-09T14:50:42.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.015+0000 7fba3ef3c800 20 add_watcher() i=2 2024-03-09T14:50:42.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.015+0000 7fba3ef3c800 20 add_watcher() i=3 2024-03-09T14:50:42.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.015+0000 7fba3ef3c800 20 add_watcher() i=4 2024-03-09T14:50:42.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.015+0000 7fba3ef3c800 20 add_watcher() i=5 2024-03-09T14:50:42.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.015+0000 7fba3ef3c800 20 add_watcher() i=6 2024-03-09T14:50:42.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.016+0000 7fba3ef3c800 20 add_watcher() i=7 2024-03-09T14:50:42.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.016+0000 7fba3ef3c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.017+0000 7fb8f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.018+0000 7fba3ef3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.018+0000 7fba3ef3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.018+0000 7fba3ef3c800 5 note: GC not initialized 2024-03-09T14:50:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.018+0000 7fb86bfff640 20 reqs_thread_entry: start 2024-03-09T14:50:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.018+0000 7fba3ef3c800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.018+0000 7fba3ef3c800 20 Filter name: none 2024-03-09T14:50:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.018+0000 7fb869ffb640 20 reqs_thread_entry: start 2024-03-09T14:50:42.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.018+0000 7fba3ef3c800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-03-09T14:50:42.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.018+0000 7fba3ef3c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.019+0000 7fba3ef3c800 20 rados_obj.operate() r=0 bl.length=494 2024-03-09T14:50:42.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.019+0000 7fba3ef3c800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-03-09T14:50:42.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.019+0000 7fba3ef3c800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:50:42.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.019+0000 7fba3ef3c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:42.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.021+0000 7fba3ef3c800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-03-09T14:50:42.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.021+0000 7fba3ef3c800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:50:42.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.021+0000 7fba3ef3c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-03-09T14:50:42.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.021+0000 7fb91e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366265 cookie 94809817992688 notifier 7833 bl.length()=695 2024-03-09T14:50:42.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.021+0000 7fb91e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-03-09T14:50:42.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.021+0000 7fb91e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:50:42.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.024+0000 7fb8f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:42.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.026+0000 7fba3ef3c800 20 remove_watcher() i=0 2024-03-09T14:50:42.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.026+0000 7fba3ef3c800 2 removed watcher, disabling cache 2024-03-09T14:50:42.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.027+0000 7fba3ef3c800 20 remove_watcher() i=1 2024-03-09T14:50:42.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.029+0000 7fba3ef3c800 20 remove_watcher() i=2 2024-03-09T14:50:42.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.030+0000 7fba3ef3c800 20 remove_watcher() i=3 2024-03-09T14:50:42.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.031+0000 7fba3ef3c800 20 remove_watcher() i=4 2024-03-09T14:50:42.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.032+0000 7fba3ef3c800 20 remove_watcher() i=5 2024-03-09T14:50:42.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.033+0000 7fba3ef3c800 20 remove_watcher() i=6 2024-03-09T14:50:42.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.034+0000 7fba3ef3c800 20 remove_watcher() i=7 2024-03-09T14:50:42.045 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name 'Mr. RGW99999999999999999' --email RGW99999999999999999+test@test.test 2024-03-09T14:50:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:42.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.131+0000 7f30dce13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.132+0000 7f30dce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.132+0000 7f30dce13800 20 realm 2024-03-09T14:50:42.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.132+0000 7f30dce13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.132+0000 7f30dce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.132+0000 7f30dce13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:42.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.132+0000 7f30dce13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.133+0000 7f30dce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.133+0000 7f30dce13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.134+0000 7f30dce13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:42.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.134+0000 7f30dce13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.134+0000 7f30dce13800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:42.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.134+0000 7f30dce13800 20 searching for the correct realm 2024-03-09T14:50:42.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.136+0000 7f30db110640 0 -- 172.21.15.88:0/3290830484 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f30d4084430 msgr2=0x7f30d4084850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:42.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.342+0000 7f30da10e640 0 -- 172.21.15.88:0/3290830484 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f30d40503f0 msgr2=0x7f30d4050870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:42.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.548+0000 7f30dce13800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:42.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.548+0000 7f30dce13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:42.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.548+0000 7f30dce13800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.548+0000 7f30dce13800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.548+0000 7f30dce13800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.548+0000 7f30dce13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.548+0000 7f30dce13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.548+0000 7f30dce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.548+0000 7f30dce13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.549+0000 7f30dce13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.549+0000 7f30dce13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.549+0000 7f30dce13800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:42.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.549+0000 7f30dce13800 20 zone default found 2024-03-09T14:50:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.549+0000 7f30dce13800 4 Realm: () 2024-03-09T14:50:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.549+0000 7f30dce13800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.549+0000 7f30dce13800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.549+0000 7f30dce13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.549+0000 7f30dce13800 20 zonegroup default 2024-03-09T14:50:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.549+0000 7f30dce13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.549+0000 7f30dce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.549+0000 7f30dce13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.550+0000 7f30dce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.550+0000 7f30dce13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.550+0000 7f30dce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.550+0000 7f30dce13800 20 started sync module instance, tier type = 2024-03-09T14:50:42.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.550+0000 7f30dce13800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.560+0000 7f30dce13800 20 add_watcher() i=0 2024-03-09T14:50:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.560+0000 7f30dce13800 20 add_watcher() i=1 2024-03-09T14:50:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.560+0000 7f30dce13800 20 add_watcher() i=2 2024-03-09T14:50:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.560+0000 7f30dce13800 20 add_watcher() i=3 2024-03-09T14:50:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.560+0000 7f30dce13800 20 add_watcher() i=4 2024-03-09T14:50:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.560+0000 7f30dce13800 20 add_watcher() i=5 2024-03-09T14:50:42.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.560+0000 7f30dce13800 20 add_watcher() i=6 2024-03-09T14:50:42.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.561+0000 7f30dce13800 20 add_watcher() i=7 2024-03-09T14:50:42.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.561+0000 7f30dce13800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.563+0000 7f2f917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.563+0000 7f30dce13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.563+0000 7f30dce13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.563+0000 7f30dce13800 5 note: GC not initialized 2024-03-09T14:50:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.563+0000 7f2f0bfff640 20 reqs_thread_entry: start 2024-03-09T14:50:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.563+0000 7f30dce13800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.563+0000 7f30dce13800 20 Filter name: none 2024-03-09T14:50:42.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.563+0000 7f2f09ffb640 20 reqs_thread_entry: start 2024-03-09T14:50:42.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.563+0000 7f30dce13800 10 cache get: name=default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 : miss 2024-03-09T14:50:42.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.563+0000 7f30dce13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.564+0000 7f30dce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.564+0000 7f30dce13800 10 cache put: name=default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 info.flags=0x0 2024-03-09T14:50:42.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.564+0000 7f30dce13800 10 adding default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 to cache LRU end 2024-03-09T14:50:42.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.564+0000 7f30dce13800 20 failed to read name.$Mr. RGW99999999999999999 with: (2) No such file or directory 2024-03-09T14:50:42.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.564+0000 7f30dce13800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-03-09T14:50:42.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.564+0000 7f30dce13800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.564+0000 7f30dce13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.564+0000 7f30dce13800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-03-09T14:50:42.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.564+0000 7f30dce13800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-03-09T14:50:42.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.564+0000 7f30dce13800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-03-09T14:50:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.566+0000 7f30dce13800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-03-09T14:50:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.566+0000 7f30dce13800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-03-09T14:50:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.566+0000 7f30dce13800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-03-09T14:50:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.567+0000 7f2fbe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366266 cookie 94387922978464 notifier 7854 bl.length()=353 2024-03-09T14:50:42.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.567+0000 7f2fbe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-03-09T14:50:42.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.567+0000 7f2fbe7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-03-09T14:50:42.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.570+0000 7f30dce13800 10 cache put: name=default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 info.flags=0x17 2024-03-09T14:50:42.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.570+0000 7f30dce13800 10 moving default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 to cache LRU end 2024-03-09T14:50:42.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.570+0000 7f30dce13800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr. RGW99999999999999999, ofs0, ns] 2024-03-09T14:50:42.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.571+0000 7f2fbe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366375 cookie 94387922992752 notifier 7854 bl.length()=226 2024-03-09T14:50:42.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.571+0000 7f2fbe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 info.flags=0x17 2024-03-09T14:50:42.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.571+0000 7f2fbe7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 to cache LRU end 2024-03-09T14:50:42.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.574+0000 7f30dce13800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-03-09T14:50:42.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.574+0000 7f30dce13800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-03-09T14:50:42.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.574+0000 7f30dce13800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-03-09T14:50:42.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.574+0000 7f2fbe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366258 cookie 94387922990512 notifier 7854 bl.length()=234 2024-03-09T14:50:42.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.574+0000 7f2fbe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-03-09T14:50:42.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.574+0000 7f2fbe7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-03-09T14:50:42.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.576+0000 7f2f917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:42.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.578+0000 7f30dce13800 20 remove_watcher() i=0 2024-03-09T14:50:42.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.578+0000 7f30dce13800 2 removed watcher, disabling cache 2024-03-09T14:50:42.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.580+0000 7f30dce13800 20 remove_watcher() i=1 2024-03-09T14:50:42.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.581+0000 7f30dce13800 20 remove_watcher() i=2 2024-03-09T14:50:42.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.582+0000 7f30dce13800 20 remove_watcher() i=3 2024-03-09T14:50:42.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.583+0000 7f30dce13800 20 remove_watcher() i=4 2024-03-09T14:50:42.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.584+0000 7f30dce13800 20 remove_watcher() i=5 2024-03-09T14:50:42.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.585+0000 7f30dce13800 20 remove_watcher() i=6 2024-03-09T14:50:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.586+0000 7f30dce13800 20 remove_watcher() i=7 2024-03-09T14:50:42.595 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T14:50:42.595 INFO:teuthology.orchestra.run.smithi088.stdout: "id": "RGW99999999999999999", 2024-03-09T14:50:42.595 INFO:teuthology.orchestra.run.smithi088.stdout: "tenant": "", 2024-03-09T14:50:42.595 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "Mr. RGW99999999999999999", 2024-03-09T14:50:42.595 INFO:teuthology.orchestra.run.smithi088.stdout: "email": "RGW99999999999999999+test@test.test", 2024-03-09T14:50:42.595 INFO:teuthology.orchestra.run.smithi088.stdout: "quota": { 2024-03-09T14:50:42.595 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:42.595 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:42.595 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:42.596 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:42.596 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:42.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:42.596 INFO:teuthology.orchestra.run.smithi088.stdout: "max_users": 1000, 2024-03-09T14:50:42.596 INFO:teuthology.orchestra.run.smithi088.stdout: "max_roles": 1000, 2024-03-09T14:50:42.596 INFO:teuthology.orchestra.run.smithi088.stdout: "max_groups": 1000, 2024-03-09T14:50:42.596 INFO:teuthology.orchestra.run.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:50:42.596 INFO:teuthology.orchestra.run.smithi088.stdout: "max_access_keys": 4 2024-03-09T14:50:42.596 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T14:50:42.597 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-03-09T14:50:42.598 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key NLMRCEMYNIMINJYWXTUM --secret 6gNeuCM7QFc04fUYVYS1ShuATm+b6+5crinerO9MdeVBYQEmShQeNQ== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-03-09T14:50:42.664 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:42.664 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:42.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.693+0000 7fa79e10f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.694+0000 7fa79e10f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.694+0000 7fa79e10f800 20 realm 2024-03-09T14:50:42.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.694+0000 7fa79e10f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.695+0000 7fa79e10f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.695+0000 7fa79e10f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:42.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.695+0000 7fa79e10f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.695+0000 7fa79e10f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:42.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.695+0000 7fa79e10f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.696+0000 7fa79e10f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:42.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.696+0000 7fa79e10f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:42.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.696+0000 7fa79e10f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:42.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.696+0000 7fa79e10f800 20 searching for the correct realm 2024-03-09T14:50:42.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.698+0000 7fa79c40c640 0 -- 172.21.15.88:0/895913048 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7fa794025030 msgr2=0x7fa79405d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:42.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:42.904+0000 7fa79340a640 0 -- 172.21.15.88:0/895913048 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fa79406f040 msgr2=0x7fa7940257b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:43.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.111+0000 7fa79e10f800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:43.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.111+0000 7fa79e10f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:43.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.111+0000 7fa79e10f800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:43.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.111+0000 7fa79e10f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:43.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.111+0000 7fa79e10f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:43.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.111+0000 7fa79e10f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:43.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.111+0000 7fa79e10f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.111+0000 7fa79e10f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:43.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.111+0000 7fa79e10f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.111+0000 7fa79e10f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:43.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.111+0000 7fa79e10f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.112+0000 7fa79e10f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.112+0000 7fa79e10f800 20 zone default found 2024-03-09T14:50:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.112+0000 7fa79e10f800 4 Realm: () 2024-03-09T14:50:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.112+0000 7fa79e10f800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.112+0000 7fa79e10f800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.112+0000 7fa79e10f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.112+0000 7fa79e10f800 20 zonegroup default 2024-03-09T14:50:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.112+0000 7fa79e10f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.112+0000 7fa79e10f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.112+0000 7fa79e10f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.112+0000 7fa79e10f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.112+0000 7fa79e10f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.113+0000 7fa79e10f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:43.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.113+0000 7fa79e10f800 20 started sync module instance, tier type = 2024-03-09T14:50:43.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.113+0000 7fa79e10f800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:43.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.123+0000 7fa79e10f800 20 add_watcher() i=0 2024-03-09T14:50:43.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.123+0000 7fa79e10f800 20 add_watcher() i=1 2024-03-09T14:50:43.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.123+0000 7fa79e10f800 20 add_watcher() i=2 2024-03-09T14:50:43.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.123+0000 7fa79e10f800 20 add_watcher() i=3 2024-03-09T14:50:43.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.123+0000 7fa79e10f800 20 add_watcher() i=4 2024-03-09T14:50:43.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.123+0000 7fa79e10f800 20 add_watcher() i=5 2024-03-09T14:50:43.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.123+0000 7fa79e10f800 20 add_watcher() i=6 2024-03-09T14:50:43.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.124+0000 7fa79e10f800 20 add_watcher() i=7 2024-03-09T14:50:43.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.124+0000 7fa79e10f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:43.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.125+0000 7fa651fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:43.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.125+0000 7fa79e10f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:43.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.125+0000 7fa79e10f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:43.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.126+0000 7fa79e10f800 5 note: GC not initialized 2024-03-09T14:50:43.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.126+0000 7fa650fe1640 20 reqs_thread_entry: start 2024-03-09T14:50:43.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.126+0000 7fa79e10f800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:43.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.126+0000 7fa79e10f800 20 Filter name: none 2024-03-09T14:50:43.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.126+0000 7fa5ca7fc640 20 reqs_thread_entry: start 2024-03-09T14:50:43.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.126+0000 7fa79e10f800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-03-09T14:50:43.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.126+0000 7fa79e10f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.126+0000 7fa79e10f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:43.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.126+0000 7fa79e10f800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-03-09T14:50:43.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.126+0000 7fa79e10f800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:50:43.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.126+0000 7fa79e10f800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-03-09T14:50:43.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.126+0000 7fa79e10f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.127+0000 7fa79e10f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:43.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.127+0000 7fa79e10f800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-03-09T14:50:43.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.127+0000 7fa79e10f800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-03-09T14:50:43.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.127+0000 7fa79e10f800 10 cache get: name=default.rgw.meta+users.keys+NLMRCEMYNIMINJYWXTUM : miss 2024-03-09T14:50:43.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.127+0000 7fa79e10f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.127+0000 7fa79e10f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:43.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.127+0000 7fa79e10f800 10 cache put: name=default.rgw.meta+users.keys+NLMRCEMYNIMINJYWXTUM info.flags=0x0 2024-03-09T14:50:43.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.127+0000 7fa79e10f800 10 adding default.rgw.meta+users.keys+NLMRCEMYNIMINJYWXTUM to cache LRU end 2024-03-09T14:50:43.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.127+0000 7fa79e10f800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-03-09T14:50:43.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.127+0000 7fa79e10f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.128+0000 7fa79e10f800 20 rados_obj.operate() r=0 bl.length=153 2024-03-09T14:50:43.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.128+0000 7fa79e10f800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-03-09T14:50:43.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.128+0000 7fa79e10f800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-03-09T14:50:43.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.128+0000 7fa79e10f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:43.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.128+0000 7fa79e10f800 10 cache get: name=default.rgw.meta+users.keys+NLMRCEMYNIMINJYWXTUM : hit (negative entry) 2024-03-09T14:50:43.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.128+0000 7fa79e10f800 10 cache get: name=default.rgw.meta+users.keys+NLMRCEMYNIMINJYWXTUM : hit (negative entry) 2024-03-09T14:50:43.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.129+0000 7fa79e10f800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-03-09T14:50:43.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.129+0000 7fa79e10f800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:50:43.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.129+0000 7fa79e10f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-03-09T14:50:43.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.130+0000 7fa67affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366267 cookie 94131051352192 notifier 7445 bl.length()=681 2024-03-09T14:50:43.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.130+0000 7fa67affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-03-09T14:50:43.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.130+0000 7fa67affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:50:43.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.133+0000 7fa79e10f800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-03-09T14:50:43.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.133+0000 7fa79e10f800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-03-09T14:50:43.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.133+0000 7fa79e10f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-03-09T14:50:43.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.133+0000 7fa67affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366326 cookie 94131051370320 notifier 7445 bl.length()=189 2024-03-09T14:50:43.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.133+0000 7fa67affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-03-09T14:50:43.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.133+0000 7fa67affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-03-09T14:50:43.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.135+0000 7fa79e10f800 10 cache put: name=default.rgw.meta+users.keys+NLMRCEMYNIMINJYWXTUM info.flags=0x7 2024-03-09T14:50:43.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.135+0000 7fa79e10f800 10 moving default.rgw.meta+users.keys+NLMRCEMYNIMINJYWXTUM to cache LRU end 2024-03-09T14:50:43.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.135+0000 7fa79e10f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:NLMRCEMYNIMINJYWXTUM, ofs0, ns] 2024-03-09T14:50:43.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.136+0000 7fa67affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366376 cookie 94131051368784 notifier 7445 bl.length()=188 2024-03-09T14:50:43.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.136+0000 7fa67affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NLMRCEMYNIMINJYWXTUM info.flags=0x7 2024-03-09T14:50:43.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.136+0000 7fa67affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NLMRCEMYNIMINJYWXTUM to cache LRU end 2024-03-09T14:50:43.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.138+0000 7fa79e10f800 20 linked user root2.client.0 to account RGW99999999999999999 2024-03-09T14:50:43.140 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T14:50:43.140 INFO:teuthology.orchestra.run.smithi088.stdout: "user_id": "root2.client.0", 2024-03-09T14:50:43.140 INFO:teuthology.orchestra.run.smithi088.stdout: "display_name": "Mr.RGW99999999999999999", 2024-03-09T14:50:43.140 INFO:teuthology.orchestra.run.smithi088.stdout: "email": "root2+test@test.test", 2024-03-09T14:50:43.141 INFO:teuthology.orchestra.run.smithi088.stdout: "suspended": 0, 2024-03-09T14:50:43.141 INFO:teuthology.orchestra.run.smithi088.stdout: "max_buckets": 1000, 2024-03-09T14:50:43.141 INFO:teuthology.orchestra.run.smithi088.stdout: "subusers": [], 2024-03-09T14:50:43.141 INFO:teuthology.orchestra.run.smithi088.stdout: "keys": [ 2024-03-09T14:50:43.141 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-03-09T14:50:43.141 INFO:teuthology.orchestra.run.smithi088.stdout: "user": "root2.client.0", 2024-03-09T14:50:43.142 INFO:teuthology.orchestra.run.smithi088.stdout: "access_key": "NLMRCEMYNIMINJYWXTUM", 2024-03-09T14:50:43.142 INFO:teuthology.orchestra.run.smithi088.stdout: "secret_key": "6gNeuCM7QFc04fUYVYS1ShuATm+b6+5crinerO9MdeVBYQEmShQeNQ==", 2024-03-09T14:50:43.142 INFO:teuthology.orchestra.run.smithi088.stdout: "active": true, 2024-03-09T14:50:43.142 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:50:43.129510Z" 2024-03-09T14:50:43.142 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-03-09T14:50:43.142 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T14:50:43.142 INFO:teuthology.orchestra.run.smithi088.stdout: "swift_keys": [], 2024-03-09T14:50:43.142 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": [], 2024-03-09T14:50:43.143 INFO:teuthology.orchestra.run.smithi088.stdout: "op_mask": "read, write, delete", 2024-03-09T14:50:43.143 INFO:teuthology.orchestra.run.smithi088.stdout: "default_placement": "", 2024-03-09T14:50:43.143 INFO:teuthology.orchestra.run.smithi088.stdout: "default_storage_class": "", 2024-03-09T14:50:43.143 INFO:teuthology.orchestra.run.smithi088.stdout: "placement_tags": [], 2024-03-09T14:50:43.143 INFO:teuthology.orchestra.run.smithi088.stdout: "bucket_quota": { 2024-03-09T14:50:43.143 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:43.143 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:43.143 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:43.144 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:43.144 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:43.144 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:43.144 INFO:teuthology.orchestra.run.smithi088.stdout: "user_quota": { 2024-03-09T14:50:43.144 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-03-09T14:50:43.144 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-03-09T14:50:43.144 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-03-09T14:50:43.144 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-03-09T14:50:43.144 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-03-09T14:50:43.144 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-03-09T14:50:43.145 INFO:teuthology.orchestra.run.smithi088.stdout: "temp_url_keys": [], 2024-03-09T14:50:43.145 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "root", 2024-03-09T14:50:43.145 INFO:teuthology.orchestra.run.smithi088.stdout: "mfa_ids": [], 2024-03-09T14:50:43.145 INFO:teuthology.orchestra.run.smithi088.stdout: "account_id": "RGW99999999999999999", 2024-03-09T14:50:43.145 INFO:teuthology.orchestra.run.smithi088.stdout: "path": "/", 2024-03-09T14:50:43.145 INFO:teuthology.orchestra.run.smithi088.stdout: "create_date": "2024-03-09T14:50:43.129498Z", 2024-03-09T14:50:43.145 INFO:teuthology.orchestra.run.smithi088.stdout: "tags": [], 2024-03-09T14:50:43.145 INFO:teuthology.orchestra.run.smithi088.stdout: "group_ids": [] 2024-03-09T14:50:43.145 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T14:50:43.146 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:50:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.139+0000 7fa651fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.142+0000 7fa79e10f800 20 remove_watcher() i=0 2024-03-09T14:50:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.142+0000 7fa79e10f800 2 removed watcher, disabling cache 2024-03-09T14:50:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.143+0000 7fa79e10f800 20 remove_watcher() i=1 2024-03-09T14:50:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.144+0000 7fa79e10f800 20 remove_watcher() i=2 2024-03-09T14:50:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.145+0000 7fa79e10f800 20 remove_watcher() i=3 2024-03-09T14:50:43.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.146+0000 7fa79e10f800 20 remove_watcher() i=4 2024-03-09T14:50:43.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.147+0000 7fa79e10f800 20 remove_watcher() i=5 2024-03-09T14:50:43.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.148+0000 7fa79e10f800 20 remove_watcher() i=6 2024-03-09T14:50:43.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.149+0000 7fa79e10f800 20 remove_watcher() i=7 2024-03-09T14:50:43.160 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 0221686437 --totp-seed JZV52VPOJC7QUGIUQDFOCGDMGOBOQTUK5SPAXDPSOLVTUIZU3OJLT4YOPRE55WBF --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:50:43.223 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:43.223 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:43.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.253+0000 7f8a20616800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.254+0000 7f8a20616800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:43.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.254+0000 7f8a20616800 20 realm 2024-03-09T14:50:43.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.254+0000 7f8a20616800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.254+0000 7f8a20616800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:43.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.254+0000 7f8a20616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:43.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.254+0000 7f8a20616800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.254+0000 7f8a20616800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:43.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.254+0000 7f8a20616800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.255+0000 7f8a20616800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:43.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.255+0000 7f8a20616800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.256+0000 7f8a20616800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:43.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.256+0000 7f8a20616800 20 searching for the correct realm 2024-03-09T14:50:43.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.258+0000 7f8a1c482640 0 -- 172.21.15.88:0/1204678264 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7f8a14034bf0 msgr2=0x7f8a1405beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:50:43.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.464+0000 7f8a1b480640 0 -- 172.21.15.88:0/1204678264 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7f8a140890b0 msgr2=0x7f8a140213e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.671+0000 7f8a20616800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T14:50:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.671+0000 7f8a20616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.671+0000 7f8a20616800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T14:50:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.671+0000 7f8a20616800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.671+0000 7f8a20616800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.671+0000 7f8a20616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.671+0000 7f8a20616800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.671+0000 7f8a20616800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.671+0000 7f8a20616800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.671+0000 7f8a20616800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.671+0000 7f8a20616800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.672+0000 7f8a20616800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:43.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.672+0000 7f8a20616800 20 zone default found 2024-03-09T14:50:43.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.672+0000 7f8a20616800 4 Realm: () 2024-03-09T14:50:43.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.672+0000 7f8a20616800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T14:50:43.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.672+0000 7f8a20616800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T14:50:43.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.672+0000 7f8a20616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:43.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.672+0000 7f8a20616800 20 zonegroup default 2024-03-09T14:50:43.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.672+0000 7f8a20616800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.672+0000 7f8a20616800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:43.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.672+0000 7f8a20616800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.672+0000 7f8a20616800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:43.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.672+0000 7f8a20616800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.673+0000 7f8a20616800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:43.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.673+0000 7f8a20616800 20 started sync module instance, tier type = 2024-03-09T14:50:43.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.673+0000 7f8a20616800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T14:50:43.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.682+0000 7f8a20616800 20 add_watcher() i=0 2024-03-09T14:50:43.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.682+0000 7f8a20616800 20 add_watcher() i=1 2024-03-09T14:50:43.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.682+0000 7f8a20616800 20 add_watcher() i=2 2024-03-09T14:50:43.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.682+0000 7f8a20616800 20 add_watcher() i=3 2024-03-09T14:50:43.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.682+0000 7f8a20616800 20 add_watcher() i=4 2024-03-09T14:50:43.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.682+0000 7f8a20616800 20 add_watcher() i=5 2024-03-09T14:50:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.682+0000 7f8a20616800 20 add_watcher() i=6 2024-03-09T14:50:43.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.683+0000 7f8a20616800 20 add_watcher() i=7 2024-03-09T14:50:43.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.683+0000 7f8a20616800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:43.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.685+0000 7f88d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:43.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.685+0000 7f8a20616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:43.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.685+0000 7f8a20616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:43.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.685+0000 7f8a20616800 5 note: GC not initialized 2024-03-09T14:50:43.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.686+0000 7f88d0fe1640 20 reqs_thread_entry: start 2024-03-09T14:50:43.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.686+0000 7f8a20616800 20 init_complete bucket index max shards: 11 2024-03-09T14:50:43.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.686+0000 7f8a20616800 20 Filter name: none 2024-03-09T14:50:43.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.686+0000 7f884a7fc640 20 reqs_thread_entry: start 2024-03-09T14:50:43.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.686+0000 7f8a20616800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-03-09T14:50:43.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.686+0000 7f8a20616800 20 rados->read ofs=0 len=0 2024-03-09T14:50:43.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.686+0000 7f8a20616800 20 rados_obj.operate() r=0 bl.length=494 2024-03-09T14:50:43.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.686+0000 7f8a20616800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-03-09T14:50:43.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.686+0000 7f8a20616800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:50:43.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.686+0000 7f8a20616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:43.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.690+0000 7f8a20616800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-03-09T14:50:43.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.690+0000 7f8a20616800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:50:43.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.690+0000 7f8a20616800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-03-09T14:50:43.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.690+0000 7f88faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366268 cookie 94324350508336 notifier 7460 bl.length()=695 2024-03-09T14:50:43.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.690+0000 7f88faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-03-09T14:50:43.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.690+0000 7f88faffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:50:43.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.693+0000 7f88d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:43.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.695+0000 7f8a20616800 20 remove_watcher() i=0 2024-03-09T14:50:43.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.695+0000 7f8a20616800 2 removed watcher, disabling cache 2024-03-09T14:50:43.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.696+0000 7f8a20616800 20 remove_watcher() i=1 2024-03-09T14:50:43.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.697+0000 7f8a20616800 20 remove_watcher() i=2 2024-03-09T14:50:43.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.699+0000 7f8a20616800 20 remove_watcher() i=3 2024-03-09T14:50:43.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.700+0000 7f8a20616800 20 remove_watcher() i=4 2024-03-09T14:50:43.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.701+0000 7f8a20616800 20 remove_watcher() i=5 2024-03-09T14:50:43.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.702+0000 7f8a20616800 20 remove_watcher() i=6 2024-03-09T14:50:43.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T14:50:43.703+0000 7f8a20616800 20 remove_watcher() i=7 2024-03-09T14:50:43.714 INFO:tasks.s3tests:Configuring s3-tests... 2024-03-09T14:50:43.715 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:50:43.715 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-03-09T14:50:43.743 INFO:tasks.s3tests:Configuring boto... 2024-03-09T14:50:43.743 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-03-09T14:50:43.743 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-03-09T14:50:43.810 DEBUG:teuthology.orchestra.run.smithi088:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-03-09T14:50:43.976 INFO:teuthology.orchestra.run.smithi088.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-03-09T14:50:44.157 INFO:teuthology.orchestra.run.smithi088.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-03-09T14:50:44.391 INFO:teuthology.orchestra.run.smithi088.stdout:py installdeps: -rrequirements.txt 2024-03-09T14:52:12.355 INFO:teuthology.orchestra.run.smithi088.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-03-09T14:52:14.003 INFO:teuthology.orchestra.run.smithi088.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.3.3,certifi==2024.2.2,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.0,filelock==3.13.1,gevent==24.2.1,greenlet==3.0.3,httplib2==0.22.0,idna==3.6,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.1.0,munch==4.0.0,packaging==23.2,platformdirs==4.2.0,pluggy==1.4.0,pyparsing==3.1.2,pyproject-api==1.6.1,pytest==8.1.1,python-dateutil==2.9.0.post0,pytz==2024.1,PyYAML==6.0.1,requests==2.31.0,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=17e40cf731baa8e6ce17f403a157131ac3ec1f1f8021b7a3ab1d447a89efb80d,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.14.1,urllib3==1.26.18,virtualenv==20.25.1,zope.event==5.0,zope.interface==6.2 2024-03-09T14:52:14.003 INFO:teuthology.orchestra.run.smithi088.stdout:py run-test-pre: PYTHONHASHSEED='77539744' 2024-03-09T14:52:14.003 INFO:teuthology.orchestra.run.smithi088.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-03-09T14:52:14.147 INFO:teuthology.orchestra.run.smithi088.stdout:============================= test session starts ============================== 2024-03-09T14:52:14.147 INFO:teuthology.orchestra.run.smithi088.stdout:platform linux -- Python 3.9.17, pytest-8.1.1, pluggy-1.4.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-03-09T14:52:14.147 INFO:teuthology.orchestra.run.smithi088.stdout:cachedir: .tox/py/.pytest_cache 2024-03-09T14:52:14.147 INFO:teuthology.orchestra.run.smithi088.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-03-09T14:52:14.148 INFO:teuthology.orchestra.run.smithi088.stdout:configfile: pytest.ini 2024-03-09T14:52:15.899 INFO:teuthology.orchestra.run.smithi088.stdout:collecting ... collected 850 items / 124 deselected / 726 selected 2024-03-09T14:52:15.900 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T14:52:16.347 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none FAILED [ 0%] 2024-03-09T14:52:16.733 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty FAILED [ 0%] 2024-03-09T14:52:17.095 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-03-09T14:52:17.459 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-03-09T14:52:17.856 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none FAILED [ 0%] 2024-03-09T14:52:18.148 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-03-09T14:52:18.571 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-03-09T14:52:18.867 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-03-09T14:52:19.164 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty FAILED [ 1%] 2024-03-09T14:52:19.462 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none FAILED [ 1%] 2024-03-09T14:52:19.831 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 FAILED [ 1%] 2024-03-09T14:52:20.207 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 FAILED [ 1%] 2024-03-09T14:52:20.582 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 FAILED [ 1%] 2024-03-09T14:52:20.960 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 FAILED [ 1%] 2024-03-09T14:52:21.256 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 FAILED [ 2%] 2024-03-09T14:52:21.561 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 FAILED [ 2%] 2024-03-09T14:52:21.638 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-03-09T14:52:21.712 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-03-09T14:52:21.788 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-03-09T14:52:21.863 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-03-09T14:52:21.939 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-03-09T14:52:22.015 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 3%] 2024-03-09T14:52:22.089 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-03-09T14:52:22.164 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-03-09T14:52:22.240 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-03-09T14:52:22.316 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-03-09T14:52:22.392 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-03-09T14:52:22.470 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-03-09T14:52:22.546 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-03-09T14:52:22.621 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-03-09T14:52:22.697 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-03-09T14:52:22.773 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-03-09T14:52:22.849 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-03-09T14:52:22.926 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-03-09T14:52:22.999 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-03-09T14:52:23.075 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-03-09T14:52:23.152 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 5%] 2024-03-09T14:52:23.230 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-03-09T14:52:23.306 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-03-09T14:52:23.382 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-03-09T14:52:23.458 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-03-09T14:52:23.534 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-03-09T14:52:23.609 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-03-09T14:52:23.686 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 6%] 2024-03-09T14:52:23.762 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-03-09T14:52:23.838 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-03-09T14:52:23.912 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-03-09T14:52:23.988 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-03-09T14:52:24.065 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-03-09T14:52:24.140 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-03-09T14:52:24.216 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 7%] 2024-03-09T14:52:24.293 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 7%] 2024-03-09T14:52:24.369 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-03-09T14:52:24.933 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-03-09T14:52:28.066 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-03-09T14:52:32.043 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-03-09T14:52:36.460 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-03-09T14:52:42.608 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-03-09T14:52:44.371 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 8%] 2024-03-09T14:52:46.874 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-03-09T14:52:47.583 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-03-09T14:52:47.859 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-03-09T14:52:48.344 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-03-09T14:52:48.854 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-03-09T14:52:49.655 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-03-09T14:52:50.142 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 9%] 2024-03-09T14:52:50.493 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 9%] 2024-03-09T14:52:50.493 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-03-09T14:52:50.494 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-03-09T14:52:50.495 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-03-09T14:52:50.497 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-03-09T14:52:50.498 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-03-09T14:52:50.499 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 10%] 2024-03-09T14:52:50.500 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-03-09T14:52:50.501 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-03-09T14:52:50.502 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-03-09T14:52:50.503 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-03-09T14:52:50.504 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-03-09T14:52:50.505 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-03-09T14:52:50.506 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 11%] 2024-03-09T14:52:50.507 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 11%] 2024-03-09T14:52:50.508 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 11%] 2024-03-09T14:52:50.509 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-03-09T14:52:50.510 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-03-09T14:52:50.511 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-03-09T14:52:50.512 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-03-09T14:52:50.513 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-03-09T14:52:50.515 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 12%] 2024-03-09T14:52:50.516 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 12%] 2024-03-09T14:52:50.517 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-03-09T14:52:50.518 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-03-09T14:52:50.519 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-03-09T14:52:50.520 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-03-09T14:52:50.521 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-03-09T14:52:50.616 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 13%] 2024-03-09T14:52:50.626 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 13%] 2024-03-09T14:52:51.482 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-03-09T14:52:58.262 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-03-09T14:52:58.846 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-03-09T14:52:59.525 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-03-09T14:53:00.172 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-03-09T14:53:00.814 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 14%] 2024-03-09T14:53:01.472 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 14%] 2024-03-09T14:53:02.034 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 14%] 2024-03-09T14:53:02.680 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-03-09T14:53:03.291 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-03-09T14:53:03.942 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-03-09T14:53:04.490 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-03-09T14:53:05.013 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 15%] 2024-03-09T14:53:05.529 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 15%] 2024-03-09T14:53:05.817 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 15%] 2024-03-09T14:53:06.384 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-03-09T14:53:07.066 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-03-09T14:53:07.699 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-03-09T14:53:08.237 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-03-09T14:53:08.768 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-03-09T14:53:09.302 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-03-09T14:53:09.873 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-03-09T14:53:10.413 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 16%] 2024-03-09T14:53:10.922 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-03-09T14:53:11.436 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-03-09T14:53:11.729 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-03-09T14:53:12.036 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-03-09T14:53:12.334 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 17%] 2024-03-09T14:53:12.661 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 17%] 2024-03-09T14:53:12.954 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 17%] 2024-03-09T14:53:13.412 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-03-09T14:53:13.721 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-03-09T14:53:14.054 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-03-09T14:53:14.541 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-03-09T14:53:15.040 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 18%] 2024-03-09T14:53:15.343 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 18%] 2024-03-09T14:53:15.807 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 18%] 2024-03-09T14:53:16.274 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 18%] 2024-03-09T14:53:16.900 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-03-09T14:53:17.315 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-03-09T14:53:17.780 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-03-09T14:53:18.278 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 19%] 2024-03-09T14:53:19.070 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 19%] 2024-03-09T14:53:19.738 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:53:20.363 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:53:21.069 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:53:21.967 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:53:23.233 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:53:24.604 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:53:25.441 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 20%] 2024-03-09T14:53:26.288 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 20%] 2024-03-09T14:53:27.019 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 20%] 2024-03-09T14:53:27.850 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 20%] 2024-03-09T14:53:28.355 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-03-09T14:53:29.730 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-03-09T14:53:30.612 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-03-09T14:53:31.692 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 21%] 2024-03-09T14:53:33.985 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 21%] 2024-03-09T14:53:36.968 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 21%] 2024-03-09T14:53:38.606 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 21%] 2024-03-09T14:53:40.118 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-03-09T14:53:41.228 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-03-09T14:53:41.997 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-03-09T14:53:43.342 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 22%] 2024-03-09T14:53:44.269 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 22%] 2024-03-09T14:53:45.548 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 22%] 2024-03-09T14:53:46.413 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 22%] 2024-03-09T14:53:48.083 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 22%] 2024-03-09T14:53:49.387 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-03-09T14:53:51.216 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-03-09T14:53:53.037 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 23%] 2024-03-09T14:53:54.264 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 23%] 2024-03-09T14:53:55.403 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 23%] 2024-03-09T14:53:56.296 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 23%] 2024-03-09T14:53:58.565 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 23%] 2024-03-09T14:54:00.158 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-03-09T14:54:02.027 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-03-09T14:54:03.825 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-03-09T14:54:05.451 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 24%] 2024-03-09T14:54:07.139 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 24%] 2024-03-09T14:54:08.487 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 24%] 2024-03-09T14:54:09.422 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 24%] 2024-03-09T14:54:10.485 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 24%] 2024-03-09T14:54:12.497 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-03-09T14:54:15.149 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-03-09T14:54:16.272 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 25%] 2024-03-09T14:54:17.971 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 25%] 2024-03-09T14:54:19.656 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 25%] 2024-03-09T14:54:21.203 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 25%] 2024-03-09T14:54:22.802 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 25%] 2024-03-09T14:54:24.499 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-03-09T14:54:26.058 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-03-09T14:54:27.585 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 26%] 2024-03-09T14:54:28.666 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 26%] 2024-03-09T14:54:30.193 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-03-09T14:54:31.742 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-03-09T14:54:33.300 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-03-09T14:54:34.768 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-03-09T14:54:36.325 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-03-09T14:54:37.796 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-03-09T14:54:39.279 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 27%] 2024-03-09T14:54:40.818 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 27%] 2024-03-09T14:54:42.340 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-03-09T14:54:43.884 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-03-09T14:54:45.365 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-03-09T14:54:46.902 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-03-09T14:54:47.927 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-03-09T14:54:48.901 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 28%] 2024-03-09T14:54:49.816 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 28%] 2024-03-09T14:54:50.733 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-03-09T14:54:51.336 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-03-09T14:54:52.312 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-03-09T14:54:53.083 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-03-09T14:54:53.863 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-03-09T14:54:54.664 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 29%] 2024-03-09T14:54:55.404 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 29%] 2024-03-09T14:54:56.184 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 29%] 2024-03-09T14:54:56.924 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-03-09T14:54:57.682 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-03-09T14:54:58.749 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-03-09T14:54:59.820 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-03-09T14:55:00.464 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 30%] 2024-03-09T14:55:01.110 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 30%] 2024-03-09T14:55:01.851 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 30%] 2024-03-09T14:55:02.639 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-03-09T14:55:03.662 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-03-09T14:55:04.708 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-03-09T14:55:05.443 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-03-09T14:55:06.192 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-03-09T14:55:06.979 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 31%] 2024-03-09T14:55:07.737 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 31%] 2024-03-09T14:55:08.469 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 31%] 2024-03-09T14:55:09.210 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-03-09T14:55:09.948 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-03-09T14:55:10.729 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-03-09T14:55:11.475 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-03-09T14:55:12.219 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 32%] 2024-03-09T14:55:12.969 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 32%] 2024-03-09T14:55:13.715 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 32%] 2024-03-09T14:55:14.471 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-03-09T14:55:15.184 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-03-09T14:55:15.902 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-03-09T14:55:16.652 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-03-09T14:55:17.410 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 33%] 2024-03-09T14:55:59.494 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 33%] 2024-03-09T14:56:00.198 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 33%] 2024-03-09T14:56:00.946 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 33%] 2024-03-09T14:56:01.654 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-03-09T14:56:02.365 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-03-09T14:56:03.071 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-03-09T14:56:03.785 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 34%] 2024-03-09T14:56:04.527 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 34%] 2024-03-09T14:56:05.242 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 34%] 2024-03-09T14:56:05.949 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 34%] 2024-03-09T14:56:06.654 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-03-09T14:56:07.365 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-03-09T14:56:08.115 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-03-09T14:56:08.856 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-03-09T14:56:09.609 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 35%] 2024-03-09T14:56:10.363 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 35%] 2024-03-09T14:56:11.103 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 35%] 2024-03-09T14:56:11.874 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-03-09T14:56:12.632 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-03-09T14:56:13.371 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-03-09T14:56:14.127 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-03-09T14:56:14.902 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 36%] 2024-03-09T14:56:15.647 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 36%] 2024-03-09T14:56:16.455 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 36%] 2024-03-09T14:56:17.272 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 36%] 2024-03-09T14:56:18.032 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-03-09T14:56:18.807 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-03-09T14:56:19.549 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-03-09T14:56:20.292 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 37%] 2024-03-09T14:56:20.623 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 37%] 2024-03-09T14:56:21.259 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 37%] 2024-03-09T14:56:23.205 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 37%] 2024-03-09T14:56:25.104 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 37%] 2024-03-09T14:56:25.833 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-03-09T14:56:26.570 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-03-09T14:56:27.320 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 38%] 2024-03-09T14:56:28.110 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 38%] 2024-03-09T14:56:28.919 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 38%] 2024-03-09T14:56:29.727 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 38%] 2024-03-09T14:56:30.467 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 38%] 2024-03-09T14:56:31.213 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-03-09T14:56:31.998 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-03-09T14:56:32.767 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-03-09T14:56:33.500 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 39%] 2024-03-09T14:56:34.237 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 39%] 2024-03-09T14:56:35.227 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 39%] 2024-03-09T14:56:36.491 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 39%] 2024-03-09T14:56:37.071 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-03-09T14:56:37.669 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-03-09T14:56:38.197 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-03-09T14:56:38.733 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 40%] 2024-03-09T14:56:39.071 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 40%] 2024-03-09T14:56:39.371 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 40%] 2024-03-09T14:56:39.669 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 40%] 2024-03-09T14:56:40.338 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 40%] 2024-03-09T14:56:42.021 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-03-09T14:56:42.332 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-03-09T14:56:43.011 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 41%] 2024-03-09T14:56:43.531 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 41%] 2024-03-09T14:56:44.077 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 41%] 2024-03-09T14:56:44.620 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 41%] 2024-03-09T14:56:46.626 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 41%] 2024-03-09T14:56:47.573 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-03-09T14:56:48.461 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-03-09T14:57:31.153 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 42%] 2024-03-09T14:58:13.314 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 42%] 2024-03-09T14:58:13.941 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 42%] 2024-03-09T14:58:14.549 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 42%] 2024-03-09T14:58:15.197 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 42%] 2024-03-09T14:58:15.832 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 42%] 2024-03-09T14:58:16.617 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-03-09T14:58:17.256 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-03-09T14:58:17.900 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 43%] 2024-03-09T14:58:18.607 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 43%] 2024-03-09T14:58:19.290 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 43%] 2024-03-09T14:58:20.026 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 43%] 2024-03-09T14:58:20.721 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 43%] 2024-03-09T14:58:21.459 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-03-09T14:58:22.135 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-03-09T14:58:22.684 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 44%] 2024-03-09T14:58:23.294 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 44%] 2024-03-09T14:58:23.900 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 44%] 2024-03-09T14:58:24.793 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 44%] 2024-03-09T14:58:25.451 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 44%] 2024-03-09T14:58:26.063 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 44%] 2024-03-09T14:58:26.676 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-03-09T14:58:27.316 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 45%] 2024-03-09T14:58:28.020 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 45%] 2024-03-09T14:58:28.597 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 45%] 2024-03-09T14:58:29.140 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 45%] 2024-03-09T14:58:29.685 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 45%] 2024-03-09T14:58:30.237 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 45%] 2024-03-09T14:58:30.777 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-03-09T14:58:31.321 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 46%] 2024-03-09T14:58:32.001 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 46%] 2024-03-09T14:58:32.544 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 46%] 2024-03-09T14:58:33.080 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 46%] 2024-03-09T14:58:33.624 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 46%] 2024-03-09T14:58:34.162 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 46%] 2024-03-09T14:58:34.969 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 46%] 2024-03-09T14:58:35.562 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-03-09T14:58:36.100 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 47%] 2024-03-09T14:58:36.639 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 47%] 2024-03-09T14:58:37.188 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 47%] 2024-03-09T14:58:37.729 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 47%] 2024-03-09T14:58:38.270 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 47%] 2024-03-09T14:58:38.853 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 47%] 2024-03-09T14:58:40.082 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-03-09T14:58:40.629 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 48%] 2024-03-09T14:58:41.310 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 48%] 2024-03-09T14:58:41.995 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 48%] 2024-03-09T14:58:42.679 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 48%] 2024-03-09T14:58:43.359 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 48%] 2024-03-09T14:58:44.039 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 48%] 2024-03-09T14:58:45.706 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 48%] 2024-03-09T14:58:46.383 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 49%] 2024-03-09T14:58:47.071 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 49%] 2024-03-09T14:58:47.887 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 49%] 2024-03-09T14:58:48.696 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 49%] 2024-03-09T14:58:49.474 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 49%] 2024-03-09T14:58:50.149 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 49%] 2024-03-09T14:58:50.912 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 49%] 2024-03-09T14:58:51.750 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 50%] 2024-03-09T14:58:52.426 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 50%] 2024-03-09T14:58:53.229 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 50%] 2024-03-09T14:58:53.858 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 50%] 2024-03-09T14:58:54.383 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 50%] 2024-03-09T14:58:54.911 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 50%] 2024-03-09T14:58:55.550 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 50%] 2024-03-09T14:58:56.094 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-03-09T14:58:56.398 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 51%] 2024-03-09T14:58:57.192 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 51%] 2024-03-09T14:58:57.822 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 51%] 2024-03-09T14:58:58.480 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 51%] 2024-03-09T14:59:01.562 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 51%] 2024-03-09T14:59:02.197 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 51%] 2024-03-09T14:59:02.846 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 51%] 2024-03-09T14:59:03.477 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 52%] 2024-03-09T14:59:04.108 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 52%] 2024-03-09T14:59:04.722 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 52%] 2024-03-09T14:59:05.370 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 52%] 2024-03-09T14:59:06.043 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 52%] 2024-03-09T14:59:06.702 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 52%] 2024-03-09T14:59:07.318 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 52%] 2024-03-09T14:59:07.941 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 53%] 2024-03-09T14:59:08.602 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 53%] 2024-03-09T14:59:09.228 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 53%] 2024-03-09T14:59:09.867 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 53%] 2024-03-09T14:59:10.495 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 53%] 2024-03-09T14:59:11.137 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 53%] 2024-03-09T14:59:11.824 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 53%] 2024-03-09T14:59:12.464 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 53%] 2024-03-09T14:59:12.766 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 54%] 2024-03-09T14:59:13.068 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 54%] 2024-03-09T14:59:13.371 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 54%] 2024-03-09T14:59:13.891 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 54%] 2024-03-09T14:59:14.408 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 54%] 2024-03-09T14:59:14.969 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 54%] 2024-03-09T14:59:15.503 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 54%] 2024-03-09T14:59:16.091 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 55%] 2024-03-09T14:59:16.393 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 55%] 2024-03-09T14:59:16.693 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 55%] 2024-03-09T14:59:17.213 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 55%] 2024-03-09T14:59:17.568 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 55%] 2024-03-09T14:59:17.866 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 55%] 2024-03-09T14:59:18.169 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 55%] 2024-03-09T14:59:18.477 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 56%] 2024-03-09T14:59:19.049 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 56%] 2024-03-09T14:59:19.639 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 56%] 2024-03-09T14:59:20.208 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 56%] 2024-03-09T14:59:20.837 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 56%] 2024-03-09T14:59:21.418 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 56%] 2024-03-09T14:59:22.197 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default FAILED [ 56%] 2024-03-09T14:59:23.141 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create FAILED [ 57%] 2024-03-09T14:59:24.038 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned FAILED [ 57%] 2024-03-09T14:59:24.972 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite FAILED [ 57%] 2024-03-09T14:59:25.943 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread FAILED [ 57%] 2024-03-09T14:59:26.954 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default FAILED [ 57%] 2024-03-09T14:59:27.991 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create FAILED [ 57%] 2024-03-09T14:59:28.992 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned FAILED [ 57%] 2024-03-09T14:59:30.022 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite FAILED [ 57%] 2024-03-09T14:59:31.096 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread FAILED [ 58%] 2024-03-09T14:59:31.875 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 58%] 2024-03-09T14:59:32.647 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 58%] 2024-03-09T14:59:33.409 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 58%] 2024-03-09T14:59:34.138 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 58%] 2024-03-09T14:59:34.692 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 58%] 2024-03-09T14:59:35.925 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl FAILED [ 58%] 2024-03-09T14:59:37.128 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write FAILED [ 59%] 2024-03-09T14:59:38.350 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp FAILED [ 59%] 2024-03-09T14:59:39.571 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read FAILED [ 59%] 2024-03-09T14:59:40.752 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp FAILED [ 59%] 2024-03-09T14:59:41.837 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol FAILED [ 59%] 2024-03-09T14:59:42.878 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read FAILED [ 59%] 2024-03-09T14:59:43.958 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp FAILED [ 59%] 2024-03-09T14:59:45.049 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write FAILED [ 60%] 2024-03-09T14:59:46.118 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp FAILED [ 60%] 2024-03-09T14:59:46.686 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 60%] 2024-03-09T14:59:47.401 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 60%] 2024-03-09T14:59:48.111 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 60%] 2024-03-09T14:59:49.067 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email FAILED [ 60%] 2024-03-09T14:59:49.667 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 60%] 2024-03-09T14:59:50.465 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 61%] 2024-03-09T14:59:51.415 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 61%] 2024-03-09T14:59:52.375 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 61%] 2024-03-09T14:59:53.389 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 61%] 2024-03-09T14:59:54.355 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 61%] 2024-03-09T14:59:55.333 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 61%] 2024-03-09T14:59:56.296 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 61%] 2024-03-09T14:59:57.308 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 61%] 2024-03-09T14:59:58.289 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 62%] 2024-03-09T14:59:59.258 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 62%] 2024-03-09T15:00:00.257 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 62%] 2024-03-09T15:00:01.237 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 62%] 2024-03-09T15:00:02.248 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 62%] 2024-03-09T15:00:03.953 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 62%] 2024-03-09T15:00:05.492 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 62%] 2024-03-09T15:00:05.789 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 63%] 2024-03-09T15:00:06.092 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 63%] 2024-03-09T15:00:06.391 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 63%] 2024-03-09T15:00:06.992 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 63%] 2024-03-09T15:00:07.561 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 63%] 2024-03-09T15:00:08.085 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 63%] 2024-03-09T15:00:08.607 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 63%] 2024-03-09T15:00:09.376 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 64%] 2024-03-09T15:00:11.574 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 64%] 2024-03-09T15:00:12.401 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 64%] 2024-03-09T15:00:13.175 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 64%] 2024-03-09T15:00:17.139 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 64%] 2024-03-09T15:00:17.917 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 64%] 2024-03-09T15:00:18.730 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 64%] 2024-03-09T15:00:19.430 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 65%] 2024-03-09T15:00:20.143 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 65%] 2024-03-09T15:00:21.239 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 65%] 2024-03-09T15:00:22.119 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 65%] 2024-03-09T15:00:23.006 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 65%] 2024-03-09T15:00:23.828 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 65%] 2024-03-09T15:00:25.149 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 65%] 2024-03-09T15:00:26.483 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 65%] 2024-03-09T15:00:27.027 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 66%] 2024-03-09T15:00:27.625 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 66%] 2024-03-09T15:00:29.759 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 66%] 2024-03-09T15:00:30.622 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 66%] 2024-03-09T15:00:39.482 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 66%] 2024-03-09T15:00:40.076 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 66%] 2024-03-09T15:00:40.933 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 66%] 2024-03-09T15:00:43.168 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 67%] 2024-03-09T15:00:43.909 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 67%] 2024-03-09T15:00:45.184 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 67%] 2024-03-09T15:00:51.894 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 67%] 2024-03-09T15:01:04.355 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 67%] 2024-03-09T15:01:18.894 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 67%] 2024-03-09T15:02:06.766 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 67%] 2024-03-09T15:02:14.370 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 68%] 2024-03-09T15:02:23.381 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 68%] 2024-03-09T15:02:24.432 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 68%] 2024-03-09T15:02:29.105 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 68%] 2024-03-09T15:02:31.840 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 68%] 2024-03-09T15:02:33.765 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 68%] 2024-03-09T15:02:34.443 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 68%] 2024-03-09T15:02:37.720 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 69%] 2024-03-09T15:02:38.829 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner FAILED [ 69%] 2024-03-09T15:02:39.517 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 69%] 2024-03-09T15:02:40.237 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 69%] 2024-03-09T15:02:57.752 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 69%] 2024-03-09T15:02:58.521 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 69%] 2024-03-09T15:02:59.096 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 69%] 2024-03-09T15:02:59.836 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 69%] 2024-03-09T15:03:04.087 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 70%] 2024-03-09T15:03:07.717 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 70%] 2024-03-09T15:03:11.321 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 70%] 2024-03-09T15:03:12.004 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 70%] 2024-03-09T15:03:12.682 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 70%] 2024-03-09T15:03:13.345 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 70%] 2024-03-09T15:03:14.087 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 70%] 2024-03-09T15:03:14.765 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 71%] 2024-03-09T15:03:15.453 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 71%] 2024-03-09T15:03:16.178 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 71%] 2024-03-09T15:03:17.197 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 71%] 2024-03-09T15:03:19.099 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 71%] 2024-03-09T15:03:22.591 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 71%] 2024-03-09T15:03:23.825 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 71%] 2024-03-09T15:03:26.285 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 72%] 2024-03-09T15:03:30.466 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 72%] 2024-03-09T15:03:31.911 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 72%] 2024-03-09T15:03:34.652 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 72%] 2024-03-09T15:03:40.594 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 72%] 2024-03-09T15:03:41.856 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 72%] 2024-03-09T15:03:42.703 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 72%] 2024-03-09T15:03:43.853 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 73%] 2024-03-09T15:03:44.537 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 73%] 2024-03-09T15:03:50.420 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 73%] 2024-03-09T15:03:51.148 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 73%] 2024-03-09T15:03:51.838 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 73%] 2024-03-09T15:03:52.521 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 73%] 2024-03-09T15:03:53.201 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 73%] 2024-03-09T15:03:54.104 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 73%] 2024-03-09T15:04:05.162 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 74%] 2024-03-09T15:04:06.377 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 74%] 2024-03-09T15:04:07.217 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 74%] 2024-03-09T15:04:08.281 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 74%] 2024-03-09T15:04:09.405 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 74%] 2024-03-09T15:04:14.092 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 74%] 2024-03-09T15:04:15.187 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 74%] 2024-03-09T15:04:20.773 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 75%] 2024-03-09T15:04:41.286 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 75%] 2024-03-09T15:04:54.930 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 75%] 2024-03-09T15:04:57.186 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 75%] 2024-03-09T15:04:59.413 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 75%] 2024-03-09T15:05:00.778 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 75%] 2024-03-09T15:05:01.820 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 75%] 2024-03-09T15:05:02.599 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 76%] 2024-03-09T15:05:03.822 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl FAILED [ 76%] 2024-03-09T15:05:05.054 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified FAILED [ 76%] 2024-03-09T15:05:06.750 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 76%] 2024-03-09T15:05:07.379 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 76%] 2024-03-09T15:05:08.013 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 76%] 2024-03-09T15:05:08.647 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 76%] 2024-03-09T15:05:09.203 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 76%] 2024-03-09T15:05:09.778 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 77%] 2024-03-09T15:05:10.445 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 77%] 2024-03-09T15:05:11.057 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 77%] 2024-03-09T15:05:11.609 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 77%] 2024-03-09T15:05:12.297 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 77%] 2024-03-09T15:05:12.856 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 77%] 2024-03-09T15:05:13.418 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 77%] 2024-03-09T15:05:13.978 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 78%] 2024-03-09T15:05:14.589 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 78%] 2024-03-09T15:05:15.157 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 78%] 2024-03-09T15:05:15.854 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 78%] 2024-03-09T15:05:16.550 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 78%] 2024-03-09T15:05:17.492 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 78%] 2024-03-09T15:05:18.226 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 78%] 2024-03-09T15:05:18.920 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 79%] 2024-03-09T15:05:19.610 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 79%] 2024-03-09T15:05:20.327 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 79%] 2024-03-09T15:05:20.920 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 79%] 2024-03-09T15:05:21.521 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 79%] 2024-03-09T15:05:22.169 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 79%] 2024-03-09T15:05:22.763 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 79%] 2024-03-09T15:05:49.537 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 80%] 2024-03-09T15:06:16.250 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 80%] 2024-03-09T15:06:23.603 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 80%] 2024-03-09T15:06:24.299 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 80%] 2024-03-09T15:06:25.015 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 80%] 2024-03-09T15:06:25.695 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 80%] 2024-03-09T15:06:26.320 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 80%] 2024-03-09T15:06:26.872 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 80%] 2024-03-09T15:06:45.159 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 81%] 2024-03-09T15:06:51.681 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 81%] 2024-03-09T15:06:58.167 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 81%] 2024-03-09T15:06:58.820 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 81%] 2024-03-09T15:06:59.509 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 81%] 2024-03-09T15:07:00.205 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 81%] 2024-03-09T15:07:01.188 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 81%] 2024-03-09T15:07:01.872 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 82%] 2024-03-09T15:07:02.553 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 82%] 2024-03-09T15:07:03.276 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 82%] 2024-03-09T15:07:04.025 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 82%] 2024-03-09T15:07:04.888 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 82%] 2024-03-09T15:07:05.699 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 82%] 2024-03-09T15:07:06.836 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 82%] 2024-03-09T15:07:07.999 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 83%] 2024-03-09T15:07:10.055 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 83%] 2024-03-09T15:07:11.681 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 83%] 2024-03-09T15:07:13.304 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 83%] 2024-03-09T15:07:15.351 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 83%] 2024-03-09T15:07:17.407 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 83%] 2024-03-09T15:07:19.007 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 83%] 2024-03-09T15:07:20.523 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 84%] 2024-03-09T15:07:22.190 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 84%] 2024-03-09T15:07:23.929 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 84%] 2024-03-09T15:07:24.678 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 84%] 2024-03-09T15:07:25.324 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 84%] 2024-03-09T15:07:26.069 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 84%] 2024-03-09T15:07:27.682 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 84%] 2024-03-09T15:07:29.239 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 84%] 2024-03-09T15:07:31.099 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 85%] 2024-03-09T15:07:32.638 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 85%] 2024-03-09T15:07:46.076 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 85%] 2024-03-09T15:07:47.067 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 85%] 2024-03-09T15:07:48.113 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 85%] 2024-03-09T15:07:49.112 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 85%] 2024-03-09T15:07:50.492 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 85%] 2024-03-09T15:07:51.693 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 86%] 2024-03-09T15:07:52.468 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 86%] 2024-03-09T15:07:53.608 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 86%] 2024-03-09T15:07:54.179 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 86%] 2024-03-09T15:07:54.716 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 86%] 2024-03-09T15:07:55.253 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 86%] 2024-03-09T15:07:55.846 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 86%] 2024-03-09T15:07:56.547 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 87%] 2024-03-09T15:07:57.160 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 87%] 2024-03-09T15:07:58.206 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 87%] 2024-03-09T15:07:58.879 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 87%] 2024-03-09T15:07:59.456 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 87%] 2024-03-09T15:08:00.090 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 87%] 2024-03-09T15:08:00.674 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 87%] 2024-03-09T15:08:01.250 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 88%] 2024-03-09T15:08:01.893 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 88%] 2024-03-09T15:08:02.475 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 88%] 2024-03-09T15:08:03.062 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 88%] 2024-03-09T15:08:03.716 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 88%] 2024-03-09T15:08:04.318 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 88%] 2024-03-09T15:08:05.049 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 88%] 2024-03-09T15:08:05.721 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 88%] 2024-03-09T15:08:06.487 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 89%] 2024-03-09T15:08:07.206 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 89%] 2024-03-09T15:08:07.930 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 89%] 2024-03-09T15:08:08.603 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 89%] 2024-03-09T15:08:09.444 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 89%] 2024-03-09T15:08:10.193 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 89%] 2024-03-09T15:08:10.947 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 89%] 2024-03-09T15:08:11.677 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 90%] 2024-03-09T15:08:12.424 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 90%] 2024-03-09T15:08:13.181 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 90%] 2024-03-09T15:08:14.062 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 90%] 2024-03-09T15:08:14.825 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 90%] 2024-03-09T15:08:15.521 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 90%] 2024-03-09T15:08:16.195 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 90%] 2024-03-09T15:08:16.895 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 91%] 2024-03-09T15:08:17.760 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 91%] 2024-03-09T15:08:18.427 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 91%] 2024-03-09T15:08:19.199 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 91%] 2024-03-09T15:08:19.847 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 91%] 2024-03-09T15:08:20.589 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 91%] 2024-03-09T15:08:21.274 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 91%] 2024-03-09T15:08:31.804 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 92%] 2024-03-09T15:08:32.502 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 92%] 2024-03-09T15:08:42.405 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 92%] 2024-03-09T15:08:43.158 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 92%] 2024-03-09T15:08:43.918 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 92%] 2024-03-09T15:08:44.497 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 92%] 2024-03-09T15:08:45.145 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 92%] 2024-03-09T15:08:45.755 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 92%] 2024-03-09T15:08:46.388 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 93%] 2024-03-09T15:08:47.029 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 93%] 2024-03-09T15:08:47.659 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status PASSED [ 93%] 2024-03-09T15:08:48.272 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 93%] 2024-03-09T15:08:49.025 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 93%] 2024-03-09T15:08:49.631 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 93%] 2024-03-09T15:08:50.406 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 93%] 2024-03-09T15:08:51.127 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 94%] 2024-03-09T15:08:51.943 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 94%] 2024-03-09T15:08:52.820 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 94%] 2024-03-09T15:08:59.888 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 94%] 2024-03-09T15:09:00.452 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 94%] 2024-03-09T15:09:01.095 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 94%] 2024-03-09T15:09:01.767 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 94%] 2024-03-09T15:09:02.440 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 95%] 2024-03-09T15:09:03.985 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 95%] 2024-03-09T15:09:08.791 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 95%] 2024-03-09T15:09:12.817 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-03-09T15:09:13.531 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-03-09T15:09:14.434 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-03-09T15:09:27.731 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-03-09T15:09:44.092 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 96%] 2024-03-09T15:09:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 96%] 2024-03-09T15:09:49.027 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 96%] 2024-03-09T15:09:50.900 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 96%] 2024-03-09T15:09:52.465 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-03-09T15:09:53.178 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-03-09T15:09:56.694 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-03-09T15:10:03.262 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-03-09T15:10:19.681 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 97%] 2024-03-09T15:10:22.324 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 97%] 2024-03-09T15:10:24.117 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 97%] 2024-03-09T15:10:25.905 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-03-09T15:10:26.791 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-03-09T15:10:31.762 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-03-09T15:10:34.640 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-03-09T15:10:35.551 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 98%] 2024-03-09T15:10:36.804 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 98%] 2024-03-09T15:10:42.381 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 98%] 2024-03-09T15:10:45.533 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 98%] 2024-03-09T15:10:49.642 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-03-09T15:10:51.273 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-03-09T15:10:51.556 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-03-09T15:10:54.747 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 99%] 2024-03-09T15:11:01.316 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 99%] 2024-03-09T15:11:04.647 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 99%] 2024-03-09T15:11:08.091 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 99%] 2024-03-09T15:11:09.394 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-03-09T15:11:37.344 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-03-09T15:11:37.630 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-03-09T15:11:37.653 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-03-09T15:11:37.653 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.653 INFO:teuthology.orchestra.run.smithi088.stdout:=================================== FAILURES =================================== 2024-03-09T15:11:37.654 INFO:teuthology.orchestra.run.smithi088.stdout:__________________ test_object_create_bad_contentlength_none ___________________ 2024-03-09T15:11:37.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.654 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.auth_common 2024-03-09T15:11:37.654 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:11:37.654 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_create_bad_contentlength_none(): 2024-03-09T15:11:37.654 INFO:teuthology.orchestra.run.smithi088.stdout: key = _setup_bad_object(remove=('Content-Length',)) 2024-03-09T15:11:37.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.654 INFO:teuthology.orchestra.run.smithi088.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:11:37.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.654 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py:180: 2024-03-09T15:11:37.654 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.655 INFO:teuthology.orchestra.run.smithi088.stdout:excClass = 2024-03-09T15:11:37.655 INFO:teuthology.orchestra.run.smithi088.stdout:callableObj = > 2024-03-09T15:11:37.655 INFO:teuthology.orchestra.run.smithi088.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:11:37.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.655 INFO:teuthology.orchestra.run.smithi088.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:11:37.655 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.655 INFO:teuthology.orchestra.run.smithi088.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:11:37.655 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.655 INFO:teuthology.orchestra.run.smithi088.stdout: try: 2024-03-09T15:11:37.655 INFO:teuthology.orchestra.run.smithi088.stdout: callableObj(*args, **kwargs) 2024-03-09T15:11:37.655 INFO:teuthology.orchestra.run.smithi088.stdout: except excClass as e: 2024-03-09T15:11:37.655 INFO:teuthology.orchestra.run.smithi088.stdout: return e 2024-03-09T15:11:37.656 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.656 INFO:teuthology.orchestra.run.smithi088.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:11:37.656 INFO:teuthology.orchestra.run.smithi088.stdout: excName = excClass.__name__ 2024-03-09T15:11:37.656 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.656 INFO:teuthology.orchestra.run.smithi088.stdout: excName = str(excClass) 2024-03-09T15:11:37.656 INFO:teuthology.orchestra.run.smithi088.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:11:37.656 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:11:37.656 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.656 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:11:37.656 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.656 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on main 2024-03-09T15:11:37.656 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection main prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.656 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on alt 2024-03-09T15:11:37.656 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection alt prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.657 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on tenant 2024-03-09T15:11:37.657 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.657 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of test buckets. 2024-03-09T15:11:37.657 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.657 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on main 2024-03-09T15:11:37.657 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection main prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.657 INFO:teuthology.orchestra.run.smithi088.stdout:prefix= test-client.0-ktjzoc14mjjf4i7- 2024-03-09T15:11:37.657 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket 2024-03-09T15:11:37.657 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket key 2024-03-09T15:11:37.657 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on alt 2024-03-09T15:11:37.657 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection alt prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.657 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on tenant 2024-03-09T15:11:37.657 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.658 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of test buckets. 2024-03-09T15:11:37.658 INFO:teuthology.orchestra.run.smithi088.stdout:__________________ test_object_create_bad_authorization_empty __________________ 2024-03-09T15:11:37.658 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.658 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.auth_common 2024-03-09T15:11:37.658 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:11:37.658 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_create_bad_authorization_empty(): 2024-03-09T15:11:37.658 INFO:teuthology.orchestra.run.smithi088.stdout: key = _setup_bad_object({'Authorization': ''}) 2024-03-09T15:11:37.658 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.658 INFO:teuthology.orchestra.run.smithi088.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:11:37.658 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.658 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py:210: 2024-03-09T15:11:37.658 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.658 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.659 INFO:teuthology.orchestra.run.smithi088.stdout:excClass = 2024-03-09T15:11:37.659 INFO:teuthology.orchestra.run.smithi088.stdout:callableObj = > 2024-03-09T15:11:37.659 INFO:teuthology.orchestra.run.smithi088.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:11:37.659 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.659 INFO:teuthology.orchestra.run.smithi088.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:11:37.659 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.659 INFO:teuthology.orchestra.run.smithi088.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:11:37.659 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.659 INFO:teuthology.orchestra.run.smithi088.stdout: try: 2024-03-09T15:11:37.659 INFO:teuthology.orchestra.run.smithi088.stdout: callableObj(*args, **kwargs) 2024-03-09T15:11:37.659 INFO:teuthology.orchestra.run.smithi088.stdout: except excClass as e: 2024-03-09T15:11:37.659 INFO:teuthology.orchestra.run.smithi088.stdout: return e 2024-03-09T15:11:37.659 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.659 INFO:teuthology.orchestra.run.smithi088.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:11:37.660 INFO:teuthology.orchestra.run.smithi088.stdout: excName = excClass.__name__ 2024-03-09T15:11:37.660 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.660 INFO:teuthology.orchestra.run.smithi088.stdout: excName = str(excClass) 2024-03-09T15:11:37.660 INFO:teuthology.orchestra.run.smithi088.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:11:37.660 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:11:37.660 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.660 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:11:37.660 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.660 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on main 2024-03-09T15:11:37.660 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection main prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.660 INFO:teuthology.orchestra.run.smithi088.stdout:prefix= test-client.0-ktjzoc14mjjf4i7- 2024-03-09T15:11:37.660 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket 2024-03-09T15:11:37.660 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket key 2024-03-09T15:11:37.661 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on alt 2024-03-09T15:11:37.661 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection alt prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.661 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on tenant 2024-03-09T15:11:37.661 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.661 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of test buckets. 2024-03-09T15:11:37.661 INFO:teuthology.orchestra.run.smithi088.stdout:__________________ test_object_create_bad_authorization_none ___________________ 2024-03-09T15:11:37.661 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.661 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.auth_common 2024-03-09T15:11:37.661 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:11:37.661 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_create_bad_authorization_none(): 2024-03-09T15:11:37.661 INFO:teuthology.orchestra.run.smithi088.stdout: key = _setup_bad_object(remove=('Authorization',)) 2024-03-09T15:11:37.661 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.661 INFO:teuthology.orchestra.run.smithi088.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:11:37.661 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.662 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py:236: 2024-03-09T15:11:37.662 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.662 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.662 INFO:teuthology.orchestra.run.smithi088.stdout:excClass = 2024-03-09T15:11:37.662 INFO:teuthology.orchestra.run.smithi088.stdout:callableObj = > 2024-03-09T15:11:37.662 INFO:teuthology.orchestra.run.smithi088.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:11:37.662 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.662 INFO:teuthology.orchestra.run.smithi088.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:11:37.662 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.662 INFO:teuthology.orchestra.run.smithi088.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:11:37.662 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.662 INFO:teuthology.orchestra.run.smithi088.stdout: try: 2024-03-09T15:11:37.662 INFO:teuthology.orchestra.run.smithi088.stdout: callableObj(*args, **kwargs) 2024-03-09T15:11:37.662 INFO:teuthology.orchestra.run.smithi088.stdout: except excClass as e: 2024-03-09T15:11:37.663 INFO:teuthology.orchestra.run.smithi088.stdout: return e 2024-03-09T15:11:37.663 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.663 INFO:teuthology.orchestra.run.smithi088.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:11:37.663 INFO:teuthology.orchestra.run.smithi088.stdout: excName = excClass.__name__ 2024-03-09T15:11:37.663 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.663 INFO:teuthology.orchestra.run.smithi088.stdout: excName = str(excClass) 2024-03-09T15:11:37.663 INFO:teuthology.orchestra.run.smithi088.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:11:37.663 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:11:37.663 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.663 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:11:37.663 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.663 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on main 2024-03-09T15:11:37.663 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection main prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.663 INFO:teuthology.orchestra.run.smithi088.stdout:prefix= test-client.0-ktjzoc14mjjf4i7- 2024-03-09T15:11:37.664 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket 2024-03-09T15:11:37.664 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket key 2024-03-09T15:11:37.664 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on alt 2024-03-09T15:11:37.664 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection alt prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.664 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on tenant 2024-03-09T15:11:37.664 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.664 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of test buckets. 2024-03-09T15:11:37.664 INFO:teuthology.orchestra.run.smithi088.stdout:__________________ test_bucket_create_bad_authorization_empty __________________ 2024-03-09T15:11:37.664 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.664 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.auth_common 2024-03-09T15:11:37.664 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:11:37.664 INFO:teuthology.orchestra.run.smithi088.stdout: def test_bucket_create_bad_authorization_empty(): 2024-03-09T15:11:37.664 INFO:teuthology.orchestra.run.smithi088.stdout: _add_custom_headers({'Authorization': ''}) 2024-03-09T15:11:37.665 INFO:teuthology.orchestra.run.smithi088.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-09T15:11:37.665 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.665 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py:294: 2024-03-09T15:11:37.665 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.665 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.665 INFO:teuthology.orchestra.run.smithi088.stdout:excClass = 2024-03-09T15:11:37.665 INFO:teuthology.orchestra.run.smithi088.stdout:callableObj = , args = () 2024-03-09T15:11:37.665 INFO:teuthology.orchestra.run.smithi088.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:11:37.665 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.665 INFO:teuthology.orchestra.run.smithi088.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:11:37.665 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.665 INFO:teuthology.orchestra.run.smithi088.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:11:37.665 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.665 INFO:teuthology.orchestra.run.smithi088.stdout: try: 2024-03-09T15:11:37.666 INFO:teuthology.orchestra.run.smithi088.stdout: callableObj(*args, **kwargs) 2024-03-09T15:11:37.666 INFO:teuthology.orchestra.run.smithi088.stdout: except excClass as e: 2024-03-09T15:11:37.666 INFO:teuthology.orchestra.run.smithi088.stdout: return e 2024-03-09T15:11:37.666 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.666 INFO:teuthology.orchestra.run.smithi088.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:11:37.666 INFO:teuthology.orchestra.run.smithi088.stdout: excName = excClass.__name__ 2024-03-09T15:11:37.666 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.666 INFO:teuthology.orchestra.run.smithi088.stdout: excName = str(excClass) 2024-03-09T15:11:37.666 INFO:teuthology.orchestra.run.smithi088.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:11:37.666 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:11:37.666 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.666 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:11:37.666 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.667 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on main 2024-03-09T15:11:37.667 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection main prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.667 INFO:teuthology.orchestra.run.smithi088.stdout:prefix= test-client.0-ktjzoc14mjjf4i7- 2024-03-09T15:11:37.667 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket 2024-03-09T15:11:37.667 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on alt 2024-03-09T15:11:37.667 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection alt prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.667 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on tenant 2024-03-09T15:11:37.667 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.667 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of test buckets. 2024-03-09T15:11:37.667 INFO:teuthology.orchestra.run.smithi088.stdout:__________________ test_bucket_create_bad_authorization_none ___________________ 2024-03-09T15:11:37.667 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.667 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.auth_common 2024-03-09T15:11:37.667 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:11:37.668 INFO:teuthology.orchestra.run.smithi088.stdout: def test_bucket_create_bad_authorization_none(): 2024-03-09T15:11:37.669 INFO:teuthology.orchestra.run.smithi088.stdout: _add_custom_headers(remove=('Authorization',)) 2024-03-09T15:11:37.669 INFO:teuthology.orchestra.run.smithi088.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-09T15:11:37.670 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.670 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py:305: 2024-03-09T15:11:37.670 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.670 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.670 INFO:teuthology.orchestra.run.smithi088.stdout:excClass = 2024-03-09T15:11:37.670 INFO:teuthology.orchestra.run.smithi088.stdout:callableObj = , args = () 2024-03-09T15:11:37.670 INFO:teuthology.orchestra.run.smithi088.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:11:37.670 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.670 INFO:teuthology.orchestra.run.smithi088.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:11:37.670 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.670 INFO:teuthology.orchestra.run.smithi088.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:11:37.670 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.671 INFO:teuthology.orchestra.run.smithi088.stdout: try: 2024-03-09T15:11:37.671 INFO:teuthology.orchestra.run.smithi088.stdout: callableObj(*args, **kwargs) 2024-03-09T15:11:37.671 INFO:teuthology.orchestra.run.smithi088.stdout: except excClass as e: 2024-03-09T15:11:37.671 INFO:teuthology.orchestra.run.smithi088.stdout: return e 2024-03-09T15:11:37.671 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.671 INFO:teuthology.orchestra.run.smithi088.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:11:37.671 INFO:teuthology.orchestra.run.smithi088.stdout: excName = excClass.__name__ 2024-03-09T15:11:37.671 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.671 INFO:teuthology.orchestra.run.smithi088.stdout: excName = str(excClass) 2024-03-09T15:11:37.671 INFO:teuthology.orchestra.run.smithi088.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:11:37.671 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:11:37.671 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.671 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:11:37.671 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.672 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on main 2024-03-09T15:11:37.672 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection main prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.672 INFO:teuthology.orchestra.run.smithi088.stdout:prefix= test-client.0-ktjzoc14mjjf4i7- 2024-03-09T15:11:37.672 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket 2024-03-09T15:11:37.672 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on alt 2024-03-09T15:11:37.672 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection alt prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.672 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on tenant 2024-03-09T15:11:37.672 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.672 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of test buckets. 2024-03-09T15:11:37.672 INFO:teuthology.orchestra.run.smithi088.stdout:___________ test_object_create_bad_contentlength_mismatch_below_aws2 ___________ 2024-03-09T15:11:37.672 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.672 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.auth_aws2 2024-03-09T15:11:37.672 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:11:37.672 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_create_bad_contentlength_mismatch_below_aws2(): 2024-03-09T15:11:37.673 INFO:teuthology.orchestra.run.smithi088.stdout: check_aws2_support() 2024-03-09T15:11:37.673 INFO:teuthology.orchestra.run.smithi088.stdout: content = 'bar' 2024-03-09T15:11:37.673 INFO:teuthology.orchestra.run.smithi088.stdout: length = len(content) - 1 2024-03-09T15:11:37.673 INFO:teuthology.orchestra.run.smithi088.stdout: key = _setup_bad_object({'Content-Length': length}) 2024-03-09T15:11:37.673 INFO:teuthology.orchestra.run.smithi088.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, content) 2024-03-09T15:11:37.673 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.673 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py:321: 2024-03-09T15:11:37.673 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.673 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.673 INFO:teuthology.orchestra.run.smithi088.stdout:excClass = 2024-03-09T15:11:37.673 INFO:teuthology.orchestra.run.smithi088.stdout:callableObj = > 2024-03-09T15:11:37.673 INFO:teuthology.orchestra.run.smithi088.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:11:37.673 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.673 INFO:teuthology.orchestra.run.smithi088.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:11:37.673 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.674 INFO:teuthology.orchestra.run.smithi088.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:11:37.674 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.674 INFO:teuthology.orchestra.run.smithi088.stdout: try: 2024-03-09T15:11:37.674 INFO:teuthology.orchestra.run.smithi088.stdout: callableObj(*args, **kwargs) 2024-03-09T15:11:37.674 INFO:teuthology.orchestra.run.smithi088.stdout: except excClass as e: 2024-03-09T15:11:37.674 INFO:teuthology.orchestra.run.smithi088.stdout: return e 2024-03-09T15:11:37.674 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.674 INFO:teuthology.orchestra.run.smithi088.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:11:37.674 INFO:teuthology.orchestra.run.smithi088.stdout: excName = excClass.__name__ 2024-03-09T15:11:37.674 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.674 INFO:teuthology.orchestra.run.smithi088.stdout: excName = str(excClass) 2024-03-09T15:11:37.674 INFO:teuthology.orchestra.run.smithi088.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:11:37.674 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:11:37.674 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.675 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:11:37.675 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.675 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on main 2024-03-09T15:11:37.675 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection main prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.675 INFO:teuthology.orchestra.run.smithi088.stdout:prefix= test-client.0-ktjzoc14mjjf4i7- 2024-03-09T15:11:37.675 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket 2024-03-09T15:11:37.675 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket key 2024-03-09T15:11:37.675 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on alt 2024-03-09T15:11:37.675 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection alt prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.675 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on tenant 2024-03-09T15:11:37.675 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.675 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of test buckets. 2024-03-09T15:11:37.675 INFO:teuthology.orchestra.run.smithi088.stdout:_____________ test_object_create_bad_authorization_incorrect_aws2 ______________ 2024-03-09T15:11:37.675 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.675 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.auth_aws2 2024-03-09T15:11:37.676 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:11:37.676 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_create_bad_authorization_incorrect_aws2(): 2024-03-09T15:11:37.676 INFO:teuthology.orchestra.run.smithi088.stdout: check_aws2_support() 2024-03-09T15:11:37.676 INFO:teuthology.orchestra.run.smithi088.stdout: key = _setup_bad_object({'Authorization': 'AWS AKIAIGR7ZNNBHC5BKSUB:FWeDfwojDSdS2Ztmpfeubhd9isU='}) 2024-03-09T15:11:37.676 INFO:teuthology.orchestra.run.smithi088.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:11:37.676 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.676 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py:332: 2024-03-09T15:11:37.676 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.676 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.676 INFO:teuthology.orchestra.run.smithi088.stdout:excClass = 2024-03-09T15:11:37.676 INFO:teuthology.orchestra.run.smithi088.stdout:callableObj = > 2024-03-09T15:11:37.676 INFO:teuthology.orchestra.run.smithi088.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:11:37.676 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.676 INFO:teuthology.orchestra.run.smithi088.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:11:37.677 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.677 INFO:teuthology.orchestra.run.smithi088.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:11:37.677 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.677 INFO:teuthology.orchestra.run.smithi088.stdout: try: 2024-03-09T15:11:37.677 INFO:teuthology.orchestra.run.smithi088.stdout: callableObj(*args, **kwargs) 2024-03-09T15:11:37.677 INFO:teuthology.orchestra.run.smithi088.stdout: except excClass as e: 2024-03-09T15:11:37.677 INFO:teuthology.orchestra.run.smithi088.stdout: return e 2024-03-09T15:11:37.677 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.677 INFO:teuthology.orchestra.run.smithi088.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:11:37.677 INFO:teuthology.orchestra.run.smithi088.stdout: excName = excClass.__name__ 2024-03-09T15:11:37.677 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.677 INFO:teuthology.orchestra.run.smithi088.stdout: excName = str(excClass) 2024-03-09T15:11:37.677 INFO:teuthology.orchestra.run.smithi088.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:11:37.677 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:11:37.677 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.678 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:11:37.678 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.678 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on main 2024-03-09T15:11:37.678 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection main prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.678 INFO:teuthology.orchestra.run.smithi088.stdout:prefix= test-client.0-ktjzoc14mjjf4i7- 2024-03-09T15:11:37.678 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket 2024-03-09T15:11:37.678 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket key 2024-03-09T15:11:37.678 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on alt 2024-03-09T15:11:37.678 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection alt prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.678 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on tenant 2024-03-09T15:11:37.679 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.679 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of test buckets. 2024-03-09T15:11:37.679 INFO:teuthology.orchestra.run.smithi088.stdout:______________ test_object_create_bad_authorization_invalid_aws2 _______________ 2024-03-09T15:11:37.679 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.679 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.auth_aws2 2024-03-09T15:11:37.679 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:11:37.679 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_create_bad_authorization_invalid_aws2(): 2024-03-09T15:11:37.679 INFO:teuthology.orchestra.run.smithi088.stdout: check_aws2_support() 2024-03-09T15:11:37.679 INFO:teuthology.orchestra.run.smithi088.stdout: key = _setup_bad_object({'Authorization': 'AWS HAHAHA'}) 2024-03-09T15:11:37.679 INFO:teuthology.orchestra.run.smithi088.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:11:37.679 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.679 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py:343: 2024-03-09T15:11:37.679 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.679 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.680 INFO:teuthology.orchestra.run.smithi088.stdout:excClass = 2024-03-09T15:11:37.680 INFO:teuthology.orchestra.run.smithi088.stdout:callableObj = > 2024-03-09T15:11:37.680 INFO:teuthology.orchestra.run.smithi088.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:11:37.680 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.680 INFO:teuthology.orchestra.run.smithi088.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:11:37.680 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.680 INFO:teuthology.orchestra.run.smithi088.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:11:37.680 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.680 INFO:teuthology.orchestra.run.smithi088.stdout: try: 2024-03-09T15:11:37.680 INFO:teuthology.orchestra.run.smithi088.stdout: callableObj(*args, **kwargs) 2024-03-09T15:11:37.680 INFO:teuthology.orchestra.run.smithi088.stdout: except excClass as e: 2024-03-09T15:11:37.680 INFO:teuthology.orchestra.run.smithi088.stdout: return e 2024-03-09T15:11:37.680 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.680 INFO:teuthology.orchestra.run.smithi088.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:11:37.680 INFO:teuthology.orchestra.run.smithi088.stdout: excName = excClass.__name__ 2024-03-09T15:11:37.681 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.681 INFO:teuthology.orchestra.run.smithi088.stdout: excName = str(excClass) 2024-03-09T15:11:37.681 INFO:teuthology.orchestra.run.smithi088.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:11:37.681 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:11:37.681 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.681 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:11:37.681 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.681 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on main 2024-03-09T15:11:37.681 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection main prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.681 INFO:teuthology.orchestra.run.smithi088.stdout:prefix= test-client.0-ktjzoc14mjjf4i7- 2024-03-09T15:11:37.681 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket 2024-03-09T15:11:37.681 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket key 2024-03-09T15:11:37.681 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on alt 2024-03-09T15:11:37.682 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection alt prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.682 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on tenant 2024-03-09T15:11:37.682 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.682 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of test buckets. 2024-03-09T15:11:37.682 INFO:teuthology.orchestra.run.smithi088.stdout:____________________ test_object_create_bad_date_none_aws2 _____________________ 2024-03-09T15:11:37.682 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.682 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.auth_aws2 2024-03-09T15:11:37.682 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:11:37.682 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_create_bad_date_none_aws2(): 2024-03-09T15:11:37.682 INFO:teuthology.orchestra.run.smithi088.stdout: check_aws2_support() 2024-03-09T15:11:37.682 INFO:teuthology.orchestra.run.smithi088.stdout: key = _setup_bad_object(remove=('Date',)) 2024-03-09T15:11:37.682 INFO:teuthology.orchestra.run.smithi088.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:11:37.682 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.682 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py:353: 2024-03-09T15:11:37.683 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.683 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.683 INFO:teuthology.orchestra.run.smithi088.stdout:excClass = 2024-03-09T15:11:37.683 INFO:teuthology.orchestra.run.smithi088.stdout:callableObj = > 2024-03-09T15:11:37.683 INFO:teuthology.orchestra.run.smithi088.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:11:37.683 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.683 INFO:teuthology.orchestra.run.smithi088.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:11:37.683 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.683 INFO:teuthology.orchestra.run.smithi088.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:11:37.683 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.683 INFO:teuthology.orchestra.run.smithi088.stdout: try: 2024-03-09T15:11:37.683 INFO:teuthology.orchestra.run.smithi088.stdout: callableObj(*args, **kwargs) 2024-03-09T15:11:37.683 INFO:teuthology.orchestra.run.smithi088.stdout: except excClass as e: 2024-03-09T15:11:37.683 INFO:teuthology.orchestra.run.smithi088.stdout: return e 2024-03-09T15:11:37.684 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.684 INFO:teuthology.orchestra.run.smithi088.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:11:37.684 INFO:teuthology.orchestra.run.smithi088.stdout: excName = excClass.__name__ 2024-03-09T15:11:37.684 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.684 INFO:teuthology.orchestra.run.smithi088.stdout: excName = str(excClass) 2024-03-09T15:11:37.684 INFO:teuthology.orchestra.run.smithi088.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:11:37.684 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:11:37.684 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.684 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:11:37.684 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.684 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on main 2024-03-09T15:11:37.684 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection main prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.684 INFO:teuthology.orchestra.run.smithi088.stdout:prefix= test-client.0-ktjzoc14mjjf4i7- 2024-03-09T15:11:37.685 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket 2024-03-09T15:11:37.685 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket key 2024-03-09T15:11:37.685 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on alt 2024-03-09T15:11:37.685 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection alt prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.685 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on tenant 2024-03-09T15:11:37.685 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.685 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of test buckets. 2024-03-09T15:11:37.685 INFO:teuthology.orchestra.run.smithi088.stdout:______________ test_bucket_create_bad_authorization_invalid_aws2 _______________ 2024-03-09T15:11:37.685 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.685 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.auth_aws2 2024-03-09T15:11:37.685 INFO:teuthology.orchestra.run.smithi088.stdout: def test_bucket_create_bad_authorization_invalid_aws2(): 2024-03-09T15:11:37.685 INFO:teuthology.orchestra.run.smithi088.stdout: check_aws2_support() 2024-03-09T15:11:37.685 INFO:teuthology.orchestra.run.smithi088.stdout: _add_custom_headers({'Authorization': 'AWS HAHAHA'}) 2024-03-09T15:11:37.685 INFO:teuthology.orchestra.run.smithi088.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-09T15:11:37.685 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.686 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py:363: 2024-03-09T15:11:37.686 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.686 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.686 INFO:teuthology.orchestra.run.smithi088.stdout:excClass = 2024-03-09T15:11:37.686 INFO:teuthology.orchestra.run.smithi088.stdout:callableObj = , args = () 2024-03-09T15:11:37.686 INFO:teuthology.orchestra.run.smithi088.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:11:37.686 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.686 INFO:teuthology.orchestra.run.smithi088.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:11:37.686 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.686 INFO:teuthology.orchestra.run.smithi088.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:11:37.686 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.686 INFO:teuthology.orchestra.run.smithi088.stdout: try: 2024-03-09T15:11:37.686 INFO:teuthology.orchestra.run.smithi088.stdout: callableObj(*args, **kwargs) 2024-03-09T15:11:37.687 INFO:teuthology.orchestra.run.smithi088.stdout: except excClass as e: 2024-03-09T15:11:37.687 INFO:teuthology.orchestra.run.smithi088.stdout: return e 2024-03-09T15:11:37.687 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.687 INFO:teuthology.orchestra.run.smithi088.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:11:37.687 INFO:teuthology.orchestra.run.smithi088.stdout: excName = excClass.__name__ 2024-03-09T15:11:37.687 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.687 INFO:teuthology.orchestra.run.smithi088.stdout: excName = str(excClass) 2024-03-09T15:11:37.687 INFO:teuthology.orchestra.run.smithi088.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:11:37.687 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:11:37.687 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.687 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:11:37.687 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.687 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on main 2024-03-09T15:11:37.687 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection main prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.688 INFO:teuthology.orchestra.run.smithi088.stdout:prefix= test-client.0-ktjzoc14mjjf4i7- 2024-03-09T15:11:37.688 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket 2024-03-09T15:11:37.688 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on alt 2024-03-09T15:11:37.688 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection alt prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.688 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on tenant 2024-03-09T15:11:37.688 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.688 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of test buckets. 2024-03-09T15:11:37.688 INFO:teuthology.orchestra.run.smithi088.stdout:____________________ test_bucket_create_bad_date_none_aws2 _____________________ 2024-03-09T15:11:37.688 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.688 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.auth_aws2 2024-03-09T15:11:37.688 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:11:37.688 INFO:teuthology.orchestra.run.smithi088.stdout: def test_bucket_create_bad_date_none_aws2(): 2024-03-09T15:11:37.688 INFO:teuthology.orchestra.run.smithi088.stdout: check_aws2_support() 2024-03-09T15:11:37.688 INFO:teuthology.orchestra.run.smithi088.stdout: _add_custom_headers(remove=('Date',)) 2024-03-09T15:11:37.688 INFO:teuthology.orchestra.run.smithi088.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-09T15:11:37.689 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.689 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py:373: 2024-03-09T15:11:37.689 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.689 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.689 INFO:teuthology.orchestra.run.smithi088.stdout:excClass = 2024-03-09T15:11:37.689 INFO:teuthology.orchestra.run.smithi088.stdout:callableObj = , args = () 2024-03-09T15:11:37.689 INFO:teuthology.orchestra.run.smithi088.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:11:37.689 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.689 INFO:teuthology.orchestra.run.smithi088.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:11:37.689 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.689 INFO:teuthology.orchestra.run.smithi088.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:11:37.689 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.689 INFO:teuthology.orchestra.run.smithi088.stdout: try: 2024-03-09T15:11:37.689 INFO:teuthology.orchestra.run.smithi088.stdout: callableObj(*args, **kwargs) 2024-03-09T15:11:37.690 INFO:teuthology.orchestra.run.smithi088.stdout: except excClass as e: 2024-03-09T15:11:37.690 INFO:teuthology.orchestra.run.smithi088.stdout: return e 2024-03-09T15:11:37.690 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.690 INFO:teuthology.orchestra.run.smithi088.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:11:37.690 INFO:teuthology.orchestra.run.smithi088.stdout: excName = excClass.__name__ 2024-03-09T15:11:37.690 INFO:teuthology.orchestra.run.smithi088.stdout: else: 2024-03-09T15:11:37.690 INFO:teuthology.orchestra.run.smithi088.stdout: excName = str(excClass) 2024-03-09T15:11:37.690 INFO:teuthology.orchestra.run.smithi088.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:11:37.690 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:11:37.690 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.690 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:11:37.690 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.690 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on main 2024-03-09T15:11:37.690 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection main prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.690 INFO:teuthology.orchestra.run.smithi088.stdout:prefix= test-client.0-ktjzoc14mjjf4i7- 2024-03-09T15:11:37.691 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning bucket 2024-03-09T15:11:37.691 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on alt 2024-03-09T15:11:37.691 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection alt prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.691 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting buckets on tenant 2024-03-09T15:11:37.691 INFO:teuthology.orchestra.run.smithi088.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-ktjzoc14mjjf4i7-'. 2024-03-09T15:11:37.691 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of test buckets. 2024-03-09T15:11:37.691 INFO:teuthology.orchestra.run.smithi088.stdout:___________________________ test_bucket_acl_default ____________________________ 2024-03-09T15:11:37.691 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.691 INFO:teuthology.orchestra.run.smithi088.stdout: def test_bucket_acl_default(): 2024-03-09T15:11:37.691 INFO:teuthology.orchestra.run.smithi088.stdout: bucket_name = get_new_bucket() 2024-03-09T15:11:37.691 INFO:teuthology.orchestra.run.smithi088.stdout: client = get_client() 2024-03-09T15:11:37.691 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.691 INFO:teuthology.orchestra.run.smithi088.stdout: response = client.get_bucket_acl(Bucket=bucket_name) 2024-03-09T15:11:37.691 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.692 INFO:teuthology.orchestra.run.smithi088.stdout: display_name = get_main_display_name() 2024-03-09T15:11:37.692 INFO:teuthology.orchestra.run.smithi088.stdout: user_id = get_main_user_id() 2024-03-09T15:11:37.692 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.692 INFO:teuthology.orchestra.run.smithi088.stdout:> assert response['Owner']['DisplayName'] == display_name 2024-03-09T15:11:37.692 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.692 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.692 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.692 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.692 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.692 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.692 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3865: AssertionError 2024-03-09T15:11:37.692 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.692 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.692 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.692 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.693 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.693 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.693 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.693 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.693 INFO:teuthology.orchestra.run.smithi088.stdout:_____________________ test_bucket_acl_canned_during_create _____________________ 2024-03-09T15:11:37.693 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.693 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_aws 2024-03-09T15:11:37.693 INFO:teuthology.orchestra.run.smithi088.stdout: def test_bucket_acl_canned_during_create(): 2024-03-09T15:11:37.693 INFO:teuthology.orchestra.run.smithi088.stdout: bucket_name = get_new_bucket_name() 2024-03-09T15:11:37.693 INFO:teuthology.orchestra.run.smithi088.stdout: client = get_client() 2024-03-09T15:11:37.693 INFO:teuthology.orchestra.run.smithi088.stdout: client.create_bucket(ACL='public-read', Bucket=bucket_name) 2024-03-09T15:11:37.693 INFO:teuthology.orchestra.run.smithi088.stdout: response = client.get_bucket_acl(Bucket=bucket_name) 2024-03-09T15:11:37.693 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.693 INFO:teuthology.orchestra.run.smithi088.stdout: display_name = get_main_display_name() 2024-03-09T15:11:37.694 INFO:teuthology.orchestra.run.smithi088.stdout: user_id = get_main_user_id() 2024-03-09T15:11:37.694 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.694 INFO:teuthology.orchestra.run.smithi088.stdout: grants = response['Grants'] 2024-03-09T15:11:37.694 INFO:teuthology.orchestra.run.smithi088.stdout:> check_grants( 2024-03-09T15:11:37.694 INFO:teuthology.orchestra.run.smithi088.stdout: grants, 2024-03-09T15:11:37.694 INFO:teuthology.orchestra.run.smithi088.stdout: [ 2024-03-09T15:11:37.694 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.694 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='READ', 2024-03-09T15:11:37.694 INFO:teuthology.orchestra.run.smithi088.stdout: ID=None, 2024-03-09T15:11:37.694 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=None, 2024-03-09T15:11:37.694 INFO:teuthology.orchestra.run.smithi088.stdout: URI='http://acs.amazonaws.com/groups/global/AllUsers', 2024-03-09T15:11:37.694 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.694 INFO:teuthology.orchestra.run.smithi088.stdout: Type='Group', 2024-03-09T15:11:37.694 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.695 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.695 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='FULL_CONTROL', 2024-03-09T15:11:37.695 INFO:teuthology.orchestra.run.smithi088.stdout: ID=user_id, 2024-03-09T15:11:37.695 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=display_name, 2024-03-09T15:11:37.695 INFO:teuthology.orchestra.run.smithi088.stdout: URI=None, 2024-03-09T15:11:37.695 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.695 INFO:teuthology.orchestra.run.smithi088.stdout: Type='CanonicalUser', 2024-03-09T15:11:37.695 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.695 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T15:11:37.695 INFO:teuthology.orchestra.run.smithi088.stdout: ) 2024-03-09T15:11:37.695 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.695 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3894: 2024-03-09T15:11:37.695 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.695 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.695 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {}, 'Permission': 'READ'}, {'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}] 2024-03-09T15:11:37.696 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': None, 'EmailAddress': None, 'ID': None, 'Permission': 'READ', ...}, {'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CONTROL', ...}] 2024-03-09T15:11:37.696 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.696 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.696 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.696 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.696 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.696 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.696 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.696 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.696 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.696 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.696 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.696 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.696 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.697 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.697 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.697 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.697 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.697 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.697 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.697 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.697 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.697 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.697 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.697 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.697 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.697 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.698 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.698 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.698 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.698 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.698 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.698 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.698 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.698 INFO:teuthology.orchestra.run.smithi088.stdout:____________________________ test_bucket_acl_canned ____________________________ 2024-03-09T15:11:37.698 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.698 INFO:teuthology.orchestra.run.smithi088.stdout: def test_bucket_acl_canned(): 2024-03-09T15:11:37.698 INFO:teuthology.orchestra.run.smithi088.stdout: bucket_name = get_new_bucket_name() 2024-03-09T15:11:37.698 INFO:teuthology.orchestra.run.smithi088.stdout: client = get_client() 2024-03-09T15:11:37.698 INFO:teuthology.orchestra.run.smithi088.stdout: client.create_bucket(ACL='public-read', Bucket=bucket_name) 2024-03-09T15:11:37.699 INFO:teuthology.orchestra.run.smithi088.stdout: response = client.get_bucket_acl(Bucket=bucket_name) 2024-03-09T15:11:37.699 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.699 INFO:teuthology.orchestra.run.smithi088.stdout: display_name = get_main_display_name() 2024-03-09T15:11:37.699 INFO:teuthology.orchestra.run.smithi088.stdout: user_id = get_main_user_id() 2024-03-09T15:11:37.699 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.699 INFO:teuthology.orchestra.run.smithi088.stdout: grants = response['Grants'] 2024-03-09T15:11:37.699 INFO:teuthology.orchestra.run.smithi088.stdout:> check_grants( 2024-03-09T15:11:37.699 INFO:teuthology.orchestra.run.smithi088.stdout: grants, 2024-03-09T15:11:37.699 INFO:teuthology.orchestra.run.smithi088.stdout: [ 2024-03-09T15:11:37.699 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.699 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='READ', 2024-03-09T15:11:37.699 INFO:teuthology.orchestra.run.smithi088.stdout: ID=None, 2024-03-09T15:11:37.699 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=None, 2024-03-09T15:11:37.700 INFO:teuthology.orchestra.run.smithi088.stdout: URI='http://acs.amazonaws.com/groups/global/AllUsers', 2024-03-09T15:11:37.700 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.700 INFO:teuthology.orchestra.run.smithi088.stdout: Type='Group', 2024-03-09T15:11:37.700 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.700 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.700 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='FULL_CONTROL', 2024-03-09T15:11:37.700 INFO:teuthology.orchestra.run.smithi088.stdout: ID=user_id, 2024-03-09T15:11:37.700 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=display_name, 2024-03-09T15:11:37.700 INFO:teuthology.orchestra.run.smithi088.stdout: URI=None, 2024-03-09T15:11:37.700 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.700 INFO:teuthology.orchestra.run.smithi088.stdout: Type='CanonicalUser', 2024-03-09T15:11:37.700 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.700 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T15:11:37.700 INFO:teuthology.orchestra.run.smithi088.stdout: ) 2024-03-09T15:11:37.701 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.701 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3926: 2024-03-09T15:11:37.701 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.701 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.701 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {}, 'Permission': 'READ'}, {'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}] 2024-03-09T15:11:37.701 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': None, 'EmailAddress': None, 'ID': None, 'Permission': 'READ', ...}, {'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CONTROL', ...}] 2024-03-09T15:11:37.701 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.701 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.701 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.701 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.701 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.701 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.701 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.701 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.702 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.702 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.702 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.702 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.702 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.702 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.702 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.702 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.702 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.702 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.702 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.702 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.702 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.703 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.703 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.703 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.703 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.703 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.703 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.703 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.703 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.703 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.703 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.703 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.703 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.703 INFO:teuthology.orchestra.run.smithi088.stdout:____________________ test_bucket_acl_canned_publicreadwrite ____________________ 2024-03-09T15:11:37.703 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.704 INFO:teuthology.orchestra.run.smithi088.stdout: def test_bucket_acl_canned_publicreadwrite(): 2024-03-09T15:11:37.704 INFO:teuthology.orchestra.run.smithi088.stdout: bucket_name = get_new_bucket_name() 2024-03-09T15:11:37.704 INFO:teuthology.orchestra.run.smithi088.stdout: client = get_client() 2024-03-09T15:11:37.704 INFO:teuthology.orchestra.run.smithi088.stdout: client.create_bucket(ACL='public-read-write', Bucket=bucket_name) 2024-03-09T15:11:37.704 INFO:teuthology.orchestra.run.smithi088.stdout: response = client.get_bucket_acl(Bucket=bucket_name) 2024-03-09T15:11:37.704 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.704 INFO:teuthology.orchestra.run.smithi088.stdout: display_name = get_main_display_name() 2024-03-09T15:11:37.704 INFO:teuthology.orchestra.run.smithi088.stdout: user_id = get_main_user_id() 2024-03-09T15:11:37.704 INFO:teuthology.orchestra.run.smithi088.stdout: grants = response['Grants'] 2024-03-09T15:11:37.704 INFO:teuthology.orchestra.run.smithi088.stdout:> check_grants( 2024-03-09T15:11:37.704 INFO:teuthology.orchestra.run.smithi088.stdout: grants, 2024-03-09T15:11:37.704 INFO:teuthology.orchestra.run.smithi088.stdout: [ 2024-03-09T15:11:37.704 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.704 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='READ', 2024-03-09T15:11:37.704 INFO:teuthology.orchestra.run.smithi088.stdout: ID=None, 2024-03-09T15:11:37.705 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=None, 2024-03-09T15:11:37.705 INFO:teuthology.orchestra.run.smithi088.stdout: URI='http://acs.amazonaws.com/groups/global/AllUsers', 2024-03-09T15:11:37.705 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.705 INFO:teuthology.orchestra.run.smithi088.stdout: Type='Group', 2024-03-09T15:11:37.705 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.705 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.705 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='WRITE', 2024-03-09T15:11:37.705 INFO:teuthology.orchestra.run.smithi088.stdout: ID=None, 2024-03-09T15:11:37.705 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=None, 2024-03-09T15:11:37.705 INFO:teuthology.orchestra.run.smithi088.stdout: URI='http://acs.amazonaws.com/groups/global/AllUsers', 2024-03-09T15:11:37.705 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.705 INFO:teuthology.orchestra.run.smithi088.stdout: Type='Group', 2024-03-09T15:11:37.705 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.705 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.706 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='FULL_CONTROL', 2024-03-09T15:11:37.706 INFO:teuthology.orchestra.run.smithi088.stdout: ID=user_id, 2024-03-09T15:11:37.706 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=display_name, 2024-03-09T15:11:37.706 INFO:teuthology.orchestra.run.smithi088.stdout: URI=None, 2024-03-09T15:11:37.706 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.706 INFO:teuthology.orchestra.run.smithi088.stdout: Type='CanonicalUser', 2024-03-09T15:11:37.706 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.706 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T15:11:37.706 INFO:teuthology.orchestra.run.smithi088.stdout: ) 2024-03-09T15:11:37.706 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.706 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3975: 2024-03-09T15:11:37.706 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.706 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.707 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {}, 'Permission': 'READ'}, {'Grantee': {}, 'Permission': 'WRITE'}, {'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}] 2024-03-09T15:11:37.707 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': None, 'EmailAddress': None, 'ID': None, 'Permission': 'READ', ...}, {'DisplayName': None, 'EmailAddre...me': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CONTROL', ...}] 2024-03-09T15:11:37.707 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.707 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.707 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.707 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.707 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.707 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.707 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.707 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.707 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.707 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.707 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.707 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.708 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.708 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.708 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.708 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.708 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.708 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.708 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.708 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.708 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.708 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.708 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.708 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.708 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.708 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.709 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.709 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.709 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.709 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.709 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.709 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.709 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.709 INFO:teuthology.orchestra.run.smithi088.stdout:___________________ test_bucket_acl_canned_authenticatedread ___________________ 2024-03-09T15:11:37.709 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.709 INFO:teuthology.orchestra.run.smithi088.stdout: def test_bucket_acl_canned_authenticatedread(): 2024-03-09T15:11:37.709 INFO:teuthology.orchestra.run.smithi088.stdout: bucket_name = get_new_bucket_name() 2024-03-09T15:11:37.709 INFO:teuthology.orchestra.run.smithi088.stdout: client = get_client() 2024-03-09T15:11:37.709 INFO:teuthology.orchestra.run.smithi088.stdout: client.create_bucket(ACL='authenticated-read', Bucket=bucket_name) 2024-03-09T15:11:37.709 INFO:teuthology.orchestra.run.smithi088.stdout: response = client.get_bucket_acl(Bucket=bucket_name) 2024-03-09T15:11:37.709 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.710 INFO:teuthology.orchestra.run.smithi088.stdout: display_name = get_main_display_name() 2024-03-09T15:11:37.710 INFO:teuthology.orchestra.run.smithi088.stdout: user_id = get_main_user_id() 2024-03-09T15:11:37.710 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.710 INFO:teuthology.orchestra.run.smithi088.stdout: grants = response['Grants'] 2024-03-09T15:11:37.710 INFO:teuthology.orchestra.run.smithi088.stdout:> check_grants( 2024-03-09T15:11:37.710 INFO:teuthology.orchestra.run.smithi088.stdout: grants, 2024-03-09T15:11:37.710 INFO:teuthology.orchestra.run.smithi088.stdout: [ 2024-03-09T15:11:37.710 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.710 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='READ', 2024-03-09T15:11:37.710 INFO:teuthology.orchestra.run.smithi088.stdout: ID=None, 2024-03-09T15:11:37.710 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=None, 2024-03-09T15:11:37.710 INFO:teuthology.orchestra.run.smithi088.stdout: URI='http://acs.amazonaws.com/groups/global/AuthenticatedUsers', 2024-03-09T15:11:37.710 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.710 INFO:teuthology.orchestra.run.smithi088.stdout: Type='Group', 2024-03-09T15:11:37.711 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.711 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.711 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='FULL_CONTROL', 2024-03-09T15:11:37.711 INFO:teuthology.orchestra.run.smithi088.stdout: ID=user_id, 2024-03-09T15:11:37.711 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=display_name, 2024-03-09T15:11:37.711 INFO:teuthology.orchestra.run.smithi088.stdout: URI=None, 2024-03-09T15:11:37.711 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.711 INFO:teuthology.orchestra.run.smithi088.stdout: Type='CanonicalUser', 2024-03-09T15:11:37.711 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.711 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T15:11:37.711 INFO:teuthology.orchestra.run.smithi088.stdout: ) 2024-03-09T15:11:37.711 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.711 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4015: 2024-03-09T15:11:37.711 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.712 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.712 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {}, 'Permission': 'READ'}, {'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}] 2024-03-09T15:11:37.712 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': None, 'EmailAddress': None, 'ID': None, 'Permission': 'READ', ...}, {'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CONTROL', ...}] 2024-03-09T15:11:37.712 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.712 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.712 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.712 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.712 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.712 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.712 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.712 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.712 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.712 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.713 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.713 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.713 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.713 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.713 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.713 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.713 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.713 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.713 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.713 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.713 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.713 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.713 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.714 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.714 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.714 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.714 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.714 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.714 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.714 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.714 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.714 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.714 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.714 INFO:teuthology.orchestra.run.smithi088.stdout:___________________________ test_object_acl_default ____________________________ 2024-03-09T15:11:37.714 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.714 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_acl_default(): 2024-03-09T15:11:37.714 INFO:teuthology.orchestra.run.smithi088.stdout: bucket_name = get_new_bucket() 2024-03-09T15:11:37.714 INFO:teuthology.orchestra.run.smithi088.stdout: client = get_client() 2024-03-09T15:11:37.715 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.715 INFO:teuthology.orchestra.run.smithi088.stdout: client.put_object(Bucket=bucket_name, Key='foo', Body='bar') 2024-03-09T15:11:37.715 INFO:teuthology.orchestra.run.smithi088.stdout: response = client.get_object_acl(Bucket=bucket_name, Key='foo') 2024-03-09T15:11:37.715 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.715 INFO:teuthology.orchestra.run.smithi088.stdout: display_name = get_main_display_name() 2024-03-09T15:11:37.715 INFO:teuthology.orchestra.run.smithi088.stdout: user_id = get_main_user_id() 2024-03-09T15:11:37.715 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.715 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.715 INFO:teuthology.orchestra.run.smithi088.stdout: grants = response['Grants'] 2024-03-09T15:11:37.715 INFO:teuthology.orchestra.run.smithi088.stdout:> check_grants( 2024-03-09T15:11:37.715 INFO:teuthology.orchestra.run.smithi088.stdout: grants, 2024-03-09T15:11:37.715 INFO:teuthology.orchestra.run.smithi088.stdout: [ 2024-03-09T15:11:37.715 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.715 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='FULL_CONTROL', 2024-03-09T15:11:37.716 INFO:teuthology.orchestra.run.smithi088.stdout: ID=user_id, 2024-03-09T15:11:37.716 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=display_name, 2024-03-09T15:11:37.716 INFO:teuthology.orchestra.run.smithi088.stdout: URI=None, 2024-03-09T15:11:37.716 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.716 INFO:teuthology.orchestra.run.smithi088.stdout: Type='CanonicalUser', 2024-03-09T15:11:37.716 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.716 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T15:11:37.716 INFO:teuthology.orchestra.run.smithi088.stdout: ) 2024-03-09T15:11:37.716 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.716 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4049: 2024-03-09T15:11:37.716 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.716 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.716 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}] 2024-03-09T15:11:37.717 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CONTROL', ...}] 2024-03-09T15:11:37.717 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.717 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.717 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.717 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.717 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.717 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.717 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.717 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.717 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.717 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.717 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.717 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.717 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.718 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.718 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.718 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.718 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.718 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.718 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.718 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.718 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.718 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.718 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.718 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.718 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.718 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.719 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.719 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.719 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.719 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.719 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.719 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.719 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.719 INFO:teuthology.orchestra.run.smithi088.stdout:_____________________ test_object_acl_canned_during_create _____________________ 2024-03-09T15:11:37.719 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.719 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_acl_canned_during_create(): 2024-03-09T15:11:37.719 INFO:teuthology.orchestra.run.smithi088.stdout: bucket_name = get_new_bucket() 2024-03-09T15:11:37.719 INFO:teuthology.orchestra.run.smithi088.stdout: client = get_client() 2024-03-09T15:11:37.719 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.720 INFO:teuthology.orchestra.run.smithi088.stdout: client.put_object(ACL='public-read', Bucket=bucket_name, Key='foo', Body='bar') 2024-03-09T15:11:37.720 INFO:teuthology.orchestra.run.smithi088.stdout: response = client.get_object_acl(Bucket=bucket_name, Key='foo') 2024-03-09T15:11:37.720 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.720 INFO:teuthology.orchestra.run.smithi088.stdout: display_name = get_main_display_name() 2024-03-09T15:11:37.720 INFO:teuthology.orchestra.run.smithi088.stdout: user_id = get_main_user_id() 2024-03-09T15:11:37.720 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.720 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.720 INFO:teuthology.orchestra.run.smithi088.stdout: grants = response['Grants'] 2024-03-09T15:11:37.720 INFO:teuthology.orchestra.run.smithi088.stdout:> check_grants( 2024-03-09T15:11:37.720 INFO:teuthology.orchestra.run.smithi088.stdout: grants, 2024-03-09T15:11:37.720 INFO:teuthology.orchestra.run.smithi088.stdout: [ 2024-03-09T15:11:37.720 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.720 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='READ', 2024-03-09T15:11:37.720 INFO:teuthology.orchestra.run.smithi088.stdout: ID=None, 2024-03-09T15:11:37.720 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=None, 2024-03-09T15:11:37.721 INFO:teuthology.orchestra.run.smithi088.stdout: URI='http://acs.amazonaws.com/groups/global/AllUsers', 2024-03-09T15:11:37.721 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.721 INFO:teuthology.orchestra.run.smithi088.stdout: Type='Group', 2024-03-09T15:11:37.721 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.721 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.721 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='FULL_CONTROL', 2024-03-09T15:11:37.721 INFO:teuthology.orchestra.run.smithi088.stdout: ID=user_id, 2024-03-09T15:11:37.721 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=display_name, 2024-03-09T15:11:37.721 INFO:teuthology.orchestra.run.smithi088.stdout: URI=None, 2024-03-09T15:11:37.721 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.721 INFO:teuthology.orchestra.run.smithi088.stdout: Type='CanonicalUser', 2024-03-09T15:11:37.721 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.721 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T15:11:37.721 INFO:teuthology.orchestra.run.smithi088.stdout: ) 2024-03-09T15:11:37.722 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.722 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4075: 2024-03-09T15:11:37.722 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.722 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.722 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {}, 'Permission': 'READ'}, {'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}] 2024-03-09T15:11:37.722 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': None, 'EmailAddress': None, 'ID': None, 'Permission': 'READ', ...}, {'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CONTROL', ...}] 2024-03-09T15:11:37.722 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.722 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.722 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.722 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.722 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.722 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.723 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.723 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.723 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.723 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.723 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.723 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.723 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.723 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.723 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.723 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.723 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.723 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.723 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.723 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.724 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:____________________________ test_object_acl_canned ____________________________ 2024-03-09T15:11:37.725 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.725 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_acl_canned(): 2024-03-09T15:11:37.725 INFO:teuthology.orchestra.run.smithi088.stdout: bucket_name = get_new_bucket() 2024-03-09T15:11:37.725 INFO:teuthology.orchestra.run.smithi088.stdout: client = get_client() 2024-03-09T15:11:37.725 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.725 INFO:teuthology.orchestra.run.smithi088.stdout: # Since it defaults to private, set it public-read first 2024-03-09T15:11:37.725 INFO:teuthology.orchestra.run.smithi088.stdout: client.put_object(ACL='public-read', Bucket=bucket_name, Key='foo', Body='bar') 2024-03-09T15:11:37.725 INFO:teuthology.orchestra.run.smithi088.stdout: response = client.get_object_acl(Bucket=bucket_name, Key='foo') 2024-03-09T15:11:37.725 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.725 INFO:teuthology.orchestra.run.smithi088.stdout: display_name = get_main_display_name() 2024-03-09T15:11:37.725 INFO:teuthology.orchestra.run.smithi088.stdout: user_id = get_main_user_id() 2024-03-09T15:11:37.725 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.725 INFO:teuthology.orchestra.run.smithi088.stdout: grants = response['Grants'] 2024-03-09T15:11:37.725 INFO:teuthology.orchestra.run.smithi088.stdout:> check_grants( 2024-03-09T15:11:37.726 INFO:teuthology.orchestra.run.smithi088.stdout: grants, 2024-03-09T15:11:37.726 INFO:teuthology.orchestra.run.smithi088.stdout: [ 2024-03-09T15:11:37.726 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.726 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='READ', 2024-03-09T15:11:37.726 INFO:teuthology.orchestra.run.smithi088.stdout: ID=None, 2024-03-09T15:11:37.726 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=None, 2024-03-09T15:11:37.726 INFO:teuthology.orchestra.run.smithi088.stdout: URI='http://acs.amazonaws.com/groups/global/AllUsers', 2024-03-09T15:11:37.726 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.726 INFO:teuthology.orchestra.run.smithi088.stdout: Type='Group', 2024-03-09T15:11:37.726 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.726 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.726 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='FULL_CONTROL', 2024-03-09T15:11:37.726 INFO:teuthology.orchestra.run.smithi088.stdout: ID=user_id, 2024-03-09T15:11:37.726 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=display_name, 2024-03-09T15:11:37.727 INFO:teuthology.orchestra.run.smithi088.stdout: URI=None, 2024-03-09T15:11:37.727 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.727 INFO:teuthology.orchestra.run.smithi088.stdout: Type='CanonicalUser', 2024-03-09T15:11:37.727 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.727 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T15:11:37.727 INFO:teuthology.orchestra.run.smithi088.stdout: ) 2024-03-09T15:11:37.727 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.727 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4109: 2024-03-09T15:11:37.727 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.727 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.727 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {}, 'Permission': 'READ'}, {'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}] 2024-03-09T15:11:37.727 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': None, 'EmailAddress': None, 'ID': None, 'Permission': 'READ', ...}, {'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CONTROL', ...}] 2024-03-09T15:11:37.727 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.727 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.728 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.728 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.728 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.728 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.728 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.728 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.728 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.728 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.728 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.728 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.728 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.728 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.728 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.728 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.729 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.729 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.729 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.729 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.729 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.729 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.729 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.729 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.729 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.729 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.729 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.729 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.729 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.730 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.730 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.730 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.730 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.730 INFO:teuthology.orchestra.run.smithi088.stdout:____________________ test_object_acl_canned_publicreadwrite ____________________ 2024-03-09T15:11:37.730 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.730 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_acl_canned_publicreadwrite(): 2024-03-09T15:11:37.730 INFO:teuthology.orchestra.run.smithi088.stdout: bucket_name = get_new_bucket() 2024-03-09T15:11:37.730 INFO:teuthology.orchestra.run.smithi088.stdout: client = get_client() 2024-03-09T15:11:37.730 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.730 INFO:teuthology.orchestra.run.smithi088.stdout: client.put_object(ACL='public-read-write', Bucket=bucket_name, Key='foo', Body='bar') 2024-03-09T15:11:37.730 INFO:teuthology.orchestra.run.smithi088.stdout: response = client.get_object_acl(Bucket=bucket_name, Key='foo') 2024-03-09T15:11:37.730 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.731 INFO:teuthology.orchestra.run.smithi088.stdout: display_name = get_main_display_name() 2024-03-09T15:11:37.731 INFO:teuthology.orchestra.run.smithi088.stdout: user_id = get_main_user_id() 2024-03-09T15:11:37.731 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.731 INFO:teuthology.orchestra.run.smithi088.stdout: grants = response['Grants'] 2024-03-09T15:11:37.731 INFO:teuthology.orchestra.run.smithi088.stdout:> check_grants( 2024-03-09T15:11:37.731 INFO:teuthology.orchestra.run.smithi088.stdout: grants, 2024-03-09T15:11:37.731 INFO:teuthology.orchestra.run.smithi088.stdout: [ 2024-03-09T15:11:37.731 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.731 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='READ', 2024-03-09T15:11:37.731 INFO:teuthology.orchestra.run.smithi088.stdout: ID=None, 2024-03-09T15:11:37.731 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=None, 2024-03-09T15:11:37.731 INFO:teuthology.orchestra.run.smithi088.stdout: URI='http://acs.amazonaws.com/groups/global/AllUsers', 2024-03-09T15:11:37.731 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.732 INFO:teuthology.orchestra.run.smithi088.stdout: Type='Group', 2024-03-09T15:11:37.732 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.732 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.732 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='WRITE', 2024-03-09T15:11:37.732 INFO:teuthology.orchestra.run.smithi088.stdout: ID=None, 2024-03-09T15:11:37.732 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=None, 2024-03-09T15:11:37.732 INFO:teuthology.orchestra.run.smithi088.stdout: URI='http://acs.amazonaws.com/groups/global/AllUsers', 2024-03-09T15:11:37.732 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.732 INFO:teuthology.orchestra.run.smithi088.stdout: Type='Group', 2024-03-09T15:11:37.732 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.732 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.732 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='FULL_CONTROL', 2024-03-09T15:11:37.732 INFO:teuthology.orchestra.run.smithi088.stdout: ID=user_id, 2024-03-09T15:11:37.732 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=display_name, 2024-03-09T15:11:37.733 INFO:teuthology.orchestra.run.smithi088.stdout: URI=None, 2024-03-09T15:11:37.733 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.733 INFO:teuthology.orchestra.run.smithi088.stdout: Type='CanonicalUser', 2024-03-09T15:11:37.733 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.733 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T15:11:37.733 INFO:teuthology.orchestra.run.smithi088.stdout: ) 2024-03-09T15:11:37.733 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.733 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4161: 2024-03-09T15:11:37.733 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.733 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.733 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {}, 'Permission': 'READ'}, {'Grantee': {}, 'Permission': 'WRITE'}, {'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}] 2024-03-09T15:11:37.733 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': None, 'EmailAddress': None, 'ID': None, 'Permission': 'READ', ...}, {'DisplayName': None, 'EmailAddre...me': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CONTROL', ...}] 2024-03-09T15:11:37.733 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.733 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.734 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.734 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.734 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.734 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.734 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.734 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.734 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.734 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.734 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.734 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.734 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.734 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.734 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.734 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.735 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.735 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.735 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.735 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.735 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.735 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.735 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.735 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.735 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.735 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.735 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.735 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.735 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.735 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.736 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.736 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.736 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.736 INFO:teuthology.orchestra.run.smithi088.stdout:___________________ test_object_acl_canned_authenticatedread ___________________ 2024-03-09T15:11:37.736 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.736 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_acl_canned_authenticatedread(): 2024-03-09T15:11:37.736 INFO:teuthology.orchestra.run.smithi088.stdout: bucket_name = get_new_bucket() 2024-03-09T15:11:37.736 INFO:teuthology.orchestra.run.smithi088.stdout: client = get_client() 2024-03-09T15:11:37.736 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.736 INFO:teuthology.orchestra.run.smithi088.stdout: client.put_object(ACL='authenticated-read', Bucket=bucket_name, Key='foo', Body='bar') 2024-03-09T15:11:37.736 INFO:teuthology.orchestra.run.smithi088.stdout: response = client.get_object_acl(Bucket=bucket_name, Key='foo') 2024-03-09T15:11:37.736 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.736 INFO:teuthology.orchestra.run.smithi088.stdout: display_name = get_main_display_name() 2024-03-09T15:11:37.736 INFO:teuthology.orchestra.run.smithi088.stdout: user_id = get_main_user_id() 2024-03-09T15:11:37.736 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.737 INFO:teuthology.orchestra.run.smithi088.stdout: grants = response['Grants'] 2024-03-09T15:11:37.737 INFO:teuthology.orchestra.run.smithi088.stdout:> check_grants( 2024-03-09T15:11:37.737 INFO:teuthology.orchestra.run.smithi088.stdout: grants, 2024-03-09T15:11:37.737 INFO:teuthology.orchestra.run.smithi088.stdout: [ 2024-03-09T15:11:37.737 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.737 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='READ', 2024-03-09T15:11:37.737 INFO:teuthology.orchestra.run.smithi088.stdout: ID=None, 2024-03-09T15:11:37.737 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=None, 2024-03-09T15:11:37.737 INFO:teuthology.orchestra.run.smithi088.stdout: URI='http://acs.amazonaws.com/groups/global/AuthenticatedUsers', 2024-03-09T15:11:37.737 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.737 INFO:teuthology.orchestra.run.smithi088.stdout: Type='Group', 2024-03-09T15:11:37.737 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.737 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.738 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='FULL_CONTROL', 2024-03-09T15:11:37.738 INFO:teuthology.orchestra.run.smithi088.stdout: ID=user_id, 2024-03-09T15:11:37.738 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=display_name, 2024-03-09T15:11:37.738 INFO:teuthology.orchestra.run.smithi088.stdout: URI=None, 2024-03-09T15:11:37.738 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.738 INFO:teuthology.orchestra.run.smithi088.stdout: Type='CanonicalUser', 2024-03-09T15:11:37.738 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.738 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-03-09T15:11:37.738 INFO:teuthology.orchestra.run.smithi088.stdout: ) 2024-03-09T15:11:37.738 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.738 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4202: 2024-03-09T15:11:37.738 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.738 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.738 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {}, 'Permission': 'READ'}, {'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}] 2024-03-09T15:11:37.738 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': None, 'EmailAddress': None, 'ID': None, 'Permission': 'READ', ...}, {'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CONTROL', ...}] 2024-03-09T15:11:37.739 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.739 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.739 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.739 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.739 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.739 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.739 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.739 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.739 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.739 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.739 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.739 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.739 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.739 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.740 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.740 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.740 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.740 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.740 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.740 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.740 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.740 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.740 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.740 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.740 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.740 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.740 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.740 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.741 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.741 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.741 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.741 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.741 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.741 INFO:teuthology.orchestra.run.smithi088.stdout:_______________________________ test_object_acl ________________________________ 2024-03-09T15:11:37.741 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.741 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_aws 2024-03-09T15:11:37.741 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_acl(): 2024-03-09T15:11:37.741 INFO:teuthology.orchestra.run.smithi088.stdout:> _check_object_acl('FULL_CONTROL') 2024-03-09T15:11:37.741 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.741 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4457: 2024-03-09T15:11:37.741 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.741 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4440: in _check_object_acl 2024-03-09T15:11:37.742 INFO:teuthology.orchestra.run.smithi088.stdout: check_grants( 2024-03-09T15:11:37.742 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.742 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.742 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}] 2024-03-09T15:11:37.742 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CONTROL', ...}] 2024-03-09T15:11:37.742 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.742 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.742 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.742 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.742 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.742 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.742 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.742 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.742 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.743 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.743 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.743 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.743 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.743 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.743 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.743 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.743 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.743 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.743 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.743 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.743 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.743 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.743 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.743 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.744 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.744 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.744 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.744 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.744 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.744 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.744 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.744 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.744 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.744 INFO:teuthology.orchestra.run.smithi088.stdout:____________________________ test_object_acl_write _____________________________ 2024-03-09T15:11:37.744 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.744 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_aws 2024-03-09T15:11:37.744 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_acl_write(): 2024-03-09T15:11:37.744 INFO:teuthology.orchestra.run.smithi088.stdout:> _check_object_acl('WRITE') 2024-03-09T15:11:37.745 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.745 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4461: 2024-03-09T15:11:37.745 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.745 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4440: in _check_object_acl 2024-03-09T15:11:37.745 INFO:teuthology.orchestra.run.smithi088.stdout: check_grants( 2024-03-09T15:11:37.745 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.745 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.745 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'WRITE'}] 2024-03-09T15:11:37.745 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'WRITE', ...}] 2024-03-09T15:11:37.745 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.745 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.745 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.745 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.745 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.746 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.746 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.746 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.746 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.746 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.746 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.746 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.746 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.746 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.746 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.746 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.746 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.746 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.746 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.747 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.747 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.747 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.747 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.747 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.747 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.747 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.747 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.747 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.747 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.747 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.747 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.747 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.748 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.748 INFO:teuthology.orchestra.run.smithi088.stdout:___________________________ test_object_acl_writeacp ___________________________ 2024-03-09T15:11:37.748 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.748 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_aws 2024-03-09T15:11:37.748 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_acl_writeacp(): 2024-03-09T15:11:37.748 INFO:teuthology.orchestra.run.smithi088.stdout:> _check_object_acl('WRITE_ACP') 2024-03-09T15:11:37.748 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.748 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4465: 2024-03-09T15:11:37.748 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.748 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4440: in _check_object_acl 2024-03-09T15:11:37.748 INFO:teuthology.orchestra.run.smithi088.stdout: check_grants( 2024-03-09T15:11:37.748 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.748 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.748 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'WRITE_ACP'}] 2024-03-09T15:11:37.748 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'WRITE_ACP', ...}] 2024-03-09T15:11:37.749 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.749 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.749 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.749 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.749 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.749 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.749 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.749 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.749 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.749 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.749 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.749 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.749 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.749 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.750 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.750 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.750 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.750 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.750 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.750 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.750 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.750 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.750 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.750 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.750 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.750 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.750 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.750 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.751 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.751 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.751 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.751 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.751 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.751 INFO:teuthology.orchestra.run.smithi088.stdout:_____________________________ test_object_acl_read _____________________________ 2024-03-09T15:11:37.751 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.751 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_aws 2024-03-09T15:11:37.751 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_acl_read(): 2024-03-09T15:11:37.751 INFO:teuthology.orchestra.run.smithi088.stdout:> _check_object_acl('READ') 2024-03-09T15:11:37.751 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.751 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4470: 2024-03-09T15:11:37.751 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.751 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4440: in _check_object_acl 2024-03-09T15:11:37.752 INFO:teuthology.orchestra.run.smithi088.stdout: check_grants( 2024-03-09T15:11:37.752 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.752 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.752 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'READ'}] 2024-03-09T15:11:37.752 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'READ', ...}] 2024-03-09T15:11:37.752 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.752 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.752 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.752 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.752 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.752 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.752 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.752 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.752 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.753 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.753 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.753 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.753 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.753 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.753 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.753 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.753 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.753 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.753 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.753 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.753 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.753 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.754 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.754 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.754 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.754 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.754 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.754 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.754 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.754 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.754 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.754 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.754 INFO:teuthology.orchestra.run.smithi088.stdout:___________________________ test_object_acl_readacp ____________________________ 2024-03-09T15:11:37.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.755 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_aws 2024-03-09T15:11:37.755 INFO:teuthology.orchestra.run.smithi088.stdout: def test_object_acl_readacp(): 2024-03-09T15:11:37.755 INFO:teuthology.orchestra.run.smithi088.stdout:> _check_object_acl('READ_ACP') 2024-03-09T15:11:37.755 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.755 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4475: 2024-03-09T15:11:37.755 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.755 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4440: in _check_object_acl 2024-03-09T15:11:37.755 INFO:teuthology.orchestra.run.smithi088.stdout: check_grants( 2024-03-09T15:11:37.755 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.755 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.755 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'READ_ACP'}] 2024-03-09T15:11:37.755 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'READ_ACP', ...}] 2024-03-09T15:11:37.755 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.755 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.755 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.756 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.756 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.756 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.756 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.756 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.756 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.756 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.756 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.756 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.756 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.756 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.756 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.756 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.757 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.757 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.757 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.757 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.757 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.757 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.757 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.757 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.757 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.757 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.757 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.757 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.757 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.757 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.757 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.758 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.758 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.758 INFO:teuthology.orchestra.run.smithi088.stdout:___________________ test_bucket_acl_grant_userid_fullcontrol ___________________ 2024-03-09T15:11:37.758 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.758 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_aws 2024-03-09T15:11:37.758 INFO:teuthology.orchestra.run.smithi088.stdout: def test_bucket_acl_grant_userid_fullcontrol(): 2024-03-09T15:11:37.758 INFO:teuthology.orchestra.run.smithi088.stdout:> bucket_name = _bucket_acl_grant_userid('FULL_CONTROL') 2024-03-09T15:11:37.758 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.758 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4584: 2024-03-09T15:11:37.758 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.758 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4501: in _bucket_acl_grant_userid 2024-03-09T15:11:37.758 INFO:teuthology.orchestra.run.smithi088.stdout: check_grants( 2024-03-09T15:11:37.759 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.759 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.759 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}, {'Grantee': {'DisplayName': 'Mr.bar.client.0', 'ID': 'bar.client.0', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}] 2024-03-09T15:11:37.759 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CO.....}, {'DisplayName': 'Mr.bar.client.0', 'EmailAddress': None, 'ID': 'bar.client.0', 'Permission': 'FULL_CONTROL', ...}] 2024-03-09T15:11:37.759 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.759 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.759 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.759 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.759 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.759 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.759 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.759 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.759 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.759 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.759 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.760 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.760 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.760 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.760 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.760 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.760 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.760 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.760 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.760 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.760 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.760 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.760 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.760 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.760 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.761 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.761 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.761 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.761 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.761 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.761 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.761 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.761 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.761 INFO:teuthology.orchestra.run.smithi088.stdout:______________________ test_bucket_acl_grant_userid_read _______________________ 2024-03-09T15:11:37.761 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.761 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_aws 2024-03-09T15:11:37.761 INFO:teuthology.orchestra.run.smithi088.stdout: def test_bucket_acl_grant_userid_read(): 2024-03-09T15:11:37.761 INFO:teuthology.orchestra.run.smithi088.stdout:> bucket_name = _bucket_acl_grant_userid('READ') 2024-03-09T15:11:37.761 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.762 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4609: 2024-03-09T15:11:37.762 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.762 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4501: in _bucket_acl_grant_userid 2024-03-09T15:11:37.762 INFO:teuthology.orchestra.run.smithi088.stdout: check_grants( 2024-03-09T15:11:37.762 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.762 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.762 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}, {'Grantee': {'DisplayName': 'Mr.bar.client.0', 'ID': 'bar.client.0', 'Type': 'CanonicalUser'}, 'Permission': 'READ'}] 2024-03-09T15:11:37.762 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CONTROL', ...}, {'DisplayName': 'Mr.bar.client.0', 'EmailAddress': None, 'ID': 'bar.client.0', 'Permission': 'READ', ...}] 2024-03-09T15:11:37.762 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.762 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.762 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.762 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.762 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.763 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.763 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.763 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.763 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.763 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.763 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.763 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.763 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.763 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.763 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.763 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.763 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.763 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.763 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.764 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.764 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.764 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.764 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.764 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.764 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.764 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.764 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.764 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.764 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.764 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.764 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.764 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.764 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.764 INFO:teuthology.orchestra.run.smithi088.stdout:_____________________ test_bucket_acl_grant_userid_readacp _____________________ 2024-03-09T15:11:37.765 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.765 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_aws 2024-03-09T15:11:37.765 INFO:teuthology.orchestra.run.smithi088.stdout: def test_bucket_acl_grant_userid_readacp(): 2024-03-09T15:11:37.765 INFO:teuthology.orchestra.run.smithi088.stdout:> bucket_name = _bucket_acl_grant_userid('READ_ACP') 2024-03-09T15:11:37.765 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.765 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4622: 2024-03-09T15:11:37.765 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.765 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4501: in _bucket_acl_grant_userid 2024-03-09T15:11:37.765 INFO:teuthology.orchestra.run.smithi088.stdout: check_grants( 2024-03-09T15:11:37.765 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.765 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.765 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}, {'Grantee': {'DisplayName': 'Mr.bar.client.0', 'ID': 'bar.client.0', 'Type': 'CanonicalUser'}, 'Permission': 'READ_ACP'}] 2024-03-09T15:11:37.765 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CO...', ...}, {'DisplayName': 'Mr.bar.client.0', 'EmailAddress': None, 'ID': 'bar.client.0', 'Permission': 'READ_ACP', ...}] 2024-03-09T15:11:37.765 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.766 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.766 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.766 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.766 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.766 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.766 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.766 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.766 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.766 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.766 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.766 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.766 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.767 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.767 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.767 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.767 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.767 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.767 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.767 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.767 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.767 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.767 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.767 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.767 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.767 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.767 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.768 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.768 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.768 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.768 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.768 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.768 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.768 INFO:teuthology.orchestra.run.smithi088.stdout:______________________ test_bucket_acl_grant_userid_write ______________________ 2024-03-09T15:11:37.768 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.768 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_aws 2024-03-09T15:11:37.768 INFO:teuthology.orchestra.run.smithi088.stdout: def test_bucket_acl_grant_userid_write(): 2024-03-09T15:11:37.768 INFO:teuthology.orchestra.run.smithi088.stdout:> bucket_name = _bucket_acl_grant_userid('WRITE') 2024-03-09T15:11:37.768 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.768 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4636: 2024-03-09T15:11:37.768 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.769 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4501: in _bucket_acl_grant_userid 2024-03-09T15:11:37.769 INFO:teuthology.orchestra.run.smithi088.stdout: check_grants( 2024-03-09T15:11:37.769 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.769 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.769 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}, {'Grantee': {'DisplayName': 'Mr.bar.client.0', 'ID': 'bar.client.0', 'Type': 'CanonicalUser'}, 'Permission': 'WRITE'}] 2024-03-09T15:11:37.769 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CONTROL', ...}, {'DisplayName': 'Mr.bar.client.0', 'EmailAddress': None, 'ID': 'bar.client.0', 'Permission': 'WRITE', ...}] 2024-03-09T15:11:37.769 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.769 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.769 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.769 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.769 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.769 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.769 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.770 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.770 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.770 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.770 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.770 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.770 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.770 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.770 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.770 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.770 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.770 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.770 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.770 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.770 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.771 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.771 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.771 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.771 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.771 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.771 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.771 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.771 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.771 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.771 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.771 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.771 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.771 INFO:teuthology.orchestra.run.smithi088.stdout:____________________ test_bucket_acl_grant_userid_writeacp _____________________ 2024-03-09T15:11:37.771 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.772 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_aws 2024-03-09T15:11:37.772 INFO:teuthology.orchestra.run.smithi088.stdout: def test_bucket_acl_grant_userid_writeacp(): 2024-03-09T15:11:37.772 INFO:teuthology.orchestra.run.smithi088.stdout:> bucket_name = _bucket_acl_grant_userid('WRITE_ACP') 2024-03-09T15:11:37.772 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.772 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4649: 2024-03-09T15:11:37.772 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.772 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4501: in _bucket_acl_grant_userid 2024-03-09T15:11:37.772 INFO:teuthology.orchestra.run.smithi088.stdout: check_grants( 2024-03-09T15:11:37.772 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.772 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.772 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}, {'Grantee': {'DisplayName': 'Mr.bar.client.0', 'ID': 'bar.client.0', 'Type': 'CanonicalUser'}, 'Permission': 'WRITE_ACP'}] 2024-03-09T15:11:37.772 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CO..., ...}, {'DisplayName': 'Mr.bar.client.0', 'EmailAddress': None, 'ID': 'bar.client.0', 'Permission': 'WRITE_ACP', ...}] 2024-03-09T15:11:37.772 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.772 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.773 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.773 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.773 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.773 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.773 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.773 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.773 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.773 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.773 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.773 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.773 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.773 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.773 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.773 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.774 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.774 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.774 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.774 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.774 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.774 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.774 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.774 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.774 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.774 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.774 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.774 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.774 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.775 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.775 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.775 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.775 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.775 INFO:teuthology.orchestra.run.smithi088.stdout:_________________________ test_bucket_acl_grant_email __________________________ 2024-03-09T15:11:37.775 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.775 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_aws 2024-03-09T15:11:37.775 INFO:teuthology.orchestra.run.smithi088.stdout: def test_bucket_acl_grant_email(): 2024-03-09T15:11:37.775 INFO:teuthology.orchestra.run.smithi088.stdout: bucket_name = get_new_bucket() 2024-03-09T15:11:37.775 INFO:teuthology.orchestra.run.smithi088.stdout: client = get_client() 2024-03-09T15:11:37.775 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.775 INFO:teuthology.orchestra.run.smithi088.stdout: alt_user_id = get_alt_user_id() 2024-03-09T15:11:37.775 INFO:teuthology.orchestra.run.smithi088.stdout: alt_display_name = get_alt_display_name() 2024-03-09T15:11:37.775 INFO:teuthology.orchestra.run.smithi088.stdout: alt_email_address = get_alt_email() 2024-03-09T15:11:37.776 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.776 INFO:teuthology.orchestra.run.smithi088.stdout: main_user_id = get_main_user_id() 2024-03-09T15:11:37.776 INFO:teuthology.orchestra.run.smithi088.stdout: main_display_name = get_main_display_name() 2024-03-09T15:11:37.776 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.776 INFO:teuthology.orchestra.run.smithi088.stdout: grant = {'Grantee': {'EmailAddress': alt_email_address, 'Type': 'AmazonCustomerByEmail' }, 'Permission': 'FULL_CONTROL'} 2024-03-09T15:11:37.776 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.776 INFO:teuthology.orchestra.run.smithi088.stdout: grant = add_bucket_user_grant(bucket_name, grant) 2024-03-09T15:11:37.776 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.776 INFO:teuthology.orchestra.run.smithi088.stdout: client.put_bucket_acl(Bucket=bucket_name, AccessControlPolicy = grant) 2024-03-09T15:11:37.776 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.776 INFO:teuthology.orchestra.run.smithi088.stdout: response = client.get_bucket_acl(Bucket=bucket_name) 2024-03-09T15:11:37.776 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.776 INFO:teuthology.orchestra.run.smithi088.stdout: grants = response['Grants'] 2024-03-09T15:11:37.776 INFO:teuthology.orchestra.run.smithi088.stdout:> check_grants( 2024-03-09T15:11:37.777 INFO:teuthology.orchestra.run.smithi088.stdout: grants, 2024-03-09T15:11:37.777 INFO:teuthology.orchestra.run.smithi088.stdout: [ 2024-03-09T15:11:37.777 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.777 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='FULL_CONTROL', 2024-03-09T15:11:37.777 INFO:teuthology.orchestra.run.smithi088.stdout: ID=alt_user_id, 2024-03-09T15:11:37.777 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=alt_display_name, 2024-03-09T15:11:37.777 INFO:teuthology.orchestra.run.smithi088.stdout: URI=None, 2024-03-09T15:11:37.777 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.777 INFO:teuthology.orchestra.run.smithi088.stdout: Type='CanonicalUser', 2024-03-09T15:11:37.777 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.777 INFO:teuthology.orchestra.run.smithi088.stdout: dict( 2024-03-09T15:11:37.777 INFO:teuthology.orchestra.run.smithi088.stdout: Permission='FULL_CONTROL', 2024-03-09T15:11:37.777 INFO:teuthology.orchestra.run.smithi088.stdout: ID=main_user_id, 2024-03-09T15:11:37.778 INFO:teuthology.orchestra.run.smithi088.stdout: DisplayName=main_display_name, 2024-03-09T15:11:37.778 INFO:teuthology.orchestra.run.smithi088.stdout: URI=None, 2024-03-09T15:11:37.778 INFO:teuthology.orchestra.run.smithi088.stdout: EmailAddress=None, 2024-03-09T15:11:37.778 INFO:teuthology.orchestra.run.smithi088.stdout: Type='CanonicalUser', 2024-03-09T15:11:37.778 INFO:teuthology.orchestra.run.smithi088.stdout: ), 2024-03-09T15:11:37.778 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-03-09T15:11:37.778 INFO:teuthology.orchestra.run.smithi088.stdout: ) 2024-03-09T15:11:37.778 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.778 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:4864: 2024-03-09T15:11:37.778 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.778 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.778 INFO:teuthology.orchestra.run.smithi088.stdout:got = [{'Grantee': {'ID': 'RGW11111111111111111', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}, {'Grantee': {'DisplayName': 'Mr.bar.client.0', 'ID': 'bar.client.0', 'Type': 'CanonicalUser'}, 'Permission': 'FULL_CONTROL'}] 2024-03-09T15:11:37.778 INFO:teuthology.orchestra.run.smithi088.stdout:want = [{'DisplayName': 'Mr.RGW11111111111111111', 'EmailAddress': None, 'ID': 'RGW11111111111111111', 'Permission': 'FULL_CO.....}, {'DisplayName': 'Mr.bar.client.0', 'EmailAddress': None, 'ID': 'bar.client.0', 'Permission': 'FULL_CONTROL', ...}] 2024-03-09T15:11:37.778 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.779 INFO:teuthology.orchestra.run.smithi088.stdout: def check_grants(got, want): 2024-03-09T15:11:37.779 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.779 INFO:teuthology.orchestra.run.smithi088.stdout: Check that grants list in got matches the dictionaries in want, 2024-03-09T15:11:37.779 INFO:teuthology.orchestra.run.smithi088.stdout: in any order. 2024-03-09T15:11:37.779 INFO:teuthology.orchestra.run.smithi088.stdout: """ 2024-03-09T15:11:37.779 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(got) == len(want) 2024-03-09T15:11:37.779 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.779 INFO:teuthology.orchestra.run.smithi088.stdout: # There are instances when got does not match due the order of item. 2024-03-09T15:11:37.779 INFO:teuthology.orchestra.run.smithi088.stdout: if got[0]["Grantee"].get("DisplayName"): 2024-03-09T15:11:37.779 INFO:teuthology.orchestra.run.smithi088.stdout: got.sort(key=lambda x: x["Grantee"].get("DisplayName")) 2024-03-09T15:11:37.779 INFO:teuthology.orchestra.run.smithi088.stdout: want.sort(key=lambda x: x["DisplayName"]) 2024-03-09T15:11:37.779 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.780 INFO:teuthology.orchestra.run.smithi088.stdout: for g, w in zip(got, want): 2024-03-09T15:11:37.780 INFO:teuthology.orchestra.run.smithi088.stdout: w = dict(w) 2024-03-09T15:11:37.780 INFO:teuthology.orchestra.run.smithi088.stdout: g = dict(g) 2024-03-09T15:11:37.780 INFO:teuthology.orchestra.run.smithi088.stdout: assert g.pop('Permission', None) == w['Permission'] 2024-03-09T15:11:37.780 INFO:teuthology.orchestra.run.smithi088.stdout:> assert g['Grantee'].pop('DisplayName', None) == w['DisplayName'] 2024-03-09T15:11:37.780 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.780 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.780 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.780 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.780 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.780 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.780 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:3848: AssertionError 2024-03-09T15:11:37.780 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.781 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.781 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.781 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.781 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.781 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.781 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.781 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.781 INFO:teuthology.orchestra.run.smithi088.stdout:_______________________ test_list_multipart_upload_owner _______________________ 2024-03-09T15:11:37.781 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.781 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:11:37.781 INFO:teuthology.orchestra.run.smithi088.stdout: def test_list_multipart_upload_owner(): 2024-03-09T15:11:37.781 INFO:teuthology.orchestra.run.smithi088.stdout: bucket_name = get_new_bucket() 2024-03-09T15:11:37.781 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.781 INFO:teuthology.orchestra.run.smithi088.stdout: client1 = get_client() 2024-03-09T15:11:37.782 INFO:teuthology.orchestra.run.smithi088.stdout: user1 = get_main_user_id() 2024-03-09T15:11:37.782 INFO:teuthology.orchestra.run.smithi088.stdout: name1 = get_main_display_name() 2024-03-09T15:11:37.782 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.782 INFO:teuthology.orchestra.run.smithi088.stdout: client2 = get_alt_client() 2024-03-09T15:11:37.782 INFO:teuthology.orchestra.run.smithi088.stdout: user2 = get_alt_user_id() 2024-03-09T15:11:37.782 INFO:teuthology.orchestra.run.smithi088.stdout: name2 = get_alt_display_name() 2024-03-09T15:11:37.782 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.782 INFO:teuthology.orchestra.run.smithi088.stdout: # add bucket acl for public read/write access 2024-03-09T15:11:37.782 INFO:teuthology.orchestra.run.smithi088.stdout: client1.put_bucket_acl(Bucket=bucket_name, ACL='public-read-write') 2024-03-09T15:11:37.782 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.782 INFO:teuthology.orchestra.run.smithi088.stdout: key1 = 'multipart1' 2024-03-09T15:11:37.782 INFO:teuthology.orchestra.run.smithi088.stdout: key2 = 'multipart2' 2024-03-09T15:11:37.782 INFO:teuthology.orchestra.run.smithi088.stdout: upload1 = client1.create_multipart_upload(Bucket=bucket_name, Key=key1)['UploadId'] 2024-03-09T15:11:37.782 INFO:teuthology.orchestra.run.smithi088.stdout: try: 2024-03-09T15:11:37.783 INFO:teuthology.orchestra.run.smithi088.stdout: upload2 = client2.create_multipart_upload(Bucket=bucket_name, Key=key2)['UploadId'] 2024-03-09T15:11:37.783 INFO:teuthology.orchestra.run.smithi088.stdout: try: 2024-03-09T15:11:37.783 INFO:teuthology.orchestra.run.smithi088.stdout: # match fields of an Upload from ListMultipartUploadsResult 2024-03-09T15:11:37.783 INFO:teuthology.orchestra.run.smithi088.stdout: def match(upload, key, uploadid, userid, username): 2024-03-09T15:11:37.783 INFO:teuthology.orchestra.run.smithi088.stdout: assert upload['Key'] == key 2024-03-09T15:11:37.783 INFO:teuthology.orchestra.run.smithi088.stdout: assert upload['UploadId'] == uploadid 2024-03-09T15:11:37.783 INFO:teuthology.orchestra.run.smithi088.stdout: assert upload['Initiator']['ID'] == userid 2024-03-09T15:11:37.783 INFO:teuthology.orchestra.run.smithi088.stdout: assert upload['Initiator']['DisplayName'] == username 2024-03-09T15:11:37.783 INFO:teuthology.orchestra.run.smithi088.stdout: assert upload['Owner']['ID'] == userid 2024-03-09T15:11:37.783 INFO:teuthology.orchestra.run.smithi088.stdout: assert upload['Owner']['DisplayName'] == username 2024-03-09T15:11:37.783 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.783 INFO:teuthology.orchestra.run.smithi088.stdout: # list uploads with client1 2024-03-09T15:11:37.783 INFO:teuthology.orchestra.run.smithi088.stdout: uploads1 = client1.list_multipart_uploads(Bucket=bucket_name)['Uploads'] 2024-03-09T15:11:37.783 INFO:teuthology.orchestra.run.smithi088.stdout: assert len(uploads1) == 2 2024-03-09T15:11:37.784 INFO:teuthology.orchestra.run.smithi088.stdout:> match(uploads1[0], key1, upload1, user1, name1) 2024-03-09T15:11:37.784 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.784 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:6362: 2024-03-09T15:11:37.784 INFO:teuthology.orchestra.run.smithi088.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:11:37.784 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.784 INFO:teuthology.orchestra.run.smithi088.stdout:upload = {'Initiated': datetime.datetime(2024, 3, 9, 15, 2, 37, 891000, tzinfo=tzlocal()), 'Initiator': {'DisplayName': 'Mr. RG...111111'}, 'Key': 'multipart1', 'Owner': {'DisplayName': 'Mr. RGW11111111111111111', 'ID': 'RGW11111111111111111'}, ...} 2024-03-09T15:11:37.784 INFO:teuthology.orchestra.run.smithi088.stdout:key = 'multipart1', uploadid = '2~a5gbuLE2SFgQrlnWf_r5_RCyzP2IZaV' 2024-03-09T15:11:37.784 INFO:teuthology.orchestra.run.smithi088.stdout:userid = 'RGW11111111111111111', username = 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.784 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.784 INFO:teuthology.orchestra.run.smithi088.stdout: def match(upload, key, uploadid, userid, username): 2024-03-09T15:11:37.784 INFO:teuthology.orchestra.run.smithi088.stdout: assert upload['Key'] == key 2024-03-09T15:11:37.784 INFO:teuthology.orchestra.run.smithi088.stdout: assert upload['UploadId'] == uploadid 2024-03-09T15:11:37.784 INFO:teuthology.orchestra.run.smithi088.stdout: assert upload['Initiator']['ID'] == userid 2024-03-09T15:11:37.785 INFO:teuthology.orchestra.run.smithi088.stdout:> assert upload['Initiator']['DisplayName'] == username 2024-03-09T15:11:37.785 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.785 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.785 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.785 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.785 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.785 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.785 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:6355: AssertionError 2024-03-09T15:11:37.785 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.785 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.785 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.785 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.785 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.786 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.786 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.786 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.786 INFO:teuthology.orchestra.run.smithi088.stdout:__________________________ test_versioned_object_acl ___________________________ 2024-03-09T15:11:37.786 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.786 INFO:teuthology.orchestra.run.smithi088.stdout: def test_versioned_object_acl(): 2024-03-09T15:11:37.786 INFO:teuthology.orchestra.run.smithi088.stdout: bucket_name = get_new_bucket() 2024-03-09T15:11:37.786 INFO:teuthology.orchestra.run.smithi088.stdout: client = get_client() 2024-03-09T15:11:37.786 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.786 INFO:teuthology.orchestra.run.smithi088.stdout: check_configure_versioning_retry(bucket_name, "Enabled", "Enabled") 2024-03-09T15:11:37.786 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.786 INFO:teuthology.orchestra.run.smithi088.stdout: key = 'xyz' 2024-03-09T15:11:37.786 INFO:teuthology.orchestra.run.smithi088.stdout: num_versions = 3 2024-03-09T15:11:37.786 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout: (version_ids, contents) = create_multiple_versions(client, bucket_name, key, num_versions) 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout: version_id = version_ids[1] 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout: response = client.get_object_acl(Bucket=bucket_name, Key=key, VersionId=version_id) 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout: display_name = get_main_display_name() 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout: user_id = get_main_user_id() 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout:> assert response['Owner']['DisplayName'] == display_name 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.787 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.788 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:7843: AssertionError 2024-03-09T15:11:37.788 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.788 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.788 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.788 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.788 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.788 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.788 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.788 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.788 INFO:teuthology.orchestra.run.smithi088.stdout:________________ test_versioned_object_acl_no_version_specified ________________ 2024-03-09T15:11:37.788 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.788 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:11:37.788 INFO:teuthology.orchestra.run.smithi088.stdout: def test_versioned_object_acl_no_version_specified(): 2024-03-09T15:11:37.788 INFO:teuthology.orchestra.run.smithi088.stdout: bucket_name = get_new_bucket() 2024-03-09T15:11:37.788 INFO:teuthology.orchestra.run.smithi088.stdout: client = get_client() 2024-03-09T15:11:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: check_configure_versioning_retry(bucket_name, "Enabled", "Enabled") 2024-03-09T15:11:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: key = 'xyz' 2024-03-09T15:11:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: num_versions = 3 2024-03-09T15:11:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: (version_ids, contents) = create_multiple_versions(client, bucket_name, key, num_versions) 2024-03-09T15:11:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: response = client.get_object(Bucket=bucket_name, Key=key) 2024-03-09T15:11:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: version_id = response['VersionId'] 2024-03-09T15:11:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: response = client.get_object_acl(Bucket=bucket_name, Key=key, VersionId=version_id) 2024-03-09T15:11:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: display_name = get_main_display_name() 2024-03-09T15:11:37.789 INFO:teuthology.orchestra.run.smithi088.stdout: user_id = get_main_user_id() 2024-03-09T15:11:37.790 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.790 INFO:teuthology.orchestra.run.smithi088.stdout:> assert response['Owner']['DisplayName'] == display_name 2024-03-09T15:11:37.790 INFO:teuthology.orchestra.run.smithi088.stdout:E AssertionError: assert 'Mr. RGW11111111111111111' == 'Mr.RGW11111111111111111' 2024-03-09T15:11:37.790 INFO:teuthology.orchestra.run.smithi088.stdout:E 2024-03-09T15:11:37.790 INFO:teuthology.orchestra.run.smithi088.stdout:E - Mr.RGW11111111111111111 2024-03-09T15:11:37.790 INFO:teuthology.orchestra.run.smithi088.stdout:E + Mr. RGW11111111111111111 2024-03-09T15:11:37.790 INFO:teuthology.orchestra.run.smithi088.stdout:E ? + 2024-03-09T15:11:37.790 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.790 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:7912: AssertionError 2024-03-09T15:11:37.790 INFO:teuthology.orchestra.run.smithi088.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:11:37.790 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.790 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.790 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.790 INFO:teuthology.orchestra.run.smithi088.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:11:37.791 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.791 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.791 INFO:teuthology.orchestra.run.smithi088.stdout:Done with cleanup of buckets in tests. 2024-03-09T15:11:37.791 INFO:teuthology.orchestra.run.smithi088.stdout:=============================== warnings summary =============================== 2024-03-09T15:11:37.791 INFO:teuthology.orchestra.run.smithi088.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-03-09T15:11:37.791 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-03-09T15:11:37.791 INFO:teuthology.orchestra.run.smithi088.stdout: import imp 2024-03-09T15:11:37.791 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.791 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py:124 2024-03-09T15:11:37.791 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-03-09T15:11:37.791 INFO:teuthology.orchestra.run.smithi088.stdout: if boto_type is 'S3Connection': 2024-03-09T15:11:37.791 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.791 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_headers.py:129 2024-03-09T15:11:37.791 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:129: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-03-09T15:11:37.791 INFO:teuthology.orchestra.run.smithi088.stdout: elif boto_type is 'HTTPRequest': 2024-03-09T15:11:37.792 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.792 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3.py:359 2024-03-09T15:11:37.792 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-03-09T15:11:37.792 INFO:teuthology.orchestra.run.smithi088.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-03-09T15:11:37.792 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.792 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py:176 2024-03-09T15:11:37.793 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-03-09T15:11:37.793 INFO:teuthology.orchestra.run.smithi088.stdout: if k is 'BucketName': 2024-03-09T15:11:37.793 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.793 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py:253 2024-03-09T15:11:37.793 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-03-09T15:11:37.793 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.timeout(10) 2024-03-09T15:11:37.793 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.793 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests/functional/test_s3_website.py:1077 2024-03-09T15:11:37.793 INFO:teuthology.orchestra.run.smithi088.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-03-09T15:11:37.793 INFO:teuthology.orchestra.run.smithi088.stdout: @pytest.mark.s3website_routing_rules 2024-03-09T15:11:37.793 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.793 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:2212 2024-03-09T15:11:37.793 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2212: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:11:37.794 INFO:teuthology.orchestra.run.smithi088.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:11:37.794 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.794 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:2227 2024-03-09T15:11:37.794 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2227: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:11:37.794 INFO:teuthology.orchestra.run.smithi088.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-03-09T15:11:37.794 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.794 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:2233 2024-03-09T15:11:37.794 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2233: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:11:37.794 INFO:teuthology.orchestra.run.smithi088.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-03-09T15:11:37.794 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.794 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:2290 2024-03-09T15:11:37.794 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2290: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:11:37.794 INFO:teuthology.orchestra.run.smithi088.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:11:37.794 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.794 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:2305 2024-03-09T15:11:37.795 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2305: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:11:37.795 INFO:teuthology.orchestra.run.smithi088.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-03-09T15:11:37.795 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.795 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:2323 2024-03-09T15:11:37.795 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2323: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:11:37.795 INFO:teuthology.orchestra.run.smithi088.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:11:37.795 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.795 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:2338 2024-03-09T15:11:37.795 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2338: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:11:37.795 INFO:teuthology.orchestra.run.smithi088.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-03-09T15:11:37.795 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.795 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:2356 2024-03-09T15:11:37.795 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2356: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:11:37.796 INFO:teuthology.orchestra.run.smithi088.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:11:37.796 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.796 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:2371 2024-03-09T15:11:37.796 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2371: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:11:37.796 INFO:teuthology.orchestra.run.smithi088.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-03-09T15:11:37.796 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.796 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:2421 2024-03-09T15:11:37.796 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2421: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:11:37.796 INFO:teuthology.orchestra.run.smithi088.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:11:37.796 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.796 INFO:teuthology.orchestra.run.smithi088.stdout:s3tests_boto3/functional/test_s3.py:2453 2024-03-09T15:11:37.796 INFO:teuthology.orchestra.run.smithi088.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2453: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:11:37.796 INFO:teuthology.orchestra.run.smithi088.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:11:37.796 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:37.797 INFO:teuthology.orchestra.run.smithi088.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-03-09T15:11:37.797 INFO:teuthology.orchestra.run.smithi088.stdout:=========================== short test summary info ============================ 2024-03-09T15:11:37.797 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none 2024-03-09T15:11:37.797 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty 2024-03-09T15:11:37.797 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_none 2024-03-09T15:11:37.797 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty 2024-03-09T15:11:37.797 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none 2024-03-09T15:11:37.797 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 2024-03-09T15:11:37.797 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 2024-03-09T15:11:37.797 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 2024-03-09T15:11:37.797 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 2024-03-09T15:11:37.797 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 2024-03-09T15:11:37.797 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 2024-03-09T15:11:37.797 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_acl_default - Asserti... 2024-03-09T15:11:37.797 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create 2024-03-09T15:11:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned - Assertio... 2024-03-09T15:11:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite 2024-03-09T15:11:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread 2024-03-09T15:11:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_acl_default - Asserti... 2024-03-09T15:11:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create 2024-03-09T15:11:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_acl_canned - Assertio... 2024-03-09T15:11:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite 2024-03-09T15:11:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread 2024-03-09T15:11:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_acl - AssertionError:... 2024-03-09T15:11:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_acl_write - Assertion... 2024-03-09T15:11:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp - Assert... 2024-03-09T15:11:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_acl_read - AssertionE... 2024-03-09T15:11:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_acl_readacp - Asserti... 2024-03-09T15:11:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol 2024-03-09T15:11:37.799 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read 2024-03-09T15:11:37.799 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp 2024-03-09T15:11:37.799 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write 2024-03-09T15:11:37.799 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp 2024-03-09T15:11:37.799 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email - Ass... 2024-03-09T15:11:37.799 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner 2024-03-09T15:11:37.799 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioned_object_acl - Asser... 2024-03-09T15:11:37.799 INFO:teuthology.orchestra.run.smithi088.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified 2024-03-09T15:11:37.799 INFO:teuthology.orchestra.run.smithi088.stdout:= 35 failed, 625 passed, 65 skipped, 124 deselected, 1 xfailed, 18 warnings in 1163.52s (0:19:23) = 2024-03-09T15:11:37.800 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: InvocationError for command /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' (exited with code 1) 2024-03-09T15:11:37.800 INFO:teuthology.orchestra.run.smithi088.stdout:___________________________________ summary ____________________________________ 2024-03-09T15:11:37.800 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: py: commands failed 2024-03-09T15:11:37.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T15:11:37.810 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 462, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 405, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi088 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-03-09T15:11:37.812 INFO:tasks.s3tests:Cleaning up boto... 2024-03-09T15:11:37.812 DEBUG:teuthology.orchestra.run.smithi088:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-03-09T15:11:37.839 INFO:tasks.s3tests:Removing s3-tests... 2024-03-09T15:11:37.839 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-03-09T15:11:38.027 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 736, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 61, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 462, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 405, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi088 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-03-09T15:11:38.239 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=e4ad29ed51094e48bb75ebcdb3b9d191 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 736, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 61, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 462, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 405, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi088 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-03-09T15:11:38.243 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-03-09T15:11:38.253 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-03-09T15:11:38.262 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-03-09T15:11:38.262 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-03-09T15:11:38.263 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-03-09T15:11:38.329 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-03-09T15:11:38.330 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-03-09T15:11:38.383 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T15:11:38.384 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T15:11:38.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.414+0000 7fadbf415800 20 rados->read ofs=0 len=0 2024-03-09T15:11:38.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.415+0000 7fadbf415800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:11:38.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.415+0000 7fadbf415800 20 realm 2024-03-09T15:11:38.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.415+0000 7fadbf415800 20 rados->read ofs=0 len=0 2024-03-09T15:11:38.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.415+0000 7fadbf415800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:11:38.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.415+0000 7fadbf415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T15:11:38.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.415+0000 7fadbf415800 20 rados->read ofs=0 len=0 2024-03-09T15:11:38.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.416+0000 7fadbf415800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:11:38.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.416+0000 7fadbf415800 20 rados->read ofs=0 len=0 2024-03-09T15:11:38.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.416+0000 7fadbf415800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T15:11:38.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.416+0000 7fadbf415800 20 rados->read ofs=0 len=0 2024-03-09T15:11:38.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.417+0000 7fadbf415800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T15:11:38.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.417+0000 7fadbf415800 20 searching for the correct realm 2024-03-09T15:11:38.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.420+0000 7fadb21dd640 0 -- 172.21.15.88:0/1407875763 >> [v2:172.21.15.132:6808/251080901,v1:172.21.15.132:6810/251080901] conn(0x7fadac057050 msgr2=0x7fadac0cb5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T15:11:38.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.424+0000 7fadb21dd640 0 -- 172.21.15.88:0/1407875763 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7fadb40980b0 msgr2=0x7fadb405d9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T15:11:38.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.630+0000 7fadbf415800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T15:11:38.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.630+0000 7fadbf415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T15:11:38.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.630+0000 7fadbf415800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T15:11:38.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.630+0000 7fadbf415800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T15:11:38.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.630+0000 7fadbf415800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T15:11:38.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.630+0000 7fadbf415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T15:11:38.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.630+0000 7fadbf415800 20 rados->read ofs=0 len=0 2024-03-09T15:11:38.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.630+0000 7fadbf415800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:11:38.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.630+0000 7fadbf415800 20 rados->read ofs=0 len=0 2024-03-09T15:11:38.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.631+0000 7fadbf415800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T15:11:38.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.631+0000 7fadbf415800 20 rados->read ofs=0 len=0 2024-03-09T15:11:38.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.631+0000 7fadbf415800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T15:11:38.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.631+0000 7fadbf415800 20 zone default found 2024-03-09T15:11:38.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.631+0000 7fadbf415800 4 Realm: () 2024-03-09T15:11:38.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.631+0000 7fadbf415800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T15:11:38.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.631+0000 7fadbf415800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T15:11:38.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.631+0000 7fadbf415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T15:11:38.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.631+0000 7fadbf415800 20 zonegroup default 2024-03-09T15:11:38.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.631+0000 7fadbf415800 20 rados->read ofs=0 len=0 2024-03-09T15:11:38.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.631+0000 7fadbf415800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:11:38.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.631+0000 7fadbf415800 20 rados->read ofs=0 len=0 2024-03-09T15:11:38.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.632+0000 7fadbf415800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:11:38.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.632+0000 7fadbf415800 20 rados->read ofs=0 len=0 2024-03-09T15:11:38.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.632+0000 7fadbf415800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:11:38.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.632+0000 7fadbf415800 20 started sync module instance, tier type = 2024-03-09T15:11:38.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.632+0000 7fadbf415800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T15:11:38.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.642+0000 7fadbf415800 20 add_watcher() i=0 2024-03-09T15:11:38.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.642+0000 7fadbf415800 20 add_watcher() i=1 2024-03-09T15:11:38.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.642+0000 7fadbf415800 20 add_watcher() i=2 2024-03-09T15:11:38.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.642+0000 7fadbf415800 20 add_watcher() i=3 2024-03-09T15:11:38.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.642+0000 7fadbf415800 20 add_watcher() i=4 2024-03-09T15:11:38.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.642+0000 7fadbf415800 20 add_watcher() i=5 2024-03-09T15:11:38.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.642+0000 7fadbf415800 20 add_watcher() i=6 2024-03-09T15:11:38.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.643+0000 7fadbf415800 20 add_watcher() i=7 2024-03-09T15:11:38.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.643+0000 7fadbf415800 2 all 8 watchers are set, enabling cache 2024-03-09T15:11:38.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.645+0000 7fac717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T15:11:38.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.645+0000 7fadbf415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T15:11:38.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.645+0000 7fadbf415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T15:11:38.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.684+0000 7fabebfff640 20 reqs_thread_entry: start 2024-03-09T15:11:38.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.684+0000 7fadbf415800 20 init_complete bucket index max shards: 11 2024-03-09T15:11:38.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.684+0000 7fadbf415800 20 Filter name: none 2024-03-09T15:11:38.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.684+0000 7fabe9ffb640 20 reqs_thread_entry: start 2024-03-09T15:11:38.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.684+0000 7fadbf415800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-03-09T15:11:38.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.684+0000 7fadbf415800 20 rados->read ofs=0 len=0 2024-03-09T15:11:38.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.685+0000 7fadbf415800 20 rados_obj.operate() r=0 bl.length=482 2024-03-09T15:11:38.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.685+0000 7fadbf415800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-03-09T15:11:38.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.685+0000 7fadbf415800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-09T15:11:38.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.685+0000 7fadbf415800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T15:11:38.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.685+0000 7fadbf415800 10 removing key index: UXRJQEQHXSFOFQZAYRAJ 2024-03-09T15:11:38.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.686+0000 7fadbf415800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:UXRJQEQHXSFOFQZAYRAJ, ofs0, ns] 2024-03-09T15:11:38.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.688+0000 7fac9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366711 cookie 93835615163904 notifier 7475 bl.length()=170 2024-03-09T15:11:38.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.690+0000 7fadbf415800 10 removing email index: tester.client.0_test@test.test 2024-03-09T15:11:38.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.690+0000 7fadbf415800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-03-09T15:11:38.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.691+0000 7fac9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366481 cookie 93835615170272 notifier 7475 bl.length()=181 2024-03-09T15:11:38.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.692+0000 7fadbf415800 10 removing user buckets index 2024-03-09T15:11:38.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.693+0000 7fadbf415800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-03-09T15:11:38.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.693+0000 7fac9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366323 cookie 93835615184032 notifier 7475 bl.length()=172 2024-03-09T15:11:38.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.694+0000 7fadbf415800 10 removing user index: tester.client.0 2024-03-09T15:11:38.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.696+0000 7fadbf415800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-03-09T15:11:38.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.696+0000 7fadbf415800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-03-09T15:11:38.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.696+0000 7fac9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871368588 cookie 93835615182416 notifier 7475 bl.length()=164 2024-03-09T15:11:38.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.698+0000 7fac717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T15:11:38.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.701+0000 7fadbf415800 20 remove_watcher() i=0 2024-03-09T15:11:38.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.701+0000 7fadbf415800 2 removed watcher, disabling cache 2024-03-09T15:11:38.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.702+0000 7fadbf415800 20 remove_watcher() i=1 2024-03-09T15:11:38.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.703+0000 7fadbf415800 20 remove_watcher() i=2 2024-03-09T15:11:38.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.704+0000 7fadbf415800 20 remove_watcher() i=3 2024-03-09T15:11:38.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.705+0000 7fadbf415800 20 remove_watcher() i=4 2024-03-09T15:11:38.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.706+0000 7fadbf415800 20 remove_watcher() i=5 2024-03-09T15:11:38.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.707+0000 7fadbf415800 20 remove_watcher() i=6 2024-03-09T15:11:38.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:38.708+0000 7fadbf415800 20 remove_watcher() i=7 2024-03-09T15:11:38.718 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-03-09T15:11:38.730 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-03-09T15:11:38.739 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-03-09T15:11:38.794 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-03-09T15:11:38.805 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-03-09T15:11:38.805 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:11:38.811 INFO:tasks.rgw.client.0.smithi088.stdout:2024-03-09T15:11:38.809+0000 f6f0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 45638) UID: 0 2024-03-09T15:11:38.815 INFO:tasks.rgw.client.0.smithi088.stdout:2024-03-09T15:11:38.812+0000 a03a0c0 -1 shutting down 2024-03-09T15:11:42.701 INFO:tasks.rgw.client.0.smithi088.stderr:==00:00:45:03.091 45641== could not unlink /tmp/vgdb-pipe-from-vgdb-to-45641-by-root-on-??? 2024-03-09T15:11:42.702 INFO:tasks.rgw.client.0.smithi088.stderr:==00:00:45:03.091 45641== could not unlink /tmp/vgdb-pipe-to-vgdb-from-45641-by-root-on-??? 2024-03-09T15:11:42.702 INFO:tasks.rgw.client.0.smithi088.stderr:==00:00:45:03.091 45641== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-45641-by-root-on-??? 2024-03-09T15:11:44.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-03-09T15:11:44.907 INFO:tasks.rgw.client.0:Stopped 2024-03-09T15:11:44.908 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-03-09T15:11:44.940 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f /etc/ceph/vault-root-token 2024-03-09T15:11:45.026 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-03-09T15:11:45.068 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-03-09T15:11:45.068 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-03-09T15:11:45.069 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-03-09T15:11:45.164 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setuser ceph since I am not root 2024-03-09T15:11:45.164 INFO:teuthology.orchestra.run.smithi088.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T15:11:45.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.195+0000 7ff3ea430800 20 rados->read ofs=0 len=0 2024-03-09T15:11:45.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.196+0000 7ff3ea430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:11:45.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.196+0000 7ff3ea430800 20 realm 2024-03-09T15:11:45.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.196+0000 7ff3ea430800 20 rados->read ofs=0 len=0 2024-03-09T15:11:45.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.196+0000 7ff3ea430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:11:45.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.196+0000 7ff3ea430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T15:11:45.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.196+0000 7ff3ea430800 20 rados->read ofs=0 len=0 2024-03-09T15:11:45.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.196+0000 7ff3ea430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:11:45.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.196+0000 7ff3ea430800 20 rados->read ofs=0 len=0 2024-03-09T15:11:45.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.197+0000 7ff3ea430800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T15:11:45.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.197+0000 7ff3ea430800 20 rados->read ofs=0 len=0 2024-03-09T15:11:45.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.198+0000 7ff3ea430800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T15:11:45.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.198+0000 7ff3ea430800 20 searching for the correct realm 2024-03-09T15:11:45.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.200+0000 7ff3e5f31640 0 -- 172.21.15.88:0/1546281715 >> [v2:172.21.15.132:6809/692310395,v1:172.21.15.132:6811/692310395] conn(0x7ff3e005e040 msgr2=0x7ff3e0054a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T15:11:45.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.407+0000 7ff3dcf2f640 0 -- 172.21.15.88:0/1546281715 >> [v2:172.21.15.88:6801/2236481287,v1:172.21.15.88:6804/2236481287] conn(0x7ff3e00c7840 msgr2=0x7ff3e00cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T15:11:45.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.613+0000 7ff3ea430800 20 RGWRados::pool_iterate: got zone_info.5d93e872-363b-498b-b665-658644296b85 2024-03-09T15:11:45.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.613+0000 7ff3ea430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T15:11:45.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.613+0000 7ff3ea430800 20 RGWRados::pool_iterate: got zonegroup_info.dcf1c19d-19e8-414d-9090-5058064597bd 2024-03-09T15:11:45.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.613+0000 7ff3ea430800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T15:11:45.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.613+0000 7ff3ea430800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T15:11:45.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.613+0000 7ff3ea430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T15:11:45.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.613+0000 7ff3ea430800 20 rados->read ofs=0 len=0 2024-03-09T15:11:45.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.614+0000 7ff3ea430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:11:45.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.614+0000 7ff3ea430800 20 rados->read ofs=0 len=0 2024-03-09T15:11:45.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.614+0000 7ff3ea430800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T15:11:45.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.614+0000 7ff3ea430800 20 rados->read ofs=0 len=0 2024-03-09T15:11:45.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.614+0000 7ff3ea430800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T15:11:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.614+0000 7ff3ea430800 20 zone default found 2024-03-09T15:11:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.614+0000 7ff3ea430800 4 Realm: () 2024-03-09T15:11:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.614+0000 7ff3ea430800 4 ZoneGroup: default (dcf1c19d-19e8-414d-9090-5058064597bd) 2024-03-09T15:11:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.614+0000 7ff3ea430800 4 Zone: default (5d93e872-363b-498b-b665-658644296b85) 2024-03-09T15:11:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.614+0000 7ff3ea430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T15:11:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.614+0000 7ff3ea430800 20 zonegroup default 2024-03-09T15:11:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.614+0000 7ff3ea430800 20 rados->read ofs=0 len=0 2024-03-09T15:11:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.615+0000 7ff3ea430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:11:45.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.615+0000 7ff3ea430800 20 rados->read ofs=0 len=0 2024-03-09T15:11:45.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.615+0000 7ff3ea430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:11:45.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.615+0000 7ff3ea430800 20 rados->read ofs=0 len=0 2024-03-09T15:11:45.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.615+0000 7ff3ea430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:11:45.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.615+0000 7ff3ea430800 20 started sync module instance, tier type = 2024-03-09T15:11:45.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.615+0000 7ff3ea430800 20 started zone id=5d93e872-363b-498b-b665-658644296b85 (name=default) with tier type = 2024-03-09T15:11:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.626+0000 7ff3ea430800 20 add_watcher() i=0 2024-03-09T15:11:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.626+0000 7ff3ea430800 20 add_watcher() i=1 2024-03-09T15:11:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.626+0000 7ff3ea430800 20 add_watcher() i=2 2024-03-09T15:11:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.626+0000 7ff3ea430800 20 add_watcher() i=3 2024-03-09T15:11:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.626+0000 7ff3ea430800 20 add_watcher() i=4 2024-03-09T15:11:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.626+0000 7ff3ea430800 20 add_watcher() i=5 2024-03-09T15:11:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.626+0000 7ff3ea430800 20 add_watcher() i=6 2024-03-09T15:11:45.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.627+0000 7ff3ea430800 20 add_watcher() i=7 2024-03-09T15:11:45.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.627+0000 7ff3ea430800 2 all 8 watchers are set, enabling cache 2024-03-09T15:11:45.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.628+0000 7ff29bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T15:11:45.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.629+0000 7ff3ea430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T15:11:45.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.629+0000 7ff3ea430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T15:11:45.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.668+0000 7ff29afe5640 20 reqs_thread_entry: start 2024-03-09T15:11:45.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.668+0000 7ff3ea430800 20 init_complete bucket index max shards: 11 2024-03-09T15:11:45.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.668+0000 7ff3ea430800 20 Filter name: none 2024-03-09T15:11:45.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.668+0000 7ff298fe1640 20 reqs_thread_entry: start 2024-03-09T15:11:45.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.668+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T15:11:45.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.670+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.670+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T15:11:45.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.3473676792937763457', time=2024-03-09T17:02:08.818541+0000, chain.objs.size()=1 2024-03-09T15:11:45.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.516__multipart_mymultipart.2~-RluNoYYnK9orvfAZRqGKAzBzhWbPcd.1 2024-03-09T15:11:45.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.16001838499044559741', time=2024-03-09T17:02:19.785280+0000, chain.objs.size()=3 2024-03-09T15:11:45.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__multipart_mymultipart.2~dq311RqEKHCCs_Oj0ZaIGfP-sbvA-VE.1 2024-03-09T15:11:45.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__shadow_mymultipart.2~dq311RqEKHCCs_Oj0ZaIGfP-sbvA-VE.1_1 2024-03-09T15:11:45.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__multipart_mymultipart.2~dq311RqEKHCCs_Oj0ZaIGfP-sbvA-VE.2 2024-03-09T15:11:45.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.10933062581931731352', time=2024-03-09T17:02:22.377468+0000, chain.objs.size()=5 2024-03-09T15:11:45.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__multipart_mymultipart.2~uboyBlL91FDmoUKNVuhN60KTCKBDDNN.1 2024-03-09T15:11:45.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__shadow_mymultipart.2~uboyBlL91FDmoUKNVuhN60KTCKBDDNN.1_1 2024-03-09T15:11:45.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__multipart_mymultipart.2~uboyBlL91FDmoUKNVuhN60KTCKBDDNN.2 2024-03-09T15:11:45.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__shadow_mymultipart.2~uboyBlL91FDmoUKNVuhN60KTCKBDDNN.2_1 2024-03-09T15:11:45.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__multipart_mymultipart.2~uboyBlL91FDmoUKNVuhN60KTCKBDDNN.3 2024-03-09T15:11:45.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.14731458900414175551', time=2024-03-09T17:07:45.251199+0000, chain.objs.size()=6 2024-03-09T15:11:45.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.648__multipart_bar.2~oMXzIczOLBtsh5IvGqjRtiCl3ONINB3.1 2024-03-09T15:11:45.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.648__multipart_bar.2~oMXzIczOLBtsh5IvGqjRtiCl3ONINB3.2 2024-03-09T15:11:45.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.671+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.648__multipart_bar.2~oMXzIczOLBtsh5IvGqjRtiCl3ONINB3.3 2024-03-09T15:11:45.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.675+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.648__multipart_bar.2~oMXzIczOLBtsh5IvGqjRtiCl3ONINB3.4 2024-03-09T15:11:45.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.675+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.648__multipart_bar.2~oMXzIczOLBtsh5IvGqjRtiCl3ONINB3.5 2024-03-09T15:11:45.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.675+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.648__multipart_bar.2~oMXzIczOLBtsh5IvGqjRtiCl3ONINB3.6 2024-03-09T15:11:45.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.678+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.681+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T15:11:45.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.682+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.682+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-09T15:11:45.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_ywNfOEvNkJIX1kwGTcYA6weYPkOT4tn', time=2024-03-09T16:52:44.226852+0000, chain.objs.size()=1 2024-03-09T15:11:45.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.156__shadow_.bsjW6Zfe1pNz_54sEO-nc0ReC4ibmaM_0 2024-03-09T15:11:45.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.10349209637801344532', time=2024-03-09T17:01:30.997917+0000, chain.objs.size()=6 2024-03-09T15:11:45.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.JCMhcfmEh2I9MCnRN_OFecAJs-F9hHVX.1 2024-03-09T15:11:45.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~gln9Zf8Q4XRpNVD-G-SEuwuiEv85SOZ.2 2024-03-09T15:11:45.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~gln9Zf8Q4XRpNVD-G-SEuwuiEv85SOZ.3 2024-03-09T15:11:45.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~gln9Zf8Q4XRpNVD-G-SEuwuiEv85SOZ.4 2024-03-09T15:11:45.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~gln9Zf8Q4XRpNVD-G-SEuwuiEv85SOZ.5 2024-03-09T15:11:45.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~gln9Zf8Q4XRpNVD-G-SEuwuiEv85SOZ.6 2024-03-09T15:11:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.9604541519525771395', time=2024-03-09T17:03:43.019634+0000, chain.objs.size()=1 2024-03-09T15:11:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.553__multipart_mymultipart.2~wmrYfoFDcxwMSiF3oZb_27XO8ce2S-2.1 2024-03-09T15:11:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.8324858008327204580', time=2024-03-09T17:05:49.208608+0000, chain.objs.size()=12 2024-03-09T15:11:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.605__multipart_multipart_enc.2~AEDsyhYpoy3V8LzCpwplJm1FGdNLv9f.1 2024-03-09T15:11:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.605__shadow_multipart_enc.2~AEDsyhYpoy3V8LzCpwplJm1FGdNLv9f.1_1 2024-03-09T15:11:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.605__multipart_multipart_enc.2~AEDsyhYpoy3V8LzCpwplJm1FGdNLv9f.2 2024-03-09T15:11:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.683+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.605__shadow_multipart_enc.2~AEDsyhYpoy3V8LzCpwplJm1FGdNLv9f.2_1 2024-03-09T15:11:45.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.685+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.605__multipart_multipart_enc.2~AEDsyhYpoy3V8LzCpwplJm1FGdNLv9f.3 2024-03-09T15:11:45.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.686+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.605__shadow_multipart_enc.2~AEDsyhYpoy3V8LzCpwplJm1FGdNLv9f.3_1 2024-03-09T15:11:45.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.686+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.605__multipart_multipart_enc.2~AEDsyhYpoy3V8LzCpwplJm1FGdNLv9f.4 2024-03-09T15:11:45.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.687+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.605__shadow_multipart_enc.2~AEDsyhYpoy3V8LzCpwplJm1FGdNLv9f.4_1 2024-03-09T15:11:45.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.687+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.605__multipart_multipart_enc.2~AEDsyhYpoy3V8LzCpwplJm1FGdNLv9f.5 2024-03-09T15:11:45.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.687+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.605__shadow_multipart_enc.2~AEDsyhYpoy3V8LzCpwplJm1FGdNLv9f.5_1 2024-03-09T15:11:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.687+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.605__multipart_multipart_enc.2~AEDsyhYpoy3V8LzCpwplJm1FGdNLv9f.6 2024-03-09T15:11:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.687+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.605__shadow_multipart_enc.2~AEDsyhYpoy3V8LzCpwplJm1FGdNLv9f.6_1 2024-03-09T15:11:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.687+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.11693548728979980295', time=2024-03-09T17:07:45.489196+0000, chain.objs.size()=6 2024-03-09T15:11:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.687+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.649__multipart_baz.2~viLxQfdp_cFatxlJT3cgIlNcCwupMYQ.1 2024-03-09T15:11:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.687+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.649__multipart_baz.2~viLxQfdp_cFatxlJT3cgIlNcCwupMYQ.2 2024-03-09T15:11:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.687+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.649__multipart_baz.2~viLxQfdp_cFatxlJT3cgIlNcCwupMYQ.3 2024-03-09T15:11:45.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.691+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.649__multipart_baz.2~viLxQfdp_cFatxlJT3cgIlNcCwupMYQ.4 2024-03-09T15:11:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.692+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.649__multipart_baz.2~viLxQfdp_cFatxlJT3cgIlNcCwupMYQ.5 2024-03-09T15:11:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.692+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.649__multipart_baz.2~viLxQfdp_cFatxlJT3cgIlNcCwupMYQ.6 2024-03-09T15:11:45.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.695+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.697+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T15:11:45.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.699+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.699+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.700+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T15:11:45.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.700+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.9308800163230611508', time=2024-03-09T17:00:51.339469+0000, chain.objs.size()=1 2024-03-09T15:11:45.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.700+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.510__shadow_.9UmvWLgqFo4WMWJE6c0VGO3Che9mx6w_1 2024-03-09T15:11:45.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.700+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.15818172852770350191', time=2024-03-09T17:02:17.595796+0000, chain.objs.size()=1 2024-03-09T15:11:45.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.700+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__multipart_mymultipart.2~e49-cjK4VNTPOiTGOeI0ZG6A-hsQgeE.1 2024-03-09T15:11:45.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.700+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.10368221738487972036', time=2024-03-09T17:02:21.143850+0000, chain.objs.size()=3 2024-03-09T15:11:45.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.700+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__multipart_mymultipart.2~G7GQgGDZf5BQQgYuLitiwzLqRwTf0RN.1 2024-03-09T15:11:45.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.700+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__multipart_mymultipart.2~G7GQgGDZf5BQQgYuLitiwzLqRwTf0RN.2 2024-03-09T15:11:45.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.700+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__multipart_mymultipart.2~G7GQgGDZf5BQQgYuLitiwzLqRwTf0RN.3 2024-03-09T15:11:45.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.702+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.705+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T15:11:45.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.706+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.706+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.707+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T15:11:45.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.707+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_uuBOB8okx1hkLFco1gtfQiVagLeCRq3', time=2024-03-09T16:52:42.412933+0000, chain.objs.size()=3 2024-03-09T15:11:45.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.707+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_.AuRR635iuFyHY0aLwQArmkUIUVXKuHC_0 2024-03-09T15:11:45.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.707+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_.AuRR635iuFyHY0aLwQArmkUIUVXKuHC_1 2024-03-09T15:11:45.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.707+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_.AuRR635iuFyHY0aLwQArmkUIUVXKuHC_2 2024-03-09T15:11:45.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.707+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.13947607085140692798', time=2024-03-09T17:00:42.591781+0000, chain.objs.size()=1 2024-03-09T15:11:45.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.707+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.505__shadow_.V2o9AQDrjiHHHx_75VYO38Y6QwakJuQ_1 2024-03-09T15:11:45.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.707+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.15941788111378675561', time=2024-03-09T17:02:06.442129+0000, chain.objs.size()=6 2024-03-09T15:11:45.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.707+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.rs7F2PBvSFAnAyLrRdj6AQtY5KVYN8Ad.1 2024-03-09T15:11:45.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.707+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.eRHAvZ2ktIFku4JYjujSscMpwoE_ooTH.2 2024-03-09T15:11:45.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.707+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.wZSS7_Nc-dcU24hcMmV7gCkGG0xhMyWV.3 2024-03-09T15:11:45.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.707+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2VJsr3IQlakNFBoJ6NqHt_wG_PR0hXt_.4 2024-03-09T15:11:45.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.707+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.UsLhMxqCZmauvSasUcjKFLZfP5l9DfaV.5 2024-03-09T15:11:45.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.707+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.G4vuwgGNnYsEKjTMZvhc7kdDgT4ry4tq.6 2024-03-09T15:11:45.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.711+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.713+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T15:11:45.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.714+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.714+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.715+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T15:11:45.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.715+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_ZxOgLIaGxMSHhg4NYgyE-s95MneWG_Z', time=2024-03-09T16:52:36.267274+0000, chain.objs.size()=3 2024-03-09T15:11:45.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.715+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.7i-EgiM_GM7m5EeOD4iQiujVDc25WMG_0 2024-03-09T15:11:45.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.715+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.7i-EgiM_GM7m5EeOD4iQiujVDc25WMG_1 2024-03-09T15:11:45.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.715+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.7i-EgiM_GM7m5EeOD4iQiujVDc25WMG_2 2024-03-09T15:11:45.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.715+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_Ujt8KfBIcCQlkYoK1x4oHjbzU4-f6rI', time=2024-03-09T16:52:42.463366+0000, chain.objs.size()=1 2024-03-09T15:11:45.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.715+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_.LM8shcXB2ntNmJYRx7wy7JdhBaEUO9-_0 2024-03-09T15:11:45.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.715+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~vhTnwFbC4fIVoxzHN3eIr1z0VIm-t-K', time=2024-03-09T17:01:40.241094+0000, chain.objs.size()=1 2024-03-09T15:11:45.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.715+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~vhTnwFbC4fIVoxzHN3eIr1z0VIm-t-K.3 2024-03-09T15:11:45.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.715+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.4474212668809989767', time=2024-03-09T17:07:27.358565+0000, chain.objs.size()=1 2024-03-09T15:11:45.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.715+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.642__shadow_._7-9R6uT9T_idnogsIs4_X_wh7__HNJ_1 2024-03-09T15:11:45.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.718+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.720+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T15:11:45.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.721+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.722+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.722+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T15:11:45.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.722+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_NXCBZ1E1MlCFEEblV1ANmXJnFj1u-C4', time=2024-03-09T16:52:46.694499+0000, chain.objs.size()=3 2024-03-09T15:11:45.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.722+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.158__shadow_._FUQ9gvtIoQq1F2r4xBSCLrP0hxsYp0_0 2024-03-09T15:11:45.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.722+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.158__shadow_._FUQ9gvtIoQq1F2r4xBSCLrP0hxsYp0_1 2024-03-09T15:11:45.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.722+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.158__shadow_._FUQ9gvtIoQq1F2r4xBSCLrP0hxsYp0_2 2024-03-09T15:11:45.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.722+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.17659726632313352886', time=2024-03-09T16:58:39.735731+0000, chain.objs.size()=1 2024-03-09T15:11:45.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.722+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.360__shadow_.Nlh3gN5u9pPwPe8Gkj93bruHxMc6e4W_1 2024-03-09T15:11:45.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.722+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~7EesgUPTJ3yDDzAt6eFEi4Yny13F5pD', time=2024-03-09T17:02:33.286623+0000, chain.objs.size()=2 2024-03-09T15:11:45.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.722+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.522__multipart_mymultipart.2~7EesgUPTJ3yDDzAt6eFEi4Yny13F5pD.1 2024-03-09T15:11:45.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.722+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.522__multipart_mymultipart.2~7EesgUPTJ3yDDzAt6eFEi4Yny13F5pD.2 2024-03-09T15:11:45.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.725+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.727+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T15:11:45.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.729+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.729+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-09T15:11:45.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.14544930554430931727', time=2024-03-09T17:00:49.620164+0000, chain.objs.size()=1 2024-03-09T15:11:45.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.511__multipart_mymultipart.2~EDo2yLiosfftajJlhQpQyEAP4IENTch.1 2024-03-09T15:11:45.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~th2S0PmNiMiEeJNjDLnYObR8VKFkHA-', time=2024-03-09T17:01:50.722782+0000, chain.objs.size()=1 2024-03-09T15:11:45.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~th2S0PmNiMiEeJNjDLnYObR8VKFkHA-.2 2024-03-09T15:11:45.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~th2S0PmNiMiEeJNjDLnYObR8VKFkHA-', time=2024-03-09T17:01:50.726533+0000, chain.objs.size()=1 2024-03-09T15:11:45.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~th2S0PmNiMiEeJNjDLnYObR8VKFkHA-.3 2024-03-09T15:11:45.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.13162318802519079796', time=2024-03-09T17:02:12.534210+0000, chain.objs.size()=3 2024-03-09T15:11:45.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.516__multipart_mymultipart.2~Yqvsfg1rJRAy5nH0FmmWbuavT_7Tw14.1 2024-03-09T15:11:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.516__multipart_mymultipart.2~Yqvsfg1rJRAy5nH0FmmWbuavT_7Tw14.2 2024-03-09T15:11:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.516__multipart_mymultipart.2~Yqvsfg1rJRAy5nH0FmmWbuavT_7Tw14.3 2024-03-09T15:11:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.5310937175757369260', time=2024-03-09T17:02:14.040445+0000, chain.objs.size()=2 2024-03-09T15:11:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.516__multipart_mymultipart.2~ThrhtwvVnR-JvssWqU2FMyT4D3aPacD.1 2024-03-09T15:11:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.516__multipart_mymultipart.2~ThrhtwvVnR-JvssWqU2FMyT4D3aPacD.2 2024-03-09T15:11:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.4508435321931116637', time=2024-03-09T17:07:45.748639+0000, chain.objs.size()=6 2024-03-09T15:11:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.650__multipart_foo.2~PGCcoGQIjzCA_4e3fBakdXyfoCBllzb.1 2024-03-09T15:11:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.650__multipart_foo.2~PGCcoGQIjzCA_4e3fBakdXyfoCBllzb.2 2024-03-09T15:11:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.650__multipart_foo.2~PGCcoGQIjzCA_4e3fBakdXyfoCBllzb.3 2024-03-09T15:11:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.730+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.650__multipart_foo.2~PGCcoGQIjzCA_4e3fBakdXyfoCBllzb.4 2024-03-09T15:11:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.732+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.650__multipart_foo.2~PGCcoGQIjzCA_4e3fBakdXyfoCBllzb.5 2024-03-09T15:11:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.733+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.650__multipart_foo.2~PGCcoGQIjzCA_4e3fBakdXyfoCBllzb.6 2024-03-09T15:11:45.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.735+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.738+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T15:11:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.740+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.740+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.740+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T15:11:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.740+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.151400489208637047', time=2024-03-09T16:52:31.894512+0000, chain.objs.size()=3 2024-03-09T15:11:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.740+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.152__multipart_mymultipart-STANDARD.2~Neo4STXrXiDPAWt_PaiBve05sLon8Yz.1 2024-03-09T15:11:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.740+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.152__multipart_mymultipart-STANDARD.2~Neo4STXrXiDPAWt_PaiBve05sLon8Yz.2 2024-03-09T15:11:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.740+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.152__multipart_mymultipart-STANDARD.2~Neo4STXrXiDPAWt_PaiBve05sLon8Yz.3 2024-03-09T15:11:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.740+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.8904713251514069436', time=2024-03-09T17:02:31.517536+0000, chain.objs.size()=2 2024-03-09T15:11:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.740+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.521__multipart_mymultipart.2~ENvmqY1LIKHVHSIZ-laPsiTu2Mk_oEx.1 2024-03-09T15:11:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.740+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.521__multipart_mymultipart.2~ENvmqY1LIKHVHSIZ-laPsiTu2Mk_oEx.2 2024-03-09T15:11:45.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.743+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.745+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T15:11:45.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.747+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.747+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.748+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T15:11:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.748+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1_1_399824d89fb876901f2da684d8779301', time=2024-03-09T17:00:38.641366+0000, chain.objs.size()=12 2024-03-09T15:11:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.748+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1 2024-03-09T15:11:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.748+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1_1 2024-03-09T15:11:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.748+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.2 2024-03-09T15:11:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.748+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.2_1 2024-03-09T15:11:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.748+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.3 2024-03-09T15:11:45.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.748+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.3_1 2024-03-09T15:11:45.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.748+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.4 2024-03-09T15:11:45.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.748+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.4_1 2024-03-09T15:11:45.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.748+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.5 2024-03-09T15:11:45.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.748+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.5_1 2024-03-09T15:11:45.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.748+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.6 2024-03-09T15:11:45.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.748+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.6_1 2024-03-09T15:11:45.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.753+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.755+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T15:11:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.756+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.757+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.757+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T15:11:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.757+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~IWRNmFVLEBQUiJGNGZS_V63tlueIi_I', time=2024-03-09T16:53:22.846355+0000, chain.objs.size()=1 2024-03-09T15:11:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.757+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.194__multipart_mymultipart.2~IWRNmFVLEBQUiJGNGZS_V63tlueIi_I.1 2024-03-09T15:11:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.757+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.3167439212495360851', time=2024-03-09T17:04:54.505352+0000, chain.objs.size()=7 2024-03-09T15:11:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.757+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__multipart_testobj.2~TViSCqKWDUJPeddmpZT--9sxD4IjZis.1 2024-03-09T15:11:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.757+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__shadow_testobj.2~TViSCqKWDUJPeddmpZT--9sxD4IjZis.1_1 2024-03-09T15:11:45.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.757+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__multipart_testobj.2~TViSCqKWDUJPeddmpZT--9sxD4IjZis.2 2024-03-09T15:11:45.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.757+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__shadow_testobj.2~TViSCqKWDUJPeddmpZT--9sxD4IjZis.2_1 2024-03-09T15:11:45.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.757+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__multipart_testobj.2~TViSCqKWDUJPeddmpZT--9sxD4IjZis.3 2024-03-09T15:11:45.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.757+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__shadow_testobj.2~TViSCqKWDUJPeddmpZT--9sxD4IjZis.3_1 2024-03-09T15:11:45.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.757+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__multipart_testobj.2~TViSCqKWDUJPeddmpZT--9sxD4IjZis.4 2024-03-09T15:11:45.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.762+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.764+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T15:11:45.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.766+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.766+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.766+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T15:11:45.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.766+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.5449014140507179760', time=2024-03-09T16:52:41.679654+0000, chain.objs.size()=5 2024-03-09T15:11:45.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.766+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.154__multipart_foo-FROZEN.2~5GZEFCPz2erMDWcS24I_pi-FJxE7u7s.1 2024-03-09T15:11:45.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.766+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_foo-FROZEN.2~5GZEFCPz2erMDWcS24I_pi-FJxE7u7s.1_1 2024-03-09T15:11:45.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.766+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.154__multipart_foo-FROZEN.2~5GZEFCPz2erMDWcS24I_pi-FJxE7u7s.2 2024-03-09T15:11:45.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.766+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_foo-FROZEN.2~5GZEFCPz2erMDWcS24I_pi-FJxE7u7s.2_1 2024-03-09T15:11:45.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.766+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.154__multipart_foo-FROZEN.2~5GZEFCPz2erMDWcS24I_pi-FJxE7u7s.3 2024-03-09T15:11:45.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.770+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.772+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T15:11:45.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.774+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.774+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-03-09T15:11:45.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.15759912290767134691', time=2024-03-09T16:52:31.840635+0000, chain.objs.size()=5 2024-03-09T15:11:45.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.152__multipart_mymultipart-FROZEN.2~fuvgwD5fTI6_E7_Qiow7xM7rXza6bxh.1 2024-03-09T15:11:45.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.152__shadow_mymultipart-FROZEN.2~fuvgwD5fTI6_E7_Qiow7xM7rXza6bxh.1_1 2024-03-09T15:11:45.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.152__multipart_mymultipart-FROZEN.2~fuvgwD5fTI6_E7_Qiow7xM7rXza6bxh.2 2024-03-09T15:11:45.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.152__shadow_mymultipart-FROZEN.2~fuvgwD5fTI6_E7_Qiow7xM7rXza6bxh.2_1 2024-03-09T15:11:45.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.152__multipart_mymultipart-FROZEN.2~fuvgwD5fTI6_E7_Qiow7xM7rXza6bxh.3 2024-03-09T15:11:45.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.4475451153796323427', time=2024-03-09T16:52:33.983420+0000, chain.objs.size()=3 2024-03-09T15:11:45.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.YbInXEre1NgiM0t7YZevpwh-zdm4kPx_0 2024-03-09T15:11:45.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.YbInXEre1NgiM0t7YZevpwh-zdm4kPx_1 2024-03-09T15:11:45.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.YbInXEre1NgiM0t7YZevpwh-zdm4kPx_2 2024-03-09T15:11:45.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_Yz4LsEdTpffaIPIVzBTXGpDHM6KTae3', time=2024-03-09T16:52:39.932357+0000, chain.objs.size()=2 2024-03-09T15:11:45.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_.fggSC5zHyWh-bPf28aH928X5JEj7MA__1 2024-03-09T15:11:45.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_.fggSC5zHyWh-bPf28aH928X5JEj7MA__2 2024-03-09T15:11:45.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~JMmJrugStEit-4jrm38IHW4S2uOxzWk', time=2024-03-09T17:02:03.206097+0000, chain.objs.size()=1 2024-03-09T15:11:45.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~JMmJrugStEit-4jrm38IHW4S2uOxzWk.1 2024-03-09T15:11:45.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~JMmJrugStEit-4jrm38IHW4S2uOxzWk', time=2024-03-09T17:02:03.209748+0000, chain.objs.size()=1 2024-03-09T15:11:45.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.775+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~JMmJrugStEit-4jrm38IHW4S2uOxzWk.2 2024-03-09T15:11:45.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.779+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~JMmJrugStEit-4jrm38IHW4S2uOxzWk', time=2024-03-09T17:02:03.213176+0000, chain.objs.size()=1 2024-03-09T15:11:45.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.779+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~JMmJrugStEit-4jrm38IHW4S2uOxzWk.3 2024-03-09T15:11:45.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.779+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~JMmJrugStEit-4jrm38IHW4S2uOxzWk', time=2024-03-09T17:02:03.216605+0000, chain.objs.size()=1 2024-03-09T15:11:45.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.779+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~JMmJrugStEit-4jrm38IHW4S2uOxzWk.4 2024-03-09T15:11:45.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.779+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~JMmJrugStEit-4jrm38IHW4S2uOxzWk', time=2024-03-09T17:02:03.220649+0000, chain.objs.size()=1 2024-03-09T15:11:45.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.779+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~JMmJrugStEit-4jrm38IHW4S2uOxzWk.5 2024-03-09T15:11:45.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.779+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~JMmJrugStEit-4jrm38IHW4S2uOxzWk', time=2024-03-09T17:02:03.224177+0000, chain.objs.size()=1 2024-03-09T15:11:45.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.779+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~JMmJrugStEit-4jrm38IHW4S2uOxzWk.6 2024-03-09T15:11:45.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.779+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~_GMjvgMJfD66bRD4Xvur4GvQKCS42I1', time=2024-03-09T17:02:37.233069+0000, chain.objs.size()=1 2024-03-09T15:11:45.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.779+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.524__multipart_mymultipart.2~_GMjvgMJfD66bRD4Xvur4GvQKCS42I1.1 2024-03-09T15:11:45.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.779+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~WLTwe99bVqq6vJZlX5TPpgbXuwizyib', time=2024-03-09T17:02:43.099968+0000, chain.objs.size()=1 2024-03-09T15:11:45.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.779+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.528__multipart_mymultipart.2~WLTwe99bVqq6vJZlX5TPpgbXuwizyib.3 2024-03-09T15:11:45.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.782+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.785+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T15:11:45.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.786+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.786+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.787+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T15:11:45.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.787+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~OVLZUrBo5QHT5uoSdWUZ-YvbGkCZk7Q', time=2024-03-09T17:02:37.271569+0000, chain.objs.size()=3 2024-03-09T15:11:45.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.787+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.524__multipart_mymultipart.2~OVLZUrBo5QHT5uoSdWUZ-YvbGkCZk7Q.1 2024-03-09T15:11:45.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.787+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.524__shadow_mymultipart.2~OVLZUrBo5QHT5uoSdWUZ-YvbGkCZk7Q.1_1 2024-03-09T15:11:45.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.787+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.524__multipart_mymultipart.2~OVLZUrBo5QHT5uoSdWUZ-YvbGkCZk7Q.2 2024-03-09T15:11:45.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.787+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~tFoi5BieKt4oEDZMh4r8ta3rD07qSFF', time=2024-03-09T17:06:51.433752+0000, chain.objs.size()=12 2024-03-09T15:11:45.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.787+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.614__multipart_multipart_enc.2~tFoi5BieKt4oEDZMh4r8ta3rD07qSFF.1 2024-03-09T15:11:45.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.787+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.614__shadow_multipart_enc.2~tFoi5BieKt4oEDZMh4r8ta3rD07qSFF.1_1 2024-03-09T15:11:45.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.787+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.614__multipart_multipart_enc.2~tFoi5BieKt4oEDZMh4r8ta3rD07qSFF.2 2024-03-09T15:11:45.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.787+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.614__shadow_multipart_enc.2~tFoi5BieKt4oEDZMh4r8ta3rD07qSFF.2_1 2024-03-09T15:11:45.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.787+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.614__multipart_multipart_enc.2~tFoi5BieKt4oEDZMh4r8ta3rD07qSFF.3 2024-03-09T15:11:45.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.787+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.614__shadow_multipart_enc.2~tFoi5BieKt4oEDZMh4r8ta3rD07qSFF.3_1 2024-03-09T15:11:45.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.787+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.614__multipart_multipart_enc.2~tFoi5BieKt4oEDZMh4r8ta3rD07qSFF.4 2024-03-09T15:11:45.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.787+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.614__shadow_multipart_enc.2~tFoi5BieKt4oEDZMh4r8ta3rD07qSFF.4_1 2024-03-09T15:11:45.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.787+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.614__multipart_multipart_enc.2~tFoi5BieKt4oEDZMh4r8ta3rD07qSFF.5 2024-03-09T15:11:45.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.790+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.614__shadow_multipart_enc.2~tFoi5BieKt4oEDZMh4r8ta3rD07qSFF.5_1 2024-03-09T15:11:45.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.790+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.614__multipart_multipart_enc.2~tFoi5BieKt4oEDZMh4r8ta3rD07qSFF.6 2024-03-09T15:11:45.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.791+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.614__shadow_multipart_enc.2~tFoi5BieKt4oEDZMh4r8ta3rD07qSFF.6_1 2024-03-09T15:11:45.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.793+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.796+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T15:11:45.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.797+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-09T15:11:45.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_cFueqMpt7Sb4OkGxaKGRuWhKgoWeMga', time=2024-03-09T16:52:36.293765+0000, chain.objs.size()=3 2024-03-09T15:11:45.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.bNeWDOmMnhkLehCz3XKpthS9XEPzzVt_0 2024-03-09T15:11:45.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.bNeWDOmMnhkLehCz3XKpthS9XEPzzVt_1 2024-03-09T15:11:45.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.bNeWDOmMnhkLehCz3XKpthS9XEPzzVt_2 2024-03-09T15:11:45.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.8912542728926129578', time=2024-03-09T17:00:38.650400+0000, chain.objs.size()=12 2024-03-09T15:11:45.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1 2024-03-09T15:11:45.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1_1 2024-03-09T15:11:45.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.2 2024-03-09T15:11:45.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.2_1 2024-03-09T15:11:45.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.3 2024-03-09T15:11:45.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.3_1 2024-03-09T15:11:45.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.4 2024-03-09T15:11:45.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.4_1 2024-03-09T15:11:45.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.798+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.5 2024-03-09T15:11:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.801+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.5_1 2024-03-09T15:11:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.801+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.6 2024-03-09T15:11:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.801+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.6_1 2024-03-09T15:11:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.801+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.10543823651558206845', time=2024-03-09T17:01:18.313298+0000, chain.objs.size()=3 2024-03-09T15:11:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.801+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.513__shadow:HDLUjZXorxtTGot7tYlNCiygizqCOpd_.K2V_JCYSG_TrXcmElxO4JwYtYR2hVVT_1 2024-03-09T15:11:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.801+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.513__shadow:HDLUjZXorxtTGot7tYlNCiygizqCOpd_.K2V_JCYSG_TrXcmElxO4JwYtYR2hVVT_2 2024-03-09T15:11:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.801+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.513__shadow:HDLUjZXorxtTGot7tYlNCiygizqCOpd_.K2V_JCYSG_TrXcmElxO4JwYtYR2hVVT_3 2024-03-09T15:11:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.801+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~wWHy1PmEyyE7yNXLJenDpPA9GtlLiY2', time=2024-03-09T17:01:30.973767+0000, chain.objs.size()=1 2024-03-09T15:11:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.801+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~wWHy1PmEyyE7yNXLJenDpPA9GtlLiY2.2 2024-03-09T15:11:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.801+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.2337617437729517551', time=2024-03-09T17:11:37.019975+0000, chain.objs.size()=9 2024-03-09T15:11:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.801+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.759__shadow_.plIJLMIBFw3VSywIBEHuSsnS0KgayV9_1 2024-03-09T15:11:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.801+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.759__shadow_.plIJLMIBFw3VSywIBEHuSsnS0KgayV9_2 2024-03-09T15:11:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.801+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.759__shadow_.plIJLMIBFw3VSywIBEHuSsnS0KgayV9_3 2024-03-09T15:11:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.801+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.759__shadow_.plIJLMIBFw3VSywIBEHuSsnS0KgayV9_4 2024-03-09T15:11:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.804+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.759__shadow_.plIJLMIBFw3VSywIBEHuSsnS0KgayV9_5 2024-03-09T15:11:45.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.804+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.759__shadow_.plIJLMIBFw3VSywIBEHuSsnS0KgayV9_6 2024-03-09T15:11:45.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.805+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.759__shadow_.plIJLMIBFw3VSywIBEHuSsnS0KgayV9_7 2024-03-09T15:11:45.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.805+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.759__shadow_.plIJLMIBFw3VSywIBEHuSsnS0KgayV9_8 2024-03-09T15:11:45.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.805+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.759__shadow_.plIJLMIBFw3VSywIBEHuSsnS0KgayV9_9 2024-03-09T15:11:45.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.810+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.812+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T15:11:45.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.813+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T15:11:45.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.17257614725223575297', time=2024-03-09T16:52:37.741324+0000, chain.objs.size()=3 2024-03-09T15:11:45.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.154__multipart_foo-STANDARD.2~1PQzO-Sno_mrQQktRahnLYzFAXd6mzs.1 2024-03-09T15:11:45.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.154__multipart_foo-STANDARD.2~1PQzO-Sno_mrQQktRahnLYzFAXd6mzs.2 2024-03-09T15:11:45.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.154__multipart_foo-STANDARD.2~1PQzO-Sno_mrQQktRahnLYzFAXd6mzs.3 2024-03-09T15:11:45.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.1041597280693876337', time=2024-03-09T17:02:13.892997+0000, chain.objs.size()=5 2024-03-09T15:11:45.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.516__multipart_mymultipart.2~wtXp7o-Rf1UQxBVAbabPocFqQrJcWL7.1 2024-03-09T15:11:45.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.516__shadow_mymultipart.2~wtXp7o-Rf1UQxBVAbabPocFqQrJcWL7.1_1 2024-03-09T15:11:45.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.516__multipart_mymultipart.2~wtXp7o-Rf1UQxBVAbabPocFqQrJcWL7.2 2024-03-09T15:11:45.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.516__shadow_mymultipart.2~wtXp7o-Rf1UQxBVAbabPocFqQrJcWL7.2_1 2024-03-09T15:11:45.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.516__multipart_mymultipart.2~wtXp7o-Rf1UQxBVAbabPocFqQrJcWL7.3 2024-03-09T15:11:45.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.16796230676042112528', time=2024-03-09T17:04:52.759445+0000, chain.objs.size()=4 2024-03-09T15:11:45.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__multipart_testobj.2~-Y0-RFrGnXBKdVS1PjfA-U_yl8mDJPl.1 2024-03-09T15:11:45.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__multipart_testobj.2~-Y0-RFrGnXBKdVS1PjfA-U_yl8mDJPl.2 2024-03-09T15:11:45.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__multipart_testobj.2~-Y0-RFrGnXBKdVS1PjfA-U_yl8mDJPl.3 2024-03-09T15:11:45.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.814+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__multipart_testobj.2~-Y0-RFrGnXBKdVS1PjfA-U_yl8mDJPl.4 2024-03-09T15:11:45.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.816+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.14242408703827554473', time=2024-03-09T17:09:03.658130+0000, chain.objs.size()=1 2024-03-09T15:11:45.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.816+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.724__shadow_.JNIpXAs7n1AmswOdvwje8rICdWiOLzy_1 2024-03-09T15:11:45.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.820+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.822+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T15:11:45.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.823+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T15:11:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.13522939753156596486', time=2024-03-09T16:52:27.871754+0000, chain.objs.size()=3 2024-03-09T15:11:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.151__shadow_.6EcmJCkyTiWvYyWD_q2eIrQL4_e43Xt_0 2024-03-09T15:11:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.151__shadow_.6EcmJCkyTiWvYyWD_q2eIrQL4_e43Xt_1 2024-03-09T15:11:45.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.151__shadow_.6EcmJCkyTiWvYyWD_q2eIrQL4_e43Xt_2 2024-03-09T15:11:45.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~MS_Va3W4WPGBM5kudXK0RtD2qIb0qSV', time=2024-03-09T17:06:57.919013+0000, chain.objs.size()=12 2024-03-09T15:11:45.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.615__multipart_multipart_enc.2~MS_Va3W4WPGBM5kudXK0RtD2qIb0qSV.1 2024-03-09T15:11:45.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.615__shadow_multipart_enc.2~MS_Va3W4WPGBM5kudXK0RtD2qIb0qSV.1_1 2024-03-09T15:11:45.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.615__multipart_multipart_enc.2~MS_Va3W4WPGBM5kudXK0RtD2qIb0qSV.2 2024-03-09T15:11:45.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.615__shadow_multipart_enc.2~MS_Va3W4WPGBM5kudXK0RtD2qIb0qSV.2_1 2024-03-09T15:11:45.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.615__multipart_multipart_enc.2~MS_Va3W4WPGBM5kudXK0RtD2qIb0qSV.3 2024-03-09T15:11:45.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.615__shadow_multipart_enc.2~MS_Va3W4WPGBM5kudXK0RtD2qIb0qSV.3_1 2024-03-09T15:11:45.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.615__multipart_multipart_enc.2~MS_Va3W4WPGBM5kudXK0RtD2qIb0qSV.4 2024-03-09T15:11:45.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.615__shadow_multipart_enc.2~MS_Va3W4WPGBM5kudXK0RtD2qIb0qSV.4_1 2024-03-09T15:11:45.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.824+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.615__multipart_multipart_enc.2~MS_Va3W4WPGBM5kudXK0RtD2qIb0qSV.5 2024-03-09T15:11:45.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.829+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.615__shadow_multipart_enc.2~MS_Va3W4WPGBM5kudXK0RtD2qIb0qSV.5_1 2024-03-09T15:11:45.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.829+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.615__multipart_multipart_enc.2~MS_Va3W4WPGBM5kudXK0RtD2qIb0qSV.6 2024-03-09T15:11:45.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.829+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.615__shadow_multipart_enc.2~MS_Va3W4WPGBM5kudXK0RtD2qIb0qSV.6_1 2024-03-09T15:11:45.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.832+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.834+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T15:11:45.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.835+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T15:11:45.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.11236019617059424503', time=2024-03-09T17:01:17.384853+0000, chain.objs.size()=3 2024-03-09T15:11:45.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.514__multipart_mymultipart.2~s5sdziJfDIxgFw81hbb6TzJKraHpM93.1 2024-03-09T15:11:45.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.514__multipart_mymultipart.2~s5sdziJfDIxgFw81hbb6TzJKraHpM93.2 2024-03-09T15:11:45.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.514__multipart_mymultipart.2~s5sdziJfDIxgFw81hbb6TzJKraHpM93.3 2024-03-09T15:11:45.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.6981849066044221523', time=2024-03-09T17:03:50.094822+0000, chain.objs.size()=1 2024-03-09T15:11:45.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.555__shadow_.ezISf_i2hZXJJA4PQACieCLrWxDsEqq_1 2024-03-09T15:11:45.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.3786462795904412726', time=2024-03-09T17:06:44.833314+0000, chain.objs.size()=12 2024-03-09T15:11:45.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.613__multipart_multipart_enc.2~UA8v1miDhMdWVdsCVcEWRdiuO8hO0zz.1 2024-03-09T15:11:45.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.613__shadow_multipart_enc.2~UA8v1miDhMdWVdsCVcEWRdiuO8hO0zz.1_1 2024-03-09T15:11:45.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.613__multipart_multipart_enc.2~UA8v1miDhMdWVdsCVcEWRdiuO8hO0zz.2 2024-03-09T15:11:45.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.613__shadow_multipart_enc.2~UA8v1miDhMdWVdsCVcEWRdiuO8hO0zz.2_1 2024-03-09T15:11:45.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.613__multipart_multipart_enc.2~UA8v1miDhMdWVdsCVcEWRdiuO8hO0zz.3 2024-03-09T15:11:45.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.613__shadow_multipart_enc.2~UA8v1miDhMdWVdsCVcEWRdiuO8hO0zz.3_1 2024-03-09T15:11:45.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.613__multipart_multipart_enc.2~UA8v1miDhMdWVdsCVcEWRdiuO8hO0zz.4 2024-03-09T15:11:45.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.836+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.613__shadow_multipart_enc.2~UA8v1miDhMdWVdsCVcEWRdiuO8hO0zz.4_1 2024-03-09T15:11:45.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.838+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.613__multipart_multipart_enc.2~UA8v1miDhMdWVdsCVcEWRdiuO8hO0zz.5 2024-03-09T15:11:45.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.839+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.613__shadow_multipart_enc.2~UA8v1miDhMdWVdsCVcEWRdiuO8hO0zz.5_1 2024-03-09T15:11:45.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.839+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.613__multipart_multipart_enc.2~UA8v1miDhMdWVdsCVcEWRdiuO8hO0zz.6 2024-03-09T15:11:45.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.839+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.613__shadow_multipart_enc.2~UA8v1miDhMdWVdsCVcEWRdiuO8hO0zz.6_1 2024-03-09T15:11:45.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.843+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.845+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T15:11:45.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.847+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.847+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.847+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T15:11:45.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.847+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_tyNjFpExSR4BrUsj67J30cTvWEIJLFR', time=2024-03-09T16:52:36.318061+0000, chain.objs.size()=1 2024-03-09T15:11:45.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.847+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.giuJRzIHXbr5pYgbF7RwjeCFX7z20mp_0 2024-03-09T15:11:45.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.848+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.16060224094966667066', time=2024-03-09T17:01:14.943427+0000, chain.objs.size()=3 2024-03-09T15:11:45.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.848+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.514__multipart_mymultipart.2~-NblMJLjNCPpfEBv-eeQTufAgWoB33q.1 2024-03-09T15:11:45.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.848+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.514__multipart_mymultipart.2~-NblMJLjNCPpfEBv-eeQTufAgWoB33q.2 2024-03-09T15:11:45.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.848+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.514__multipart_mymultipart.2~-NblMJLjNCPpfEBv-eeQTufAgWoB33q.3 2024-03-09T15:11:45.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.848+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.14470484874222571895', time=2024-03-09T17:02:11.021304+0000, chain.objs.size()=2 2024-03-09T15:11:45.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.848+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.516__multipart_mymultipart.2~VoRVcYZGfELBPaQLMk7iy8NH-fWTYix.1 2024-03-09T15:11:45.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.848+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.516__multipart_mymultipart.2~VoRVcYZGfELBPaQLMk7iy8NH-fWTYix.2 2024-03-09T15:11:45.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.848+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.3785406013078924655', time=2024-03-09T17:02:23.028816+0000, chain.objs.size()=2 2024-03-09T15:11:45.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.848+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__multipart_mymultipart.2~atCMijB-g314YjDc2PjJk4uZQmprFPt.1 2024-03-09T15:11:45.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.848+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__multipart_mymultipart.2~atCMijB-g314YjDc2PjJk4uZQmprFPt.2 2024-03-09T15:11:45.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.851+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.853+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T15:11:45.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.855+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.855+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.855+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T15:11:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.855+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~wESnBkbRMZAxbA_2CJRcUUOcSWoaQ1P', time=2024-03-09T16:53:24.292577+0000, chain.objs.size()=2 2024-03-09T15:11:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.855+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.195__multipart_mymultipart.2~wESnBkbRMZAxbA_2CJRcUUOcSWoaQ1P.1 2024-03-09T15:11:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.855+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.195__shadow_mymultipart.2~wESnBkbRMZAxbA_2CJRcUUOcSWoaQ1P.1_1 2024-03-09T15:11:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.855+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1_1_9ccdb7a19d0a65aeb44f801e494f753d', time=2024-03-09T17:00:38.922307+0000, chain.objs.size()=12 2024-03-09T15:11:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.855+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1 2024-03-09T15:11:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.855+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1_1 2024-03-09T15:11:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.855+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.2 2024-03-09T15:11:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.855+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.2_1 2024-03-09T15:11:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.855+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.3 2024-03-09T15:11:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.855+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.3_1 2024-03-09T15:11:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.855+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.4 2024-03-09T15:11:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.855+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.4_1 2024-03-09T15:11:45.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.856+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.5 2024-03-09T15:11:45.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.856+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.5_1 2024-03-09T15:11:45.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.858+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.6 2024-03-09T15:11:45.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.858+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.6_1 2024-03-09T15:11:45.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.860+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.862+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T15:11:45.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.863+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.864+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.864+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T15:11:45.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.864+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_o_gBWoHiwLK3jkRKUz6qQDiLjCaSIGI', time=2024-03-09T16:52:42.101864+0000, chain.objs.size()=2 2024-03-09T15:11:45.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.864+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_.wIRBJuDZmH2kke8tR6pysR01LiTuEHW_1 2024-03-09T15:11:45.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.864+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_.wIRBJuDZmH2kke8tR6pysR01LiTuEHW_2 2024-03-09T15:11:45.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.864+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.5535027819388932775', time=2024-03-09T17:02:57.422321+0000, chain.objs.size()=4 2024-03-09T15:11:45.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.864+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.528__multipart_mymultipart.2~WLTwe99bVqq6vJZlX5TPpgbXuwizyib.1 2024-03-09T15:11:45.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.864+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.528__multipart_mymultipart.2~WLTwe99bVqq6vJZlX5TPpgbXuwizyib.2 2024-03-09T15:11:45.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.864+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.528__multipart_mymultipart.0F3cTaawBr_fWQUmiSB7RWbQ8Sdj8FrN.3 2024-03-09T15:11:45.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.864+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.528__multipart_mymultipart.2~WLTwe99bVqq6vJZlX5TPpgbXuwizyib.4 2024-03-09T15:11:45.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.867+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.869+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T15:11:45.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.871+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.871+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T15:11:45.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_GLxlOhQi618Dsfe-QOcILIRqVnHlUDF', time=2024-03-09T16:52:37.870228+0000, chain.objs.size()=1 2024-03-09T15:11:45.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_.8YTnl3j5vGbeqG6m50jwn17bMylEWnD_0 2024-03-09T15:11:45.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_MP3y_6327lMDQ8KUUk0uuxZ73slmL7x', time=2024-03-09T16:52:44.201824+0000, chain.objs.size()=1 2024-03-09T15:11:45.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.156__shadow_.lyC73VrOtLoFvwWjgz2rhUbBixKY6tC_0 2024-03-09T15:11:45.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.8469590747001406760', time=2024-03-09T17:01:18.576250+0000, chain.objs.size()=3 2024-03-09T15:11:45.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.514__multipart_mymultipart.2~K5b-UnTFz3CYuEWQkL__6Hp_knkXSm0.1 2024-03-09T15:11:45.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.514__multipart_mymultipart.2~K5b-UnTFz3CYuEWQkL__6Hp_knkXSm0.2 2024-03-09T15:11:45.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.514__multipart_mymultipart.2~K5b-UnTFz3CYuEWQkL__6Hp_knkXSm0.3 2024-03-09T15:11:45.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.6901306430184399183', time=2024-03-09T17:06:15.931196+0000, chain.objs.size()=12 2024-03-09T15:11:45.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.606__multipart_multipart_enc.2~_0ge4QUjfxmZt5XYXMe5csrVxoaoMQ3.1 2024-03-09T15:11:45.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.606__shadow_multipart_enc.2~_0ge4QUjfxmZt5XYXMe5csrVxoaoMQ3.1_1 2024-03-09T15:11:45.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.606__multipart_multipart_enc.2~_0ge4QUjfxmZt5XYXMe5csrVxoaoMQ3.2 2024-03-09T15:11:45.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.606__shadow_multipart_enc.2~_0ge4QUjfxmZt5XYXMe5csrVxoaoMQ3.2_1 2024-03-09T15:11:45.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.606__multipart_multipart_enc.2~_0ge4QUjfxmZt5XYXMe5csrVxoaoMQ3.3 2024-03-09T15:11:45.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.606__shadow_multipart_enc.2~_0ge4QUjfxmZt5XYXMe5csrVxoaoMQ3.3_1 2024-03-09T15:11:45.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.872+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.606__multipart_multipart_enc.2~_0ge4QUjfxmZt5XYXMe5csrVxoaoMQ3.4 2024-03-09T15:11:45.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.875+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.606__shadow_multipart_enc.2~_0ge4QUjfxmZt5XYXMe5csrVxoaoMQ3.4_1 2024-03-09T15:11:45.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.875+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.606__multipart_multipart_enc.2~_0ge4QUjfxmZt5XYXMe5csrVxoaoMQ3.5 2024-03-09T15:11:45.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.876+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.606__shadow_multipart_enc.2~_0ge4QUjfxmZt5XYXMe5csrVxoaoMQ3.5_1 2024-03-09T15:11:45.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.876+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.606__multipart_multipart_enc.2~_0ge4QUjfxmZt5XYXMe5csrVxoaoMQ3.6 2024-03-09T15:11:45.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.876+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.606__shadow_multipart_enc.2~_0ge4QUjfxmZt5XYXMe5csrVxoaoMQ3.6_1 2024-03-09T15:11:45.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.880+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.882+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T15:11:45.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.884+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.884+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.884+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T15:11:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.884+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.586721914540777466', time=2024-03-09T16:52:31.868678+0000, chain.objs.size()=5 2024-03-09T15:11:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.884+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.152__multipart_mymultipart-LUKEWARM.2~vThTVrjpA-nnxkGb7iHolRZwEH4Vl78.1 2024-03-09T15:11:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.884+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.152__shadow_mymultipart-LUKEWARM.2~vThTVrjpA-nnxkGb7iHolRZwEH4Vl78.1_1 2024-03-09T15:11:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.884+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.152__multipart_mymultipart-LUKEWARM.2~vThTVrjpA-nnxkGb7iHolRZwEH4Vl78.2 2024-03-09T15:11:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.884+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.152__shadow_mymultipart-LUKEWARM.2~vThTVrjpA-nnxkGb7iHolRZwEH4Vl78.2_1 2024-03-09T15:11:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.884+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.152__multipart_mymultipart-LUKEWARM.2~vThTVrjpA-nnxkGb7iHolRZwEH4Vl78.3 2024-03-09T15:11:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.884+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~gln9Zf8Q4XRpNVD-G-SEuwuiEv85SOZ', time=2024-03-09T17:01:23.424129+0000, chain.objs.size()=1 2024-03-09T15:11:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.884+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~gln9Zf8Q4XRpNVD-G-SEuwuiEv85SOZ.1 2024-03-09T15:11:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.884+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.14603829417993826029', time=2024-03-09T17:07:12.968544+0000, chain.objs.size()=1 2024-03-09T15:11:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.884+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.632__shadow_.2V8u47jrYvPJiAYBj2SHev1FS9WpbD4_1 2024-03-09T15:11:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.887+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.889+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T15:11:45.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.890+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.891+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.891+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T15:11:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.891+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_R_zGDlLbnr9FE-hVxXzW9GEf5jZj4XW', time=2024-03-09T16:52:34.365822+0000, chain.objs.size()=2 2024-03-09T15:11:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.891+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.5maQqSIedMwmFpxmwK1H_GK1QDGTmcv_1 2024-03-09T15:11:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.891+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.5maQqSIedMwmFpxmwK1H_GK1QDGTmcv_2 2024-03-09T15:11:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.891+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.10954214484282369299', time=2024-03-09T16:52:46.496456+0000, chain.objs.size()=3 2024-03-09T15:11:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.891+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.157__multipart_foo.2~hxBcY3Rw7yPi9MWBMfbcZSzCP801SIc.1 2024-03-09T15:11:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.891+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.157__shadow_foo.2~hxBcY3Rw7yPi9MWBMfbcZSzCP801SIc.1_1 2024-03-09T15:11:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.891+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.157__multipart_foo.2~hxBcY3Rw7yPi9MWBMfbcZSzCP801SIc.2 2024-03-09T15:11:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.891+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.11689187445472229554', time=2024-03-09T17:00:42.840654+0000, chain.objs.size()=1 2024-03-09T15:11:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.891+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.506__multipart_mymultipart.2~ssfq8lpf5fpvll8IrbnuUBFz5Nf4BCR.1 2024-03-09T15:11:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.891+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.4780130540122451999', time=2024-03-09T17:00:50.955736+0000, chain.objs.size()=1 2024-03-09T15:11:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.891+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.511__multipart_mymultipart.2~UV1-Q10ocPvRwQKuHb6ttqdl-j62AwD.1 2024-03-09T15:11:45.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.895+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.897+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T15:11:45.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.898+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.899+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.899+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T15:11:45.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.899+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.14737709891978164455', time=2024-03-09T17:00:47.818317+0000, chain.objs.size()=1 2024-03-09T15:11:45.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.899+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.511__multipart_mymultipart.2~mEJ1spHf161QuvpAyt70XKsa6qWDqGg.1 2024-03-09T15:11:45.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.899+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.1567873036120250829', time=2024-03-09T17:01:04.033699+0000, chain.objs.size()=6 2024-03-09T15:11:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.899+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.512__multipart_mymultipart.2~utoYNwU3k85uejlA-qsZeQnX0QItLNh.1 2024-03-09T15:11:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.899+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.512__multipart_mymultipart.2~utoYNwU3k85uejlA-qsZeQnX0QItLNh.2 2024-03-09T15:11:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.899+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.512__multipart_mymultipart.2~utoYNwU3k85uejlA-qsZeQnX0QItLNh.3 2024-03-09T15:11:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.899+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.512__multipart_mymultipart.2~utoYNwU3k85uejlA-qsZeQnX0QItLNh.4 2024-03-09T15:11:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.899+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.512__multipart_mymultipart.2~utoYNwU3k85uejlA-qsZeQnX0QItLNh.5 2024-03-09T15:11:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.899+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.512__multipart_mymultipart.2~utoYNwU3k85uejlA-qsZeQnX0QItLNh.6 2024-03-09T15:11:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.899+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.15327919753132401210', time=2024-03-09T17:07:18.678627+0000, chain.objs.size()=1 2024-03-09T15:11:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.899+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.635__shadow_.H-f3d7tnGFqVP6lGYYNc2G980aTmCzS_1 2024-03-09T15:11:45.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.903+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.905+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T15:11:45.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.906+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.907+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.907+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T15:11:45.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.907+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1_1_0aeb5a20f7d34f316baf655b10d1172f', time=2024-03-09T17:00:39.171564+0000, chain.objs.size()=12 2024-03-09T15:11:45.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.907+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1 2024-03-09T15:11:45.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.907+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1_1 2024-03-09T15:11:45.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.907+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.2 2024-03-09T15:11:45.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.907+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.2_1 2024-03-09T15:11:45.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.907+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.3 2024-03-09T15:11:45.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.907+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.3_1 2024-03-09T15:11:45.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.907+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.4 2024-03-09T15:11:45.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.907+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.4_1 2024-03-09T15:11:45.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.907+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.5 2024-03-09T15:11:45.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.907+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.5_1 2024-03-09T15:11:45.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.907+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.6 2024-03-09T15:11:45.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.907+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.6_1 2024-03-09T15:11:45.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.909+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.12751546479224410998', time=2024-03-09T17:03:30.139523+0000, chain.objs.size()=1 2024-03-09T15:11:45.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.909+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.547__shadow_.qCCJABeVcWIUJ-MvgXoaB3w0GW9QH-6_1 2024-03-09T15:11:45.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.909+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.4278872310269876558', time=2024-03-09T17:07:30.562021+0000, chain.objs.size()=1 2024-03-09T15:11:45.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.909+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.644__shadow_.CDjjysPD4EuhkMWiYr1FcTrqKtn0eEg_1 2024-03-09T15:11:45.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.911+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.913+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T15:11:45.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.914+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.915+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.915+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.916+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T15:11:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.917+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.917+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.918+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T15:11:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.918+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.15130332275888122983', time=2024-03-09T16:52:27.897899+0000, chain.objs.size()=3 2024-03-09T15:11:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.918+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.151__shadow_.p6d6Z84bEl8yS7s41VMPVGlKAFC7q0y_0 2024-03-09T15:11:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.918+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.151__shadow_.p6d6Z84bEl8yS7s41VMPVGlKAFC7q0y_1 2024-03-09T15:11:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.918+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.151__shadow_.p6d6Z84bEl8yS7s41VMPVGlKAFC7q0y_2 2024-03-09T15:11:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.918+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1_1_28973a3ac353d4995dce31d857344948', time=2024-03-09T17:00:39.176171+0000, chain.objs.size()=12 2024-03-09T15:11:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.918+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1 2024-03-09T15:11:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.918+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1_1 2024-03-09T15:11:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.918+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.2 2024-03-09T15:11:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.918+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.2_1 2024-03-09T15:11:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.918+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.3 2024-03-09T15:11:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.918+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.3_1 2024-03-09T15:11:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.918+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.4 2024-03-09T15:11:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.918+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.4_1 2024-03-09T15:11:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.918+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.5 2024-03-09T15:11:45.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.921+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.5_1 2024-03-09T15:11:45.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.921+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.6 2024-03-09T15:11:45.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.921+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.6_1 2024-03-09T15:11:45.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.921+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.12519085102166596415', time=2024-03-09T17:00:40.580377+0000, chain.objs.size()=1 2024-03-09T15:11:45.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.921+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.504__multipart_mymultipart.2~D1Y8kimL9KPCKsLusPjcHgGb9K-CsVM.1 2024-03-09T15:11:45.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.921+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.3531872225547240373', time=2024-03-09T17:02:03.250093+0000, chain.objs.size()=6 2024-03-09T15:11:45.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.921+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~th2S0PmNiMiEeJNjDLnYObR8VKFkHA-.1 2024-03-09T15:11:45.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.921+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.DlkuO4P89_IuzpiM6RI5iX6y7XEyKEBB.2 2024-03-09T15:11:45.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.921+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.qh7NL_b1GypYLeuek-rxYro33oM7WzVj.3 2024-03-09T15:11:45.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.921+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~th2S0PmNiMiEeJNjDLnYObR8VKFkHA-.4 2024-03-09T15:11:45.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.921+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~th2S0PmNiMiEeJNjDLnYObR8VKFkHA-.5 2024-03-09T15:11:45.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.921+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~th2S0PmNiMiEeJNjDLnYObR8VKFkHA-.6 2024-03-09T15:11:45.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.924+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.927+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T15:11:45.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.928+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.929+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.929+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.930+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T15:11:45.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.931+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.931+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-03-09T15:11:45.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.15349629110093163868', time=2024-03-09T16:52:27.923535+0000, chain.objs.size()=2 2024-03-09T15:11:45.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.151__shadow_.vhNQkDBxxQ9mkuHLWg1EjwjklumKeXO_1 2024-03-09T15:11:45.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.151__shadow_.vhNQkDBxxQ9mkuHLWg1EjwjklumKeXO_2 2024-03-09T15:11:45.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_ModRXbKFozUp8Y6XdHY9F--JSPdanab', time=2024-03-09T16:52:35.987310+0000, chain.objs.size()=2 2024-03-09T15:11:45.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.V2_StFlZr_z-1tMpf8psVbx-eLocxi5_1 2024-03-09T15:11:45.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.V2_StFlZr_z-1tMpf8psVbx-eLocxi5_2 2024-03-09T15:11:45.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_KOrKGklvjKnOinY6ouT8m5lRkdG_SBM', time=2024-03-09T16:52:42.439083+0000, chain.objs.size()=3 2024-03-09T15:11:45.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_.5_OeQN9kr9Dg_MezGAbFZ91otvEoK_n_0 2024-03-09T15:11:45.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_.5_OeQN9kr9Dg_MezGAbFZ91otvEoK_n_1 2024-03-09T15:11:45.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_.5_OeQN9kr9Dg_MezGAbFZ91otvEoK_n_2 2024-03-09T15:11:45.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1_1_321ebb4edfbeb994a3b469b6d7a78930', time=2024-03-09T17:00:38.660245+0000, chain.objs.size()=12 2024-03-09T15:11:45.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1 2024-03-09T15:11:45.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.1_1 2024-03-09T15:11:45.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.2 2024-03-09T15:11:45.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.2_1 2024-03-09T15:11:45.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.932+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.3 2024-03-09T15:11:45.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.936+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.3_1 2024-03-09T15:11:45.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.936+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.4 2024-03-09T15:11:45.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.936+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.4_1 2024-03-09T15:11:45.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.936+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.5 2024-03-09T15:11:45.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.936+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.5_1 2024-03-09T15:11:45.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.937+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__multipart_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.6 2024-03-09T15:11:45.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.937+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.500__shadow_srcmultipart.2~W8ZICnCUMDCqr7H2ua0SuvO1G2DTN7h.6_1 2024-03-09T15:11:45.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.937+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.15406781660647601788', time=2024-03-09T17:00:44.859312+0000, chain.objs.size()=1 2024-03-09T15:11:45.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.937+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.509__multipart_mymultipartcopy.2~RdwyyWWuODB09xjobMUslhHmHfu1tka.1 2024-03-09T15:11:45.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.937+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.4844663746936740808', time=2024-03-09T17:01:50.749213+0000, chain.objs.size()=6 2024-03-09T15:11:45.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.937+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~vhTnwFbC4fIVoxzHN3eIr1z0VIm-t-K.1 2024-03-09T15:11:45.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.937+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~vhTnwFbC4fIVoxzHN3eIr1z0VIm-t-K.2 2024-03-09T15:11:45.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.937+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.Z0OwrxEbFrNB3dKPDUwkqEDUQ97zufR6.3 2024-03-09T15:11:45.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.939+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~vhTnwFbC4fIVoxzHN3eIr1z0VIm-t-K.4 2024-03-09T15:11:45.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.939+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~vhTnwFbC4fIVoxzHN3eIr1z0VIm-t-K.5 2024-03-09T15:11:45.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.939+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~vhTnwFbC4fIVoxzHN3eIr1z0VIm-t-K.6 2024-03-09T15:11:45.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.939+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.11347794322679363289', time=2024-03-09T17:02:09.635270+0000, chain.objs.size()=2 2024-03-09T15:11:45.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.939+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.516__multipart_mymultipart.2~LWgCevbRdO6w942f8PEv00CkzcJZMIM.1 2024-03-09T15:11:45.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.939+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.516__multipart_mymultipart.2~LWgCevbRdO6w942f8PEv00CkzcJZMIM.2 2024-03-09T15:11:45.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.939+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~3Z0vDHesWqCfUWbazTjGPyw72TCbkVZ', time=2024-03-09T17:03:43.203304+0000, chain.objs.size()=1 2024-03-09T15:11:45.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.939+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.553__multipart_mymultipart.2~3Z0vDHesWqCfUWbazTjGPyw72TCbkVZ.1 2024-03-09T15:11:45.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.940+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.16471561335435534750', time=2024-03-09T17:04:53.768470+0000, chain.objs.size()=7 2024-03-09T15:11:45.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.940+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__multipart_testobj.2~2r9JirJnnlKS03aq1IVAnULmFa4tbs9.1 2024-03-09T15:11:45.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.940+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__shadow_testobj.2~2r9JirJnnlKS03aq1IVAnULmFa4tbs9.1_1 2024-03-09T15:11:45.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.940+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__multipart_testobj.2~2r9JirJnnlKS03aq1IVAnULmFa4tbs9.2 2024-03-09T15:11:45.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.940+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__shadow_testobj.2~2r9JirJnnlKS03aq1IVAnULmFa4tbs9.2_1 2024-03-09T15:11:45.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.940+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__multipart_testobj.2~2r9JirJnnlKS03aq1IVAnULmFa4tbs9.3 2024-03-09T15:11:45.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.941+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__shadow_testobj.2~2r9JirJnnlKS03aq1IVAnULmFa4tbs9.3_1 2024-03-09T15:11:45.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.942+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.570__multipart_testobj.2~2r9JirJnnlKS03aq1IVAnULmFa4tbs9.4 2024-03-09T15:11:45.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.946+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.948+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T15:11:45.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.949+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-09T15:11:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_cvERGMXNyiBaA2fpB3IuI4074RHCLSG', time=2024-03-09T16:52:32.902495+0000, chain.objs.size()=1 2024-03-09T15:11:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.By9locavtDoQc7Kwc7VL-eM5e_Nt1s8_0 2024-03-09T15:11:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.10652005460070014167', time=2024-03-09T16:52:35.598425+0000, chain.objs.size()=3 2024-03-09T15:11:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.T1nCl1fLtX-geV_GY-F8obwyZFYbXUF_0 2024-03-09T15:11:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.T1nCl1fLtX-geV_GY-F8obwyZFYbXUF_1 2024-03-09T15:11:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5d93e872-363b-498b-b665-658644296b85.4535.153__shadow_.T1nCl1fLtX-geV_GY-F8obwyZFYbXUF_2 2024-03-09T15:11:45.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.6129383017847851144', time=2024-03-09T16:52:39.505165+0000, chain.objs.size()=5 2024-03-09T15:11:45.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.154__multipart_foo-LUKEWARM.2~lvBvqbUU952IaV7-boR4tVGY2-o1X0x.1 2024-03-09T15:11:45.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_foo-LUKEWARM.2~lvBvqbUU952IaV7-boR4tVGY2-o1X0x.1_1 2024-03-09T15:11:45.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.154__multipart_foo-LUKEWARM.2~lvBvqbUU952IaV7-boR4tVGY2-o1X0x.2 2024-03-09T15:11:45.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.154__shadow_foo-LUKEWARM.2~lvBvqbUU952IaV7-boR4tVGY2-o1X0x.2_1 2024-03-09T15:11:45.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.154__multipart_foo-LUKEWARM.2~lvBvqbUU952IaV7-boR4tVGY2-o1X0x.3 2024-03-09T15:11:45.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='_RvGfDqAXpTXkLxWK5Ztyx2DffFSgz1x', time=2024-03-09T16:52:46.720547+0000, chain.objs.size()=3 2024-03-09T15:11:45.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.158__shadow_.ceVdHCJ6FyvdDnLiCKMz_ex2sN2n1Yq_0 2024-03-09T15:11:45.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.158__shadow_.ceVdHCJ6FyvdDnLiCKMz_ex2sN2n1Yq_1 2024-03-09T15:11:45.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.950+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5d93e872-363b-498b-b665-658644296b85.4535.158__shadow_.ceVdHCJ6FyvdDnLiCKMz_ex2sN2n1Yq_2 2024-03-09T15:11:45.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.952+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.15383496384101809227', time=2024-03-09T17:02:18.493485+0000, chain.objs.size()=2 2024-03-09T15:11:45.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.952+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__multipart_mymultipart.2~eRMI_ltLL8Qj1EDNea-2b7Iwqbown68.1 2024-03-09T15:11:45.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.954+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.518__multipart_mymultipart.2~eRMI_ltLL8Qj1EDNea-2b7Iwqbown68.2 2024-03-09T15:11:45.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.955+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.957+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T15:11:45.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.959+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.959+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.959+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T15:11:45.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.959+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.1133502017178642320', time=2024-03-09T17:01:40.264022+0000, chain.objs.size()=6 2024-03-09T15:11:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.959+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~wWHy1PmEyyE7yNXLJenDpPA9GtlLiY2.1 2024-03-09T15:11:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.960+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart._OUoSqs-g-Rolb6YgEom-v-osG49Zhpt.2 2024-03-09T15:11:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.960+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~wWHy1PmEyyE7yNXLJenDpPA9GtlLiY2.3 2024-03-09T15:11:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.960+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~wWHy1PmEyyE7yNXLJenDpPA9GtlLiY2.4 2024-03-09T15:11:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.960+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~wWHy1PmEyyE7yNXLJenDpPA9GtlLiY2.5 2024-03-09T15:11:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.960+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.515__multipart_mymultipart.2~wWHy1PmEyyE7yNXLJenDpPA9GtlLiY2.6 2024-03-09T15:11:45.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.960+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.2575569034988291293', time=2024-03-09T17:02:28.784032+0000, chain.objs.size()=4 2024-03-09T15:11:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.960+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.520__multipart_mymultipart.2~dTsiSiLJ7LuuAxW0NbxvzZy2cugM8KE.1 2024-03-09T15:11:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.960+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.520__multipart_mymultipart.2~dTsiSiLJ7LuuAxW0NbxvzZy2cugM8KE.2 2024-03-09T15:11:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.960+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.520__multipart_mymultipart.2~dTsiSiLJ7LuuAxW0NbxvzZy2cugM8KE.3 2024-03-09T15:11:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.960+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.520__multipart_mymultipart.2~dTsiSiLJ7LuuAxW0NbxvzZy2cugM8KE.4 2024-03-09T15:11:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.960+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.329246132227305234', time=2024-03-09T17:06:23.276045+0000, chain.objs.size()=12 2024-03-09T15:11:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.960+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.607__multipart_multipart_enc.2~Sm05t7DYTuQd0Rqu3pYouKcEzii05sh.1 2024-03-09T15:11:45.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.960+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.607__shadow_multipart_enc.2~Sm05t7DYTuQd0Rqu3pYouKcEzii05sh.1_1 2024-03-09T15:11:45.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.963+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.607__multipart_multipart_enc.2~Sm05t7DYTuQd0Rqu3pYouKcEzii05sh.2 2024-03-09T15:11:45.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.963+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.607__shadow_multipart_enc.2~Sm05t7DYTuQd0Rqu3pYouKcEzii05sh.2_1 2024-03-09T15:11:45.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.963+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.607__multipart_multipart_enc.2~Sm05t7DYTuQd0Rqu3pYouKcEzii05sh.3 2024-03-09T15:11:45.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.963+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.607__shadow_multipart_enc.2~Sm05t7DYTuQd0Rqu3pYouKcEzii05sh.3_1 2024-03-09T15:11:45.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.963+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.607__multipart_multipart_enc.2~Sm05t7DYTuQd0Rqu3pYouKcEzii05sh.4 2024-03-09T15:11:45.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.963+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.607__shadow_multipart_enc.2~Sm05t7DYTuQd0Rqu3pYouKcEzii05sh.4_1 2024-03-09T15:11:45.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.965+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.607__multipart_multipart_enc.2~Sm05t7DYTuQd0Rqu3pYouKcEzii05sh.5 2024-03-09T15:11:45.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.965+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.607__shadow_multipart_enc.2~Sm05t7DYTuQd0Rqu3pYouKcEzii05sh.5_1 2024-03-09T15:11:45.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.965+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.607__multipart_multipart_enc.2~Sm05t7DYTuQd0Rqu3pYouKcEzii05sh.6 2024-03-09T15:11:45.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.965+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.607__shadow_multipart_enc.2~Sm05t7DYTuQd0Rqu3pYouKcEzii05sh.6_1 2024-03-09T15:11:45.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.970+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.972+0000 7ff3ea430800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T15:11:45.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.973+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:11:45.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:11:45.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T15:11:45.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.12663610952794640222', time=2024-03-09T17:00:51.566898+0000, chain.objs.size()=1 2024-03-09T15:11:45.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.511__multipart_mymultipart.2~E0y0532Nw6i7XkDlDLtiyj99r4ZySiv.1 2024-03-09T15:11:45.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='2~rBRCK9CAszXEBLVOBDl-_SqNgl8RLU6', time=2024-03-09T17:02:37.306337+0000, chain.objs.size()=2 2024-03-09T15:11:45.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.524__multipart_mymultipart2.2~rBRCK9CAszXEBLVOBDl-_SqNgl8RLU6.1 2024-03-09T15:11:45.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.524__shadow_mymultipart2.2~rBRCK9CAszXEBLVOBDl-_SqNgl8RLU6.1_1 2024-03-09T15:11:45.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.4203345548268402960', time=2024-03-09T17:03:43.493120+0000, chain.objs.size()=1 2024-03-09T15:11:45.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.553__multipart_mymultipart.fIPm-talSrhzw0Fie6xfuUuINgVjqdLW.1 2024-03-09T15:11:45.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 20 garbage collection: RGWGC::process iterating over entry tag='5d93e872-363b-498b-b665-658644296b85.4535.2614333423932734041', time=2024-03-09T17:08:59.558452+0000, chain.objs.size()=10 2024-03-09T15:11:45.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.719__multipart_foo.2~DND4BK-SjiMtK9ze0k9c8DM3lIfQEEs.1 2024-03-09T15:11:45.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.719__multipart_foo.2~DND4BK-SjiMtK9ze0k9c8DM3lIfQEEs.2 2024-03-09T15:11:45.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.719__multipart_foo.2~DND4BK-SjiMtK9ze0k9c8DM3lIfQEEs.3 2024-03-09T15:11:45.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.719__multipart_foo.2~DND4BK-SjiMtK9ze0k9c8DM3lIfQEEs.4 2024-03-09T15:11:45.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.719__multipart_foo.2~DND4BK-SjiMtK9ze0k9c8DM3lIfQEEs.5 2024-03-09T15:11:45.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.719__multipart_foo.2~DND4BK-SjiMtK9ze0k9c8DM3lIfQEEs.6 2024-03-09T15:11:45.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.719__multipart_foo.2~DND4BK-SjiMtK9ze0k9c8DM3lIfQEEs.7 2024-03-09T15:11:45.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.974+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.719__multipart_foo.2~DND4BK-SjiMtK9ze0k9c8DM3lIfQEEs.8 2024-03-09T15:11:45.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.977+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.719__multipart_foo.2~DND4BK-SjiMtK9ze0k9c8DM3lIfQEEs.9 2024-03-09T15:11:45.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.977+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5d93e872-363b-498b-b665-658644296b85.4535.719__multipart_foo.2~DND4BK-SjiMtK9ze0k9c8DM3lIfQEEs.10 2024-03-09T15:11:45.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.980+0000 7ff3ea430800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:11:45.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.983+0000 7ff29bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T15:11:45.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.985+0000 7ff3ea430800 20 remove_watcher() i=0 2024-03-09T15:11:45.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.985+0000 7ff3ea430800 2 removed watcher, disabling cache 2024-03-09T15:11:45.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.987+0000 7ff3ea430800 20 remove_watcher() i=1 2024-03-09T15:11:45.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.987+0000 7ff3ea430800 20 remove_watcher() i=2 2024-03-09T15:11:45.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.988+0000 7ff3ea430800 20 remove_watcher() i=3 2024-03-09T15:11:45.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.989+0000 7ff3ea430800 20 remove_watcher() i=4 2024-03-09T15:11:45.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.990+0000 7ff3ea430800 20 remove_watcher() i=5 2024-03-09T15:11:45.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.991+0000 7ff3ea430800 20 remove_watcher() i=6 2024-03-09T15:11:45.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-03-09T15:11:45.992+0000 7ff3ea430800 20 remove_watcher() i=7 2024-03-09T15:11:46.002 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-03-09T15:11:46.023 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-09T15:11:46.095 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-09T15:11:46.095 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:11:46.418 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:46.436 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-03-09T15:11:46.442 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":1624,"stamp":"2024-03-09T15:11:45.532585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":734312783,"num_objects":1010,"num_object_clones":0,"num_object_copies":2539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1010,"num_whiteouts":0,"num_read":258340,"num_read_kb":2875976,"num_write":145702,"num_write_kb":2437205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":166,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14017,"ondisk_log_size":14017,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2560084,"kb_used_data":1198740,"kb_used_omap":12,"kb_used_meta":1361267,"kb_avail":752414636,"statfs":{"total":773094113280,"available":770472587264,"internally_reserved":0,"allocated":1227509760,"data_stored":1211617594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1393937968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4193250,"num_objects":-18,"num_object_clones":0,"num_object_copies":-37,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":189,"num_read_kb":10494,"num_write":42,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005623"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.575812+0000","last_change":"2024-03-09T14:50:35.506808+0000","last_active":"2024-03-09T15:08:06.575812+0000","last_peered":"2024-03-09T15:08:06.575812+0000","last_clean":"2024-03-09T15:08:06.575812+0000","last_became_active":"2024-03-09T14:50:35.506543+0000","last_became_peered":"2024-03-09T14:50:35.506543+0000","last_unstale":"2024-03-09T15:08:06.575812+0000","last_undegraded":"2024-03-09T15:08:06.575812+0000","last_fullsized":"2024-03-09T15:08:06.575812+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:58.593691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.579403+0000","last_change":"2024-03-09T14:38:37.436681+0000","last_active":"2024-03-09T15:08:36.579403+0000","last_peered":"2024-03-09T15:08:36.579403+0000","last_clean":"2024-03-09T15:08:36.579403+0000","last_became_active":"2024-03-09T14:38:37.436381+0000","last_became_peered":"2024-03-09T14:38:37.436381+0000","last_unstale":"2024-03-09T15:08:36.579403+0000","last_undegraded":"2024-03-09T15:08:36.579403+0000","last_fullsized":"2024-03-09T15:08:36.579403+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:00:43.470078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'4","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.679815+0000","last_change":"2024-03-09T14:38:34.419017+0000","last_active":"2024-03-09T15:08:36.679815+0000","last_peered":"2024-03-09T15:08:36.679815+0000","last_clean":"2024-03-09T15:08:36.679815+0000","last_became_active":"2024-03-09T14:38:34.418748+0000","last_became_peered":"2024-03-09T14:38:34.418748+0000","last_unstale":"2024-03-09T15:08:36.679815+0000","last_undegraded":"2024-03-09T15:08:36.679815+0000","last_fullsized":"2024-03-09T15:08:36.679815+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:59:58.574754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'22","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.579987+0000","last_change":"2024-03-09T14:35:41.122537+0000","last_active":"2024-03-09T15:09:01.579987+0000","last_peered":"2024-03-09T15:09:01.579987+0000","last_clean":"2024-03-09T15:09:01.579987+0000","last_became_active":"2024-03-09T14:35:41.121412+0000","last_became_peered":"2024-03-09T14:35:41.121412+0000","last_unstale":"2024-03-09T15:09:01.579987+0000","last_undegraded":"2024-03-09T15:09:01.579987+0000","last_fullsized":"2024-03-09T15:09:01.579987+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:26:10.508823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":67,"num_write":35,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.561315+0000","last_change":"2024-03-09T14:50:35.507193+0000","last_active":"2024-03-09T15:08:06.561315+0000","last_peered":"2024-03-09T15:08:06.561315+0000","last_clean":"2024-03-09T15:08:06.561315+0000","last_became_active":"2024-03-09T14:50:35.506905+0000","last_became_peered":"2024-03-09T14:50:35.506905+0000","last_unstale":"2024-03-09T15:08:06.561315+0000","last_undegraded":"2024-03-09T15:08:06.561315+0000","last_fullsized":"2024-03-09T15:08:06.561315+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:36:12.492461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.594554+0000","last_change":"2024-03-09T14:38:37.440992+0000","last_active":"2024-03-09T15:08:36.594554+0000","last_peered":"2024-03-09T15:08:36.594554+0000","last_clean":"2024-03-09T15:08:36.594554+0000","last_became_active":"2024-03-09T14:38:37.440733+0000","last_became_peered":"2024-03-09T14:38:37.440733+0000","last_unstale":"2024-03-09T15:08:36.594554+0000","last_undegraded":"2024-03-09T15:08:36.594554+0000","last_fullsized":"2024-03-09T15:08:36.594554+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:32:36.858145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'4","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.569798+0000","last_change":"2024-03-09T14:38:34.426397+0000","last_active":"2024-03-09T15:08:36.569798+0000","last_peered":"2024-03-09T15:08:36.569798+0000","last_clean":"2024-03-09T15:08:36.569798+0000","last_became_active":"2024-03-09T14:38:34.425629+0000","last_became_peered":"2024-03-09T14:38:34.425629+0000","last_unstale":"2024-03-09T15:08:36.569798+0000","last_undegraded":"2024-03-09T15:08:36.569798+0000","last_fullsized":"2024-03-09T15:08:36.569798+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:05.228490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'52","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.559699+0000","last_change":"2024-03-09T14:35:41.118142+0000","last_active":"2024-03-09T15:07:51.559699+0000","last_peered":"2024-03-09T15:07:51.559699+0000","last_clean":"2024-03-09T15:07:51.559699+0000","last_became_active":"2024-03-09T14:35:41.117858+0000","last_became_peered":"2024-03-09T14:35:41.117858+0000","last_unstale":"2024-03-09T15:07:51.559699+0000","last_undegraded":"2024-03-09T15:07:51.559699+0000","last_fullsized":"2024-03-09T15:07:51.559699+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:33:55.309111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":156,"num_write":85,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.585850+0000","last_change":"2024-03-09T14:50:35.506417+0000","last_active":"2024-03-09T15:07:31.585850+0000","last_peered":"2024-03-09T15:07:31.585850+0000","last_clean":"2024-03-09T15:07:31.585850+0000","last_became_active":"2024-03-09T14:50:35.506136+0000","last_became_peered":"2024-03-09T14:50:35.506136+0000","last_unstale":"2024-03-09T15:07:31.585850+0000","last_undegraded":"2024-03-09T15:07:31.585850+0000","last_fullsized":"2024-03-09T15:07:31.585850+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:25:26.999053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"261'9","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.571362+0000","last_change":"2024-03-09T14:38:37.443197+0000","last_active":"2024-03-09T15:07:46.571362+0000","last_peered":"2024-03-09T15:07:46.571362+0000","last_clean":"2024-03-09T15:07:46.571362+0000","last_became_active":"2024-03-09T14:38:37.442906+0000","last_became_peered":"2024-03-09T14:38:37.442906+0000","last_unstale":"2024-03-09T15:07:46.571362+0000","last_undegraded":"2024-03-09T15:07:46.571362+0000","last_fullsized":"2024-03-09T15:07:46.571362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:32:22.327056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":8196,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:46.566095+0000","last_change":"2024-03-09T14:38:34.425940+0000","last_active":"2024-03-09T15:08:46.566095+0000","last_peered":"2024-03-09T15:08:46.566095+0000","last_clean":"2024-03-09T15:08:46.566095+0000","last_became_active":"2024-03-09T14:38:34.425459+0000","last_became_peered":"2024-03-09T14:38:34.425459+0000","last_unstale":"2024-03-09T15:08:46.566095+0000","last_undegraded":"2024-03-09T15:08:46.566095+0000","last_fullsized":"2024-03-09T15:08:46.566095+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:37:12.404902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"261'16","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.574184+0000","last_change":"2024-03-09T14:35:41.123438+0000","last_active":"2024-03-09T15:08:11.574184+0000","last_peered":"2024-03-09T15:08:11.574184+0000","last_clean":"2024-03-09T15:08:11.574184+0000","last_became_active":"2024-03-09T14:35:41.123171+0000","last_became_peered":"2024-03-09T14:35:41.123171+0000","last_unstale":"2024-03-09T15:08:11.574184+0000","last_undegraded":"2024-03-09T15:08:11.574184+0000","last_fullsized":"2024-03-09T15:08:11.574184+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:41:36.543762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":56,"num_write":23,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.670756+0000","last_change":"2024-03-09T14:50:35.503396+0000","last_active":"2024-03-09T15:07:31.670756+0000","last_peered":"2024-03-09T15:07:31.670756+0000","last_clean":"2024-03-09T15:07:31.670756+0000","last_became_active":"2024-03-09T14:50:35.503090+0000","last_became_peered":"2024-03-09T14:50:35.503090+0000","last_unstale":"2024-03-09T15:07:31.670756+0000","last_undegraded":"2024-03-09T15:07:31.670756+0000","last_fullsized":"2024-03-09T15:07:31.670756+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:41:04.564051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'1","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.680879+0000","last_change":"2024-03-09T14:38:37.432464+0000","last_active":"2024-03-09T15:08:41.680879+0000","last_peered":"2024-03-09T15:08:41.680879+0000","last_clean":"2024-03-09T15:08:41.680879+0000","last_became_active":"2024-03-09T14:38:37.432089+0000","last_became_peered":"2024-03-09T14:38:37.432089+0000","last_unstale":"2024-03-09T15:08:41.680879+0000","last_undegraded":"2024-03-09T15:08:41.680879+0000","last_fullsized":"2024-03-09T15:08:41.680879+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:57:20.656020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'1","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588329+0000","last_change":"2024-03-09T14:38:34.417315+0000","last_active":"2024-03-09T15:07:46.588329+0000","last_peered":"2024-03-09T15:07:46.588329+0000","last_clean":"2024-03-09T15:07:46.588329+0000","last_became_active":"2024-03-09T14:38:34.417024+0000","last_became_peered":"2024-03-09T14:38:34.417024+0000","last_unstale":"2024-03-09T15:07:46.588329+0000","last_undegraded":"2024-03-09T15:07:46.588329+0000","last_fullsized":"2024-03-09T15:07:46.588329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:49:02.652837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'52","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.675909+0000","last_change":"2024-03-09T14:35:41.119245+0000","last_active":"2024-03-09T15:08:11.675909+0000","last_peered":"2024-03-09T15:08:11.675909+0000","last_clean":"2024-03-09T15:08:11.675909+0000","last_became_active":"2024-03-09T14:35:41.118960+0000","last_became_peered":"2024-03-09T14:35:41.118960+0000","last_unstale":"2024-03-09T15:08:11.675909+0000","last_undegraded":"2024-03-09T15:08:11.675909+0000","last_fullsized":"2024-03-09T15:08:11.675909+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:37.838048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":146,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.680090+0000","last_change":"2024-03-09T14:50:35.513378+0000","last_active":"2024-03-09T15:08:36.680090+0000","last_peered":"2024-03-09T15:08:36.680090+0000","last_clean":"2024-03-09T15:08:36.680090+0000","last_became_active":"2024-03-09T14:50:35.512534+0000","last_became_peered":"2024-03-09T14:50:35.512534+0000","last_unstale":"2024-03-09T15:08:36.680090+0000","last_undegraded":"2024-03-09T15:08:36.680090+0000","last_fullsized":"2024-03-09T15:08:36.680090+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:42:59.375192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.572976+0000","last_change":"2024-03-09T14:38:37.437102+0000","last_active":"2024-03-09T15:07:41.572976+0000","last_peered":"2024-03-09T15:07:41.572976+0000","last_clean":"2024-03-09T15:07:41.572976+0000","last_became_active":"2024-03-09T14:38:37.436829+0000","last_became_peered":"2024-03-09T14:38:37.436829+0000","last_unstale":"2024-03-09T15:07:41.572976+0000","last_undegraded":"2024-03-09T15:07:41.572976+0000","last_fullsized":"2024-03-09T15:07:41.572976+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:50:39.916587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'4","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.569979+0000","last_change":"2024-03-09T14:38:34.418873+0000","last_active":"2024-03-09T15:07:36.569979+0000","last_peered":"2024-03-09T15:07:36.569979+0000","last_clean":"2024-03-09T15:07:36.569979+0000","last_became_active":"2024-03-09T14:38:34.418209+0000","last_became_peered":"2024-03-09T14:38:34.418209+0000","last_unstale":"2024-03-09T15:07:36.569979+0000","last_undegraded":"2024-03-09T15:07:36.569979+0000","last_fullsized":"2024-03-09T15:07:36.569979+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:50.765837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099035,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6194,"num_write":4,"num_write_kb":5170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'22","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.675884+0000","last_change":"2024-03-09T14:35:41.123984+0000","last_active":"2024-03-09T15:08:11.675884+0000","last_peered":"2024-03-09T15:08:11.675884+0000","last_clean":"2024-03-09T15:08:11.675884+0000","last_became_active":"2024-03-09T14:35:41.123715+0000","last_became_peered":"2024-03-09T14:35:41.123715+0000","last_unstale":"2024-03-09T15:08:11.675884+0000","last_undegraded":"2024-03-09T15:08:11.675884+0000","last_fullsized":"2024-03-09T15:08:11.675884+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:09:46.063200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":62,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.574433+0000","last_change":"2024-03-09T14:50:35.510228+0000","last_active":"2024-03-09T15:09:21.574433+0000","last_peered":"2024-03-09T15:09:21.574433+0000","last_clean":"2024-03-09T15:09:21.574433+0000","last_became_active":"2024-03-09T14:50:35.509938+0000","last_became_peered":"2024-03-09T14:50:35.509938+0000","last_unstale":"2024-03-09T15:09:21.574433+0000","last_undegraded":"2024-03-09T15:09:21.574433+0000","last_fullsized":"2024-03-09T15:09:21.574433+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:07:27.212874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.586636+0000","last_change":"2024-03-09T14:38:37.439503+0000","last_active":"2024-03-09T15:07:36.586636+0000","last_peered":"2024-03-09T15:07:36.586636+0000","last_clean":"2024-03-09T15:07:36.586636+0000","last_became_active":"2024-03-09T14:38:37.439120+0000","last_became_peered":"2024-03-09T14:38:37.439120+0000","last_unstale":"2024-03-09T15:07:36.586636+0000","last_undegraded":"2024-03-09T15:07:36.586636+0000","last_fullsized":"2024-03-09T15:07:36.586636+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:27:16.750464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'4","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588215+0000","last_change":"2024-03-09T14:38:34.418823+0000","last_active":"2024-03-09T15:07:46.588215+0000","last_peered":"2024-03-09T15:07:46.588215+0000","last_clean":"2024-03-09T15:07:46.588215+0000","last_became_active":"2024-03-09T14:38:34.418553+0000","last_became_peered":"2024-03-09T14:38:34.418553+0000","last_unstale":"2024-03-09T15:07:46.588215+0000","last_undegraded":"2024-03-09T15:07:46.588215+0000","last_fullsized":"2024-03-09T15:07:46.588215+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:14.699597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'47","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591412+0000","last_change":"2024-03-09T14:35:41.124086+0000","last_active":"2024-03-09T15:08:11.591412+0000","last_peered":"2024-03-09T15:08:11.591412+0000","last_clean":"2024-03-09T15:08:11.591412+0000","last_became_active":"2024-03-09T14:35:41.123785+0000","last_became_peered":"2024-03-09T14:35:41.123785+0000","last_unstale":"2024-03-09T15:08:11.591412+0000","last_undegraded":"2024-03-09T15:08:11.591412+0000","last_fullsized":"2024-03-09T15:08:11.591412+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:48:27.983405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":141,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.711751+0000","last_change":"2024-03-09T14:50:35.500344+0000","last_active":"2024-03-09T15:08:06.711751+0000","last_peered":"2024-03-09T15:08:06.711751+0000","last_clean":"2024-03-09T15:08:06.711751+0000","last_became_active":"2024-03-09T14:50:35.499942+0000","last_became_peered":"2024-03-09T14:50:35.499942+0000","last_unstale":"2024-03-09T15:08:06.711751+0000","last_undegraded":"2024-03-09T15:08:06.711751+0000","last_fullsized":"2024-03-09T15:08:06.711751+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:47:17.395153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.594512+0000","last_change":"2024-03-09T14:38:37.438111+0000","last_active":"2024-03-09T15:08:36.594512+0000","last_peered":"2024-03-09T15:08:36.594512+0000","last_clean":"2024-03-09T15:08:36.594512+0000","last_became_active":"2024-03-09T14:38:37.437714+0000","last_became_peered":"2024-03-09T14:38:37.437714+0000","last_unstale":"2024-03-09T15:08:36.594512+0000","last_undegraded":"2024-03-09T15:08:36.594512+0000","last_fullsized":"2024-03-09T15:08:36.594512+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:33.290321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'1","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.594465+0000","last_change":"2024-03-09T14:38:34.420968+0000","last_active":"2024-03-09T15:08:36.594465+0000","last_peered":"2024-03-09T15:08:36.594465+0000","last_clean":"2024-03-09T15:08:36.594465+0000","last_became_active":"2024-03-09T14:38:34.420232+0000","last_became_peered":"2024-03-09T14:38:34.420232+0000","last_unstale":"2024-03-09T15:08:36.594465+0000","last_undegraded":"2024-03-09T15:08:36.594465+0000","last_fullsized":"2024-03-09T15:08:36.594465+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:19.316094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'24","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.567871+0000","last_change":"2024-03-09T14:35:41.121844+0000","last_active":"2024-03-09T15:07:16.567871+0000","last_peered":"2024-03-09T15:07:16.567871+0000","last_clean":"2024-03-09T15:07:16.567871+0000","last_became_active":"2024-03-09T14:35:41.121566+0000","last_became_peered":"2024-03-09T14:35:41.121566+0000","last_unstale":"2024-03-09T15:07:16.567871+0000","last_undegraded":"2024-03-09T15:07:16.567871+0000","last_fullsized":"2024-03-09T15:07:16.567871+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:48.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.711796+0000","last_change":"2024-03-09T14:50:35.501732+0000","last_active":"2024-03-09T15:08:06.711796+0000","last_peered":"2024-03-09T15:08:06.711796+0000","last_clean":"2024-03-09T15:08:06.711796+0000","last_became_active":"2024-03-09T14:50:35.501422+0000","last_became_peered":"2024-03-09T14:50:35.501422+0000","last_unstale":"2024-03-09T15:08:06.711796+0000","last_undegraded":"2024-03-09T15:08:06.711796+0000","last_fullsized":"2024-03-09T15:08:06.711796+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:51:45.968049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.679731+0000","last_change":"2024-03-09T14:38:37.438996+0000","last_active":"2024-03-09T15:08:36.679731+0000","last_peered":"2024-03-09T15:08:36.679731+0000","last_clean":"2024-03-09T15:08:36.679731+0000","last_became_active":"2024-03-09T14:38:37.438685+0000","last_became_peered":"2024-03-09T14:38:37.438685+0000","last_unstale":"2024-03-09T15:08:36.679731+0000","last_undegraded":"2024-03-09T15:08:36.679731+0000","last_fullsized":"2024-03-09T15:08:36.679731+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:52:54.773763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.577053+0000","last_change":"2024-03-09T14:38:34.422906+0000","last_active":"2024-03-09T15:08:36.577053+0000","last_peered":"2024-03-09T15:08:36.577053+0000","last_clean":"2024-03-09T15:08:36.577053+0000","last_became_active":"2024-03-09T14:38:34.422607+0000","last_became_peered":"2024-03-09T14:38:34.422607+0000","last_unstale":"2024-03-09T15:08:36.577053+0000","last_undegraded":"2024-03-09T15:08:36.577053+0000","last_fullsized":"2024-03-09T15:08:36.577053+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:57.914098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'68","reported_seq":223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:06.559342+0000","last_change":"2024-03-09T14:35:41.123207+0000","last_active":"2024-03-09T15:07:06.559342+0000","last_peered":"2024-03-09T15:07:06.559342+0000","last_clean":"2024-03-09T15:07:06.559342+0000","last_became_active":"2024-03-09T14:35:41.122898+0000","last_became_peered":"2024-03-09T14:35:41.122898+0000","last_unstale":"2024-03-09T15:07:06.559342+0000","last_undegraded":"2024-03-09T15:07:06.559342+0000","last_fullsized":"2024-03-09T15:07:06.559342+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:05:14.087935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":238,"num_write":108,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.573887+0000","last_change":"2024-03-09T14:50:35.508995+0000","last_active":"2024-03-09T15:09:16.573887+0000","last_peered":"2024-03-09T15:09:16.573887+0000","last_clean":"2024-03-09T15:09:16.573887+0000","last_became_active":"2024-03-09T14:50:35.508726+0000","last_became_peered":"2024-03-09T14:50:35.508726+0000","last_unstale":"2024-03-09T15:09:16.573887+0000","last_undegraded":"2024-03-09T15:09:16.573887+0000","last_fullsized":"2024-03-09T15:09:16.573887+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:57:02.512282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.671503+0000","last_change":"2024-03-09T14:38:37.437565+0000","last_active":"2024-03-09T15:07:36.671503+0000","last_peered":"2024-03-09T15:07:36.671503+0000","last_clean":"2024-03-09T15:07:36.671503+0000","last_became_active":"2024-03-09T14:38:37.437039+0000","last_became_peered":"2024-03-09T14:38:37.437039+0000","last_unstale":"2024-03-09T15:07:36.671503+0000","last_undegraded":"2024-03-09T15:07:36.671503+0000","last_fullsized":"2024-03-09T15:07:36.671503+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:19.810352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5293339,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":10340,"num_write":5,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"264'4","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.582498+0000","last_change":"2024-03-09T14:38:34.418567+0000","last_active":"2024-03-09T15:09:01.582498+0000","last_peered":"2024-03-09T15:09:01.582498+0000","last_clean":"2024-03-09T15:09:01.582498+0000","last_became_active":"2024-03-09T14:38:34.418269+0000","last_became_peered":"2024-03-09T14:38:34.418269+0000","last_unstale":"2024-03-09T15:09:01.582498+0000","last_undegraded":"2024-03-09T15:09:01.582498+0000","last_fullsized":"2024-03-09T15:09:01.582498+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:37.564267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":13312,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'38","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.061406+0000","last_change":"2024-03-09T14:35:41.122751+0000","last_active":"2024-03-09T15:07:45.061406+0000","last_peered":"2024-03-09T15:07:45.061406+0000","last_clean":"2024-03-09T15:07:45.061406+0000","last_became_active":"2024-03-09T14:35:41.122257+0000","last_became_peered":"2024-03-09T14:35:41.122257+0000","last_unstale":"2024-03-09T15:07:45.061406+0000","last_undegraded":"2024-03-09T15:07:45.061406+0000","last_fullsized":"2024-03-09T15:07:45.061406+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:47:51.831859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":116,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.569244+0000","last_change":"2024-03-09T14:50:35.503872+0000","last_active":"2024-03-09T15:09:16.569244+0000","last_peered":"2024-03-09T15:09:16.569244+0000","last_clean":"2024-03-09T15:09:16.569244+0000","last_became_active":"2024-03-09T14:50:35.503595+0000","last_became_peered":"2024-03-09T14:50:35.503595+0000","last_unstale":"2024-03-09T15:09:16.569244+0000","last_undegraded":"2024-03-09T15:09:16.569244+0000","last_fullsized":"2024-03-09T15:09:16.569244+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:47.112637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.682932+0000","last_change":"2024-03-09T14:38:37.430250+0000","last_active":"2024-03-09T15:09:01.682932+0000","last_peered":"2024-03-09T15:09:01.682932+0000","last_clean":"2024-03-09T15:09:01.682932+0000","last_became_active":"2024-03-09T14:38:37.429956+0000","last_became_peered":"2024-03-09T14:38:37.429956+0000","last_unstale":"2024-03-09T15:09:01.682932+0000","last_undegraded":"2024-03-09T15:09:01.682932+0000","last_fullsized":"2024-03-09T15:09:01.682932+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:30.262564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":11264,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'1","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.707983+0000","last_change":"2024-03-09T14:38:34.421959+0000","last_active":"2024-03-09T15:07:36.707983+0000","last_peered":"2024-03-09T15:07:36.707983+0000","last_clean":"2024-03-09T15:07:36.707983+0000","last_became_active":"2024-03-09T14:38:34.421678+0000","last_became_peered":"2024-03-09T14:38:34.421678+0000","last_unstale":"2024-03-09T15:07:36.707983+0000","last_undegraded":"2024-03-09T15:07:36.707983+0000","last_fullsized":"2024-03-09T15:07:36.707983+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:48.989741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'25","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:06.667904+0000","last_change":"2024-03-09T14:35:41.121109+0000","last_active":"2024-03-09T15:07:06.667904+0000","last_peered":"2024-03-09T15:07:06.667904+0000","last_clean":"2024-03-09T15:07:06.667904+0000","last_became_active":"2024-03-09T14:35:41.120818+0000","last_became_peered":"2024-03-09T14:35:41.120818+0000","last_unstale":"2024-03-09T15:07:06.667904+0000","last_undegraded":"2024-03-09T15:07:06.667904+0000","last_fullsized":"2024-03-09T15:07:06.667904+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:00.066768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":54,"num_write":56,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.721253+0000","last_change":"2024-03-09T14:50:35.500497+0000","last_active":"2024-03-09T15:09:16.721253+0000","last_peered":"2024-03-09T15:09:16.721253+0000","last_clean":"2024-03-09T15:09:16.721253+0000","last_became_active":"2024-03-09T14:50:35.500196+0000","last_became_peered":"2024-03-09T14:50:35.500196+0000","last_unstale":"2024-03-09T15:09:16.721253+0000","last_undegraded":"2024-03-09T15:09:16.721253+0000","last_fullsized":"2024-03-09T15:09:16.721253+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:59:34.049420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.671535+0000","last_change":"2024-03-09T14:38:37.437194+0000","last_active":"2024-03-09T15:07:36.671535+0000","last_peered":"2024-03-09T15:07:36.671535+0000","last_clean":"2024-03-09T15:07:36.671535+0000","last_became_active":"2024-03-09T14:38:37.436884+0000","last_became_peered":"2024-03-09T14:38:37.436884+0000","last_unstale":"2024-03-09T15:07:36.671535+0000","last_undegraded":"2024-03-09T15:07:36.671535+0000","last_fullsized":"2024-03-09T15:07:36.671535+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:13:52.104812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.558107+0000","last_change":"2024-03-09T14:38:34.420272+0000","last_active":"2024-03-09T15:07:36.558107+0000","last_peered":"2024-03-09T15:07:36.558107+0000","last_clean":"2024-03-09T15:07:36.558107+0000","last_became_active":"2024-03-09T14:38:34.420002+0000","last_became_peered":"2024-03-09T14:38:34.420002+0000","last_unstale":"2024-03-09T15:07:36.558107+0000","last_undegraded":"2024-03-09T15:07:36.558107+0000","last_fullsized":"2024-03-09T15:07:36.558107+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:05:58.461847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'34","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:06.555328+0000","last_change":"2024-03-09T14:35:41.116727+0000","last_active":"2024-03-09T15:07:06.555328+0000","last_peered":"2024-03-09T15:07:06.555328+0000","last_clean":"2024-03-09T15:07:06.555328+0000","last_became_active":"2024-03-09T14:35:41.116430+0000","last_became_peered":"2024-03-09T14:35:41.116430+0000","last_unstale":"2024-03-09T15:07:06.555328+0000","last_undegraded":"2024-03-09T15:07:06.555328+0000","last_fullsized":"2024-03-09T15:07:06.555328+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:09.089142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":94,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.584576+0000","last_change":"2024-03-09T14:50:35.507650+0000","last_active":"2024-03-09T15:09:16.584576+0000","last_peered":"2024-03-09T15:09:16.584576+0000","last_clean":"2024-03-09T15:09:16.584576+0000","last_became_active":"2024-03-09T14:50:35.506969+0000","last_became_peered":"2024-03-09T14:50:35.506969+0000","last_unstale":"2024-03-09T15:09:16.584576+0000","last_undegraded":"2024-03-09T15:09:16.584576+0000","last_fullsized":"2024-03-09T15:09:16.584576+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:45:43.559282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.586813+0000","last_change":"2024-03-09T14:38:37.436281+0000","last_active":"2024-03-09T15:07:36.586813+0000","last_peered":"2024-03-09T15:07:36.586813+0000","last_clean":"2024-03-09T15:07:36.586813+0000","last_became_active":"2024-03-09T14:38:37.435960+0000","last_became_peered":"2024-03-09T14:38:37.435960+0000","last_unstale":"2024-03-09T15:07:36.586813+0000","last_undegraded":"2024-03-09T15:07:36.586813+0000","last_fullsized":"2024-03-09T15:07:36.586813+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:44:42.297000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.570149+0000","last_change":"2024-03-09T14:38:34.420846+0000","last_active":"2024-03-09T15:07:36.570149+0000","last_peered":"2024-03-09T15:07:36.570149+0000","last_clean":"2024-03-09T15:07:36.570149+0000","last_became_active":"2024-03-09T14:38:34.420571+0000","last_became_peered":"2024-03-09T14:38:34.420571+0000","last_unstale":"2024-03-09T15:07:36.570149+0000","last_undegraded":"2024-03-09T15:07:36.570149+0000","last_fullsized":"2024-03-09T15:07:36.570149+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:29:07.174232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'36","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.714611+0000","last_change":"2024-03-09T14:35:41.121354+0000","last_active":"2024-03-09T15:08:26.714611+0000","last_peered":"2024-03-09T15:08:26.714611+0000","last_clean":"2024-03-09T15:08:26.714611+0000","last_became_active":"2024-03-09T14:35:41.121060+0000","last_became_peered":"2024-03-09T14:35:41.121060+0000","last_unstale":"2024-03-09T15:08:26.714611+0000","last_undegraded":"2024-03-09T15:08:26.714611+0000","last_fullsized":"2024-03-09T15:08:26.714611+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:59:13.798282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":100,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.670889+0000","last_change":"2024-03-09T14:50:35.504223+0000","last_active":"2024-03-09T15:07:31.670889+0000","last_peered":"2024-03-09T15:07:31.670889+0000","last_clean":"2024-03-09T15:07:31.670889+0000","last_became_active":"2024-03-09T14:50:35.503970+0000","last_became_peered":"2024-03-09T14:50:35.503970+0000","last_unstale":"2024-03-09T15:07:31.670889+0000","last_undegraded":"2024-03-09T15:07:31.670889+0000","last_fullsized":"2024-03-09T15:07:31.670889+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:00:00.835576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.571890+0000","last_change":"2024-03-09T14:38:37.438872+0000","last_active":"2024-03-09T15:08:56.571890+0000","last_peered":"2024-03-09T15:08:56.571890+0000","last_clean":"2024-03-09T15:08:56.571890+0000","last_became_active":"2024-03-09T14:38:37.438604+0000","last_became_peered":"2024-03-09T14:38:37.438604+0000","last_unstale":"2024-03-09T15:08:56.571890+0000","last_undegraded":"2024-03-09T15:08:56.571890+0000","last_fullsized":"2024-03-09T15:08:56.571890+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:51.268275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.596981+0000","last_change":"2024-03-09T14:38:34.421755+0000","last_active":"2024-03-09T15:08:56.596981+0000","last_peered":"2024-03-09T15:08:56.596981+0000","last_clean":"2024-03-09T15:08:56.596981+0000","last_became_active":"2024-03-09T14:38:34.421476+0000","last_became_peered":"2024-03-09T14:38:34.421476+0000","last_unstale":"2024-03-09T15:08:56.596981+0000","last_undegraded":"2024-03-09T15:08:56.596981+0000","last_fullsized":"2024-03-09T15:08:56.596981+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:39:12.298428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'114","reported_seq":387,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.713908+0000","last_change":"2024-03-09T14:35:41.125457+0000","last_active":"2024-03-09T15:08:21.713908+0000","last_peered":"2024-03-09T15:08:21.713908+0000","last_clean":"2024-03-09T15:08:21.713908+0000","last_became_active":"2024-03-09T14:35:41.125114+0000","last_became_peered":"2024-03-09T14:35:41.125114+0000","last_unstale":"2024-03-09T15:08:21.713908+0000","last_undegraded":"2024-03-09T15:08:21.713908+0000","last_fullsized":"2024-03-09T15:08:21.713908+0000","mapping_epoch":251,"log_start":"264'100","ondisk_log_start":"264'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:47.982191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":488,"num_write":144,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.569420+0000","last_change":"2024-03-09T14:50:35.510923+0000","last_active":"2024-03-09T15:07:31.569420+0000","last_peered":"2024-03-09T15:07:31.569420+0000","last_clean":"2024-03-09T15:07:31.569420+0000","last_became_active":"2024-03-09T14:50:35.510598+0000","last_became_peered":"2024-03-09T14:50:35.510598+0000","last_unstale":"2024-03-09T15:07:31.569420+0000","last_undegraded":"2024-03-09T15:07:31.569420+0000","last_fullsized":"2024-03-09T15:07:31.569420+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:52:13.398359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.571855+0000","last_change":"2024-03-09T14:38:37.439640+0000","last_active":"2024-03-09T15:08:56.571855+0000","last_peered":"2024-03-09T15:08:56.571855+0000","last_clean":"2024-03-09T15:08:56.571855+0000","last_became_active":"2024-03-09T14:38:37.439360+0000","last_became_peered":"2024-03-09T14:38:37.439360+0000","last_unstale":"2024-03-09T15:08:56.571855+0000","last_undegraded":"2024-03-09T15:08:56.571855+0000","last_fullsized":"2024-03-09T15:08:56.571855+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:24.960393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.682399+0000","last_change":"2024-03-09T14:38:34.419720+0000","last_active":"2024-03-09T15:08:56.682399+0000","last_peered":"2024-03-09T15:08:56.682399+0000","last_clean":"2024-03-09T15:08:56.682399+0000","last_became_active":"2024-03-09T14:38:34.419467+0000","last_became_peered":"2024-03-09T14:38:34.419467+0000","last_unstale":"2024-03-09T15:08:56.682399+0000","last_undegraded":"2024-03-09T15:08:56.682399+0000","last_fullsized":"2024-03-09T15:08:56.682399+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:29.894750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'15","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.575178+0000","last_change":"2024-03-09T14:35:41.118830+0000","last_active":"2024-03-09T15:08:21.575178+0000","last_peered":"2024-03-09T15:08:21.575178+0000","last_clean":"2024-03-09T15:08:21.575178+0000","last_became_active":"2024-03-09T14:35:41.118591+0000","last_became_peered":"2024-03-09T14:35:41.118591+0000","last_unstale":"2024-03-09T15:08:21.575178+0000","last_undegraded":"2024-03-09T15:08:21.575178+0000","last_fullsized":"2024-03-09T15:08:21.575178+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:44:14.623143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":42,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.582148+0000","last_change":"2024-03-09T14:50:35.503951+0000","last_active":"2024-03-09T15:09:21.582148+0000","last_peered":"2024-03-09T15:09:21.582148+0000","last_clean":"2024-03-09T15:09:21.582148+0000","last_became_active":"2024-03-09T14:50:35.503274+0000","last_became_peered":"2024-03-09T14:50:35.503274+0000","last_unstale":"2024-03-09T15:09:21.582148+0000","last_undegraded":"2024-03-09T15:09:21.582148+0000","last_fullsized":"2024-03-09T15:09:21.582148+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:51.019829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.682437+0000","last_change":"2024-03-09T14:38:37.436377+0000","last_active":"2024-03-09T15:08:56.682437+0000","last_peered":"2024-03-09T15:08:56.682437+0000","last_clean":"2024-03-09T15:08:56.682437+0000","last_became_active":"2024-03-09T14:38:37.436078+0000","last_became_peered":"2024-03-09T14:38:37.436078+0000","last_unstale":"2024-03-09T15:08:56.682437+0000","last_undegraded":"2024-03-09T15:08:56.682437+0000","last_fullsized":"2024-03-09T15:08:56.682437+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:51:30.342500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'4","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.597003+0000","last_change":"2024-03-09T14:38:34.420240+0000","last_active":"2024-03-09T15:08:56.597003+0000","last_peered":"2024-03-09T15:08:56.597003+0000","last_clean":"2024-03-09T15:08:56.597003+0000","last_became_active":"2024-03-09T14:38:34.419935+0000","last_became_peered":"2024-03-09T14:38:34.419935+0000","last_unstale":"2024-03-09T15:08:56.597003+0000","last_undegraded":"2024-03-09T15:08:56.597003+0000","last_fullsized":"2024-03-09T15:08:56.597003+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:16:59.079986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4234449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":7208,"num_write":4,"num_write_kb":7208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'26","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.592508+0000","last_change":"2024-03-09T14:35:41.117147+0000","last_active":"2024-03-09T15:08:21.592508+0000","last_peered":"2024-03-09T15:08:21.592508+0000","last_clean":"2024-03-09T15:08:21.592508+0000","last_became_active":"2024-03-09T14:35:41.116852+0000","last_became_peered":"2024-03-09T14:35:41.116852+0000","last_unstale":"2024-03-09T15:08:21.592508+0000","last_undegraded":"2024-03-09T15:08:21.592508+0000","last_fullsized":"2024-03-09T15:08:21.592508+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:27:43.779129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.670857+0000","last_change":"2024-03-09T14:50:35.509510+0000","last_active":"2024-03-09T15:07:31.670857+0000","last_peered":"2024-03-09T15:07:31.670857+0000","last_clean":"2024-03-09T15:07:31.670857+0000","last_became_active":"2024-03-09T14:50:35.509202+0000","last_became_peered":"2024-03-09T14:50:35.509202+0000","last_unstale":"2024-03-09T15:07:31.670857+0000","last_undegraded":"2024-03-09T15:07:31.670857+0000","last_fullsized":"2024-03-09T15:07:31.670857+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:23:44.698798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.596967+0000","last_change":"2024-03-09T14:38:37.441897+0000","last_active":"2024-03-09T15:08:56.596967+0000","last_peered":"2024-03-09T15:08:56.596967+0000","last_clean":"2024-03-09T15:08:56.596967+0000","last_became_active":"2024-03-09T14:38:37.441554+0000","last_became_peered":"2024-03-09T14:38:37.441554+0000","last_unstale":"2024-03-09T15:08:56.596967+0000","last_undegraded":"2024-03-09T15:08:56.596967+0000","last_fullsized":"2024-03-09T15:08:56.596967+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:13.709348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":80,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'1","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.581826+0000","last_change":"2024-03-09T14:38:34.424750+0000","last_active":"2024-03-09T15:08:56.581826+0000","last_peered":"2024-03-09T15:08:56.581826+0000","last_clean":"2024-03-09T15:08:56.581826+0000","last_became_active":"2024-03-09T14:38:34.424507+0000","last_became_peered":"2024-03-09T14:38:34.424507+0000","last_unstale":"2024-03-09T15:08:56.581826+0000","last_undegraded":"2024-03-09T15:08:56.581826+0000","last_fullsized":"2024-03-09T15:08:56.581826+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:14:16.729687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'52","reported_seq":169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.677257+0000","last_change":"2024-03-09T14:35:41.117227+0000","last_active":"2024-03-09T15:08:21.677257+0000","last_peered":"2024-03-09T15:08:21.677257+0000","last_clean":"2024-03-09T15:08:21.677257+0000","last_became_active":"2024-03-09T14:35:41.116932+0000","last_became_peered":"2024-03-09T14:35:41.116932+0000","last_unstale":"2024-03-09T15:08:21.677257+0000","last_undegraded":"2024-03-09T15:08:21.677257+0000","last_fullsized":"2024-03-09T15:08:21.677257+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:30:03.952026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":147,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.560814+0000","last_change":"2024-03-09T14:50:35.498350+0000","last_active":"2024-03-09T15:08:01.560814+0000","last_peered":"2024-03-09T15:08:01.560814+0000","last_clean":"2024-03-09T15:08:01.560814+0000","last_became_active":"2024-03-09T14:50:35.498045+0000","last_became_peered":"2024-03-09T14:50:35.498045+0000","last_unstale":"2024-03-09T15:08:01.560814+0000","last_undegraded":"2024-03-09T15:08:01.560814+0000","last_fullsized":"2024-03-09T15:08:01.560814+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:36.419114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.673446+0000","last_change":"2024-03-09T14:38:37.437345+0000","last_active":"2024-03-09T15:07:51.673446+0000","last_peered":"2024-03-09T15:07:51.673446+0000","last_clean":"2024-03-09T15:07:51.673446+0000","last_became_active":"2024-03-09T14:38:37.436672+0000","last_became_peered":"2024-03-09T14:38:37.436672+0000","last_unstale":"2024-03-09T15:07:51.673446+0000","last_undegraded":"2024-03-09T15:07:51.673446+0000","last_fullsized":"2024-03-09T15:07:51.673446+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:31:54.627840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1028,"num_write":9,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'8","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.709912+0000","last_change":"2024-03-09T14:38:34.423665+0000","last_active":"2024-03-09T15:07:51.709912+0000","last_peered":"2024-03-09T15:07:51.709912+0000","last_clean":"2024-03-09T15:07:51.709912+0000","last_became_active":"2024-03-09T14:38:34.423136+0000","last_became_peered":"2024-03-09T14:38:34.423136+0000","last_unstale":"2024-03-09T15:07:51.709912+0000","last_undegraded":"2024-03-09T15:07:51.709912+0000","last_fullsized":"2024-03-09T15:07:51.709912+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:45.903637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":17,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'29","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.669118+0000","last_change":"2024-03-09T14:35:41.120249+0000","last_active":"2024-03-09T15:07:16.669118+0000","last_peered":"2024-03-09T15:07:16.669118+0000","last_clean":"2024-03-09T15:07:16.669118+0000","last_became_active":"2024-03-09T14:35:41.119901+0000","last_became_peered":"2024-03-09T14:35:41.119901+0000","last_unstale":"2024-03-09T15:07:16.669118+0000","last_undegraded":"2024-03-09T15:07:16.669118+0000","last_fullsized":"2024-03-09T15:07:16.669118+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:28:37.467123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":86,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715810+0000","last_change":"2024-03-09T14:50:35.510602+0000","last_active":"2024-03-09T15:08:36.715810+0000","last_peered":"2024-03-09T15:08:36.715810+0000","last_clean":"2024-03-09T15:08:36.715810+0000","last_became_active":"2024-03-09T14:50:35.510330+0000","last_became_peered":"2024-03-09T14:50:35.510330+0000","last_unstale":"2024-03-09T15:08:36.715810+0000","last_undegraded":"2024-03-09T15:08:36.715810+0000","last_fullsized":"2024-03-09T15:08:36.715810+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:46.816086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"261'9","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.577422+0000","last_change":"2024-03-09T14:39:04.870290+0000","last_active":"2024-03-09T15:08:21.577422+0000","last_peered":"2024-03-09T15:08:21.577422+0000","last_clean":"2024-03-09T15:08:21.577422+0000","last_became_active":"2024-03-09T14:39:04.819697+0000","last_became_peered":"2024-03-09T14:39:04.819697+0000","last_unstale":"2024-03-09T15:08:21.577422+0000","last_undegraded":"2024-03-09T15:08:21.577422+0000","last_fullsized":"2024-03-09T15:08:21.577422+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:51.693969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":4098,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.d","version":"264'7","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.559668+0000","last_change":"2024-03-09T14:38:34.416788+0000","last_active":"2024-03-09T15:07:51.559668+0000","last_peered":"2024-03-09T15:07:51.559668+0000","last_clean":"2024-03-09T15:07:51.559668+0000","last_became_active":"2024-03-09T14:38:34.416475+0000","last_became_peered":"2024-03-09T14:38:34.416475+0000","last_unstale":"2024-03-09T15:07:51.559668+0000","last_undegraded":"2024-03-09T15:07:51.559668+0000","last_fullsized":"2024-03-09T15:07:51.559668+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:45.337347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":11,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'38","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.585918+0000","last_change":"2024-03-09T14:35:41.120210+0000","last_active":"2024-03-09T15:09:26.585918+0000","last_peered":"2024-03-09T15:09:26.585918+0000","last_clean":"2024-03-09T15:09:26.585918+0000","last_became_active":"2024-03-09T14:35:41.119890+0000","last_became_peered":"2024-03-09T14:35:41.119890+0000","last_unstale":"2024-03-09T15:09:26.585918+0000","last_undegraded":"2024-03-09T15:09:26.585918+0000","last_fullsized":"2024-03-09T15:09:26.585918+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:29.027891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":99,"num_write":64,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.589494+0000","last_change":"2024-03-09T14:50:35.503867+0000","last_active":"2024-03-09T15:07:56.589494+0000","last_peered":"2024-03-09T15:07:56.589494+0000","last_clean":"2024-03-09T15:07:56.589494+0000","last_became_active":"2024-03-09T14:50:35.503207+0000","last_became_peered":"2024-03-09T14:50:35.503207+0000","last_unstale":"2024-03-09T15:07:56.589494+0000","last_undegraded":"2024-03-09T15:07:56.589494+0000","last_fullsized":"2024-03-09T15:07:56.589494+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:56:26.518688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.564787+0000","last_change":"2024-03-09T14:38:37.438790+0000","last_active":"2024-03-09T15:07:56.564787+0000","last_peered":"2024-03-09T15:07:56.564787+0000","last_clean":"2024-03-09T15:07:56.564787+0000","last_became_active":"2024-03-09T14:38:37.438507+0000","last_became_peered":"2024-03-09T14:38:37.438507+0000","last_unstale":"2024-03-09T15:07:56.564787+0000","last_undegraded":"2024-03-09T15:07:56.564787+0000","last_fullsized":"2024-03-09T15:07:56.564787+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:53:53.804104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"261'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.571875+0000","last_change":"2024-03-09T14:38:34.420034+0000","last_active":"2024-03-09T15:07:51.571875+0000","last_peered":"2024-03-09T15:07:51.571875+0000","last_clean":"2024-03-09T15:07:51.571875+0000","last_became_active":"2024-03-09T14:38:34.419043+0000","last_became_peered":"2024-03-09T14:38:34.419043+0000","last_unstale":"2024-03-09T15:07:51.571875+0000","last_undegraded":"2024-03-09T15:07:51.571875+0000","last_fullsized":"2024-03-09T15:07:51.571875+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:11:48.118366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'88","reported_seq":332,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.601567+0000","last_change":"2024-03-09T14:35:41.117878+0000","last_active":"2024-03-09T15:09:26.601567+0000","last_peered":"2024-03-09T15:09:26.601567+0000","last_clean":"2024-03-09T15:09:26.601567+0000","last_became_active":"2024-03-09T14:35:41.117590+0000","last_became_peered":"2024-03-09T14:35:41.117590+0000","last_unstale":"2024-03-09T15:09:26.601567+0000","last_undegraded":"2024-03-09T15:09:26.601567+0000","last_fullsized":"2024-03-09T15:09:26.601567+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:41:31.619759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":440,"num_write":100,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.710572+0000","last_change":"2024-03-09T14:50:35.509165+0000","last_active":"2024-03-09T15:07:56.710572+0000","last_peered":"2024-03-09T15:07:56.710572+0000","last_clean":"2024-03-09T15:07:56.710572+0000","last_became_active":"2024-03-09T14:50:35.508832+0000","last_became_peered":"2024-03-09T14:50:35.508832+0000","last_unstale":"2024-03-09T15:07:56.710572+0000","last_undegraded":"2024-03-09T15:07:56.710572+0000","last_fullsized":"2024-03-09T15:07:56.710572+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:53.394584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.673464+0000","last_change":"2024-03-09T14:38:37.439624+0000","last_active":"2024-03-09T15:07:51.673464+0000","last_peered":"2024-03-09T15:07:51.673464+0000","last_clean":"2024-03-09T15:07:51.673464+0000","last_became_active":"2024-03-09T14:38:37.439177+0000","last_became_peered":"2024-03-09T14:38:37.439177+0000","last_unstale":"2024-03-09T15:07:51.673464+0000","last_undegraded":"2024-03-09T15:07:51.673464+0000","last_fullsized":"2024-03-09T15:07:51.673464+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:54:00.072929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'1","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.564764+0000","last_change":"2024-03-09T14:38:34.421435+0000","last_active":"2024-03-09T15:07:56.564764+0000","last_peered":"2024-03-09T15:07:56.564764+0000","last_clean":"2024-03-09T15:07:56.564764+0000","last_became_active":"2024-03-09T14:38:34.419461+0000","last_became_peered":"2024-03-09T14:38:34.419461+0000","last_unstale":"2024-03-09T15:07:56.564764+0000","last_undegraded":"2024-03-09T15:07:56.564764+0000","last_fullsized":"2024-03-09T15:07:56.564764+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:34:20.395850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'58","reported_seq":192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.570354+0000","last_change":"2024-03-09T14:35:41.116097+0000","last_active":"2024-03-09T15:09:26.570354+0000","last_peered":"2024-03-09T15:09:26.570354+0000","last_clean":"2024-03-09T15:09:26.570354+0000","last_became_active":"2024-03-09T14:35:41.115769+0000","last_became_peered":"2024-03-09T14:35:41.115769+0000","last_unstale":"2024-03-09T15:09:26.570354+0000","last_undegraded":"2024-03-09T15:09:26.570354+0000","last_fullsized":"2024-03-09T15:09:26.570354+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:05:10.170303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":187,"num_write":89,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.680129+0000","last_change":"2024-03-09T14:50:35.512842+0000","last_active":"2024-03-09T15:08:36.680129+0000","last_peered":"2024-03-09T15:08:36.680129+0000","last_clean":"2024-03-09T15:08:36.680129+0000","last_became_active":"2024-03-09T14:50:35.512515+0000","last_became_peered":"2024-03-09T14:50:35.512515+0000","last_unstale":"2024-03-09T15:08:36.680129+0000","last_undegraded":"2024-03-09T15:08:36.680129+0000","last_fullsized":"2024-03-09T15:08:36.680129+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:52:53.532722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'7","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.597014+0000","last_change":"2024-03-09T14:38:37.437989+0000","last_active":"2024-03-09T15:08:56.597014+0000","last_peered":"2024-03-09T15:08:56.597014+0000","last_clean":"2024-03-09T15:08:56.597014+0000","last_became_active":"2024-03-09T14:38:37.437674+0000","last_became_peered":"2024-03-09T14:38:37.437674+0000","last_unstale":"2024-03-09T15:08:56.597014+0000","last_undegraded":"2024-03-09T15:08:56.597014+0000","last_fullsized":"2024-03-09T15:08:56.597014+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:15:44.990882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'9","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.579384+0000","last_change":"2024-03-09T14:38:34.416934+0000","last_active":"2024-03-09T15:08:56.579384+0000","last_peered":"2024-03-09T15:08:56.579384+0000","last_clean":"2024-03-09T15:08:56.579384+0000","last_became_active":"2024-03-09T14:38:34.416635+0000","last_became_peered":"2024-03-09T14:38:34.416635+0000","last_unstale":"2024-03-09T15:08:56.579384+0000","last_undegraded":"2024-03-09T15:08:56.579384+0000","last_fullsized":"2024-03-09T15:08:56.579384+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:04.243246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'78","reported_seq":244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.582617+0000","last_change":"2024-03-09T14:35:41.113581+0000","last_active":"2024-03-09T15:09:26.582617+0000","last_peered":"2024-03-09T15:09:26.582617+0000","last_clean":"2024-03-09T15:09:26.582617+0000","last_became_active":"2024-03-09T14:35:41.113283+0000","last_became_peered":"2024-03-09T14:35:41.113283+0000","last_unstale":"2024-03-09T15:09:26.582617+0000","last_undegraded":"2024-03-09T15:09:26.582617+0000","last_fullsized":"2024-03-09T15:09:26.582617+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:01:48.405901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":352,"num_read_kb":252,"num_write":133,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715876+0000","last_change":"2024-03-09T14:50:35.509538+0000","last_active":"2024-03-09T15:08:36.715876+0000","last_peered":"2024-03-09T15:08:36.715876+0000","last_clean":"2024-03-09T15:08:36.715876+0000","last_became_active":"2024-03-09T14:50:35.509248+0000","last_became_peered":"2024-03-09T14:50:35.509248+0000","last_unstale":"2024-03-09T15:08:36.715876+0000","last_undegraded":"2024-03-09T15:08:36.715876+0000","last_fullsized":"2024-03-09T15:08:36.715876+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:52:29.204507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.718503+0000","last_change":"2024-03-09T14:38:37.432905+0000","last_active":"2024-03-09T15:08:56.718503+0000","last_peered":"2024-03-09T15:08:56.718503+0000","last_clean":"2024-03-09T15:08:56.718503+0000","last_became_active":"2024-03-09T14:38:37.432007+0000","last_became_peered":"2024-03-09T14:38:37.432007+0000","last_unstale":"2024-03-09T15:08:56.718503+0000","last_undegraded":"2024-03-09T15:08:56.718503+0000","last_fullsized":"2024-03-09T15:08:56.718503+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:42.955791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"261'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.571875+0000","last_change":"2024-03-09T14:38:34.421506+0000","last_active":"2024-03-09T15:08:56.571875+0000","last_peered":"2024-03-09T15:08:56.571875+0000","last_clean":"2024-03-09T15:08:56.571875+0000","last_became_active":"2024-03-09T14:38:34.419582+0000","last_became_peered":"2024-03-09T14:38:34.419582+0000","last_unstale":"2024-03-09T15:08:56.571875+0000","last_undegraded":"2024-03-09T15:08:56.571875+0000","last_fullsized":"2024-03-09T15:08:56.571875+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:37.179560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"261'10","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:16.713161+0000","last_change":"2024-03-09T14:35:41.123265+0000","last_active":"2024-03-09T15:08:16.713161+0000","last_peered":"2024-03-09T15:08:16.713161+0000","last_clean":"2024-03-09T15:08:16.713161+0000","last_became_active":"2024-03-09T14:35:41.122670+0000","last_became_peered":"2024-03-09T14:35:41.122670+0000","last_unstale":"2024-03-09T15:08:16.713161+0000","last_undegraded":"2024-03-09T15:08:16.713161+0000","last_fullsized":"2024-03-09T15:08:16.713161+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:24.170437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715833+0000","last_change":"2024-03-09T14:50:35.506808+0000","last_active":"2024-03-09T15:08:36.715833+0000","last_peered":"2024-03-09T15:08:36.715833+0000","last_clean":"2024-03-09T15:08:36.715833+0000","last_became_active":"2024-03-09T14:50:35.506542+0000","last_became_peered":"2024-03-09T14:50:35.506542+0000","last_unstale":"2024-03-09T15:08:36.715833+0000","last_undegraded":"2024-03-09T15:08:36.715833+0000","last_fullsized":"2024-03-09T15:08:36.715833+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:53:55.176426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.564277+0000","last_change":"2024-03-09T14:38:37.439732+0000","last_active":"2024-03-09T15:07:51.564277+0000","last_peered":"2024-03-09T15:07:51.564277+0000","last_clean":"2024-03-09T15:07:51.564277+0000","last_became_active":"2024-03-09T14:38:37.439444+0000","last_became_peered":"2024-03-09T14:38:37.439444+0000","last_unstale":"2024-03-09T15:07:51.564277+0000","last_undegraded":"2024-03-09T15:07:51.564277+0000","last_fullsized":"2024-03-09T15:07:51.564277+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:04:27.690405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'1","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.580438+0000","last_change":"2024-03-09T14:38:34.416466+0000","last_active":"2024-03-09T15:09:06.580438+0000","last_peered":"2024-03-09T15:09:06.580438+0000","last_clean":"2024-03-09T15:09:06.580438+0000","last_became_active":"2024-03-09T14:38:34.416139+0000","last_became_peered":"2024-03-09T14:38:34.416139+0000","last_unstale":"2024-03-09T15:09:06.580438+0000","last_undegraded":"2024-03-09T15:09:06.580438+0000","last_fullsized":"2024-03-09T15:09:06.580438+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:43:48.564982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'57","reported_seq":187,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:59.379012+0000","last_change":"2024-03-09T14:35:41.121118+0000","last_active":"2024-03-09T15:08:59.379012+0000","last_peered":"2024-03-09T15:08:59.379012+0000","last_clean":"2024-03-09T15:08:59.379012+0000","last_became_active":"2024-03-09T14:35:41.120802+0000","last_became_peered":"2024-03-09T14:35:41.120802+0000","last_unstale":"2024-03-09T15:08:59.379012+0000","last_undegraded":"2024-03-09T15:08:59.379012+0000","last_fullsized":"2024-03-09T15:08:59.379012+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:25:26.837573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":244,"num_read_kb":179,"num_write":100,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.577117+0000","last_change":"2024-03-09T14:50:35.505537+0000","last_active":"2024-03-09T15:08:36.577117+0000","last_peered":"2024-03-09T15:08:36.577117+0000","last_clean":"2024-03-09T15:08:36.577117+0000","last_became_active":"2024-03-09T14:50:35.505278+0000","last_became_peered":"2024-03-09T14:50:35.505278+0000","last_unstale":"2024-03-09T15:08:36.577117+0000","last_undegraded":"2024-03-09T15:08:36.577117+0000","last_fullsized":"2024-03-09T15:08:36.577117+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:48:40.487487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.719250+0000","last_change":"2024-03-09T14:38:37.436225+0000","last_active":"2024-03-09T15:09:01.719250+0000","last_peered":"2024-03-09T15:09:01.719250+0000","last_clean":"2024-03-09T15:09:01.719250+0000","last_became_active":"2024-03-09T14:38:37.435952+0000","last_became_peered":"2024-03-09T14:38:37.435952+0000","last_unstale":"2024-03-09T15:09:01.719250+0000","last_undegraded":"2024-03-09T15:09:01.719250+0000","last_fullsized":"2024-03-09T15:09:01.719250+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:45:59.696392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.588961+0000","last_change":"2024-03-09T14:38:34.420726+0000","last_active":"2024-03-09T15:07:51.588961+0000","last_peered":"2024-03-09T15:07:51.588961+0000","last_clean":"2024-03-09T15:07:51.588961+0000","last_became_active":"2024-03-09T14:38:34.420453+0000","last_became_peered":"2024-03-09T14:38:34.420453+0000","last_unstale":"2024-03-09T15:07:51.588961+0000","last_undegraded":"2024-03-09T15:07:51.588961+0000","last_fullsized":"2024-03-09T15:07:51.588961+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:12.244916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4100,"num_write":3,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'47","reported_seq":164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591361+0000","last_change":"2024-03-09T14:35:41.119775+0000","last_active":"2024-03-09T15:08:11.591361+0000","last_peered":"2024-03-09T15:08:11.591361+0000","last_clean":"2024-03-09T15:08:11.591361+0000","last_became_active":"2024-03-09T14:35:41.119481+0000","last_became_peered":"2024-03-09T14:35:41.119481+0000","last_unstale":"2024-03-09T15:08:11.591361+0000","last_undegraded":"2024-03-09T15:08:11.591361+0000","last_fullsized":"2024-03-09T15:08:11.591361+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:09.488004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":141,"num_write":77,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.722037+0000","last_change":"2024-03-09T14:50:35.508997+0000","last_active":"2024-03-09T15:09:21.722037+0000","last_peered":"2024-03-09T15:09:21.722037+0000","last_clean":"2024-03-09T15:09:21.722037+0000","last_became_active":"2024-03-09T14:50:35.508707+0000","last_became_peered":"2024-03-09T14:50:35.508707+0000","last_unstale":"2024-03-09T15:09:21.722037+0000","last_undegraded":"2024-03-09T15:09:21.722037+0000","last_fullsized":"2024-03-09T15:09:21.722037+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:47:02.507364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.572512+0000","last_change":"2024-03-09T14:38:37.444242+0000","last_active":"2024-03-09T15:07:56.572512+0000","last_peered":"2024-03-09T15:07:56.572512+0000","last_clean":"2024-03-09T15:07:56.572512+0000","last_became_active":"2024-03-09T14:38:37.443923+0000","last_became_peered":"2024-03-09T14:38:37.443923+0000","last_unstale":"2024-03-09T15:07:56.572512+0000","last_undegraded":"2024-03-09T15:07:56.572512+0000","last_fullsized":"2024-03-09T15:07:56.572512+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:13:01.825580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'7","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.709361+0000","last_change":"2024-03-09T14:38:34.421417+0000","last_active":"2024-03-09T15:07:46.709361+0000","last_peered":"2024-03-09T15:07:46.709361+0000","last_clean":"2024-03-09T15:07:46.709361+0000","last_became_active":"2024-03-09T14:38:34.421150+0000","last_became_peered":"2024-03-09T14:38:34.421150+0000","last_unstale":"2024-03-09T15:07:46.709361+0000","last_undegraded":"2024-03-09T15:07:46.709361+0000","last_fullsized":"2024-03-09T15:07:46.709361+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:24:24.004077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":20480,"num_write":22,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'56","reported_seq":186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.574223+0000","last_change":"2024-03-09T14:35:41.121720+0000","last_active":"2024-03-09T15:08:11.574223+0000","last_peered":"2024-03-09T15:08:11.574223+0000","last_clean":"2024-03-09T15:08:11.574223+0000","last_became_active":"2024-03-09T14:35:41.121047+0000","last_became_peered":"2024-03-09T14:35:41.121047+0000","last_unstale":"2024-03-09T15:08:11.574223+0000","last_undegraded":"2024-03-09T15:08:11.574223+0000","last_fullsized":"2024-03-09T15:08:11.574223+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:40.334231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":176,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.585246+0000","last_change":"2024-03-09T14:50:35.512833+0000","last_active":"2024-03-09T15:09:21.585246+0000","last_peered":"2024-03-09T15:09:21.585246+0000","last_clean":"2024-03-09T15:09:21.585246+0000","last_became_active":"2024-03-09T14:50:35.512540+0000","last_became_peered":"2024-03-09T14:50:35.512540+0000","last_unstale":"2024-03-09T15:09:21.585246+0000","last_undegraded":"2024-03-09T15:09:21.585246+0000","last_fullsized":"2024-03-09T15:09:21.585246+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:14.133666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"261'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.571314+0000","last_change":"2024-03-09T14:38:37.436520+0000","last_active":"2024-03-09T15:07:46.571314+0000","last_peered":"2024-03-09T15:07:46.571314+0000","last_clean":"2024-03-09T15:07:46.571314+0000","last_became_active":"2024-03-09T14:38:37.436246+0000","last_became_peered":"2024-03-09T14:38:37.436246+0000","last_unstale":"2024-03-09T15:07:46.571314+0000","last_undegraded":"2024-03-09T15:07:46.571314+0000","last_fullsized":"2024-03-09T15:07:46.571314+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:42:32.801291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.560208+0000","last_change":"2024-03-09T14:38:34.417805+0000","last_active":"2024-03-09T15:07:56.560208+0000","last_peered":"2024-03-09T15:07:56.560208+0000","last_clean":"2024-03-09T15:07:56.560208+0000","last_became_active":"2024-03-09T14:38:34.417530+0000","last_became_peered":"2024-03-09T14:38:34.417530+0000","last_unstale":"2024-03-09T15:07:56.560208+0000","last_undegraded":"2024-03-09T15:07:56.560208+0000","last_fullsized":"2024-03-09T15:07:56.560208+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:01.677780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'34","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591468+0000","last_change":"2024-03-09T14:35:41.116363+0000","last_active":"2024-03-09T15:08:11.591468+0000","last_peered":"2024-03-09T15:08:11.591468+0000","last_clean":"2024-03-09T15:08:11.591468+0000","last_became_active":"2024-03-09T14:35:41.116050+0000","last_became_peered":"2024-03-09T14:35:41.116050+0000","last_unstale":"2024-03-09T15:08:11.591468+0000","last_undegraded":"2024-03-09T15:08:11.591468+0000","last_fullsized":"2024-03-09T15:08:11.591468+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:25:09.271246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":98,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.570342+0000","last_change":"2024-03-09T14:50:35.513092+0000","last_active":"2024-03-09T15:08:41.570342+0000","last_peered":"2024-03-09T15:08:41.570342+0000","last_clean":"2024-03-09T15:08:41.570342+0000","last_became_active":"2024-03-09T14:50:35.512533+0000","last_became_peered":"2024-03-09T14:50:35.512533+0000","last_unstale":"2024-03-09T15:08:41.570342+0000","last_undegraded":"2024-03-09T15:08:41.570342+0000","last_fullsized":"2024-03-09T15:08:41.570342+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:04:55.415472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.718635+0000","last_change":"2024-03-09T14:38:37.432938+0000","last_active":"2024-03-09T15:08:56.718635+0000","last_peered":"2024-03-09T15:08:56.718635+0000","last_clean":"2024-03-09T15:08:56.718635+0000","last_became_active":"2024-03-09T14:38:37.432627+0000","last_became_peered":"2024-03-09T14:38:37.432627+0000","last_unstale":"2024-03-09T15:08:56.718635+0000","last_undegraded":"2024-03-09T15:08:56.718635+0000","last_fullsized":"2024-03-09T15:08:56.718635+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:58:51.983213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4119,"num_write":3,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.581912+0000","last_change":"2024-03-09T14:38:34.416562+0000","last_active":"2024-03-09T15:08:56.581912+0000","last_peered":"2024-03-09T15:08:56.581912+0000","last_clean":"2024-03-09T15:08:56.581912+0000","last_became_active":"2024-03-09T14:38:34.415277+0000","last_became_peered":"2024-03-09T14:38:34.415277+0000","last_unstale":"2024-03-09T15:08:56.581912+0000","last_undegraded":"2024-03-09T15:08:56.581912+0000","last_fullsized":"2024-03-09T15:08:56.581912+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:20.801857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'18","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.719901+0000","last_change":"2024-03-09T14:35:41.123833+0000","last_active":"2024-03-09T15:09:06.719901+0000","last_peered":"2024-03-09T15:09:06.719901+0000","last_clean":"2024-03-09T15:09:06.719901+0000","last_became_active":"2024-03-09T14:35:41.123542+0000","last_became_peered":"2024-03-09T14:35:41.123542+0000","last_unstale":"2024-03-09T15:09:06.719901+0000","last_undegraded":"2024-03-09T15:09:06.719901+0000","last_fullsized":"2024-03-09T15:09:06.719901+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:01.200992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":44,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.600834+0000","last_change":"2024-03-09T14:50:35.506612+0000","last_active":"2024-03-09T15:09:21.600834+0000","last_peered":"2024-03-09T15:09:21.600834+0000","last_clean":"2024-03-09T15:09:21.600834+0000","last_became_active":"2024-03-09T14:50:35.506332+0000","last_became_peered":"2024-03-09T14:50:35.506332+0000","last_unstale":"2024-03-09T15:09:21.600834+0000","last_undegraded":"2024-03-09T15:09:21.600834+0000","last_fullsized":"2024-03-09T15:09:21.600834+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:34:03.683363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.597155+0000","last_change":"2024-03-09T14:38:37.438481+0000","last_active":"2024-03-09T15:08:56.597155+0000","last_peered":"2024-03-09T15:08:56.597155+0000","last_clean":"2024-03-09T15:08:56.597155+0000","last_became_active":"2024-03-09T14:38:37.438182+0000","last_became_peered":"2024-03-09T14:38:37.438182+0000","last_unstale":"2024-03-09T15:08:56.597155+0000","last_undegraded":"2024-03-09T15:08:56.597155+0000","last_fullsized":"2024-03-09T15:08:56.597155+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:04.307257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'1","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.718649+0000","last_change":"2024-03-09T14:38:34.423437+0000","last_active":"2024-03-09T15:08:56.718649+0000","last_peered":"2024-03-09T15:08:56.718649+0000","last_clean":"2024-03-09T15:08:56.718649+0000","last_became_active":"2024-03-09T14:38:34.423106+0000","last_became_peered":"2024-03-09T14:38:34.423106+0000","last_unstale":"2024-03-09T15:08:56.718649+0000","last_undegraded":"2024-03-09T15:08:56.718649+0000","last_fullsized":"2024-03-09T15:08:56.718649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:39:42.766455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'25","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.572391+0000","last_change":"2024-03-09T14:35:41.118139+0000","last_active":"2024-03-09T15:09:01.572391+0000","last_peered":"2024-03-09T15:09:01.572391+0000","last_clean":"2024-03-09T15:09:01.572391+0000","last_became_active":"2024-03-09T14:35:41.117841+0000","last_became_peered":"2024-03-09T14:35:41.117841+0000","last_unstale":"2024-03-09T15:09:01.572391+0000","last_undegraded":"2024-03-09T15:09:01.572391+0000","last_fullsized":"2024-03-09T15:09:01.572391+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:59:14.029378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":73,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.560222+0000","last_change":"2024-03-09T14:50:35.509942+0000","last_active":"2024-03-09T15:07:56.560222+0000","last_peered":"2024-03-09T15:07:56.560222+0000","last_clean":"2024-03-09T15:07:56.560222+0000","last_became_active":"2024-03-09T14:50:35.509460+0000","last_became_peered":"2024-03-09T14:50:35.509460+0000","last_unstale":"2024-03-09T15:07:56.560222+0000","last_undegraded":"2024-03-09T15:07:56.560222+0000","last_fullsized":"2024-03-09T15:07:56.560222+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:23:50.413320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.563731+0000","last_change":"2024-03-09T14:38:37.439377+0000","last_active":"2024-03-09T15:07:46.563731+0000","last_peered":"2024-03-09T15:07:46.563731+0000","last_clean":"2024-03-09T15:07:46.563731+0000","last_became_active":"2024-03-09T14:38:37.439087+0000","last_became_peered":"2024-03-09T14:38:37.439087+0000","last_unstale":"2024-03-09T15:07:46.563731+0000","last_undegraded":"2024-03-09T15:07:46.563731+0000","last_fullsized":"2024-03-09T15:07:46.563731+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:58.859594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'1","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.716561+0000","last_change":"2024-03-09T14:38:34.418700+0000","last_active":"2024-03-09T15:08:41.716561+0000","last_peered":"2024-03-09T15:08:41.716561+0000","last_clean":"2024-03-09T15:08:41.716561+0000","last_became_active":"2024-03-09T14:38:34.418453+0000","last_became_peered":"2024-03-09T14:38:34.418453+0000","last_unstale":"2024-03-09T15:08:41.716561+0000","last_undegraded":"2024-03-09T15:08:41.716561+0000","last_fullsized":"2024-03-09T15:08:41.716561+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:34:24.696789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'42","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.582487+0000","last_change":"2024-03-09T14:35:41.119444+0000","last_active":"2024-03-09T15:09:01.582487+0000","last_peered":"2024-03-09T15:09:01.582487+0000","last_clean":"2024-03-09T15:09:01.582487+0000","last_became_active":"2024-03-09T14:35:41.119181+0000","last_became_peered":"2024-03-09T14:35:41.119181+0000","last_unstale":"2024-03-09T15:09:01.582487+0000","last_undegraded":"2024-03-09T15:09:01.582487+0000","last_fullsized":"2024-03-09T15:09:01.582487+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:50:55.417930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":129,"num_write":69,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.572571+0000","last_change":"2024-03-09T14:50:35.504114+0000","last_active":"2024-03-09T15:07:56.572571+0000","last_peered":"2024-03-09T15:07:56.572571+0000","last_clean":"2024-03-09T15:07:56.572571+0000","last_became_active":"2024-03-09T14:50:35.503858+0000","last_became_peered":"2024-03-09T14:50:35.503858+0000","last_unstale":"2024-03-09T15:07:56.572571+0000","last_undegraded":"2024-03-09T15:07:56.572571+0000","last_fullsized":"2024-03-09T15:07:56.572571+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:40:55.004194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.580175+0000","last_change":"2024-03-09T14:38:37.434360+0000","last_active":"2024-03-09T15:08:41.580175+0000","last_peered":"2024-03-09T15:08:41.580175+0000","last_clean":"2024-03-09T15:08:41.580175+0000","last_became_active":"2024-03-09T14:38:37.434065+0000","last_became_peered":"2024-03-09T14:38:37.434065+0000","last_unstale":"2024-03-09T15:08:41.580175+0000","last_undegraded":"2024-03-09T15:08:41.580175+0000","last_fullsized":"2024-03-09T15:08:41.580175+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:19:29.089561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.709323+0000","last_change":"2024-03-09T14:38:34.423457+0000","last_active":"2024-03-09T15:07:46.709323+0000","last_peered":"2024-03-09T15:07:46.709323+0000","last_clean":"2024-03-09T15:07:46.709323+0000","last_became_active":"2024-03-09T14:38:34.423145+0000","last_became_peered":"2024-03-09T14:38:34.423145+0000","last_unstale":"2024-03-09T15:07:46.709323+0000","last_undegraded":"2024-03-09T15:07:46.709323+0000","last_fullsized":"2024-03-09T15:07:46.709323+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:09.464410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'41","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.597881+0000","last_change":"2024-03-09T14:35:41.117904+0000","last_active":"2024-03-09T15:09:01.597881+0000","last_peered":"2024-03-09T15:09:01.597881+0000","last_clean":"2024-03-09T15:09:01.597881+0000","last_became_active":"2024-03-09T14:35:41.117617+0000","last_became_peered":"2024-03-09T14:35:41.117617+0000","last_unstale":"2024-03-09T15:09:01.597881+0000","last_undegraded":"2024-03-09T15:09:01.597881+0000","last_fullsized":"2024-03-09T15:09:01.597881+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:19:10.800608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":72,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.582122+0000","last_change":"2024-03-09T14:50:35.506611+0000","last_active":"2024-03-09T15:09:21.582122+0000","last_peered":"2024-03-09T15:09:21.582122+0000","last_clean":"2024-03-09T15:09:21.582122+0000","last_became_active":"2024-03-09T14:50:35.506356+0000","last_became_peered":"2024-03-09T14:50:35.506356+0000","last_unstale":"2024-03-09T15:09:21.582122+0000","last_undegraded":"2024-03-09T15:09:21.582122+0000","last_fullsized":"2024-03-09T15:09:21.582122+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:42:15.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588120+0000","last_change":"2024-03-09T14:38:37.439826+0000","last_active":"2024-03-09T15:07:46.588120+0000","last_peered":"2024-03-09T15:07:46.588120+0000","last_clean":"2024-03-09T15:07:46.588120+0000","last_became_active":"2024-03-09T14:38:37.439120+0000","last_became_peered":"2024-03-09T14:38:37.439120+0000","last_unstale":"2024-03-09T15:07:46.588120+0000","last_undegraded":"2024-03-09T15:07:46.588120+0000","last_fullsized":"2024-03-09T15:07:46.588120+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:27.748958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"261'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.563759+0000","last_change":"2024-03-09T14:38:34.422928+0000","last_active":"2024-03-09T15:07:46.563759+0000","last_peered":"2024-03-09T15:07:46.563759+0000","last_clean":"2024-03-09T15:07:46.563759+0000","last_became_active":"2024-03-09T14:38:34.422585+0000","last_became_peered":"2024-03-09T14:38:34.422585+0000","last_unstale":"2024-03-09T15:07:46.563759+0000","last_undegraded":"2024-03-09T15:07:46.563759+0000","last_fullsized":"2024-03-09T15:07:46.563759+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:09.827968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'19","reported_seq":94,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.597802+0000","last_change":"2024-03-09T14:35:41.119625+0000","last_active":"2024-03-09T15:09:01.597802+0000","last_peered":"2024-03-09T15:09:01.597802+0000","last_clean":"2024-03-09T15:09:01.597802+0000","last_became_active":"2024-03-09T14:35:41.118425+0000","last_became_peered":"2024-03-09T14:35:41.118425+0000","last_unstale":"2024-03-09T15:09:01.597802+0000","last_undegraded":"2024-03-09T15:09:01.597802+0000","last_fullsized":"2024-03-09T15:09:01.597802+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:23:15.437892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":53,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.722085+0000","last_change":"2024-03-09T14:50:35.505890+0000","last_active":"2024-03-09T15:09:21.722085+0000","last_peered":"2024-03-09T15:09:21.722085+0000","last_clean":"2024-03-09T15:09:21.722085+0000","last_became_active":"2024-03-09T14:50:35.505615+0000","last_became_peered":"2024-03-09T14:50:35.505615+0000","last_unstale":"2024-03-09T15:09:21.722085+0000","last_undegraded":"2024-03-09T15:09:21.722085+0000","last_fullsized":"2024-03-09T15:09:21.722085+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:12.727103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588248+0000","last_change":"2024-03-09T14:38:37.437735+0000","last_active":"2024-03-09T15:07:46.588248+0000","last_peered":"2024-03-09T15:07:46.588248+0000","last_clean":"2024-03-09T15:07:46.588248+0000","last_became_active":"2024-03-09T14:38:37.437417+0000","last_became_peered":"2024-03-09T14:38:37.437417+0000","last_unstale":"2024-03-09T15:07:46.588248+0000","last_undegraded":"2024-03-09T15:07:46.588248+0000","last_fullsized":"2024-03-09T15:07:46.588248+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:55.465162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":9,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"261'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588136+0000","last_change":"2024-03-09T14:38:34.415988+0000","last_active":"2024-03-09T15:07:46.588136+0000","last_peered":"2024-03-09T15:07:46.588136+0000","last_clean":"2024-03-09T15:07:46.588136+0000","last_became_active":"2024-03-09T14:38:34.415722+0000","last_became_peered":"2024-03-09T14:38:34.415722+0000","last_unstale":"2024-03-09T15:07:46.588136+0000","last_undegraded":"2024-03-09T15:07:46.588136+0000","last_fullsized":"2024-03-09T15:07:46.588136+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:07.146194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'34","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.709277+0000","last_change":"2024-03-09T14:35:41.121819+0000","last_active":"2024-03-09T15:07:46.709277+0000","last_peered":"2024-03-09T15:07:46.709277+0000","last_clean":"2024-03-09T15:07:46.709277+0000","last_became_active":"2024-03-09T14:35:41.121524+0000","last_became_peered":"2024-03-09T14:35:41.121524+0000","last_unstale":"2024-03-09T15:07:46.709277+0000","last_undegraded":"2024-03-09T15:07:46.709277+0000","last_fullsized":"2024-03-09T15:07:46.709277+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:28:01.825341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":103,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'177","reported_seq":777,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:10.542951+0000","last_change":"2024-03-09T14:27:03.724626+0000","last_active":"2024-03-09T15:08:10.542951+0000","last_peered":"2024-03-09T15:08:10.542951+0000","last_clean":"2024-03-09T15:08:10.542951+0000","last_became_active":"2024-03-09T14:27:03.724231+0000","last_became_peered":"2024-03-09T14:27:03.724231+0000","last_unstale":"2024-03-09T15:08:10.542951+0000","last_undegraded":"2024-03-09T15:08:10.542951+0000","last_fullsized":"2024-03-09T15:08:10.542951+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:50.020398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18164995,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":328,"num_read_kb":37533,"num_write":989,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'398","reported_seq":1851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:49.452754+0000","last_change":"2024-03-09T14:26:28.649571+0000","last_active":"2024-03-09T15:10:49.452754+0000","last_peered":"2024-03-09T15:10:49.452754+0000","last_clean":"2024-03-09T15:10:49.452754+0000","last_became_active":"2024-03-09T14:26:28.648852+0000","last_became_peered":"2024-03-09T14:26:28.648852+0000","last_unstale":"2024-03-09T15:10:49.452754+0000","last_undegraded":"2024-03-09T15:10:49.452754+0000","last_fullsized":"2024-03-09T15:10:49.452754+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:19.263893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2165,"num_read_kb":2027,"num_write":486,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'158","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:23.774722+0000","last_change":"2024-03-09T14:26:26.636093+0000","last_active":"2024-03-09T15:10:23.774722+0000","last_peered":"2024-03-09T15:10:23.774722+0000","last_clean":"2024-03-09T15:10:23.774722+0000","last_became_active":"2024-03-09T14:26:26.635705+0000","last_became_peered":"2024-03-09T14:26:26.635705+0000","last_unstale":"2024-03-09T15:10:23.774722+0000","last_undegraded":"2024-03-09T15:10:23.774722+0000","last_fullsized":"2024-03-09T15:10:23.774722+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:44.432842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8483879,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":33876,"num_write":830,"num_write_kb":32927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'816","reported_seq":2387,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.199607+0000","last_change":"2024-03-09T14:28:04.197235+0000","last_active":"2024-03-09T15:11:09.199607+0000","last_peered":"2024-03-09T15:11:09.199607+0000","last_clean":"2024-03-09T15:11:09.199607+0000","last_became_active":"2024-03-09T14:28:04.196872+0000","last_became_peered":"2024-03-09T14:28:04.196872+0000","last_unstale":"2024-03-09T15:11:09.199607+0000","last_undegraded":"2024-03-09T15:11:09.199607+0000","last_fullsized":"2024-03-09T15:11:09.199607+0000","mapping_epoch":38,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:48.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3746,"num_read_kb":3347,"num_write":1098,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'203","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.573686+0000","last_change":"2024-03-09T14:26:26.626838+0000","last_active":"2024-03-09T15:08:06.573686+0000","last_peered":"2024-03-09T15:08:06.573686+0000","last_clean":"2024-03-09T15:08:06.573686+0000","last_became_active":"2024-03-09T14:26:26.626521+0000","last_became_peered":"2024-03-09T14:26:26.626521+0000","last_unstale":"2024-03-09T15:08:06.573686+0000","last_undegraded":"2024-03-09T15:08:06.573686+0000","last_fullsized":"2024-03-09T15:08:06.573686+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:37.136696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5829780,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":482,"num_read_kb":60498,"num_write":1102,"num_write_kb":28928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'630","reported_seq":2071,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.123841+0000","last_change":"2024-03-09T14:26:28.649656+0000","last_active":"2024-03-09T15:11:01.123841+0000","last_peered":"2024-03-09T15:11:01.123841+0000","last_clean":"2024-03-09T15:11:01.123841+0000","last_became_active":"2024-03-09T14:26:28.649054+0000","last_became_peered":"2024-03-09T14:26:28.649054+0000","last_unstale":"2024-03-09T15:11:01.123841+0000","last_undegraded":"2024-03-09T15:11:01.123841+0000","last_fullsized":"2024-03-09T15:11:01.123841+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":600,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:52:42.171996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3080,"num_read_kb":2811,"num_write":822,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'175","reported_seq":781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:21.992580+0000","last_change":"2024-03-09T14:26:26.647604+0000","last_active":"2024-03-09T15:10:21.992580+0000","last_peered":"2024-03-09T15:10:21.992580+0000","last_clean":"2024-03-09T15:10:21.992580+0000","last_became_active":"2024-03-09T14:26:26.647183+0000","last_became_peered":"2024-03-09T14:26:26.647183+0000","last_unstale":"2024-03-09T15:10:21.992580+0000","last_undegraded":"2024-03-09T15:10:21.992580+0000","last_fullsized":"2024-03-09T15:10:21.992580+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:57:15.681003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2102091,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":10841,"num_write":989,"num_write_kb":22118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'383","reported_seq":1952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.553788+0000","last_change":"2024-03-09T14:26:28.649519+0000","last_active":"2024-03-09T15:10:54.553788+0000","last_peered":"2024-03-09T15:10:54.553788+0000","last_clean":"2024-03-09T15:10:54.553788+0000","last_became_active":"2024-03-09T14:26:28.649146+0000","last_became_peered":"2024-03-09T14:26:28.649146+0000","last_unstale":"2024-03-09T15:10:54.553788+0000","last_undegraded":"2024-03-09T15:10:54.553788+0000","last_fullsized":"2024-03-09T15:10:54.553788+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:12:07.136106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2286,"num_read_kb":2187,"num_write":441,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'258","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.718584+0000","last_change":"2024-03-09T14:26:26.652067+0000","last_active":"2024-03-09T15:08:56.718584+0000","last_peered":"2024-03-09T15:08:56.718584+0000","last_clean":"2024-03-09T15:08:56.718584+0000","last_became_active":"2024-03-09T14:26:26.651564+0000","last_became_peered":"2024-03-09T14:26:26.651564+0000","last_unstale":"2024-03-09T15:08:56.718584+0000","last_undegraded":"2024-03-09T15:08:56.718584+0000","last_fullsized":"2024-03-09T15:08:56.718584+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:14:35.603518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18185497,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":642,"num_read_kb":37846,"num_write":1526,"num_write_kb":26421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'334","reported_seq":1772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:13.861455+0000","last_change":"2024-03-09T14:26:28.648555+0000","last_active":"2024-03-09T15:09:13.861455+0000","last_peered":"2024-03-09T15:09:13.861455+0000","last_clean":"2024-03-09T15:09:13.861455+0000","last_became_active":"2024-03-09T14:26:28.648259+0000","last_became_peered":"2024-03-09T14:26:28.648259+0000","last_unstale":"2024-03-09T15:09:13.861455+0000","last_undegraded":"2024-03-09T15:09:13.861455+0000","last_fullsized":"2024-03-09T15:09:13.861455+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:13:53.538477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2053,"num_read_kb":1964,"num_write":385,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'167","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:26.458259+0000","last_change":"2024-03-09T14:26:26.649108+0000","last_active":"2024-03-09T15:10:26.458259+0000","last_peered":"2024-03-09T15:10:26.458259+0000","last_clean":"2024-03-09T15:10:26.458259+0000","last_became_active":"2024-03-09T14:26:26.648780+0000","last_became_peered":"2024-03-09T14:26:26.648780+0000","last_unstale":"2024-03-09T15:10:26.458259+0000","last_undegraded":"2024-03-09T15:10:26.458259+0000","last_fullsized":"2024-03-09T15:10:26.458259+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:42.844197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":557887,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":379,"num_read_kb":3119,"num_write":931,"num_write_kb":23902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'461","reported_seq":2006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.310310+0000","last_change":"2024-03-09T14:26:28.650877+0000","last_active":"2024-03-09T15:10:45.310310+0000","last_peered":"2024-03-09T15:10:45.310310+0000","last_clean":"2024-03-09T15:10:45.310310+0000","last_became_active":"2024-03-09T14:26:28.649994+0000","last_became_peered":"2024-03-09T14:26:28.649994+0000","last_unstale":"2024-03-09T15:10:45.310310+0000","last_undegraded":"2024-03-09T15:10:45.310310+0000","last_fullsized":"2024-03-09T15:10:45.310310+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:45:40.976578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2508,"num_read_kb":2326,"num_write":602,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'156","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.386580+0000","last_change":"2024-03-09T14:26:26.652122+0000","last_active":"2024-03-09T15:11:26.386580+0000","last_peered":"2024-03-09T15:11:26.386580+0000","last_clean":"2024-03-09T15:11:26.386580+0000","last_became_active":"2024-03-09T14:26:26.651754+0000","last_became_peered":"2024-03-09T14:26:26.651754+0000","last_unstale":"2024-03-09T15:11:26.386580+0000","last_undegraded":"2024-03-09T15:11:26.386580+0000","last_fullsized":"2024-03-09T15:11:26.386580+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:56:39.902062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25167905,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":425,"num_read_kb":120305,"num_write":884,"num_write_kb":41051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'1264","reported_seq":2891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.180247+0000","last_change":"2024-03-09T14:26:28.652076+0000","last_active":"2024-03-09T15:11:09.180247+0000","last_peered":"2024-03-09T15:11:09.180247+0000","last_clean":"2024-03-09T15:11:09.180247+0000","last_became_active":"2024-03-09T14:26:28.651754+0000","last_became_peered":"2024-03-09T14:26:28.651754+0000","last_unstale":"2024-03-09T15:11:09.180247+0000","last_undegraded":"2024-03-09T15:11:09.180247+0000","last_fullsized":"2024-03-09T15:11:09.180247+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:58.139033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5611,"num_read_kb":4890,"num_write":1803,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'155","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.682372+0000","last_change":"2024-03-09T14:26:26.643565+0000","last_active":"2024-03-09T15:08:56.682372+0000","last_peered":"2024-03-09T15:08:56.682372+0000","last_clean":"2024-03-09T15:08:56.682372+0000","last_became_active":"2024-03-09T14:26:26.643195+0000","last_became_peered":"2024-03-09T14:26:26.643195+0000","last_unstale":"2024-03-09T15:08:56.682372+0000","last_undegraded":"2024-03-09T15:08:56.682372+0000","last_fullsized":"2024-03-09T15:08:56.682372+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:07:00.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6997673,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":383,"num_read_kb":7445,"num_write":882,"num_write_kb":17740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'832","reported_seq":2501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.868382+0000","last_change":"2024-03-09T14:26:28.654056+0000","last_active":"2024-03-09T15:11:07.868382+0000","last_peered":"2024-03-09T15:11:07.868382+0000","last_clean":"2024-03-09T15:11:07.868382+0000","last_became_active":"2024-03-09T14:26:28.653778+0000","last_became_peered":"2024-03-09T14:26:28.653778+0000","last_unstale":"2024-03-09T15:11:07.868382+0000","last_undegraded":"2024-03-09T15:11:07.868382+0000","last_fullsized":"2024-03-09T15:11:07.868382+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:38:55.151292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3883,"num_read_kb":3504,"num_write":1111,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'451","reported_seq":2033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.529624+0000","last_change":"2024-03-09T14:26:28.649892+0000","last_active":"2024-03-09T15:10:54.529624+0000","last_peered":"2024-03-09T15:10:54.529624+0000","last_clean":"2024-03-09T15:10:54.529624+0000","last_became_active":"2024-03-09T14:26:28.649128+0000","last_became_peered":"2024-03-09T14:26:28.649128+0000","last_unstale":"2024-03-09T15:10:54.529624+0000","last_undegraded":"2024-03-09T15:10:54.529624+0000","last_fullsized":"2024-03-09T15:10:54.529624+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:11:16.956384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2472,"num_read_kb":2328,"num_write":564,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'186","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:02.923440+0000","last_change":"2024-03-09T14:26:26.651818+0000","last_active":"2024-03-09T15:10:02.923440+0000","last_peered":"2024-03-09T15:10:02.923440+0000","last_clean":"2024-03-09T15:10:02.923440+0000","last_became_active":"2024-03-09T14:26:26.651323+0000","last_became_peered":"2024-03-09T14:26:26.651323+0000","last_unstale":"2024-03-09T15:10:02.923440+0000","last_undegraded":"2024-03-09T15:10:02.923440+0000","last_fullsized":"2024-03-09T15:10:02.923440+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:26.086700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2099339,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":437,"num_read_kb":7847,"num_write":1010,"num_write_kb":34087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'415","reported_seq":1935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:34.444271+0000","last_change":"2024-03-09T14:26:28.646304+0000","last_active":"2024-03-09T15:10:34.444271+0000","last_peered":"2024-03-09T15:10:34.444271+0000","last_clean":"2024-03-09T15:10:34.444271+0000","last_became_active":"2024-03-09T14:26:28.645422+0000","last_became_peered":"2024-03-09T14:26:28.645422+0000","last_unstale":"2024-03-09T15:10:34.444271+0000","last_undegraded":"2024-03-09T15:10:34.444271+0000","last_fullsized":"2024-03-09T15:10:34.444271+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:50:13.964684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2243,"num_read_kb":2118,"num_write":516,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'176","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:27.397246+0000","last_change":"2024-03-09T14:26:26.644904+0000","last_active":"2024-03-09T15:09:27.397246+0000","last_peered":"2024-03-09T15:09:27.397246+0000","last_clean":"2024-03-09T15:09:27.397246+0000","last_became_active":"2024-03-09T14:26:26.644578+0000","last_became_peered":"2024-03-09T14:26:26.644578+0000","last_unstale":"2024-03-09T15:09:27.397246+0000","last_undegraded":"2024-03-09T15:09:27.397246+0000","last_fullsized":"2024-03-09T15:09:27.397246+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:27:29.674744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582928,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":445,"num_read_kb":16041,"num_write":1040,"num_write_kb":25248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'392","reported_seq":2099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.420096+0000","last_change":"2024-03-09T14:26:28.648611+0000","last_active":"2024-03-09T15:11:04.420096+0000","last_peered":"2024-03-09T15:11:04.420096+0000","last_clean":"2024-03-09T15:11:04.420096+0000","last_became_active":"2024-03-09T14:26:28.648115+0000","last_became_peered":"2024-03-09T14:26:28.648115+0000","last_unstale":"2024-03-09T15:11:04.420096+0000","last_undegraded":"2024-03-09T15:11:04.420096+0000","last_fullsized":"2024-03-09T15:11:04.420096+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:30:00.259696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2471,"num_read_kb":2382,"num_write":449,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'202","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:43.589351+0000","last_change":"2024-03-09T14:26:26.647793+0000","last_active":"2024-03-09T15:08:43.589351+0000","last_peered":"2024-03-09T15:08:43.589351+0000","last_clean":"2024-03-09T15:08:43.589351+0000","last_became_active":"2024-03-09T14:26:26.647391+0000","last_became_peered":"2024-03-09T14:26:26.647391+0000","last_unstale":"2024-03-09T15:08:43.589351+0000","last_undegraded":"2024-03-09T15:08:43.589351+0000","last_fullsized":"2024-03-09T15:08:43.589351+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:14.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2846719,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":382,"num_read_kb":14846,"num_write":1052,"num_write_kb":41673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'453","reported_seq":2022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.896057+0000","last_change":"2024-03-09T14:26:28.648170+0000","last_active":"2024-03-09T15:11:07.896057+0000","last_peered":"2024-03-09T15:11:07.896057+0000","last_clean":"2024-03-09T15:11:07.896057+0000","last_became_active":"2024-03-09T14:26:28.647846+0000","last_became_peered":"2024-03-09T14:26:28.647846+0000","last_unstale":"2024-03-09T15:11:07.896057+0000","last_undegraded":"2024-03-09T15:11:07.896057+0000","last_fullsized":"2024-03-09T15:11:07.896057+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:52:23.409112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2382,"num_read_kb":2246,"num_write":552,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'279","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:54.343225+0000","last_change":"2024-03-09T14:26:26.638124+0000","last_active":"2024-03-09T15:08:54.343225+0000","last_peered":"2024-03-09T15:08:54.343225+0000","last_clean":"2024-03-09T15:08:54.343225+0000","last_became_active":"2024-03-09T14:26:26.637767+0000","last_became_peered":"2024-03-09T14:26:26.637767+0000","last_unstale":"2024-03-09T15:08:54.343225+0000","last_undegraded":"2024-03-09T15:08:54.343225+0000","last_fullsized":"2024-03-09T15:08:54.343225+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:29:58.146491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11882780,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":593,"num_read_kb":72489,"num_write":1410,"num_write_kb":47263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'1533","reported_seq":3258,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.873260+0000","last_change":"2024-03-09T14:26:28.654340+0000","last_active":"2024-03-09T15:11:07.873260+0000","last_peered":"2024-03-09T15:11:07.873260+0000","last_clean":"2024-03-09T15:11:07.873260+0000","last_became_active":"2024-03-09T14:26:28.653385+0000","last_became_peered":"2024-03-09T14:26:28.653385+0000","last_unstale":"2024-03-09T15:11:07.873260+0000","last_undegraded":"2024-03-09T15:11:07.873260+0000","last_fullsized":"2024-03-09T15:11:07.873260+0000","mapping_epoch":25,"log_start":"264'1500","ondisk_log_start":"264'1500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:12:04.813024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6446,"num_read_kb":5594,"num_write":2158,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'214","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:22.846291+0000","last_change":"2024-03-09T14:26:26.644011+0000","last_active":"2024-03-09T15:09:22.846291+0000","last_peered":"2024-03-09T15:09:22.846291+0000","last_clean":"2024-03-09T15:09:22.846291+0000","last_became_active":"2024-03-09T14:26:26.643401+0000","last_became_peered":"2024-03-09T14:26:26.643401+0000","last_unstale":"2024-03-09T15:09:22.846291+0000","last_undegraded":"2024-03-09T15:09:22.846291+0000","last_fullsized":"2024-03-09T15:09:22.846291+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:05.752386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10309380,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":458,"num_read_kb":13858,"num_write":1170,"num_write_kb":34499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'726","reported_seq":2205,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.153334+0000","last_change":"2024-03-09T14:26:28.650896+0000","last_active":"2024-03-09T15:11:37.153334+0000","last_peered":"2024-03-09T15:11:37.153334+0000","last_clean":"2024-03-09T15:11:37.153334+0000","last_became_active":"2024-03-09T14:26:28.650334+0000","last_became_peered":"2024-03-09T14:26:28.650334+0000","last_unstale":"2024-03-09T15:11:37.153334+0000","last_undegraded":"2024-03-09T15:11:37.153334+0000","last_fullsized":"2024-03-09T15:11:37.153334+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:18:31.435564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3318,"num_read_kb":2980,"num_write":968,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'135","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.577012+0000","last_change":"2024-03-09T14:26:26.631574+0000","last_active":"2024-03-09T15:08:36.577012+0000","last_peered":"2024-03-09T15:08:36.577012+0000","last_clean":"2024-03-09T15:08:36.577012+0000","last_became_active":"2024-03-09T14:26:26.631203+0000","last_became_peered":"2024-03-09T14:26:26.631203+0000","last_unstale":"2024-03-09T15:08:36.577012+0000","last_undegraded":"2024-03-09T15:08:36.577012+0000","last_fullsized":"2024-03-09T15:08:36.577012+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:18:43.836166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3147062,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":303,"num_read_kb":11988,"num_write":736,"num_write_kb":25932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'99","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.863832+0000","last_change":"2024-03-09T14:26:36.674788+0000","last_active":"2024-03-09T15:11:04.863832+0000","last_peered":"2024-03-09T15:11:04.863832+0000","last_clean":"2024-03-09T15:11:04.863832+0000","last_became_active":"2024-03-09T14:26:36.674500+0000","last_became_peered":"2024-03-09T14:26:36.674500+0000","last_unstale":"2024-03-09T15:11:04.863832+0000","last_undegraded":"2024-03-09T15:11:04.863832+0000","last_fullsized":"2024-03-09T15:11:04.863832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:14:05.988499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":88,"num_write":230,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'372","reported_seq":1772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:44.538039+0000","last_change":"2024-03-09T14:28:03.816157+0000","last_active":"2024-03-09T15:09:44.538039+0000","last_peered":"2024-03-09T15:09:44.538039+0000","last_clean":"2024-03-09T15:09:44.538039+0000","last_became_active":"2024-03-09T14:28:03.815924+0000","last_became_peered":"2024-03-09T14:28:03.815924+0000","last_unstale":"2024-03-09T15:09:44.538039+0000","last_undegraded":"2024-03-09T15:09:44.538039+0000","last_fullsized":"2024-03-09T15:09:44.538039+0000","mapping_epoch":38,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:54:24.380063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1992,"num_read_kb":1883,"num_write":432,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"264'201","reported_seq":807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:54.965731+0000","last_change":"2024-03-09T14:26:26.653743+0000","last_active":"2024-03-09T15:08:54.965731+0000","last_peered":"2024-03-09T15:08:54.965731+0000","last_clean":"2024-03-09T15:08:54.965731+0000","last_became_active":"2024-03-09T14:26:26.652957+0000","last_became_peered":"2024-03-09T14:26:26.652957+0000","last_unstale":"2024-03-09T15:08:54.965731+0000","last_undegraded":"2024-03-09T15:08:54.965731+0000","last_fullsized":"2024-03-09T15:08:54.965731+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:49.440301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5267750,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":418,"num_read_kb":22200,"num_write":1163,"num_write_kb":38864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.572316+0000","last_change":"2024-03-09T14:26:30.655416+0000","last_active":"2024-03-09T15:07:36.572316+0000","last_peered":"2024-03-09T15:07:36.572316+0000","last_clean":"2024-03-09T15:07:36.572316+0000","last_became_active":"2024-03-09T14:26:30.654862+0000","last_became_peered":"2024-03-09T14:26:30.654862+0000","last_unstale":"2024-03-09T15:07:36.572316+0000","last_undegraded":"2024-03-09T15:07:36.572316+0000","last_fullsized":"2024-03-09T15:07:36.572316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:05.895677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'181","reported_seq":779,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.587222+0000","last_change":"2024-03-09T14:26:32.653350+0000","last_active":"2024-03-09T15:10:06.587222+0000","last_peered":"2024-03-09T15:10:06.587222+0000","last_clean":"2024-03-09T15:10:06.587222+0000","last_became_active":"2024-03-09T14:26:32.652879+0000","last_became_peered":"2024-03-09T14:26:32.652879+0000","last_unstale":"2024-03-09T15:10:06.587222+0000","last_undegraded":"2024-03-09T15:10:06.587222+0000","last_fullsized":"2024-03-09T15:10:06.587222+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:22:58.520379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21241,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":242,"num_read_kb":333,"num_write":140,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.708826+0000","last_change":"2024-03-09T14:26:34.670623+0000","last_active":"2024-03-09T15:07:41.708826+0000","last_peered":"2024-03-09T15:07:41.708826+0000","last_clean":"2024-03-09T15:07:41.708826+0000","last_became_active":"2024-03-09T14:26:34.670336+0000","last_became_peered":"2024-03-09T14:26:34.670336+0000","last_unstale":"2024-03-09T15:07:41.708826+0000","last_undegraded":"2024-03-09T15:07:41.708826+0000","last_fullsized":"2024-03-09T15:07:41.708826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:22:58.489151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'168","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.758728+0000","last_change":"2024-03-09T14:26:36.674055+0000","last_active":"2024-03-09T15:10:35.758728+0000","last_peered":"2024-03-09T15:10:35.758728+0000","last_clean":"2024-03-09T15:10:35.758728+0000","last_became_active":"2024-03-09T14:26:36.673806+0000","last_became_peered":"2024-03-09T14:26:36.673806+0000","last_unstale":"2024-03-09T15:10:35.758728+0000","last_undegraded":"2024-03-09T15:10:35.758728+0000","last_fullsized":"2024-03-09T15:10:35.758728+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:17:00.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":385,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'374","reported_seq":1917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.421489+0000","last_change":"2024-03-09T14:26:28.646103+0000","last_active":"2024-03-09T15:11:04.421489+0000","last_peered":"2024-03-09T15:11:04.421489+0000","last_clean":"2024-03-09T15:11:04.421489+0000","last_became_active":"2024-03-09T14:26:28.645537+0000","last_became_peered":"2024-03-09T14:26:28.645537+0000","last_unstale":"2024-03-09T15:11:04.421489+0000","last_undegraded":"2024-03-09T15:11:04.421489+0000","last_fullsized":"2024-03-09T15:11:04.421489+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:56:00.728701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2096,"num_read_kb":2016,"num_write":417,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'221","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:03.654938+0000","last_change":"2024-03-09T14:26:26.644936+0000","last_active":"2024-03-09T15:09:03.654938+0000","last_peered":"2024-03-09T15:09:03.654938+0000","last_clean":"2024-03-09T15:09:03.654938+0000","last_became_active":"2024-03-09T14:26:26.644563+0000","last_became_peered":"2024-03-09T14:26:26.644563+0000","last_unstale":"2024-03-09T15:09:03.654938+0000","last_undegraded":"2024-03-09T15:09:03.654938+0000","last_fullsized":"2024-03-09T15:09:03.654938+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:22:28.065455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9503167,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":457,"num_read_kb":29388,"num_write":1128,"num_write_kb":42312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.679955+0000","last_change":"2024-03-09T14:26:30.651988+0000","last_active":"2024-03-09T15:08:36.679955+0000","last_peered":"2024-03-09T15:08:36.679955+0000","last_clean":"2024-03-09T15:08:36.679955+0000","last_became_active":"2024-03-09T14:26:30.651683+0000","last_became_peered":"2024-03-09T14:26:30.651683+0000","last_unstale":"2024-03-09T15:08:36.679955+0000","last_undegraded":"2024-03-09T15:08:36.679955+0000","last_fullsized":"2024-03-09T15:08:36.679955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:33:21.797293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'81","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.607493+0000","last_change":"2024-03-09T14:26:32.657274+0000","last_active":"2024-03-09T15:10:06.607493+0000","last_peered":"2024-03-09T15:10:06.607493+0000","last_clean":"2024-03-09T15:10:06.607493+0000","last_became_active":"2024-03-09T14:26:32.656995+0000","last_became_peered":"2024-03-09T14:26:32.656995+0000","last_unstale":"2024-03-09T15:10:06.607493+0000","last_undegraded":"2024-03-09T15:10:06.607493+0000","last_fullsized":"2024-03-09T15:10:06.607493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:23:29.312811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":86,"num_read_kb":83,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.587663+0000","last_change":"2024-03-09T14:26:34.666672+0000","last_active":"2024-03-09T15:07:41.587663+0000","last_peered":"2024-03-09T15:07:41.587663+0000","last_clean":"2024-03-09T15:07:41.587663+0000","last_became_active":"2024-03-09T14:26:34.666326+0000","last_became_peered":"2024-03-09T14:26:34.666326+0000","last_unstale":"2024-03-09T15:07:41.587663+0000","last_undegraded":"2024-03-09T15:07:41.587663+0000","last_fullsized":"2024-03-09T15:07:41.587663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:51:24.275827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'111","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:25.702130+0000","last_change":"2024-03-09T14:26:36.671366+0000","last_active":"2024-03-09T15:10:25.702130+0000","last_peered":"2024-03-09T15:10:25.702130+0000","last_clean":"2024-03-09T15:10:25.702130+0000","last_became_active":"2024-03-09T14:26:36.671071+0000","last_became_peered":"2024-03-09T14:26:36.671071+0000","last_unstale":"2024-03-09T15:10:25.702130+0000","last_undegraded":"2024-03-09T15:10:25.702130+0000","last_fullsized":"2024-03-09T15:10:25.702130+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:35.587717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":104,"num_write":246,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'951","reported_seq":2539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.046845+0000","last_change":"2024-03-09T14:26:28.649069+0000","last_active":"2024-03-09T15:10:51.046845+0000","last_peered":"2024-03-09T15:10:51.046845+0000","last_clean":"2024-03-09T15:10:51.046845+0000","last_became_active":"2024-03-09T14:26:28.648586+0000","last_became_peered":"2024-03-09T14:26:28.648586+0000","last_unstale":"2024-03-09T15:10:51.046845+0000","last_undegraded":"2024-03-09T15:10:51.046845+0000","last_fullsized":"2024-03-09T15:10:51.046845+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:43:05.587726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4258,"num_read_kb":3730,"num_write":1359,"num_write_kb":540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'181","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:14.100648+0000","last_change":"2024-03-09T14:26:26.653314+0000","last_active":"2024-03-09T15:09:14.100648+0000","last_peered":"2024-03-09T15:09:14.100648+0000","last_clean":"2024-03-09T15:09:14.100648+0000","last_became_active":"2024-03-09T14:26:26.652803+0000","last_became_peered":"2024-03-09T14:26:26.652803+0000","last_unstale":"2024-03-09T15:09:14.100648+0000","last_undegraded":"2024-03-09T15:09:14.100648+0000","last_fullsized":"2024-03-09T15:09:14.100648+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:35:03.501326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195206,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":380,"num_read_kb":6854,"num_write":968,"num_write_kb":33721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.671581+0000","last_change":"2024-03-09T14:26:30.652950+0000","last_active":"2024-03-09T15:07:36.671581+0000","last_peered":"2024-03-09T15:07:36.671581+0000","last_clean":"2024-03-09T15:07:36.671581+0000","last_became_active":"2024-03-09T14:26:30.652699+0000","last_became_peered":"2024-03-09T14:26:30.652699+0000","last_unstale":"2024-03-09T15:07:36.671581+0000","last_undegraded":"2024-03-09T15:07:36.671581+0000","last_fullsized":"2024-03-09T15:07:36.671581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:39:48.909510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'98","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:22.138446+0000","last_change":"2024-03-09T14:26:32.658656+0000","last_active":"2024-03-09T15:10:22.138446+0000","last_peered":"2024-03-09T15:10:22.138446+0000","last_clean":"2024-03-09T15:10:22.138446+0000","last_became_active":"2024-03-09T14:26:32.658348+0000","last_became_peered":"2024-03-09T14:26:32.658348+0000","last_unstale":"2024-03-09T15:10:22.138446+0000","last_undegraded":"2024-03-09T15:10:22.138446+0000","last_fullsized":"2024-03-09T15:10:22.138446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:46.676833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'528","reported_seq":1962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.638789+0000","last_change":"2024-03-09T14:26:34.674301+0000","last_active":"2024-03-09T15:11:38.638789+0000","last_peered":"2024-03-09T15:11:38.638789+0000","last_clean":"2024-03-09T15:11:38.638789+0000","last_became_active":"2024-03-09T14:26:34.673916+0000","last_became_peered":"2024-03-09T14:26:34.673916+0000","last_unstale":"2024-03-09T15:11:38.638789+0000","last_undegraded":"2024-03-09T15:11:38.638789+0000","last_fullsized":"2024-03-09T15:11:38.638789+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:25:43.485522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'204","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:26.584268+0000","last_change":"2024-03-09T14:26:36.786508+0000","last_active":"2024-03-09T15:10:26.584268+0000","last_peered":"2024-03-09T15:10:26.584268+0000","last_clean":"2024-03-09T15:10:26.584268+0000","last_became_active":"2024-03-09T14:26:36.786202+0000","last_became_peered":"2024-03-09T14:26:36.786202+0000","last_unstale":"2024-03-09T15:10:26.584268+0000","last_undegraded":"2024-03-09T15:10:26.584268+0000","last_fullsized":"2024-03-09T15:10:26.584268+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:32:12.717992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":555,"num_write":450,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'733","reported_seq":2331,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.058929+0000","last_change":"2024-03-09T14:26:28.658592+0000","last_active":"2024-03-09T15:10:51.058929+0000","last_peered":"2024-03-09T15:10:51.058929+0000","last_clean":"2024-03-09T15:10:51.058929+0000","last_became_active":"2024-03-09T14:26:28.657030+0000","last_became_peered":"2024-03-09T14:26:28.657030+0000","last_unstale":"2024-03-09T15:10:51.058929+0000","last_undegraded":"2024-03-09T15:10:51.058929+0000","last_fullsized":"2024-03-09T15:10:51.058929+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:32:55.173962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3495,"num_read_kb":3179,"num_write":956,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'231","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:24.542219+0000","last_change":"2024-03-09T14:26:26.644365+0000","last_active":"2024-03-09T15:11:24.542219+0000","last_peered":"2024-03-09T15:11:24.542219+0000","last_clean":"2024-03-09T15:11:24.542219+0000","last_became_active":"2024-03-09T14:26:26.643877+0000","last_became_peered":"2024-03-09T14:26:26.643877+0000","last_unstale":"2024-03-09T15:11:24.542219+0000","last_undegraded":"2024-03-09T15:11:24.542219+0000","last_fullsized":"2024-03-09T15:11:24.542219+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:57:15.681003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5567527,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":42109,"num_write":1105,"num_write_kb":38892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.572348+0000","last_change":"2024-03-09T14:26:30.651051+0000","last_active":"2024-03-09T15:07:36.572348+0000","last_peered":"2024-03-09T15:07:36.572348+0000","last_clean":"2024-03-09T15:07:36.572348+0000","last_became_active":"2024-03-09T14:26:30.650741+0000","last_became_peered":"2024-03-09T14:26:30.650741+0000","last_unstale":"2024-03-09T15:07:36.572348+0000","last_undegraded":"2024-03-09T15:07:36.572348+0000","last_fullsized":"2024-03-09T15:07:36.572348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:26.277367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'141","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.083284+0000","last_change":"2024-03-09T14:26:32.869163+0000","last_active":"2024-03-09T15:10:51.083284+0000","last_peered":"2024-03-09T15:10:51.083284+0000","last_clean":"2024-03-09T15:10:51.083284+0000","last_became_active":"2024-03-09T14:26:32.868081+0000","last_became_peered":"2024-03-09T14:26:32.868081+0000","last_unstale":"2024-03-09T15:10:51.083284+0000","last_undegraded":"2024-03-09T15:10:51.083284+0000","last_fullsized":"2024-03-09T15:10:51.083284+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:50:41.428007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9327,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":223,"num_write":98,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'561","reported_seq":4021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.698977+0000","last_change":"2024-03-09T14:26:34.679581+0000","last_active":"2024-03-09T15:11:38.698977+0000","last_peered":"2024-03-09T15:11:38.698977+0000","last_clean":"2024-03-09T15:11:38.698977+0000","last_became_active":"2024-03-09T14:26:34.679280+0000","last_became_peered":"2024-03-09T14:26:34.679280+0000","last_unstale":"2024-03-09T15:11:38.698977+0000","last_undegraded":"2024-03-09T15:11:38.698977+0000","last_fullsized":"2024-03-09T15:11:38.698977+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:22:33.914415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'336","reported_seq":1680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.864421+0000","last_change":"2024-03-09T14:26:28.646029+0000","last_active":"2024-03-09T15:11:07.864421+0000","last_peered":"2024-03-09T15:11:07.864421+0000","last_clean":"2024-03-09T15:11:07.864421+0000","last_became_active":"2024-03-09T14:26:28.645600+0000","last_became_peered":"2024-03-09T14:26:28.645600+0000","last_unstale":"2024-03-09T15:11:07.864421+0000","last_undegraded":"2024-03-09T15:11:07.864421+0000","last_fullsized":"2024-03-09T15:11:07.864421+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:31.580713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1869,"num_read_kb":1759,"num_write":401,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'204","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.047804+0000","last_change":"2024-03-09T14:26:26.652521+0000","last_active":"2024-03-09T15:10:42.047804+0000","last_peered":"2024-03-09T15:10:42.047804+0000","last_clean":"2024-03-09T15:10:42.047804+0000","last_became_active":"2024-03-09T14:26:26.652163+0000","last_became_peered":"2024-03-09T14:26:26.652163+0000","last_unstale":"2024-03-09T15:10:42.047804+0000","last_undegraded":"2024-03-09T15:10:42.047804+0000","last_fullsized":"2024-03-09T15:10:42.047804+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:35.690754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8676548,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":479,"num_read_kb":85490,"num_write":1161,"num_write_kb":31492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.708678+0000","last_change":"2024-03-09T14:26:30.648514+0000","last_active":"2024-03-09T15:07:41.708678+0000","last_peered":"2024-03-09T15:07:41.708678+0000","last_clean":"2024-03-09T15:07:41.708678+0000","last_became_active":"2024-03-09T14:26:30.648227+0000","last_became_peered":"2024-03-09T14:26:30.648227+0000","last_unstale":"2024-03-09T15:07:41.708678+0000","last_undegraded":"2024-03-09T15:07:41.708678+0000","last_fullsized":"2024-03-09T15:07:41.708678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:08:30.571556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'201","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:34.447773+0000","last_change":"2024-03-09T14:26:32.868345+0000","last_active":"2024-03-09T15:10:34.447773+0000","last_peered":"2024-03-09T15:10:34.447773+0000","last_clean":"2024-03-09T15:10:34.447773+0000","last_became_active":"2024-03-09T14:26:32.868020+0000","last_became_peered":"2024-03-09T14:26:32.868020+0000","last_unstale":"2024-03-09T15:10:34.447773+0000","last_undegraded":"2024-03-09T15:10:34.447773+0000","last_fullsized":"2024-03-09T15:10:34.447773+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:16:05.222921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9656,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":269,"num_read_kb":288,"num_write":158,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.574392+0000","last_change":"2024-03-09T14:26:34.666827+0000","last_active":"2024-03-09T15:09:21.574392+0000","last_peered":"2024-03-09T15:09:21.574392+0000","last_clean":"2024-03-09T15:09:21.574392+0000","last_became_active":"2024-03-09T14:26:34.666539+0000","last_became_peered":"2024-03-09T14:26:34.666539+0000","last_unstale":"2024-03-09T15:09:21.574392+0000","last_undegraded":"2024-03-09T15:09:21.574392+0000","last_fullsized":"2024-03-09T15:09:21.574392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:45:05.086023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'537","reported_seq":1343,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.686743+0000","last_change":"2024-03-09T14:26:36.672487+0000","last_active":"2024-03-09T15:11:38.686743+0000","last_peered":"2024-03-09T15:11:38.686743+0000","last_clean":"2024-03-09T15:11:38.686743+0000","last_became_active":"2024-03-09T14:26:36.672173+0000","last_became_peered":"2024-03-09T14:26:36.672173+0000","last_unstale":"2024-03-09T15:11:38.686743+0000","last_undegraded":"2024-03-09T15:11:38.686743+0000","last_fullsized":"2024-03-09T15:11:38.686743+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:51:07.339596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1288,"num_read_kb":1278,"num_write":1107,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'868","reported_seq":2461,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.106159+0000","last_change":"2024-03-09T14:26:28.656027+0000","last_active":"2024-03-09T15:11:01.106159+0000","last_peered":"2024-03-09T15:11:01.106159+0000","last_clean":"2024-03-09T15:11:01.106159+0000","last_became_active":"2024-03-09T14:26:28.655572+0000","last_became_peered":"2024-03-09T14:26:28.655572+0000","last_unstale":"2024-03-09T15:11:01.106159+0000","last_undegraded":"2024-03-09T15:11:01.106159+0000","last_fullsized":"2024-03-09T15:11:01.106159+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:10:40.483371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4137,"num_read_kb":3672,"num_write":1196,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'210","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:49.310102+0000","last_change":"2024-03-09T14:26:26.654328+0000","last_active":"2024-03-09T15:10:49.310102+0000","last_peered":"2024-03-09T15:10:49.310102+0000","last_clean":"2024-03-09T15:10:49.310102+0000","last_became_active":"2024-03-09T14:26:26.653969+0000","last_became_peered":"2024-03-09T14:26:26.653969+0000","last_unstale":"2024-03-09T15:10:49.310102+0000","last_undegraded":"2024-03-09T15:10:49.310102+0000","last_fullsized":"2024-03-09T15:10:49.310102+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:24:44.283252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6616130,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":36496,"num_write":1169,"num_write_kb":46772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.558546+0000","last_change":"2024-03-09T14:26:30.647064+0000","last_active":"2024-03-09T15:07:41.558546+0000","last_peered":"2024-03-09T15:07:41.558546+0000","last_clean":"2024-03-09T15:07:41.558546+0000","last_became_active":"2024-03-09T14:26:30.646765+0000","last_became_peered":"2024-03-09T14:26:30.646765+0000","last_unstale":"2024-03-09T15:07:41.558546+0000","last_undegraded":"2024-03-09T15:07:41.558546+0000","last_fullsized":"2024-03-09T15:07:41.558546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:19.489495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'118","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.490724+0000","last_change":"2024-03-09T14:26:32.655422+0000","last_active":"2024-03-09T15:11:36.490724+0000","last_peered":"2024-03-09T15:11:36.490724+0000","last_clean":"2024-03-09T15:11:36.490724+0000","last_became_active":"2024-03-09T14:26:32.655037+0000","last_became_peered":"2024-03-09T14:26:32.655037+0000","last_unstale":"2024-03-09T15:11:36.490724+0000","last_undegraded":"2024-03-09T15:11:36.490724+0000","last_fullsized":"2024-03-09T15:11:36.490724+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:57:37.124968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":156,"num_write":70,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.673401+0000","last_change":"2024-03-09T14:26:34.678829+0000","last_active":"2024-03-09T15:07:51.673401+0000","last_peered":"2024-03-09T15:07:51.673401+0000","last_clean":"2024-03-09T15:07:51.673401+0000","last_became_active":"2024-03-09T14:26:34.678525+0000","last_became_peered":"2024-03-09T14:26:34.678525+0000","last_unstale":"2024-03-09T15:07:51.673401+0000","last_undegraded":"2024-03-09T15:07:51.673401+0000","last_fullsized":"2024-03-09T15:07:51.673401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:57:05.745633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2463","reported_seq":4879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.372073+0000","last_change":"2024-03-09T14:26:36.671509+0000","last_active":"2024-03-09T15:11:37.372073+0000","last_peered":"2024-03-09T15:11:37.372073+0000","last_clean":"2024-03-09T15:11:37.372073+0000","last_became_active":"2024-03-09T14:26:36.671204+0000","last_became_peered":"2024-03-09T14:26:36.671204+0000","last_unstale":"2024-03-09T15:11:37.372073+0000","last_undegraded":"2024-03-09T15:11:37.372073+0000","last_fullsized":"2024-03-09T15:11:37.372073+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":2400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:54:22.325503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6722,"num_read_kb":6726,"num_write":4987,"num_write_kb":1828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'374","reported_seq":1941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.098113+0000","last_change":"2024-03-09T14:26:28.648968+0000","last_active":"2024-03-09T15:11:01.098113+0000","last_peered":"2024-03-09T15:11:01.098113+0000","last_clean":"2024-03-09T15:11:01.098113+0000","last_became_active":"2024-03-09T14:26:28.648620+0000","last_became_peered":"2024-03-09T14:26:28.648620+0000","last_unstale":"2024-03-09T15:11:01.098113+0000","last_undegraded":"2024-03-09T15:11:01.098113+0000","last_fullsized":"2024-03-09T15:11:01.098113+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:45:55.545173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2195,"num_write":437,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'209","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.383080+0000","last_change":"2024-03-09T14:26:26.653520+0000","last_active":"2024-03-09T15:11:26.383080+0000","last_peered":"2024-03-09T15:11:26.383080+0000","last_clean":"2024-03-09T15:11:26.383080+0000","last_became_active":"2024-03-09T14:26:26.653181+0000","last_became_peered":"2024-03-09T14:26:26.653181+0000","last_unstale":"2024-03-09T15:11:26.383080+0000","last_undegraded":"2024-03-09T15:11:26.383080+0000","last_fullsized":"2024-03-09T15:11:26.383080+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:52.372652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15751382,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1034,"num_read_kb":176274,"num_write":1127,"num_write_kb":52674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.569270+0000","last_change":"2024-03-09T14:26:30.646000+0000","last_active":"2024-03-09T15:09:16.569270+0000","last_peered":"2024-03-09T15:09:16.569270+0000","last_clean":"2024-03-09T15:09:16.569270+0000","last_became_active":"2024-03-09T14:26:30.645656+0000","last_became_peered":"2024-03-09T14:26:30.645656+0000","last_unstale":"2024-03-09T15:09:16.569270+0000","last_undegraded":"2024-03-09T15:09:16.569270+0000","last_fullsized":"2024-03-09T15:09:16.569270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:24:40.309796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'168","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.021145+0000","last_change":"2024-03-09T14:26:32.657586+0000","last_active":"2024-03-09T15:11:37.021145+0000","last_peered":"2024-03-09T15:11:37.021145+0000","last_clean":"2024-03-09T15:11:37.021145+0000","last_became_active":"2024-03-09T14:26:32.657144+0000","last_became_peered":"2024-03-09T14:26:32.657144+0000","last_unstale":"2024-03-09T15:11:37.021145+0000","last_undegraded":"2024-03-09T15:11:37.021145+0000","last_fullsized":"2024-03-09T15:11:37.021145+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:12:23.509222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13623,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":200,"num_read_kb":247,"num_write":114,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'540","reported_seq":1934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.696160+0000","last_change":"2024-03-09T14:26:34.668104+0000","last_active":"2024-03-09T15:11:38.696160+0000","last_peered":"2024-03-09T15:11:38.696160+0000","last_clean":"2024-03-09T15:11:38.696160+0000","last_became_active":"2024-03-09T14:26:34.667795+0000","last_became_peered":"2024-03-09T14:26:34.667795+0000","last_unstale":"2024-03-09T15:11:38.696160+0000","last_undegraded":"2024-03-09T15:11:38.696160+0000","last_fullsized":"2024-03-09T15:11:38.696160+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:54.046352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'109","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:19.855122+0000","last_change":"2024-03-09T14:26:36.671949+0000","last_active":"2024-03-09T15:10:19.855122+0000","last_peered":"2024-03-09T15:10:19.855122+0000","last_clean":"2024-03-09T15:10:19.855122+0000","last_became_active":"2024-03-09T14:26:36.671635+0000","last_became_peered":"2024-03-09T14:26:36.671635+0000","last_unstale":"2024-03-09T15:10:19.855122+0000","last_undegraded":"2024-03-09T15:10:19.855122+0000","last_fullsized":"2024-03-09T15:10:19.855122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:02:06.007889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":89,"num_write":251,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'431","reported_seq":1949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.186291+0000","last_change":"2024-03-09T14:26:28.645748+0000","last_active":"2024-03-09T15:10:42.186291+0000","last_peered":"2024-03-09T15:10:42.186291+0000","last_clean":"2024-03-09T15:10:42.186291+0000","last_became_active":"2024-03-09T14:26:28.645215+0000","last_became_peered":"2024-03-09T14:26:28.645215+0000","last_unstale":"2024-03-09T15:10:42.186291+0000","last_undegraded":"2024-03-09T15:10:42.186291+0000","last_fullsized":"2024-03-09T15:10:42.186291+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:02:01.979402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2276,"num_read_kb":2131,"num_write":518,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'206","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:31.434109+0000","last_change":"2024-03-09T14:26:26.640453+0000","last_active":"2024-03-09T15:10:31.434109+0000","last_peered":"2024-03-09T15:10:31.434109+0000","last_clean":"2024-03-09T15:10:31.434109+0000","last_became_active":"2024-03-09T14:26:26.639784+0000","last_became_peered":"2024-03-09T14:26:26.639784+0000","last_unstale":"2024-03-09T15:10:31.434109+0000","last_undegraded":"2024-03-09T15:10:31.434109+0000","last_fullsized":"2024-03-09T15:10:31.434109+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:31.481843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8443050,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":713,"num_read_kb":41891,"num_write":1157,"num_write_kb":44648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.559614+0000","last_change":"2024-03-09T14:26:30.653007+0000","last_active":"2024-03-09T15:07:51.559614+0000","last_peered":"2024-03-09T15:07:51.559614+0000","last_clean":"2024-03-09T15:07:51.559614+0000","last_became_active":"2024-03-09T14:26:30.652726+0000","last_became_peered":"2024-03-09T14:26:30.652726+0000","last_unstale":"2024-03-09T15:07:51.559614+0000","last_undegraded":"2024-03-09T15:07:51.559614+0000","last_fullsized":"2024-03-09T15:07:51.559614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:39.318802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'175","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.654007+0000","last_change":"2024-03-09T14:26:32.653345+0000","last_active":"2024-03-09T15:11:38.654007+0000","last_peered":"2024-03-09T15:11:38.654007+0000","last_clean":"2024-03-09T15:11:38.654007+0000","last_became_active":"2024-03-09T14:26:32.653026+0000","last_became_peered":"2024-03-09T14:26:32.653026+0000","last_unstale":"2024-03-09T15:11:38.654007+0000","last_undegraded":"2024-03-09T15:11:38.654007+0000","last_fullsized":"2024-03-09T15:11:38.654007+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:27:09.685607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12290,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":235,"num_read_kb":289,"num_write":106,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.559028+0000","last_change":"2024-03-09T14:26:34.673997+0000","last_active":"2024-03-09T15:07:46.559028+0000","last_peered":"2024-03-09T15:07:46.559028+0000","last_clean":"2024-03-09T15:07:46.559028+0000","last_became_active":"2024-03-09T14:26:34.673715+0000","last_became_peered":"2024-03-09T14:26:34.673715+0000","last_unstale":"2024-03-09T15:07:46.559028+0000","last_undegraded":"2024-03-09T15:07:46.559028+0000","last_fullsized":"2024-03-09T15:07:46.559028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:42:47.462483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'121","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:49.854347+0000","last_change":"2024-03-09T14:26:36.673170+0000","last_active":"2024-03-09T15:10:49.854347+0000","last_peered":"2024-03-09T15:10:49.854347+0000","last_clean":"2024-03-09T15:10:49.854347+0000","last_became_active":"2024-03-09T14:26:36.672843+0000","last_became_peered":"2024-03-09T14:26:36.672843+0000","last_unstale":"2024-03-09T15:10:49.854347+0000","last_undegraded":"2024-03-09T15:10:49.854347+0000","last_fullsized":"2024-03-09T15:10:49.854347+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:17:11.123320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":286,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'745","reported_seq":2333,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.200285+0000","last_change":"2024-03-09T14:26:28.657382+0000","last_active":"2024-03-09T15:11:09.200285+0000","last_peered":"2024-03-09T15:11:09.200285+0000","last_clean":"2024-03-09T15:11:09.200285+0000","last_became_active":"2024-03-09T14:26:28.656983+0000","last_became_peered":"2024-03-09T14:26:28.656983+0000","last_unstale":"2024-03-09T15:11:09.200285+0000","last_undegraded":"2024-03-09T15:11:09.200285+0000","last_fullsized":"2024-03-09T15:11:09.200285+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:26.645538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3462,"num_read_kb":3140,"num_write":976,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'175","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.745805+0000","last_change":"2024-03-09T14:27:03.724793+0000","last_active":"2024-03-09T15:11:07.745805+0000","last_peered":"2024-03-09T15:11:07.745805+0000","last_clean":"2024-03-09T15:11:07.745805+0000","last_became_active":"2024-03-09T14:27:03.724370+0000","last_became_peered":"2024-03-09T14:27:03.724370+0000","last_unstale":"2024-03-09T15:11:07.745805+0000","last_undegraded":"2024-03-09T15:11:07.745805+0000","last_fullsized":"2024-03-09T15:11:07.745805+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:39:53.570919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8270984,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":386,"num_read_kb":32223,"num_write":1029,"num_write_kb":26912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.569303+0000","last_change":"2024-03-09T14:26:30.653536+0000","last_active":"2024-03-09T15:09:16.569303+0000","last_peered":"2024-03-09T15:09:16.569303+0000","last_clean":"2024-03-09T15:09:16.569303+0000","last_became_active":"2024-03-09T14:26:30.653184+0000","last_became_peered":"2024-03-09T14:26:30.653184+0000","last_unstale":"2024-03-09T15:09:16.569303+0000","last_undegraded":"2024-03-09T15:09:16.569303+0000","last_fullsized":"2024-03-09T15:09:16.569303+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:52:00.683557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'154","reported_seq":724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.494515+0000","last_change":"2024-03-09T14:26:32.653203+0000","last_active":"2024-03-09T15:11:36.494515+0000","last_peered":"2024-03-09T15:11:36.494515+0000","last_clean":"2024-03-09T15:11:36.494515+0000","last_became_active":"2024-03-09T14:26:32.652956+0000","last_became_peered":"2024-03-09T14:26:32.652956+0000","last_unstale":"2024-03-09T15:11:36.494515+0000","last_undegraded":"2024-03-09T15:11:36.494515+0000","last_fullsized":"2024-03-09T15:11:36.494515+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:40.426986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18074,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":220,"num_read_kb":285,"num_write":176,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.567970+0000","last_change":"2024-03-09T14:26:34.675619+0000","last_active":"2024-03-09T15:07:16.567970+0000","last_peered":"2024-03-09T15:07:16.567970+0000","last_clean":"2024-03-09T15:07:16.567970+0000","last_became_active":"2024-03-09T14:26:34.675354+0000","last_became_peered":"2024-03-09T14:26:34.675354+0000","last_unstale":"2024-03-09T15:07:16.567970+0000","last_undegraded":"2024-03-09T15:07:16.567970+0000","last_fullsized":"2024-03-09T15:07:16.567970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:12:54.378319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'144","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:08.302012+0000","last_change":"2024-03-09T14:26:36.672548+0000","last_active":"2024-03-09T15:11:08.302012+0000","last_peered":"2024-03-09T15:11:08.302012+0000","last_clean":"2024-03-09T15:11:08.302012+0000","last_became_active":"2024-03-09T14:26:36.672111+0000","last_became_peered":"2024-03-09T14:26:36.672111+0000","last_unstale":"2024-03-09T15:11:08.302012+0000","last_undegraded":"2024-03-09T15:11:08.302012+0000","last_fullsized":"2024-03-09T15:11:08.302012+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:18:51.718050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":110,"num_write":237,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'510","reported_seq":1980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:31.567905+0000","last_change":"2024-03-09T14:26:28.651133+0000","last_active":"2024-03-09T15:10:31.567905+0000","last_peered":"2024-03-09T15:10:31.567905+0000","last_clean":"2024-03-09T15:10:31.567905+0000","last_became_active":"2024-03-09T14:26:28.650560+0000","last_became_peered":"2024-03-09T14:26:28.650560+0000","last_unstale":"2024-03-09T15:10:31.567905+0000","last_undegraded":"2024-03-09T15:10:31.567905+0000","last_fullsized":"2024-03-09T15:10:31.567905+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:59:27.981231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2567,"num_read_kb":2395,"num_write":702,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'169","reported_seq":749,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:25.559961+0000","last_change":"2024-03-09T14:26:26.644672+0000","last_active":"2024-03-09T15:10:25.559961+0000","last_peered":"2024-03-09T15:10:25.559961+0000","last_clean":"2024-03-09T15:10:25.559961+0000","last_became_active":"2024-03-09T14:26:26.644347+0000","last_became_peered":"2024-03-09T14:26:26.644347+0000","last_unstale":"2024-03-09T15:10:25.559961+0000","last_undegraded":"2024-03-09T15:10:25.559961+0000","last_fullsized":"2024-03-09T15:10:25.559961+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:38.187729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4479180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":341,"num_read_kb":3953,"num_write":940,"num_write_kb":27527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.573925+0000","last_change":"2024-03-09T14:26:30.654838+0000","last_active":"2024-03-09T15:09:16.573925+0000","last_peered":"2024-03-09T15:09:16.573925+0000","last_clean":"2024-03-09T15:09:16.573925+0000","last_became_active":"2024-03-09T14:26:30.654575+0000","last_became_peered":"2024-03-09T14:26:30.654575+0000","last_unstale":"2024-03-09T15:09:16.573925+0000","last_undegraded":"2024-03-09T15:09:16.573925+0000","last_fullsized":"2024-03-09T15:09:16.573925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:39.725009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'141","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:31.570934+0000","last_change":"2024-03-09T14:26:32.660279+0000","last_active":"2024-03-09T15:09:31.570934+0000","last_peered":"2024-03-09T15:09:31.570934+0000","last_clean":"2024-03-09T15:09:31.570934+0000","last_became_active":"2024-03-09T14:26:32.659984+0000","last_became_peered":"2024-03-09T14:26:32.659984+0000","last_unstale":"2024-03-09T15:09:31.570934+0000","last_undegraded":"2024-03-09T15:09:31.570934+0000","last_fullsized":"2024-03-09T15:09:31.570934+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:08.563248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15183,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":196,"num_read_kb":257,"num_write":108,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'502","reported_seq":2219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.693554+0000","last_change":"2024-03-09T14:26:34.673343+0000","last_active":"2024-03-09T15:11:38.693554+0000","last_peered":"2024-03-09T15:11:38.693554+0000","last_clean":"2024-03-09T15:11:38.693554+0000","last_became_active":"2024-03-09T14:26:34.673054+0000","last_became_peered":"2024-03-09T14:26:34.673054+0000","last_unstale":"2024-03-09T15:11:38.693554+0000","last_undegraded":"2024-03-09T15:11:38.693554+0000","last_fullsized":"2024-03-09T15:11:38.693554+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:53.004843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'97","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.765724+0000","last_change":"2024-03-09T14:26:36.668508+0000","last_active":"2024-03-09T15:10:35.765724+0000","last_peered":"2024-03-09T15:10:35.765724+0000","last_clean":"2024-03-09T15:10:35.765724+0000","last_became_active":"2024-03-09T14:26:36.668217+0000","last_became_peered":"2024-03-09T14:26:36.668217+0000","last_unstale":"2024-03-09T15:10:35.765724+0000","last_undegraded":"2024-03-09T15:10:35.765724+0000","last_fullsized":"2024-03-09T15:10:35.765724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:12:50.274345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":82,"num_write":217,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'678","reported_seq":2377,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.078332+0000","last_change":"2024-03-09T14:26:28.648677+0000","last_active":"2024-03-09T15:10:51.078332+0000","last_peered":"2024-03-09T15:10:51.078332+0000","last_clean":"2024-03-09T15:10:51.078332+0000","last_became_active":"2024-03-09T14:26:28.648408+0000","last_became_peered":"2024-03-09T14:26:28.648408+0000","last_unstale":"2024-03-09T15:10:51.078332+0000","last_undegraded":"2024-03-09T15:10:51.078332+0000","last_fullsized":"2024-03-09T15:10:51.078332+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:36:20.272704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3385,"num_read_kb":3042,"num_write":948,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'218","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.586731+0000","last_change":"2024-03-09T14:26:26.643846+0000","last_active":"2024-03-09T15:07:36.586731+0000","last_peered":"2024-03-09T15:07:36.586731+0000","last_clean":"2024-03-09T15:07:36.586731+0000","last_became_active":"2024-03-09T14:26:26.643522+0000","last_became_peered":"2024-03-09T14:26:26.643522+0000","last_unstale":"2024-03-09T15:07:36.586731+0000","last_undegraded":"2024-03-09T15:07:36.586731+0000","last_fullsized":"2024-03-09T15:07:36.586731+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:35.944430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14178549,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":448,"num_read_kb":51521,"num_write":1231,"num_write_kb":50999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.418039+0000","last_change":"2024-03-09T14:26:30.652855+0000","last_active":"2024-03-09T15:11:38.418039+0000","last_peered":"2024-03-09T15:11:38.418039+0000","last_clean":"2024-03-09T15:11:38.418039+0000","last_became_active":"2024-03-09T14:26:30.652594+0000","last_became_peered":"2024-03-09T14:26:30.652594+0000","last_unstale":"2024-03-09T15:11:38.418039+0000","last_undegraded":"2024-03-09T15:11:38.418039+0000","last_fullsized":"2024-03-09T15:11:38.418039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:25.009722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":626,"num_read_kb":626,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'78","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.685232+0000","last_change":"2024-03-09T14:26:32.868538+0000","last_active":"2024-03-09T15:09:21.685232+0000","last_peered":"2024-03-09T15:09:21.685232+0000","last_clean":"2024-03-09T15:09:21.685232+0000","last_became_active":"2024-03-09T14:26:32.868147+0000","last_became_peered":"2024-03-09T14:26:32.868147+0000","last_unstale":"2024-03-09T15:09:21.685232+0000","last_undegraded":"2024-03-09T15:09:21.685232+0000","last_fullsized":"2024-03-09T15:09:21.685232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:01:35.357782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'531","reported_seq":2283,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.690271+0000","last_change":"2024-03-09T14:26:34.670121+0000","last_active":"2024-03-09T15:11:38.690271+0000","last_peered":"2024-03-09T15:11:38.690271+0000","last_clean":"2024-03-09T15:11:38.690271+0000","last_became_active":"2024-03-09T14:26:34.669695+0000","last_became_peered":"2024-03-09T14:26:34.669695+0000","last_unstale":"2024-03-09T15:11:38.690271+0000","last_undegraded":"2024-03-09T15:11:38.690271+0000","last_fullsized":"2024-03-09T15:11:38.690271+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:34:05.625218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'142","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:52.263284+0000","last_change":"2024-03-09T14:26:36.668658+0000","last_active":"2024-03-09T15:09:52.263284+0000","last_peered":"2024-03-09T15:09:52.263284+0000","last_clean":"2024-03-09T15:09:52.263284+0000","last_became_active":"2024-03-09T14:26:36.668361+0000","last_became_peered":"2024-03-09T14:26:36.668361+0000","last_unstale":"2024-03-09T15:09:52.263284+0000","last_undegraded":"2024-03-09T15:09:52.263284+0000","last_fullsized":"2024-03-09T15:09:52.263284+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:40.438535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":387,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":346,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'485","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.448831+0000","last_change":"2024-03-09T14:26:28.654782+0000","last_active":"2024-03-09T15:11:04.448831+0000","last_peered":"2024-03-09T15:11:04.448831+0000","last_clean":"2024-03-09T15:11:04.448831+0000","last_became_active":"2024-03-09T14:26:28.654325+0000","last_became_peered":"2024-03-09T14:26:28.654325+0000","last_unstale":"2024-03-09T15:11:04.448831+0000","last_undegraded":"2024-03-09T15:11:04.448831+0000","last_fullsized":"2024-03-09T15:11:04.448831+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:42.930737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2761,"num_read_kb":2604,"num_write":649,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'182","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.482602+0000","last_change":"2024-03-09T14:26:26.652669+0000","last_active":"2024-03-09T15:07:45.482602+0000","last_peered":"2024-03-09T15:07:45.482602+0000","last_clean":"2024-03-09T15:07:45.482602+0000","last_became_active":"2024-03-09T14:26:26.652273+0000","last_became_peered":"2024-03-09T14:26:26.652273+0000","last_unstale":"2024-03-09T15:07:45.482602+0000","last_undegraded":"2024-03-09T15:07:45.482602+0000","last_fullsized":"2024-03-09T15:07:45.482602+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:08:00.596097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9022863,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":356,"num_read_kb":15479,"num_write":992,"num_write_kb":26748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.600254+0000","last_change":"2024-03-09T14:26:30.652256+0000","last_active":"2024-03-09T15:09:16.600254+0000","last_peered":"2024-03-09T15:09:16.600254+0000","last_clean":"2024-03-09T15:09:16.600254+0000","last_became_active":"2024-03-09T14:26:30.651949+0000","last_became_peered":"2024-03-09T14:26:30.651949+0000","last_unstale":"2024-03-09T15:09:16.600254+0000","last_undegraded":"2024-03-09T15:09:16.600254+0000","last_fullsized":"2024-03-09T15:09:16.600254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:35.514543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'184","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.604763+0000","last_change":"2024-03-09T14:26:32.658049+0000","last_active":"2024-03-09T15:11:36.604763+0000","last_peered":"2024-03-09T15:11:36.604763+0000","last_clean":"2024-03-09T15:11:36.604763+0000","last_became_active":"2024-03-09T14:26:32.656959+0000","last_became_peered":"2024-03-09T14:26:32.656959+0000","last_unstale":"2024-03-09T15:11:36.604763+0000","last_undegraded":"2024-03-09T15:11:36.604763+0000","last_fullsized":"2024-03-09T15:11:36.604763+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:00:25.716853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12977,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":255,"num_read_kb":308,"num_write":148,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.600784+0000","last_change":"2024-03-09T14:26:34.675814+0000","last_active":"2024-03-09T15:09:21.600784+0000","last_peered":"2024-03-09T15:09:21.600784+0000","last_clean":"2024-03-09T15:09:21.600784+0000","last_became_active":"2024-03-09T14:26:34.675350+0000","last_became_peered":"2024-03-09T14:26:34.675350+0000","last_unstale":"2024-03-09T15:09:21.600784+0000","last_undegraded":"2024-03-09T15:09:21.600784+0000","last_fullsized":"2024-03-09T15:09:21.600784+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:43.105375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'122","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:31.932959+0000","last_change":"2024-03-09T14:26:36.673342+0000","last_active":"2024-03-09T15:10:31.932959+0000","last_peered":"2024-03-09T15:10:31.932959+0000","last_clean":"2024-03-09T15:10:31.932959+0000","last_became_active":"2024-03-09T14:26:36.673059+0000","last_became_peered":"2024-03-09T14:26:36.673059+0000","last_unstale":"2024-03-09T15:10:31.932959+0000","last_undegraded":"2024-03-09T15:10:31.932959+0000","last_fullsized":"2024-03-09T15:10:31.932959+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:24:05.127996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":194,"num_write":274,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'855","reported_seq":2474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.169290+0000","last_change":"2024-03-09T14:26:28.653445+0000","last_active":"2024-03-09T15:11:09.169290+0000","last_peered":"2024-03-09T15:11:09.169290+0000","last_clean":"2024-03-09T15:11:09.169290+0000","last_became_active":"2024-03-09T14:26:28.653261+0000","last_became_peered":"2024-03-09T14:26:28.653261+0000","last_unstale":"2024-03-09T15:11:09.169290+0000","last_undegraded":"2024-03-09T15:11:09.169290+0000","last_fullsized":"2024-03-09T15:11:09.169290+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:52:30.405371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3846,"num_read_kb":3440,"num_write":1147,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.713861+0000","last_change":"2024-03-09T14:26:13.798768+0000","last_active":"2024-03-09T15:08:21.713861+0000","last_peered":"2024-03-09T15:08:21.713861+0000","last_clean":"2024-03-09T15:08:21.713861+0000","last_became_active":"2024-03-09T14:26:13.797817+0000","last_became_peered":"2024-03-09T14:26:13.797817+0000","last_unstale":"2024-03-09T15:08:21.713861+0000","last_undegraded":"2024-03-09T15:08:21.713861+0000","last_fullsized":"2024-03-09T15:08:21.713861+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_clean_scrub_stamp":"2024-03-09T14:26:12.541311+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:56:57.729803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.575317+0000","last_change":"2024-03-09T14:26:18.581955+0000","last_active":"2024-03-09T15:08:01.575317+0000","last_peered":"2024-03-09T15:08:01.575317+0000","last_clean":"2024-03-09T15:08:01.575317+0000","last_became_active":"2024-03-09T14:26:18.581598+0000","last_became_peered":"2024-03-09T14:26:18.581598+0000","last_unstale":"2024-03-09T15:08:01.575317+0000","last_undegraded":"2024-03-09T15:08:01.575317+0000","last_fullsized":"2024-03-09T15:08:01.575317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:38:36.176997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'175","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:52.845578+0000","last_change":"2024-03-09T14:26:26.645174+0000","last_active":"2024-03-09T15:09:52.845578+0000","last_peered":"2024-03-09T15:09:52.845578+0000","last_clean":"2024-03-09T15:09:52.845578+0000","last_became_active":"2024-03-09T14:26:26.644848+0000","last_became_peered":"2024-03-09T14:26:26.644848+0000","last_unstale":"2024-03-09T15:09:52.845578+0000","last_undegraded":"2024-03-09T15:09:52.845578+0000","last_fullsized":"2024-03-09T15:09:52.845578+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:09:13.899449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17619055,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":337,"num_read_kb":37512,"num_write":1000,"num_write_kb":40555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.712568+0000","last_change":"2024-03-09T14:26:30.650647+0000","last_active":"2024-03-09T15:08:11.712568+0000","last_peered":"2024-03-09T15:08:11.712568+0000","last_clean":"2024-03-09T15:08:11.712568+0000","last_became_active":"2024-03-09T14:26:30.650376+0000","last_became_peered":"2024-03-09T14:26:30.650376+0000","last_unstale":"2024-03-09T15:08:11.712568+0000","last_undegraded":"2024-03-09T15:08:11.712568+0000","last_fullsized":"2024-03-09T15:08:11.712568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:35.280770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'290","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.672714+0000","last_change":"2024-03-09T14:26:32.658070+0000","last_active":"2024-03-09T15:11:38.672714+0000","last_peered":"2024-03-09T15:11:38.672714+0000","last_clean":"2024-03-09T15:11:38.672714+0000","last_became_active":"2024-03-09T14:26:32.657752+0000","last_became_peered":"2024-03-09T14:26:32.657752+0000","last_unstale":"2024-03-09T15:11:38.672714+0000","last_undegraded":"2024-03-09T15:11:38.672714+0000","last_fullsized":"2024-03-09T15:11:38.672714+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:31.136392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38712,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":719,"num_write":470,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.571341+0000","last_change":"2024-03-09T14:26:34.671261+0000","last_active":"2024-03-09T15:07:46.571341+0000","last_peered":"2024-03-09T15:07:46.571341+0000","last_clean":"2024-03-09T15:07:46.571341+0000","last_became_active":"2024-03-09T14:26:34.670987+0000","last_became_peered":"2024-03-09T14:26:34.670987+0000","last_unstale":"2024-03-09T15:07:46.571341+0000","last_undegraded":"2024-03-09T15:07:46.571341+0000","last_fullsized":"2024-03-09T15:07:46.571341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:48.297381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'204","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:26.958614+0000","last_change":"2024-03-09T14:26:36.672227+0000","last_active":"2024-03-09T15:10:26.958614+0000","last_peered":"2024-03-09T15:10:26.958614+0000","last_clean":"2024-03-09T15:10:26.958614+0000","last_became_active":"2024-03-09T14:26:36.671941+0000","last_became_peered":"2024-03-09T14:26:36.671941+0000","last_unstale":"2024-03-09T15:10:26.958614+0000","last_undegraded":"2024-03-09T15:10:26.958614+0000","last_fullsized":"2024-03-09T15:10:26.958614+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:49:17.903765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":432,"num_read_kb":416,"num_write":433,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'391","reported_seq":1981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:49.432074+0000","last_change":"2024-03-09T14:26:28.652892+0000","last_active":"2024-03-09T15:10:49.432074+0000","last_peered":"2024-03-09T15:10:49.432074+0000","last_clean":"2024-03-09T15:10:49.432074+0000","last_became_active":"2024-03-09T14:26:28.652611+0000","last_became_peered":"2024-03-09T14:26:28.652611+0000","last_unstale":"2024-03-09T15:10:49.432074+0000","last_undegraded":"2024-03-09T15:10:49.432074+0000","last_fullsized":"2024-03-09T15:10:49.432074+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:02:24.839775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2259,"num_read_kb":2164,"num_write":448,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.714524+0000","last_change":"2024-03-09T14:26:18.582346+0000","last_active":"2024-03-09T15:08:26.714524+0000","last_peered":"2024-03-09T15:08:26.714524+0000","last_clean":"2024-03-09T15:08:26.714524+0000","last_became_active":"2024-03-09T14:26:18.581306+0000","last_became_peered":"2024-03-09T14:26:18.581306+0000","last_unstale":"2024-03-09T15:08:26.714524+0000","last_undegraded":"2024-03-09T15:08:26.714524+0000","last_fullsized":"2024-03-09T15:08:26.714524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:30.980957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'135","reported_seq":734,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.573626+0000","last_change":"2024-03-09T14:26:26.632618+0000","last_active":"2024-03-09T15:08:06.573626+0000","last_peered":"2024-03-09T15:08:06.573626+0000","last_clean":"2024-03-09T15:08:06.573626+0000","last_became_active":"2024-03-09T14:26:26.632272+0000","last_became_peered":"2024-03-09T14:26:26.632272+0000","last_unstale":"2024-03-09T15:08:06.573626+0000","last_undegraded":"2024-03-09T15:08:06.573626+0000","last_fullsized":"2024-03-09T15:08:06.573626+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:03.965638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194333,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":281,"num_read_kb":61756,"num_write":786,"num_write_kb":21716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.573097+0000","last_change":"2024-03-09T14:26:30.655248+0000","last_active":"2024-03-09T15:07:41.573097+0000","last_peered":"2024-03-09T15:07:41.573097+0000","last_clean":"2024-03-09T15:07:41.573097+0000","last_became_active":"2024-03-09T14:26:30.654922+0000","last_became_peered":"2024-03-09T14:26:30.654922+0000","last_unstale":"2024-03-09T15:07:41.573097+0000","last_undegraded":"2024-03-09T15:07:41.573097+0000","last_fullsized":"2024-03-09T15:07:41.573097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:41:46.097520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'681","reported_seq":2057,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.701069+0000","last_change":"2024-03-09T14:26:32.655775+0000","last_active":"2024-03-09T15:11:38.701069+0000","last_peered":"2024-03-09T15:11:38.701069+0000","last_clean":"2024-03-09T15:11:38.701069+0000","last_became_active":"2024-03-09T14:26:32.655430+0000","last_became_peered":"2024-03-09T14:26:32.655430+0000","last_unstale":"2024-03-09T15:11:38.701069+0000","last_undegraded":"2024-03-09T15:11:38.701069+0000","last_fullsized":"2024-03-09T15:11:38.701069+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":600,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:38:38.807873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21406,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":898,"num_read_kb":1030,"num_write":284,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.713974+0000","last_change":"2024-03-09T14:26:34.678707+0000","last_active":"2024-03-09T15:08:21.713974+0000","last_peered":"2024-03-09T15:08:21.713974+0000","last_clean":"2024-03-09T15:08:21.713974+0000","last_became_active":"2024-03-09T14:26:34.678431+0000","last_became_peered":"2024-03-09T14:26:34.678431+0000","last_unstale":"2024-03-09T15:08:21.713974+0000","last_undegraded":"2024-03-09T15:08:21.713974+0000","last_fullsized":"2024-03-09T15:08:21.713974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:25.952912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'162","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:19.730383+0000","last_change":"2024-03-09T14:26:36.785121+0000","last_active":"2024-03-09T15:11:19.730383+0000","last_peered":"2024-03-09T15:11:19.730383+0000","last_clean":"2024-03-09T15:11:19.730383+0000","last_became_active":"2024-03-09T14:26:36.784815+0000","last_became_peered":"2024-03-09T14:26:36.784815+0000","last_unstale":"2024-03-09T15:11:19.730383+0000","last_undegraded":"2024-03-09T15:11:19.730383+0000","last_fullsized":"2024-03-09T15:11:19.730383+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:32:28.804163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":213,"num_read_kb":212,"num_write":359,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'794","reported_seq":2457,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.129970+0000","last_change":"2024-03-09T14:26:28.650746+0000","last_active":"2024-03-09T15:11:37.129970+0000","last_peered":"2024-03-09T15:11:37.129970+0000","last_clean":"2024-03-09T15:11:37.129970+0000","last_became_active":"2024-03-09T14:26:28.650409+0000","last_became_peered":"2024-03-09T14:26:28.650409+0000","last_unstale":"2024-03-09T15:11:37.129970+0000","last_undegraded":"2024-03-09T15:11:37.129970+0000","last_fullsized":"2024-03-09T15:11:37.129970+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:56:59.410066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3830,"num_read_kb":3466,"num_write":1049,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.560159+0000","last_change":"2024-03-09T14:26:18.577541+0000","last_active":"2024-03-09T15:07:56.560159+0000","last_peered":"2024-03-09T15:07:56.560159+0000","last_clean":"2024-03-09T15:07:56.560159+0000","last_became_active":"2024-03-09T14:26:18.577041+0000","last_became_peered":"2024-03-09T14:26:18.577041+0000","last_unstale":"2024-03-09T15:07:56.560159+0000","last_undegraded":"2024-03-09T15:07:56.560159+0000","last_fullsized":"2024-03-09T15:07:56.560159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:35.300799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'173","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.569025+0000","last_change":"2024-03-09T14:26:26.636212+0000","last_active":"2024-03-09T15:08:31.569025+0000","last_peered":"2024-03-09T15:08:31.569025+0000","last_clean":"2024-03-09T15:08:31.569025+0000","last_became_active":"2024-03-09T14:26:26.635771+0000","last_became_peered":"2024-03-09T14:26:26.635771+0000","last_unstale":"2024-03-09T15:08:31.569025+0000","last_undegraded":"2024-03-09T15:08:31.569025+0000","last_fullsized":"2024-03-09T15:08:31.569025+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:05.752386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6276296,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":354,"num_read_kb":5368,"num_write":1011,"num_write_kb":33352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"35'5","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.407443+0000","last_change":"2024-03-09T14:26:30.651034+0000","last_active":"2024-03-09T15:11:38.407443+0000","last_peered":"2024-03-09T15:11:38.407443+0000","last_clean":"2024-03-09T15:11:38.407443+0000","last_became_active":"2024-03-09T14:26:30.650766+0000","last_became_peered":"2024-03-09T14:26:30.650766+0000","last_unstale":"2024-03-09T15:11:38.407443+0000","last_undegraded":"2024-03-09T15:11:38.407443+0000","last_fullsized":"2024-03-09T15:11:38.407443+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:00.425079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1149,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":782,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'246","reported_seq":1320,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.821315+0000","last_change":"2024-03-09T14:26:32.869468+0000","last_active":"2024-03-09T15:11:38.821315+0000","last_peered":"2024-03-09T15:11:38.821315+0000","last_clean":"2024-03-09T15:11:38.821315+0000","last_became_active":"2024-03-09T14:26:32.868092+0000","last_became_peered":"2024-03-09T14:26:32.868092+0000","last_unstale":"2024-03-09T15:11:38.821315+0000","last_undegraded":"2024-03-09T15:11:38.821315+0000","last_fullsized":"2024-03-09T15:11:38.821315+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:31:58.327354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":188,"num_read_kb":180,"num_write":173,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:16.574728+0000","last_change":"2024-03-09T14:26:34.666767+0000","last_active":"2024-03-09T15:08:16.574728+0000","last_peered":"2024-03-09T15:08:16.574728+0000","last_clean":"2024-03-09T15:08:16.574728+0000","last_became_active":"2024-03-09T14:26:34.666484+0000","last_became_peered":"2024-03-09T14:26:34.666484+0000","last_unstale":"2024-03-09T15:08:16.574728+0000","last_undegraded":"2024-03-09T15:08:16.574728+0000","last_fullsized":"2024-03-09T15:08:16.574728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:42:45.793755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'255","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:03.057657+0000","last_change":"2024-03-09T14:26:36.674946+0000","last_active":"2024-03-09T15:10:03.057657+0000","last_peered":"2024-03-09T15:10:03.057657+0000","last_clean":"2024-03-09T15:10:03.057657+0000","last_became_active":"2024-03-09T14:26:36.674637+0000","last_became_peered":"2024-03-09T14:26:36.674637+0000","last_unstale":"2024-03-09T15:10:03.057657+0000","last_undegraded":"2024-03-09T15:10:03.057657+0000","last_fullsized":"2024-03-09T15:10:03.057657+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:25.308980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":491,"num_write":562,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'351","reported_seq":1818,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.871971+0000","last_change":"2024-03-09T14:26:28.646960+0000","last_active":"2024-03-09T15:11:07.871971+0000","last_peered":"2024-03-09T15:11:07.871971+0000","last_clean":"2024-03-09T15:11:07.871971+0000","last_became_active":"2024-03-09T14:26:28.646594+0000","last_became_peered":"2024-03-09T14:26:28.646594+0000","last_unstale":"2024-03-09T15:11:07.871971+0000","last_undegraded":"2024-03-09T15:11:07.871971+0000","last_fullsized":"2024-03-09T15:11:07.871971+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:27:04.392681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1989,"num_read_kb":1907,"num_write":411,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.575282+0000","last_change":"2024-03-09T14:26:18.581769+0000","last_active":"2024-03-09T15:08:01.575282+0000","last_peered":"2024-03-09T15:08:01.575282+0000","last_clean":"2024-03-09T15:08:01.575282+0000","last_became_active":"2024-03-09T14:26:18.581330+0000","last_became_peered":"2024-03-09T14:26:18.581330+0000","last_unstale":"2024-03-09T15:08:01.575282+0000","last_undegraded":"2024-03-09T15:08:01.575282+0000","last_fullsized":"2024-03-09T15:08:01.575282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:58.260466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'262","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:08.456038+0000","last_change":"2024-03-09T14:27:03.720094+0000","last_active":"2024-03-09T15:09:08.456038+0000","last_peered":"2024-03-09T15:09:08.456038+0000","last_clean":"2024-03-09T15:09:08.456038+0000","last_became_active":"2024-03-09T14:27:03.719517+0000","last_became_peered":"2024-03-09T14:27:03.719517+0000","last_unstale":"2024-03-09T15:09:08.456038+0000","last_undegraded":"2024-03-09T15:09:08.456038+0000","last_fullsized":"2024-03-09T15:09:08.456038+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:29:42.092045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8390664,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1104,"num_read_kb":25709,"num_write":1304,"num_write_kb":24224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.575225+0000","last_change":"2024-03-09T14:26:30.646463+0000","last_active":"2024-03-09T15:08:21.575225+0000","last_peered":"2024-03-09T15:08:21.575225+0000","last_clean":"2024-03-09T15:08:21.575225+0000","last_became_active":"2024-03-09T14:26:30.646190+0000","last_became_peered":"2024-03-09T14:26:30.646190+0000","last_unstale":"2024-03-09T15:08:21.575225+0000","last_undegraded":"2024-03-09T15:08:21.575225+0000","last_fullsized":"2024-03-09T15:08:21.575225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:39:12.950657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'108","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:43.733396+0000","last_change":"2024-03-09T14:26:32.650252+0000","last_active":"2024-03-09T15:08:43.733396+0000","last_peered":"2024-03-09T15:08:43.733396+0000","last_clean":"2024-03-09T15:08:43.733396+0000","last_became_active":"2024-03-09T14:26:32.650020+0000","last_became_peered":"2024-03-09T14:26:32.650020+0000","last_unstale":"2024-03-09T15:08:43.733396+0000","last_undegraded":"2024-03-09T15:08:43.733396+0000","last_fullsized":"2024-03-09T15:08:43.733396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:18:23.773127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":130,"num_write":96,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588167+0000","last_change":"2024-03-09T14:26:34.667767+0000","last_active":"2024-03-09T15:07:46.588167+0000","last_peered":"2024-03-09T15:07:46.588167+0000","last_clean":"2024-03-09T15:07:46.588167+0000","last_became_active":"2024-03-09T14:26:34.667409+0000","last_became_peered":"2024-03-09T14:26:34.667409+0000","last_unstale":"2024-03-09T15:07:46.588167+0000","last_undegraded":"2024-03-09T15:07:46.588167+0000","last_fullsized":"2024-03-09T15:07:46.588167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:39:12.935329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'126","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.598323+0000","last_change":"2024-03-09T14:26:36.674661+0000","last_active":"2024-03-09T15:10:42.598323+0000","last_peered":"2024-03-09T15:10:42.598323+0000","last_clean":"2024-03-09T15:10:42.598323+0000","last_became_active":"2024-03-09T14:26:36.674343+0000","last_became_peered":"2024-03-09T14:26:36.674343+0000","last_unstale":"2024-03-09T15:10:42.598323+0000","last_undegraded":"2024-03-09T15:10:42.598323+0000","last_fullsized":"2024-03-09T15:10:42.598323+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:49.926126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":182,"num_write":308,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'425","reported_seq":2180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.316492+0000","last_change":"2024-03-09T14:26:28.656196+0000","last_active":"2024-03-09T15:10:45.316492+0000","last_peered":"2024-03-09T15:10:45.316492+0000","last_clean":"2024-03-09T15:10:45.316492+0000","last_became_active":"2024-03-09T14:26:28.655479+0000","last_became_peered":"2024-03-09T14:26:28.655479+0000","last_unstale":"2024-03-09T15:10:45.316492+0000","last_undegraded":"2024-03-09T15:10:45.316492+0000","last_fullsized":"2024-03-09T15:10:45.316492+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:41.351260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2618,"num_read_kb":2506,"num_write":497,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'269","reported_seq":1002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:52.126933+0000","last_change":"2024-03-09T14:26:26.650096+0000","last_active":"2024-03-09T15:09:52.126933+0000","last_peered":"2024-03-09T15:09:52.126933+0000","last_clean":"2024-03-09T15:09:52.126933+0000","last_became_active":"2024-03-09T14:26:26.649325+0000","last_became_peered":"2024-03-09T14:26:26.649325+0000","last_unstale":"2024-03-09T15:09:52.126933+0000","last_undegraded":"2024-03-09T15:09:52.126933+0000","last_fullsized":"2024-03-09T15:09:52.126933+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:00:26.744072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11172498,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":944,"num_read_kb":64620,"num_write":1392,"num_write_kb":23267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.565283+0000","last_change":"2024-03-09T14:26:18.579051+0000","last_active":"2024-03-09T15:08:01.565283+0000","last_peered":"2024-03-09T15:08:01.565283+0000","last_clean":"2024-03-09T15:08:01.565283+0000","last_became_active":"2024-03-09T14:26:18.578807+0000","last_became_peered":"2024-03-09T14:26:18.578807+0000","last_unstale":"2024-03-09T15:08:01.565283+0000","last_undegraded":"2024-03-09T15:08:01.565283+0000","last_fullsized":"2024-03-09T15:08:01.565283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:16:28.179997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.574166+0000","last_change":"2024-03-09T14:26:30.648960+0000","last_active":"2024-03-09T15:08:11.574166+0000","last_peered":"2024-03-09T15:08:11.574166+0000","last_clean":"2024-03-09T15:08:11.574166+0000","last_became_active":"2024-03-09T14:26:30.648619+0000","last_became_peered":"2024-03-09T14:26:30.648619+0000","last_unstale":"2024-03-09T15:08:11.574166+0000","last_undegraded":"2024-03-09T15:08:11.574166+0000","last_fullsized":"2024-03-09T15:08:11.574166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:18.621839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'266","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.684052+0000","last_change":"2024-03-09T14:26:32.654402+0000","last_active":"2024-03-09T15:11:38.684052+0000","last_peered":"2024-03-09T15:11:38.684052+0000","last_clean":"2024-03-09T15:11:38.684052+0000","last_became_active":"2024-03-09T14:26:32.653912+0000","last_became_peered":"2024-03-09T14:26:32.653912+0000","last_unstale":"2024-03-09T15:11:38.684052+0000","last_undegraded":"2024-03-09T15:11:38.684052+0000","last_fullsized":"2024-03-09T15:11:38.684052+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:56.284532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23916,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":998,"num_read_kb":1067,"num_write":1504,"num_write_kb":1367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:16.591995+0000","last_change":"2024-03-09T14:26:34.675583+0000","last_active":"2024-03-09T15:08:16.591995+0000","last_peered":"2024-03-09T15:08:16.591995+0000","last_clean":"2024-03-09T15:08:16.591995+0000","last_became_active":"2024-03-09T14:26:34.675234+0000","last_became_peered":"2024-03-09T14:26:34.675234+0000","last_unstale":"2024-03-09T15:08:16.591995+0000","last_undegraded":"2024-03-09T15:08:16.591995+0000","last_fullsized":"2024-03-09T15:08:16.591995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:00:48.565032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'165","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.434217+0000","last_change":"2024-03-09T14:26:36.786450+0000","last_active":"2024-03-09T15:11:04.434217+0000","last_peered":"2024-03-09T15:11:04.434217+0000","last_clean":"2024-03-09T15:11:04.434217+0000","last_became_active":"2024-03-09T14:26:36.786088+0000","last_became_peered":"2024-03-09T14:26:36.786088+0000","last_unstale":"2024-03-09T15:11:04.434217+0000","last_undegraded":"2024-03-09T15:11:04.434217+0000","last_fullsized":"2024-03-09T15:11:04.434217+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:44.688510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":687,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":146,"num_write":429,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'835","reported_seq":2538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.876837+0000","last_change":"2024-03-09T14:26:28.646272+0000","last_active":"2024-03-09T15:11:07.876837+0000","last_peered":"2024-03-09T15:11:07.876837+0000","last_clean":"2024-03-09T15:11:07.876837+0000","last_became_active":"2024-03-09T14:26:28.645944+0000","last_became_peered":"2024-03-09T14:26:28.645944+0000","last_unstale":"2024-03-09T15:11:07.876837+0000","last_undegraded":"2024-03-09T15:11:07.876837+0000","last_fullsized":"2024-03-09T15:11:07.876837+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:09.470917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4110,"num_read_kb":3687,"num_write":1137,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'198","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.404922+0000","last_change":"2024-03-09T14:26:26.640197+0000","last_active":"2024-03-09T15:10:54.404922+0000","last_peered":"2024-03-09T15:10:54.404922+0000","last_clean":"2024-03-09T15:10:54.404922+0000","last_became_active":"2024-03-09T14:26:26.639853+0000","last_became_peered":"2024-03-09T14:26:26.639853+0000","last_unstale":"2024-03-09T15:10:54.404922+0000","last_undegraded":"2024-03-09T15:10:54.404922+0000","last_fullsized":"2024-03-09T15:10:54.404922+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:01:10.961843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6188704,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":10153,"num_write":1143,"num_write_kb":29784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.711777+0000","last_change":"2024-03-09T14:26:18.582360+0000","last_active":"2024-03-09T15:08:06.711777+0000","last_peered":"2024-03-09T15:08:06.711777+0000","last_clean":"2024-03-09T15:08:06.711777+0000","last_became_active":"2024-03-09T14:26:18.581750+0000","last_became_peered":"2024-03-09T14:26:18.581750+0000","last_unstale":"2024-03-09T15:08:06.711777+0000","last_undegraded":"2024-03-09T15:08:06.711777+0000","last_fullsized":"2024-03-09T15:08:06.711777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:51.952352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591427+0000","last_change":"2024-03-09T14:26:30.649458+0000","last_active":"2024-03-09T15:08:11.591427+0000","last_peered":"2024-03-09T15:08:11.591427+0000","last_clean":"2024-03-09T15:08:11.591427+0000","last_became_active":"2024-03-09T14:26:30.649176+0000","last_became_peered":"2024-03-09T14:26:30.649176+0000","last_unstale":"2024-03-09T15:08:11.591427+0000","last_undegraded":"2024-03-09T15:08:11.591427+0000","last_fullsized":"2024-03-09T15:08:11.591427+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:32:57.186116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'186","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:12.268768+0000","last_change":"2024-03-09T14:26:32.868553+0000","last_active":"2024-03-09T15:11:12.268768+0000","last_peered":"2024-03-09T15:11:12.268768+0000","last_clean":"2024-03-09T15:11:12.268768+0000","last_became_active":"2024-03-09T14:26:32.868165+0000","last_became_peered":"2024-03-09T14:26:32.868165+0000","last_unstale":"2024-03-09T15:11:12.268768+0000","last_undegraded":"2024-03-09T15:11:12.268768+0000","last_fullsized":"2024-03-09T15:11:12.268768+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:54:17.205454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":224,"num_write":210,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'554","reported_seq":2219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.637557+0000","last_change":"2024-03-09T14:26:34.673130+0000","last_active":"2024-03-09T15:11:38.637557+0000","last_peered":"2024-03-09T15:11:38.637557+0000","last_clean":"2024-03-09T15:11:38.637557+0000","last_became_active":"2024-03-09T14:26:34.672351+0000","last_became_peered":"2024-03-09T14:26:34.672351+0000","last_unstale":"2024-03-09T15:11:38.637557+0000","last_undegraded":"2024-03-09T15:11:38.637557+0000","last_fullsized":"2024-03-09T15:11:38.637557+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:47:41.314294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'119","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.329530+0000","last_change":"2024-03-09T14:26:36.785772+0000","last_active":"2024-03-09T15:10:45.329530+0000","last_peered":"2024-03-09T15:10:45.329530+0000","last_clean":"2024-03-09T15:10:45.329530+0000","last_became_active":"2024-03-09T14:26:36.785453+0000","last_became_peered":"2024-03-09T14:26:36.785453+0000","last_unstale":"2024-03-09T15:10:45.329530+0000","last_undegraded":"2024-03-09T15:10:45.329530+0000","last_fullsized":"2024-03-09T15:10:45.329530+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:52:43.326578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":860,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":155,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'674","reported_seq":2122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.096689+0000","last_change":"2024-03-09T14:26:28.656712+0000","last_active":"2024-03-09T15:11:01.096689+0000","last_peered":"2024-03-09T15:11:01.096689+0000","last_clean":"2024-03-09T15:11:01.096689+0000","last_became_active":"2024-03-09T14:26:28.655904+0000","last_became_peered":"2024-03-09T14:26:28.655904+0000","last_unstale":"2024-03-09T15:11:01.096689+0000","last_undegraded":"2024-03-09T15:11:01.096689+0000","last_fullsized":"2024-03-09T15:11:01.096689+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":600,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:45:14.565089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3203,"num_read_kb":2919,"num_write":883,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'217","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:13.198226+0000","last_change":"2024-03-09T14:26:26.644176+0000","last_active":"2024-03-09T15:09:13.198226+0000","last_peered":"2024-03-09T15:09:13.198226+0000","last_clean":"2024-03-09T15:09:13.198226+0000","last_became_active":"2024-03-09T14:26:26.643087+0000","last_became_peered":"2024-03-09T14:26:26.643087+0000","last_unstale":"2024-03-09T15:09:13.198226+0000","last_undegraded":"2024-03-09T15:09:13.198226+0000","last_fullsized":"2024-03-09T15:09:13.198226+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:46.349094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5550336,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":452,"num_read_kb":60158,"num_write":1084,"num_write_kb":49675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.561646+0000","last_change":"2024-03-09T14:26:18.577844+0000","last_active":"2024-03-09T15:07:26.561646+0000","last_peered":"2024-03-09T15:07:26.561646+0000","last_clean":"2024-03-09T15:07:26.561646+0000","last_became_active":"2024-03-09T14:26:18.577564+0000","last_became_peered":"2024-03-09T14:26:18.577564+0000","last_unstale":"2024-03-09T15:07:26.561646+0000","last_undegraded":"2024-03-09T15:07:26.561646+0000","last_fullsized":"2024-03-09T15:07:26.561646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:23:41.274783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591387+0000","last_change":"2024-03-09T14:26:30.650699+0000","last_active":"2024-03-09T15:08:11.591387+0000","last_peered":"2024-03-09T15:08:11.591387+0000","last_clean":"2024-03-09T15:08:11.591387+0000","last_became_active":"2024-03-09T14:26:30.650370+0000","last_became_peered":"2024-03-09T14:26:30.650370+0000","last_unstale":"2024-03-09T15:08:11.591387+0000","last_undegraded":"2024-03-09T15:08:11.591387+0000","last_fullsized":"2024-03-09T15:08:11.591387+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:48:57.173305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'101","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:44.959697+0000","last_change":"2024-03-09T14:26:32.655602+0000","last_active":"2024-03-09T15:08:44.959697+0000","last_peered":"2024-03-09T15:08:44.959697+0000","last_clean":"2024-03-09T15:08:44.959697+0000","last_became_active":"2024-03-09T14:26:32.655285+0000","last_became_peered":"2024-03-09T14:26:32.655285+0000","last_unstale":"2024-03-09T15:08:44.959697+0000","last_undegraded":"2024-03-09T15:08:44.959697+0000","last_fullsized":"2024-03-09T15:08:44.959697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:00:18.543951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":120,"num_read_kb":114,"num_write":82,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'561","reported_seq":4057,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.642164+0000","last_change":"2024-03-09T14:26:34.678783+0000","last_active":"2024-03-09T15:11:38.642164+0000","last_peered":"2024-03-09T15:11:38.642164+0000","last_clean":"2024-03-09T15:11:38.642164+0000","last_became_active":"2024-03-09T14:26:34.678503+0000","last_became_peered":"2024-03-09T14:26:34.678503+0000","last_unstale":"2024-03-09T15:11:38.642164+0000","last_undegraded":"2024-03-09T15:11:38.642164+0000","last_fullsized":"2024-03-09T15:11:38.642164+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:21:21.377753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'184","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.887085+0000","last_change":"2024-03-09T14:26:36.669037+0000","last_active":"2024-03-09T15:11:07.887085+0000","last_peered":"2024-03-09T15:11:07.887085+0000","last_clean":"2024-03-09T15:11:07.887085+0000","last_became_active":"2024-03-09T14:26:36.668775+0000","last_became_peered":"2024-03-09T14:26:36.668775+0000","last_unstale":"2024-03-09T15:11:07.887085+0000","last_undegraded":"2024-03-09T15:11:07.887085+0000","last_fullsized":"2024-03-09T15:11:07.887085+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:19.439405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":97,"num_write":406,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'321","reported_seq":1657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.428353+0000","last_change":"2024-03-09T14:26:28.653283+0000","last_active":"2024-03-09T15:11:04.428353+0000","last_peered":"2024-03-09T15:11:04.428353+0000","last_clean":"2024-03-09T15:11:04.428353+0000","last_became_active":"2024-03-09T14:26:28.653003+0000","last_became_peered":"2024-03-09T14:26:28.653003+0000","last_unstale":"2024-03-09T15:11:04.428353+0000","last_undegraded":"2024-03-09T15:11:04.428353+0000","last_fullsized":"2024-03-09T15:11:04.428353+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:58:52.458831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1763,"num_read_kb":1672,"num_write":372,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'238","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:24.964533+0000","last_change":"2024-03-09T14:27:03.719767+0000","last_active":"2024-03-09T15:11:24.964533+0000","last_peered":"2024-03-09T15:11:24.964533+0000","last_clean":"2024-03-09T15:11:24.964533+0000","last_became_active":"2024-03-09T14:27:03.719395+0000","last_became_peered":"2024-03-09T14:27:03.719395+0000","last_unstale":"2024-03-09T15:11:24.964533+0000","last_undegraded":"2024-03-09T15:11:24.964533+0000","last_fullsized":"2024-03-09T15:11:24.964533+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:12:44.724715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7559825,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":547,"num_read_kb":20107,"num_write":1290,"num_write_kb":28946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.585979+0000","last_change":"2024-03-09T14:26:18.578318+0000","last_active":"2024-03-09T15:07:31.585979+0000","last_peered":"2024-03-09T15:07:31.585979+0000","last_clean":"2024-03-09T15:07:31.585979+0000","last_became_active":"2024-03-09T14:26:18.577994+0000","last_became_peered":"2024-03-09T14:26:18.577994+0000","last_unstale":"2024-03-09T15:07:31.585979+0000","last_undegraded":"2024-03-09T15:07:31.585979+0000","last_fullsized":"2024-03-09T15:07:31.585979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:01:22.815335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.679647+0000","last_change":"2024-03-09T14:26:30.649199+0000","last_active":"2024-03-09T15:08:36.679647+0000","last_peered":"2024-03-09T15:08:36.679647+0000","last_clean":"2024-03-09T15:08:36.679647+0000","last_became_active":"2024-03-09T14:26:30.648910+0000","last_became_peered":"2024-03-09T14:26:30.648910+0000","last_unstale":"2024-03-09T15:08:36.679647+0000","last_undegraded":"2024-03-09T15:08:36.679647+0000","last_fullsized":"2024-03-09T15:08:36.679647+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:55:35.984723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'298","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.661350+0000","last_change":"2024-03-09T14:26:32.869477+0000","last_active":"2024-03-09T15:11:38.661350+0000","last_peered":"2024-03-09T15:11:38.661350+0000","last_clean":"2024-03-09T15:11:38.661350+0000","last_became_active":"2024-03-09T14:26:32.868370+0000","last_became_peered":"2024-03-09T14:26:32.868370+0000","last_unstale":"2024-03-09T15:11:38.661350+0000","last_undegraded":"2024-03-09T15:11:38.661350+0000","last_fullsized":"2024-03-09T15:11:38.661350+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:40.706622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46826,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":447,"num_read_kb":653,"num_write":234,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:16.676484+0000","last_change":"2024-03-09T14:26:34.673146+0000","last_active":"2024-03-09T15:08:16.676484+0000","last_peered":"2024-03-09T15:08:16.676484+0000","last_clean":"2024-03-09T15:08:16.676484+0000","last_became_active":"2024-03-09T14:26:34.672655+0000","last_became_peered":"2024-03-09T14:26:34.672655+0000","last_unstale":"2024-03-09T15:08:16.676484+0000","last_undegraded":"2024-03-09T15:08:16.676484+0000","last_fullsized":"2024-03-09T15:08:16.676484+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:28:25.637599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'120","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.538977+0000","last_change":"2024-03-09T14:26:36.678909+0000","last_active":"2024-03-09T15:10:54.538977+0000","last_peered":"2024-03-09T15:10:54.538977+0000","last_clean":"2024-03-09T15:10:54.538977+0000","last_became_active":"2024-03-09T14:26:36.678641+0000","last_became_peered":"2024-03-09T14:26:36.678641+0000","last_unstale":"2024-03-09T15:10:54.538977+0000","last_undegraded":"2024-03-09T15:10:54.538977+0000","last_fullsized":"2024-03-09T15:10:54.538977+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:51:04.017437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'140","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:56.494079+0000","last_change":"2024-03-09T14:26:36.672110+0000","last_active":"2024-03-09T15:09:56.494079+0000","last_peered":"2024-03-09T15:09:56.494079+0000","last_clean":"2024-03-09T15:09:56.494079+0000","last_became_active":"2024-03-09T14:26:36.671823+0000","last_became_peered":"2024-03-09T14:26:36.671823+0000","last_unstale":"2024-03-09T15:09:56.494079+0000","last_undegraded":"2024-03-09T15:09:56.494079+0000","last_fullsized":"2024-03-09T15:09:56.494079+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:31:00.040419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":220,"num_write":322,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'409","reported_seq":1969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.135137+0000","last_change":"2024-03-09T14:26:28.650708+0000","last_active":"2024-03-09T15:11:37.135137+0000","last_peered":"2024-03-09T15:11:37.135137+0000","last_clean":"2024-03-09T15:11:37.135137+0000","last_became_active":"2024-03-09T14:26:28.649681+0000","last_became_peered":"2024-03-09T14:26:28.649681+0000","last_unstale":"2024-03-09T15:11:37.135137+0000","last_undegraded":"2024-03-09T15:11:37.135137+0000","last_fullsized":"2024-03-09T15:11:37.135137+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:18:32.826847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2231,"num_read_kb":2115,"num_write":479,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'186","reported_seq":885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:34.295443+0000","last_change":"2024-03-09T14:26:26.644133+0000","last_active":"2024-03-09T15:10:34.295443+0000","last_peered":"2024-03-09T15:10:34.295443+0000","last_clean":"2024-03-09T15:10:34.295443+0000","last_became_active":"2024-03-09T14:26:26.643598+0000","last_became_peered":"2024-03-09T14:26:26.643598+0000","last_unstale":"2024-03-09T15:10:34.295443+0000","last_undegraded":"2024-03-09T15:10:34.295443+0000","last_fullsized":"2024-03-09T15:10:34.295443+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:11.376622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9509681,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":564,"num_read_kb":35501,"num_write":896,"num_write_kb":49168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.569074+0000","last_change":"2024-03-09T14:26:30.651022+0000","last_active":"2024-03-09T15:08:31.569074+0000","last_peered":"2024-03-09T15:08:31.569074+0000","last_clean":"2024-03-09T15:08:31.569074+0000","last_became_active":"2024-03-09T14:26:30.650743+0000","last_became_peered":"2024-03-09T14:26:30.650743+0000","last_unstale":"2024-03-09T15:08:31.569074+0000","last_undegraded":"2024-03-09T15:08:31.569074+0000","last_fullsized":"2024-03-09T15:08:31.569074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:24.403091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'124","reported_seq":684,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.696257+0000","last_change":"2024-03-09T14:26:32.651032+0000","last_active":"2024-03-09T15:10:56.696257+0000","last_peered":"2024-03-09T15:10:56.696257+0000","last_clean":"2024-03-09T15:10:56.696257+0000","last_became_active":"2024-03-09T14:26:32.650770+0000","last_became_peered":"2024-03-09T14:26:32.650770+0000","last_unstale":"2024-03-09T15:10:56.696257+0000","last_undegraded":"2024-03-09T15:10:56.696257+0000","last_fullsized":"2024-03-09T15:10:56.696257+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:42:47.799009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11686,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":164,"num_read_kb":220,"num_write":86,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.679613+0000","last_change":"2024-03-09T14:26:34.679002+0000","last_active":"2024-03-09T15:08:36.679613+0000","last_peered":"2024-03-09T15:08:36.679613+0000","last_clean":"2024-03-09T15:08:36.679613+0000","last_became_active":"2024-03-09T14:26:34.678657+0000","last_became_peered":"2024-03-09T14:26:34.678657+0000","last_unstale":"2024-03-09T15:08:36.679613+0000","last_undegraded":"2024-03-09T15:08:36.679613+0000","last_fullsized":"2024-03-09T15:08:36.679613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:14.990198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'108","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.590925+0000","last_change":"2024-03-09T14:26:36.678524+0000","last_active":"2024-03-09T15:11:01.590925+0000","last_peered":"2024-03-09T15:11:01.590925+0000","last_clean":"2024-03-09T15:11:01.590925+0000","last_became_active":"2024-03-09T14:26:36.678174+0000","last_became_peered":"2024-03-09T14:26:36.678174+0000","last_unstale":"2024-03-09T15:11:01.590925+0000","last_undegraded":"2024-03-09T15:11:01.590925+0000","last_fullsized":"2024-03-09T15:11:01.590925+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:31:59.766233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":96,"num_write":259,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'447","reported_seq":2102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.167849+0000","last_change":"2024-03-09T14:26:28.645383+0000","last_active":"2024-03-09T15:11:09.167849+0000","last_peered":"2024-03-09T15:11:09.167849+0000","last_clean":"2024-03-09T15:11:09.167849+0000","last_became_active":"2024-03-09T14:26:28.644951+0000","last_became_peered":"2024-03-09T14:26:28.644951+0000","last_unstale":"2024-03-09T15:11:09.167849+0000","last_undegraded":"2024-03-09T15:11:09.167849+0000","last_fullsized":"2024-03-09T15:11:09.167849+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:15:07.312913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2607,"num_read_kb":2478,"num_write":564,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'183","reported_seq":795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:46.815399+0000","last_change":"2024-03-09T14:26:26.652608+0000","last_active":"2024-03-09T15:09:46.815399+0000","last_peered":"2024-03-09T15:09:46.815399+0000","last_clean":"2024-03-09T15:09:46.815399+0000","last_became_active":"2024-03-09T14:26:26.652260+0000","last_became_peered":"2024-03-09T14:26:26.652260+0000","last_unstale":"2024-03-09T15:09:46.815399+0000","last_undegraded":"2024-03-09T15:09:46.815399+0000","last_fullsized":"2024-03-09T15:09:46.815399+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:55.237307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698699,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":390,"num_read_kb":5479,"num_write":1047,"num_write_kb":16075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.678739+0000","last_change":"2024-03-09T14:26:30.650065+0000","last_active":"2024-03-09T15:08:31.678739+0000","last_peered":"2024-03-09T15:08:31.678739+0000","last_clean":"2024-03-09T15:08:31.678739+0000","last_became_active":"2024-03-09T14:26:30.649790+0000","last_became_peered":"2024-03-09T14:26:30.649790+0000","last_unstale":"2024-03-09T15:08:31.678739+0000","last_undegraded":"2024-03-09T15:08:31.678739+0000","last_fullsized":"2024-03-09T15:08:31.678739+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:16.289908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'56","reported_seq":562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.592684+0000","last_change":"2024-03-09T14:26:32.655566+0000","last_active":"2024-03-09T15:10:56.592684+0000","last_peered":"2024-03-09T15:10:56.592684+0000","last_clean":"2024-03-09T15:10:56.592684+0000","last_became_active":"2024-03-09T14:26:32.655269+0000","last_became_peered":"2024-03-09T14:26:32.655269+0000","last_unstale":"2024-03-09T15:10:56.592684+0000","last_undegraded":"2024-03-09T15:10:56.592684+0000","last_fullsized":"2024-03-09T15:10:56.592684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:13.374240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715778+0000","last_change":"2024-03-09T14:26:34.671491+0000","last_active":"2024-03-09T15:08:36.715778+0000","last_peered":"2024-03-09T15:08:36.715778+0000","last_clean":"2024-03-09T15:08:36.715778+0000","last_became_active":"2024-03-09T14:26:34.671065+0000","last_became_peered":"2024-03-09T14:26:34.671065+0000","last_unstale":"2024-03-09T15:08:36.715778+0000","last_undegraded":"2024-03-09T15:08:36.715778+0000","last_fullsized":"2024-03-09T15:08:36.715778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:19:07.578080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'188","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:14.235785+0000","last_change":"2024-03-09T14:26:36.667732+0000","last_active":"2024-03-09T15:09:14.235785+0000","last_peered":"2024-03-09T15:09:14.235785+0000","last_clean":"2024-03-09T15:09:14.235785+0000","last_became_active":"2024-03-09T14:26:36.666762+0000","last_became_peered":"2024-03-09T14:26:36.666762+0000","last_unstale":"2024-03-09T15:09:14.235785+0000","last_undegraded":"2024-03-09T15:09:14.235785+0000","last_fullsized":"2024-03-09T15:09:14.235785+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:03:47.792239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":266,"num_read_kb":261,"num_write":413,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'437","reported_seq":2099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.101150+0000","last_change":"2024-03-09T14:26:28.658137+0000","last_active":"2024-03-09T15:11:01.101150+0000","last_peered":"2024-03-09T15:11:01.101150+0000","last_clean":"2024-03-09T15:11:01.101150+0000","last_became_active":"2024-03-09T14:26:28.657024+0000","last_became_peered":"2024-03-09T14:26:28.657024+0000","last_unstale":"2024-03-09T15:11:01.101150+0000","last_undegraded":"2024-03-09T15:11:01.101150+0000","last_fullsized":"2024-03-09T15:11:01.101150+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:04.541686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2592,"num_read_kb":2450,"num_write":527,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'190","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.302084+0000","last_change":"2024-03-09T14:26:26.646837+0000","last_active":"2024-03-09T15:11:04.302084+0000","last_peered":"2024-03-09T15:11:04.302084+0000","last_clean":"2024-03-09T15:11:04.302084+0000","last_became_active":"2024-03-09T14:26:26.646506+0000","last_became_peered":"2024-03-09T14:26:26.646506+0000","last_unstale":"2024-03-09T15:11:04.302084+0000","last_undegraded":"2024-03-09T15:11:04.302084+0000","last_fullsized":"2024-03-09T15:11:04.302084+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:13.870996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23070885,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":392,"num_read_kb":50370,"num_write":984,"num_write_kb":56973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.715107+0000","last_change":"2024-03-09T14:26:30.652971+0000","last_active":"2024-03-09T15:08:31.715107+0000","last_peered":"2024-03-09T15:08:31.715107+0000","last_clean":"2024-03-09T15:08:31.715107+0000","last_became_active":"2024-03-09T14:26:30.652245+0000","last_became_peered":"2024-03-09T14:26:30.652245+0000","last_unstale":"2024-03-09T15:08:31.715107+0000","last_undegraded":"2024-03-09T15:08:31.715107+0000","last_fullsized":"2024-03-09T15:08:31.715107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:24:02.699008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'163","reported_seq":738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.696289+0000","last_change":"2024-03-09T14:26:32.652895+0000","last_active":"2024-03-09T15:10:56.696289+0000","last_peered":"2024-03-09T15:10:56.696289+0000","last_clean":"2024-03-09T15:10:56.696289+0000","last_became_active":"2024-03-09T14:26:32.652610+0000","last_became_peered":"2024-03-09T14:26:32.652610+0000","last_unstale":"2024-03-09T15:10:56.696289+0000","last_undegraded":"2024-03-09T15:10:56.696289+0000","last_fullsized":"2024-03-09T15:10:56.696289+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:38:51.192534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18633,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":211,"num_read_kb":282,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.594468+0000","last_change":"2024-03-09T14:26:34.667654+0000","last_active":"2024-03-09T15:08:36.594468+0000","last_peered":"2024-03-09T15:08:36.594468+0000","last_clean":"2024-03-09T15:08:36.594468+0000","last_became_active":"2024-03-09T14:26:34.667373+0000","last_became_peered":"2024-03-09T14:26:34.667373+0000","last_unstale":"2024-03-09T15:08:36.594468+0000","last_undegraded":"2024-03-09T15:08:36.594468+0000","last_fullsized":"2024-03-09T15:08:36.594468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:15.287538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'134","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.348642+0000","last_change":"2024-03-09T14:26:36.678631+0000","last_active":"2024-03-09T15:10:35.348642+0000","last_peered":"2024-03-09T15:10:35.348642+0000","last_clean":"2024-03-09T15:10:35.348642+0000","last_became_active":"2024-03-09T14:26:36.678306+0000","last_became_peered":"2024-03-09T14:26:36.678306+0000","last_unstale":"2024-03-09T15:10:35.348642+0000","last_undegraded":"2024-03-09T15:10:35.348642+0000","last_fullsized":"2024-03-09T15:10:35.348642+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:33:48.413353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":110,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'432","reported_seq":2096,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.534339+0000","last_change":"2024-03-09T14:26:28.652461+0000","last_active":"2024-03-09T15:10:54.534339+0000","last_peered":"2024-03-09T15:10:54.534339+0000","last_clean":"2024-03-09T15:10:54.534339+0000","last_became_active":"2024-03-09T14:26:28.651640+0000","last_became_peered":"2024-03-09T14:26:28.651640+0000","last_unstale":"2024-03-09T15:10:54.534339+0000","last_undegraded":"2024-03-09T15:10:54.534339+0000","last_fullsized":"2024-03-09T15:10:54.534339+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:46.863189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2590,"num_read_kb":2461,"num_write":546,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'203","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.046619+0000","last_change":"2024-03-09T14:26:26.636955+0000","last_active":"2024-03-09T15:11:09.046619+0000","last_peered":"2024-03-09T15:11:09.046619+0000","last_clean":"2024-03-09T15:11:09.046619+0000","last_became_active":"2024-03-09T14:26:26.636087+0000","last_became_peered":"2024-03-09T14:26:26.636087+0000","last_unstale":"2024-03-09T15:11:09.046619+0000","last_undegraded":"2024-03-09T15:11:09.046619+0000","last_fullsized":"2024-03-09T15:11:09.046619+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:08:49.930168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221125,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":647,"num_read_kb":124750,"num_write":1243,"num_write_kb":18410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.593747+0000","last_change":"2024-03-09T14:26:30.653233+0000","last_active":"2024-03-09T15:08:31.593747+0000","last_peered":"2024-03-09T15:08:31.593747+0000","last_clean":"2024-03-09T15:08:31.593747+0000","last_became_active":"2024-03-09T14:26:30.652925+0000","last_became_peered":"2024-03-09T14:26:30.652925+0000","last_unstale":"2024-03-09T15:08:31.593747+0000","last_undegraded":"2024-03-09T15:08:31.593747+0000","last_fullsized":"2024-03-09T15:08:31.593747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:15:46.808131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'126","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.159039+0000","last_change":"2024-03-09T14:26:32.657556+0000","last_active":"2024-03-09T15:11:37.159039+0000","last_peered":"2024-03-09T15:11:37.159039+0000","last_clean":"2024-03-09T15:11:37.159039+0000","last_became_active":"2024-03-09T14:26:32.657221+0000","last_became_peered":"2024-03-09T14:26:32.657221+0000","last_unstale":"2024-03-09T15:11:37.159039+0000","last_undegraded":"2024-03-09T15:11:37.159039+0000","last_fullsized":"2024-03-09T15:11:37.159039+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:53:32.822261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30241,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":153,"num_read_kb":246,"num_write":80,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.577073+0000","last_change":"2024-03-09T14:26:34.670563+0000","last_active":"2024-03-09T15:08:36.577073+0000","last_peered":"2024-03-09T15:08:36.577073+0000","last_clean":"2024-03-09T15:08:36.577073+0000","last_became_active":"2024-03-09T14:26:34.670283+0000","last_became_peered":"2024-03-09T14:26:34.670283+0000","last_unstale":"2024-03-09T15:08:36.577073+0000","last_undegraded":"2024-03-09T15:08:36.577073+0000","last_fullsized":"2024-03-09T15:08:36.577073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:08:44.244645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'870","reported_seq":2445,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.175205+0000","last_change":"2024-03-09T14:26:28.652528+0000","last_active":"2024-03-09T15:11:09.175205+0000","last_peered":"2024-03-09T15:11:09.175205+0000","last_clean":"2024-03-09T15:11:09.175205+0000","last_became_active":"2024-03-09T14:26:28.651921+0000","last_became_peered":"2024-03-09T14:26:28.651921+0000","last_unstale":"2024-03-09T15:11:09.175205+0000","last_undegraded":"2024-03-09T15:11:09.175205+0000","last_fullsized":"2024-03-09T15:11:09.175205+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:35:33.794890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3929,"num_read_kb":3481,"num_write":1218,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'258","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:02.109115+0000","last_change":"2024-03-09T14:27:03.717196+0000","last_active":"2024-03-09T15:09:02.109115+0000","last_peered":"2024-03-09T15:09:02.109115+0000","last_clean":"2024-03-09T15:09:02.109115+0000","last_became_active":"2024-03-09T14:27:03.716852+0000","last_became_peered":"2024-03-09T14:27:03.716852+0000","last_unstale":"2024-03-09T15:09:02.109115+0000","last_undegraded":"2024-03-09T15:09:02.109115+0000","last_fullsized":"2024-03-09T15:09:02.109115+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:55.331529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621563,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":888,"num_read_kb":7728,"num_write":1382,"num_write_kb":17237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"35'3","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.408491+0000","last_change":"2024-03-09T14:26:30.652021+0000","last_active":"2024-03-09T15:11:38.408491+0000","last_peered":"2024-03-09T15:11:38.408491+0000","last_clean":"2024-03-09T15:11:38.408491+0000","last_became_active":"2024-03-09T14:26:30.651711+0000","last_became_peered":"2024-03-09T14:26:30.651711+0000","last_unstale":"2024-03-09T15:11:38.408491+0000","last_undegraded":"2024-03-09T15:11:38.408491+0000","last_fullsized":"2024-03-09T15:11:38.408491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:37.178573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":479,"num_read_kb":477,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'199","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.657964+0000","last_change":"2024-03-09T14:26:32.655679+0000","last_active":"2024-03-09T15:11:38.657964+0000","last_peered":"2024-03-09T15:11:38.657964+0000","last_clean":"2024-03-09T15:11:38.657964+0000","last_became_active":"2024-03-09T14:26:32.655391+0000","last_became_peered":"2024-03-09T14:26:32.655391+0000","last_unstale":"2024-03-09T15:11:38.657964+0000","last_undegraded":"2024-03-09T15:11:38.657964+0000","last_fullsized":"2024-03-09T15:11:38.657964+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:26:19.532383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47720,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":299,"num_read_kb":492,"num_write":192,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.583116+0000","last_change":"2024-03-09T14:26:34.675539+0000","last_active":"2024-03-09T15:09:06.583116+0000","last_peered":"2024-03-09T15:09:06.583116+0000","last_clean":"2024-03-09T15:09:06.583116+0000","last_became_active":"2024-03-09T14:26:34.675248+0000","last_became_peered":"2024-03-09T14:26:34.675248+0000","last_unstale":"2024-03-09T15:09:06.583116+0000","last_undegraded":"2024-03-09T15:09:06.583116+0000","last_fullsized":"2024-03-09T15:09:06.583116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:43:16.280150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'185","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.696274+0000","last_change":"2024-03-09T14:26:36.786828+0000","last_active":"2024-03-09T15:10:56.696274+0000","last_peered":"2024-03-09T15:10:56.696274+0000","last_clean":"2024-03-09T15:10:56.696274+0000","last_became_active":"2024-03-09T14:26:36.786403+0000","last_became_peered":"2024-03-09T14:26:36.786403+0000","last_unstale":"2024-03-09T15:10:56.696274+0000","last_undegraded":"2024-03-09T15:10:56.696274+0000","last_fullsized":"2024-03-09T15:10:56.696274+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:54:17.134629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1042,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":213,"num_write":429,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'371","reported_seq":1881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.128774+0000","last_change":"2024-03-09T14:26:28.642746+0000","last_active":"2024-03-09T15:11:37.128774+0000","last_peered":"2024-03-09T15:11:37.128774+0000","last_clean":"2024-03-09T15:11:37.128774+0000","last_became_active":"2024-03-09T14:26:28.642452+0000","last_became_peered":"2024-03-09T14:26:28.642452+0000","last_unstale":"2024-03-09T15:11:37.128774+0000","last_undegraded":"2024-03-09T15:11:37.128774+0000","last_fullsized":"2024-03-09T15:11:37.128774+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:40.141256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2046,"num_read_kb":1963,"num_write":419,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'172","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:03.384230+0000","last_change":"2024-03-09T14:27:03.724915+0000","last_active":"2024-03-09T15:09:03.384230+0000","last_peered":"2024-03-09T15:09:03.384230+0000","last_clean":"2024-03-09T15:09:03.384230+0000","last_became_active":"2024-03-09T14:27:03.724521+0000","last_became_peered":"2024-03-09T14:27:03.724521+0000","last_unstale":"2024-03-09T15:09:03.384230+0000","last_undegraded":"2024-03-09T15:09:03.384230+0000","last_fullsized":"2024-03-09T15:09:03.384230+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:32:10.947685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17066132,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":316,"num_read_kb":39345,"num_write":954,"num_write_kb":40541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591483+0000","last_change":"2024-03-09T14:26:30.652505+0000","last_active":"2024-03-09T15:08:11.591483+0000","last_peered":"2024-03-09T15:08:11.591483+0000","last_clean":"2024-03-09T15:08:11.591483+0000","last_became_active":"2024-03-09T14:26:30.652243+0000","last_became_peered":"2024-03-09T14:26:30.652243+0000","last_unstale":"2024-03-09T15:08:11.591483+0000","last_undegraded":"2024-03-09T15:08:11.591483+0000","last_fullsized":"2024-03-09T15:08:11.591483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:42:30.815337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'149","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.617080+0000","last_change":"2024-03-09T14:26:32.658910+0000","last_active":"2024-03-09T15:11:36.617080+0000","last_peered":"2024-03-09T15:11:36.617080+0000","last_clean":"2024-03-09T15:11:36.617080+0000","last_became_active":"2024-03-09T14:26:32.658626+0000","last_became_peered":"2024-03-09T14:26:32.658626+0000","last_unstale":"2024-03-09T15:11:36.617080+0000","last_undegraded":"2024-03-09T15:11:36.617080+0000","last_fullsized":"2024-03-09T15:11:36.617080+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:20.837652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17393,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":278,"num_write":142,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.572913+0000","last_change":"2024-03-09T14:26:34.669777+0000","last_active":"2024-03-09T15:09:06.572913+0000","last_peered":"2024-03-09T15:09:06.572913+0000","last_clean":"2024-03-09T15:09:06.572913+0000","last_became_active":"2024-03-09T14:26:34.669482+0000","last_became_peered":"2024-03-09T14:26:34.669482+0000","last_unstale":"2024-03-09T15:09:06.572913+0000","last_undegraded":"2024-03-09T15:09:06.572913+0000","last_fullsized":"2024-03-09T15:09:06.572913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:44:39.381656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'220","reported_seq":1403,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.414241+0000","last_change":"2024-03-09T14:26:36.678544+0000","last_active":"2024-03-09T15:11:37.414241+0000","last_peered":"2024-03-09T15:11:37.414241+0000","last_clean":"2024-03-09T15:11:37.414241+0000","last_became_active":"2024-03-09T14:26:36.678232+0000","last_became_peered":"2024-03-09T14:26:36.678232+0000","last_unstale":"2024-03-09T15:11:37.414241+0000","last_undegraded":"2024-03-09T15:11:37.414241+0000","last_fullsized":"2024-03-09T15:11:37.414241+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:27.054472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":941,"num_read_kb":939,"num_write":605,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'431","reported_seq":1927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.133871+0000","last_change":"2024-03-09T14:26:28.658740+0000","last_active":"2024-03-09T15:11:37.133871+0000","last_peered":"2024-03-09T15:11:37.133871+0000","last_clean":"2024-03-09T15:11:37.133871+0000","last_became_active":"2024-03-09T14:26:28.657488+0000","last_became_peered":"2024-03-09T14:26:28.657488+0000","last_unstale":"2024-03-09T15:11:37.133871+0000","last_undegraded":"2024-03-09T15:11:37.133871+0000","last_fullsized":"2024-03-09T15:11:37.133871+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:15:44.795978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2287,"num_read_kb":2137,"num_write":511,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'195","reported_seq":801,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.492761+0000","last_change":"2024-03-09T14:26:26.641350+0000","last_active":"2024-03-09T15:11:26.492761+0000","last_peered":"2024-03-09T15:11:26.492761+0000","last_clean":"2024-03-09T15:11:26.492761+0000","last_became_active":"2024-03-09T14:26:26.641003+0000","last_became_peered":"2024-03-09T14:26:26.641003+0000","last_unstale":"2024-03-09T15:11:26.492761+0000","last_undegraded":"2024-03-09T15:11:26.492761+0000","last_fullsized":"2024-03-09T15:11:26.492761+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:10:53.927499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582977,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":372,"num_read_kb":32756,"num_write":1154,"num_write_kb":45988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.597964+0000","last_change":"2024-03-09T14:26:30.654064+0000","last_active":"2024-03-09T15:09:01.597964+0000","last_peered":"2024-03-09T15:09:01.597964+0000","last_clean":"2024-03-09T15:09:01.597964+0000","last_became_active":"2024-03-09T14:26:30.653249+0000","last_became_peered":"2024-03-09T14:26:30.653249+0000","last_unstale":"2024-03-09T15:09:01.597964+0000","last_undegraded":"2024-03-09T15:09:01.597964+0000","last_fullsized":"2024-03-09T15:09:01.597964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:11:30.602441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'124","reported_seq":686,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:21.692304+0000","last_change":"2024-03-09T14:26:32.868697+0000","last_active":"2024-03-09T15:10:21.692304+0000","last_peered":"2024-03-09T15:10:21.692304+0000","last_clean":"2024-03-09T15:10:21.692304+0000","last_became_active":"2024-03-09T14:26:32.868236+0000","last_became_peered":"2024-03-09T14:26:32.868236+0000","last_unstale":"2024-03-09T15:10:21.692304+0000","last_undegraded":"2024-03-09T15:10:21.692304+0000","last_fullsized":"2024-03-09T15:10:21.692304+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:50:04.808478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12376,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":164,"num_read_kb":223,"num_write":86,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.570427+0000","last_change":"2024-03-09T14:26:34.675615+0000","last_active":"2024-03-09T15:08:41.570427+0000","last_peered":"2024-03-09T15:08:41.570427+0000","last_clean":"2024-03-09T15:08:41.570427+0000","last_became_active":"2024-03-09T14:26:34.675120+0000","last_became_peered":"2024-03-09T14:26:34.675120+0000","last_unstale":"2024-03-09T15:08:41.570427+0000","last_undegraded":"2024-03-09T15:08:41.570427+0000","last_fullsized":"2024-03-09T15:08:41.570427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:06.267360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'104","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.686247+0000","last_change":"2024-03-09T14:26:36.678845+0000","last_active":"2024-03-09T15:11:38.686247+0000","last_peered":"2024-03-09T15:11:38.686247+0000","last_clean":"2024-03-09T15:11:38.686247+0000","last_became_active":"2024-03-09T14:26:36.678521+0000","last_became_peered":"2024-03-09T14:26:36.678521+0000","last_unstale":"2024-03-09T15:11:38.686247+0000","last_undegraded":"2024-03-09T15:11:38.686247+0000","last_fullsized":"2024-03-09T15:11:38.686247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:26:18.582752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":103,"num_write":248,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'325","reported_seq":1740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.198591+0000","last_change":"2024-03-09T14:26:28.648512+0000","last_active":"2024-03-09T15:11:09.198591+0000","last_peered":"2024-03-09T15:11:09.198591+0000","last_clean":"2024-03-09T15:11:09.198591+0000","last_became_active":"2024-03-09T14:26:28.648204+0000","last_became_peered":"2024-03-09T14:26:28.648204+0000","last_unstale":"2024-03-09T15:11:09.198591+0000","last_undegraded":"2024-03-09T15:11:09.198591+0000","last_fullsized":"2024-03-09T15:11:09.198591+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:16:38.156513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1841,"num_read_kb":1771,"num_write":371,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'191","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:12.482693+0000","last_change":"2024-03-09T14:27:03.719684+0000","last_active":"2024-03-09T15:09:12.482693+0000","last_peered":"2024-03-09T15:09:12.482693+0000","last_clean":"2024-03-09T15:09:12.482693+0000","last_became_active":"2024-03-09T14:27:03.719292+0000","last_became_peered":"2024-03-09T14:27:03.719292+0000","last_unstale":"2024-03-09T15:09:12.482693+0000","last_undegraded":"2024-03-09T15:09:12.482693+0000","last_fullsized":"2024-03-09T15:09:12.482693+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:28.532681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7024912,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":930,"num_read_kb":86824,"num_write":1013,"num_write_kb":33052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.572422+0000","last_change":"2024-03-09T14:26:30.652463+0000","last_active":"2024-03-09T15:09:01.572422+0000","last_peered":"2024-03-09T15:09:01.572422+0000","last_clean":"2024-03-09T15:09:01.572422+0000","last_became_active":"2024-03-09T14:26:30.652190+0000","last_became_peered":"2024-03-09T14:26:30.652190+0000","last_unstale":"2024-03-09T15:09:01.572422+0000","last_undegraded":"2024-03-09T15:09:01.572422+0000","last_fullsized":"2024-03-09T15:09:01.572422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:52:53.691492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'82","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:46.595898+0000","last_change":"2024-03-09T14:26:32.868321+0000","last_active":"2024-03-09T15:08:46.595898+0000","last_peered":"2024-03-09T15:08:46.595898+0000","last_clean":"2024-03-09T15:08:46.595898+0000","last_became_active":"2024-03-09T14:26:32.867985+0000","last_became_peered":"2024-03-09T14:26:32.867985+0000","last_unstale":"2024-03-09T15:08:46.595898+0000","last_undegraded":"2024-03-09T15:08:46.595898+0000","last_fullsized":"2024-03-09T15:08:46.595898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:20.552555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":100,"num_read_kb":95,"num_write":100,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'531","reported_seq":2041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.691175+0000","last_change":"2024-03-09T14:26:34.665855+0000","last_active":"2024-03-09T15:11:38.691175+0000","last_peered":"2024-03-09T15:11:38.691175+0000","last_clean":"2024-03-09T15:11:38.691175+0000","last_became_active":"2024-03-09T14:26:34.664708+0000","last_became_peered":"2024-03-09T14:26:34.664708+0000","last_unstale":"2024-03-09T15:11:38.691175+0000","last_undegraded":"2024-03-09T15:11:38.691175+0000","last_fullsized":"2024-03-09T15:11:38.691175+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:21:02.162854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'142","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.341774+0000","last_change":"2024-03-09T14:26:36.676199+0000","last_active":"2024-03-09T15:10:35.341774+0000","last_peered":"2024-03-09T15:10:35.341774+0000","last_clean":"2024-03-09T15:10:35.341774+0000","last_became_active":"2024-03-09T14:26:36.675855+0000","last_became_peered":"2024-03-09T14:26:36.675855+0000","last_unstale":"2024-03-09T15:10:35.341774+0000","last_undegraded":"2024-03-09T15:10:35.341774+0000","last_fullsized":"2024-03-09T15:10:35.341774+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:10:54.315090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":194,"num_write":349,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'797","reported_seq":2329,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.448334+0000","last_change":"2024-03-09T14:26:28.657378+0000","last_active":"2024-03-09T15:11:04.448334+0000","last_peered":"2024-03-09T15:11:04.448334+0000","last_clean":"2024-03-09T15:11:04.448334+0000","last_became_active":"2024-03-09T14:26:28.656940+0000","last_became_peered":"2024-03-09T14:26:28.656940+0000","last_unstale":"2024-03-09T15:11:04.448334+0000","last_undegraded":"2024-03-09T15:11:04.448334+0000","last_fullsized":"2024-03-09T15:11:04.448334+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:15:38.996663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3613,"num_read_kb":3222,"num_write":1070,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'206","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.581855+0000","last_change":"2024-03-09T14:26:26.641435+0000","last_active":"2024-03-09T15:08:56.581855+0000","last_peered":"2024-03-09T15:08:56.581855+0000","last_clean":"2024-03-09T15:08:56.581855+0000","last_became_active":"2024-03-09T14:26:26.641031+0000","last_became_peered":"2024-03-09T14:26:26.641031+0000","last_unstale":"2024-03-09T15:08:56.581855+0000","last_undegraded":"2024-03-09T15:08:56.581855+0000","last_fullsized":"2024-03-09T15:08:56.581855+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:53:53.180266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9752665,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":391,"num_read_kb":2692,"num_write":1147,"num_write_kb":40768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.719265+0000","last_change":"2024-03-09T14:26:30.652643+0000","last_active":"2024-03-09T15:09:01.719265+0000","last_peered":"2024-03-09T15:09:01.719265+0000","last_clean":"2024-03-09T15:09:01.719265+0000","last_became_active":"2024-03-09T14:26:30.652315+0000","last_became_peered":"2024-03-09T14:26:30.652315+0000","last_unstale":"2024-03-09T15:09:01.719265+0000","last_undegraded":"2024-03-09T15:09:01.719265+0000","last_fullsized":"2024-03-09T15:09:01.719265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:10.314147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'166","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:11.592429+0000","last_change":"2024-03-09T14:26:32.657278+0000","last_active":"2024-03-09T15:10:11.592429+0000","last_peered":"2024-03-09T15:10:11.592429+0000","last_clean":"2024-03-09T15:10:11.592429+0000","last_became_active":"2024-03-09T14:26:32.656973+0000","last_became_peered":"2024-03-09T14:26:32.656973+0000","last_unstale":"2024-03-09T15:10:11.592429+0000","last_undegraded":"2024-03-09T15:10:11.592429+0000","last_fullsized":"2024-03-09T15:10:11.592429+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:33.380705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11498,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":242,"num_write":114,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.570657+0000","last_change":"2024-03-09T14:26:34.665616+0000","last_active":"2024-03-09T15:07:41.570657+0000","last_peered":"2024-03-09T15:07:41.570657+0000","last_clean":"2024-03-09T15:07:41.570657+0000","last_became_active":"2024-03-09T14:26:34.665208+0000","last_became_peered":"2024-03-09T14:26:34.665208+0000","last_unstale":"2024-03-09T15:07:41.570657+0000","last_undegraded":"2024-03-09T15:07:41.570657+0000","last_fullsized":"2024-03-09T15:07:41.570657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:06:56.886360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'128","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:08.308795+0000","last_change":"2024-03-09T14:26:36.678157+0000","last_active":"2024-03-09T15:11:08.308795+0000","last_peered":"2024-03-09T15:11:08.308795+0000","last_clean":"2024-03-09T15:11:08.308795+0000","last_became_active":"2024-03-09T14:26:36.677867+0000","last_became_peered":"2024-03-09T14:26:36.677867+0000","last_unstale":"2024-03-09T15:11:08.308795+0000","last_undegraded":"2024-03-09T15:11:08.308795+0000","last_fullsized":"2024-03-09T15:11:08.308795+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:04:56.832371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":311,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'823","reported_seq":2497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.123341+0000","last_change":"2024-03-09T14:26:28.657249+0000","last_active":"2024-03-09T15:11:37.123341+0000","last_peered":"2024-03-09T15:11:37.123341+0000","last_clean":"2024-03-09T15:11:37.123341+0000","last_became_active":"2024-03-09T14:26:28.656960+0000","last_became_peered":"2024-03-09T14:26:28.656960+0000","last_unstale":"2024-03-09T15:11:37.123341+0000","last_undegraded":"2024-03-09T15:11:37.123341+0000","last_fullsized":"2024-03-09T15:11:37.123341+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:23.435423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4034,"num_read_kb":3617,"num_write":1125,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'213","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.581881+0000","last_change":"2024-03-09T14:26:26.650356+0000","last_active":"2024-03-09T15:08:56.581881+0000","last_peered":"2024-03-09T15:08:56.581881+0000","last_clean":"2024-03-09T15:08:56.581881+0000","last_became_active":"2024-03-09T14:26:26.649772+0000","last_became_peered":"2024-03-09T14:26:26.649772+0000","last_unstale":"2024-03-09T15:08:56.581881+0000","last_undegraded":"2024-03-09T15:08:56.581881+0000","last_fullsized":"2024-03-09T15:08:56.581881+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:59.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12930210,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":400,"num_read_kb":32014,"num_write":1022,"num_write_kb":48046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.582476+0000","last_change":"2024-03-09T14:26:30.650955+0000","last_active":"2024-03-09T15:09:01.582476+0000","last_peered":"2024-03-09T15:09:01.582476+0000","last_clean":"2024-03-09T15:09:01.582476+0000","last_became_active":"2024-03-09T14:26:30.650674+0000","last_became_peered":"2024-03-09T14:26:30.650674+0000","last_unstale":"2024-03-09T15:09:01.582476+0000","last_undegraded":"2024-03-09T15:09:01.582476+0000","last_fullsized":"2024-03-09T15:09:01.582476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:18.310162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'125","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.587145+0000","last_change":"2024-03-09T14:26:32.653856+0000","last_active":"2024-03-09T15:10:06.587145+0000","last_peered":"2024-03-09T15:10:06.587145+0000","last_clean":"2024-03-09T15:10:06.587145+0000","last_became_active":"2024-03-09T14:26:32.652397+0000","last_became_peered":"2024-03-09T14:26:32.652397+0000","last_unstale":"2024-03-09T15:10:06.587145+0000","last_undegraded":"2024-03-09T15:10:06.587145+0000","last_fullsized":"2024-03-09T15:10:06.587145+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:53:36.740581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17184,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":239,"num_write":84,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.588861+0000","last_change":"2024-03-09T14:26:34.671397+0000","last_active":"2024-03-09T15:07:51.588861+0000","last_peered":"2024-03-09T15:07:51.588861+0000","last_clean":"2024-03-09T15:07:51.588861+0000","last_became_active":"2024-03-09T14:26:34.671029+0000","last_became_peered":"2024-03-09T14:26:34.671029+0000","last_unstale":"2024-03-09T15:07:51.588861+0000","last_undegraded":"2024-03-09T15:07:51.588861+0000","last_fullsized":"2024-03-09T15:07:51.588861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:21:55.027507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'112","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:43.714487+0000","last_change":"2024-03-09T14:26:36.786838+0000","last_active":"2024-03-09T15:08:43.714487+0000","last_peered":"2024-03-09T15:08:43.714487+0000","last_clean":"2024-03-09T15:08:43.714487+0000","last_became_active":"2024-03-09T14:26:36.786449+0000","last_became_peered":"2024-03-09T14:26:36.786449+0000","last_unstale":"2024-03-09T15:08:43.714487+0000","last_undegraded":"2024-03-09T15:08:43.714487+0000","last_fullsized":"2024-03-09T15:08:43.714487+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:16:55.574602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":178,"num_write":287,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'518","reported_seq":2099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.331511+0000","last_change":"2024-03-09T14:26:28.649113+0000","last_active":"2024-03-09T15:10:35.331511+0000","last_peered":"2024-03-09T15:10:35.331511+0000","last_clean":"2024-03-09T15:10:35.331511+0000","last_became_active":"2024-03-09T14:26:28.647178+0000","last_became_peered":"2024-03-09T14:26:28.647178+0000","last_unstale":"2024-03-09T15:10:35.331511+0000","last_undegraded":"2024-03-09T15:10:35.331511+0000","last_fullsized":"2024-03-09T15:10:35.331511+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:45:41.501592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2831,"num_read_kb":2584,"num_write":686,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'265","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:24.832572+0000","last_change":"2024-03-09T14:26:26.643743+0000","last_active":"2024-03-09T15:11:24.832572+0000","last_peered":"2024-03-09T15:11:24.832572+0000","last_clean":"2024-03-09T15:11:24.832572+0000","last_became_active":"2024-03-09T14:26:26.643338+0000","last_became_peered":"2024-03-09T14:26:26.643338+0000","last_unstale":"2024-03-09T15:11:24.832572+0000","last_undegraded":"2024-03-09T15:11:24.832572+0000","last_fullsized":"2024-03-09T15:11:24.832572+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:31.097518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18897035,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":642,"num_read_kb":43219,"num_write":1334,"num_write_kb":45633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.586671+0000","last_change":"2024-03-09T14:26:30.648059+0000","last_active":"2024-03-09T15:07:36.586671+0000","last_peered":"2024-03-09T15:07:36.586671+0000","last_clean":"2024-03-09T15:07:36.586671+0000","last_became_active":"2024-03-09T14:26:30.647466+0000","last_became_peered":"2024-03-09T14:26:30.647466+0000","last_unstale":"2024-03-09T15:07:36.586671+0000","last_undegraded":"2024-03-09T15:07:36.586671+0000","last_fullsized":"2024-03-09T15:07:36.586671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:23:46.397656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'101","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.490736+0000","last_change":"2024-03-09T14:26:32.654369+0000","last_active":"2024-03-09T15:11:36.490736+0000","last_peered":"2024-03-09T15:11:36.490736+0000","last_clean":"2024-03-09T15:11:36.490736+0000","last_became_active":"2024-03-09T14:26:32.654096+0000","last_became_peered":"2024-03-09T14:26:32.654096+0000","last_unstale":"2024-03-09T15:11:36.490736+0000","last_undegraded":"2024-03-09T15:11:36.490736+0000","last_fullsized":"2024-03-09T15:11:36.490736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:18.258039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":160,"num_write":58,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.598713+0000","last_change":"2024-03-09T14:26:34.665772+0000","last_active":"2024-03-09T15:09:06.598713+0000","last_peered":"2024-03-09T15:09:06.598713+0000","last_clean":"2024-03-09T15:09:06.598713+0000","last_became_active":"2024-03-09T14:26:34.665478+0000","last_became_peered":"2024-03-09T14:26:34.665478+0000","last_unstale":"2024-03-09T15:09:06.598713+0000","last_undegraded":"2024-03-09T15:09:06.598713+0000","last_fullsized":"2024-03-09T15:09:06.598713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:56:28.715090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'118","reported_seq":1775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.464880+0000","last_change":"2024-03-09T14:26:36.678308+0000","last_active":"2024-03-09T15:11:37.464880+0000","last_peered":"2024-03-09T15:11:37.464880+0000","last_clean":"2024-03-09T15:11:37.464880+0000","last_became_active":"2024-03-09T14:26:36.677953+0000","last_became_peered":"2024-03-09T14:26:36.677953+0000","last_unstale":"2024-03-09T15:11:37.464880+0000","last_undegraded":"2024-03-09T15:11:37.464880+0000","last_fullsized":"2024-03-09T15:11:37.464880+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:17:40.272125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1291,"num_read_kb":1290,"num_write":257,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'553","reported_seq":2040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.176462+0000","last_change":"2024-03-09T14:26:28.644942+0000","last_active":"2024-03-09T15:11:09.176462+0000","last_peered":"2024-03-09T15:11:09.176462+0000","last_clean":"2024-03-09T15:11:09.176462+0000","last_became_active":"2024-03-09T14:26:28.644628+0000","last_became_peered":"2024-03-09T14:26:28.644628+0000","last_unstale":"2024-03-09T15:11:09.176462+0000","last_undegraded":"2024-03-09T15:11:09.176462+0000","last_fullsized":"2024-03-09T15:11:09.176462+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:08:03.645545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2742,"num_read_kb":2524,"num_write":748,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'198","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:20.871802+0000","last_change":"2024-03-09T14:26:26.637200+0000","last_active":"2024-03-09T15:08:20.871802+0000","last_peered":"2024-03-09T15:08:20.871802+0000","last_clean":"2024-03-09T15:08:20.871802+0000","last_became_active":"2024-03-09T14:26:26.636600+0000","last_became_peered":"2024-03-09T14:26:26.636600+0000","last_unstale":"2024-03-09T15:08:20.871802+0000","last_undegraded":"2024-03-09T15:08:20.871802+0000","last_fullsized":"2024-03-09T15:08:20.871802+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:11:27.327284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2977557,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":472,"num_read_kb":15859,"num_write":1031,"num_write_kb":26682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.563142+0000","last_change":"2024-03-09T14:26:30.651345+0000","last_active":"2024-03-09T15:07:41.563142+0000","last_peered":"2024-03-09T15:07:41.563142+0000","last_clean":"2024-03-09T15:07:41.563142+0000","last_became_active":"2024-03-09T14:26:30.650852+0000","last_became_peered":"2024-03-09T14:26:30.650852+0000","last_unstale":"2024-03-09T15:07:41.563142+0000","last_undegraded":"2024-03-09T15:07:41.563142+0000","last_fullsized":"2024-03-09T15:07:41.563142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:55:54.919531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'148","reported_seq":726,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.494435+0000","last_change":"2024-03-09T14:26:32.655600+0000","last_active":"2024-03-09T15:11:36.494435+0000","last_peered":"2024-03-09T15:11:36.494435+0000","last_clean":"2024-03-09T15:11:36.494435+0000","last_became_active":"2024-03-09T14:26:32.655220+0000","last_became_peered":"2024-03-09T14:26:32.655220+0000","last_unstale":"2024-03-09T15:11:36.494435+0000","last_undegraded":"2024-03-09T15:11:36.494435+0000","last_fullsized":"2024-03-09T15:11:36.494435+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:09:44.324675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8881,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":189,"num_read_kb":206,"num_write":102,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.580477+0000","last_change":"2024-03-09T14:26:34.673862+0000","last_active":"2024-03-09T15:09:06.580477+0000","last_peered":"2024-03-09T15:09:06.580477+0000","last_clean":"2024-03-09T15:09:06.580477+0000","last_became_active":"2024-03-09T14:26:34.673572+0000","last_became_peered":"2024-03-09T14:26:34.673572+0000","last_unstale":"2024-03-09T15:09:06.580477+0000","last_undegraded":"2024-03-09T15:09:06.580477+0000","last_fullsized":"2024-03-09T15:09:06.580477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:59.420732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'131","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:46.595865+0000","last_change":"2024-03-09T14:26:36.668917+0000","last_active":"2024-03-09T15:08:46.595865+0000","last_peered":"2024-03-09T15:08:46.595865+0000","last_clean":"2024-03-09T15:08:46.595865+0000","last_became_active":"2024-03-09T14:26:36.668616+0000","last_became_peered":"2024-03-09T14:26:36.668616+0000","last_unstale":"2024-03-09T15:08:46.595865+0000","last_undegraded":"2024-03-09T15:08:46.595865+0000","last_fullsized":"2024-03-09T15:08:46.595865+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:54:43.806686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":154,"num_write":316,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'645","reported_seq":2232,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.865830+0000","last_change":"2024-03-09T14:26:28.645899+0000","last_active":"2024-03-09T15:11:07.865830+0000","last_peered":"2024-03-09T15:11:07.865830+0000","last_clean":"2024-03-09T15:11:07.865830+0000","last_became_active":"2024-03-09T14:26:28.645626+0000","last_became_peered":"2024-03-09T14:26:28.645626+0000","last_unstale":"2024-03-09T15:11:07.865830+0000","last_undegraded":"2024-03-09T15:11:07.865830+0000","last_fullsized":"2024-03-09T15:11:07.865830+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":600,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:57.043642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3206,"num_read_kb":2874,"num_write":967,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'165","reported_seq":768,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:46.079700+0000","last_change":"2024-03-09T14:26:26.652363+0000","last_active":"2024-03-09T15:09:46.079700+0000","last_peered":"2024-03-09T15:09:46.079700+0000","last_clean":"2024-03-09T15:09:46.079700+0000","last_became_active":"2024-03-09T14:26:26.652050+0000","last_became_peered":"2024-03-09T14:26:26.652050+0000","last_unstale":"2024-03-09T15:09:46.079700+0000","last_undegraded":"2024-03-09T15:09:46.079700+0000","last_fullsized":"2024-03-09T15:09:46.079700+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:42.844197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12023466,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":327,"num_read_kb":46066,"num_write":937,"num_write_kb":31825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'424","reported_seq":2029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.131178+0000","last_change":"2024-03-09T14:26:28.652919+0000","last_active":"2024-03-09T15:11:37.131178+0000","last_peered":"2024-03-09T15:11:37.131178+0000","last_clean":"2024-03-09T15:11:37.131178+0000","last_became_active":"2024-03-09T14:26:28.652474+0000","last_became_peered":"2024-03-09T14:26:28.652474+0000","last_unstale":"2024-03-09T15:11:37.131178+0000","last_undegraded":"2024-03-09T15:11:37.131178+0000","last_fullsized":"2024-03-09T15:11:37.131178+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:16:37.419231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2338,"num_read_kb":2225,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'228","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:24.914180+0000","last_change":"2024-03-09T14:26:26.636278+0000","last_active":"2024-03-09T15:11:24.914180+0000","last_peered":"2024-03-09T15:11:24.914180+0000","last_clean":"2024-03-09T15:11:24.914180+0000","last_became_active":"2024-03-09T14:26:26.635943+0000","last_became_peered":"2024-03-09T14:26:26.635943+0000","last_unstale":"2024-03-09T15:11:24.914180+0000","last_undegraded":"2024-03-09T15:11:24.914180+0000","last_fullsized":"2024-03-09T15:11:24.914180+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:16.699434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340097,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":21029,"num_write":1137,"num_write_kb":21105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'402","reported_seq":1826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.431048+0000","last_change":"2024-03-09T14:26:28.646197+0000","last_active":"2024-03-09T15:11:04.431048+0000","last_peered":"2024-03-09T15:11:04.431048+0000","last_clean":"2024-03-09T15:11:04.431048+0000","last_became_active":"2024-03-09T14:26:28.645917+0000","last_became_peered":"2024-03-09T14:26:28.645917+0000","last_unstale":"2024-03-09T15:11:04.431048+0000","last_undegraded":"2024-03-09T15:11:04.431048+0000","last_fullsized":"2024-03-09T15:11:04.431048+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:35.149765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2143,"num_read_kb":1999,"num_write":476,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'193","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:20.184684+0000","last_change":"2024-03-09T14:26:26.648411+0000","last_active":"2024-03-09T15:08:20.184684+0000","last_peered":"2024-03-09T15:08:20.184684+0000","last_clean":"2024-03-09T15:08:20.184684+0000","last_became_active":"2024-03-09T14:26:26.648084+0000","last_became_peered":"2024-03-09T14:26:26.648084+0000","last_unstale":"2024-03-09T15:08:20.184684+0000","last_undegraded":"2024-03-09T15:08:20.184684+0000","last_fullsized":"2024-03-09T15:08:20.184684+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:33.823275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7394875,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":451,"num_read_kb":30660,"num_write":1031,"num_write_kb":42042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'1285","reported_seq":2878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:27.537784+0000","last_change":"2024-03-09T14:26:28.647203+0000","last_active":"2024-03-09T15:09:27.537784+0000","last_peered":"2024-03-09T15:09:27.537784+0000","last_clean":"2024-03-09T15:09:27.537784+0000","last_became_active":"2024-03-09T14:26:28.646936+0000","last_became_peered":"2024-03-09T14:26:28.646936+0000","last_unstale":"2024-03-09T15:09:27.537784+0000","last_undegraded":"2024-03-09T15:09:27.537784+0000","last_fullsized":"2024-03-09T15:09:27.537784+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:30:25.079154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5472,"num_read_kb":4757,"num_write":1845,"num_write_kb":841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'169","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:58.674844+0000","last_change":"2024-03-09T14:26:26.632719+0000","last_active":"2024-03-09T15:08:58.674844+0000","last_peered":"2024-03-09T15:08:58.674844+0000","last_clean":"2024-03-09T15:08:58.674844+0000","last_became_active":"2024-03-09T14:26:26.632394+0000","last_became_peered":"2024-03-09T14:26:26.632394+0000","last_unstale":"2024-03-09T15:08:58.674844+0000","last_undegraded":"2024-03-09T15:08:58.674844+0000","last_fullsized":"2024-03-09T15:08:58.674844+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:11:31.631305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8412719,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":374,"num_read_kb":61859,"num_write":995,"num_write_kb":24366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'709","reported_seq":2155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.166230+0000","last_change":"2024-03-09T14:26:28.656837+0000","last_active":"2024-03-09T15:10:42.166230+0000","last_peered":"2024-03-09T15:10:42.166230+0000","last_clean":"2024-03-09T15:10:42.166230+0000","last_became_active":"2024-03-09T14:26:28.655549+0000","last_became_peered":"2024-03-09T14:26:28.655549+0000","last_unstale":"2024-03-09T15:10:42.166230+0000","last_undegraded":"2024-03-09T15:10:42.166230+0000","last_fullsized":"2024-03-09T15:10:42.166230+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:44.581756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3228,"num_read_kb":2913,"num_write":936,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'242","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:18.097684+0000","last_change":"2024-03-09T14:26:26.641172+0000","last_active":"2024-03-09T15:08:18.097684+0000","last_peered":"2024-03-09T15:08:18.097684+0000","last_clean":"2024-03-09T15:08:18.097684+0000","last_became_active":"2024-03-09T14:26:26.640874+0000","last_became_peered":"2024-03-09T14:26:26.640874+0000","last_unstale":"2024-03-09T15:08:18.097684+0000","last_undegraded":"2024-03-09T15:08:18.097684+0000","last_fullsized":"2024-03-09T15:08:18.097684+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:53:42.224141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6964972,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":546,"num_read_kb":47489,"num_write":1241,"num_write_kb":60004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'342","reported_seq":1774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.320525+0000","last_change":"2024-03-09T14:26:28.645684+0000","last_active":"2024-03-09T15:10:45.320525+0000","last_peered":"2024-03-09T15:10:45.320525+0000","last_clean":"2024-03-09T15:10:45.320525+0000","last_became_active":"2024-03-09T14:26:28.645393+0000","last_became_peered":"2024-03-09T14:26:28.645393+0000","last_unstale":"2024-03-09T15:10:45.320525+0000","last_undegraded":"2024-03-09T15:10:45.320525+0000","last_fullsized":"2024-03-09T15:10:45.320525+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:56.794238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1972,"num_read_kb":1873,"num_write":396,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'179","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.208070+0000","last_change":"2024-03-09T14:26:26.631389+0000","last_active":"2024-03-09T15:10:35.208070+0000","last_peered":"2024-03-09T15:10:35.208070+0000","last_clean":"2024-03-09T15:10:35.208070+0000","last_became_active":"2024-03-09T14:26:26.631046+0000","last_became_peered":"2024-03-09T14:26:26.631046+0000","last_unstale":"2024-03-09T15:10:35.208070+0000","last_undegraded":"2024-03-09T15:10:35.208070+0000","last_fullsized":"2024-03-09T15:10:35.208070+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:11:06.737937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7710007,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":457,"num_read_kb":18518,"num_write":1078,"num_write_kb":23654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'765","reported_seq":2186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.177793+0000","last_change":"2024-03-09T14:26:28.652220+0000","last_active":"2024-03-09T15:11:09.177793+0000","last_peered":"2024-03-09T15:11:09.177793+0000","last_clean":"2024-03-09T15:11:09.177793+0000","last_became_active":"2024-03-09T14:26:28.651945+0000","last_became_peered":"2024-03-09T14:26:28.651945+0000","last_unstale":"2024-03-09T15:11:09.177793+0000","last_undegraded":"2024-03-09T15:11:09.177793+0000","last_fullsized":"2024-03-09T15:11:09.177793+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:11.189515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3422,"num_read_kb":3025,"num_write":1046,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'207","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:00.970317+0000","last_change":"2024-03-09T14:26:26.645774+0000","last_active":"2024-03-09T15:11:00.970317+0000","last_peered":"2024-03-09T15:11:00.970317+0000","last_clean":"2024-03-09T15:11:00.970317+0000","last_became_active":"2024-03-09T14:26:26.645379+0000","last_became_peered":"2024-03-09T14:26:26.645379+0000","last_unstale":"2024-03-09T15:11:00.970317+0000","last_undegraded":"2024-03-09T15:11:00.970317+0000","last_fullsized":"2024-03-09T15:11:00.970317+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:29:31.655184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11989,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":544,"num_read_kb":953,"num_write":1104,"num_write_kb":19452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'1201","reported_seq":2796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.336817+0000","last_change":"2024-03-09T14:26:28.652319+0000","last_active":"2024-03-09T15:10:35.336817+0000","last_peered":"2024-03-09T15:10:35.336817+0000","last_clean":"2024-03-09T15:10:35.336817+0000","last_became_active":"2024-03-09T14:26:28.651254+0000","last_became_peered":"2024-03-09T14:26:28.651254+0000","last_unstale":"2024-03-09T15:10:35.336817+0000","last_undegraded":"2024-03-09T15:10:35.336817+0000","last_fullsized":"2024-03-09T15:10:35.336817+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":1100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:17:36.798177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5174,"num_read_kb":4521,"num_write":1709,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'209","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:50.564141+0000","last_change":"2024-03-09T14:26:26.640461+0000","last_active":"2024-03-09T15:09:50.564141+0000","last_peered":"2024-03-09T15:09:50.564141+0000","last_clean":"2024-03-09T15:09:50.564141+0000","last_became_active":"2024-03-09T14:26:26.639719+0000","last_became_peered":"2024-03-09T14:26:26.639719+0000","last_unstale":"2024-03-09T15:09:50.564141+0000","last_undegraded":"2024-03-09T15:09:50.564141+0000","last_fullsized":"2024-03-09T15:09:50.564141+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:52.609065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16421214,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":521,"num_read_kb":50172,"num_write":1164,"num_write_kb":33138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1152","reported_seq":2678,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.124689+0000","last_change":"2024-03-09T14:26:28.648946+0000","last_active":"2024-03-09T15:11:37.124689+0000","last_peered":"2024-03-09T15:11:37.124689+0000","last_clean":"2024-03-09T15:11:37.124689+0000","last_became_active":"2024-03-09T14:26:28.648626+0000","last_became_peered":"2024-03-09T14:26:28.648626+0000","last_unstale":"2024-03-09T15:11:37.124689+0000","last_undegraded":"2024-03-09T15:11:37.124689+0000","last_fullsized":"2024-03-09T15:11:37.124689+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:23:27.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4796,"num_read_kb":4189,"num_write":1590,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'182","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.006378+0000","last_change":"2024-03-09T14:26:26.640526+0000","last_active":"2024-03-09T15:11:37.006378+0000","last_peered":"2024-03-09T15:11:37.006378+0000","last_clean":"2024-03-09T15:11:37.006378+0000","last_became_active":"2024-03-09T14:26:26.640157+0000","last_became_peered":"2024-03-09T14:26:26.640157+0000","last_unstale":"2024-03-09T15:11:37.006378+0000","last_undegraded":"2024-03-09T15:11:37.006378+0000","last_fullsized":"2024-03-09T15:11:37.006378+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:22.974524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5571611,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":437,"num_read_kb":19255,"num_write":998,"num_write_kb":28212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'708","reported_seq":2134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.078327+0000","last_change":"2024-03-09T14:26:28.650311+0000","last_active":"2024-03-09T15:10:51.078327+0000","last_peered":"2024-03-09T15:10:51.078327+0000","last_clean":"2024-03-09T15:10:51.078327+0000","last_became_active":"2024-03-09T14:26:28.650013+0000","last_became_peered":"2024-03-09T14:26:28.650013+0000","last_unstale":"2024-03-09T15:10:51.078327+0000","last_undegraded":"2024-03-09T15:10:51.078327+0000","last_fullsized":"2024-03-09T15:10:51.078327+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":600,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:26.543324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3189,"num_read_kb":2865,"num_write":935,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'206","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.469017+0000","last_change":"2024-03-09T14:26:26.642035+0000","last_active":"2024-03-09T15:10:36.469017+0000","last_peered":"2024-03-09T15:10:36.469017+0000","last_clean":"2024-03-09T15:10:36.469017+0000","last_became_active":"2024-03-09T14:26:26.641737+0000","last_became_peered":"2024-03-09T14:26:26.641737+0000","last_unstale":"2024-03-09T15:10:36.469017+0000","last_undegraded":"2024-03-09T15:10:36.469017+0000","last_fullsized":"2024-03-09T15:10:36.469017+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:42:55.138498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5853727,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":491,"num_read_kb":32584,"num_write":1132,"num_write_kb":28426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'421","reported_seq":2053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.552733+0000","last_change":"2024-03-09T14:26:28.644372+0000","last_active":"2024-03-09T15:10:54.552733+0000","last_peered":"2024-03-09T15:10:54.552733+0000","last_clean":"2024-03-09T15:10:54.552733+0000","last_became_active":"2024-03-09T14:26:28.644094+0000","last_became_peered":"2024-03-09T14:26:28.644094+0000","last_unstale":"2024-03-09T15:10:54.552733+0000","last_undegraded":"2024-03-09T15:10:54.552733+0000","last_fullsized":"2024-03-09T15:10:54.552733+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:42.631901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2230,"num_write":484,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'211","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:11.583745+0000","last_change":"2024-03-09T14:26:26.645771+0000","last_active":"2024-03-09T15:09:11.583745+0000","last_peered":"2024-03-09T15:09:11.583745+0000","last_clean":"2024-03-09T15:09:11.583745+0000","last_became_active":"2024-03-09T14:26:26.645413+0000","last_became_peered":"2024-03-09T14:26:26.645413+0000","last_unstale":"2024-03-09T15:09:11.583745+0000","last_undegraded":"2024-03-09T15:09:11.583745+0000","last_fullsized":"2024-03-09T15:09:11.583745+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:23:25.742745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269833,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":456,"num_read_kb":3495,"num_write":1053,"num_write_kb":12293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'790","reported_seq":2457,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.600171+0000","last_change":"2024-03-09T14:26:28.650961+0000","last_active":"2024-03-09T15:09:16.600171+0000","last_peered":"2024-03-09T15:09:16.600171+0000","last_clean":"2024-03-09T15:09:16.600171+0000","last_became_active":"2024-03-09T14:26:28.650629+0000","last_became_peered":"2024-03-09T14:26:28.650629+0000","last_unstale":"2024-03-09T15:09:16.600171+0000","last_undegraded":"2024-03-09T15:09:16.600171+0000","last_fullsized":"2024-03-09T15:09:16.600171+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:53:42.426447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3842,"num_read_kb":3483,"num_write":1039,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'230","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:11.580982+0000","last_change":"2024-03-09T14:26:26.644786+0000","last_active":"2024-03-09T15:09:11.580982+0000","last_peered":"2024-03-09T15:09:11.580982+0000","last_clean":"2024-03-09T15:09:11.580982+0000","last_became_active":"2024-03-09T14:26:26.644358+0000","last_became_peered":"2024-03-09T14:26:26.644358+0000","last_unstale":"2024-03-09T15:09:11.580982+0000","last_undegraded":"2024-03-09T15:09:11.580982+0000","last_fullsized":"2024-03-09T15:09:11.580982+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:25:50.487416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11881660,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":7434,"num_write":1300,"num_write_kb":33527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'509","reported_seq":2075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.121732+0000","last_change":"2024-03-09T14:26:28.655751+0000","last_active":"2024-03-09T15:11:37.121732+0000","last_peered":"2024-03-09T15:11:37.121732+0000","last_clean":"2024-03-09T15:11:37.121732+0000","last_became_active":"2024-03-09T14:26:28.655438+0000","last_became_peered":"2024-03-09T14:26:28.655438+0000","last_unstale":"2024-03-09T15:11:37.121732+0000","last_undegraded":"2024-03-09T15:11:37.121732+0000","last_fullsized":"2024-03-09T15:11:37.121732+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:20:48.282049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2613,"num_read_kb":2408,"num_write":650,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'181","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.493354+0000","last_change":"2024-03-09T14:26:26.649089+0000","last_active":"2024-03-09T15:11:26.493354+0000","last_peered":"2024-03-09T15:11:26.493354+0000","last_clean":"2024-03-09T15:11:26.493354+0000","last_became_active":"2024-03-09T14:26:26.648682+0000","last_became_peered":"2024-03-09T14:26:26.648682+0000","last_unstale":"2024-03-09T15:11:26.493354+0000","last_undegraded":"2024-03-09T15:11:26.493354+0000","last_fullsized":"2024-03-09T15:11:26.493354+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:54:12.434919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2164234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":6066,"num_write":1000,"num_write_kb":27510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'408","reported_seq":2014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.553857+0000","last_change":"2024-03-09T14:26:28.646581+0000","last_active":"2024-03-09T15:10:54.553857+0000","last_peered":"2024-03-09T15:10:54.553857+0000","last_clean":"2024-03-09T15:10:54.553857+0000","last_became_active":"2024-03-09T14:26:28.646239+0000","last_became_peered":"2024-03-09T14:26:28.646239+0000","last_unstale":"2024-03-09T15:10:54.553857+0000","last_undegraded":"2024-03-09T15:10:54.553857+0000","last_fullsized":"2024-03-09T15:10:54.553857+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:05.491938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2327,"num_read_kb":2213,"num_write":484,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'211","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.721377+0000","last_change":"2024-03-09T14:26:26.646103+0000","last_active":"2024-03-09T15:09:16.721377+0000","last_peered":"2024-03-09T15:09:16.721377+0000","last_clean":"2024-03-09T15:09:16.721377+0000","last_became_active":"2024-03-09T14:26:26.645230+0000","last_became_peered":"2024-03-09T14:26:26.645230+0000","last_unstale":"2024-03-09T15:09:16.721377+0000","last_undegraded":"2024-03-09T15:09:16.721377+0000","last_fullsized":"2024-03-09T15:09:16.721377+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:46:59.836355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7622315,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":431,"num_read_kb":27386,"num_write":1082,"num_write_kb":24817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'342","reported_seq":1816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.357304+0000","last_change":"2024-03-09T14:26:28.653452+0000","last_active":"2024-03-09T15:10:35.357304+0000","last_peered":"2024-03-09T15:10:35.357304+0000","last_clean":"2024-03-09T15:10:35.357304+0000","last_became_active":"2024-03-09T14:26:28.653177+0000","last_became_peered":"2024-03-09T14:26:28.653177+0000","last_unstale":"2024-03-09T15:10:35.357304+0000","last_undegraded":"2024-03-09T15:10:35.357304+0000","last_fullsized":"2024-03-09T15:10:35.357304+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:12:43.827174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1954,"num_read_kb":1880,"num_write":380,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'192","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.563634+0000","last_change":"2024-03-09T14:26:26.637956+0000","last_active":"2024-03-09T15:08:26.563634+0000","last_peered":"2024-03-09T15:08:26.563634+0000","last_clean":"2024-03-09T15:08:26.563634+0000","last_became_active":"2024-03-09T14:26:26.637589+0000","last_became_peered":"2024-03-09T14:26:26.637589+0000","last_unstale":"2024-03-09T15:08:26.563634+0000","last_undegraded":"2024-03-09T15:08:26.563634+0000","last_fullsized":"2024-03-09T15:08:26.563634+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:33.711328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10750031,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":377,"num_read_kb":13354,"num_write":1021,"num_write_kb":55720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'1151","reported_seq":2610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.127436+0000","last_change":"2024-03-09T14:26:28.655806+0000","last_active":"2024-03-09T15:11:37.127436+0000","last_peered":"2024-03-09T15:11:37.127436+0000","last_clean":"2024-03-09T15:11:37.127436+0000","last_became_active":"2024-03-09T14:26:28.655383+0000","last_became_peered":"2024-03-09T14:26:28.655383+0000","last_unstale":"2024-03-09T15:11:37.127436+0000","last_undegraded":"2024-03-09T15:11:37.127436+0000","last_fullsized":"2024-03-09T15:11:37.127436+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:09:15.464868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4791,"num_read_kb":4166,"num_write":1605,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'228","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.578230+0000","last_change":"2024-03-09T14:26:26.653398+0000","last_active":"2024-03-09T15:08:26.578230+0000","last_peered":"2024-03-09T15:08:26.578230+0000","last_clean":"2024-03-09T15:08:26.578230+0000","last_became_active":"2024-03-09T14:26:26.652576+0000","last_became_peered":"2024-03-09T14:26:26.652576+0000","last_unstale":"2024-03-09T15:08:26.578230+0000","last_undegraded":"2024-03-09T15:08:26.578230+0000","last_fullsized":"2024-03-09T15:08:26.578230+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:27:29.674744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3830168,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":651,"num_read_kb":5204,"num_write":1019,"num_write_kb":18451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'311","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.578116+0000","last_change":"2024-03-09T14:27:03.716194+0000","last_active":"2024-03-09T15:08:26.578116+0000","last_peered":"2024-03-09T15:08:26.578116+0000","last_clean":"2024-03-09T15:08:26.578116+0000","last_became_active":"2024-03-09T14:27:03.715719+0000","last_became_peered":"2024-03-09T14:27:03.715719+0000","last_unstale":"2024-03-09T15:08:26.578116+0000","last_undegraded":"2024-03-09T15:08:26.578116+0000","last_fullsized":"2024-03-09T15:08:26.578116+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:14.860709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11557044,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":835,"num_read_kb":60306,"num_write":1283,"num_write_kb":31608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'792","reported_seq":2406,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.338529+0000","last_change":"2024-03-09T14:26:28.649429+0000","last_active":"2024-03-09T15:10:35.338529+0000","last_peered":"2024-03-09T15:10:35.338529+0000","last_clean":"2024-03-09T15:10:35.338529+0000","last_became_active":"2024-03-09T14:26:28.649178+0000","last_became_peered":"2024-03-09T14:26:28.649178+0000","last_unstale":"2024-03-09T15:10:35.338529+0000","last_undegraded":"2024-03-09T15:10:35.338529+0000","last_fullsized":"2024-03-09T15:10:35.338529+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:22:23.602537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3684,"num_read_kb":3311,"num_write":1055,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'185","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.568496+0000","last_change":"2024-03-09T14:27:03.721922+0000","last_active":"2024-03-09T15:08:26.568496+0000","last_peered":"2024-03-09T15:08:26.568496+0000","last_clean":"2024-03-09T15:08:26.568496+0000","last_became_active":"2024-03-09T14:27:03.721595+0000","last_became_peered":"2024-03-09T14:27:03.721595+0000","last_unstale":"2024-03-09T15:08:26.568496+0000","last_undegraded":"2024-03-09T15:08:26.568496+0000","last_fullsized":"2024-03-09T15:08:26.568496+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:37:54.615568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12408196,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":487,"num_read_kb":112993,"num_write":1047,"num_write_kb":48480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'387","reported_seq":2043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.590524+0000","last_change":"2024-03-09T14:26:28.645372+0000","last_active":"2024-03-09T15:10:36.590524+0000","last_peered":"2024-03-09T15:10:36.590524+0000","last_clean":"2024-03-09T15:10:36.590524+0000","last_became_active":"2024-03-09T14:26:28.645067+0000","last_became_peered":"2024-03-09T14:26:28.645067+0000","last_unstale":"2024-03-09T15:10:36.590524+0000","last_undegraded":"2024-03-09T15:10:36.590524+0000","last_fullsized":"2024-03-09T15:10:36.590524+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:44:56.178003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2475,"num_read_kb":2383,"num_write":438,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5887,"num_read_kb":4246,"num_write":2185,"num_write_kb":841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1217,"ondisk_log_size":1217,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":12946,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":15495,"num_read_kb":15279,"num_write":16228,"num_write_kb":4747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":507904,"data_stored":25892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1762,"ondisk_log_size":1762,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":408,"ondisk_log_size":408,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":438641,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":7752,"num_read_kb":9480,"num_write":5539,"num_write_kb":2830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":770048,"data_stored":239200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2159,"ondisk_log_size":2159,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1583,"num_read_kb":1885,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":195183,"num_read_kb":178329,"num_write":51691,"num_write_kb":17736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":121,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3837,"ondisk_log_size":3837,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":554823561,"num_objects":519,"num_object_clones":0,"num_object_copies":1557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":519,"num_whiteouts":0,"num_read":32040,"num_read_kb":2319153,"num_write":69560,"num_write_kb":2158516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":835055616,"data_stored":835055616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4404,"ondisk_log_size":4404,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":89222774,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":133,"num_read_kb":164063,"num_write":151,"num_write_kb":125047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":178454528,"data_stored":178445548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":89222774,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":139,"num_read_kb":183429,"num_write":151,"num_write_kb":125047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":178454528,"data_stored":178445548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575400,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444216,"kb_used_data":174256,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93927624,"statfs":{"total":96636764160,"available":96181886976,"internally_reserved":0,"allocated":178438144,"data_stored":176418466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575399,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378896,"kb_used_data":122824,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93992944,"statfs":{"total":96636764160,"available":96248774656,"internally_reserved":0,"allocated":125771776,"data_stored":123793256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575400,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241656,"kb_used_data":156336,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94130184,"statfs":{"total":96636764160,"available":96389308416,"internally_reserved":0,"allocated":160088064,"data_stored":158047167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575398,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":234120,"kb_used_data":148800,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94137720,"statfs":{"total":96636764160,"available":96397025280,"internally_reserved":0,"allocated":152371200,"data_stored":150461065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575399,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409320,"kb_used_data":175456,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93962520,"statfs":{"total":96636764160,"available":96217620480,"internally_reserved":0,"allocated":179666944,"data_stored":177639659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575398,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":210328,"kb_used_data":138896,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94161512,"statfs":{"total":96636764160,"available":96421388288,"internally_reserved":0,"allocated":142229504,"data_stored":140290947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575399,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272976,"kb_used_data":151624,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94098864,"statfs":{"total":96636764160,"available":96357236736,"internally_reserved":0,"allocated":155262976,"data_stored":153295586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575399,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368572,"kb_used_data":130548,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94003268,"statfs":{"total":96636764160,"available":96259346432,"internally_reserved":0,"allocated":133681152,"data_stored":131671448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93069312,"data_stored":93069312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":112103424,"data_stored":112103424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":92852224,"data_stored":92852224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106057728,"data_stored":106057728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":118755328,"data_stored":118755328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":100155392,"data_stored":100155392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":92041216,"data_stored":92041216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":120020992,"data_stored":120020992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":27934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":30982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":16269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":39607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":12830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":35670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":27123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":48785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18927616,"data_stored":18924827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18919424,"data_stored":18917723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19980288,"data_stored":19976613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34603008,"data_stored":34603008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15769600,"data_stored":15768785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19963904,"data_stored":19963089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32559104,"data_stored":32556315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":47243264,"data_stored":47239589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13676544,"data_stored":13674843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:11:46.491 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:11:46.822 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:46.835 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-03-09T15:11:46.837 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":1624,"stamp":"2024-03-09T15:11:45.532585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":734312783,"num_objects":1010,"num_object_clones":0,"num_object_copies":2539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1010,"num_whiteouts":0,"num_read":258340,"num_read_kb":2875976,"num_write":145702,"num_write_kb":2437205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":166,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14017,"ondisk_log_size":14017,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2560084,"kb_used_data":1198740,"kb_used_omap":12,"kb_used_meta":1361267,"kb_avail":752414636,"statfs":{"total":773094113280,"available":770472587264,"internally_reserved":0,"allocated":1227509760,"data_stored":1211617594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1393937968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4193250,"num_objects":-18,"num_object_clones":0,"num_object_copies":-37,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":189,"num_read_kb":10494,"num_write":42,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005623"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.575812+0000","last_change":"2024-03-09T14:50:35.506808+0000","last_active":"2024-03-09T15:08:06.575812+0000","last_peered":"2024-03-09T15:08:06.575812+0000","last_clean":"2024-03-09T15:08:06.575812+0000","last_became_active":"2024-03-09T14:50:35.506543+0000","last_became_peered":"2024-03-09T14:50:35.506543+0000","last_unstale":"2024-03-09T15:08:06.575812+0000","last_undegraded":"2024-03-09T15:08:06.575812+0000","last_fullsized":"2024-03-09T15:08:06.575812+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:58.593691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.579403+0000","last_change":"2024-03-09T14:38:37.436681+0000","last_active":"2024-03-09T15:08:36.579403+0000","last_peered":"2024-03-09T15:08:36.579403+0000","last_clean":"2024-03-09T15:08:36.579403+0000","last_became_active":"2024-03-09T14:38:37.436381+0000","last_became_peered":"2024-03-09T14:38:37.436381+0000","last_unstale":"2024-03-09T15:08:36.579403+0000","last_undegraded":"2024-03-09T15:08:36.579403+0000","last_fullsized":"2024-03-09T15:08:36.579403+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:00:43.470078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'4","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.679815+0000","last_change":"2024-03-09T14:38:34.419017+0000","last_active":"2024-03-09T15:08:36.679815+0000","last_peered":"2024-03-09T15:08:36.679815+0000","last_clean":"2024-03-09T15:08:36.679815+0000","last_became_active":"2024-03-09T14:38:34.418748+0000","last_became_peered":"2024-03-09T14:38:34.418748+0000","last_unstale":"2024-03-09T15:08:36.679815+0000","last_undegraded":"2024-03-09T15:08:36.679815+0000","last_fullsized":"2024-03-09T15:08:36.679815+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:59:58.574754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'22","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.579987+0000","last_change":"2024-03-09T14:35:41.122537+0000","last_active":"2024-03-09T15:09:01.579987+0000","last_peered":"2024-03-09T15:09:01.579987+0000","last_clean":"2024-03-09T15:09:01.579987+0000","last_became_active":"2024-03-09T14:35:41.121412+0000","last_became_peered":"2024-03-09T14:35:41.121412+0000","last_unstale":"2024-03-09T15:09:01.579987+0000","last_undegraded":"2024-03-09T15:09:01.579987+0000","last_fullsized":"2024-03-09T15:09:01.579987+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:26:10.508823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":67,"num_write":35,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.561315+0000","last_change":"2024-03-09T14:50:35.507193+0000","last_active":"2024-03-09T15:08:06.561315+0000","last_peered":"2024-03-09T15:08:06.561315+0000","last_clean":"2024-03-09T15:08:06.561315+0000","last_became_active":"2024-03-09T14:50:35.506905+0000","last_became_peered":"2024-03-09T14:50:35.506905+0000","last_unstale":"2024-03-09T15:08:06.561315+0000","last_undegraded":"2024-03-09T15:08:06.561315+0000","last_fullsized":"2024-03-09T15:08:06.561315+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:36:12.492461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.594554+0000","last_change":"2024-03-09T14:38:37.440992+0000","last_active":"2024-03-09T15:08:36.594554+0000","last_peered":"2024-03-09T15:08:36.594554+0000","last_clean":"2024-03-09T15:08:36.594554+0000","last_became_active":"2024-03-09T14:38:37.440733+0000","last_became_peered":"2024-03-09T14:38:37.440733+0000","last_unstale":"2024-03-09T15:08:36.594554+0000","last_undegraded":"2024-03-09T15:08:36.594554+0000","last_fullsized":"2024-03-09T15:08:36.594554+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:32:36.858145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'4","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.569798+0000","last_change":"2024-03-09T14:38:34.426397+0000","last_active":"2024-03-09T15:08:36.569798+0000","last_peered":"2024-03-09T15:08:36.569798+0000","last_clean":"2024-03-09T15:08:36.569798+0000","last_became_active":"2024-03-09T14:38:34.425629+0000","last_became_peered":"2024-03-09T14:38:34.425629+0000","last_unstale":"2024-03-09T15:08:36.569798+0000","last_undegraded":"2024-03-09T15:08:36.569798+0000","last_fullsized":"2024-03-09T15:08:36.569798+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:05.228490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'52","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.559699+0000","last_change":"2024-03-09T14:35:41.118142+0000","last_active":"2024-03-09T15:07:51.559699+0000","last_peered":"2024-03-09T15:07:51.559699+0000","last_clean":"2024-03-09T15:07:51.559699+0000","last_became_active":"2024-03-09T14:35:41.117858+0000","last_became_peered":"2024-03-09T14:35:41.117858+0000","last_unstale":"2024-03-09T15:07:51.559699+0000","last_undegraded":"2024-03-09T15:07:51.559699+0000","last_fullsized":"2024-03-09T15:07:51.559699+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:33:55.309111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":156,"num_write":85,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.585850+0000","last_change":"2024-03-09T14:50:35.506417+0000","last_active":"2024-03-09T15:07:31.585850+0000","last_peered":"2024-03-09T15:07:31.585850+0000","last_clean":"2024-03-09T15:07:31.585850+0000","last_became_active":"2024-03-09T14:50:35.506136+0000","last_became_peered":"2024-03-09T14:50:35.506136+0000","last_unstale":"2024-03-09T15:07:31.585850+0000","last_undegraded":"2024-03-09T15:07:31.585850+0000","last_fullsized":"2024-03-09T15:07:31.585850+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:25:26.999053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"261'9","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.571362+0000","last_change":"2024-03-09T14:38:37.443197+0000","last_active":"2024-03-09T15:07:46.571362+0000","last_peered":"2024-03-09T15:07:46.571362+0000","last_clean":"2024-03-09T15:07:46.571362+0000","last_became_active":"2024-03-09T14:38:37.442906+0000","last_became_peered":"2024-03-09T14:38:37.442906+0000","last_unstale":"2024-03-09T15:07:46.571362+0000","last_undegraded":"2024-03-09T15:07:46.571362+0000","last_fullsized":"2024-03-09T15:07:46.571362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:32:22.327056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":8196,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:46.566095+0000","last_change":"2024-03-09T14:38:34.425940+0000","last_active":"2024-03-09T15:08:46.566095+0000","last_peered":"2024-03-09T15:08:46.566095+0000","last_clean":"2024-03-09T15:08:46.566095+0000","last_became_active":"2024-03-09T14:38:34.425459+0000","last_became_peered":"2024-03-09T14:38:34.425459+0000","last_unstale":"2024-03-09T15:08:46.566095+0000","last_undegraded":"2024-03-09T15:08:46.566095+0000","last_fullsized":"2024-03-09T15:08:46.566095+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:37:12.404902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"261'16","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.574184+0000","last_change":"2024-03-09T14:35:41.123438+0000","last_active":"2024-03-09T15:08:11.574184+0000","last_peered":"2024-03-09T15:08:11.574184+0000","last_clean":"2024-03-09T15:08:11.574184+0000","last_became_active":"2024-03-09T14:35:41.123171+0000","last_became_peered":"2024-03-09T14:35:41.123171+0000","last_unstale":"2024-03-09T15:08:11.574184+0000","last_undegraded":"2024-03-09T15:08:11.574184+0000","last_fullsized":"2024-03-09T15:08:11.574184+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:41:36.543762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":56,"num_write":23,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.670756+0000","last_change":"2024-03-09T14:50:35.503396+0000","last_active":"2024-03-09T15:07:31.670756+0000","last_peered":"2024-03-09T15:07:31.670756+0000","last_clean":"2024-03-09T15:07:31.670756+0000","last_became_active":"2024-03-09T14:50:35.503090+0000","last_became_peered":"2024-03-09T14:50:35.503090+0000","last_unstale":"2024-03-09T15:07:31.670756+0000","last_undegraded":"2024-03-09T15:07:31.670756+0000","last_fullsized":"2024-03-09T15:07:31.670756+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:41:04.564051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'1","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.680879+0000","last_change":"2024-03-09T14:38:37.432464+0000","last_active":"2024-03-09T15:08:41.680879+0000","last_peered":"2024-03-09T15:08:41.680879+0000","last_clean":"2024-03-09T15:08:41.680879+0000","last_became_active":"2024-03-09T14:38:37.432089+0000","last_became_peered":"2024-03-09T14:38:37.432089+0000","last_unstale":"2024-03-09T15:08:41.680879+0000","last_undegraded":"2024-03-09T15:08:41.680879+0000","last_fullsized":"2024-03-09T15:08:41.680879+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:57:20.656020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'1","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588329+0000","last_change":"2024-03-09T14:38:34.417315+0000","last_active":"2024-03-09T15:07:46.588329+0000","last_peered":"2024-03-09T15:07:46.588329+0000","last_clean":"2024-03-09T15:07:46.588329+0000","last_became_active":"2024-03-09T14:38:34.417024+0000","last_became_peered":"2024-03-09T14:38:34.417024+0000","last_unstale":"2024-03-09T15:07:46.588329+0000","last_undegraded":"2024-03-09T15:07:46.588329+0000","last_fullsized":"2024-03-09T15:07:46.588329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:49:02.652837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'52","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.675909+0000","last_change":"2024-03-09T14:35:41.119245+0000","last_active":"2024-03-09T15:08:11.675909+0000","last_peered":"2024-03-09T15:08:11.675909+0000","last_clean":"2024-03-09T15:08:11.675909+0000","last_became_active":"2024-03-09T14:35:41.118960+0000","last_became_peered":"2024-03-09T14:35:41.118960+0000","last_unstale":"2024-03-09T15:08:11.675909+0000","last_undegraded":"2024-03-09T15:08:11.675909+0000","last_fullsized":"2024-03-09T15:08:11.675909+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:37.838048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":146,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.680090+0000","last_change":"2024-03-09T14:50:35.513378+0000","last_active":"2024-03-09T15:08:36.680090+0000","last_peered":"2024-03-09T15:08:36.680090+0000","last_clean":"2024-03-09T15:08:36.680090+0000","last_became_active":"2024-03-09T14:50:35.512534+0000","last_became_peered":"2024-03-09T14:50:35.512534+0000","last_unstale":"2024-03-09T15:08:36.680090+0000","last_undegraded":"2024-03-09T15:08:36.680090+0000","last_fullsized":"2024-03-09T15:08:36.680090+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:42:59.375192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.572976+0000","last_change":"2024-03-09T14:38:37.437102+0000","last_active":"2024-03-09T15:07:41.572976+0000","last_peered":"2024-03-09T15:07:41.572976+0000","last_clean":"2024-03-09T15:07:41.572976+0000","last_became_active":"2024-03-09T14:38:37.436829+0000","last_became_peered":"2024-03-09T14:38:37.436829+0000","last_unstale":"2024-03-09T15:07:41.572976+0000","last_undegraded":"2024-03-09T15:07:41.572976+0000","last_fullsized":"2024-03-09T15:07:41.572976+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:50:39.916587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'4","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.569979+0000","last_change":"2024-03-09T14:38:34.418873+0000","last_active":"2024-03-09T15:07:36.569979+0000","last_peered":"2024-03-09T15:07:36.569979+0000","last_clean":"2024-03-09T15:07:36.569979+0000","last_became_active":"2024-03-09T14:38:34.418209+0000","last_became_peered":"2024-03-09T14:38:34.418209+0000","last_unstale":"2024-03-09T15:07:36.569979+0000","last_undegraded":"2024-03-09T15:07:36.569979+0000","last_fullsized":"2024-03-09T15:07:36.569979+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:50.765837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099035,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6194,"num_write":4,"num_write_kb":5170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'22","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.675884+0000","last_change":"2024-03-09T14:35:41.123984+0000","last_active":"2024-03-09T15:08:11.675884+0000","last_peered":"2024-03-09T15:08:11.675884+0000","last_clean":"2024-03-09T15:08:11.675884+0000","last_became_active":"2024-03-09T14:35:41.123715+0000","last_became_peered":"2024-03-09T14:35:41.123715+0000","last_unstale":"2024-03-09T15:08:11.675884+0000","last_undegraded":"2024-03-09T15:08:11.675884+0000","last_fullsized":"2024-03-09T15:08:11.675884+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:09:46.063200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":62,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.574433+0000","last_change":"2024-03-09T14:50:35.510228+0000","last_active":"2024-03-09T15:09:21.574433+0000","last_peered":"2024-03-09T15:09:21.574433+0000","last_clean":"2024-03-09T15:09:21.574433+0000","last_became_active":"2024-03-09T14:50:35.509938+0000","last_became_peered":"2024-03-09T14:50:35.509938+0000","last_unstale":"2024-03-09T15:09:21.574433+0000","last_undegraded":"2024-03-09T15:09:21.574433+0000","last_fullsized":"2024-03-09T15:09:21.574433+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:07:27.212874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.586636+0000","last_change":"2024-03-09T14:38:37.439503+0000","last_active":"2024-03-09T15:07:36.586636+0000","last_peered":"2024-03-09T15:07:36.586636+0000","last_clean":"2024-03-09T15:07:36.586636+0000","last_became_active":"2024-03-09T14:38:37.439120+0000","last_became_peered":"2024-03-09T14:38:37.439120+0000","last_unstale":"2024-03-09T15:07:36.586636+0000","last_undegraded":"2024-03-09T15:07:36.586636+0000","last_fullsized":"2024-03-09T15:07:36.586636+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:27:16.750464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'4","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588215+0000","last_change":"2024-03-09T14:38:34.418823+0000","last_active":"2024-03-09T15:07:46.588215+0000","last_peered":"2024-03-09T15:07:46.588215+0000","last_clean":"2024-03-09T15:07:46.588215+0000","last_became_active":"2024-03-09T14:38:34.418553+0000","last_became_peered":"2024-03-09T14:38:34.418553+0000","last_unstale":"2024-03-09T15:07:46.588215+0000","last_undegraded":"2024-03-09T15:07:46.588215+0000","last_fullsized":"2024-03-09T15:07:46.588215+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:14.699597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'47","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591412+0000","last_change":"2024-03-09T14:35:41.124086+0000","last_active":"2024-03-09T15:08:11.591412+0000","last_peered":"2024-03-09T15:08:11.591412+0000","last_clean":"2024-03-09T15:08:11.591412+0000","last_became_active":"2024-03-09T14:35:41.123785+0000","last_became_peered":"2024-03-09T14:35:41.123785+0000","last_unstale":"2024-03-09T15:08:11.591412+0000","last_undegraded":"2024-03-09T15:08:11.591412+0000","last_fullsized":"2024-03-09T15:08:11.591412+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:48:27.983405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":141,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.711751+0000","last_change":"2024-03-09T14:50:35.500344+0000","last_active":"2024-03-09T15:08:06.711751+0000","last_peered":"2024-03-09T15:08:06.711751+0000","last_clean":"2024-03-09T15:08:06.711751+0000","last_became_active":"2024-03-09T14:50:35.499942+0000","last_became_peered":"2024-03-09T14:50:35.499942+0000","last_unstale":"2024-03-09T15:08:06.711751+0000","last_undegraded":"2024-03-09T15:08:06.711751+0000","last_fullsized":"2024-03-09T15:08:06.711751+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:47:17.395153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.594512+0000","last_change":"2024-03-09T14:38:37.438111+0000","last_active":"2024-03-09T15:08:36.594512+0000","last_peered":"2024-03-09T15:08:36.594512+0000","last_clean":"2024-03-09T15:08:36.594512+0000","last_became_active":"2024-03-09T14:38:37.437714+0000","last_became_peered":"2024-03-09T14:38:37.437714+0000","last_unstale":"2024-03-09T15:08:36.594512+0000","last_undegraded":"2024-03-09T15:08:36.594512+0000","last_fullsized":"2024-03-09T15:08:36.594512+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:33.290321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'1","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.594465+0000","last_change":"2024-03-09T14:38:34.420968+0000","last_active":"2024-03-09T15:08:36.594465+0000","last_peered":"2024-03-09T15:08:36.594465+0000","last_clean":"2024-03-09T15:08:36.594465+0000","last_became_active":"2024-03-09T14:38:34.420232+0000","last_became_peered":"2024-03-09T14:38:34.420232+0000","last_unstale":"2024-03-09T15:08:36.594465+0000","last_undegraded":"2024-03-09T15:08:36.594465+0000","last_fullsized":"2024-03-09T15:08:36.594465+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:19.316094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'24","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.567871+0000","last_change":"2024-03-09T14:35:41.121844+0000","last_active":"2024-03-09T15:07:16.567871+0000","last_peered":"2024-03-09T15:07:16.567871+0000","last_clean":"2024-03-09T15:07:16.567871+0000","last_became_active":"2024-03-09T14:35:41.121566+0000","last_became_peered":"2024-03-09T14:35:41.121566+0000","last_unstale":"2024-03-09T15:07:16.567871+0000","last_undegraded":"2024-03-09T15:07:16.567871+0000","last_fullsized":"2024-03-09T15:07:16.567871+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:48.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.711796+0000","last_change":"2024-03-09T14:50:35.501732+0000","last_active":"2024-03-09T15:08:06.711796+0000","last_peered":"2024-03-09T15:08:06.711796+0000","last_clean":"2024-03-09T15:08:06.711796+0000","last_became_active":"2024-03-09T14:50:35.501422+0000","last_became_peered":"2024-03-09T14:50:35.501422+0000","last_unstale":"2024-03-09T15:08:06.711796+0000","last_undegraded":"2024-03-09T15:08:06.711796+0000","last_fullsized":"2024-03-09T15:08:06.711796+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:51:45.968049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.679731+0000","last_change":"2024-03-09T14:38:37.438996+0000","last_active":"2024-03-09T15:08:36.679731+0000","last_peered":"2024-03-09T15:08:36.679731+0000","last_clean":"2024-03-09T15:08:36.679731+0000","last_became_active":"2024-03-09T14:38:37.438685+0000","last_became_peered":"2024-03-09T14:38:37.438685+0000","last_unstale":"2024-03-09T15:08:36.679731+0000","last_undegraded":"2024-03-09T15:08:36.679731+0000","last_fullsized":"2024-03-09T15:08:36.679731+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:52:54.773763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.577053+0000","last_change":"2024-03-09T14:38:34.422906+0000","last_active":"2024-03-09T15:08:36.577053+0000","last_peered":"2024-03-09T15:08:36.577053+0000","last_clean":"2024-03-09T15:08:36.577053+0000","last_became_active":"2024-03-09T14:38:34.422607+0000","last_became_peered":"2024-03-09T14:38:34.422607+0000","last_unstale":"2024-03-09T15:08:36.577053+0000","last_undegraded":"2024-03-09T15:08:36.577053+0000","last_fullsized":"2024-03-09T15:08:36.577053+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:57.914098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'68","reported_seq":223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:06.559342+0000","last_change":"2024-03-09T14:35:41.123207+0000","last_active":"2024-03-09T15:07:06.559342+0000","last_peered":"2024-03-09T15:07:06.559342+0000","last_clean":"2024-03-09T15:07:06.559342+0000","last_became_active":"2024-03-09T14:35:41.122898+0000","last_became_peered":"2024-03-09T14:35:41.122898+0000","last_unstale":"2024-03-09T15:07:06.559342+0000","last_undegraded":"2024-03-09T15:07:06.559342+0000","last_fullsized":"2024-03-09T15:07:06.559342+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:05:14.087935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":238,"num_write":108,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.573887+0000","last_change":"2024-03-09T14:50:35.508995+0000","last_active":"2024-03-09T15:09:16.573887+0000","last_peered":"2024-03-09T15:09:16.573887+0000","last_clean":"2024-03-09T15:09:16.573887+0000","last_became_active":"2024-03-09T14:50:35.508726+0000","last_became_peered":"2024-03-09T14:50:35.508726+0000","last_unstale":"2024-03-09T15:09:16.573887+0000","last_undegraded":"2024-03-09T15:09:16.573887+0000","last_fullsized":"2024-03-09T15:09:16.573887+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:57:02.512282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.671503+0000","last_change":"2024-03-09T14:38:37.437565+0000","last_active":"2024-03-09T15:07:36.671503+0000","last_peered":"2024-03-09T15:07:36.671503+0000","last_clean":"2024-03-09T15:07:36.671503+0000","last_became_active":"2024-03-09T14:38:37.437039+0000","last_became_peered":"2024-03-09T14:38:37.437039+0000","last_unstale":"2024-03-09T15:07:36.671503+0000","last_undegraded":"2024-03-09T15:07:36.671503+0000","last_fullsized":"2024-03-09T15:07:36.671503+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:19.810352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5293339,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":10340,"num_write":5,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"264'4","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.582498+0000","last_change":"2024-03-09T14:38:34.418567+0000","last_active":"2024-03-09T15:09:01.582498+0000","last_peered":"2024-03-09T15:09:01.582498+0000","last_clean":"2024-03-09T15:09:01.582498+0000","last_became_active":"2024-03-09T14:38:34.418269+0000","last_became_peered":"2024-03-09T14:38:34.418269+0000","last_unstale":"2024-03-09T15:09:01.582498+0000","last_undegraded":"2024-03-09T15:09:01.582498+0000","last_fullsized":"2024-03-09T15:09:01.582498+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:37.564267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":13312,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'38","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.061406+0000","last_change":"2024-03-09T14:35:41.122751+0000","last_active":"2024-03-09T15:07:45.061406+0000","last_peered":"2024-03-09T15:07:45.061406+0000","last_clean":"2024-03-09T15:07:45.061406+0000","last_became_active":"2024-03-09T14:35:41.122257+0000","last_became_peered":"2024-03-09T14:35:41.122257+0000","last_unstale":"2024-03-09T15:07:45.061406+0000","last_undegraded":"2024-03-09T15:07:45.061406+0000","last_fullsized":"2024-03-09T15:07:45.061406+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:47:51.831859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":116,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.569244+0000","last_change":"2024-03-09T14:50:35.503872+0000","last_active":"2024-03-09T15:09:16.569244+0000","last_peered":"2024-03-09T15:09:16.569244+0000","last_clean":"2024-03-09T15:09:16.569244+0000","last_became_active":"2024-03-09T14:50:35.503595+0000","last_became_peered":"2024-03-09T14:50:35.503595+0000","last_unstale":"2024-03-09T15:09:16.569244+0000","last_undegraded":"2024-03-09T15:09:16.569244+0000","last_fullsized":"2024-03-09T15:09:16.569244+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:47.112637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.682932+0000","last_change":"2024-03-09T14:38:37.430250+0000","last_active":"2024-03-09T15:09:01.682932+0000","last_peered":"2024-03-09T15:09:01.682932+0000","last_clean":"2024-03-09T15:09:01.682932+0000","last_became_active":"2024-03-09T14:38:37.429956+0000","last_became_peered":"2024-03-09T14:38:37.429956+0000","last_unstale":"2024-03-09T15:09:01.682932+0000","last_undegraded":"2024-03-09T15:09:01.682932+0000","last_fullsized":"2024-03-09T15:09:01.682932+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:30.262564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":11264,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'1","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.707983+0000","last_change":"2024-03-09T14:38:34.421959+0000","last_active":"2024-03-09T15:07:36.707983+0000","last_peered":"2024-03-09T15:07:36.707983+0000","last_clean":"2024-03-09T15:07:36.707983+0000","last_became_active":"2024-03-09T14:38:34.421678+0000","last_became_peered":"2024-03-09T14:38:34.421678+0000","last_unstale":"2024-03-09T15:07:36.707983+0000","last_undegraded":"2024-03-09T15:07:36.707983+0000","last_fullsized":"2024-03-09T15:07:36.707983+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:48.989741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'25","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:06.667904+0000","last_change":"2024-03-09T14:35:41.121109+0000","last_active":"2024-03-09T15:07:06.667904+0000","last_peered":"2024-03-09T15:07:06.667904+0000","last_clean":"2024-03-09T15:07:06.667904+0000","last_became_active":"2024-03-09T14:35:41.120818+0000","last_became_peered":"2024-03-09T14:35:41.120818+0000","last_unstale":"2024-03-09T15:07:06.667904+0000","last_undegraded":"2024-03-09T15:07:06.667904+0000","last_fullsized":"2024-03-09T15:07:06.667904+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:00.066768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":54,"num_write":56,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.721253+0000","last_change":"2024-03-09T14:50:35.500497+0000","last_active":"2024-03-09T15:09:16.721253+0000","last_peered":"2024-03-09T15:09:16.721253+0000","last_clean":"2024-03-09T15:09:16.721253+0000","last_became_active":"2024-03-09T14:50:35.500196+0000","last_became_peered":"2024-03-09T14:50:35.500196+0000","last_unstale":"2024-03-09T15:09:16.721253+0000","last_undegraded":"2024-03-09T15:09:16.721253+0000","last_fullsized":"2024-03-09T15:09:16.721253+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:59:34.049420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.671535+0000","last_change":"2024-03-09T14:38:37.437194+0000","last_active":"2024-03-09T15:07:36.671535+0000","last_peered":"2024-03-09T15:07:36.671535+0000","last_clean":"2024-03-09T15:07:36.671535+0000","last_became_active":"2024-03-09T14:38:37.436884+0000","last_became_peered":"2024-03-09T14:38:37.436884+0000","last_unstale":"2024-03-09T15:07:36.671535+0000","last_undegraded":"2024-03-09T15:07:36.671535+0000","last_fullsized":"2024-03-09T15:07:36.671535+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:13:52.104812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.558107+0000","last_change":"2024-03-09T14:38:34.420272+0000","last_active":"2024-03-09T15:07:36.558107+0000","last_peered":"2024-03-09T15:07:36.558107+0000","last_clean":"2024-03-09T15:07:36.558107+0000","last_became_active":"2024-03-09T14:38:34.420002+0000","last_became_peered":"2024-03-09T14:38:34.420002+0000","last_unstale":"2024-03-09T15:07:36.558107+0000","last_undegraded":"2024-03-09T15:07:36.558107+0000","last_fullsized":"2024-03-09T15:07:36.558107+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:05:58.461847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'34","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:06.555328+0000","last_change":"2024-03-09T14:35:41.116727+0000","last_active":"2024-03-09T15:07:06.555328+0000","last_peered":"2024-03-09T15:07:06.555328+0000","last_clean":"2024-03-09T15:07:06.555328+0000","last_became_active":"2024-03-09T14:35:41.116430+0000","last_became_peered":"2024-03-09T14:35:41.116430+0000","last_unstale":"2024-03-09T15:07:06.555328+0000","last_undegraded":"2024-03-09T15:07:06.555328+0000","last_fullsized":"2024-03-09T15:07:06.555328+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:09.089142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":94,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.584576+0000","last_change":"2024-03-09T14:50:35.507650+0000","last_active":"2024-03-09T15:09:16.584576+0000","last_peered":"2024-03-09T15:09:16.584576+0000","last_clean":"2024-03-09T15:09:16.584576+0000","last_became_active":"2024-03-09T14:50:35.506969+0000","last_became_peered":"2024-03-09T14:50:35.506969+0000","last_unstale":"2024-03-09T15:09:16.584576+0000","last_undegraded":"2024-03-09T15:09:16.584576+0000","last_fullsized":"2024-03-09T15:09:16.584576+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:45:43.559282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.586813+0000","last_change":"2024-03-09T14:38:37.436281+0000","last_active":"2024-03-09T15:07:36.586813+0000","last_peered":"2024-03-09T15:07:36.586813+0000","last_clean":"2024-03-09T15:07:36.586813+0000","last_became_active":"2024-03-09T14:38:37.435960+0000","last_became_peered":"2024-03-09T14:38:37.435960+0000","last_unstale":"2024-03-09T15:07:36.586813+0000","last_undegraded":"2024-03-09T15:07:36.586813+0000","last_fullsized":"2024-03-09T15:07:36.586813+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:44:42.297000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.570149+0000","last_change":"2024-03-09T14:38:34.420846+0000","last_active":"2024-03-09T15:07:36.570149+0000","last_peered":"2024-03-09T15:07:36.570149+0000","last_clean":"2024-03-09T15:07:36.570149+0000","last_became_active":"2024-03-09T14:38:34.420571+0000","last_became_peered":"2024-03-09T14:38:34.420571+0000","last_unstale":"2024-03-09T15:07:36.570149+0000","last_undegraded":"2024-03-09T15:07:36.570149+0000","last_fullsized":"2024-03-09T15:07:36.570149+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:29:07.174232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'36","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.714611+0000","last_change":"2024-03-09T14:35:41.121354+0000","last_active":"2024-03-09T15:08:26.714611+0000","last_peered":"2024-03-09T15:08:26.714611+0000","last_clean":"2024-03-09T15:08:26.714611+0000","last_became_active":"2024-03-09T14:35:41.121060+0000","last_became_peered":"2024-03-09T14:35:41.121060+0000","last_unstale":"2024-03-09T15:08:26.714611+0000","last_undegraded":"2024-03-09T15:08:26.714611+0000","last_fullsized":"2024-03-09T15:08:26.714611+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:59:13.798282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":100,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.670889+0000","last_change":"2024-03-09T14:50:35.504223+0000","last_active":"2024-03-09T15:07:31.670889+0000","last_peered":"2024-03-09T15:07:31.670889+0000","last_clean":"2024-03-09T15:07:31.670889+0000","last_became_active":"2024-03-09T14:50:35.503970+0000","last_became_peered":"2024-03-09T14:50:35.503970+0000","last_unstale":"2024-03-09T15:07:31.670889+0000","last_undegraded":"2024-03-09T15:07:31.670889+0000","last_fullsized":"2024-03-09T15:07:31.670889+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:00:00.835576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.571890+0000","last_change":"2024-03-09T14:38:37.438872+0000","last_active":"2024-03-09T15:08:56.571890+0000","last_peered":"2024-03-09T15:08:56.571890+0000","last_clean":"2024-03-09T15:08:56.571890+0000","last_became_active":"2024-03-09T14:38:37.438604+0000","last_became_peered":"2024-03-09T14:38:37.438604+0000","last_unstale":"2024-03-09T15:08:56.571890+0000","last_undegraded":"2024-03-09T15:08:56.571890+0000","last_fullsized":"2024-03-09T15:08:56.571890+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:51.268275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.596981+0000","last_change":"2024-03-09T14:38:34.421755+0000","last_active":"2024-03-09T15:08:56.596981+0000","last_peered":"2024-03-09T15:08:56.596981+0000","last_clean":"2024-03-09T15:08:56.596981+0000","last_became_active":"2024-03-09T14:38:34.421476+0000","last_became_peered":"2024-03-09T14:38:34.421476+0000","last_unstale":"2024-03-09T15:08:56.596981+0000","last_undegraded":"2024-03-09T15:08:56.596981+0000","last_fullsized":"2024-03-09T15:08:56.596981+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:39:12.298428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'114","reported_seq":387,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.713908+0000","last_change":"2024-03-09T14:35:41.125457+0000","last_active":"2024-03-09T15:08:21.713908+0000","last_peered":"2024-03-09T15:08:21.713908+0000","last_clean":"2024-03-09T15:08:21.713908+0000","last_became_active":"2024-03-09T14:35:41.125114+0000","last_became_peered":"2024-03-09T14:35:41.125114+0000","last_unstale":"2024-03-09T15:08:21.713908+0000","last_undegraded":"2024-03-09T15:08:21.713908+0000","last_fullsized":"2024-03-09T15:08:21.713908+0000","mapping_epoch":251,"log_start":"264'100","ondisk_log_start":"264'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:47.982191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":488,"num_write":144,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.569420+0000","last_change":"2024-03-09T14:50:35.510923+0000","last_active":"2024-03-09T15:07:31.569420+0000","last_peered":"2024-03-09T15:07:31.569420+0000","last_clean":"2024-03-09T15:07:31.569420+0000","last_became_active":"2024-03-09T14:50:35.510598+0000","last_became_peered":"2024-03-09T14:50:35.510598+0000","last_unstale":"2024-03-09T15:07:31.569420+0000","last_undegraded":"2024-03-09T15:07:31.569420+0000","last_fullsized":"2024-03-09T15:07:31.569420+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:52:13.398359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.571855+0000","last_change":"2024-03-09T14:38:37.439640+0000","last_active":"2024-03-09T15:08:56.571855+0000","last_peered":"2024-03-09T15:08:56.571855+0000","last_clean":"2024-03-09T15:08:56.571855+0000","last_became_active":"2024-03-09T14:38:37.439360+0000","last_became_peered":"2024-03-09T14:38:37.439360+0000","last_unstale":"2024-03-09T15:08:56.571855+0000","last_undegraded":"2024-03-09T15:08:56.571855+0000","last_fullsized":"2024-03-09T15:08:56.571855+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:24.960393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.682399+0000","last_change":"2024-03-09T14:38:34.419720+0000","last_active":"2024-03-09T15:08:56.682399+0000","last_peered":"2024-03-09T15:08:56.682399+0000","last_clean":"2024-03-09T15:08:56.682399+0000","last_became_active":"2024-03-09T14:38:34.419467+0000","last_became_peered":"2024-03-09T14:38:34.419467+0000","last_unstale":"2024-03-09T15:08:56.682399+0000","last_undegraded":"2024-03-09T15:08:56.682399+0000","last_fullsized":"2024-03-09T15:08:56.682399+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:29.894750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'15","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.575178+0000","last_change":"2024-03-09T14:35:41.118830+0000","last_active":"2024-03-09T15:08:21.575178+0000","last_peered":"2024-03-09T15:08:21.575178+0000","last_clean":"2024-03-09T15:08:21.575178+0000","last_became_active":"2024-03-09T14:35:41.118591+0000","last_became_peered":"2024-03-09T14:35:41.118591+0000","last_unstale":"2024-03-09T15:08:21.575178+0000","last_undegraded":"2024-03-09T15:08:21.575178+0000","last_fullsized":"2024-03-09T15:08:21.575178+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:44:14.623143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":42,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.582148+0000","last_change":"2024-03-09T14:50:35.503951+0000","last_active":"2024-03-09T15:09:21.582148+0000","last_peered":"2024-03-09T15:09:21.582148+0000","last_clean":"2024-03-09T15:09:21.582148+0000","last_became_active":"2024-03-09T14:50:35.503274+0000","last_became_peered":"2024-03-09T14:50:35.503274+0000","last_unstale":"2024-03-09T15:09:21.582148+0000","last_undegraded":"2024-03-09T15:09:21.582148+0000","last_fullsized":"2024-03-09T15:09:21.582148+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:51.019829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.682437+0000","last_change":"2024-03-09T14:38:37.436377+0000","last_active":"2024-03-09T15:08:56.682437+0000","last_peered":"2024-03-09T15:08:56.682437+0000","last_clean":"2024-03-09T15:08:56.682437+0000","last_became_active":"2024-03-09T14:38:37.436078+0000","last_became_peered":"2024-03-09T14:38:37.436078+0000","last_unstale":"2024-03-09T15:08:56.682437+0000","last_undegraded":"2024-03-09T15:08:56.682437+0000","last_fullsized":"2024-03-09T15:08:56.682437+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:51:30.342500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'4","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.597003+0000","last_change":"2024-03-09T14:38:34.420240+0000","last_active":"2024-03-09T15:08:56.597003+0000","last_peered":"2024-03-09T15:08:56.597003+0000","last_clean":"2024-03-09T15:08:56.597003+0000","last_became_active":"2024-03-09T14:38:34.419935+0000","last_became_peered":"2024-03-09T14:38:34.419935+0000","last_unstale":"2024-03-09T15:08:56.597003+0000","last_undegraded":"2024-03-09T15:08:56.597003+0000","last_fullsized":"2024-03-09T15:08:56.597003+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:16:59.079986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4234449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":7208,"num_write":4,"num_write_kb":7208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'26","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.592508+0000","last_change":"2024-03-09T14:35:41.117147+0000","last_active":"2024-03-09T15:08:21.592508+0000","last_peered":"2024-03-09T15:08:21.592508+0000","last_clean":"2024-03-09T15:08:21.592508+0000","last_became_active":"2024-03-09T14:35:41.116852+0000","last_became_peered":"2024-03-09T14:35:41.116852+0000","last_unstale":"2024-03-09T15:08:21.592508+0000","last_undegraded":"2024-03-09T15:08:21.592508+0000","last_fullsized":"2024-03-09T15:08:21.592508+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:27:43.779129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.670857+0000","last_change":"2024-03-09T14:50:35.509510+0000","last_active":"2024-03-09T15:07:31.670857+0000","last_peered":"2024-03-09T15:07:31.670857+0000","last_clean":"2024-03-09T15:07:31.670857+0000","last_became_active":"2024-03-09T14:50:35.509202+0000","last_became_peered":"2024-03-09T14:50:35.509202+0000","last_unstale":"2024-03-09T15:07:31.670857+0000","last_undegraded":"2024-03-09T15:07:31.670857+0000","last_fullsized":"2024-03-09T15:07:31.670857+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:23:44.698798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.596967+0000","last_change":"2024-03-09T14:38:37.441897+0000","last_active":"2024-03-09T15:08:56.596967+0000","last_peered":"2024-03-09T15:08:56.596967+0000","last_clean":"2024-03-09T15:08:56.596967+0000","last_became_active":"2024-03-09T14:38:37.441554+0000","last_became_peered":"2024-03-09T14:38:37.441554+0000","last_unstale":"2024-03-09T15:08:56.596967+0000","last_undegraded":"2024-03-09T15:08:56.596967+0000","last_fullsized":"2024-03-09T15:08:56.596967+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:13.709348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":80,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'1","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.581826+0000","last_change":"2024-03-09T14:38:34.424750+0000","last_active":"2024-03-09T15:08:56.581826+0000","last_peered":"2024-03-09T15:08:56.581826+0000","last_clean":"2024-03-09T15:08:56.581826+0000","last_became_active":"2024-03-09T14:38:34.424507+0000","last_became_peered":"2024-03-09T14:38:34.424507+0000","last_unstale":"2024-03-09T15:08:56.581826+0000","last_undegraded":"2024-03-09T15:08:56.581826+0000","last_fullsized":"2024-03-09T15:08:56.581826+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:14:16.729687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'52","reported_seq":169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.677257+0000","last_change":"2024-03-09T14:35:41.117227+0000","last_active":"2024-03-09T15:08:21.677257+0000","last_peered":"2024-03-09T15:08:21.677257+0000","last_clean":"2024-03-09T15:08:21.677257+0000","last_became_active":"2024-03-09T14:35:41.116932+0000","last_became_peered":"2024-03-09T14:35:41.116932+0000","last_unstale":"2024-03-09T15:08:21.677257+0000","last_undegraded":"2024-03-09T15:08:21.677257+0000","last_fullsized":"2024-03-09T15:08:21.677257+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:30:03.952026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":147,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.560814+0000","last_change":"2024-03-09T14:50:35.498350+0000","last_active":"2024-03-09T15:08:01.560814+0000","last_peered":"2024-03-09T15:08:01.560814+0000","last_clean":"2024-03-09T15:08:01.560814+0000","last_became_active":"2024-03-09T14:50:35.498045+0000","last_became_peered":"2024-03-09T14:50:35.498045+0000","last_unstale":"2024-03-09T15:08:01.560814+0000","last_undegraded":"2024-03-09T15:08:01.560814+0000","last_fullsized":"2024-03-09T15:08:01.560814+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:36.419114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.673446+0000","last_change":"2024-03-09T14:38:37.437345+0000","last_active":"2024-03-09T15:07:51.673446+0000","last_peered":"2024-03-09T15:07:51.673446+0000","last_clean":"2024-03-09T15:07:51.673446+0000","last_became_active":"2024-03-09T14:38:37.436672+0000","last_became_peered":"2024-03-09T14:38:37.436672+0000","last_unstale":"2024-03-09T15:07:51.673446+0000","last_undegraded":"2024-03-09T15:07:51.673446+0000","last_fullsized":"2024-03-09T15:07:51.673446+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:31:54.627840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1028,"num_write":9,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'8","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.709912+0000","last_change":"2024-03-09T14:38:34.423665+0000","last_active":"2024-03-09T15:07:51.709912+0000","last_peered":"2024-03-09T15:07:51.709912+0000","last_clean":"2024-03-09T15:07:51.709912+0000","last_became_active":"2024-03-09T14:38:34.423136+0000","last_became_peered":"2024-03-09T14:38:34.423136+0000","last_unstale":"2024-03-09T15:07:51.709912+0000","last_undegraded":"2024-03-09T15:07:51.709912+0000","last_fullsized":"2024-03-09T15:07:51.709912+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:45.903637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":17,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'29","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.669118+0000","last_change":"2024-03-09T14:35:41.120249+0000","last_active":"2024-03-09T15:07:16.669118+0000","last_peered":"2024-03-09T15:07:16.669118+0000","last_clean":"2024-03-09T15:07:16.669118+0000","last_became_active":"2024-03-09T14:35:41.119901+0000","last_became_peered":"2024-03-09T14:35:41.119901+0000","last_unstale":"2024-03-09T15:07:16.669118+0000","last_undegraded":"2024-03-09T15:07:16.669118+0000","last_fullsized":"2024-03-09T15:07:16.669118+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:28:37.467123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":86,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715810+0000","last_change":"2024-03-09T14:50:35.510602+0000","last_active":"2024-03-09T15:08:36.715810+0000","last_peered":"2024-03-09T15:08:36.715810+0000","last_clean":"2024-03-09T15:08:36.715810+0000","last_became_active":"2024-03-09T14:50:35.510330+0000","last_became_peered":"2024-03-09T14:50:35.510330+0000","last_unstale":"2024-03-09T15:08:36.715810+0000","last_undegraded":"2024-03-09T15:08:36.715810+0000","last_fullsized":"2024-03-09T15:08:36.715810+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:46.816086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"261'9","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.577422+0000","last_change":"2024-03-09T14:39:04.870290+0000","last_active":"2024-03-09T15:08:21.577422+0000","last_peered":"2024-03-09T15:08:21.577422+0000","last_clean":"2024-03-09T15:08:21.577422+0000","last_became_active":"2024-03-09T14:39:04.819697+0000","last_became_peered":"2024-03-09T14:39:04.819697+0000","last_unstale":"2024-03-09T15:08:21.577422+0000","last_undegraded":"2024-03-09T15:08:21.577422+0000","last_fullsized":"2024-03-09T15:08:21.577422+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:51.693969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":4098,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.d","version":"264'7","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.559668+0000","last_change":"2024-03-09T14:38:34.416788+0000","last_active":"2024-03-09T15:07:51.559668+0000","last_peered":"2024-03-09T15:07:51.559668+0000","last_clean":"2024-03-09T15:07:51.559668+0000","last_became_active":"2024-03-09T14:38:34.416475+0000","last_became_peered":"2024-03-09T14:38:34.416475+0000","last_unstale":"2024-03-09T15:07:51.559668+0000","last_undegraded":"2024-03-09T15:07:51.559668+0000","last_fullsized":"2024-03-09T15:07:51.559668+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:45.337347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":11,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'38","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.585918+0000","last_change":"2024-03-09T14:35:41.120210+0000","last_active":"2024-03-09T15:09:26.585918+0000","last_peered":"2024-03-09T15:09:26.585918+0000","last_clean":"2024-03-09T15:09:26.585918+0000","last_became_active":"2024-03-09T14:35:41.119890+0000","last_became_peered":"2024-03-09T14:35:41.119890+0000","last_unstale":"2024-03-09T15:09:26.585918+0000","last_undegraded":"2024-03-09T15:09:26.585918+0000","last_fullsized":"2024-03-09T15:09:26.585918+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:29.027891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":99,"num_write":64,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.589494+0000","last_change":"2024-03-09T14:50:35.503867+0000","last_active":"2024-03-09T15:07:56.589494+0000","last_peered":"2024-03-09T15:07:56.589494+0000","last_clean":"2024-03-09T15:07:56.589494+0000","last_became_active":"2024-03-09T14:50:35.503207+0000","last_became_peered":"2024-03-09T14:50:35.503207+0000","last_unstale":"2024-03-09T15:07:56.589494+0000","last_undegraded":"2024-03-09T15:07:56.589494+0000","last_fullsized":"2024-03-09T15:07:56.589494+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:56:26.518688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.564787+0000","last_change":"2024-03-09T14:38:37.438790+0000","last_active":"2024-03-09T15:07:56.564787+0000","last_peered":"2024-03-09T15:07:56.564787+0000","last_clean":"2024-03-09T15:07:56.564787+0000","last_became_active":"2024-03-09T14:38:37.438507+0000","last_became_peered":"2024-03-09T14:38:37.438507+0000","last_unstale":"2024-03-09T15:07:56.564787+0000","last_undegraded":"2024-03-09T15:07:56.564787+0000","last_fullsized":"2024-03-09T15:07:56.564787+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:53:53.804104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"261'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.571875+0000","last_change":"2024-03-09T14:38:34.420034+0000","last_active":"2024-03-09T15:07:51.571875+0000","last_peered":"2024-03-09T15:07:51.571875+0000","last_clean":"2024-03-09T15:07:51.571875+0000","last_became_active":"2024-03-09T14:38:34.419043+0000","last_became_peered":"2024-03-09T14:38:34.419043+0000","last_unstale":"2024-03-09T15:07:51.571875+0000","last_undegraded":"2024-03-09T15:07:51.571875+0000","last_fullsized":"2024-03-09T15:07:51.571875+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:11:48.118366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'88","reported_seq":332,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.601567+0000","last_change":"2024-03-09T14:35:41.117878+0000","last_active":"2024-03-09T15:09:26.601567+0000","last_peered":"2024-03-09T15:09:26.601567+0000","last_clean":"2024-03-09T15:09:26.601567+0000","last_became_active":"2024-03-09T14:35:41.117590+0000","last_became_peered":"2024-03-09T14:35:41.117590+0000","last_unstale":"2024-03-09T15:09:26.601567+0000","last_undegraded":"2024-03-09T15:09:26.601567+0000","last_fullsized":"2024-03-09T15:09:26.601567+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:41:31.619759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":440,"num_write":100,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.710572+0000","last_change":"2024-03-09T14:50:35.509165+0000","last_active":"2024-03-09T15:07:56.710572+0000","last_peered":"2024-03-09T15:07:56.710572+0000","last_clean":"2024-03-09T15:07:56.710572+0000","last_became_active":"2024-03-09T14:50:35.508832+0000","last_became_peered":"2024-03-09T14:50:35.508832+0000","last_unstale":"2024-03-09T15:07:56.710572+0000","last_undegraded":"2024-03-09T15:07:56.710572+0000","last_fullsized":"2024-03-09T15:07:56.710572+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:53.394584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.673464+0000","last_change":"2024-03-09T14:38:37.439624+0000","last_active":"2024-03-09T15:07:51.673464+0000","last_peered":"2024-03-09T15:07:51.673464+0000","last_clean":"2024-03-09T15:07:51.673464+0000","last_became_active":"2024-03-09T14:38:37.439177+0000","last_became_peered":"2024-03-09T14:38:37.439177+0000","last_unstale":"2024-03-09T15:07:51.673464+0000","last_undegraded":"2024-03-09T15:07:51.673464+0000","last_fullsized":"2024-03-09T15:07:51.673464+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:54:00.072929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'1","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.564764+0000","last_change":"2024-03-09T14:38:34.421435+0000","last_active":"2024-03-09T15:07:56.564764+0000","last_peered":"2024-03-09T15:07:56.564764+0000","last_clean":"2024-03-09T15:07:56.564764+0000","last_became_active":"2024-03-09T14:38:34.419461+0000","last_became_peered":"2024-03-09T14:38:34.419461+0000","last_unstale":"2024-03-09T15:07:56.564764+0000","last_undegraded":"2024-03-09T15:07:56.564764+0000","last_fullsized":"2024-03-09T15:07:56.564764+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:34:20.395850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'58","reported_seq":192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.570354+0000","last_change":"2024-03-09T14:35:41.116097+0000","last_active":"2024-03-09T15:09:26.570354+0000","last_peered":"2024-03-09T15:09:26.570354+0000","last_clean":"2024-03-09T15:09:26.570354+0000","last_became_active":"2024-03-09T14:35:41.115769+0000","last_became_peered":"2024-03-09T14:35:41.115769+0000","last_unstale":"2024-03-09T15:09:26.570354+0000","last_undegraded":"2024-03-09T15:09:26.570354+0000","last_fullsized":"2024-03-09T15:09:26.570354+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:05:10.170303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":187,"num_write":89,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.680129+0000","last_change":"2024-03-09T14:50:35.512842+0000","last_active":"2024-03-09T15:08:36.680129+0000","last_peered":"2024-03-09T15:08:36.680129+0000","last_clean":"2024-03-09T15:08:36.680129+0000","last_became_active":"2024-03-09T14:50:35.512515+0000","last_became_peered":"2024-03-09T14:50:35.512515+0000","last_unstale":"2024-03-09T15:08:36.680129+0000","last_undegraded":"2024-03-09T15:08:36.680129+0000","last_fullsized":"2024-03-09T15:08:36.680129+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:52:53.532722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'7","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.597014+0000","last_change":"2024-03-09T14:38:37.437989+0000","last_active":"2024-03-09T15:08:56.597014+0000","last_peered":"2024-03-09T15:08:56.597014+0000","last_clean":"2024-03-09T15:08:56.597014+0000","last_became_active":"2024-03-09T14:38:37.437674+0000","last_became_peered":"2024-03-09T14:38:37.437674+0000","last_unstale":"2024-03-09T15:08:56.597014+0000","last_undegraded":"2024-03-09T15:08:56.597014+0000","last_fullsized":"2024-03-09T15:08:56.597014+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:15:44.990882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'9","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.579384+0000","last_change":"2024-03-09T14:38:34.416934+0000","last_active":"2024-03-09T15:08:56.579384+0000","last_peered":"2024-03-09T15:08:56.579384+0000","last_clean":"2024-03-09T15:08:56.579384+0000","last_became_active":"2024-03-09T14:38:34.416635+0000","last_became_peered":"2024-03-09T14:38:34.416635+0000","last_unstale":"2024-03-09T15:08:56.579384+0000","last_undegraded":"2024-03-09T15:08:56.579384+0000","last_fullsized":"2024-03-09T15:08:56.579384+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:04.243246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'78","reported_seq":244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.582617+0000","last_change":"2024-03-09T14:35:41.113581+0000","last_active":"2024-03-09T15:09:26.582617+0000","last_peered":"2024-03-09T15:09:26.582617+0000","last_clean":"2024-03-09T15:09:26.582617+0000","last_became_active":"2024-03-09T14:35:41.113283+0000","last_became_peered":"2024-03-09T14:35:41.113283+0000","last_unstale":"2024-03-09T15:09:26.582617+0000","last_undegraded":"2024-03-09T15:09:26.582617+0000","last_fullsized":"2024-03-09T15:09:26.582617+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:01:48.405901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":352,"num_read_kb":252,"num_write":133,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715876+0000","last_change":"2024-03-09T14:50:35.509538+0000","last_active":"2024-03-09T15:08:36.715876+0000","last_peered":"2024-03-09T15:08:36.715876+0000","last_clean":"2024-03-09T15:08:36.715876+0000","last_became_active":"2024-03-09T14:50:35.509248+0000","last_became_peered":"2024-03-09T14:50:35.509248+0000","last_unstale":"2024-03-09T15:08:36.715876+0000","last_undegraded":"2024-03-09T15:08:36.715876+0000","last_fullsized":"2024-03-09T15:08:36.715876+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:52:29.204507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.718503+0000","last_change":"2024-03-09T14:38:37.432905+0000","last_active":"2024-03-09T15:08:56.718503+0000","last_peered":"2024-03-09T15:08:56.718503+0000","last_clean":"2024-03-09T15:08:56.718503+0000","last_became_active":"2024-03-09T14:38:37.432007+0000","last_became_peered":"2024-03-09T14:38:37.432007+0000","last_unstale":"2024-03-09T15:08:56.718503+0000","last_undegraded":"2024-03-09T15:08:56.718503+0000","last_fullsized":"2024-03-09T15:08:56.718503+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:42.955791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"261'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.571875+0000","last_change":"2024-03-09T14:38:34.421506+0000","last_active":"2024-03-09T15:08:56.571875+0000","last_peered":"2024-03-09T15:08:56.571875+0000","last_clean":"2024-03-09T15:08:56.571875+0000","last_became_active":"2024-03-09T14:38:34.419582+0000","last_became_peered":"2024-03-09T14:38:34.419582+0000","last_unstale":"2024-03-09T15:08:56.571875+0000","last_undegraded":"2024-03-09T15:08:56.571875+0000","last_fullsized":"2024-03-09T15:08:56.571875+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:37.179560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"261'10","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:16.713161+0000","last_change":"2024-03-09T14:35:41.123265+0000","last_active":"2024-03-09T15:08:16.713161+0000","last_peered":"2024-03-09T15:08:16.713161+0000","last_clean":"2024-03-09T15:08:16.713161+0000","last_became_active":"2024-03-09T14:35:41.122670+0000","last_became_peered":"2024-03-09T14:35:41.122670+0000","last_unstale":"2024-03-09T15:08:16.713161+0000","last_undegraded":"2024-03-09T15:08:16.713161+0000","last_fullsized":"2024-03-09T15:08:16.713161+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:24.170437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715833+0000","last_change":"2024-03-09T14:50:35.506808+0000","last_active":"2024-03-09T15:08:36.715833+0000","last_peered":"2024-03-09T15:08:36.715833+0000","last_clean":"2024-03-09T15:08:36.715833+0000","last_became_active":"2024-03-09T14:50:35.506542+0000","last_became_peered":"2024-03-09T14:50:35.506542+0000","last_unstale":"2024-03-09T15:08:36.715833+0000","last_undegraded":"2024-03-09T15:08:36.715833+0000","last_fullsized":"2024-03-09T15:08:36.715833+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:53:55.176426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.564277+0000","last_change":"2024-03-09T14:38:37.439732+0000","last_active":"2024-03-09T15:07:51.564277+0000","last_peered":"2024-03-09T15:07:51.564277+0000","last_clean":"2024-03-09T15:07:51.564277+0000","last_became_active":"2024-03-09T14:38:37.439444+0000","last_became_peered":"2024-03-09T14:38:37.439444+0000","last_unstale":"2024-03-09T15:07:51.564277+0000","last_undegraded":"2024-03-09T15:07:51.564277+0000","last_fullsized":"2024-03-09T15:07:51.564277+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:04:27.690405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'1","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.580438+0000","last_change":"2024-03-09T14:38:34.416466+0000","last_active":"2024-03-09T15:09:06.580438+0000","last_peered":"2024-03-09T15:09:06.580438+0000","last_clean":"2024-03-09T15:09:06.580438+0000","last_became_active":"2024-03-09T14:38:34.416139+0000","last_became_peered":"2024-03-09T14:38:34.416139+0000","last_unstale":"2024-03-09T15:09:06.580438+0000","last_undegraded":"2024-03-09T15:09:06.580438+0000","last_fullsized":"2024-03-09T15:09:06.580438+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:43:48.564982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'57","reported_seq":187,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:59.379012+0000","last_change":"2024-03-09T14:35:41.121118+0000","last_active":"2024-03-09T15:08:59.379012+0000","last_peered":"2024-03-09T15:08:59.379012+0000","last_clean":"2024-03-09T15:08:59.379012+0000","last_became_active":"2024-03-09T14:35:41.120802+0000","last_became_peered":"2024-03-09T14:35:41.120802+0000","last_unstale":"2024-03-09T15:08:59.379012+0000","last_undegraded":"2024-03-09T15:08:59.379012+0000","last_fullsized":"2024-03-09T15:08:59.379012+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:25:26.837573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":244,"num_read_kb":179,"num_write":100,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.577117+0000","last_change":"2024-03-09T14:50:35.505537+0000","last_active":"2024-03-09T15:08:36.577117+0000","last_peered":"2024-03-09T15:08:36.577117+0000","last_clean":"2024-03-09T15:08:36.577117+0000","last_became_active":"2024-03-09T14:50:35.505278+0000","last_became_peered":"2024-03-09T14:50:35.505278+0000","last_unstale":"2024-03-09T15:08:36.577117+0000","last_undegraded":"2024-03-09T15:08:36.577117+0000","last_fullsized":"2024-03-09T15:08:36.577117+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:48:40.487487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.719250+0000","last_change":"2024-03-09T14:38:37.436225+0000","last_active":"2024-03-09T15:09:01.719250+0000","last_peered":"2024-03-09T15:09:01.719250+0000","last_clean":"2024-03-09T15:09:01.719250+0000","last_became_active":"2024-03-09T14:38:37.435952+0000","last_became_peered":"2024-03-09T14:38:37.435952+0000","last_unstale":"2024-03-09T15:09:01.719250+0000","last_undegraded":"2024-03-09T15:09:01.719250+0000","last_fullsized":"2024-03-09T15:09:01.719250+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:45:59.696392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.588961+0000","last_change":"2024-03-09T14:38:34.420726+0000","last_active":"2024-03-09T15:07:51.588961+0000","last_peered":"2024-03-09T15:07:51.588961+0000","last_clean":"2024-03-09T15:07:51.588961+0000","last_became_active":"2024-03-09T14:38:34.420453+0000","last_became_peered":"2024-03-09T14:38:34.420453+0000","last_unstale":"2024-03-09T15:07:51.588961+0000","last_undegraded":"2024-03-09T15:07:51.588961+0000","last_fullsized":"2024-03-09T15:07:51.588961+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:12.244916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4100,"num_write":3,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'47","reported_seq":164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591361+0000","last_change":"2024-03-09T14:35:41.119775+0000","last_active":"2024-03-09T15:08:11.591361+0000","last_peered":"2024-03-09T15:08:11.591361+0000","last_clean":"2024-03-09T15:08:11.591361+0000","last_became_active":"2024-03-09T14:35:41.119481+0000","last_became_peered":"2024-03-09T14:35:41.119481+0000","last_unstale":"2024-03-09T15:08:11.591361+0000","last_undegraded":"2024-03-09T15:08:11.591361+0000","last_fullsized":"2024-03-09T15:08:11.591361+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:09.488004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":141,"num_write":77,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.722037+0000","last_change":"2024-03-09T14:50:35.508997+0000","last_active":"2024-03-09T15:09:21.722037+0000","last_peered":"2024-03-09T15:09:21.722037+0000","last_clean":"2024-03-09T15:09:21.722037+0000","last_became_active":"2024-03-09T14:50:35.508707+0000","last_became_peered":"2024-03-09T14:50:35.508707+0000","last_unstale":"2024-03-09T15:09:21.722037+0000","last_undegraded":"2024-03-09T15:09:21.722037+0000","last_fullsized":"2024-03-09T15:09:21.722037+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:47:02.507364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.572512+0000","last_change":"2024-03-09T14:38:37.444242+0000","last_active":"2024-03-09T15:07:56.572512+0000","last_peered":"2024-03-09T15:07:56.572512+0000","last_clean":"2024-03-09T15:07:56.572512+0000","last_became_active":"2024-03-09T14:38:37.443923+0000","last_became_peered":"2024-03-09T14:38:37.443923+0000","last_unstale":"2024-03-09T15:07:56.572512+0000","last_undegraded":"2024-03-09T15:07:56.572512+0000","last_fullsized":"2024-03-09T15:07:56.572512+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:13:01.825580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'7","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.709361+0000","last_change":"2024-03-09T14:38:34.421417+0000","last_active":"2024-03-09T15:07:46.709361+0000","last_peered":"2024-03-09T15:07:46.709361+0000","last_clean":"2024-03-09T15:07:46.709361+0000","last_became_active":"2024-03-09T14:38:34.421150+0000","last_became_peered":"2024-03-09T14:38:34.421150+0000","last_unstale":"2024-03-09T15:07:46.709361+0000","last_undegraded":"2024-03-09T15:07:46.709361+0000","last_fullsized":"2024-03-09T15:07:46.709361+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:24:24.004077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":20480,"num_write":22,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'56","reported_seq":186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.574223+0000","last_change":"2024-03-09T14:35:41.121720+0000","last_active":"2024-03-09T15:08:11.574223+0000","last_peered":"2024-03-09T15:08:11.574223+0000","last_clean":"2024-03-09T15:08:11.574223+0000","last_became_active":"2024-03-09T14:35:41.121047+0000","last_became_peered":"2024-03-09T14:35:41.121047+0000","last_unstale":"2024-03-09T15:08:11.574223+0000","last_undegraded":"2024-03-09T15:08:11.574223+0000","last_fullsized":"2024-03-09T15:08:11.574223+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:40.334231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":176,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.585246+0000","last_change":"2024-03-09T14:50:35.512833+0000","last_active":"2024-03-09T15:09:21.585246+0000","last_peered":"2024-03-09T15:09:21.585246+0000","last_clean":"2024-03-09T15:09:21.585246+0000","last_became_active":"2024-03-09T14:50:35.512540+0000","last_became_peered":"2024-03-09T14:50:35.512540+0000","last_unstale":"2024-03-09T15:09:21.585246+0000","last_undegraded":"2024-03-09T15:09:21.585246+0000","last_fullsized":"2024-03-09T15:09:21.585246+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:14.133666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"261'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.571314+0000","last_change":"2024-03-09T14:38:37.436520+0000","last_active":"2024-03-09T15:07:46.571314+0000","last_peered":"2024-03-09T15:07:46.571314+0000","last_clean":"2024-03-09T15:07:46.571314+0000","last_became_active":"2024-03-09T14:38:37.436246+0000","last_became_peered":"2024-03-09T14:38:37.436246+0000","last_unstale":"2024-03-09T15:07:46.571314+0000","last_undegraded":"2024-03-09T15:07:46.571314+0000","last_fullsized":"2024-03-09T15:07:46.571314+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:42:32.801291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.560208+0000","last_change":"2024-03-09T14:38:34.417805+0000","last_active":"2024-03-09T15:07:56.560208+0000","last_peered":"2024-03-09T15:07:56.560208+0000","last_clean":"2024-03-09T15:07:56.560208+0000","last_became_active":"2024-03-09T14:38:34.417530+0000","last_became_peered":"2024-03-09T14:38:34.417530+0000","last_unstale":"2024-03-09T15:07:56.560208+0000","last_undegraded":"2024-03-09T15:07:56.560208+0000","last_fullsized":"2024-03-09T15:07:56.560208+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:01.677780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'34","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591468+0000","last_change":"2024-03-09T14:35:41.116363+0000","last_active":"2024-03-09T15:08:11.591468+0000","last_peered":"2024-03-09T15:08:11.591468+0000","last_clean":"2024-03-09T15:08:11.591468+0000","last_became_active":"2024-03-09T14:35:41.116050+0000","last_became_peered":"2024-03-09T14:35:41.116050+0000","last_unstale":"2024-03-09T15:08:11.591468+0000","last_undegraded":"2024-03-09T15:08:11.591468+0000","last_fullsized":"2024-03-09T15:08:11.591468+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:25:09.271246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":98,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.570342+0000","last_change":"2024-03-09T14:50:35.513092+0000","last_active":"2024-03-09T15:08:41.570342+0000","last_peered":"2024-03-09T15:08:41.570342+0000","last_clean":"2024-03-09T15:08:41.570342+0000","last_became_active":"2024-03-09T14:50:35.512533+0000","last_became_peered":"2024-03-09T14:50:35.512533+0000","last_unstale":"2024-03-09T15:08:41.570342+0000","last_undegraded":"2024-03-09T15:08:41.570342+0000","last_fullsized":"2024-03-09T15:08:41.570342+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:04:55.415472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.718635+0000","last_change":"2024-03-09T14:38:37.432938+0000","last_active":"2024-03-09T15:08:56.718635+0000","last_peered":"2024-03-09T15:08:56.718635+0000","last_clean":"2024-03-09T15:08:56.718635+0000","last_became_active":"2024-03-09T14:38:37.432627+0000","last_became_peered":"2024-03-09T14:38:37.432627+0000","last_unstale":"2024-03-09T15:08:56.718635+0000","last_undegraded":"2024-03-09T15:08:56.718635+0000","last_fullsized":"2024-03-09T15:08:56.718635+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:58:51.983213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4119,"num_write":3,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.581912+0000","last_change":"2024-03-09T14:38:34.416562+0000","last_active":"2024-03-09T15:08:56.581912+0000","last_peered":"2024-03-09T15:08:56.581912+0000","last_clean":"2024-03-09T15:08:56.581912+0000","last_became_active":"2024-03-09T14:38:34.415277+0000","last_became_peered":"2024-03-09T14:38:34.415277+0000","last_unstale":"2024-03-09T15:08:56.581912+0000","last_undegraded":"2024-03-09T15:08:56.581912+0000","last_fullsized":"2024-03-09T15:08:56.581912+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:20.801857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'18","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.719901+0000","last_change":"2024-03-09T14:35:41.123833+0000","last_active":"2024-03-09T15:09:06.719901+0000","last_peered":"2024-03-09T15:09:06.719901+0000","last_clean":"2024-03-09T15:09:06.719901+0000","last_became_active":"2024-03-09T14:35:41.123542+0000","last_became_peered":"2024-03-09T14:35:41.123542+0000","last_unstale":"2024-03-09T15:09:06.719901+0000","last_undegraded":"2024-03-09T15:09:06.719901+0000","last_fullsized":"2024-03-09T15:09:06.719901+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:01.200992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":44,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.600834+0000","last_change":"2024-03-09T14:50:35.506612+0000","last_active":"2024-03-09T15:09:21.600834+0000","last_peered":"2024-03-09T15:09:21.600834+0000","last_clean":"2024-03-09T15:09:21.600834+0000","last_became_active":"2024-03-09T14:50:35.506332+0000","last_became_peered":"2024-03-09T14:50:35.506332+0000","last_unstale":"2024-03-09T15:09:21.600834+0000","last_undegraded":"2024-03-09T15:09:21.600834+0000","last_fullsized":"2024-03-09T15:09:21.600834+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:34:03.683363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.597155+0000","last_change":"2024-03-09T14:38:37.438481+0000","last_active":"2024-03-09T15:08:56.597155+0000","last_peered":"2024-03-09T15:08:56.597155+0000","last_clean":"2024-03-09T15:08:56.597155+0000","last_became_active":"2024-03-09T14:38:37.438182+0000","last_became_peered":"2024-03-09T14:38:37.438182+0000","last_unstale":"2024-03-09T15:08:56.597155+0000","last_undegraded":"2024-03-09T15:08:56.597155+0000","last_fullsized":"2024-03-09T15:08:56.597155+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:04.307257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'1","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.718649+0000","last_change":"2024-03-09T14:38:34.423437+0000","last_active":"2024-03-09T15:08:56.718649+0000","last_peered":"2024-03-09T15:08:56.718649+0000","last_clean":"2024-03-09T15:08:56.718649+0000","last_became_active":"2024-03-09T14:38:34.423106+0000","last_became_peered":"2024-03-09T14:38:34.423106+0000","last_unstale":"2024-03-09T15:08:56.718649+0000","last_undegraded":"2024-03-09T15:08:56.718649+0000","last_fullsized":"2024-03-09T15:08:56.718649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:39:42.766455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'25","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.572391+0000","last_change":"2024-03-09T14:35:41.118139+0000","last_active":"2024-03-09T15:09:01.572391+0000","last_peered":"2024-03-09T15:09:01.572391+0000","last_clean":"2024-03-09T15:09:01.572391+0000","last_became_active":"2024-03-09T14:35:41.117841+0000","last_became_peered":"2024-03-09T14:35:41.117841+0000","last_unstale":"2024-03-09T15:09:01.572391+0000","last_undegraded":"2024-03-09T15:09:01.572391+0000","last_fullsized":"2024-03-09T15:09:01.572391+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:59:14.029378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":73,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.560222+0000","last_change":"2024-03-09T14:50:35.509942+0000","last_active":"2024-03-09T15:07:56.560222+0000","last_peered":"2024-03-09T15:07:56.560222+0000","last_clean":"2024-03-09T15:07:56.560222+0000","last_became_active":"2024-03-09T14:50:35.509460+0000","last_became_peered":"2024-03-09T14:50:35.509460+0000","last_unstale":"2024-03-09T15:07:56.560222+0000","last_undegraded":"2024-03-09T15:07:56.560222+0000","last_fullsized":"2024-03-09T15:07:56.560222+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:23:50.413320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.563731+0000","last_change":"2024-03-09T14:38:37.439377+0000","last_active":"2024-03-09T15:07:46.563731+0000","last_peered":"2024-03-09T15:07:46.563731+0000","last_clean":"2024-03-09T15:07:46.563731+0000","last_became_active":"2024-03-09T14:38:37.439087+0000","last_became_peered":"2024-03-09T14:38:37.439087+0000","last_unstale":"2024-03-09T15:07:46.563731+0000","last_undegraded":"2024-03-09T15:07:46.563731+0000","last_fullsized":"2024-03-09T15:07:46.563731+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:58.859594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'1","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.716561+0000","last_change":"2024-03-09T14:38:34.418700+0000","last_active":"2024-03-09T15:08:41.716561+0000","last_peered":"2024-03-09T15:08:41.716561+0000","last_clean":"2024-03-09T15:08:41.716561+0000","last_became_active":"2024-03-09T14:38:34.418453+0000","last_became_peered":"2024-03-09T14:38:34.418453+0000","last_unstale":"2024-03-09T15:08:41.716561+0000","last_undegraded":"2024-03-09T15:08:41.716561+0000","last_fullsized":"2024-03-09T15:08:41.716561+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:34:24.696789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'42","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.582487+0000","last_change":"2024-03-09T14:35:41.119444+0000","last_active":"2024-03-09T15:09:01.582487+0000","last_peered":"2024-03-09T15:09:01.582487+0000","last_clean":"2024-03-09T15:09:01.582487+0000","last_became_active":"2024-03-09T14:35:41.119181+0000","last_became_peered":"2024-03-09T14:35:41.119181+0000","last_unstale":"2024-03-09T15:09:01.582487+0000","last_undegraded":"2024-03-09T15:09:01.582487+0000","last_fullsized":"2024-03-09T15:09:01.582487+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:50:55.417930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":129,"num_write":69,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.572571+0000","last_change":"2024-03-09T14:50:35.504114+0000","last_active":"2024-03-09T15:07:56.572571+0000","last_peered":"2024-03-09T15:07:56.572571+0000","last_clean":"2024-03-09T15:07:56.572571+0000","last_became_active":"2024-03-09T14:50:35.503858+0000","last_became_peered":"2024-03-09T14:50:35.503858+0000","last_unstale":"2024-03-09T15:07:56.572571+0000","last_undegraded":"2024-03-09T15:07:56.572571+0000","last_fullsized":"2024-03-09T15:07:56.572571+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:40:55.004194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.580175+0000","last_change":"2024-03-09T14:38:37.434360+0000","last_active":"2024-03-09T15:08:41.580175+0000","last_peered":"2024-03-09T15:08:41.580175+0000","last_clean":"2024-03-09T15:08:41.580175+0000","last_became_active":"2024-03-09T14:38:37.434065+0000","last_became_peered":"2024-03-09T14:38:37.434065+0000","last_unstale":"2024-03-09T15:08:41.580175+0000","last_undegraded":"2024-03-09T15:08:41.580175+0000","last_fullsized":"2024-03-09T15:08:41.580175+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:19:29.089561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.709323+0000","last_change":"2024-03-09T14:38:34.423457+0000","last_active":"2024-03-09T15:07:46.709323+0000","last_peered":"2024-03-09T15:07:46.709323+0000","last_clean":"2024-03-09T15:07:46.709323+0000","last_became_active":"2024-03-09T14:38:34.423145+0000","last_became_peered":"2024-03-09T14:38:34.423145+0000","last_unstale":"2024-03-09T15:07:46.709323+0000","last_undegraded":"2024-03-09T15:07:46.709323+0000","last_fullsized":"2024-03-09T15:07:46.709323+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:09.464410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'41","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.597881+0000","last_change":"2024-03-09T14:35:41.117904+0000","last_active":"2024-03-09T15:09:01.597881+0000","last_peered":"2024-03-09T15:09:01.597881+0000","last_clean":"2024-03-09T15:09:01.597881+0000","last_became_active":"2024-03-09T14:35:41.117617+0000","last_became_peered":"2024-03-09T14:35:41.117617+0000","last_unstale":"2024-03-09T15:09:01.597881+0000","last_undegraded":"2024-03-09T15:09:01.597881+0000","last_fullsized":"2024-03-09T15:09:01.597881+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:19:10.800608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":72,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.582122+0000","last_change":"2024-03-09T14:50:35.506611+0000","last_active":"2024-03-09T15:09:21.582122+0000","last_peered":"2024-03-09T15:09:21.582122+0000","last_clean":"2024-03-09T15:09:21.582122+0000","last_became_active":"2024-03-09T14:50:35.506356+0000","last_became_peered":"2024-03-09T14:50:35.506356+0000","last_unstale":"2024-03-09T15:09:21.582122+0000","last_undegraded":"2024-03-09T15:09:21.582122+0000","last_fullsized":"2024-03-09T15:09:21.582122+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:42:15.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588120+0000","last_change":"2024-03-09T14:38:37.439826+0000","last_active":"2024-03-09T15:07:46.588120+0000","last_peered":"2024-03-09T15:07:46.588120+0000","last_clean":"2024-03-09T15:07:46.588120+0000","last_became_active":"2024-03-09T14:38:37.439120+0000","last_became_peered":"2024-03-09T14:38:37.439120+0000","last_unstale":"2024-03-09T15:07:46.588120+0000","last_undegraded":"2024-03-09T15:07:46.588120+0000","last_fullsized":"2024-03-09T15:07:46.588120+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:27.748958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"261'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.563759+0000","last_change":"2024-03-09T14:38:34.422928+0000","last_active":"2024-03-09T15:07:46.563759+0000","last_peered":"2024-03-09T15:07:46.563759+0000","last_clean":"2024-03-09T15:07:46.563759+0000","last_became_active":"2024-03-09T14:38:34.422585+0000","last_became_peered":"2024-03-09T14:38:34.422585+0000","last_unstale":"2024-03-09T15:07:46.563759+0000","last_undegraded":"2024-03-09T15:07:46.563759+0000","last_fullsized":"2024-03-09T15:07:46.563759+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:09.827968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'19","reported_seq":94,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.597802+0000","last_change":"2024-03-09T14:35:41.119625+0000","last_active":"2024-03-09T15:09:01.597802+0000","last_peered":"2024-03-09T15:09:01.597802+0000","last_clean":"2024-03-09T15:09:01.597802+0000","last_became_active":"2024-03-09T14:35:41.118425+0000","last_became_peered":"2024-03-09T14:35:41.118425+0000","last_unstale":"2024-03-09T15:09:01.597802+0000","last_undegraded":"2024-03-09T15:09:01.597802+0000","last_fullsized":"2024-03-09T15:09:01.597802+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:23:15.437892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":53,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.722085+0000","last_change":"2024-03-09T14:50:35.505890+0000","last_active":"2024-03-09T15:09:21.722085+0000","last_peered":"2024-03-09T15:09:21.722085+0000","last_clean":"2024-03-09T15:09:21.722085+0000","last_became_active":"2024-03-09T14:50:35.505615+0000","last_became_peered":"2024-03-09T14:50:35.505615+0000","last_unstale":"2024-03-09T15:09:21.722085+0000","last_undegraded":"2024-03-09T15:09:21.722085+0000","last_fullsized":"2024-03-09T15:09:21.722085+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:12.727103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588248+0000","last_change":"2024-03-09T14:38:37.437735+0000","last_active":"2024-03-09T15:07:46.588248+0000","last_peered":"2024-03-09T15:07:46.588248+0000","last_clean":"2024-03-09T15:07:46.588248+0000","last_became_active":"2024-03-09T14:38:37.437417+0000","last_became_peered":"2024-03-09T14:38:37.437417+0000","last_unstale":"2024-03-09T15:07:46.588248+0000","last_undegraded":"2024-03-09T15:07:46.588248+0000","last_fullsized":"2024-03-09T15:07:46.588248+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:55.465162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":9,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"261'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588136+0000","last_change":"2024-03-09T14:38:34.415988+0000","last_active":"2024-03-09T15:07:46.588136+0000","last_peered":"2024-03-09T15:07:46.588136+0000","last_clean":"2024-03-09T15:07:46.588136+0000","last_became_active":"2024-03-09T14:38:34.415722+0000","last_became_peered":"2024-03-09T14:38:34.415722+0000","last_unstale":"2024-03-09T15:07:46.588136+0000","last_undegraded":"2024-03-09T15:07:46.588136+0000","last_fullsized":"2024-03-09T15:07:46.588136+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:07.146194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'34","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.709277+0000","last_change":"2024-03-09T14:35:41.121819+0000","last_active":"2024-03-09T15:07:46.709277+0000","last_peered":"2024-03-09T15:07:46.709277+0000","last_clean":"2024-03-09T15:07:46.709277+0000","last_became_active":"2024-03-09T14:35:41.121524+0000","last_became_peered":"2024-03-09T14:35:41.121524+0000","last_unstale":"2024-03-09T15:07:46.709277+0000","last_undegraded":"2024-03-09T15:07:46.709277+0000","last_fullsized":"2024-03-09T15:07:46.709277+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:28:01.825341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":103,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'177","reported_seq":777,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:10.542951+0000","last_change":"2024-03-09T14:27:03.724626+0000","last_active":"2024-03-09T15:08:10.542951+0000","last_peered":"2024-03-09T15:08:10.542951+0000","last_clean":"2024-03-09T15:08:10.542951+0000","last_became_active":"2024-03-09T14:27:03.724231+0000","last_became_peered":"2024-03-09T14:27:03.724231+0000","last_unstale":"2024-03-09T15:08:10.542951+0000","last_undegraded":"2024-03-09T15:08:10.542951+0000","last_fullsized":"2024-03-09T15:08:10.542951+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:50.020398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18164995,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":328,"num_read_kb":37533,"num_write":989,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'398","reported_seq":1851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:49.452754+0000","last_change":"2024-03-09T14:26:28.649571+0000","last_active":"2024-03-09T15:10:49.452754+0000","last_peered":"2024-03-09T15:10:49.452754+0000","last_clean":"2024-03-09T15:10:49.452754+0000","last_became_active":"2024-03-09T14:26:28.648852+0000","last_became_peered":"2024-03-09T14:26:28.648852+0000","last_unstale":"2024-03-09T15:10:49.452754+0000","last_undegraded":"2024-03-09T15:10:49.452754+0000","last_fullsized":"2024-03-09T15:10:49.452754+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:19.263893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2165,"num_read_kb":2027,"num_write":486,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'158","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:23.774722+0000","last_change":"2024-03-09T14:26:26.636093+0000","last_active":"2024-03-09T15:10:23.774722+0000","last_peered":"2024-03-09T15:10:23.774722+0000","last_clean":"2024-03-09T15:10:23.774722+0000","last_became_active":"2024-03-09T14:26:26.635705+0000","last_became_peered":"2024-03-09T14:26:26.635705+0000","last_unstale":"2024-03-09T15:10:23.774722+0000","last_undegraded":"2024-03-09T15:10:23.774722+0000","last_fullsized":"2024-03-09T15:10:23.774722+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:44.432842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8483879,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":33876,"num_write":830,"num_write_kb":32927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'816","reported_seq":2387,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.199607+0000","last_change":"2024-03-09T14:28:04.197235+0000","last_active":"2024-03-09T15:11:09.199607+0000","last_peered":"2024-03-09T15:11:09.199607+0000","last_clean":"2024-03-09T15:11:09.199607+0000","last_became_active":"2024-03-09T14:28:04.196872+0000","last_became_peered":"2024-03-09T14:28:04.196872+0000","last_unstale":"2024-03-09T15:11:09.199607+0000","last_undegraded":"2024-03-09T15:11:09.199607+0000","last_fullsized":"2024-03-09T15:11:09.199607+0000","mapping_epoch":38,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:48.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3746,"num_read_kb":3347,"num_write":1098,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'203","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.573686+0000","last_change":"2024-03-09T14:26:26.626838+0000","last_active":"2024-03-09T15:08:06.573686+0000","last_peered":"2024-03-09T15:08:06.573686+0000","last_clean":"2024-03-09T15:08:06.573686+0000","last_became_active":"2024-03-09T14:26:26.626521+0000","last_became_peered":"2024-03-09T14:26:26.626521+0000","last_unstale":"2024-03-09T15:08:06.573686+0000","last_undegraded":"2024-03-09T15:08:06.573686+0000","last_fullsized":"2024-03-09T15:08:06.573686+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:37.136696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5829780,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":482,"num_read_kb":60498,"num_write":1102,"num_write_kb":28928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'630","reported_seq":2071,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.123841+0000","last_change":"2024-03-09T14:26:28.649656+0000","last_active":"2024-03-09T15:11:01.123841+0000","last_peered":"2024-03-09T15:11:01.123841+0000","last_clean":"2024-03-09T15:11:01.123841+0000","last_became_active":"2024-03-09T14:26:28.649054+0000","last_became_peered":"2024-03-09T14:26:28.649054+0000","last_unstale":"2024-03-09T15:11:01.123841+0000","last_undegraded":"2024-03-09T15:11:01.123841+0000","last_fullsized":"2024-03-09T15:11:01.123841+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":600,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:52:42.171996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3080,"num_read_kb":2811,"num_write":822,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'175","reported_seq":781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:21.992580+0000","last_change":"2024-03-09T14:26:26.647604+0000","last_active":"2024-03-09T15:10:21.992580+0000","last_peered":"2024-03-09T15:10:21.992580+0000","last_clean":"2024-03-09T15:10:21.992580+0000","last_became_active":"2024-03-09T14:26:26.647183+0000","last_became_peered":"2024-03-09T14:26:26.647183+0000","last_unstale":"2024-03-09T15:10:21.992580+0000","last_undegraded":"2024-03-09T15:10:21.992580+0000","last_fullsized":"2024-03-09T15:10:21.992580+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:57:15.681003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2102091,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":10841,"num_write":989,"num_write_kb":22118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'383","reported_seq":1952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.553788+0000","last_change":"2024-03-09T14:26:28.649519+0000","last_active":"2024-03-09T15:10:54.553788+0000","last_peered":"2024-03-09T15:10:54.553788+0000","last_clean":"2024-03-09T15:10:54.553788+0000","last_became_active":"2024-03-09T14:26:28.649146+0000","last_became_peered":"2024-03-09T14:26:28.649146+0000","last_unstale":"2024-03-09T15:10:54.553788+0000","last_undegraded":"2024-03-09T15:10:54.553788+0000","last_fullsized":"2024-03-09T15:10:54.553788+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:12:07.136106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2286,"num_read_kb":2187,"num_write":441,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'258","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.718584+0000","last_change":"2024-03-09T14:26:26.652067+0000","last_active":"2024-03-09T15:08:56.718584+0000","last_peered":"2024-03-09T15:08:56.718584+0000","last_clean":"2024-03-09T15:08:56.718584+0000","last_became_active":"2024-03-09T14:26:26.651564+0000","last_became_peered":"2024-03-09T14:26:26.651564+0000","last_unstale":"2024-03-09T15:08:56.718584+0000","last_undegraded":"2024-03-09T15:08:56.718584+0000","last_fullsized":"2024-03-09T15:08:56.718584+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:14:35.603518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18185497,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":642,"num_read_kb":37846,"num_write":1526,"num_write_kb":26421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'334","reported_seq":1772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:13.861455+0000","last_change":"2024-03-09T14:26:28.648555+0000","last_active":"2024-03-09T15:09:13.861455+0000","last_peered":"2024-03-09T15:09:13.861455+0000","last_clean":"2024-03-09T15:09:13.861455+0000","last_became_active":"2024-03-09T14:26:28.648259+0000","last_became_peered":"2024-03-09T14:26:28.648259+0000","last_unstale":"2024-03-09T15:09:13.861455+0000","last_undegraded":"2024-03-09T15:09:13.861455+0000","last_fullsized":"2024-03-09T15:09:13.861455+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:13:53.538477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2053,"num_read_kb":1964,"num_write":385,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'167","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:26.458259+0000","last_change":"2024-03-09T14:26:26.649108+0000","last_active":"2024-03-09T15:10:26.458259+0000","last_peered":"2024-03-09T15:10:26.458259+0000","last_clean":"2024-03-09T15:10:26.458259+0000","last_became_active":"2024-03-09T14:26:26.648780+0000","last_became_peered":"2024-03-09T14:26:26.648780+0000","last_unstale":"2024-03-09T15:10:26.458259+0000","last_undegraded":"2024-03-09T15:10:26.458259+0000","last_fullsized":"2024-03-09T15:10:26.458259+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:42.844197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":557887,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":379,"num_read_kb":3119,"num_write":931,"num_write_kb":23902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'461","reported_seq":2006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.310310+0000","last_change":"2024-03-09T14:26:28.650877+0000","last_active":"2024-03-09T15:10:45.310310+0000","last_peered":"2024-03-09T15:10:45.310310+0000","last_clean":"2024-03-09T15:10:45.310310+0000","last_became_active":"2024-03-09T14:26:28.649994+0000","last_became_peered":"2024-03-09T14:26:28.649994+0000","last_unstale":"2024-03-09T15:10:45.310310+0000","last_undegraded":"2024-03-09T15:10:45.310310+0000","last_fullsized":"2024-03-09T15:10:45.310310+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:45:40.976578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2508,"num_read_kb":2326,"num_write":602,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'156","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.386580+0000","last_change":"2024-03-09T14:26:26.652122+0000","last_active":"2024-03-09T15:11:26.386580+0000","last_peered":"2024-03-09T15:11:26.386580+0000","last_clean":"2024-03-09T15:11:26.386580+0000","last_became_active":"2024-03-09T14:26:26.651754+0000","last_became_peered":"2024-03-09T14:26:26.651754+0000","last_unstale":"2024-03-09T15:11:26.386580+0000","last_undegraded":"2024-03-09T15:11:26.386580+0000","last_fullsized":"2024-03-09T15:11:26.386580+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:56:39.902062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25167905,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":425,"num_read_kb":120305,"num_write":884,"num_write_kb":41051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'1264","reported_seq":2891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.180247+0000","last_change":"2024-03-09T14:26:28.652076+0000","last_active":"2024-03-09T15:11:09.180247+0000","last_peered":"2024-03-09T15:11:09.180247+0000","last_clean":"2024-03-09T15:11:09.180247+0000","last_became_active":"2024-03-09T14:26:28.651754+0000","last_became_peered":"2024-03-09T14:26:28.651754+0000","last_unstale":"2024-03-09T15:11:09.180247+0000","last_undegraded":"2024-03-09T15:11:09.180247+0000","last_fullsized":"2024-03-09T15:11:09.180247+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:58.139033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5611,"num_read_kb":4890,"num_write":1803,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'155","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.682372+0000","last_change":"2024-03-09T14:26:26.643565+0000","last_active":"2024-03-09T15:08:56.682372+0000","last_peered":"2024-03-09T15:08:56.682372+0000","last_clean":"2024-03-09T15:08:56.682372+0000","last_became_active":"2024-03-09T14:26:26.643195+0000","last_became_peered":"2024-03-09T14:26:26.643195+0000","last_unstale":"2024-03-09T15:08:56.682372+0000","last_undegraded":"2024-03-09T15:08:56.682372+0000","last_fullsized":"2024-03-09T15:08:56.682372+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:07:00.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6997673,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":383,"num_read_kb":7445,"num_write":882,"num_write_kb":17740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'832","reported_seq":2501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.868382+0000","last_change":"2024-03-09T14:26:28.654056+0000","last_active":"2024-03-09T15:11:07.868382+0000","last_peered":"2024-03-09T15:11:07.868382+0000","last_clean":"2024-03-09T15:11:07.868382+0000","last_became_active":"2024-03-09T14:26:28.653778+0000","last_became_peered":"2024-03-09T14:26:28.653778+0000","last_unstale":"2024-03-09T15:11:07.868382+0000","last_undegraded":"2024-03-09T15:11:07.868382+0000","last_fullsized":"2024-03-09T15:11:07.868382+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:38:55.151292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3883,"num_read_kb":3504,"num_write":1111,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'451","reported_seq":2033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.529624+0000","last_change":"2024-03-09T14:26:28.649892+0000","last_active":"2024-03-09T15:10:54.529624+0000","last_peered":"2024-03-09T15:10:54.529624+0000","last_clean":"2024-03-09T15:10:54.529624+0000","last_became_active":"2024-03-09T14:26:28.649128+0000","last_became_peered":"2024-03-09T14:26:28.649128+0000","last_unstale":"2024-03-09T15:10:54.529624+0000","last_undegraded":"2024-03-09T15:10:54.529624+0000","last_fullsized":"2024-03-09T15:10:54.529624+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:11:16.956384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2472,"num_read_kb":2328,"num_write":564,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'186","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:02.923440+0000","last_change":"2024-03-09T14:26:26.651818+0000","last_active":"2024-03-09T15:10:02.923440+0000","last_peered":"2024-03-09T15:10:02.923440+0000","last_clean":"2024-03-09T15:10:02.923440+0000","last_became_active":"2024-03-09T14:26:26.651323+0000","last_became_peered":"2024-03-09T14:26:26.651323+0000","last_unstale":"2024-03-09T15:10:02.923440+0000","last_undegraded":"2024-03-09T15:10:02.923440+0000","last_fullsized":"2024-03-09T15:10:02.923440+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:26.086700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2099339,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":437,"num_read_kb":7847,"num_write":1010,"num_write_kb":34087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'415","reported_seq":1935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:34.444271+0000","last_change":"2024-03-09T14:26:28.646304+0000","last_active":"2024-03-09T15:10:34.444271+0000","last_peered":"2024-03-09T15:10:34.444271+0000","last_clean":"2024-03-09T15:10:34.444271+0000","last_became_active":"2024-03-09T14:26:28.645422+0000","last_became_peered":"2024-03-09T14:26:28.645422+0000","last_unstale":"2024-03-09T15:10:34.444271+0000","last_undegraded":"2024-03-09T15:10:34.444271+0000","last_fullsized":"2024-03-09T15:10:34.444271+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:50:13.964684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2243,"num_read_kb":2118,"num_write":516,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'176","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:27.397246+0000","last_change":"2024-03-09T14:26:26.644904+0000","last_active":"2024-03-09T15:09:27.397246+0000","last_peered":"2024-03-09T15:09:27.397246+0000","last_clean":"2024-03-09T15:09:27.397246+0000","last_became_active":"2024-03-09T14:26:26.644578+0000","last_became_peered":"2024-03-09T14:26:26.644578+0000","last_unstale":"2024-03-09T15:09:27.397246+0000","last_undegraded":"2024-03-09T15:09:27.397246+0000","last_fullsized":"2024-03-09T15:09:27.397246+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:27:29.674744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582928,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":445,"num_read_kb":16041,"num_write":1040,"num_write_kb":25248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'392","reported_seq":2099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.420096+0000","last_change":"2024-03-09T14:26:28.648611+0000","last_active":"2024-03-09T15:11:04.420096+0000","last_peered":"2024-03-09T15:11:04.420096+0000","last_clean":"2024-03-09T15:11:04.420096+0000","last_became_active":"2024-03-09T14:26:28.648115+0000","last_became_peered":"2024-03-09T14:26:28.648115+0000","last_unstale":"2024-03-09T15:11:04.420096+0000","last_undegraded":"2024-03-09T15:11:04.420096+0000","last_fullsized":"2024-03-09T15:11:04.420096+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:30:00.259696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2471,"num_read_kb":2382,"num_write":449,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'202","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:43.589351+0000","last_change":"2024-03-09T14:26:26.647793+0000","last_active":"2024-03-09T15:08:43.589351+0000","last_peered":"2024-03-09T15:08:43.589351+0000","last_clean":"2024-03-09T15:08:43.589351+0000","last_became_active":"2024-03-09T14:26:26.647391+0000","last_became_peered":"2024-03-09T14:26:26.647391+0000","last_unstale":"2024-03-09T15:08:43.589351+0000","last_undegraded":"2024-03-09T15:08:43.589351+0000","last_fullsized":"2024-03-09T15:08:43.589351+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:14.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2846719,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":382,"num_read_kb":14846,"num_write":1052,"num_write_kb":41673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'453","reported_seq":2022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.896057+0000","last_change":"2024-03-09T14:26:28.648170+0000","last_active":"2024-03-09T15:11:07.896057+0000","last_peered":"2024-03-09T15:11:07.896057+0000","last_clean":"2024-03-09T15:11:07.896057+0000","last_became_active":"2024-03-09T14:26:28.647846+0000","last_became_peered":"2024-03-09T14:26:28.647846+0000","last_unstale":"2024-03-09T15:11:07.896057+0000","last_undegraded":"2024-03-09T15:11:07.896057+0000","last_fullsized":"2024-03-09T15:11:07.896057+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:52:23.409112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2382,"num_read_kb":2246,"num_write":552,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'279","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:54.343225+0000","last_change":"2024-03-09T14:26:26.638124+0000","last_active":"2024-03-09T15:08:54.343225+0000","last_peered":"2024-03-09T15:08:54.343225+0000","last_clean":"2024-03-09T15:08:54.343225+0000","last_became_active":"2024-03-09T14:26:26.637767+0000","last_became_peered":"2024-03-09T14:26:26.637767+0000","last_unstale":"2024-03-09T15:08:54.343225+0000","last_undegraded":"2024-03-09T15:08:54.343225+0000","last_fullsized":"2024-03-09T15:08:54.343225+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:29:58.146491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11882780,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":593,"num_read_kb":72489,"num_write":1410,"num_write_kb":47263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'1533","reported_seq":3258,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.873260+0000","last_change":"2024-03-09T14:26:28.654340+0000","last_active":"2024-03-09T15:11:07.873260+0000","last_peered":"2024-03-09T15:11:07.873260+0000","last_clean":"2024-03-09T15:11:07.873260+0000","last_became_active":"2024-03-09T14:26:28.653385+0000","last_became_peered":"2024-03-09T14:26:28.653385+0000","last_unstale":"2024-03-09T15:11:07.873260+0000","last_undegraded":"2024-03-09T15:11:07.873260+0000","last_fullsized":"2024-03-09T15:11:07.873260+0000","mapping_epoch":25,"log_start":"264'1500","ondisk_log_start":"264'1500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:12:04.813024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6446,"num_read_kb":5594,"num_write":2158,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'214","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:22.846291+0000","last_change":"2024-03-09T14:26:26.644011+0000","last_active":"2024-03-09T15:09:22.846291+0000","last_peered":"2024-03-09T15:09:22.846291+0000","last_clean":"2024-03-09T15:09:22.846291+0000","last_became_active":"2024-03-09T14:26:26.643401+0000","last_became_peered":"2024-03-09T14:26:26.643401+0000","last_unstale":"2024-03-09T15:09:22.846291+0000","last_undegraded":"2024-03-09T15:09:22.846291+0000","last_fullsized":"2024-03-09T15:09:22.846291+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:05.752386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10309380,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":458,"num_read_kb":13858,"num_write":1170,"num_write_kb":34499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'726","reported_seq":2205,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.153334+0000","last_change":"2024-03-09T14:26:28.650896+0000","last_active":"2024-03-09T15:11:37.153334+0000","last_peered":"2024-03-09T15:11:37.153334+0000","last_clean":"2024-03-09T15:11:37.153334+0000","last_became_active":"2024-03-09T14:26:28.650334+0000","last_became_peered":"2024-03-09T14:26:28.650334+0000","last_unstale":"2024-03-09T15:11:37.153334+0000","last_undegraded":"2024-03-09T15:11:37.153334+0000","last_fullsized":"2024-03-09T15:11:37.153334+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:18:31.435564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3318,"num_read_kb":2980,"num_write":968,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'135","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.577012+0000","last_change":"2024-03-09T14:26:26.631574+0000","last_active":"2024-03-09T15:08:36.577012+0000","last_peered":"2024-03-09T15:08:36.577012+0000","last_clean":"2024-03-09T15:08:36.577012+0000","last_became_active":"2024-03-09T14:26:26.631203+0000","last_became_peered":"2024-03-09T14:26:26.631203+0000","last_unstale":"2024-03-09T15:08:36.577012+0000","last_undegraded":"2024-03-09T15:08:36.577012+0000","last_fullsized":"2024-03-09T15:08:36.577012+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:18:43.836166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3147062,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":303,"num_read_kb":11988,"num_write":736,"num_write_kb":25932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'99","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.863832+0000","last_change":"2024-03-09T14:26:36.674788+0000","last_active":"2024-03-09T15:11:04.863832+0000","last_peered":"2024-03-09T15:11:04.863832+0000","last_clean":"2024-03-09T15:11:04.863832+0000","last_became_active":"2024-03-09T14:26:36.674500+0000","last_became_peered":"2024-03-09T14:26:36.674500+0000","last_unstale":"2024-03-09T15:11:04.863832+0000","last_undegraded":"2024-03-09T15:11:04.863832+0000","last_fullsized":"2024-03-09T15:11:04.863832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:14:05.988499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":88,"num_write":230,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'372","reported_seq":1772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:44.538039+0000","last_change":"2024-03-09T14:28:03.816157+0000","last_active":"2024-03-09T15:09:44.538039+0000","last_peered":"2024-03-09T15:09:44.538039+0000","last_clean":"2024-03-09T15:09:44.538039+0000","last_became_active":"2024-03-09T14:28:03.815924+0000","last_became_peered":"2024-03-09T14:28:03.815924+0000","last_unstale":"2024-03-09T15:09:44.538039+0000","last_undegraded":"2024-03-09T15:09:44.538039+0000","last_fullsized":"2024-03-09T15:09:44.538039+0000","mapping_epoch":38,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:54:24.380063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1992,"num_read_kb":1883,"num_write":432,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"264'201","reported_seq":807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:54.965731+0000","last_change":"2024-03-09T14:26:26.653743+0000","last_active":"2024-03-09T15:08:54.965731+0000","last_peered":"2024-03-09T15:08:54.965731+0000","last_clean":"2024-03-09T15:08:54.965731+0000","last_became_active":"2024-03-09T14:26:26.652957+0000","last_became_peered":"2024-03-09T14:26:26.652957+0000","last_unstale":"2024-03-09T15:08:54.965731+0000","last_undegraded":"2024-03-09T15:08:54.965731+0000","last_fullsized":"2024-03-09T15:08:54.965731+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:49.440301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5267750,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":418,"num_read_kb":22200,"num_write":1163,"num_write_kb":38864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.572316+0000","last_change":"2024-03-09T14:26:30.655416+0000","last_active":"2024-03-09T15:07:36.572316+0000","last_peered":"2024-03-09T15:07:36.572316+0000","last_clean":"2024-03-09T15:07:36.572316+0000","last_became_active":"2024-03-09T14:26:30.654862+0000","last_became_peered":"2024-03-09T14:26:30.654862+0000","last_unstale":"2024-03-09T15:07:36.572316+0000","last_undegraded":"2024-03-09T15:07:36.572316+0000","last_fullsized":"2024-03-09T15:07:36.572316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:05.895677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'181","reported_seq":779,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.587222+0000","last_change":"2024-03-09T14:26:32.653350+0000","last_active":"2024-03-09T15:10:06.587222+0000","last_peered":"2024-03-09T15:10:06.587222+0000","last_clean":"2024-03-09T15:10:06.587222+0000","last_became_active":"2024-03-09T14:26:32.652879+0000","last_became_peered":"2024-03-09T14:26:32.652879+0000","last_unstale":"2024-03-09T15:10:06.587222+0000","last_undegraded":"2024-03-09T15:10:06.587222+0000","last_fullsized":"2024-03-09T15:10:06.587222+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:22:58.520379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21241,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":242,"num_read_kb":333,"num_write":140,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.708826+0000","last_change":"2024-03-09T14:26:34.670623+0000","last_active":"2024-03-09T15:07:41.708826+0000","last_peered":"2024-03-09T15:07:41.708826+0000","last_clean":"2024-03-09T15:07:41.708826+0000","last_became_active":"2024-03-09T14:26:34.670336+0000","last_became_peered":"2024-03-09T14:26:34.670336+0000","last_unstale":"2024-03-09T15:07:41.708826+0000","last_undegraded":"2024-03-09T15:07:41.708826+0000","last_fullsized":"2024-03-09T15:07:41.708826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:22:58.489151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'168","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.758728+0000","last_change":"2024-03-09T14:26:36.674055+0000","last_active":"2024-03-09T15:10:35.758728+0000","last_peered":"2024-03-09T15:10:35.758728+0000","last_clean":"2024-03-09T15:10:35.758728+0000","last_became_active":"2024-03-09T14:26:36.673806+0000","last_became_peered":"2024-03-09T14:26:36.673806+0000","last_unstale":"2024-03-09T15:10:35.758728+0000","last_undegraded":"2024-03-09T15:10:35.758728+0000","last_fullsized":"2024-03-09T15:10:35.758728+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:17:00.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":385,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'374","reported_seq":1917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.421489+0000","last_change":"2024-03-09T14:26:28.646103+0000","last_active":"2024-03-09T15:11:04.421489+0000","last_peered":"2024-03-09T15:11:04.421489+0000","last_clean":"2024-03-09T15:11:04.421489+0000","last_became_active":"2024-03-09T14:26:28.645537+0000","last_became_peered":"2024-03-09T14:26:28.645537+0000","last_unstale":"2024-03-09T15:11:04.421489+0000","last_undegraded":"2024-03-09T15:11:04.421489+0000","last_fullsized":"2024-03-09T15:11:04.421489+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:56:00.728701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2096,"num_read_kb":2016,"num_write":417,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'221","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:03.654938+0000","last_change":"2024-03-09T14:26:26.644936+0000","last_active":"2024-03-09T15:09:03.654938+0000","last_peered":"2024-03-09T15:09:03.654938+0000","last_clean":"2024-03-09T15:09:03.654938+0000","last_became_active":"2024-03-09T14:26:26.644563+0000","last_became_peered":"2024-03-09T14:26:26.644563+0000","last_unstale":"2024-03-09T15:09:03.654938+0000","last_undegraded":"2024-03-09T15:09:03.654938+0000","last_fullsized":"2024-03-09T15:09:03.654938+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:22:28.065455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9503167,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":457,"num_read_kb":29388,"num_write":1128,"num_write_kb":42312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.679955+0000","last_change":"2024-03-09T14:26:30.651988+0000","last_active":"2024-03-09T15:08:36.679955+0000","last_peered":"2024-03-09T15:08:36.679955+0000","last_clean":"2024-03-09T15:08:36.679955+0000","last_became_active":"2024-03-09T14:26:30.651683+0000","last_became_peered":"2024-03-09T14:26:30.651683+0000","last_unstale":"2024-03-09T15:08:36.679955+0000","last_undegraded":"2024-03-09T15:08:36.679955+0000","last_fullsized":"2024-03-09T15:08:36.679955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:33:21.797293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'81","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.607493+0000","last_change":"2024-03-09T14:26:32.657274+0000","last_active":"2024-03-09T15:10:06.607493+0000","last_peered":"2024-03-09T15:10:06.607493+0000","last_clean":"2024-03-09T15:10:06.607493+0000","last_became_active":"2024-03-09T14:26:32.656995+0000","last_became_peered":"2024-03-09T14:26:32.656995+0000","last_unstale":"2024-03-09T15:10:06.607493+0000","last_undegraded":"2024-03-09T15:10:06.607493+0000","last_fullsized":"2024-03-09T15:10:06.607493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:23:29.312811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":86,"num_read_kb":83,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.587663+0000","last_change":"2024-03-09T14:26:34.666672+0000","last_active":"2024-03-09T15:07:41.587663+0000","last_peered":"2024-03-09T15:07:41.587663+0000","last_clean":"2024-03-09T15:07:41.587663+0000","last_became_active":"2024-03-09T14:26:34.666326+0000","last_became_peered":"2024-03-09T14:26:34.666326+0000","last_unstale":"2024-03-09T15:07:41.587663+0000","last_undegraded":"2024-03-09T15:07:41.587663+0000","last_fullsized":"2024-03-09T15:07:41.587663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:51:24.275827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'111","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:25.702130+0000","last_change":"2024-03-09T14:26:36.671366+0000","last_active":"2024-03-09T15:10:25.702130+0000","last_peered":"2024-03-09T15:10:25.702130+0000","last_clean":"2024-03-09T15:10:25.702130+0000","last_became_active":"2024-03-09T14:26:36.671071+0000","last_became_peered":"2024-03-09T14:26:36.671071+0000","last_unstale":"2024-03-09T15:10:25.702130+0000","last_undegraded":"2024-03-09T15:10:25.702130+0000","last_fullsized":"2024-03-09T15:10:25.702130+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:35.587717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":104,"num_write":246,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'951","reported_seq":2539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.046845+0000","last_change":"2024-03-09T14:26:28.649069+0000","last_active":"2024-03-09T15:10:51.046845+0000","last_peered":"2024-03-09T15:10:51.046845+0000","last_clean":"2024-03-09T15:10:51.046845+0000","last_became_active":"2024-03-09T14:26:28.648586+0000","last_became_peered":"2024-03-09T14:26:28.648586+0000","last_unstale":"2024-03-09T15:10:51.046845+0000","last_undegraded":"2024-03-09T15:10:51.046845+0000","last_fullsized":"2024-03-09T15:10:51.046845+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:43:05.587726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4258,"num_read_kb":3730,"num_write":1359,"num_write_kb":540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'181","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:14.100648+0000","last_change":"2024-03-09T14:26:26.653314+0000","last_active":"2024-03-09T15:09:14.100648+0000","last_peered":"2024-03-09T15:09:14.100648+0000","last_clean":"2024-03-09T15:09:14.100648+0000","last_became_active":"2024-03-09T14:26:26.652803+0000","last_became_peered":"2024-03-09T14:26:26.652803+0000","last_unstale":"2024-03-09T15:09:14.100648+0000","last_undegraded":"2024-03-09T15:09:14.100648+0000","last_fullsized":"2024-03-09T15:09:14.100648+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:35:03.501326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195206,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":380,"num_read_kb":6854,"num_write":968,"num_write_kb":33721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.671581+0000","last_change":"2024-03-09T14:26:30.652950+0000","last_active":"2024-03-09T15:07:36.671581+0000","last_peered":"2024-03-09T15:07:36.671581+0000","last_clean":"2024-03-09T15:07:36.671581+0000","last_became_active":"2024-03-09T14:26:30.652699+0000","last_became_peered":"2024-03-09T14:26:30.652699+0000","last_unstale":"2024-03-09T15:07:36.671581+0000","last_undegraded":"2024-03-09T15:07:36.671581+0000","last_fullsized":"2024-03-09T15:07:36.671581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:39:48.909510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'98","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:22.138446+0000","last_change":"2024-03-09T14:26:32.658656+0000","last_active":"2024-03-09T15:10:22.138446+0000","last_peered":"2024-03-09T15:10:22.138446+0000","last_clean":"2024-03-09T15:10:22.138446+0000","last_became_active":"2024-03-09T14:26:32.658348+0000","last_became_peered":"2024-03-09T14:26:32.658348+0000","last_unstale":"2024-03-09T15:10:22.138446+0000","last_undegraded":"2024-03-09T15:10:22.138446+0000","last_fullsized":"2024-03-09T15:10:22.138446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:46.676833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'528","reported_seq":1962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.638789+0000","last_change":"2024-03-09T14:26:34.674301+0000","last_active":"2024-03-09T15:11:38.638789+0000","last_peered":"2024-03-09T15:11:38.638789+0000","last_clean":"2024-03-09T15:11:38.638789+0000","last_became_active":"2024-03-09T14:26:34.673916+0000","last_became_peered":"2024-03-09T14:26:34.673916+0000","last_unstale":"2024-03-09T15:11:38.638789+0000","last_undegraded":"2024-03-09T15:11:38.638789+0000","last_fullsized":"2024-03-09T15:11:38.638789+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:25:43.485522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'204","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:26.584268+0000","last_change":"2024-03-09T14:26:36.786508+0000","last_active":"2024-03-09T15:10:26.584268+0000","last_peered":"2024-03-09T15:10:26.584268+0000","last_clean":"2024-03-09T15:10:26.584268+0000","last_became_active":"2024-03-09T14:26:36.786202+0000","last_became_peered":"2024-03-09T14:26:36.786202+0000","last_unstale":"2024-03-09T15:10:26.584268+0000","last_undegraded":"2024-03-09T15:10:26.584268+0000","last_fullsized":"2024-03-09T15:10:26.584268+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:32:12.717992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":555,"num_write":450,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'733","reported_seq":2331,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.058929+0000","last_change":"2024-03-09T14:26:28.658592+0000","last_active":"2024-03-09T15:10:51.058929+0000","last_peered":"2024-03-09T15:10:51.058929+0000","last_clean":"2024-03-09T15:10:51.058929+0000","last_became_active":"2024-03-09T14:26:28.657030+0000","last_became_peered":"2024-03-09T14:26:28.657030+0000","last_unstale":"2024-03-09T15:10:51.058929+0000","last_undegraded":"2024-03-09T15:10:51.058929+0000","last_fullsized":"2024-03-09T15:10:51.058929+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:32:55.173962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3495,"num_read_kb":3179,"num_write":956,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'231","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:24.542219+0000","last_change":"2024-03-09T14:26:26.644365+0000","last_active":"2024-03-09T15:11:24.542219+0000","last_peered":"2024-03-09T15:11:24.542219+0000","last_clean":"2024-03-09T15:11:24.542219+0000","last_became_active":"2024-03-09T14:26:26.643877+0000","last_became_peered":"2024-03-09T14:26:26.643877+0000","last_unstale":"2024-03-09T15:11:24.542219+0000","last_undegraded":"2024-03-09T15:11:24.542219+0000","last_fullsized":"2024-03-09T15:11:24.542219+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:57:15.681003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5567527,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":42109,"num_write":1105,"num_write_kb":38892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.572348+0000","last_change":"2024-03-09T14:26:30.651051+0000","last_active":"2024-03-09T15:07:36.572348+0000","last_peered":"2024-03-09T15:07:36.572348+0000","last_clean":"2024-03-09T15:07:36.572348+0000","last_became_active":"2024-03-09T14:26:30.650741+0000","last_became_peered":"2024-03-09T14:26:30.650741+0000","last_unstale":"2024-03-09T15:07:36.572348+0000","last_undegraded":"2024-03-09T15:07:36.572348+0000","last_fullsized":"2024-03-09T15:07:36.572348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:26.277367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'141","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.083284+0000","last_change":"2024-03-09T14:26:32.869163+0000","last_active":"2024-03-09T15:10:51.083284+0000","last_peered":"2024-03-09T15:10:51.083284+0000","last_clean":"2024-03-09T15:10:51.083284+0000","last_became_active":"2024-03-09T14:26:32.868081+0000","last_became_peered":"2024-03-09T14:26:32.868081+0000","last_unstale":"2024-03-09T15:10:51.083284+0000","last_undegraded":"2024-03-09T15:10:51.083284+0000","last_fullsized":"2024-03-09T15:10:51.083284+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:50:41.428007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9327,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":223,"num_write":98,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'561","reported_seq":4021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.698977+0000","last_change":"2024-03-09T14:26:34.679581+0000","last_active":"2024-03-09T15:11:38.698977+0000","last_peered":"2024-03-09T15:11:38.698977+0000","last_clean":"2024-03-09T15:11:38.698977+0000","last_became_active":"2024-03-09T14:26:34.679280+0000","last_became_peered":"2024-03-09T14:26:34.679280+0000","last_unstale":"2024-03-09T15:11:38.698977+0000","last_undegraded":"2024-03-09T15:11:38.698977+0000","last_fullsized":"2024-03-09T15:11:38.698977+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:22:33.914415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'336","reported_seq":1680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.864421+0000","last_change":"2024-03-09T14:26:28.646029+0000","last_active":"2024-03-09T15:11:07.864421+0000","last_peered":"2024-03-09T15:11:07.864421+0000","last_clean":"2024-03-09T15:11:07.864421+0000","last_became_active":"2024-03-09T14:26:28.645600+0000","last_became_peered":"2024-03-09T14:26:28.645600+0000","last_unstale":"2024-03-09T15:11:07.864421+0000","last_undegraded":"2024-03-09T15:11:07.864421+0000","last_fullsized":"2024-03-09T15:11:07.864421+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:31.580713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1869,"num_read_kb":1759,"num_write":401,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'204","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.047804+0000","last_change":"2024-03-09T14:26:26.652521+0000","last_active":"2024-03-09T15:10:42.047804+0000","last_peered":"2024-03-09T15:10:42.047804+0000","last_clean":"2024-03-09T15:10:42.047804+0000","last_became_active":"2024-03-09T14:26:26.652163+0000","last_became_peered":"2024-03-09T14:26:26.652163+0000","last_unstale":"2024-03-09T15:10:42.047804+0000","last_undegraded":"2024-03-09T15:10:42.047804+0000","last_fullsized":"2024-03-09T15:10:42.047804+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:35.690754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8676548,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":479,"num_read_kb":85490,"num_write":1161,"num_write_kb":31492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.708678+0000","last_change":"2024-03-09T14:26:30.648514+0000","last_active":"2024-03-09T15:07:41.708678+0000","last_peered":"2024-03-09T15:07:41.708678+0000","last_clean":"2024-03-09T15:07:41.708678+0000","last_became_active":"2024-03-09T14:26:30.648227+0000","last_became_peered":"2024-03-09T14:26:30.648227+0000","last_unstale":"2024-03-09T15:07:41.708678+0000","last_undegraded":"2024-03-09T15:07:41.708678+0000","last_fullsized":"2024-03-09T15:07:41.708678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:08:30.571556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'201","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:34.447773+0000","last_change":"2024-03-09T14:26:32.868345+0000","last_active":"2024-03-09T15:10:34.447773+0000","last_peered":"2024-03-09T15:10:34.447773+0000","last_clean":"2024-03-09T15:10:34.447773+0000","last_became_active":"2024-03-09T14:26:32.868020+0000","last_became_peered":"2024-03-09T14:26:32.868020+0000","last_unstale":"2024-03-09T15:10:34.447773+0000","last_undegraded":"2024-03-09T15:10:34.447773+0000","last_fullsized":"2024-03-09T15:10:34.447773+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:16:05.222921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9656,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":269,"num_read_kb":288,"num_write":158,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.574392+0000","last_change":"2024-03-09T14:26:34.666827+0000","last_active":"2024-03-09T15:09:21.574392+0000","last_peered":"2024-03-09T15:09:21.574392+0000","last_clean":"2024-03-09T15:09:21.574392+0000","last_became_active":"2024-03-09T14:26:34.666539+0000","last_became_peered":"2024-03-09T14:26:34.666539+0000","last_unstale":"2024-03-09T15:09:21.574392+0000","last_undegraded":"2024-03-09T15:09:21.574392+0000","last_fullsized":"2024-03-09T15:09:21.574392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:45:05.086023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'537","reported_seq":1343,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.686743+0000","last_change":"2024-03-09T14:26:36.672487+0000","last_active":"2024-03-09T15:11:38.686743+0000","last_peered":"2024-03-09T15:11:38.686743+0000","last_clean":"2024-03-09T15:11:38.686743+0000","last_became_active":"2024-03-09T14:26:36.672173+0000","last_became_peered":"2024-03-09T14:26:36.672173+0000","last_unstale":"2024-03-09T15:11:38.686743+0000","last_undegraded":"2024-03-09T15:11:38.686743+0000","last_fullsized":"2024-03-09T15:11:38.686743+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:51:07.339596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1288,"num_read_kb":1278,"num_write":1107,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'868","reported_seq":2461,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.106159+0000","last_change":"2024-03-09T14:26:28.656027+0000","last_active":"2024-03-09T15:11:01.106159+0000","last_peered":"2024-03-09T15:11:01.106159+0000","last_clean":"2024-03-09T15:11:01.106159+0000","last_became_active":"2024-03-09T14:26:28.655572+0000","last_became_peered":"2024-03-09T14:26:28.655572+0000","last_unstale":"2024-03-09T15:11:01.106159+0000","last_undegraded":"2024-03-09T15:11:01.106159+0000","last_fullsized":"2024-03-09T15:11:01.106159+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:10:40.483371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4137,"num_read_kb":3672,"num_write":1196,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'210","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:49.310102+0000","last_change":"2024-03-09T14:26:26.654328+0000","last_active":"2024-03-09T15:10:49.310102+0000","last_peered":"2024-03-09T15:10:49.310102+0000","last_clean":"2024-03-09T15:10:49.310102+0000","last_became_active":"2024-03-09T14:26:26.653969+0000","last_became_peered":"2024-03-09T14:26:26.653969+0000","last_unstale":"2024-03-09T15:10:49.310102+0000","last_undegraded":"2024-03-09T15:10:49.310102+0000","last_fullsized":"2024-03-09T15:10:49.310102+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:24:44.283252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6616130,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":36496,"num_write":1169,"num_write_kb":46772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.558546+0000","last_change":"2024-03-09T14:26:30.647064+0000","last_active":"2024-03-09T15:07:41.558546+0000","last_peered":"2024-03-09T15:07:41.558546+0000","last_clean":"2024-03-09T15:07:41.558546+0000","last_became_active":"2024-03-09T14:26:30.646765+0000","last_became_peered":"2024-03-09T14:26:30.646765+0000","last_unstale":"2024-03-09T15:07:41.558546+0000","last_undegraded":"2024-03-09T15:07:41.558546+0000","last_fullsized":"2024-03-09T15:07:41.558546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:19.489495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'118","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.490724+0000","last_change":"2024-03-09T14:26:32.655422+0000","last_active":"2024-03-09T15:11:36.490724+0000","last_peered":"2024-03-09T15:11:36.490724+0000","last_clean":"2024-03-09T15:11:36.490724+0000","last_became_active":"2024-03-09T14:26:32.655037+0000","last_became_peered":"2024-03-09T14:26:32.655037+0000","last_unstale":"2024-03-09T15:11:36.490724+0000","last_undegraded":"2024-03-09T15:11:36.490724+0000","last_fullsized":"2024-03-09T15:11:36.490724+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:57:37.124968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":156,"num_write":70,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.673401+0000","last_change":"2024-03-09T14:26:34.678829+0000","last_active":"2024-03-09T15:07:51.673401+0000","last_peered":"2024-03-09T15:07:51.673401+0000","last_clean":"2024-03-09T15:07:51.673401+0000","last_became_active":"2024-03-09T14:26:34.678525+0000","last_became_peered":"2024-03-09T14:26:34.678525+0000","last_unstale":"2024-03-09T15:07:51.673401+0000","last_undegraded":"2024-03-09T15:07:51.673401+0000","last_fullsized":"2024-03-09T15:07:51.673401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:57:05.745633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2463","reported_seq":4879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.372073+0000","last_change":"2024-03-09T14:26:36.671509+0000","last_active":"2024-03-09T15:11:37.372073+0000","last_peered":"2024-03-09T15:11:37.372073+0000","last_clean":"2024-03-09T15:11:37.372073+0000","last_became_active":"2024-03-09T14:26:36.671204+0000","last_became_peered":"2024-03-09T14:26:36.671204+0000","last_unstale":"2024-03-09T15:11:37.372073+0000","last_undegraded":"2024-03-09T15:11:37.372073+0000","last_fullsized":"2024-03-09T15:11:37.372073+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":2400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:54:22.325503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6722,"num_read_kb":6726,"num_write":4987,"num_write_kb":1828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'374","reported_seq":1941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.098113+0000","last_change":"2024-03-09T14:26:28.648968+0000","last_active":"2024-03-09T15:11:01.098113+0000","last_peered":"2024-03-09T15:11:01.098113+0000","last_clean":"2024-03-09T15:11:01.098113+0000","last_became_active":"2024-03-09T14:26:28.648620+0000","last_became_peered":"2024-03-09T14:26:28.648620+0000","last_unstale":"2024-03-09T15:11:01.098113+0000","last_undegraded":"2024-03-09T15:11:01.098113+0000","last_fullsized":"2024-03-09T15:11:01.098113+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:45:55.545173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2195,"num_write":437,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'209","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.383080+0000","last_change":"2024-03-09T14:26:26.653520+0000","last_active":"2024-03-09T15:11:26.383080+0000","last_peered":"2024-03-09T15:11:26.383080+0000","last_clean":"2024-03-09T15:11:26.383080+0000","last_became_active":"2024-03-09T14:26:26.653181+0000","last_became_peered":"2024-03-09T14:26:26.653181+0000","last_unstale":"2024-03-09T15:11:26.383080+0000","last_undegraded":"2024-03-09T15:11:26.383080+0000","last_fullsized":"2024-03-09T15:11:26.383080+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:52.372652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15751382,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1034,"num_read_kb":176274,"num_write":1127,"num_write_kb":52674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.569270+0000","last_change":"2024-03-09T14:26:30.646000+0000","last_active":"2024-03-09T15:09:16.569270+0000","last_peered":"2024-03-09T15:09:16.569270+0000","last_clean":"2024-03-09T15:09:16.569270+0000","last_became_active":"2024-03-09T14:26:30.645656+0000","last_became_peered":"2024-03-09T14:26:30.645656+0000","last_unstale":"2024-03-09T15:09:16.569270+0000","last_undegraded":"2024-03-09T15:09:16.569270+0000","last_fullsized":"2024-03-09T15:09:16.569270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:24:40.309796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'168","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.021145+0000","last_change":"2024-03-09T14:26:32.657586+0000","last_active":"2024-03-09T15:11:37.021145+0000","last_peered":"2024-03-09T15:11:37.021145+0000","last_clean":"2024-03-09T15:11:37.021145+0000","last_became_active":"2024-03-09T14:26:32.657144+0000","last_became_peered":"2024-03-09T14:26:32.657144+0000","last_unstale":"2024-03-09T15:11:37.021145+0000","last_undegraded":"2024-03-09T15:11:37.021145+0000","last_fullsized":"2024-03-09T15:11:37.021145+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:12:23.509222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13623,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":200,"num_read_kb":247,"num_write":114,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'540","reported_seq":1934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.696160+0000","last_change":"2024-03-09T14:26:34.668104+0000","last_active":"2024-03-09T15:11:38.696160+0000","last_peered":"2024-03-09T15:11:38.696160+0000","last_clean":"2024-03-09T15:11:38.696160+0000","last_became_active":"2024-03-09T14:26:34.667795+0000","last_became_peered":"2024-03-09T14:26:34.667795+0000","last_unstale":"2024-03-09T15:11:38.696160+0000","last_undegraded":"2024-03-09T15:11:38.696160+0000","last_fullsized":"2024-03-09T15:11:38.696160+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:54.046352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'109","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:19.855122+0000","last_change":"2024-03-09T14:26:36.671949+0000","last_active":"2024-03-09T15:10:19.855122+0000","last_peered":"2024-03-09T15:10:19.855122+0000","last_clean":"2024-03-09T15:10:19.855122+0000","last_became_active":"2024-03-09T14:26:36.671635+0000","last_became_peered":"2024-03-09T14:26:36.671635+0000","last_unstale":"2024-03-09T15:10:19.855122+0000","last_undegraded":"2024-03-09T15:10:19.855122+0000","last_fullsized":"2024-03-09T15:10:19.855122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:02:06.007889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":89,"num_write":251,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'431","reported_seq":1949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.186291+0000","last_change":"2024-03-09T14:26:28.645748+0000","last_active":"2024-03-09T15:10:42.186291+0000","last_peered":"2024-03-09T15:10:42.186291+0000","last_clean":"2024-03-09T15:10:42.186291+0000","last_became_active":"2024-03-09T14:26:28.645215+0000","last_became_peered":"2024-03-09T14:26:28.645215+0000","last_unstale":"2024-03-09T15:10:42.186291+0000","last_undegraded":"2024-03-09T15:10:42.186291+0000","last_fullsized":"2024-03-09T15:10:42.186291+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:02:01.979402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2276,"num_read_kb":2131,"num_write":518,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'206","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:31.434109+0000","last_change":"2024-03-09T14:26:26.640453+0000","last_active":"2024-03-09T15:10:31.434109+0000","last_peered":"2024-03-09T15:10:31.434109+0000","last_clean":"2024-03-09T15:10:31.434109+0000","last_became_active":"2024-03-09T14:26:26.639784+0000","last_became_peered":"2024-03-09T14:26:26.639784+0000","last_unstale":"2024-03-09T15:10:31.434109+0000","last_undegraded":"2024-03-09T15:10:31.434109+0000","last_fullsized":"2024-03-09T15:10:31.434109+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:31.481843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8443050,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":713,"num_read_kb":41891,"num_write":1157,"num_write_kb":44648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.559614+0000","last_change":"2024-03-09T14:26:30.653007+0000","last_active":"2024-03-09T15:07:51.559614+0000","last_peered":"2024-03-09T15:07:51.559614+0000","last_clean":"2024-03-09T15:07:51.559614+0000","last_became_active":"2024-03-09T14:26:30.652726+0000","last_became_peered":"2024-03-09T14:26:30.652726+0000","last_unstale":"2024-03-09T15:07:51.559614+0000","last_undegraded":"2024-03-09T15:07:51.559614+0000","last_fullsized":"2024-03-09T15:07:51.559614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:39.318802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'175","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.654007+0000","last_change":"2024-03-09T14:26:32.653345+0000","last_active":"2024-03-09T15:11:38.654007+0000","last_peered":"2024-03-09T15:11:38.654007+0000","last_clean":"2024-03-09T15:11:38.654007+0000","last_became_active":"2024-03-09T14:26:32.653026+0000","last_became_peered":"2024-03-09T14:26:32.653026+0000","last_unstale":"2024-03-09T15:11:38.654007+0000","last_undegraded":"2024-03-09T15:11:38.654007+0000","last_fullsized":"2024-03-09T15:11:38.654007+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:27:09.685607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12290,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":235,"num_read_kb":289,"num_write":106,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.559028+0000","last_change":"2024-03-09T14:26:34.673997+0000","last_active":"2024-03-09T15:07:46.559028+0000","last_peered":"2024-03-09T15:07:46.559028+0000","last_clean":"2024-03-09T15:07:46.559028+0000","last_became_active":"2024-03-09T14:26:34.673715+0000","last_became_peered":"2024-03-09T14:26:34.673715+0000","last_unstale":"2024-03-09T15:07:46.559028+0000","last_undegraded":"2024-03-09T15:07:46.559028+0000","last_fullsized":"2024-03-09T15:07:46.559028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:42:47.462483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'121","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:49.854347+0000","last_change":"2024-03-09T14:26:36.673170+0000","last_active":"2024-03-09T15:10:49.854347+0000","last_peered":"2024-03-09T15:10:49.854347+0000","last_clean":"2024-03-09T15:10:49.854347+0000","last_became_active":"2024-03-09T14:26:36.672843+0000","last_became_peered":"2024-03-09T14:26:36.672843+0000","last_unstale":"2024-03-09T15:10:49.854347+0000","last_undegraded":"2024-03-09T15:10:49.854347+0000","last_fullsized":"2024-03-09T15:10:49.854347+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:17:11.123320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":286,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'745","reported_seq":2333,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.200285+0000","last_change":"2024-03-09T14:26:28.657382+0000","last_active":"2024-03-09T15:11:09.200285+0000","last_peered":"2024-03-09T15:11:09.200285+0000","last_clean":"2024-03-09T15:11:09.200285+0000","last_became_active":"2024-03-09T14:26:28.656983+0000","last_became_peered":"2024-03-09T14:26:28.656983+0000","last_unstale":"2024-03-09T15:11:09.200285+0000","last_undegraded":"2024-03-09T15:11:09.200285+0000","last_fullsized":"2024-03-09T15:11:09.200285+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:26.645538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3462,"num_read_kb":3140,"num_write":976,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'175","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.745805+0000","last_change":"2024-03-09T14:27:03.724793+0000","last_active":"2024-03-09T15:11:07.745805+0000","last_peered":"2024-03-09T15:11:07.745805+0000","last_clean":"2024-03-09T15:11:07.745805+0000","last_became_active":"2024-03-09T14:27:03.724370+0000","last_became_peered":"2024-03-09T14:27:03.724370+0000","last_unstale":"2024-03-09T15:11:07.745805+0000","last_undegraded":"2024-03-09T15:11:07.745805+0000","last_fullsized":"2024-03-09T15:11:07.745805+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:39:53.570919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8270984,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":386,"num_read_kb":32223,"num_write":1029,"num_write_kb":26912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.569303+0000","last_change":"2024-03-09T14:26:30.653536+0000","last_active":"2024-03-09T15:09:16.569303+0000","last_peered":"2024-03-09T15:09:16.569303+0000","last_clean":"2024-03-09T15:09:16.569303+0000","last_became_active":"2024-03-09T14:26:30.653184+0000","last_became_peered":"2024-03-09T14:26:30.653184+0000","last_unstale":"2024-03-09T15:09:16.569303+0000","last_undegraded":"2024-03-09T15:09:16.569303+0000","last_fullsized":"2024-03-09T15:09:16.569303+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:52:00.683557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'154","reported_seq":724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.494515+0000","last_change":"2024-03-09T14:26:32.653203+0000","last_active":"2024-03-09T15:11:36.494515+0000","last_peered":"2024-03-09T15:11:36.494515+0000","last_clean":"2024-03-09T15:11:36.494515+0000","last_became_active":"2024-03-09T14:26:32.652956+0000","last_became_peered":"2024-03-09T14:26:32.652956+0000","last_unstale":"2024-03-09T15:11:36.494515+0000","last_undegraded":"2024-03-09T15:11:36.494515+0000","last_fullsized":"2024-03-09T15:11:36.494515+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:40.426986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18074,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":220,"num_read_kb":285,"num_write":176,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.567970+0000","last_change":"2024-03-09T14:26:34.675619+0000","last_active":"2024-03-09T15:07:16.567970+0000","last_peered":"2024-03-09T15:07:16.567970+0000","last_clean":"2024-03-09T15:07:16.567970+0000","last_became_active":"2024-03-09T14:26:34.675354+0000","last_became_peered":"2024-03-09T14:26:34.675354+0000","last_unstale":"2024-03-09T15:07:16.567970+0000","last_undegraded":"2024-03-09T15:07:16.567970+0000","last_fullsized":"2024-03-09T15:07:16.567970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:12:54.378319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'144","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:08.302012+0000","last_change":"2024-03-09T14:26:36.672548+0000","last_active":"2024-03-09T15:11:08.302012+0000","last_peered":"2024-03-09T15:11:08.302012+0000","last_clean":"2024-03-09T15:11:08.302012+0000","last_became_active":"2024-03-09T14:26:36.672111+0000","last_became_peered":"2024-03-09T14:26:36.672111+0000","last_unstale":"2024-03-09T15:11:08.302012+0000","last_undegraded":"2024-03-09T15:11:08.302012+0000","last_fullsized":"2024-03-09T15:11:08.302012+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:18:51.718050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":110,"num_write":237,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'510","reported_seq":1980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:31.567905+0000","last_change":"2024-03-09T14:26:28.651133+0000","last_active":"2024-03-09T15:10:31.567905+0000","last_peered":"2024-03-09T15:10:31.567905+0000","last_clean":"2024-03-09T15:10:31.567905+0000","last_became_active":"2024-03-09T14:26:28.650560+0000","last_became_peered":"2024-03-09T14:26:28.650560+0000","last_unstale":"2024-03-09T15:10:31.567905+0000","last_undegraded":"2024-03-09T15:10:31.567905+0000","last_fullsized":"2024-03-09T15:10:31.567905+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:59:27.981231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2567,"num_read_kb":2395,"num_write":702,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'169","reported_seq":749,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:25.559961+0000","last_change":"2024-03-09T14:26:26.644672+0000","last_active":"2024-03-09T15:10:25.559961+0000","last_peered":"2024-03-09T15:10:25.559961+0000","last_clean":"2024-03-09T15:10:25.559961+0000","last_became_active":"2024-03-09T14:26:26.644347+0000","last_became_peered":"2024-03-09T14:26:26.644347+0000","last_unstale":"2024-03-09T15:10:25.559961+0000","last_undegraded":"2024-03-09T15:10:25.559961+0000","last_fullsized":"2024-03-09T15:10:25.559961+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:38.187729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4479180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":341,"num_read_kb":3953,"num_write":940,"num_write_kb":27527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.573925+0000","last_change":"2024-03-09T14:26:30.654838+0000","last_active":"2024-03-09T15:09:16.573925+0000","last_peered":"2024-03-09T15:09:16.573925+0000","last_clean":"2024-03-09T15:09:16.573925+0000","last_became_active":"2024-03-09T14:26:30.654575+0000","last_became_peered":"2024-03-09T14:26:30.654575+0000","last_unstale":"2024-03-09T15:09:16.573925+0000","last_undegraded":"2024-03-09T15:09:16.573925+0000","last_fullsized":"2024-03-09T15:09:16.573925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:39.725009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'141","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:31.570934+0000","last_change":"2024-03-09T14:26:32.660279+0000","last_active":"2024-03-09T15:09:31.570934+0000","last_peered":"2024-03-09T15:09:31.570934+0000","last_clean":"2024-03-09T15:09:31.570934+0000","last_became_active":"2024-03-09T14:26:32.659984+0000","last_became_peered":"2024-03-09T14:26:32.659984+0000","last_unstale":"2024-03-09T15:09:31.570934+0000","last_undegraded":"2024-03-09T15:09:31.570934+0000","last_fullsized":"2024-03-09T15:09:31.570934+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:08.563248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15183,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":196,"num_read_kb":257,"num_write":108,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'502","reported_seq":2219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.693554+0000","last_change":"2024-03-09T14:26:34.673343+0000","last_active":"2024-03-09T15:11:38.693554+0000","last_peered":"2024-03-09T15:11:38.693554+0000","last_clean":"2024-03-09T15:11:38.693554+0000","last_became_active":"2024-03-09T14:26:34.673054+0000","last_became_peered":"2024-03-09T14:26:34.673054+0000","last_unstale":"2024-03-09T15:11:38.693554+0000","last_undegraded":"2024-03-09T15:11:38.693554+0000","last_fullsized":"2024-03-09T15:11:38.693554+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:53.004843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'97","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.765724+0000","last_change":"2024-03-09T14:26:36.668508+0000","last_active":"2024-03-09T15:10:35.765724+0000","last_peered":"2024-03-09T15:10:35.765724+0000","last_clean":"2024-03-09T15:10:35.765724+0000","last_became_active":"2024-03-09T14:26:36.668217+0000","last_became_peered":"2024-03-09T14:26:36.668217+0000","last_unstale":"2024-03-09T15:10:35.765724+0000","last_undegraded":"2024-03-09T15:10:35.765724+0000","last_fullsized":"2024-03-09T15:10:35.765724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:12:50.274345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":82,"num_write":217,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'678","reported_seq":2377,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.078332+0000","last_change":"2024-03-09T14:26:28.648677+0000","last_active":"2024-03-09T15:10:51.078332+0000","last_peered":"2024-03-09T15:10:51.078332+0000","last_clean":"2024-03-09T15:10:51.078332+0000","last_became_active":"2024-03-09T14:26:28.648408+0000","last_became_peered":"2024-03-09T14:26:28.648408+0000","last_unstale":"2024-03-09T15:10:51.078332+0000","last_undegraded":"2024-03-09T15:10:51.078332+0000","last_fullsized":"2024-03-09T15:10:51.078332+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:36:20.272704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3385,"num_read_kb":3042,"num_write":948,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'218","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.586731+0000","last_change":"2024-03-09T14:26:26.643846+0000","last_active":"2024-03-09T15:07:36.586731+0000","last_peered":"2024-03-09T15:07:36.586731+0000","last_clean":"2024-03-09T15:07:36.586731+0000","last_became_active":"2024-03-09T14:26:26.643522+0000","last_became_peered":"2024-03-09T14:26:26.643522+0000","last_unstale":"2024-03-09T15:07:36.586731+0000","last_undegraded":"2024-03-09T15:07:36.586731+0000","last_fullsized":"2024-03-09T15:07:36.586731+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:35.944430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14178549,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":448,"num_read_kb":51521,"num_write":1231,"num_write_kb":50999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.418039+0000","last_change":"2024-03-09T14:26:30.652855+0000","last_active":"2024-03-09T15:11:38.418039+0000","last_peered":"2024-03-09T15:11:38.418039+0000","last_clean":"2024-03-09T15:11:38.418039+0000","last_became_active":"2024-03-09T14:26:30.652594+0000","last_became_peered":"2024-03-09T14:26:30.652594+0000","last_unstale":"2024-03-09T15:11:38.418039+0000","last_undegraded":"2024-03-09T15:11:38.418039+0000","last_fullsized":"2024-03-09T15:11:38.418039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:25.009722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":626,"num_read_kb":626,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'78","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.685232+0000","last_change":"2024-03-09T14:26:32.868538+0000","last_active":"2024-03-09T15:09:21.685232+0000","last_peered":"2024-03-09T15:09:21.685232+0000","last_clean":"2024-03-09T15:09:21.685232+0000","last_became_active":"2024-03-09T14:26:32.868147+0000","last_became_peered":"2024-03-09T14:26:32.868147+0000","last_unstale":"2024-03-09T15:09:21.685232+0000","last_undegraded":"2024-03-09T15:09:21.685232+0000","last_fullsized":"2024-03-09T15:09:21.685232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:01:35.357782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'531","reported_seq":2283,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.690271+0000","last_change":"2024-03-09T14:26:34.670121+0000","last_active":"2024-03-09T15:11:38.690271+0000","last_peered":"2024-03-09T15:11:38.690271+0000","last_clean":"2024-03-09T15:11:38.690271+0000","last_became_active":"2024-03-09T14:26:34.669695+0000","last_became_peered":"2024-03-09T14:26:34.669695+0000","last_unstale":"2024-03-09T15:11:38.690271+0000","last_undegraded":"2024-03-09T15:11:38.690271+0000","last_fullsized":"2024-03-09T15:11:38.690271+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:34:05.625218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'142","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:52.263284+0000","last_change":"2024-03-09T14:26:36.668658+0000","last_active":"2024-03-09T15:09:52.263284+0000","last_peered":"2024-03-09T15:09:52.263284+0000","last_clean":"2024-03-09T15:09:52.263284+0000","last_became_active":"2024-03-09T14:26:36.668361+0000","last_became_peered":"2024-03-09T14:26:36.668361+0000","last_unstale":"2024-03-09T15:09:52.263284+0000","last_undegraded":"2024-03-09T15:09:52.263284+0000","last_fullsized":"2024-03-09T15:09:52.263284+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:40.438535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":387,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":346,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'485","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.448831+0000","last_change":"2024-03-09T14:26:28.654782+0000","last_active":"2024-03-09T15:11:04.448831+0000","last_peered":"2024-03-09T15:11:04.448831+0000","last_clean":"2024-03-09T15:11:04.448831+0000","last_became_active":"2024-03-09T14:26:28.654325+0000","last_became_peered":"2024-03-09T14:26:28.654325+0000","last_unstale":"2024-03-09T15:11:04.448831+0000","last_undegraded":"2024-03-09T15:11:04.448831+0000","last_fullsized":"2024-03-09T15:11:04.448831+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:42.930737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2761,"num_read_kb":2604,"num_write":649,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'182","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.482602+0000","last_change":"2024-03-09T14:26:26.652669+0000","last_active":"2024-03-09T15:07:45.482602+0000","last_peered":"2024-03-09T15:07:45.482602+0000","last_clean":"2024-03-09T15:07:45.482602+0000","last_became_active":"2024-03-09T14:26:26.652273+0000","last_became_peered":"2024-03-09T14:26:26.652273+0000","last_unstale":"2024-03-09T15:07:45.482602+0000","last_undegraded":"2024-03-09T15:07:45.482602+0000","last_fullsized":"2024-03-09T15:07:45.482602+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:08:00.596097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9022863,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":356,"num_read_kb":15479,"num_write":992,"num_write_kb":26748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.600254+0000","last_change":"2024-03-09T14:26:30.652256+0000","last_active":"2024-03-09T15:09:16.600254+0000","last_peered":"2024-03-09T15:09:16.600254+0000","last_clean":"2024-03-09T15:09:16.600254+0000","last_became_active":"2024-03-09T14:26:30.651949+0000","last_became_peered":"2024-03-09T14:26:30.651949+0000","last_unstale":"2024-03-09T15:09:16.600254+0000","last_undegraded":"2024-03-09T15:09:16.600254+0000","last_fullsized":"2024-03-09T15:09:16.600254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:35.514543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'184","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.604763+0000","last_change":"2024-03-09T14:26:32.658049+0000","last_active":"2024-03-09T15:11:36.604763+0000","last_peered":"2024-03-09T15:11:36.604763+0000","last_clean":"2024-03-09T15:11:36.604763+0000","last_became_active":"2024-03-09T14:26:32.656959+0000","last_became_peered":"2024-03-09T14:26:32.656959+0000","last_unstale":"2024-03-09T15:11:36.604763+0000","last_undegraded":"2024-03-09T15:11:36.604763+0000","last_fullsized":"2024-03-09T15:11:36.604763+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:00:25.716853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12977,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":255,"num_read_kb":308,"num_write":148,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.600784+0000","last_change":"2024-03-09T14:26:34.675814+0000","last_active":"2024-03-09T15:09:21.600784+0000","last_peered":"2024-03-09T15:09:21.600784+0000","last_clean":"2024-03-09T15:09:21.600784+0000","last_became_active":"2024-03-09T14:26:34.675350+0000","last_became_peered":"2024-03-09T14:26:34.675350+0000","last_unstale":"2024-03-09T15:09:21.600784+0000","last_undegraded":"2024-03-09T15:09:21.600784+0000","last_fullsized":"2024-03-09T15:09:21.600784+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:43.105375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'122","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:31.932959+0000","last_change":"2024-03-09T14:26:36.673342+0000","last_active":"2024-03-09T15:10:31.932959+0000","last_peered":"2024-03-09T15:10:31.932959+0000","last_clean":"2024-03-09T15:10:31.932959+0000","last_became_active":"2024-03-09T14:26:36.673059+0000","last_became_peered":"2024-03-09T14:26:36.673059+0000","last_unstale":"2024-03-09T15:10:31.932959+0000","last_undegraded":"2024-03-09T15:10:31.932959+0000","last_fullsized":"2024-03-09T15:10:31.932959+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:24:05.127996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":194,"num_write":274,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'855","reported_seq":2474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.169290+0000","last_change":"2024-03-09T14:26:28.653445+0000","last_active":"2024-03-09T15:11:09.169290+0000","last_peered":"2024-03-09T15:11:09.169290+0000","last_clean":"2024-03-09T15:11:09.169290+0000","last_became_active":"2024-03-09T14:26:28.653261+0000","last_became_peered":"2024-03-09T14:26:28.653261+0000","last_unstale":"2024-03-09T15:11:09.169290+0000","last_undegraded":"2024-03-09T15:11:09.169290+0000","last_fullsized":"2024-03-09T15:11:09.169290+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:52:30.405371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3846,"num_read_kb":3440,"num_write":1147,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.713861+0000","last_change":"2024-03-09T14:26:13.798768+0000","last_active":"2024-03-09T15:08:21.713861+0000","last_peered":"2024-03-09T15:08:21.713861+0000","last_clean":"2024-03-09T15:08:21.713861+0000","last_became_active":"2024-03-09T14:26:13.797817+0000","last_became_peered":"2024-03-09T14:26:13.797817+0000","last_unstale":"2024-03-09T15:08:21.713861+0000","last_undegraded":"2024-03-09T15:08:21.713861+0000","last_fullsized":"2024-03-09T15:08:21.713861+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_clean_scrub_stamp":"2024-03-09T14:26:12.541311+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:56:57.729803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.575317+0000","last_change":"2024-03-09T14:26:18.581955+0000","last_active":"2024-03-09T15:08:01.575317+0000","last_peered":"2024-03-09T15:08:01.575317+0000","last_clean":"2024-03-09T15:08:01.575317+0000","last_became_active":"2024-03-09T14:26:18.581598+0000","last_became_peered":"2024-03-09T14:26:18.581598+0000","last_unstale":"2024-03-09T15:08:01.575317+0000","last_undegraded":"2024-03-09T15:08:01.575317+0000","last_fullsized":"2024-03-09T15:08:01.575317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:38:36.176997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'175","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:52.845578+0000","last_change":"2024-03-09T14:26:26.645174+0000","last_active":"2024-03-09T15:09:52.845578+0000","last_peered":"2024-03-09T15:09:52.845578+0000","last_clean":"2024-03-09T15:09:52.845578+0000","last_became_active":"2024-03-09T14:26:26.644848+0000","last_became_peered":"2024-03-09T14:26:26.644848+0000","last_unstale":"2024-03-09T15:09:52.845578+0000","last_undegraded":"2024-03-09T15:09:52.845578+0000","last_fullsized":"2024-03-09T15:09:52.845578+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:09:13.899449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17619055,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":337,"num_read_kb":37512,"num_write":1000,"num_write_kb":40555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.712568+0000","last_change":"2024-03-09T14:26:30.650647+0000","last_active":"2024-03-09T15:08:11.712568+0000","last_peered":"2024-03-09T15:08:11.712568+0000","last_clean":"2024-03-09T15:08:11.712568+0000","last_became_active":"2024-03-09T14:26:30.650376+0000","last_became_peered":"2024-03-09T14:26:30.650376+0000","last_unstale":"2024-03-09T15:08:11.712568+0000","last_undegraded":"2024-03-09T15:08:11.712568+0000","last_fullsized":"2024-03-09T15:08:11.712568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:35.280770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'290","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.672714+0000","last_change":"2024-03-09T14:26:32.658070+0000","last_active":"2024-03-09T15:11:38.672714+0000","last_peered":"2024-03-09T15:11:38.672714+0000","last_clean":"2024-03-09T15:11:38.672714+0000","last_became_active":"2024-03-09T14:26:32.657752+0000","last_became_peered":"2024-03-09T14:26:32.657752+0000","last_unstale":"2024-03-09T15:11:38.672714+0000","last_undegraded":"2024-03-09T15:11:38.672714+0000","last_fullsized":"2024-03-09T15:11:38.672714+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:31.136392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38712,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":719,"num_write":470,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.571341+0000","last_change":"2024-03-09T14:26:34.671261+0000","last_active":"2024-03-09T15:07:46.571341+0000","last_peered":"2024-03-09T15:07:46.571341+0000","last_clean":"2024-03-09T15:07:46.571341+0000","last_became_active":"2024-03-09T14:26:34.670987+0000","last_became_peered":"2024-03-09T14:26:34.670987+0000","last_unstale":"2024-03-09T15:07:46.571341+0000","last_undegraded":"2024-03-09T15:07:46.571341+0000","last_fullsized":"2024-03-09T15:07:46.571341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:48.297381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'204","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:26.958614+0000","last_change":"2024-03-09T14:26:36.672227+0000","last_active":"2024-03-09T15:10:26.958614+0000","last_peered":"2024-03-09T15:10:26.958614+0000","last_clean":"2024-03-09T15:10:26.958614+0000","last_became_active":"2024-03-09T14:26:36.671941+0000","last_became_peered":"2024-03-09T14:26:36.671941+0000","last_unstale":"2024-03-09T15:10:26.958614+0000","last_undegraded":"2024-03-09T15:10:26.958614+0000","last_fullsized":"2024-03-09T15:10:26.958614+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:49:17.903765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":432,"num_read_kb":416,"num_write":433,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'391","reported_seq":1981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:49.432074+0000","last_change":"2024-03-09T14:26:28.652892+0000","last_active":"2024-03-09T15:10:49.432074+0000","last_peered":"2024-03-09T15:10:49.432074+0000","last_clean":"2024-03-09T15:10:49.432074+0000","last_became_active":"2024-03-09T14:26:28.652611+0000","last_became_peered":"2024-03-09T14:26:28.652611+0000","last_unstale":"2024-03-09T15:10:49.432074+0000","last_undegraded":"2024-03-09T15:10:49.432074+0000","last_fullsized":"2024-03-09T15:10:49.432074+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:02:24.839775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2259,"num_read_kb":2164,"num_write":448,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.714524+0000","last_change":"2024-03-09T14:26:18.582346+0000","last_active":"2024-03-09T15:08:26.714524+0000","last_peered":"2024-03-09T15:08:26.714524+0000","last_clean":"2024-03-09T15:08:26.714524+0000","last_became_active":"2024-03-09T14:26:18.581306+0000","last_became_peered":"2024-03-09T14:26:18.581306+0000","last_unstale":"2024-03-09T15:08:26.714524+0000","last_undegraded":"2024-03-09T15:08:26.714524+0000","last_fullsized":"2024-03-09T15:08:26.714524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:30.980957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'135","reported_seq":734,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.573626+0000","last_change":"2024-03-09T14:26:26.632618+0000","last_active":"2024-03-09T15:08:06.573626+0000","last_peered":"2024-03-09T15:08:06.573626+0000","last_clean":"2024-03-09T15:08:06.573626+0000","last_became_active":"2024-03-09T14:26:26.632272+0000","last_became_peered":"2024-03-09T14:26:26.632272+0000","last_unstale":"2024-03-09T15:08:06.573626+0000","last_undegraded":"2024-03-09T15:08:06.573626+0000","last_fullsized":"2024-03-09T15:08:06.573626+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:03.965638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194333,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":281,"num_read_kb":61756,"num_write":786,"num_write_kb":21716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.573097+0000","last_change":"2024-03-09T14:26:30.655248+0000","last_active":"2024-03-09T15:07:41.573097+0000","last_peered":"2024-03-09T15:07:41.573097+0000","last_clean":"2024-03-09T15:07:41.573097+0000","last_became_active":"2024-03-09T14:26:30.654922+0000","last_became_peered":"2024-03-09T14:26:30.654922+0000","last_unstale":"2024-03-09T15:07:41.573097+0000","last_undegraded":"2024-03-09T15:07:41.573097+0000","last_fullsized":"2024-03-09T15:07:41.573097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:41:46.097520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'681","reported_seq":2057,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.701069+0000","last_change":"2024-03-09T14:26:32.655775+0000","last_active":"2024-03-09T15:11:38.701069+0000","last_peered":"2024-03-09T15:11:38.701069+0000","last_clean":"2024-03-09T15:11:38.701069+0000","last_became_active":"2024-03-09T14:26:32.655430+0000","last_became_peered":"2024-03-09T14:26:32.655430+0000","last_unstale":"2024-03-09T15:11:38.701069+0000","last_undegraded":"2024-03-09T15:11:38.701069+0000","last_fullsized":"2024-03-09T15:11:38.701069+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":600,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:38:38.807873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21406,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":898,"num_read_kb":1030,"num_write":284,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.713974+0000","last_change":"2024-03-09T14:26:34.678707+0000","last_active":"2024-03-09T15:08:21.713974+0000","last_peered":"2024-03-09T15:08:21.713974+0000","last_clean":"2024-03-09T15:08:21.713974+0000","last_became_active":"2024-03-09T14:26:34.678431+0000","last_became_peered":"2024-03-09T14:26:34.678431+0000","last_unstale":"2024-03-09T15:08:21.713974+0000","last_undegraded":"2024-03-09T15:08:21.713974+0000","last_fullsized":"2024-03-09T15:08:21.713974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:25.952912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'162","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:19.730383+0000","last_change":"2024-03-09T14:26:36.785121+0000","last_active":"2024-03-09T15:11:19.730383+0000","last_peered":"2024-03-09T15:11:19.730383+0000","last_clean":"2024-03-09T15:11:19.730383+0000","last_became_active":"2024-03-09T14:26:36.784815+0000","last_became_peered":"2024-03-09T14:26:36.784815+0000","last_unstale":"2024-03-09T15:11:19.730383+0000","last_undegraded":"2024-03-09T15:11:19.730383+0000","last_fullsized":"2024-03-09T15:11:19.730383+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:32:28.804163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":213,"num_read_kb":212,"num_write":359,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'794","reported_seq":2457,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.129970+0000","last_change":"2024-03-09T14:26:28.650746+0000","last_active":"2024-03-09T15:11:37.129970+0000","last_peered":"2024-03-09T15:11:37.129970+0000","last_clean":"2024-03-09T15:11:37.129970+0000","last_became_active":"2024-03-09T14:26:28.650409+0000","last_became_peered":"2024-03-09T14:26:28.650409+0000","last_unstale":"2024-03-09T15:11:37.129970+0000","last_undegraded":"2024-03-09T15:11:37.129970+0000","last_fullsized":"2024-03-09T15:11:37.129970+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:56:59.410066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3830,"num_read_kb":3466,"num_write":1049,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.560159+0000","last_change":"2024-03-09T14:26:18.577541+0000","last_active":"2024-03-09T15:07:56.560159+0000","last_peered":"2024-03-09T15:07:56.560159+0000","last_clean":"2024-03-09T15:07:56.560159+0000","last_became_active":"2024-03-09T14:26:18.577041+0000","last_became_peered":"2024-03-09T14:26:18.577041+0000","last_unstale":"2024-03-09T15:07:56.560159+0000","last_undegraded":"2024-03-09T15:07:56.560159+0000","last_fullsized":"2024-03-09T15:07:56.560159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:35.300799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'173","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.569025+0000","last_change":"2024-03-09T14:26:26.636212+0000","last_active":"2024-03-09T15:08:31.569025+0000","last_peered":"2024-03-09T15:08:31.569025+0000","last_clean":"2024-03-09T15:08:31.569025+0000","last_became_active":"2024-03-09T14:26:26.635771+0000","last_became_peered":"2024-03-09T14:26:26.635771+0000","last_unstale":"2024-03-09T15:08:31.569025+0000","last_undegraded":"2024-03-09T15:08:31.569025+0000","last_fullsized":"2024-03-09T15:08:31.569025+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:05.752386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6276296,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":354,"num_read_kb":5368,"num_write":1011,"num_write_kb":33352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"35'5","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.407443+0000","last_change":"2024-03-09T14:26:30.651034+0000","last_active":"2024-03-09T15:11:38.407443+0000","last_peered":"2024-03-09T15:11:38.407443+0000","last_clean":"2024-03-09T15:11:38.407443+0000","last_became_active":"2024-03-09T14:26:30.650766+0000","last_became_peered":"2024-03-09T14:26:30.650766+0000","last_unstale":"2024-03-09T15:11:38.407443+0000","last_undegraded":"2024-03-09T15:11:38.407443+0000","last_fullsized":"2024-03-09T15:11:38.407443+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:00.425079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1149,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":782,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'246","reported_seq":1320,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.821315+0000","last_change":"2024-03-09T14:26:32.869468+0000","last_active":"2024-03-09T15:11:38.821315+0000","last_peered":"2024-03-09T15:11:38.821315+0000","last_clean":"2024-03-09T15:11:38.821315+0000","last_became_active":"2024-03-09T14:26:32.868092+0000","last_became_peered":"2024-03-09T14:26:32.868092+0000","last_unstale":"2024-03-09T15:11:38.821315+0000","last_undegraded":"2024-03-09T15:11:38.821315+0000","last_fullsized":"2024-03-09T15:11:38.821315+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:31:58.327354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":188,"num_read_kb":180,"num_write":173,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:16.574728+0000","last_change":"2024-03-09T14:26:34.666767+0000","last_active":"2024-03-09T15:08:16.574728+0000","last_peered":"2024-03-09T15:08:16.574728+0000","last_clean":"2024-03-09T15:08:16.574728+0000","last_became_active":"2024-03-09T14:26:34.666484+0000","last_became_peered":"2024-03-09T14:26:34.666484+0000","last_unstale":"2024-03-09T15:08:16.574728+0000","last_undegraded":"2024-03-09T15:08:16.574728+0000","last_fullsized":"2024-03-09T15:08:16.574728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:42:45.793755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'255","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:03.057657+0000","last_change":"2024-03-09T14:26:36.674946+0000","last_active":"2024-03-09T15:10:03.057657+0000","last_peered":"2024-03-09T15:10:03.057657+0000","last_clean":"2024-03-09T15:10:03.057657+0000","last_became_active":"2024-03-09T14:26:36.674637+0000","last_became_peered":"2024-03-09T14:26:36.674637+0000","last_unstale":"2024-03-09T15:10:03.057657+0000","last_undegraded":"2024-03-09T15:10:03.057657+0000","last_fullsized":"2024-03-09T15:10:03.057657+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:25.308980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":491,"num_write":562,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'351","reported_seq":1818,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.871971+0000","last_change":"2024-03-09T14:26:28.646960+0000","last_active":"2024-03-09T15:11:07.871971+0000","last_peered":"2024-03-09T15:11:07.871971+0000","last_clean":"2024-03-09T15:11:07.871971+0000","last_became_active":"2024-03-09T14:26:28.646594+0000","last_became_peered":"2024-03-09T14:26:28.646594+0000","last_unstale":"2024-03-09T15:11:07.871971+0000","last_undegraded":"2024-03-09T15:11:07.871971+0000","last_fullsized":"2024-03-09T15:11:07.871971+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:27:04.392681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1989,"num_read_kb":1907,"num_write":411,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.575282+0000","last_change":"2024-03-09T14:26:18.581769+0000","last_active":"2024-03-09T15:08:01.575282+0000","last_peered":"2024-03-09T15:08:01.575282+0000","last_clean":"2024-03-09T15:08:01.575282+0000","last_became_active":"2024-03-09T14:26:18.581330+0000","last_became_peered":"2024-03-09T14:26:18.581330+0000","last_unstale":"2024-03-09T15:08:01.575282+0000","last_undegraded":"2024-03-09T15:08:01.575282+0000","last_fullsized":"2024-03-09T15:08:01.575282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:58.260466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'262","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:08.456038+0000","last_change":"2024-03-09T14:27:03.720094+0000","last_active":"2024-03-09T15:09:08.456038+0000","last_peered":"2024-03-09T15:09:08.456038+0000","last_clean":"2024-03-09T15:09:08.456038+0000","last_became_active":"2024-03-09T14:27:03.719517+0000","last_became_peered":"2024-03-09T14:27:03.719517+0000","last_unstale":"2024-03-09T15:09:08.456038+0000","last_undegraded":"2024-03-09T15:09:08.456038+0000","last_fullsized":"2024-03-09T15:09:08.456038+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:29:42.092045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8390664,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1104,"num_read_kb":25709,"num_write":1304,"num_write_kb":24224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.575225+0000","last_change":"2024-03-09T14:26:30.646463+0000","last_active":"2024-03-09T15:08:21.575225+0000","last_peered":"2024-03-09T15:08:21.575225+0000","last_clean":"2024-03-09T15:08:21.575225+0000","last_became_active":"2024-03-09T14:26:30.646190+0000","last_became_peered":"2024-03-09T14:26:30.646190+0000","last_unstale":"2024-03-09T15:08:21.575225+0000","last_undegraded":"2024-03-09T15:08:21.575225+0000","last_fullsized":"2024-03-09T15:08:21.575225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:39:12.950657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'108","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:43.733396+0000","last_change":"2024-03-09T14:26:32.650252+0000","last_active":"2024-03-09T15:08:43.733396+0000","last_peered":"2024-03-09T15:08:43.733396+0000","last_clean":"2024-03-09T15:08:43.733396+0000","last_became_active":"2024-03-09T14:26:32.650020+0000","last_became_peered":"2024-03-09T14:26:32.650020+0000","last_unstale":"2024-03-09T15:08:43.733396+0000","last_undegraded":"2024-03-09T15:08:43.733396+0000","last_fullsized":"2024-03-09T15:08:43.733396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:18:23.773127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":130,"num_write":96,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588167+0000","last_change":"2024-03-09T14:26:34.667767+0000","last_active":"2024-03-09T15:07:46.588167+0000","last_peered":"2024-03-09T15:07:46.588167+0000","last_clean":"2024-03-09T15:07:46.588167+0000","last_became_active":"2024-03-09T14:26:34.667409+0000","last_became_peered":"2024-03-09T14:26:34.667409+0000","last_unstale":"2024-03-09T15:07:46.588167+0000","last_undegraded":"2024-03-09T15:07:46.588167+0000","last_fullsized":"2024-03-09T15:07:46.588167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:39:12.935329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'126","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.598323+0000","last_change":"2024-03-09T14:26:36.674661+0000","last_active":"2024-03-09T15:10:42.598323+0000","last_peered":"2024-03-09T15:10:42.598323+0000","last_clean":"2024-03-09T15:10:42.598323+0000","last_became_active":"2024-03-09T14:26:36.674343+0000","last_became_peered":"2024-03-09T14:26:36.674343+0000","last_unstale":"2024-03-09T15:10:42.598323+0000","last_undegraded":"2024-03-09T15:10:42.598323+0000","last_fullsized":"2024-03-09T15:10:42.598323+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:49.926126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":182,"num_write":308,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'425","reported_seq":2180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.316492+0000","last_change":"2024-03-09T14:26:28.656196+0000","last_active":"2024-03-09T15:10:45.316492+0000","last_peered":"2024-03-09T15:10:45.316492+0000","last_clean":"2024-03-09T15:10:45.316492+0000","last_became_active":"2024-03-09T14:26:28.655479+0000","last_became_peered":"2024-03-09T14:26:28.655479+0000","last_unstale":"2024-03-09T15:10:45.316492+0000","last_undegraded":"2024-03-09T15:10:45.316492+0000","last_fullsized":"2024-03-09T15:10:45.316492+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:41.351260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2618,"num_read_kb":2506,"num_write":497,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'269","reported_seq":1002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:52.126933+0000","last_change":"2024-03-09T14:26:26.650096+0000","last_active":"2024-03-09T15:09:52.126933+0000","last_peered":"2024-03-09T15:09:52.126933+0000","last_clean":"2024-03-09T15:09:52.126933+0000","last_became_active":"2024-03-09T14:26:26.649325+0000","last_became_peered":"2024-03-09T14:26:26.649325+0000","last_unstale":"2024-03-09T15:09:52.126933+0000","last_undegraded":"2024-03-09T15:09:52.126933+0000","last_fullsized":"2024-03-09T15:09:52.126933+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:00:26.744072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11172498,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":944,"num_read_kb":64620,"num_write":1392,"num_write_kb":23267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.565283+0000","last_change":"2024-03-09T14:26:18.579051+0000","last_active":"2024-03-09T15:08:01.565283+0000","last_peered":"2024-03-09T15:08:01.565283+0000","last_clean":"2024-03-09T15:08:01.565283+0000","last_became_active":"2024-03-09T14:26:18.578807+0000","last_became_peered":"2024-03-09T14:26:18.578807+0000","last_unstale":"2024-03-09T15:08:01.565283+0000","last_undegraded":"2024-03-09T15:08:01.565283+0000","last_fullsized":"2024-03-09T15:08:01.565283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:16:28.179997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.574166+0000","last_change":"2024-03-09T14:26:30.648960+0000","last_active":"2024-03-09T15:08:11.574166+0000","last_peered":"2024-03-09T15:08:11.574166+0000","last_clean":"2024-03-09T15:08:11.574166+0000","last_became_active":"2024-03-09T14:26:30.648619+0000","last_became_peered":"2024-03-09T14:26:30.648619+0000","last_unstale":"2024-03-09T15:08:11.574166+0000","last_undegraded":"2024-03-09T15:08:11.574166+0000","last_fullsized":"2024-03-09T15:08:11.574166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:18.621839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'266","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.684052+0000","last_change":"2024-03-09T14:26:32.654402+0000","last_active":"2024-03-09T15:11:38.684052+0000","last_peered":"2024-03-09T15:11:38.684052+0000","last_clean":"2024-03-09T15:11:38.684052+0000","last_became_active":"2024-03-09T14:26:32.653912+0000","last_became_peered":"2024-03-09T14:26:32.653912+0000","last_unstale":"2024-03-09T15:11:38.684052+0000","last_undegraded":"2024-03-09T15:11:38.684052+0000","last_fullsized":"2024-03-09T15:11:38.684052+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:56.284532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23916,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":998,"num_read_kb":1067,"num_write":1504,"num_write_kb":1367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:16.591995+0000","last_change":"2024-03-09T14:26:34.675583+0000","last_active":"2024-03-09T15:08:16.591995+0000","last_peered":"2024-03-09T15:08:16.591995+0000","last_clean":"2024-03-09T15:08:16.591995+0000","last_became_active":"2024-03-09T14:26:34.675234+0000","last_became_peered":"2024-03-09T14:26:34.675234+0000","last_unstale":"2024-03-09T15:08:16.591995+0000","last_undegraded":"2024-03-09T15:08:16.591995+0000","last_fullsized":"2024-03-09T15:08:16.591995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:00:48.565032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'165","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.434217+0000","last_change":"2024-03-09T14:26:36.786450+0000","last_active":"2024-03-09T15:11:04.434217+0000","last_peered":"2024-03-09T15:11:04.434217+0000","last_clean":"2024-03-09T15:11:04.434217+0000","last_became_active":"2024-03-09T14:26:36.786088+0000","last_became_peered":"2024-03-09T14:26:36.786088+0000","last_unstale":"2024-03-09T15:11:04.434217+0000","last_undegraded":"2024-03-09T15:11:04.434217+0000","last_fullsized":"2024-03-09T15:11:04.434217+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:44.688510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":687,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":146,"num_write":429,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'835","reported_seq":2538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.876837+0000","last_change":"2024-03-09T14:26:28.646272+0000","last_active":"2024-03-09T15:11:07.876837+0000","last_peered":"2024-03-09T15:11:07.876837+0000","last_clean":"2024-03-09T15:11:07.876837+0000","last_became_active":"2024-03-09T14:26:28.645944+0000","last_became_peered":"2024-03-09T14:26:28.645944+0000","last_unstale":"2024-03-09T15:11:07.876837+0000","last_undegraded":"2024-03-09T15:11:07.876837+0000","last_fullsized":"2024-03-09T15:11:07.876837+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:09.470917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4110,"num_read_kb":3687,"num_write":1137,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'198","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.404922+0000","last_change":"2024-03-09T14:26:26.640197+0000","last_active":"2024-03-09T15:10:54.404922+0000","last_peered":"2024-03-09T15:10:54.404922+0000","last_clean":"2024-03-09T15:10:54.404922+0000","last_became_active":"2024-03-09T14:26:26.639853+0000","last_became_peered":"2024-03-09T14:26:26.639853+0000","last_unstale":"2024-03-09T15:10:54.404922+0000","last_undegraded":"2024-03-09T15:10:54.404922+0000","last_fullsized":"2024-03-09T15:10:54.404922+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:01:10.961843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6188704,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":10153,"num_write":1143,"num_write_kb":29784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.711777+0000","last_change":"2024-03-09T14:26:18.582360+0000","last_active":"2024-03-09T15:08:06.711777+0000","last_peered":"2024-03-09T15:08:06.711777+0000","last_clean":"2024-03-09T15:08:06.711777+0000","last_became_active":"2024-03-09T14:26:18.581750+0000","last_became_peered":"2024-03-09T14:26:18.581750+0000","last_unstale":"2024-03-09T15:08:06.711777+0000","last_undegraded":"2024-03-09T15:08:06.711777+0000","last_fullsized":"2024-03-09T15:08:06.711777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:51.952352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591427+0000","last_change":"2024-03-09T14:26:30.649458+0000","last_active":"2024-03-09T15:08:11.591427+0000","last_peered":"2024-03-09T15:08:11.591427+0000","last_clean":"2024-03-09T15:08:11.591427+0000","last_became_active":"2024-03-09T14:26:30.649176+0000","last_became_peered":"2024-03-09T14:26:30.649176+0000","last_unstale":"2024-03-09T15:08:11.591427+0000","last_undegraded":"2024-03-09T15:08:11.591427+0000","last_fullsized":"2024-03-09T15:08:11.591427+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:32:57.186116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'186","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:12.268768+0000","last_change":"2024-03-09T14:26:32.868553+0000","last_active":"2024-03-09T15:11:12.268768+0000","last_peered":"2024-03-09T15:11:12.268768+0000","last_clean":"2024-03-09T15:11:12.268768+0000","last_became_active":"2024-03-09T14:26:32.868165+0000","last_became_peered":"2024-03-09T14:26:32.868165+0000","last_unstale":"2024-03-09T15:11:12.268768+0000","last_undegraded":"2024-03-09T15:11:12.268768+0000","last_fullsized":"2024-03-09T15:11:12.268768+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:54:17.205454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":224,"num_write":210,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'554","reported_seq":2219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.637557+0000","last_change":"2024-03-09T14:26:34.673130+0000","last_active":"2024-03-09T15:11:38.637557+0000","last_peered":"2024-03-09T15:11:38.637557+0000","last_clean":"2024-03-09T15:11:38.637557+0000","last_became_active":"2024-03-09T14:26:34.672351+0000","last_became_peered":"2024-03-09T14:26:34.672351+0000","last_unstale":"2024-03-09T15:11:38.637557+0000","last_undegraded":"2024-03-09T15:11:38.637557+0000","last_fullsized":"2024-03-09T15:11:38.637557+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:47:41.314294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'119","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.329530+0000","last_change":"2024-03-09T14:26:36.785772+0000","last_active":"2024-03-09T15:10:45.329530+0000","last_peered":"2024-03-09T15:10:45.329530+0000","last_clean":"2024-03-09T15:10:45.329530+0000","last_became_active":"2024-03-09T14:26:36.785453+0000","last_became_peered":"2024-03-09T14:26:36.785453+0000","last_unstale":"2024-03-09T15:10:45.329530+0000","last_undegraded":"2024-03-09T15:10:45.329530+0000","last_fullsized":"2024-03-09T15:10:45.329530+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:52:43.326578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":860,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":155,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'674","reported_seq":2122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.096689+0000","last_change":"2024-03-09T14:26:28.656712+0000","last_active":"2024-03-09T15:11:01.096689+0000","last_peered":"2024-03-09T15:11:01.096689+0000","last_clean":"2024-03-09T15:11:01.096689+0000","last_became_active":"2024-03-09T14:26:28.655904+0000","last_became_peered":"2024-03-09T14:26:28.655904+0000","last_unstale":"2024-03-09T15:11:01.096689+0000","last_undegraded":"2024-03-09T15:11:01.096689+0000","last_fullsized":"2024-03-09T15:11:01.096689+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":600,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:45:14.565089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3203,"num_read_kb":2919,"num_write":883,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'217","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:13.198226+0000","last_change":"2024-03-09T14:26:26.644176+0000","last_active":"2024-03-09T15:09:13.198226+0000","last_peered":"2024-03-09T15:09:13.198226+0000","last_clean":"2024-03-09T15:09:13.198226+0000","last_became_active":"2024-03-09T14:26:26.643087+0000","last_became_peered":"2024-03-09T14:26:26.643087+0000","last_unstale":"2024-03-09T15:09:13.198226+0000","last_undegraded":"2024-03-09T15:09:13.198226+0000","last_fullsized":"2024-03-09T15:09:13.198226+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:46.349094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5550336,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":452,"num_read_kb":60158,"num_write":1084,"num_write_kb":49675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.561646+0000","last_change":"2024-03-09T14:26:18.577844+0000","last_active":"2024-03-09T15:07:26.561646+0000","last_peered":"2024-03-09T15:07:26.561646+0000","last_clean":"2024-03-09T15:07:26.561646+0000","last_became_active":"2024-03-09T14:26:18.577564+0000","last_became_peered":"2024-03-09T14:26:18.577564+0000","last_unstale":"2024-03-09T15:07:26.561646+0000","last_undegraded":"2024-03-09T15:07:26.561646+0000","last_fullsized":"2024-03-09T15:07:26.561646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:23:41.274783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591387+0000","last_change":"2024-03-09T14:26:30.650699+0000","last_active":"2024-03-09T15:08:11.591387+0000","last_peered":"2024-03-09T15:08:11.591387+0000","last_clean":"2024-03-09T15:08:11.591387+0000","last_became_active":"2024-03-09T14:26:30.650370+0000","last_became_peered":"2024-03-09T14:26:30.650370+0000","last_unstale":"2024-03-09T15:08:11.591387+0000","last_undegraded":"2024-03-09T15:08:11.591387+0000","last_fullsized":"2024-03-09T15:08:11.591387+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:48:57.173305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'101","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:44.959697+0000","last_change":"2024-03-09T14:26:32.655602+0000","last_active":"2024-03-09T15:08:44.959697+0000","last_peered":"2024-03-09T15:08:44.959697+0000","last_clean":"2024-03-09T15:08:44.959697+0000","last_became_active":"2024-03-09T14:26:32.655285+0000","last_became_peered":"2024-03-09T14:26:32.655285+0000","last_unstale":"2024-03-09T15:08:44.959697+0000","last_undegraded":"2024-03-09T15:08:44.959697+0000","last_fullsized":"2024-03-09T15:08:44.959697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:00:18.543951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":120,"num_read_kb":114,"num_write":82,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'561","reported_seq":4057,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.642164+0000","last_change":"2024-03-09T14:26:34.678783+0000","last_active":"2024-03-09T15:11:38.642164+0000","last_peered":"2024-03-09T15:11:38.642164+0000","last_clean":"2024-03-09T15:11:38.642164+0000","last_became_active":"2024-03-09T14:26:34.678503+0000","last_became_peered":"2024-03-09T14:26:34.678503+0000","last_unstale":"2024-03-09T15:11:38.642164+0000","last_undegraded":"2024-03-09T15:11:38.642164+0000","last_fullsized":"2024-03-09T15:11:38.642164+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:21:21.377753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'184","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.887085+0000","last_change":"2024-03-09T14:26:36.669037+0000","last_active":"2024-03-09T15:11:07.887085+0000","last_peered":"2024-03-09T15:11:07.887085+0000","last_clean":"2024-03-09T15:11:07.887085+0000","last_became_active":"2024-03-09T14:26:36.668775+0000","last_became_peered":"2024-03-09T14:26:36.668775+0000","last_unstale":"2024-03-09T15:11:07.887085+0000","last_undegraded":"2024-03-09T15:11:07.887085+0000","last_fullsized":"2024-03-09T15:11:07.887085+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:19.439405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":97,"num_write":406,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'321","reported_seq":1657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.428353+0000","last_change":"2024-03-09T14:26:28.653283+0000","last_active":"2024-03-09T15:11:04.428353+0000","last_peered":"2024-03-09T15:11:04.428353+0000","last_clean":"2024-03-09T15:11:04.428353+0000","last_became_active":"2024-03-09T14:26:28.653003+0000","last_became_peered":"2024-03-09T14:26:28.653003+0000","last_unstale":"2024-03-09T15:11:04.428353+0000","last_undegraded":"2024-03-09T15:11:04.428353+0000","last_fullsized":"2024-03-09T15:11:04.428353+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:58:52.458831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1763,"num_read_kb":1672,"num_write":372,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'238","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:24.964533+0000","last_change":"2024-03-09T14:27:03.719767+0000","last_active":"2024-03-09T15:11:24.964533+0000","last_peered":"2024-03-09T15:11:24.964533+0000","last_clean":"2024-03-09T15:11:24.964533+0000","last_became_active":"2024-03-09T14:27:03.719395+0000","last_became_peered":"2024-03-09T14:27:03.719395+0000","last_unstale":"2024-03-09T15:11:24.964533+0000","last_undegraded":"2024-03-09T15:11:24.964533+0000","last_fullsized":"2024-03-09T15:11:24.964533+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:12:44.724715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7559825,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":547,"num_read_kb":20107,"num_write":1290,"num_write_kb":28946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.585979+0000","last_change":"2024-03-09T14:26:18.578318+0000","last_active":"2024-03-09T15:07:31.585979+0000","last_peered":"2024-03-09T15:07:31.585979+0000","last_clean":"2024-03-09T15:07:31.585979+0000","last_became_active":"2024-03-09T14:26:18.577994+0000","last_became_peered":"2024-03-09T14:26:18.577994+0000","last_unstale":"2024-03-09T15:07:31.585979+0000","last_undegraded":"2024-03-09T15:07:31.585979+0000","last_fullsized":"2024-03-09T15:07:31.585979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:01:22.815335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.679647+0000","last_change":"2024-03-09T14:26:30.649199+0000","last_active":"2024-03-09T15:08:36.679647+0000","last_peered":"2024-03-09T15:08:36.679647+0000","last_clean":"2024-03-09T15:08:36.679647+0000","last_became_active":"2024-03-09T14:26:30.648910+0000","last_became_peered":"2024-03-09T14:26:30.648910+0000","last_unstale":"2024-03-09T15:08:36.679647+0000","last_undegraded":"2024-03-09T15:08:36.679647+0000","last_fullsized":"2024-03-09T15:08:36.679647+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:55:35.984723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'298","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.661350+0000","last_change":"2024-03-09T14:26:32.869477+0000","last_active":"2024-03-09T15:11:38.661350+0000","last_peered":"2024-03-09T15:11:38.661350+0000","last_clean":"2024-03-09T15:11:38.661350+0000","last_became_active":"2024-03-09T14:26:32.868370+0000","last_became_peered":"2024-03-09T14:26:32.868370+0000","last_unstale":"2024-03-09T15:11:38.661350+0000","last_undegraded":"2024-03-09T15:11:38.661350+0000","last_fullsized":"2024-03-09T15:11:38.661350+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:40.706622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46826,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":447,"num_read_kb":653,"num_write":234,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:16.676484+0000","last_change":"2024-03-09T14:26:34.673146+0000","last_active":"2024-03-09T15:08:16.676484+0000","last_peered":"2024-03-09T15:08:16.676484+0000","last_clean":"2024-03-09T15:08:16.676484+0000","last_became_active":"2024-03-09T14:26:34.672655+0000","last_became_peered":"2024-03-09T14:26:34.672655+0000","last_unstale":"2024-03-09T15:08:16.676484+0000","last_undegraded":"2024-03-09T15:08:16.676484+0000","last_fullsized":"2024-03-09T15:08:16.676484+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:28:25.637599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'120","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.538977+0000","last_change":"2024-03-09T14:26:36.678909+0000","last_active":"2024-03-09T15:10:54.538977+0000","last_peered":"2024-03-09T15:10:54.538977+0000","last_clean":"2024-03-09T15:10:54.538977+0000","last_became_active":"2024-03-09T14:26:36.678641+0000","last_became_peered":"2024-03-09T14:26:36.678641+0000","last_unstale":"2024-03-09T15:10:54.538977+0000","last_undegraded":"2024-03-09T15:10:54.538977+0000","last_fullsized":"2024-03-09T15:10:54.538977+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:51:04.017437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'140","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:56.494079+0000","last_change":"2024-03-09T14:26:36.672110+0000","last_active":"2024-03-09T15:09:56.494079+0000","last_peered":"2024-03-09T15:09:56.494079+0000","last_clean":"2024-03-09T15:09:56.494079+0000","last_became_active":"2024-03-09T14:26:36.671823+0000","last_became_peered":"2024-03-09T14:26:36.671823+0000","last_unstale":"2024-03-09T15:09:56.494079+0000","last_undegraded":"2024-03-09T15:09:56.494079+0000","last_fullsized":"2024-03-09T15:09:56.494079+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:31:00.040419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":220,"num_write":322,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'409","reported_seq":1969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.135137+0000","last_change":"2024-03-09T14:26:28.650708+0000","last_active":"2024-03-09T15:11:37.135137+0000","last_peered":"2024-03-09T15:11:37.135137+0000","last_clean":"2024-03-09T15:11:37.135137+0000","last_became_active":"2024-03-09T14:26:28.649681+0000","last_became_peered":"2024-03-09T14:26:28.649681+0000","last_unstale":"2024-03-09T15:11:37.135137+0000","last_undegraded":"2024-03-09T15:11:37.135137+0000","last_fullsized":"2024-03-09T15:11:37.135137+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:18:32.826847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2231,"num_read_kb":2115,"num_write":479,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'186","reported_seq":885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:34.295443+0000","last_change":"2024-03-09T14:26:26.644133+0000","last_active":"2024-03-09T15:10:34.295443+0000","last_peered":"2024-03-09T15:10:34.295443+0000","last_clean":"2024-03-09T15:10:34.295443+0000","last_became_active":"2024-03-09T14:26:26.643598+0000","last_became_peered":"2024-03-09T14:26:26.643598+0000","last_unstale":"2024-03-09T15:10:34.295443+0000","last_undegraded":"2024-03-09T15:10:34.295443+0000","last_fullsized":"2024-03-09T15:10:34.295443+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:11.376622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9509681,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":564,"num_read_kb":35501,"num_write":896,"num_write_kb":49168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.569074+0000","last_change":"2024-03-09T14:26:30.651022+0000","last_active":"2024-03-09T15:08:31.569074+0000","last_peered":"2024-03-09T15:08:31.569074+0000","last_clean":"2024-03-09T15:08:31.569074+0000","last_became_active":"2024-03-09T14:26:30.650743+0000","last_became_peered":"2024-03-09T14:26:30.650743+0000","last_unstale":"2024-03-09T15:08:31.569074+0000","last_undegraded":"2024-03-09T15:08:31.569074+0000","last_fullsized":"2024-03-09T15:08:31.569074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:24.403091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'124","reported_seq":684,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.696257+0000","last_change":"2024-03-09T14:26:32.651032+0000","last_active":"2024-03-09T15:10:56.696257+0000","last_peered":"2024-03-09T15:10:56.696257+0000","last_clean":"2024-03-09T15:10:56.696257+0000","last_became_active":"2024-03-09T14:26:32.650770+0000","last_became_peered":"2024-03-09T14:26:32.650770+0000","last_unstale":"2024-03-09T15:10:56.696257+0000","last_undegraded":"2024-03-09T15:10:56.696257+0000","last_fullsized":"2024-03-09T15:10:56.696257+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:42:47.799009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11686,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":164,"num_read_kb":220,"num_write":86,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.679613+0000","last_change":"2024-03-09T14:26:34.679002+0000","last_active":"2024-03-09T15:08:36.679613+0000","last_peered":"2024-03-09T15:08:36.679613+0000","last_clean":"2024-03-09T15:08:36.679613+0000","last_became_active":"2024-03-09T14:26:34.678657+0000","last_became_peered":"2024-03-09T14:26:34.678657+0000","last_unstale":"2024-03-09T15:08:36.679613+0000","last_undegraded":"2024-03-09T15:08:36.679613+0000","last_fullsized":"2024-03-09T15:08:36.679613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:14.990198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'108","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.590925+0000","last_change":"2024-03-09T14:26:36.678524+0000","last_active":"2024-03-09T15:11:01.590925+0000","last_peered":"2024-03-09T15:11:01.590925+0000","last_clean":"2024-03-09T15:11:01.590925+0000","last_became_active":"2024-03-09T14:26:36.678174+0000","last_became_peered":"2024-03-09T14:26:36.678174+0000","last_unstale":"2024-03-09T15:11:01.590925+0000","last_undegraded":"2024-03-09T15:11:01.590925+0000","last_fullsized":"2024-03-09T15:11:01.590925+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:31:59.766233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":96,"num_write":259,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'447","reported_seq":2102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.167849+0000","last_change":"2024-03-09T14:26:28.645383+0000","last_active":"2024-03-09T15:11:09.167849+0000","last_peered":"2024-03-09T15:11:09.167849+0000","last_clean":"2024-03-09T15:11:09.167849+0000","last_became_active":"2024-03-09T14:26:28.644951+0000","last_became_peered":"2024-03-09T14:26:28.644951+0000","last_unstale":"2024-03-09T15:11:09.167849+0000","last_undegraded":"2024-03-09T15:11:09.167849+0000","last_fullsized":"2024-03-09T15:11:09.167849+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:15:07.312913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2607,"num_read_kb":2478,"num_write":564,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'183","reported_seq":795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:46.815399+0000","last_change":"2024-03-09T14:26:26.652608+0000","last_active":"2024-03-09T15:09:46.815399+0000","last_peered":"2024-03-09T15:09:46.815399+0000","last_clean":"2024-03-09T15:09:46.815399+0000","last_became_active":"2024-03-09T14:26:26.652260+0000","last_became_peered":"2024-03-09T14:26:26.652260+0000","last_unstale":"2024-03-09T15:09:46.815399+0000","last_undegraded":"2024-03-09T15:09:46.815399+0000","last_fullsized":"2024-03-09T15:09:46.815399+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:55.237307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698699,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":390,"num_read_kb":5479,"num_write":1047,"num_write_kb":16075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.678739+0000","last_change":"2024-03-09T14:26:30.650065+0000","last_active":"2024-03-09T15:08:31.678739+0000","last_peered":"2024-03-09T15:08:31.678739+0000","last_clean":"2024-03-09T15:08:31.678739+0000","last_became_active":"2024-03-09T14:26:30.649790+0000","last_became_peered":"2024-03-09T14:26:30.649790+0000","last_unstale":"2024-03-09T15:08:31.678739+0000","last_undegraded":"2024-03-09T15:08:31.678739+0000","last_fullsized":"2024-03-09T15:08:31.678739+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:16.289908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'56","reported_seq":562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.592684+0000","last_change":"2024-03-09T14:26:32.655566+0000","last_active":"2024-03-09T15:10:56.592684+0000","last_peered":"2024-03-09T15:10:56.592684+0000","last_clean":"2024-03-09T15:10:56.592684+0000","last_became_active":"2024-03-09T14:26:32.655269+0000","last_became_peered":"2024-03-09T14:26:32.655269+0000","last_unstale":"2024-03-09T15:10:56.592684+0000","last_undegraded":"2024-03-09T15:10:56.592684+0000","last_fullsized":"2024-03-09T15:10:56.592684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:13.374240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715778+0000","last_change":"2024-03-09T14:26:34.671491+0000","last_active":"2024-03-09T15:08:36.715778+0000","last_peered":"2024-03-09T15:08:36.715778+0000","last_clean":"2024-03-09T15:08:36.715778+0000","last_became_active":"2024-03-09T14:26:34.671065+0000","last_became_peered":"2024-03-09T14:26:34.671065+0000","last_unstale":"2024-03-09T15:08:36.715778+0000","last_undegraded":"2024-03-09T15:08:36.715778+0000","last_fullsized":"2024-03-09T15:08:36.715778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:19:07.578080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'188","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:14.235785+0000","last_change":"2024-03-09T14:26:36.667732+0000","last_active":"2024-03-09T15:09:14.235785+0000","last_peered":"2024-03-09T15:09:14.235785+0000","last_clean":"2024-03-09T15:09:14.235785+0000","last_became_active":"2024-03-09T14:26:36.666762+0000","last_became_peered":"2024-03-09T14:26:36.666762+0000","last_unstale":"2024-03-09T15:09:14.235785+0000","last_undegraded":"2024-03-09T15:09:14.235785+0000","last_fullsized":"2024-03-09T15:09:14.235785+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:03:47.792239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":266,"num_read_kb":261,"num_write":413,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'437","reported_seq":2099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.101150+0000","last_change":"2024-03-09T14:26:28.658137+0000","last_active":"2024-03-09T15:11:01.101150+0000","last_peered":"2024-03-09T15:11:01.101150+0000","last_clean":"2024-03-09T15:11:01.101150+0000","last_became_active":"2024-03-09T14:26:28.657024+0000","last_became_peered":"2024-03-09T14:26:28.657024+0000","last_unstale":"2024-03-09T15:11:01.101150+0000","last_undegraded":"2024-03-09T15:11:01.101150+0000","last_fullsized":"2024-03-09T15:11:01.101150+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:04.541686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2592,"num_read_kb":2450,"num_write":527,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'190","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.302084+0000","last_change":"2024-03-09T14:26:26.646837+0000","last_active":"2024-03-09T15:11:04.302084+0000","last_peered":"2024-03-09T15:11:04.302084+0000","last_clean":"2024-03-09T15:11:04.302084+0000","last_became_active":"2024-03-09T14:26:26.646506+0000","last_became_peered":"2024-03-09T14:26:26.646506+0000","last_unstale":"2024-03-09T15:11:04.302084+0000","last_undegraded":"2024-03-09T15:11:04.302084+0000","last_fullsized":"2024-03-09T15:11:04.302084+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:13.870996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23070885,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":392,"num_read_kb":50370,"num_write":984,"num_write_kb":56973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.715107+0000","last_change":"2024-03-09T14:26:30.652971+0000","last_active":"2024-03-09T15:08:31.715107+0000","last_peered":"2024-03-09T15:08:31.715107+0000","last_clean":"2024-03-09T15:08:31.715107+0000","last_became_active":"2024-03-09T14:26:30.652245+0000","last_became_peered":"2024-03-09T14:26:30.652245+0000","last_unstale":"2024-03-09T15:08:31.715107+0000","last_undegraded":"2024-03-09T15:08:31.715107+0000","last_fullsized":"2024-03-09T15:08:31.715107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:24:02.699008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'163","reported_seq":738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.696289+0000","last_change":"2024-03-09T14:26:32.652895+0000","last_active":"2024-03-09T15:10:56.696289+0000","last_peered":"2024-03-09T15:10:56.696289+0000","last_clean":"2024-03-09T15:10:56.696289+0000","last_became_active":"2024-03-09T14:26:32.652610+0000","last_became_peered":"2024-03-09T14:26:32.652610+0000","last_unstale":"2024-03-09T15:10:56.696289+0000","last_undegraded":"2024-03-09T15:10:56.696289+0000","last_fullsized":"2024-03-09T15:10:56.696289+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:38:51.192534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18633,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":211,"num_read_kb":282,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.594468+0000","last_change":"2024-03-09T14:26:34.667654+0000","last_active":"2024-03-09T15:08:36.594468+0000","last_peered":"2024-03-09T15:08:36.594468+0000","last_clean":"2024-03-09T15:08:36.594468+0000","last_became_active":"2024-03-09T14:26:34.667373+0000","last_became_peered":"2024-03-09T14:26:34.667373+0000","last_unstale":"2024-03-09T15:08:36.594468+0000","last_undegraded":"2024-03-09T15:08:36.594468+0000","last_fullsized":"2024-03-09T15:08:36.594468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:15.287538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'134","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.348642+0000","last_change":"2024-03-09T14:26:36.678631+0000","last_active":"2024-03-09T15:10:35.348642+0000","last_peered":"2024-03-09T15:10:35.348642+0000","last_clean":"2024-03-09T15:10:35.348642+0000","last_became_active":"2024-03-09T14:26:36.678306+0000","last_became_peered":"2024-03-09T14:26:36.678306+0000","last_unstale":"2024-03-09T15:10:35.348642+0000","last_undegraded":"2024-03-09T15:10:35.348642+0000","last_fullsized":"2024-03-09T15:10:35.348642+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:33:48.413353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":110,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'432","reported_seq":2096,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.534339+0000","last_change":"2024-03-09T14:26:28.652461+0000","last_active":"2024-03-09T15:10:54.534339+0000","last_peered":"2024-03-09T15:10:54.534339+0000","last_clean":"2024-03-09T15:10:54.534339+0000","last_became_active":"2024-03-09T14:26:28.651640+0000","last_became_peered":"2024-03-09T14:26:28.651640+0000","last_unstale":"2024-03-09T15:10:54.534339+0000","last_undegraded":"2024-03-09T15:10:54.534339+0000","last_fullsized":"2024-03-09T15:10:54.534339+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:46.863189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2590,"num_read_kb":2461,"num_write":546,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'203","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.046619+0000","last_change":"2024-03-09T14:26:26.636955+0000","last_active":"2024-03-09T15:11:09.046619+0000","last_peered":"2024-03-09T15:11:09.046619+0000","last_clean":"2024-03-09T15:11:09.046619+0000","last_became_active":"2024-03-09T14:26:26.636087+0000","last_became_peered":"2024-03-09T14:26:26.636087+0000","last_unstale":"2024-03-09T15:11:09.046619+0000","last_undegraded":"2024-03-09T15:11:09.046619+0000","last_fullsized":"2024-03-09T15:11:09.046619+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:08:49.930168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221125,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":647,"num_read_kb":124750,"num_write":1243,"num_write_kb":18410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.593747+0000","last_change":"2024-03-09T14:26:30.653233+0000","last_active":"2024-03-09T15:08:31.593747+0000","last_peered":"2024-03-09T15:08:31.593747+0000","last_clean":"2024-03-09T15:08:31.593747+0000","last_became_active":"2024-03-09T14:26:30.652925+0000","last_became_peered":"2024-03-09T14:26:30.652925+0000","last_unstale":"2024-03-09T15:08:31.593747+0000","last_undegraded":"2024-03-09T15:08:31.593747+0000","last_fullsized":"2024-03-09T15:08:31.593747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:15:46.808131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'126","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.159039+0000","last_change":"2024-03-09T14:26:32.657556+0000","last_active":"2024-03-09T15:11:37.159039+0000","last_peered":"2024-03-09T15:11:37.159039+0000","last_clean":"2024-03-09T15:11:37.159039+0000","last_became_active":"2024-03-09T14:26:32.657221+0000","last_became_peered":"2024-03-09T14:26:32.657221+0000","last_unstale":"2024-03-09T15:11:37.159039+0000","last_undegraded":"2024-03-09T15:11:37.159039+0000","last_fullsized":"2024-03-09T15:11:37.159039+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:53:32.822261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30241,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":153,"num_read_kb":246,"num_write":80,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.577073+0000","last_change":"2024-03-09T14:26:34.670563+0000","last_active":"2024-03-09T15:08:36.577073+0000","last_peered":"2024-03-09T15:08:36.577073+0000","last_clean":"2024-03-09T15:08:36.577073+0000","last_became_active":"2024-03-09T14:26:34.670283+0000","last_became_peered":"2024-03-09T14:26:34.670283+0000","last_unstale":"2024-03-09T15:08:36.577073+0000","last_undegraded":"2024-03-09T15:08:36.577073+0000","last_fullsized":"2024-03-09T15:08:36.577073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:08:44.244645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'870","reported_seq":2445,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.175205+0000","last_change":"2024-03-09T14:26:28.652528+0000","last_active":"2024-03-09T15:11:09.175205+0000","last_peered":"2024-03-09T15:11:09.175205+0000","last_clean":"2024-03-09T15:11:09.175205+0000","last_became_active":"2024-03-09T14:26:28.651921+0000","last_became_peered":"2024-03-09T14:26:28.651921+0000","last_unstale":"2024-03-09T15:11:09.175205+0000","last_undegraded":"2024-03-09T15:11:09.175205+0000","last_fullsized":"2024-03-09T15:11:09.175205+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:35:33.794890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3929,"num_read_kb":3481,"num_write":1218,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'258","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:02.109115+0000","last_change":"2024-03-09T14:27:03.717196+0000","last_active":"2024-03-09T15:09:02.109115+0000","last_peered":"2024-03-09T15:09:02.109115+0000","last_clean":"2024-03-09T15:09:02.109115+0000","last_became_active":"2024-03-09T14:27:03.716852+0000","last_became_peered":"2024-03-09T14:27:03.716852+0000","last_unstale":"2024-03-09T15:09:02.109115+0000","last_undegraded":"2024-03-09T15:09:02.109115+0000","last_fullsized":"2024-03-09T15:09:02.109115+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:55.331529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621563,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":888,"num_read_kb":7728,"num_write":1382,"num_write_kb":17237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"35'3","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.408491+0000","last_change":"2024-03-09T14:26:30.652021+0000","last_active":"2024-03-09T15:11:38.408491+0000","last_peered":"2024-03-09T15:11:38.408491+0000","last_clean":"2024-03-09T15:11:38.408491+0000","last_became_active":"2024-03-09T14:26:30.651711+0000","last_became_peered":"2024-03-09T14:26:30.651711+0000","last_unstale":"2024-03-09T15:11:38.408491+0000","last_undegraded":"2024-03-09T15:11:38.408491+0000","last_fullsized":"2024-03-09T15:11:38.408491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:37.178573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":479,"num_read_kb":477,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'199","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.657964+0000","last_change":"2024-03-09T14:26:32.655679+0000","last_active":"2024-03-09T15:11:38.657964+0000","last_peered":"2024-03-09T15:11:38.657964+0000","last_clean":"2024-03-09T15:11:38.657964+0000","last_became_active":"2024-03-09T14:26:32.655391+0000","last_became_peered":"2024-03-09T14:26:32.655391+0000","last_unstale":"2024-03-09T15:11:38.657964+0000","last_undegraded":"2024-03-09T15:11:38.657964+0000","last_fullsized":"2024-03-09T15:11:38.657964+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:26:19.532383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47720,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":299,"num_read_kb":492,"num_write":192,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.583116+0000","last_change":"2024-03-09T14:26:34.675539+0000","last_active":"2024-03-09T15:09:06.583116+0000","last_peered":"2024-03-09T15:09:06.583116+0000","last_clean":"2024-03-09T15:09:06.583116+0000","last_became_active":"2024-03-09T14:26:34.675248+0000","last_became_peered":"2024-03-09T14:26:34.675248+0000","last_unstale":"2024-03-09T15:09:06.583116+0000","last_undegraded":"2024-03-09T15:09:06.583116+0000","last_fullsized":"2024-03-09T15:09:06.583116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:43:16.280150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'185","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.696274+0000","last_change":"2024-03-09T14:26:36.786828+0000","last_active":"2024-03-09T15:10:56.696274+0000","last_peered":"2024-03-09T15:10:56.696274+0000","last_clean":"2024-03-09T15:10:56.696274+0000","last_became_active":"2024-03-09T14:26:36.786403+0000","last_became_peered":"2024-03-09T14:26:36.786403+0000","last_unstale":"2024-03-09T15:10:56.696274+0000","last_undegraded":"2024-03-09T15:10:56.696274+0000","last_fullsized":"2024-03-09T15:10:56.696274+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:54:17.134629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1042,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":213,"num_write":429,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'371","reported_seq":1881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.128774+0000","last_change":"2024-03-09T14:26:28.642746+0000","last_active":"2024-03-09T15:11:37.128774+0000","last_peered":"2024-03-09T15:11:37.128774+0000","last_clean":"2024-03-09T15:11:37.128774+0000","last_became_active":"2024-03-09T14:26:28.642452+0000","last_became_peered":"2024-03-09T14:26:28.642452+0000","last_unstale":"2024-03-09T15:11:37.128774+0000","last_undegraded":"2024-03-09T15:11:37.128774+0000","last_fullsized":"2024-03-09T15:11:37.128774+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:40.141256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2046,"num_read_kb":1963,"num_write":419,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'172","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:03.384230+0000","last_change":"2024-03-09T14:27:03.724915+0000","last_active":"2024-03-09T15:09:03.384230+0000","last_peered":"2024-03-09T15:09:03.384230+0000","last_clean":"2024-03-09T15:09:03.384230+0000","last_became_active":"2024-03-09T14:27:03.724521+0000","last_became_peered":"2024-03-09T14:27:03.724521+0000","last_unstale":"2024-03-09T15:09:03.384230+0000","last_undegraded":"2024-03-09T15:09:03.384230+0000","last_fullsized":"2024-03-09T15:09:03.384230+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:32:10.947685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17066132,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":316,"num_read_kb":39345,"num_write":954,"num_write_kb":40541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591483+0000","last_change":"2024-03-09T14:26:30.652505+0000","last_active":"2024-03-09T15:08:11.591483+0000","last_peered":"2024-03-09T15:08:11.591483+0000","last_clean":"2024-03-09T15:08:11.591483+0000","last_became_active":"2024-03-09T14:26:30.652243+0000","last_became_peered":"2024-03-09T14:26:30.652243+0000","last_unstale":"2024-03-09T15:08:11.591483+0000","last_undegraded":"2024-03-09T15:08:11.591483+0000","last_fullsized":"2024-03-09T15:08:11.591483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:42:30.815337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'149","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.617080+0000","last_change":"2024-03-09T14:26:32.658910+0000","last_active":"2024-03-09T15:11:36.617080+0000","last_peered":"2024-03-09T15:11:36.617080+0000","last_clean":"2024-03-09T15:11:36.617080+0000","last_became_active":"2024-03-09T14:26:32.658626+0000","last_became_peered":"2024-03-09T14:26:32.658626+0000","last_unstale":"2024-03-09T15:11:36.617080+0000","last_undegraded":"2024-03-09T15:11:36.617080+0000","last_fullsized":"2024-03-09T15:11:36.617080+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:20.837652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17393,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":278,"num_write":142,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.572913+0000","last_change":"2024-03-09T14:26:34.669777+0000","last_active":"2024-03-09T15:09:06.572913+0000","last_peered":"2024-03-09T15:09:06.572913+0000","last_clean":"2024-03-09T15:09:06.572913+0000","last_became_active":"2024-03-09T14:26:34.669482+0000","last_became_peered":"2024-03-09T14:26:34.669482+0000","last_unstale":"2024-03-09T15:09:06.572913+0000","last_undegraded":"2024-03-09T15:09:06.572913+0000","last_fullsized":"2024-03-09T15:09:06.572913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:44:39.381656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'220","reported_seq":1403,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.414241+0000","last_change":"2024-03-09T14:26:36.678544+0000","last_active":"2024-03-09T15:11:37.414241+0000","last_peered":"2024-03-09T15:11:37.414241+0000","last_clean":"2024-03-09T15:11:37.414241+0000","last_became_active":"2024-03-09T14:26:36.678232+0000","last_became_peered":"2024-03-09T14:26:36.678232+0000","last_unstale":"2024-03-09T15:11:37.414241+0000","last_undegraded":"2024-03-09T15:11:37.414241+0000","last_fullsized":"2024-03-09T15:11:37.414241+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:27.054472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":941,"num_read_kb":939,"num_write":605,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'431","reported_seq":1927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.133871+0000","last_change":"2024-03-09T14:26:28.658740+0000","last_active":"2024-03-09T15:11:37.133871+0000","last_peered":"2024-03-09T15:11:37.133871+0000","last_clean":"2024-03-09T15:11:37.133871+0000","last_became_active":"2024-03-09T14:26:28.657488+0000","last_became_peered":"2024-03-09T14:26:28.657488+0000","last_unstale":"2024-03-09T15:11:37.133871+0000","last_undegraded":"2024-03-09T15:11:37.133871+0000","last_fullsized":"2024-03-09T15:11:37.133871+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:15:44.795978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2287,"num_read_kb":2137,"num_write":511,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'195","reported_seq":801,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.492761+0000","last_change":"2024-03-09T14:26:26.641350+0000","last_active":"2024-03-09T15:11:26.492761+0000","last_peered":"2024-03-09T15:11:26.492761+0000","last_clean":"2024-03-09T15:11:26.492761+0000","last_became_active":"2024-03-09T14:26:26.641003+0000","last_became_peered":"2024-03-09T14:26:26.641003+0000","last_unstale":"2024-03-09T15:11:26.492761+0000","last_undegraded":"2024-03-09T15:11:26.492761+0000","last_fullsized":"2024-03-09T15:11:26.492761+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:10:53.927499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582977,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":372,"num_read_kb":32756,"num_write":1154,"num_write_kb":45988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.597964+0000","last_change":"2024-03-09T14:26:30.654064+0000","last_active":"2024-03-09T15:09:01.597964+0000","last_peered":"2024-03-09T15:09:01.597964+0000","last_clean":"2024-03-09T15:09:01.597964+0000","last_became_active":"2024-03-09T14:26:30.653249+0000","last_became_peered":"2024-03-09T14:26:30.653249+0000","last_unstale":"2024-03-09T15:09:01.597964+0000","last_undegraded":"2024-03-09T15:09:01.597964+0000","last_fullsized":"2024-03-09T15:09:01.597964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:11:30.602441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'124","reported_seq":686,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:21.692304+0000","last_change":"2024-03-09T14:26:32.868697+0000","last_active":"2024-03-09T15:10:21.692304+0000","last_peered":"2024-03-09T15:10:21.692304+0000","last_clean":"2024-03-09T15:10:21.692304+0000","last_became_active":"2024-03-09T14:26:32.868236+0000","last_became_peered":"2024-03-09T14:26:32.868236+0000","last_unstale":"2024-03-09T15:10:21.692304+0000","last_undegraded":"2024-03-09T15:10:21.692304+0000","last_fullsized":"2024-03-09T15:10:21.692304+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:50:04.808478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12376,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":164,"num_read_kb":223,"num_write":86,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.570427+0000","last_change":"2024-03-09T14:26:34.675615+0000","last_active":"2024-03-09T15:08:41.570427+0000","last_peered":"2024-03-09T15:08:41.570427+0000","last_clean":"2024-03-09T15:08:41.570427+0000","last_became_active":"2024-03-09T14:26:34.675120+0000","last_became_peered":"2024-03-09T14:26:34.675120+0000","last_unstale":"2024-03-09T15:08:41.570427+0000","last_undegraded":"2024-03-09T15:08:41.570427+0000","last_fullsized":"2024-03-09T15:08:41.570427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:06.267360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'104","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.686247+0000","last_change":"2024-03-09T14:26:36.678845+0000","last_active":"2024-03-09T15:11:38.686247+0000","last_peered":"2024-03-09T15:11:38.686247+0000","last_clean":"2024-03-09T15:11:38.686247+0000","last_became_active":"2024-03-09T14:26:36.678521+0000","last_became_peered":"2024-03-09T14:26:36.678521+0000","last_unstale":"2024-03-09T15:11:38.686247+0000","last_undegraded":"2024-03-09T15:11:38.686247+0000","last_fullsized":"2024-03-09T15:11:38.686247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:26:18.582752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":103,"num_write":248,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'325","reported_seq":1740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.198591+0000","last_change":"2024-03-09T14:26:28.648512+0000","last_active":"2024-03-09T15:11:09.198591+0000","last_peered":"2024-03-09T15:11:09.198591+0000","last_clean":"2024-03-09T15:11:09.198591+0000","last_became_active":"2024-03-09T14:26:28.648204+0000","last_became_peered":"2024-03-09T14:26:28.648204+0000","last_unstale":"2024-03-09T15:11:09.198591+0000","last_undegraded":"2024-03-09T15:11:09.198591+0000","last_fullsized":"2024-03-09T15:11:09.198591+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:16:38.156513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1841,"num_read_kb":1771,"num_write":371,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'191","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:12.482693+0000","last_change":"2024-03-09T14:27:03.719684+0000","last_active":"2024-03-09T15:09:12.482693+0000","last_peered":"2024-03-09T15:09:12.482693+0000","last_clean":"2024-03-09T15:09:12.482693+0000","last_became_active":"2024-03-09T14:27:03.719292+0000","last_became_peered":"2024-03-09T14:27:03.719292+0000","last_unstale":"2024-03-09T15:09:12.482693+0000","last_undegraded":"2024-03-09T15:09:12.482693+0000","last_fullsized":"2024-03-09T15:09:12.482693+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:28.532681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7024912,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":930,"num_read_kb":86824,"num_write":1013,"num_write_kb":33052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.572422+0000","last_change":"2024-03-09T14:26:30.652463+0000","last_active":"2024-03-09T15:09:01.572422+0000","last_peered":"2024-03-09T15:09:01.572422+0000","last_clean":"2024-03-09T15:09:01.572422+0000","last_became_active":"2024-03-09T14:26:30.652190+0000","last_became_peered":"2024-03-09T14:26:30.652190+0000","last_unstale":"2024-03-09T15:09:01.572422+0000","last_undegraded":"2024-03-09T15:09:01.572422+0000","last_fullsized":"2024-03-09T15:09:01.572422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:52:53.691492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'82","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:46.595898+0000","last_change":"2024-03-09T14:26:32.868321+0000","last_active":"2024-03-09T15:08:46.595898+0000","last_peered":"2024-03-09T15:08:46.595898+0000","last_clean":"2024-03-09T15:08:46.595898+0000","last_became_active":"2024-03-09T14:26:32.867985+0000","last_became_peered":"2024-03-09T14:26:32.867985+0000","last_unstale":"2024-03-09T15:08:46.595898+0000","last_undegraded":"2024-03-09T15:08:46.595898+0000","last_fullsized":"2024-03-09T15:08:46.595898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:20.552555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":100,"num_read_kb":95,"num_write":100,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'531","reported_seq":2041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.691175+0000","last_change":"2024-03-09T14:26:34.665855+0000","last_active":"2024-03-09T15:11:38.691175+0000","last_peered":"2024-03-09T15:11:38.691175+0000","last_clean":"2024-03-09T15:11:38.691175+0000","last_became_active":"2024-03-09T14:26:34.664708+0000","last_became_peered":"2024-03-09T14:26:34.664708+0000","last_unstale":"2024-03-09T15:11:38.691175+0000","last_undegraded":"2024-03-09T15:11:38.691175+0000","last_fullsized":"2024-03-09T15:11:38.691175+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:21:02.162854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'142","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.341774+0000","last_change":"2024-03-09T14:26:36.676199+0000","last_active":"2024-03-09T15:10:35.341774+0000","last_peered":"2024-03-09T15:10:35.341774+0000","last_clean":"2024-03-09T15:10:35.341774+0000","last_became_active":"2024-03-09T14:26:36.675855+0000","last_became_peered":"2024-03-09T14:26:36.675855+0000","last_unstale":"2024-03-09T15:10:35.341774+0000","last_undegraded":"2024-03-09T15:10:35.341774+0000","last_fullsized":"2024-03-09T15:10:35.341774+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:10:54.315090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":194,"num_write":349,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'797","reported_seq":2329,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.448334+0000","last_change":"2024-03-09T14:26:28.657378+0000","last_active":"2024-03-09T15:11:04.448334+0000","last_peered":"2024-03-09T15:11:04.448334+0000","last_clean":"2024-03-09T15:11:04.448334+0000","last_became_active":"2024-03-09T14:26:28.656940+0000","last_became_peered":"2024-03-09T14:26:28.656940+0000","last_unstale":"2024-03-09T15:11:04.448334+0000","last_undegraded":"2024-03-09T15:11:04.448334+0000","last_fullsized":"2024-03-09T15:11:04.448334+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:15:38.996663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3613,"num_read_kb":3222,"num_write":1070,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'206","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.581855+0000","last_change":"2024-03-09T14:26:26.641435+0000","last_active":"2024-03-09T15:08:56.581855+0000","last_peered":"2024-03-09T15:08:56.581855+0000","last_clean":"2024-03-09T15:08:56.581855+0000","last_became_active":"2024-03-09T14:26:26.641031+0000","last_became_peered":"2024-03-09T14:26:26.641031+0000","last_unstale":"2024-03-09T15:08:56.581855+0000","last_undegraded":"2024-03-09T15:08:56.581855+0000","last_fullsized":"2024-03-09T15:08:56.581855+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:53:53.180266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9752665,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":391,"num_read_kb":2692,"num_write":1147,"num_write_kb":40768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.719265+0000","last_change":"2024-03-09T14:26:30.652643+0000","last_active":"2024-03-09T15:09:01.719265+0000","last_peered":"2024-03-09T15:09:01.719265+0000","last_clean":"2024-03-09T15:09:01.719265+0000","last_became_active":"2024-03-09T14:26:30.652315+0000","last_became_peered":"2024-03-09T14:26:30.652315+0000","last_unstale":"2024-03-09T15:09:01.719265+0000","last_undegraded":"2024-03-09T15:09:01.719265+0000","last_fullsized":"2024-03-09T15:09:01.719265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:10.314147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'166","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:11.592429+0000","last_change":"2024-03-09T14:26:32.657278+0000","last_active":"2024-03-09T15:10:11.592429+0000","last_peered":"2024-03-09T15:10:11.592429+0000","last_clean":"2024-03-09T15:10:11.592429+0000","last_became_active":"2024-03-09T14:26:32.656973+0000","last_became_peered":"2024-03-09T14:26:32.656973+0000","last_unstale":"2024-03-09T15:10:11.592429+0000","last_undegraded":"2024-03-09T15:10:11.592429+0000","last_fullsized":"2024-03-09T15:10:11.592429+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:33.380705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11498,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":242,"num_write":114,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.570657+0000","last_change":"2024-03-09T14:26:34.665616+0000","last_active":"2024-03-09T15:07:41.570657+0000","last_peered":"2024-03-09T15:07:41.570657+0000","last_clean":"2024-03-09T15:07:41.570657+0000","last_became_active":"2024-03-09T14:26:34.665208+0000","last_became_peered":"2024-03-09T14:26:34.665208+0000","last_unstale":"2024-03-09T15:07:41.570657+0000","last_undegraded":"2024-03-09T15:07:41.570657+0000","last_fullsized":"2024-03-09T15:07:41.570657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:06:56.886360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'128","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:08.308795+0000","last_change":"2024-03-09T14:26:36.678157+0000","last_active":"2024-03-09T15:11:08.308795+0000","last_peered":"2024-03-09T15:11:08.308795+0000","last_clean":"2024-03-09T15:11:08.308795+0000","last_became_active":"2024-03-09T14:26:36.677867+0000","last_became_peered":"2024-03-09T14:26:36.677867+0000","last_unstale":"2024-03-09T15:11:08.308795+0000","last_undegraded":"2024-03-09T15:11:08.308795+0000","last_fullsized":"2024-03-09T15:11:08.308795+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:04:56.832371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":311,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'823","reported_seq":2497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.123341+0000","last_change":"2024-03-09T14:26:28.657249+0000","last_active":"2024-03-09T15:11:37.123341+0000","last_peered":"2024-03-09T15:11:37.123341+0000","last_clean":"2024-03-09T15:11:37.123341+0000","last_became_active":"2024-03-09T14:26:28.656960+0000","last_became_peered":"2024-03-09T14:26:28.656960+0000","last_unstale":"2024-03-09T15:11:37.123341+0000","last_undegraded":"2024-03-09T15:11:37.123341+0000","last_fullsized":"2024-03-09T15:11:37.123341+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:23.435423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4034,"num_read_kb":3617,"num_write":1125,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'213","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.581881+0000","last_change":"2024-03-09T14:26:26.650356+0000","last_active":"2024-03-09T15:08:56.581881+0000","last_peered":"2024-03-09T15:08:56.581881+0000","last_clean":"2024-03-09T15:08:56.581881+0000","last_became_active":"2024-03-09T14:26:26.649772+0000","last_became_peered":"2024-03-09T14:26:26.649772+0000","last_unstale":"2024-03-09T15:08:56.581881+0000","last_undegraded":"2024-03-09T15:08:56.581881+0000","last_fullsized":"2024-03-09T15:08:56.581881+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:59.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12930210,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":400,"num_read_kb":32014,"num_write":1022,"num_write_kb":48046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.582476+0000","last_change":"2024-03-09T14:26:30.650955+0000","last_active":"2024-03-09T15:09:01.582476+0000","last_peered":"2024-03-09T15:09:01.582476+0000","last_clean":"2024-03-09T15:09:01.582476+0000","last_became_active":"2024-03-09T14:26:30.650674+0000","last_became_peered":"2024-03-09T14:26:30.650674+0000","last_unstale":"2024-03-09T15:09:01.582476+0000","last_undegraded":"2024-03-09T15:09:01.582476+0000","last_fullsized":"2024-03-09T15:09:01.582476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:18.310162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'125","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.587145+0000","last_change":"2024-03-09T14:26:32.653856+0000","last_active":"2024-03-09T15:10:06.587145+0000","last_peered":"2024-03-09T15:10:06.587145+0000","last_clean":"2024-03-09T15:10:06.587145+0000","last_became_active":"2024-03-09T14:26:32.652397+0000","last_became_peered":"2024-03-09T14:26:32.652397+0000","last_unstale":"2024-03-09T15:10:06.587145+0000","last_undegraded":"2024-03-09T15:10:06.587145+0000","last_fullsized":"2024-03-09T15:10:06.587145+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:53:36.740581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17184,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":239,"num_write":84,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.588861+0000","last_change":"2024-03-09T14:26:34.671397+0000","last_active":"2024-03-09T15:07:51.588861+0000","last_peered":"2024-03-09T15:07:51.588861+0000","last_clean":"2024-03-09T15:07:51.588861+0000","last_became_active":"2024-03-09T14:26:34.671029+0000","last_became_peered":"2024-03-09T14:26:34.671029+0000","last_unstale":"2024-03-09T15:07:51.588861+0000","last_undegraded":"2024-03-09T15:07:51.588861+0000","last_fullsized":"2024-03-09T15:07:51.588861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:21:55.027507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'112","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:43.714487+0000","last_change":"2024-03-09T14:26:36.786838+0000","last_active":"2024-03-09T15:08:43.714487+0000","last_peered":"2024-03-09T15:08:43.714487+0000","last_clean":"2024-03-09T15:08:43.714487+0000","last_became_active":"2024-03-09T14:26:36.786449+0000","last_became_peered":"2024-03-09T14:26:36.786449+0000","last_unstale":"2024-03-09T15:08:43.714487+0000","last_undegraded":"2024-03-09T15:08:43.714487+0000","last_fullsized":"2024-03-09T15:08:43.714487+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:16:55.574602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":178,"num_write":287,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'518","reported_seq":2099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.331511+0000","last_change":"2024-03-09T14:26:28.649113+0000","last_active":"2024-03-09T15:10:35.331511+0000","last_peered":"2024-03-09T15:10:35.331511+0000","last_clean":"2024-03-09T15:10:35.331511+0000","last_became_active":"2024-03-09T14:26:28.647178+0000","last_became_peered":"2024-03-09T14:26:28.647178+0000","last_unstale":"2024-03-09T15:10:35.331511+0000","last_undegraded":"2024-03-09T15:10:35.331511+0000","last_fullsized":"2024-03-09T15:10:35.331511+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:45:41.501592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2831,"num_read_kb":2584,"num_write":686,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'265","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:24.832572+0000","last_change":"2024-03-09T14:26:26.643743+0000","last_active":"2024-03-09T15:11:24.832572+0000","last_peered":"2024-03-09T15:11:24.832572+0000","last_clean":"2024-03-09T15:11:24.832572+0000","last_became_active":"2024-03-09T14:26:26.643338+0000","last_became_peered":"2024-03-09T14:26:26.643338+0000","last_unstale":"2024-03-09T15:11:24.832572+0000","last_undegraded":"2024-03-09T15:11:24.832572+0000","last_fullsized":"2024-03-09T15:11:24.832572+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:31.097518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18897035,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":642,"num_read_kb":43219,"num_write":1334,"num_write_kb":45633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.586671+0000","last_change":"2024-03-09T14:26:30.648059+0000","last_active":"2024-03-09T15:07:36.586671+0000","last_peered":"2024-03-09T15:07:36.586671+0000","last_clean":"2024-03-09T15:07:36.586671+0000","last_became_active":"2024-03-09T14:26:30.647466+0000","last_became_peered":"2024-03-09T14:26:30.647466+0000","last_unstale":"2024-03-09T15:07:36.586671+0000","last_undegraded":"2024-03-09T15:07:36.586671+0000","last_fullsized":"2024-03-09T15:07:36.586671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:23:46.397656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'101","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.490736+0000","last_change":"2024-03-09T14:26:32.654369+0000","last_active":"2024-03-09T15:11:36.490736+0000","last_peered":"2024-03-09T15:11:36.490736+0000","last_clean":"2024-03-09T15:11:36.490736+0000","last_became_active":"2024-03-09T14:26:32.654096+0000","last_became_peered":"2024-03-09T14:26:32.654096+0000","last_unstale":"2024-03-09T15:11:36.490736+0000","last_undegraded":"2024-03-09T15:11:36.490736+0000","last_fullsized":"2024-03-09T15:11:36.490736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:18.258039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":160,"num_write":58,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.598713+0000","last_change":"2024-03-09T14:26:34.665772+0000","last_active":"2024-03-09T15:09:06.598713+0000","last_peered":"2024-03-09T15:09:06.598713+0000","last_clean":"2024-03-09T15:09:06.598713+0000","last_became_active":"2024-03-09T14:26:34.665478+0000","last_became_peered":"2024-03-09T14:26:34.665478+0000","last_unstale":"2024-03-09T15:09:06.598713+0000","last_undegraded":"2024-03-09T15:09:06.598713+0000","last_fullsized":"2024-03-09T15:09:06.598713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:56:28.715090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'118","reported_seq":1775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.464880+0000","last_change":"2024-03-09T14:26:36.678308+0000","last_active":"2024-03-09T15:11:37.464880+0000","last_peered":"2024-03-09T15:11:37.464880+0000","last_clean":"2024-03-09T15:11:37.464880+0000","last_became_active":"2024-03-09T14:26:36.677953+0000","last_became_peered":"2024-03-09T14:26:36.677953+0000","last_unstale":"2024-03-09T15:11:37.464880+0000","last_undegraded":"2024-03-09T15:11:37.464880+0000","last_fullsized":"2024-03-09T15:11:37.464880+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:17:40.272125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1291,"num_read_kb":1290,"num_write":257,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'553","reported_seq":2040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.176462+0000","last_change":"2024-03-09T14:26:28.644942+0000","last_active":"2024-03-09T15:11:09.176462+0000","last_peered":"2024-03-09T15:11:09.176462+0000","last_clean":"2024-03-09T15:11:09.176462+0000","last_became_active":"2024-03-09T14:26:28.644628+0000","last_became_peered":"2024-03-09T14:26:28.644628+0000","last_unstale":"2024-03-09T15:11:09.176462+0000","last_undegraded":"2024-03-09T15:11:09.176462+0000","last_fullsized":"2024-03-09T15:11:09.176462+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:08:03.645545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2742,"num_read_kb":2524,"num_write":748,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'198","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:20.871802+0000","last_change":"2024-03-09T14:26:26.637200+0000","last_active":"2024-03-09T15:08:20.871802+0000","last_peered":"2024-03-09T15:08:20.871802+0000","last_clean":"2024-03-09T15:08:20.871802+0000","last_became_active":"2024-03-09T14:26:26.636600+0000","last_became_peered":"2024-03-09T14:26:26.636600+0000","last_unstale":"2024-03-09T15:08:20.871802+0000","last_undegraded":"2024-03-09T15:08:20.871802+0000","last_fullsized":"2024-03-09T15:08:20.871802+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:11:27.327284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2977557,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":472,"num_read_kb":15859,"num_write":1031,"num_write_kb":26682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.563142+0000","last_change":"2024-03-09T14:26:30.651345+0000","last_active":"2024-03-09T15:07:41.563142+0000","last_peered":"2024-03-09T15:07:41.563142+0000","last_clean":"2024-03-09T15:07:41.563142+0000","last_became_active":"2024-03-09T14:26:30.650852+0000","last_became_peered":"2024-03-09T14:26:30.650852+0000","last_unstale":"2024-03-09T15:07:41.563142+0000","last_undegraded":"2024-03-09T15:07:41.563142+0000","last_fullsized":"2024-03-09T15:07:41.563142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:55:54.919531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'148","reported_seq":726,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.494435+0000","last_change":"2024-03-09T14:26:32.655600+0000","last_active":"2024-03-09T15:11:36.494435+0000","last_peered":"2024-03-09T15:11:36.494435+0000","last_clean":"2024-03-09T15:11:36.494435+0000","last_became_active":"2024-03-09T14:26:32.655220+0000","last_became_peered":"2024-03-09T14:26:32.655220+0000","last_unstale":"2024-03-09T15:11:36.494435+0000","last_undegraded":"2024-03-09T15:11:36.494435+0000","last_fullsized":"2024-03-09T15:11:36.494435+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:09:44.324675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8881,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":189,"num_read_kb":206,"num_write":102,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.580477+0000","last_change":"2024-03-09T14:26:34.673862+0000","last_active":"2024-03-09T15:09:06.580477+0000","last_peered":"2024-03-09T15:09:06.580477+0000","last_clean":"2024-03-09T15:09:06.580477+0000","last_became_active":"2024-03-09T14:26:34.673572+0000","last_became_peered":"2024-03-09T14:26:34.673572+0000","last_unstale":"2024-03-09T15:09:06.580477+0000","last_undegraded":"2024-03-09T15:09:06.580477+0000","last_fullsized":"2024-03-09T15:09:06.580477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:59.420732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'131","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:46.595865+0000","last_change":"2024-03-09T14:26:36.668917+0000","last_active":"2024-03-09T15:08:46.595865+0000","last_peered":"2024-03-09T15:08:46.595865+0000","last_clean":"2024-03-09T15:08:46.595865+0000","last_became_active":"2024-03-09T14:26:36.668616+0000","last_became_peered":"2024-03-09T14:26:36.668616+0000","last_unstale":"2024-03-09T15:08:46.595865+0000","last_undegraded":"2024-03-09T15:08:46.595865+0000","last_fullsized":"2024-03-09T15:08:46.595865+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:54:43.806686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":154,"num_write":316,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'645","reported_seq":2232,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.865830+0000","last_change":"2024-03-09T14:26:28.645899+0000","last_active":"2024-03-09T15:11:07.865830+0000","last_peered":"2024-03-09T15:11:07.865830+0000","last_clean":"2024-03-09T15:11:07.865830+0000","last_became_active":"2024-03-09T14:26:28.645626+0000","last_became_peered":"2024-03-09T14:26:28.645626+0000","last_unstale":"2024-03-09T15:11:07.865830+0000","last_undegraded":"2024-03-09T15:11:07.865830+0000","last_fullsized":"2024-03-09T15:11:07.865830+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":600,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:57.043642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3206,"num_read_kb":2874,"num_write":967,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'165","reported_seq":768,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:46.079700+0000","last_change":"2024-03-09T14:26:26.652363+0000","last_active":"2024-03-09T15:09:46.079700+0000","last_peered":"2024-03-09T15:09:46.079700+0000","last_clean":"2024-03-09T15:09:46.079700+0000","last_became_active":"2024-03-09T14:26:26.652050+0000","last_became_peered":"2024-03-09T14:26:26.652050+0000","last_unstale":"2024-03-09T15:09:46.079700+0000","last_undegraded":"2024-03-09T15:09:46.079700+0000","last_fullsized":"2024-03-09T15:09:46.079700+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:42.844197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12023466,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":327,"num_read_kb":46066,"num_write":937,"num_write_kb":31825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'424","reported_seq":2029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.131178+0000","last_change":"2024-03-09T14:26:28.652919+0000","last_active":"2024-03-09T15:11:37.131178+0000","last_peered":"2024-03-09T15:11:37.131178+0000","last_clean":"2024-03-09T15:11:37.131178+0000","last_became_active":"2024-03-09T14:26:28.652474+0000","last_became_peered":"2024-03-09T14:26:28.652474+0000","last_unstale":"2024-03-09T15:11:37.131178+0000","last_undegraded":"2024-03-09T15:11:37.131178+0000","last_fullsized":"2024-03-09T15:11:37.131178+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:16:37.419231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2338,"num_read_kb":2225,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'228","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:24.914180+0000","last_change":"2024-03-09T14:26:26.636278+0000","last_active":"2024-03-09T15:11:24.914180+0000","last_peered":"2024-03-09T15:11:24.914180+0000","last_clean":"2024-03-09T15:11:24.914180+0000","last_became_active":"2024-03-09T14:26:26.635943+0000","last_became_peered":"2024-03-09T14:26:26.635943+0000","last_unstale":"2024-03-09T15:11:24.914180+0000","last_undegraded":"2024-03-09T15:11:24.914180+0000","last_fullsized":"2024-03-09T15:11:24.914180+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:16.699434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340097,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":21029,"num_write":1137,"num_write_kb":21105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'402","reported_seq":1826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.431048+0000","last_change":"2024-03-09T14:26:28.646197+0000","last_active":"2024-03-09T15:11:04.431048+0000","last_peered":"2024-03-09T15:11:04.431048+0000","last_clean":"2024-03-09T15:11:04.431048+0000","last_became_active":"2024-03-09T14:26:28.645917+0000","last_became_peered":"2024-03-09T14:26:28.645917+0000","last_unstale":"2024-03-09T15:11:04.431048+0000","last_undegraded":"2024-03-09T15:11:04.431048+0000","last_fullsized":"2024-03-09T15:11:04.431048+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:35.149765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2143,"num_read_kb":1999,"num_write":476,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'193","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:20.184684+0000","last_change":"2024-03-09T14:26:26.648411+0000","last_active":"2024-03-09T15:08:20.184684+0000","last_peered":"2024-03-09T15:08:20.184684+0000","last_clean":"2024-03-09T15:08:20.184684+0000","last_became_active":"2024-03-09T14:26:26.648084+0000","last_became_peered":"2024-03-09T14:26:26.648084+0000","last_unstale":"2024-03-09T15:08:20.184684+0000","last_undegraded":"2024-03-09T15:08:20.184684+0000","last_fullsized":"2024-03-09T15:08:20.184684+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:33.823275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7394875,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":451,"num_read_kb":30660,"num_write":1031,"num_write_kb":42042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'1285","reported_seq":2878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:27.537784+0000","last_change":"2024-03-09T14:26:28.647203+0000","last_active":"2024-03-09T15:09:27.537784+0000","last_peered":"2024-03-09T15:09:27.537784+0000","last_clean":"2024-03-09T15:09:27.537784+0000","last_became_active":"2024-03-09T14:26:28.646936+0000","last_became_peered":"2024-03-09T14:26:28.646936+0000","last_unstale":"2024-03-09T15:09:27.537784+0000","last_undegraded":"2024-03-09T15:09:27.537784+0000","last_fullsized":"2024-03-09T15:09:27.537784+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:30:25.079154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5472,"num_read_kb":4757,"num_write":1845,"num_write_kb":841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'169","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:58.674844+0000","last_change":"2024-03-09T14:26:26.632719+0000","last_active":"2024-03-09T15:08:58.674844+0000","last_peered":"2024-03-09T15:08:58.674844+0000","last_clean":"2024-03-09T15:08:58.674844+0000","last_became_active":"2024-03-09T14:26:26.632394+0000","last_became_peered":"2024-03-09T14:26:26.632394+0000","last_unstale":"2024-03-09T15:08:58.674844+0000","last_undegraded":"2024-03-09T15:08:58.674844+0000","last_fullsized":"2024-03-09T15:08:58.674844+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:11:31.631305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8412719,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":374,"num_read_kb":61859,"num_write":995,"num_write_kb":24366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'709","reported_seq":2155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.166230+0000","last_change":"2024-03-09T14:26:28.656837+0000","last_active":"2024-03-09T15:10:42.166230+0000","last_peered":"2024-03-09T15:10:42.166230+0000","last_clean":"2024-03-09T15:10:42.166230+0000","last_became_active":"2024-03-09T14:26:28.655549+0000","last_became_peered":"2024-03-09T14:26:28.655549+0000","last_unstale":"2024-03-09T15:10:42.166230+0000","last_undegraded":"2024-03-09T15:10:42.166230+0000","last_fullsized":"2024-03-09T15:10:42.166230+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:44.581756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3228,"num_read_kb":2913,"num_write":936,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'242","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:18.097684+0000","last_change":"2024-03-09T14:26:26.641172+0000","last_active":"2024-03-09T15:08:18.097684+0000","last_peered":"2024-03-09T15:08:18.097684+0000","last_clean":"2024-03-09T15:08:18.097684+0000","last_became_active":"2024-03-09T14:26:26.640874+0000","last_became_peered":"2024-03-09T14:26:26.640874+0000","last_unstale":"2024-03-09T15:08:18.097684+0000","last_undegraded":"2024-03-09T15:08:18.097684+0000","last_fullsized":"2024-03-09T15:08:18.097684+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:53:42.224141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6964972,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":546,"num_read_kb":47489,"num_write":1241,"num_write_kb":60004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'342","reported_seq":1774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.320525+0000","last_change":"2024-03-09T14:26:28.645684+0000","last_active":"2024-03-09T15:10:45.320525+0000","last_peered":"2024-03-09T15:10:45.320525+0000","last_clean":"2024-03-09T15:10:45.320525+0000","last_became_active":"2024-03-09T14:26:28.645393+0000","last_became_peered":"2024-03-09T14:26:28.645393+0000","last_unstale":"2024-03-09T15:10:45.320525+0000","last_undegraded":"2024-03-09T15:10:45.320525+0000","last_fullsized":"2024-03-09T15:10:45.320525+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:56.794238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1972,"num_read_kb":1873,"num_write":396,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'179","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.208070+0000","last_change":"2024-03-09T14:26:26.631389+0000","last_active":"2024-03-09T15:10:35.208070+0000","last_peered":"2024-03-09T15:10:35.208070+0000","last_clean":"2024-03-09T15:10:35.208070+0000","last_became_active":"2024-03-09T14:26:26.631046+0000","last_became_peered":"2024-03-09T14:26:26.631046+0000","last_unstale":"2024-03-09T15:10:35.208070+0000","last_undegraded":"2024-03-09T15:10:35.208070+0000","last_fullsized":"2024-03-09T15:10:35.208070+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:11:06.737937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7710007,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":457,"num_read_kb":18518,"num_write":1078,"num_write_kb":23654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'765","reported_seq":2186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.177793+0000","last_change":"2024-03-09T14:26:28.652220+0000","last_active":"2024-03-09T15:11:09.177793+0000","last_peered":"2024-03-09T15:11:09.177793+0000","last_clean":"2024-03-09T15:11:09.177793+0000","last_became_active":"2024-03-09T14:26:28.651945+0000","last_became_peered":"2024-03-09T14:26:28.651945+0000","last_unstale":"2024-03-09T15:11:09.177793+0000","last_undegraded":"2024-03-09T15:11:09.177793+0000","last_fullsized":"2024-03-09T15:11:09.177793+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:11.189515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3422,"num_read_kb":3025,"num_write":1046,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'207","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:00.970317+0000","last_change":"2024-03-09T14:26:26.645774+0000","last_active":"2024-03-09T15:11:00.970317+0000","last_peered":"2024-03-09T15:11:00.970317+0000","last_clean":"2024-03-09T15:11:00.970317+0000","last_became_active":"2024-03-09T14:26:26.645379+0000","last_became_peered":"2024-03-09T14:26:26.645379+0000","last_unstale":"2024-03-09T15:11:00.970317+0000","last_undegraded":"2024-03-09T15:11:00.970317+0000","last_fullsized":"2024-03-09T15:11:00.970317+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:29:31.655184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11989,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":544,"num_read_kb":953,"num_write":1104,"num_write_kb":19452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'1201","reported_seq":2796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.336817+0000","last_change":"2024-03-09T14:26:28.652319+0000","last_active":"2024-03-09T15:10:35.336817+0000","last_peered":"2024-03-09T15:10:35.336817+0000","last_clean":"2024-03-09T15:10:35.336817+0000","last_became_active":"2024-03-09T14:26:28.651254+0000","last_became_peered":"2024-03-09T14:26:28.651254+0000","last_unstale":"2024-03-09T15:10:35.336817+0000","last_undegraded":"2024-03-09T15:10:35.336817+0000","last_fullsized":"2024-03-09T15:10:35.336817+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":1100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:17:36.798177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5174,"num_read_kb":4521,"num_write":1709,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'209","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:50.564141+0000","last_change":"2024-03-09T14:26:26.640461+0000","last_active":"2024-03-09T15:09:50.564141+0000","last_peered":"2024-03-09T15:09:50.564141+0000","last_clean":"2024-03-09T15:09:50.564141+0000","last_became_active":"2024-03-09T14:26:26.639719+0000","last_became_peered":"2024-03-09T14:26:26.639719+0000","last_unstale":"2024-03-09T15:09:50.564141+0000","last_undegraded":"2024-03-09T15:09:50.564141+0000","last_fullsized":"2024-03-09T15:09:50.564141+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:52.609065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16421214,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":521,"num_read_kb":50172,"num_write":1164,"num_write_kb":33138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1152","reported_seq":2678,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.124689+0000","last_change":"2024-03-09T14:26:28.648946+0000","last_active":"2024-03-09T15:11:37.124689+0000","last_peered":"2024-03-09T15:11:37.124689+0000","last_clean":"2024-03-09T15:11:37.124689+0000","last_became_active":"2024-03-09T14:26:28.648626+0000","last_became_peered":"2024-03-09T14:26:28.648626+0000","last_unstale":"2024-03-09T15:11:37.124689+0000","last_undegraded":"2024-03-09T15:11:37.124689+0000","last_fullsized":"2024-03-09T15:11:37.124689+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:23:27.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4796,"num_read_kb":4189,"num_write":1590,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'182","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.006378+0000","last_change":"2024-03-09T14:26:26.640526+0000","last_active":"2024-03-09T15:11:37.006378+0000","last_peered":"2024-03-09T15:11:37.006378+0000","last_clean":"2024-03-09T15:11:37.006378+0000","last_became_active":"2024-03-09T14:26:26.640157+0000","last_became_peered":"2024-03-09T14:26:26.640157+0000","last_unstale":"2024-03-09T15:11:37.006378+0000","last_undegraded":"2024-03-09T15:11:37.006378+0000","last_fullsized":"2024-03-09T15:11:37.006378+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:22.974524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5571611,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":437,"num_read_kb":19255,"num_write":998,"num_write_kb":28212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'708","reported_seq":2134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.078327+0000","last_change":"2024-03-09T14:26:28.650311+0000","last_active":"2024-03-09T15:10:51.078327+0000","last_peered":"2024-03-09T15:10:51.078327+0000","last_clean":"2024-03-09T15:10:51.078327+0000","last_became_active":"2024-03-09T14:26:28.650013+0000","last_became_peered":"2024-03-09T14:26:28.650013+0000","last_unstale":"2024-03-09T15:10:51.078327+0000","last_undegraded":"2024-03-09T15:10:51.078327+0000","last_fullsized":"2024-03-09T15:10:51.078327+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":600,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:26.543324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3189,"num_read_kb":2865,"num_write":935,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'206","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.469017+0000","last_change":"2024-03-09T14:26:26.642035+0000","last_active":"2024-03-09T15:10:36.469017+0000","last_peered":"2024-03-09T15:10:36.469017+0000","last_clean":"2024-03-09T15:10:36.469017+0000","last_became_active":"2024-03-09T14:26:26.641737+0000","last_became_peered":"2024-03-09T14:26:26.641737+0000","last_unstale":"2024-03-09T15:10:36.469017+0000","last_undegraded":"2024-03-09T15:10:36.469017+0000","last_fullsized":"2024-03-09T15:10:36.469017+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:42:55.138498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5853727,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":491,"num_read_kb":32584,"num_write":1132,"num_write_kb":28426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'421","reported_seq":2053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.552733+0000","last_change":"2024-03-09T14:26:28.644372+0000","last_active":"2024-03-09T15:10:54.552733+0000","last_peered":"2024-03-09T15:10:54.552733+0000","last_clean":"2024-03-09T15:10:54.552733+0000","last_became_active":"2024-03-09T14:26:28.644094+0000","last_became_peered":"2024-03-09T14:26:28.644094+0000","last_unstale":"2024-03-09T15:10:54.552733+0000","last_undegraded":"2024-03-09T15:10:54.552733+0000","last_fullsized":"2024-03-09T15:10:54.552733+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:42.631901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2230,"num_write":484,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'211","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:11.583745+0000","last_change":"2024-03-09T14:26:26.645771+0000","last_active":"2024-03-09T15:09:11.583745+0000","last_peered":"2024-03-09T15:09:11.583745+0000","last_clean":"2024-03-09T15:09:11.583745+0000","last_became_active":"2024-03-09T14:26:26.645413+0000","last_became_peered":"2024-03-09T14:26:26.645413+0000","last_unstale":"2024-03-09T15:09:11.583745+0000","last_undegraded":"2024-03-09T15:09:11.583745+0000","last_fullsized":"2024-03-09T15:09:11.583745+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:23:25.742745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269833,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":456,"num_read_kb":3495,"num_write":1053,"num_write_kb":12293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'790","reported_seq":2457,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.600171+0000","last_change":"2024-03-09T14:26:28.650961+0000","last_active":"2024-03-09T15:09:16.600171+0000","last_peered":"2024-03-09T15:09:16.600171+0000","last_clean":"2024-03-09T15:09:16.600171+0000","last_became_active":"2024-03-09T14:26:28.650629+0000","last_became_peered":"2024-03-09T14:26:28.650629+0000","last_unstale":"2024-03-09T15:09:16.600171+0000","last_undegraded":"2024-03-09T15:09:16.600171+0000","last_fullsized":"2024-03-09T15:09:16.600171+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:53:42.426447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3842,"num_read_kb":3483,"num_write":1039,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'230","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:11.580982+0000","last_change":"2024-03-09T14:26:26.644786+0000","last_active":"2024-03-09T15:09:11.580982+0000","last_peered":"2024-03-09T15:09:11.580982+0000","last_clean":"2024-03-09T15:09:11.580982+0000","last_became_active":"2024-03-09T14:26:26.644358+0000","last_became_peered":"2024-03-09T14:26:26.644358+0000","last_unstale":"2024-03-09T15:09:11.580982+0000","last_undegraded":"2024-03-09T15:09:11.580982+0000","last_fullsized":"2024-03-09T15:09:11.580982+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:25:50.487416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11881660,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":7434,"num_write":1300,"num_write_kb":33527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'509","reported_seq":2075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.121732+0000","last_change":"2024-03-09T14:26:28.655751+0000","last_active":"2024-03-09T15:11:37.121732+0000","last_peered":"2024-03-09T15:11:37.121732+0000","last_clean":"2024-03-09T15:11:37.121732+0000","last_became_active":"2024-03-09T14:26:28.655438+0000","last_became_peered":"2024-03-09T14:26:28.655438+0000","last_unstale":"2024-03-09T15:11:37.121732+0000","last_undegraded":"2024-03-09T15:11:37.121732+0000","last_fullsized":"2024-03-09T15:11:37.121732+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:20:48.282049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2613,"num_read_kb":2408,"num_write":650,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'181","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.493354+0000","last_change":"2024-03-09T14:26:26.649089+0000","last_active":"2024-03-09T15:11:26.493354+0000","last_peered":"2024-03-09T15:11:26.493354+0000","last_clean":"2024-03-09T15:11:26.493354+0000","last_became_active":"2024-03-09T14:26:26.648682+0000","last_became_peered":"2024-03-09T14:26:26.648682+0000","last_unstale":"2024-03-09T15:11:26.493354+0000","last_undegraded":"2024-03-09T15:11:26.493354+0000","last_fullsized":"2024-03-09T15:11:26.493354+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:54:12.434919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2164234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":6066,"num_write":1000,"num_write_kb":27510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'408","reported_seq":2014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.553857+0000","last_change":"2024-03-09T14:26:28.646581+0000","last_active":"2024-03-09T15:10:54.553857+0000","last_peered":"2024-03-09T15:10:54.553857+0000","last_clean":"2024-03-09T15:10:54.553857+0000","last_became_active":"2024-03-09T14:26:28.646239+0000","last_became_peered":"2024-03-09T14:26:28.646239+0000","last_unstale":"2024-03-09T15:10:54.553857+0000","last_undegraded":"2024-03-09T15:10:54.553857+0000","last_fullsized":"2024-03-09T15:10:54.553857+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:05.491938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2327,"num_read_kb":2213,"num_write":484,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'211","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.721377+0000","last_change":"2024-03-09T14:26:26.646103+0000","last_active":"2024-03-09T15:09:16.721377+0000","last_peered":"2024-03-09T15:09:16.721377+0000","last_clean":"2024-03-09T15:09:16.721377+0000","last_became_active":"2024-03-09T14:26:26.645230+0000","last_became_peered":"2024-03-09T14:26:26.645230+0000","last_unstale":"2024-03-09T15:09:16.721377+0000","last_undegraded":"2024-03-09T15:09:16.721377+0000","last_fullsized":"2024-03-09T15:09:16.721377+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:46:59.836355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7622315,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":431,"num_read_kb":27386,"num_write":1082,"num_write_kb":24817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'342","reported_seq":1816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.357304+0000","last_change":"2024-03-09T14:26:28.653452+0000","last_active":"2024-03-09T15:10:35.357304+0000","last_peered":"2024-03-09T15:10:35.357304+0000","last_clean":"2024-03-09T15:10:35.357304+0000","last_became_active":"2024-03-09T14:26:28.653177+0000","last_became_peered":"2024-03-09T14:26:28.653177+0000","last_unstale":"2024-03-09T15:10:35.357304+0000","last_undegraded":"2024-03-09T15:10:35.357304+0000","last_fullsized":"2024-03-09T15:10:35.357304+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:12:43.827174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1954,"num_read_kb":1880,"num_write":380,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'192","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.563634+0000","last_change":"2024-03-09T14:26:26.637956+0000","last_active":"2024-03-09T15:08:26.563634+0000","last_peered":"2024-03-09T15:08:26.563634+0000","last_clean":"2024-03-09T15:08:26.563634+0000","last_became_active":"2024-03-09T14:26:26.637589+0000","last_became_peered":"2024-03-09T14:26:26.637589+0000","last_unstale":"2024-03-09T15:08:26.563634+0000","last_undegraded":"2024-03-09T15:08:26.563634+0000","last_fullsized":"2024-03-09T15:08:26.563634+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:33.711328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10750031,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":377,"num_read_kb":13354,"num_write":1021,"num_write_kb":55720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'1151","reported_seq":2610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.127436+0000","last_change":"2024-03-09T14:26:28.655806+0000","last_active":"2024-03-09T15:11:37.127436+0000","last_peered":"2024-03-09T15:11:37.127436+0000","last_clean":"2024-03-09T15:11:37.127436+0000","last_became_active":"2024-03-09T14:26:28.655383+0000","last_became_peered":"2024-03-09T14:26:28.655383+0000","last_unstale":"2024-03-09T15:11:37.127436+0000","last_undegraded":"2024-03-09T15:11:37.127436+0000","last_fullsized":"2024-03-09T15:11:37.127436+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:09:15.464868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4791,"num_read_kb":4166,"num_write":1605,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'228","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.578230+0000","last_change":"2024-03-09T14:26:26.653398+0000","last_active":"2024-03-09T15:08:26.578230+0000","last_peered":"2024-03-09T15:08:26.578230+0000","last_clean":"2024-03-09T15:08:26.578230+0000","last_became_active":"2024-03-09T14:26:26.652576+0000","last_became_peered":"2024-03-09T14:26:26.652576+0000","last_unstale":"2024-03-09T15:08:26.578230+0000","last_undegraded":"2024-03-09T15:08:26.578230+0000","last_fullsized":"2024-03-09T15:08:26.578230+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:27:29.674744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3830168,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":651,"num_read_kb":5204,"num_write":1019,"num_write_kb":18451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'311","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.578116+0000","last_change":"2024-03-09T14:27:03.716194+0000","last_active":"2024-03-09T15:08:26.578116+0000","last_peered":"2024-03-09T15:08:26.578116+0000","last_clean":"2024-03-09T15:08:26.578116+0000","last_became_active":"2024-03-09T14:27:03.715719+0000","last_became_peered":"2024-03-09T14:27:03.715719+0000","last_unstale":"2024-03-09T15:08:26.578116+0000","last_undegraded":"2024-03-09T15:08:26.578116+0000","last_fullsized":"2024-03-09T15:08:26.578116+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:14.860709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11557044,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":835,"num_read_kb":60306,"num_write":1283,"num_write_kb":31608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'792","reported_seq":2406,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.338529+0000","last_change":"2024-03-09T14:26:28.649429+0000","last_active":"2024-03-09T15:10:35.338529+0000","last_peered":"2024-03-09T15:10:35.338529+0000","last_clean":"2024-03-09T15:10:35.338529+0000","last_became_active":"2024-03-09T14:26:28.649178+0000","last_became_peered":"2024-03-09T14:26:28.649178+0000","last_unstale":"2024-03-09T15:10:35.338529+0000","last_undegraded":"2024-03-09T15:10:35.338529+0000","last_fullsized":"2024-03-09T15:10:35.338529+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:22:23.602537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3684,"num_read_kb":3311,"num_write":1055,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'185","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.568496+0000","last_change":"2024-03-09T14:27:03.721922+0000","last_active":"2024-03-09T15:08:26.568496+0000","last_peered":"2024-03-09T15:08:26.568496+0000","last_clean":"2024-03-09T15:08:26.568496+0000","last_became_active":"2024-03-09T14:27:03.721595+0000","last_became_peered":"2024-03-09T14:27:03.721595+0000","last_unstale":"2024-03-09T15:08:26.568496+0000","last_undegraded":"2024-03-09T15:08:26.568496+0000","last_fullsized":"2024-03-09T15:08:26.568496+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:37:54.615568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12408196,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":487,"num_read_kb":112993,"num_write":1047,"num_write_kb":48480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'387","reported_seq":2043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.590524+0000","last_change":"2024-03-09T14:26:28.645372+0000","last_active":"2024-03-09T15:10:36.590524+0000","last_peered":"2024-03-09T15:10:36.590524+0000","last_clean":"2024-03-09T15:10:36.590524+0000","last_became_active":"2024-03-09T14:26:28.645067+0000","last_became_peered":"2024-03-09T14:26:28.645067+0000","last_unstale":"2024-03-09T15:10:36.590524+0000","last_undegraded":"2024-03-09T15:10:36.590524+0000","last_fullsized":"2024-03-09T15:10:36.590524+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:44:56.178003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2475,"num_read_kb":2383,"num_write":438,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5887,"num_read_kb":4246,"num_write":2185,"num_write_kb":841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1217,"ondisk_log_size":1217,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":12946,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":15495,"num_read_kb":15279,"num_write":16228,"num_write_kb":4747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":507904,"data_stored":25892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1762,"ondisk_log_size":1762,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":408,"ondisk_log_size":408,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":438641,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":7752,"num_read_kb":9480,"num_write":5539,"num_write_kb":2830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":770048,"data_stored":239200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2159,"ondisk_log_size":2159,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1583,"num_read_kb":1885,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":195183,"num_read_kb":178329,"num_write":51691,"num_write_kb":17736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":121,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3837,"ondisk_log_size":3837,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":554823561,"num_objects":519,"num_object_clones":0,"num_object_copies":1557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":519,"num_whiteouts":0,"num_read":32040,"num_read_kb":2319153,"num_write":69560,"num_write_kb":2158516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":835055616,"data_stored":835055616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4404,"ondisk_log_size":4404,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":89222774,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":133,"num_read_kb":164063,"num_write":151,"num_write_kb":125047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":178454528,"data_stored":178445548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":89222774,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":139,"num_read_kb":183429,"num_write":151,"num_write_kb":125047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":178454528,"data_stored":178445548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575400,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444216,"kb_used_data":174256,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93927624,"statfs":{"total":96636764160,"available":96181886976,"internally_reserved":0,"allocated":178438144,"data_stored":176418466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575399,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378896,"kb_used_data":122824,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93992944,"statfs":{"total":96636764160,"available":96248774656,"internally_reserved":0,"allocated":125771776,"data_stored":123793256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575400,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241656,"kb_used_data":156336,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94130184,"statfs":{"total":96636764160,"available":96389308416,"internally_reserved":0,"allocated":160088064,"data_stored":158047167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575398,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":234120,"kb_used_data":148800,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94137720,"statfs":{"total":96636764160,"available":96397025280,"internally_reserved":0,"allocated":152371200,"data_stored":150461065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575399,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409320,"kb_used_data":175456,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93962520,"statfs":{"total":96636764160,"available":96217620480,"internally_reserved":0,"allocated":179666944,"data_stored":177639659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575398,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":210328,"kb_used_data":138896,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94161512,"statfs":{"total":96636764160,"available":96421388288,"internally_reserved":0,"allocated":142229504,"data_stored":140290947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575399,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272976,"kb_used_data":151624,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94098864,"statfs":{"total":96636764160,"available":96357236736,"internally_reserved":0,"allocated":155262976,"data_stored":153295586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575399,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368572,"kb_used_data":130548,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94003268,"statfs":{"total":96636764160,"available":96259346432,"internally_reserved":0,"allocated":133681152,"data_stored":131671448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93069312,"data_stored":93069312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":112103424,"data_stored":112103424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":92852224,"data_stored":92852224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106057728,"data_stored":106057728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":118755328,"data_stored":118755328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":100155392,"data_stored":100155392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":92041216,"data_stored":92041216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":120020992,"data_stored":120020992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":27934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":30982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":16269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":39607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":12830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":35670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":27123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":48785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18927616,"data_stored":18924827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18919424,"data_stored":18917723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19980288,"data_stored":19976613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34603008,"data_stored":34603008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15769600,"data_stored":15768785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19963904,"data_stored":19963089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32559104,"data_stored":32556315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":47243264,"data_stored":47239589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13676544,"data_stored":13674843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:11:46.854 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-09T15:11:46.855 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:11:47.193 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:47.205 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-03-09T15:11:47.207 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":1624,"stamp":"2024-03-09T15:11:45.532585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":734312783,"num_objects":1010,"num_object_clones":0,"num_object_copies":2539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1010,"num_whiteouts":0,"num_read":258340,"num_read_kb":2875976,"num_write":145702,"num_write_kb":2437205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":166,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14017,"ondisk_log_size":14017,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2560084,"kb_used_data":1198740,"kb_used_omap":12,"kb_used_meta":1361267,"kb_avail":752414636,"statfs":{"total":773094113280,"available":770472587264,"internally_reserved":0,"allocated":1227509760,"data_stored":1211617594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1393937968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4193250,"num_objects":-18,"num_object_clones":0,"num_object_copies":-37,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":189,"num_read_kb":10494,"num_write":42,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005623"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.575812+0000","last_change":"2024-03-09T14:50:35.506808+0000","last_active":"2024-03-09T15:08:06.575812+0000","last_peered":"2024-03-09T15:08:06.575812+0000","last_clean":"2024-03-09T15:08:06.575812+0000","last_became_active":"2024-03-09T14:50:35.506543+0000","last_became_peered":"2024-03-09T14:50:35.506543+0000","last_unstale":"2024-03-09T15:08:06.575812+0000","last_undegraded":"2024-03-09T15:08:06.575812+0000","last_fullsized":"2024-03-09T15:08:06.575812+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:58.593691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.579403+0000","last_change":"2024-03-09T14:38:37.436681+0000","last_active":"2024-03-09T15:08:36.579403+0000","last_peered":"2024-03-09T15:08:36.579403+0000","last_clean":"2024-03-09T15:08:36.579403+0000","last_became_active":"2024-03-09T14:38:37.436381+0000","last_became_peered":"2024-03-09T14:38:37.436381+0000","last_unstale":"2024-03-09T15:08:36.579403+0000","last_undegraded":"2024-03-09T15:08:36.579403+0000","last_fullsized":"2024-03-09T15:08:36.579403+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:00:43.470078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'4","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.679815+0000","last_change":"2024-03-09T14:38:34.419017+0000","last_active":"2024-03-09T15:08:36.679815+0000","last_peered":"2024-03-09T15:08:36.679815+0000","last_clean":"2024-03-09T15:08:36.679815+0000","last_became_active":"2024-03-09T14:38:34.418748+0000","last_became_peered":"2024-03-09T14:38:34.418748+0000","last_unstale":"2024-03-09T15:08:36.679815+0000","last_undegraded":"2024-03-09T15:08:36.679815+0000","last_fullsized":"2024-03-09T15:08:36.679815+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:59:58.574754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'22","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.579987+0000","last_change":"2024-03-09T14:35:41.122537+0000","last_active":"2024-03-09T15:09:01.579987+0000","last_peered":"2024-03-09T15:09:01.579987+0000","last_clean":"2024-03-09T15:09:01.579987+0000","last_became_active":"2024-03-09T14:35:41.121412+0000","last_became_peered":"2024-03-09T14:35:41.121412+0000","last_unstale":"2024-03-09T15:09:01.579987+0000","last_undegraded":"2024-03-09T15:09:01.579987+0000","last_fullsized":"2024-03-09T15:09:01.579987+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:26:10.508823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":67,"num_write":35,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.561315+0000","last_change":"2024-03-09T14:50:35.507193+0000","last_active":"2024-03-09T15:08:06.561315+0000","last_peered":"2024-03-09T15:08:06.561315+0000","last_clean":"2024-03-09T15:08:06.561315+0000","last_became_active":"2024-03-09T14:50:35.506905+0000","last_became_peered":"2024-03-09T14:50:35.506905+0000","last_unstale":"2024-03-09T15:08:06.561315+0000","last_undegraded":"2024-03-09T15:08:06.561315+0000","last_fullsized":"2024-03-09T15:08:06.561315+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:36:12.492461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.594554+0000","last_change":"2024-03-09T14:38:37.440992+0000","last_active":"2024-03-09T15:08:36.594554+0000","last_peered":"2024-03-09T15:08:36.594554+0000","last_clean":"2024-03-09T15:08:36.594554+0000","last_became_active":"2024-03-09T14:38:37.440733+0000","last_became_peered":"2024-03-09T14:38:37.440733+0000","last_unstale":"2024-03-09T15:08:36.594554+0000","last_undegraded":"2024-03-09T15:08:36.594554+0000","last_fullsized":"2024-03-09T15:08:36.594554+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:32:36.858145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'4","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.569798+0000","last_change":"2024-03-09T14:38:34.426397+0000","last_active":"2024-03-09T15:08:36.569798+0000","last_peered":"2024-03-09T15:08:36.569798+0000","last_clean":"2024-03-09T15:08:36.569798+0000","last_became_active":"2024-03-09T14:38:34.425629+0000","last_became_peered":"2024-03-09T14:38:34.425629+0000","last_unstale":"2024-03-09T15:08:36.569798+0000","last_undegraded":"2024-03-09T15:08:36.569798+0000","last_fullsized":"2024-03-09T15:08:36.569798+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:05.228490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'52","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.559699+0000","last_change":"2024-03-09T14:35:41.118142+0000","last_active":"2024-03-09T15:07:51.559699+0000","last_peered":"2024-03-09T15:07:51.559699+0000","last_clean":"2024-03-09T15:07:51.559699+0000","last_became_active":"2024-03-09T14:35:41.117858+0000","last_became_peered":"2024-03-09T14:35:41.117858+0000","last_unstale":"2024-03-09T15:07:51.559699+0000","last_undegraded":"2024-03-09T15:07:51.559699+0000","last_fullsized":"2024-03-09T15:07:51.559699+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:33:55.309111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":156,"num_write":85,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.585850+0000","last_change":"2024-03-09T14:50:35.506417+0000","last_active":"2024-03-09T15:07:31.585850+0000","last_peered":"2024-03-09T15:07:31.585850+0000","last_clean":"2024-03-09T15:07:31.585850+0000","last_became_active":"2024-03-09T14:50:35.506136+0000","last_became_peered":"2024-03-09T14:50:35.506136+0000","last_unstale":"2024-03-09T15:07:31.585850+0000","last_undegraded":"2024-03-09T15:07:31.585850+0000","last_fullsized":"2024-03-09T15:07:31.585850+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:25:26.999053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"261'9","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.571362+0000","last_change":"2024-03-09T14:38:37.443197+0000","last_active":"2024-03-09T15:07:46.571362+0000","last_peered":"2024-03-09T15:07:46.571362+0000","last_clean":"2024-03-09T15:07:46.571362+0000","last_became_active":"2024-03-09T14:38:37.442906+0000","last_became_peered":"2024-03-09T14:38:37.442906+0000","last_unstale":"2024-03-09T15:07:46.571362+0000","last_undegraded":"2024-03-09T15:07:46.571362+0000","last_fullsized":"2024-03-09T15:07:46.571362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:32:22.327056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":8196,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:46.566095+0000","last_change":"2024-03-09T14:38:34.425940+0000","last_active":"2024-03-09T15:08:46.566095+0000","last_peered":"2024-03-09T15:08:46.566095+0000","last_clean":"2024-03-09T15:08:46.566095+0000","last_became_active":"2024-03-09T14:38:34.425459+0000","last_became_peered":"2024-03-09T14:38:34.425459+0000","last_unstale":"2024-03-09T15:08:46.566095+0000","last_undegraded":"2024-03-09T15:08:46.566095+0000","last_fullsized":"2024-03-09T15:08:46.566095+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:37:12.404902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"261'16","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.574184+0000","last_change":"2024-03-09T14:35:41.123438+0000","last_active":"2024-03-09T15:08:11.574184+0000","last_peered":"2024-03-09T15:08:11.574184+0000","last_clean":"2024-03-09T15:08:11.574184+0000","last_became_active":"2024-03-09T14:35:41.123171+0000","last_became_peered":"2024-03-09T14:35:41.123171+0000","last_unstale":"2024-03-09T15:08:11.574184+0000","last_undegraded":"2024-03-09T15:08:11.574184+0000","last_fullsized":"2024-03-09T15:08:11.574184+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:41:36.543762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":56,"num_write":23,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.670756+0000","last_change":"2024-03-09T14:50:35.503396+0000","last_active":"2024-03-09T15:07:31.670756+0000","last_peered":"2024-03-09T15:07:31.670756+0000","last_clean":"2024-03-09T15:07:31.670756+0000","last_became_active":"2024-03-09T14:50:35.503090+0000","last_became_peered":"2024-03-09T14:50:35.503090+0000","last_unstale":"2024-03-09T15:07:31.670756+0000","last_undegraded":"2024-03-09T15:07:31.670756+0000","last_fullsized":"2024-03-09T15:07:31.670756+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:41:04.564051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'1","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.680879+0000","last_change":"2024-03-09T14:38:37.432464+0000","last_active":"2024-03-09T15:08:41.680879+0000","last_peered":"2024-03-09T15:08:41.680879+0000","last_clean":"2024-03-09T15:08:41.680879+0000","last_became_active":"2024-03-09T14:38:37.432089+0000","last_became_peered":"2024-03-09T14:38:37.432089+0000","last_unstale":"2024-03-09T15:08:41.680879+0000","last_undegraded":"2024-03-09T15:08:41.680879+0000","last_fullsized":"2024-03-09T15:08:41.680879+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:57:20.656020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'1","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588329+0000","last_change":"2024-03-09T14:38:34.417315+0000","last_active":"2024-03-09T15:07:46.588329+0000","last_peered":"2024-03-09T15:07:46.588329+0000","last_clean":"2024-03-09T15:07:46.588329+0000","last_became_active":"2024-03-09T14:38:34.417024+0000","last_became_peered":"2024-03-09T14:38:34.417024+0000","last_unstale":"2024-03-09T15:07:46.588329+0000","last_undegraded":"2024-03-09T15:07:46.588329+0000","last_fullsized":"2024-03-09T15:07:46.588329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:49:02.652837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'52","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.675909+0000","last_change":"2024-03-09T14:35:41.119245+0000","last_active":"2024-03-09T15:08:11.675909+0000","last_peered":"2024-03-09T15:08:11.675909+0000","last_clean":"2024-03-09T15:08:11.675909+0000","last_became_active":"2024-03-09T14:35:41.118960+0000","last_became_peered":"2024-03-09T14:35:41.118960+0000","last_unstale":"2024-03-09T15:08:11.675909+0000","last_undegraded":"2024-03-09T15:08:11.675909+0000","last_fullsized":"2024-03-09T15:08:11.675909+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:37.838048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":146,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.680090+0000","last_change":"2024-03-09T14:50:35.513378+0000","last_active":"2024-03-09T15:08:36.680090+0000","last_peered":"2024-03-09T15:08:36.680090+0000","last_clean":"2024-03-09T15:08:36.680090+0000","last_became_active":"2024-03-09T14:50:35.512534+0000","last_became_peered":"2024-03-09T14:50:35.512534+0000","last_unstale":"2024-03-09T15:08:36.680090+0000","last_undegraded":"2024-03-09T15:08:36.680090+0000","last_fullsized":"2024-03-09T15:08:36.680090+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:42:59.375192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.572976+0000","last_change":"2024-03-09T14:38:37.437102+0000","last_active":"2024-03-09T15:07:41.572976+0000","last_peered":"2024-03-09T15:07:41.572976+0000","last_clean":"2024-03-09T15:07:41.572976+0000","last_became_active":"2024-03-09T14:38:37.436829+0000","last_became_peered":"2024-03-09T14:38:37.436829+0000","last_unstale":"2024-03-09T15:07:41.572976+0000","last_undegraded":"2024-03-09T15:07:41.572976+0000","last_fullsized":"2024-03-09T15:07:41.572976+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:50:39.916587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'4","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.569979+0000","last_change":"2024-03-09T14:38:34.418873+0000","last_active":"2024-03-09T15:07:36.569979+0000","last_peered":"2024-03-09T15:07:36.569979+0000","last_clean":"2024-03-09T15:07:36.569979+0000","last_became_active":"2024-03-09T14:38:34.418209+0000","last_became_peered":"2024-03-09T14:38:34.418209+0000","last_unstale":"2024-03-09T15:07:36.569979+0000","last_undegraded":"2024-03-09T15:07:36.569979+0000","last_fullsized":"2024-03-09T15:07:36.569979+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:50.765837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099035,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6194,"num_write":4,"num_write_kb":5170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'22","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.675884+0000","last_change":"2024-03-09T14:35:41.123984+0000","last_active":"2024-03-09T15:08:11.675884+0000","last_peered":"2024-03-09T15:08:11.675884+0000","last_clean":"2024-03-09T15:08:11.675884+0000","last_became_active":"2024-03-09T14:35:41.123715+0000","last_became_peered":"2024-03-09T14:35:41.123715+0000","last_unstale":"2024-03-09T15:08:11.675884+0000","last_undegraded":"2024-03-09T15:08:11.675884+0000","last_fullsized":"2024-03-09T15:08:11.675884+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:09:46.063200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":62,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.574433+0000","last_change":"2024-03-09T14:50:35.510228+0000","last_active":"2024-03-09T15:09:21.574433+0000","last_peered":"2024-03-09T15:09:21.574433+0000","last_clean":"2024-03-09T15:09:21.574433+0000","last_became_active":"2024-03-09T14:50:35.509938+0000","last_became_peered":"2024-03-09T14:50:35.509938+0000","last_unstale":"2024-03-09T15:09:21.574433+0000","last_undegraded":"2024-03-09T15:09:21.574433+0000","last_fullsized":"2024-03-09T15:09:21.574433+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:07:27.212874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.586636+0000","last_change":"2024-03-09T14:38:37.439503+0000","last_active":"2024-03-09T15:07:36.586636+0000","last_peered":"2024-03-09T15:07:36.586636+0000","last_clean":"2024-03-09T15:07:36.586636+0000","last_became_active":"2024-03-09T14:38:37.439120+0000","last_became_peered":"2024-03-09T14:38:37.439120+0000","last_unstale":"2024-03-09T15:07:36.586636+0000","last_undegraded":"2024-03-09T15:07:36.586636+0000","last_fullsized":"2024-03-09T15:07:36.586636+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:27:16.750464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'4","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588215+0000","last_change":"2024-03-09T14:38:34.418823+0000","last_active":"2024-03-09T15:07:46.588215+0000","last_peered":"2024-03-09T15:07:46.588215+0000","last_clean":"2024-03-09T15:07:46.588215+0000","last_became_active":"2024-03-09T14:38:34.418553+0000","last_became_peered":"2024-03-09T14:38:34.418553+0000","last_unstale":"2024-03-09T15:07:46.588215+0000","last_undegraded":"2024-03-09T15:07:46.588215+0000","last_fullsized":"2024-03-09T15:07:46.588215+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:14.699597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'47","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591412+0000","last_change":"2024-03-09T14:35:41.124086+0000","last_active":"2024-03-09T15:08:11.591412+0000","last_peered":"2024-03-09T15:08:11.591412+0000","last_clean":"2024-03-09T15:08:11.591412+0000","last_became_active":"2024-03-09T14:35:41.123785+0000","last_became_peered":"2024-03-09T14:35:41.123785+0000","last_unstale":"2024-03-09T15:08:11.591412+0000","last_undegraded":"2024-03-09T15:08:11.591412+0000","last_fullsized":"2024-03-09T15:08:11.591412+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:48:27.983405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":141,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.711751+0000","last_change":"2024-03-09T14:50:35.500344+0000","last_active":"2024-03-09T15:08:06.711751+0000","last_peered":"2024-03-09T15:08:06.711751+0000","last_clean":"2024-03-09T15:08:06.711751+0000","last_became_active":"2024-03-09T14:50:35.499942+0000","last_became_peered":"2024-03-09T14:50:35.499942+0000","last_unstale":"2024-03-09T15:08:06.711751+0000","last_undegraded":"2024-03-09T15:08:06.711751+0000","last_fullsized":"2024-03-09T15:08:06.711751+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:47:17.395153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.594512+0000","last_change":"2024-03-09T14:38:37.438111+0000","last_active":"2024-03-09T15:08:36.594512+0000","last_peered":"2024-03-09T15:08:36.594512+0000","last_clean":"2024-03-09T15:08:36.594512+0000","last_became_active":"2024-03-09T14:38:37.437714+0000","last_became_peered":"2024-03-09T14:38:37.437714+0000","last_unstale":"2024-03-09T15:08:36.594512+0000","last_undegraded":"2024-03-09T15:08:36.594512+0000","last_fullsized":"2024-03-09T15:08:36.594512+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:33.290321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'1","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.594465+0000","last_change":"2024-03-09T14:38:34.420968+0000","last_active":"2024-03-09T15:08:36.594465+0000","last_peered":"2024-03-09T15:08:36.594465+0000","last_clean":"2024-03-09T15:08:36.594465+0000","last_became_active":"2024-03-09T14:38:34.420232+0000","last_became_peered":"2024-03-09T14:38:34.420232+0000","last_unstale":"2024-03-09T15:08:36.594465+0000","last_undegraded":"2024-03-09T15:08:36.594465+0000","last_fullsized":"2024-03-09T15:08:36.594465+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:19.316094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'24","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.567871+0000","last_change":"2024-03-09T14:35:41.121844+0000","last_active":"2024-03-09T15:07:16.567871+0000","last_peered":"2024-03-09T15:07:16.567871+0000","last_clean":"2024-03-09T15:07:16.567871+0000","last_became_active":"2024-03-09T14:35:41.121566+0000","last_became_peered":"2024-03-09T14:35:41.121566+0000","last_unstale":"2024-03-09T15:07:16.567871+0000","last_undegraded":"2024-03-09T15:07:16.567871+0000","last_fullsized":"2024-03-09T15:07:16.567871+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:48.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.711796+0000","last_change":"2024-03-09T14:50:35.501732+0000","last_active":"2024-03-09T15:08:06.711796+0000","last_peered":"2024-03-09T15:08:06.711796+0000","last_clean":"2024-03-09T15:08:06.711796+0000","last_became_active":"2024-03-09T14:50:35.501422+0000","last_became_peered":"2024-03-09T14:50:35.501422+0000","last_unstale":"2024-03-09T15:08:06.711796+0000","last_undegraded":"2024-03-09T15:08:06.711796+0000","last_fullsized":"2024-03-09T15:08:06.711796+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:51:45.968049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.679731+0000","last_change":"2024-03-09T14:38:37.438996+0000","last_active":"2024-03-09T15:08:36.679731+0000","last_peered":"2024-03-09T15:08:36.679731+0000","last_clean":"2024-03-09T15:08:36.679731+0000","last_became_active":"2024-03-09T14:38:37.438685+0000","last_became_peered":"2024-03-09T14:38:37.438685+0000","last_unstale":"2024-03-09T15:08:36.679731+0000","last_undegraded":"2024-03-09T15:08:36.679731+0000","last_fullsized":"2024-03-09T15:08:36.679731+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:52:54.773763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.577053+0000","last_change":"2024-03-09T14:38:34.422906+0000","last_active":"2024-03-09T15:08:36.577053+0000","last_peered":"2024-03-09T15:08:36.577053+0000","last_clean":"2024-03-09T15:08:36.577053+0000","last_became_active":"2024-03-09T14:38:34.422607+0000","last_became_peered":"2024-03-09T14:38:34.422607+0000","last_unstale":"2024-03-09T15:08:36.577053+0000","last_undegraded":"2024-03-09T15:08:36.577053+0000","last_fullsized":"2024-03-09T15:08:36.577053+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:57.914098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'68","reported_seq":223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:06.559342+0000","last_change":"2024-03-09T14:35:41.123207+0000","last_active":"2024-03-09T15:07:06.559342+0000","last_peered":"2024-03-09T15:07:06.559342+0000","last_clean":"2024-03-09T15:07:06.559342+0000","last_became_active":"2024-03-09T14:35:41.122898+0000","last_became_peered":"2024-03-09T14:35:41.122898+0000","last_unstale":"2024-03-09T15:07:06.559342+0000","last_undegraded":"2024-03-09T15:07:06.559342+0000","last_fullsized":"2024-03-09T15:07:06.559342+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:05:14.087935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":238,"num_write":108,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.573887+0000","last_change":"2024-03-09T14:50:35.508995+0000","last_active":"2024-03-09T15:09:16.573887+0000","last_peered":"2024-03-09T15:09:16.573887+0000","last_clean":"2024-03-09T15:09:16.573887+0000","last_became_active":"2024-03-09T14:50:35.508726+0000","last_became_peered":"2024-03-09T14:50:35.508726+0000","last_unstale":"2024-03-09T15:09:16.573887+0000","last_undegraded":"2024-03-09T15:09:16.573887+0000","last_fullsized":"2024-03-09T15:09:16.573887+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:57:02.512282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.671503+0000","last_change":"2024-03-09T14:38:37.437565+0000","last_active":"2024-03-09T15:07:36.671503+0000","last_peered":"2024-03-09T15:07:36.671503+0000","last_clean":"2024-03-09T15:07:36.671503+0000","last_became_active":"2024-03-09T14:38:37.437039+0000","last_became_peered":"2024-03-09T14:38:37.437039+0000","last_unstale":"2024-03-09T15:07:36.671503+0000","last_undegraded":"2024-03-09T15:07:36.671503+0000","last_fullsized":"2024-03-09T15:07:36.671503+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:19.810352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5293339,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":10340,"num_write":5,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"264'4","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.582498+0000","last_change":"2024-03-09T14:38:34.418567+0000","last_active":"2024-03-09T15:09:01.582498+0000","last_peered":"2024-03-09T15:09:01.582498+0000","last_clean":"2024-03-09T15:09:01.582498+0000","last_became_active":"2024-03-09T14:38:34.418269+0000","last_became_peered":"2024-03-09T14:38:34.418269+0000","last_unstale":"2024-03-09T15:09:01.582498+0000","last_undegraded":"2024-03-09T15:09:01.582498+0000","last_fullsized":"2024-03-09T15:09:01.582498+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:37.564267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":13312,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'38","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.061406+0000","last_change":"2024-03-09T14:35:41.122751+0000","last_active":"2024-03-09T15:07:45.061406+0000","last_peered":"2024-03-09T15:07:45.061406+0000","last_clean":"2024-03-09T15:07:45.061406+0000","last_became_active":"2024-03-09T14:35:41.122257+0000","last_became_peered":"2024-03-09T14:35:41.122257+0000","last_unstale":"2024-03-09T15:07:45.061406+0000","last_undegraded":"2024-03-09T15:07:45.061406+0000","last_fullsized":"2024-03-09T15:07:45.061406+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:47:51.831859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":116,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.569244+0000","last_change":"2024-03-09T14:50:35.503872+0000","last_active":"2024-03-09T15:09:16.569244+0000","last_peered":"2024-03-09T15:09:16.569244+0000","last_clean":"2024-03-09T15:09:16.569244+0000","last_became_active":"2024-03-09T14:50:35.503595+0000","last_became_peered":"2024-03-09T14:50:35.503595+0000","last_unstale":"2024-03-09T15:09:16.569244+0000","last_undegraded":"2024-03-09T15:09:16.569244+0000","last_fullsized":"2024-03-09T15:09:16.569244+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:47.112637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.682932+0000","last_change":"2024-03-09T14:38:37.430250+0000","last_active":"2024-03-09T15:09:01.682932+0000","last_peered":"2024-03-09T15:09:01.682932+0000","last_clean":"2024-03-09T15:09:01.682932+0000","last_became_active":"2024-03-09T14:38:37.429956+0000","last_became_peered":"2024-03-09T14:38:37.429956+0000","last_unstale":"2024-03-09T15:09:01.682932+0000","last_undegraded":"2024-03-09T15:09:01.682932+0000","last_fullsized":"2024-03-09T15:09:01.682932+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:30.262564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":11264,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'1","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.707983+0000","last_change":"2024-03-09T14:38:34.421959+0000","last_active":"2024-03-09T15:07:36.707983+0000","last_peered":"2024-03-09T15:07:36.707983+0000","last_clean":"2024-03-09T15:07:36.707983+0000","last_became_active":"2024-03-09T14:38:34.421678+0000","last_became_peered":"2024-03-09T14:38:34.421678+0000","last_unstale":"2024-03-09T15:07:36.707983+0000","last_undegraded":"2024-03-09T15:07:36.707983+0000","last_fullsized":"2024-03-09T15:07:36.707983+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:48.989741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'25","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:06.667904+0000","last_change":"2024-03-09T14:35:41.121109+0000","last_active":"2024-03-09T15:07:06.667904+0000","last_peered":"2024-03-09T15:07:06.667904+0000","last_clean":"2024-03-09T15:07:06.667904+0000","last_became_active":"2024-03-09T14:35:41.120818+0000","last_became_peered":"2024-03-09T14:35:41.120818+0000","last_unstale":"2024-03-09T15:07:06.667904+0000","last_undegraded":"2024-03-09T15:07:06.667904+0000","last_fullsized":"2024-03-09T15:07:06.667904+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:00.066768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":54,"num_write":56,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.721253+0000","last_change":"2024-03-09T14:50:35.500497+0000","last_active":"2024-03-09T15:09:16.721253+0000","last_peered":"2024-03-09T15:09:16.721253+0000","last_clean":"2024-03-09T15:09:16.721253+0000","last_became_active":"2024-03-09T14:50:35.500196+0000","last_became_peered":"2024-03-09T14:50:35.500196+0000","last_unstale":"2024-03-09T15:09:16.721253+0000","last_undegraded":"2024-03-09T15:09:16.721253+0000","last_fullsized":"2024-03-09T15:09:16.721253+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:59:34.049420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.671535+0000","last_change":"2024-03-09T14:38:37.437194+0000","last_active":"2024-03-09T15:07:36.671535+0000","last_peered":"2024-03-09T15:07:36.671535+0000","last_clean":"2024-03-09T15:07:36.671535+0000","last_became_active":"2024-03-09T14:38:37.436884+0000","last_became_peered":"2024-03-09T14:38:37.436884+0000","last_unstale":"2024-03-09T15:07:36.671535+0000","last_undegraded":"2024-03-09T15:07:36.671535+0000","last_fullsized":"2024-03-09T15:07:36.671535+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:13:52.104812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.558107+0000","last_change":"2024-03-09T14:38:34.420272+0000","last_active":"2024-03-09T15:07:36.558107+0000","last_peered":"2024-03-09T15:07:36.558107+0000","last_clean":"2024-03-09T15:07:36.558107+0000","last_became_active":"2024-03-09T14:38:34.420002+0000","last_became_peered":"2024-03-09T14:38:34.420002+0000","last_unstale":"2024-03-09T15:07:36.558107+0000","last_undegraded":"2024-03-09T15:07:36.558107+0000","last_fullsized":"2024-03-09T15:07:36.558107+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:05:58.461847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'34","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:06.555328+0000","last_change":"2024-03-09T14:35:41.116727+0000","last_active":"2024-03-09T15:07:06.555328+0000","last_peered":"2024-03-09T15:07:06.555328+0000","last_clean":"2024-03-09T15:07:06.555328+0000","last_became_active":"2024-03-09T14:35:41.116430+0000","last_became_peered":"2024-03-09T14:35:41.116430+0000","last_unstale":"2024-03-09T15:07:06.555328+0000","last_undegraded":"2024-03-09T15:07:06.555328+0000","last_fullsized":"2024-03-09T15:07:06.555328+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:09.089142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":94,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.584576+0000","last_change":"2024-03-09T14:50:35.507650+0000","last_active":"2024-03-09T15:09:16.584576+0000","last_peered":"2024-03-09T15:09:16.584576+0000","last_clean":"2024-03-09T15:09:16.584576+0000","last_became_active":"2024-03-09T14:50:35.506969+0000","last_became_peered":"2024-03-09T14:50:35.506969+0000","last_unstale":"2024-03-09T15:09:16.584576+0000","last_undegraded":"2024-03-09T15:09:16.584576+0000","last_fullsized":"2024-03-09T15:09:16.584576+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:45:43.559282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.586813+0000","last_change":"2024-03-09T14:38:37.436281+0000","last_active":"2024-03-09T15:07:36.586813+0000","last_peered":"2024-03-09T15:07:36.586813+0000","last_clean":"2024-03-09T15:07:36.586813+0000","last_became_active":"2024-03-09T14:38:37.435960+0000","last_became_peered":"2024-03-09T14:38:37.435960+0000","last_unstale":"2024-03-09T15:07:36.586813+0000","last_undegraded":"2024-03-09T15:07:36.586813+0000","last_fullsized":"2024-03-09T15:07:36.586813+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:44:42.297000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.570149+0000","last_change":"2024-03-09T14:38:34.420846+0000","last_active":"2024-03-09T15:07:36.570149+0000","last_peered":"2024-03-09T15:07:36.570149+0000","last_clean":"2024-03-09T15:07:36.570149+0000","last_became_active":"2024-03-09T14:38:34.420571+0000","last_became_peered":"2024-03-09T14:38:34.420571+0000","last_unstale":"2024-03-09T15:07:36.570149+0000","last_undegraded":"2024-03-09T15:07:36.570149+0000","last_fullsized":"2024-03-09T15:07:36.570149+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:29:07.174232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'36","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.714611+0000","last_change":"2024-03-09T14:35:41.121354+0000","last_active":"2024-03-09T15:08:26.714611+0000","last_peered":"2024-03-09T15:08:26.714611+0000","last_clean":"2024-03-09T15:08:26.714611+0000","last_became_active":"2024-03-09T14:35:41.121060+0000","last_became_peered":"2024-03-09T14:35:41.121060+0000","last_unstale":"2024-03-09T15:08:26.714611+0000","last_undegraded":"2024-03-09T15:08:26.714611+0000","last_fullsized":"2024-03-09T15:08:26.714611+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:59:13.798282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":100,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.670889+0000","last_change":"2024-03-09T14:50:35.504223+0000","last_active":"2024-03-09T15:07:31.670889+0000","last_peered":"2024-03-09T15:07:31.670889+0000","last_clean":"2024-03-09T15:07:31.670889+0000","last_became_active":"2024-03-09T14:50:35.503970+0000","last_became_peered":"2024-03-09T14:50:35.503970+0000","last_unstale":"2024-03-09T15:07:31.670889+0000","last_undegraded":"2024-03-09T15:07:31.670889+0000","last_fullsized":"2024-03-09T15:07:31.670889+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:00:00.835576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.571890+0000","last_change":"2024-03-09T14:38:37.438872+0000","last_active":"2024-03-09T15:08:56.571890+0000","last_peered":"2024-03-09T15:08:56.571890+0000","last_clean":"2024-03-09T15:08:56.571890+0000","last_became_active":"2024-03-09T14:38:37.438604+0000","last_became_peered":"2024-03-09T14:38:37.438604+0000","last_unstale":"2024-03-09T15:08:56.571890+0000","last_undegraded":"2024-03-09T15:08:56.571890+0000","last_fullsized":"2024-03-09T15:08:56.571890+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:51.268275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.596981+0000","last_change":"2024-03-09T14:38:34.421755+0000","last_active":"2024-03-09T15:08:56.596981+0000","last_peered":"2024-03-09T15:08:56.596981+0000","last_clean":"2024-03-09T15:08:56.596981+0000","last_became_active":"2024-03-09T14:38:34.421476+0000","last_became_peered":"2024-03-09T14:38:34.421476+0000","last_unstale":"2024-03-09T15:08:56.596981+0000","last_undegraded":"2024-03-09T15:08:56.596981+0000","last_fullsized":"2024-03-09T15:08:56.596981+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:39:12.298428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'114","reported_seq":387,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.713908+0000","last_change":"2024-03-09T14:35:41.125457+0000","last_active":"2024-03-09T15:08:21.713908+0000","last_peered":"2024-03-09T15:08:21.713908+0000","last_clean":"2024-03-09T15:08:21.713908+0000","last_became_active":"2024-03-09T14:35:41.125114+0000","last_became_peered":"2024-03-09T14:35:41.125114+0000","last_unstale":"2024-03-09T15:08:21.713908+0000","last_undegraded":"2024-03-09T15:08:21.713908+0000","last_fullsized":"2024-03-09T15:08:21.713908+0000","mapping_epoch":251,"log_start":"264'100","ondisk_log_start":"264'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:47.982191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":488,"num_write":144,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.569420+0000","last_change":"2024-03-09T14:50:35.510923+0000","last_active":"2024-03-09T15:07:31.569420+0000","last_peered":"2024-03-09T15:07:31.569420+0000","last_clean":"2024-03-09T15:07:31.569420+0000","last_became_active":"2024-03-09T14:50:35.510598+0000","last_became_peered":"2024-03-09T14:50:35.510598+0000","last_unstale":"2024-03-09T15:07:31.569420+0000","last_undegraded":"2024-03-09T15:07:31.569420+0000","last_fullsized":"2024-03-09T15:07:31.569420+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:52:13.398359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.571855+0000","last_change":"2024-03-09T14:38:37.439640+0000","last_active":"2024-03-09T15:08:56.571855+0000","last_peered":"2024-03-09T15:08:56.571855+0000","last_clean":"2024-03-09T15:08:56.571855+0000","last_became_active":"2024-03-09T14:38:37.439360+0000","last_became_peered":"2024-03-09T14:38:37.439360+0000","last_unstale":"2024-03-09T15:08:56.571855+0000","last_undegraded":"2024-03-09T15:08:56.571855+0000","last_fullsized":"2024-03-09T15:08:56.571855+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:24.960393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.682399+0000","last_change":"2024-03-09T14:38:34.419720+0000","last_active":"2024-03-09T15:08:56.682399+0000","last_peered":"2024-03-09T15:08:56.682399+0000","last_clean":"2024-03-09T15:08:56.682399+0000","last_became_active":"2024-03-09T14:38:34.419467+0000","last_became_peered":"2024-03-09T14:38:34.419467+0000","last_unstale":"2024-03-09T15:08:56.682399+0000","last_undegraded":"2024-03-09T15:08:56.682399+0000","last_fullsized":"2024-03-09T15:08:56.682399+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:29.894750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'15","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.575178+0000","last_change":"2024-03-09T14:35:41.118830+0000","last_active":"2024-03-09T15:08:21.575178+0000","last_peered":"2024-03-09T15:08:21.575178+0000","last_clean":"2024-03-09T15:08:21.575178+0000","last_became_active":"2024-03-09T14:35:41.118591+0000","last_became_peered":"2024-03-09T14:35:41.118591+0000","last_unstale":"2024-03-09T15:08:21.575178+0000","last_undegraded":"2024-03-09T15:08:21.575178+0000","last_fullsized":"2024-03-09T15:08:21.575178+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:44:14.623143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":42,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.582148+0000","last_change":"2024-03-09T14:50:35.503951+0000","last_active":"2024-03-09T15:09:21.582148+0000","last_peered":"2024-03-09T15:09:21.582148+0000","last_clean":"2024-03-09T15:09:21.582148+0000","last_became_active":"2024-03-09T14:50:35.503274+0000","last_became_peered":"2024-03-09T14:50:35.503274+0000","last_unstale":"2024-03-09T15:09:21.582148+0000","last_undegraded":"2024-03-09T15:09:21.582148+0000","last_fullsized":"2024-03-09T15:09:21.582148+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:51.019829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.682437+0000","last_change":"2024-03-09T14:38:37.436377+0000","last_active":"2024-03-09T15:08:56.682437+0000","last_peered":"2024-03-09T15:08:56.682437+0000","last_clean":"2024-03-09T15:08:56.682437+0000","last_became_active":"2024-03-09T14:38:37.436078+0000","last_became_peered":"2024-03-09T14:38:37.436078+0000","last_unstale":"2024-03-09T15:08:56.682437+0000","last_undegraded":"2024-03-09T15:08:56.682437+0000","last_fullsized":"2024-03-09T15:08:56.682437+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:51:30.342500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'4","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.597003+0000","last_change":"2024-03-09T14:38:34.420240+0000","last_active":"2024-03-09T15:08:56.597003+0000","last_peered":"2024-03-09T15:08:56.597003+0000","last_clean":"2024-03-09T15:08:56.597003+0000","last_became_active":"2024-03-09T14:38:34.419935+0000","last_became_peered":"2024-03-09T14:38:34.419935+0000","last_unstale":"2024-03-09T15:08:56.597003+0000","last_undegraded":"2024-03-09T15:08:56.597003+0000","last_fullsized":"2024-03-09T15:08:56.597003+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:16:59.079986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4234449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":7208,"num_write":4,"num_write_kb":7208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'26","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.592508+0000","last_change":"2024-03-09T14:35:41.117147+0000","last_active":"2024-03-09T15:08:21.592508+0000","last_peered":"2024-03-09T15:08:21.592508+0000","last_clean":"2024-03-09T15:08:21.592508+0000","last_became_active":"2024-03-09T14:35:41.116852+0000","last_became_peered":"2024-03-09T14:35:41.116852+0000","last_unstale":"2024-03-09T15:08:21.592508+0000","last_undegraded":"2024-03-09T15:08:21.592508+0000","last_fullsized":"2024-03-09T15:08:21.592508+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:27:43.779129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.670857+0000","last_change":"2024-03-09T14:50:35.509510+0000","last_active":"2024-03-09T15:07:31.670857+0000","last_peered":"2024-03-09T15:07:31.670857+0000","last_clean":"2024-03-09T15:07:31.670857+0000","last_became_active":"2024-03-09T14:50:35.509202+0000","last_became_peered":"2024-03-09T14:50:35.509202+0000","last_unstale":"2024-03-09T15:07:31.670857+0000","last_undegraded":"2024-03-09T15:07:31.670857+0000","last_fullsized":"2024-03-09T15:07:31.670857+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:23:44.698798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.596967+0000","last_change":"2024-03-09T14:38:37.441897+0000","last_active":"2024-03-09T15:08:56.596967+0000","last_peered":"2024-03-09T15:08:56.596967+0000","last_clean":"2024-03-09T15:08:56.596967+0000","last_became_active":"2024-03-09T14:38:37.441554+0000","last_became_peered":"2024-03-09T14:38:37.441554+0000","last_unstale":"2024-03-09T15:08:56.596967+0000","last_undegraded":"2024-03-09T15:08:56.596967+0000","last_fullsized":"2024-03-09T15:08:56.596967+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:13.709348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":80,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'1","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.581826+0000","last_change":"2024-03-09T14:38:34.424750+0000","last_active":"2024-03-09T15:08:56.581826+0000","last_peered":"2024-03-09T15:08:56.581826+0000","last_clean":"2024-03-09T15:08:56.581826+0000","last_became_active":"2024-03-09T14:38:34.424507+0000","last_became_peered":"2024-03-09T14:38:34.424507+0000","last_unstale":"2024-03-09T15:08:56.581826+0000","last_undegraded":"2024-03-09T15:08:56.581826+0000","last_fullsized":"2024-03-09T15:08:56.581826+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:14:16.729687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'52","reported_seq":169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.677257+0000","last_change":"2024-03-09T14:35:41.117227+0000","last_active":"2024-03-09T15:08:21.677257+0000","last_peered":"2024-03-09T15:08:21.677257+0000","last_clean":"2024-03-09T15:08:21.677257+0000","last_became_active":"2024-03-09T14:35:41.116932+0000","last_became_peered":"2024-03-09T14:35:41.116932+0000","last_unstale":"2024-03-09T15:08:21.677257+0000","last_undegraded":"2024-03-09T15:08:21.677257+0000","last_fullsized":"2024-03-09T15:08:21.677257+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:30:03.952026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":147,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.560814+0000","last_change":"2024-03-09T14:50:35.498350+0000","last_active":"2024-03-09T15:08:01.560814+0000","last_peered":"2024-03-09T15:08:01.560814+0000","last_clean":"2024-03-09T15:08:01.560814+0000","last_became_active":"2024-03-09T14:50:35.498045+0000","last_became_peered":"2024-03-09T14:50:35.498045+0000","last_unstale":"2024-03-09T15:08:01.560814+0000","last_undegraded":"2024-03-09T15:08:01.560814+0000","last_fullsized":"2024-03-09T15:08:01.560814+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:36.419114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.673446+0000","last_change":"2024-03-09T14:38:37.437345+0000","last_active":"2024-03-09T15:07:51.673446+0000","last_peered":"2024-03-09T15:07:51.673446+0000","last_clean":"2024-03-09T15:07:51.673446+0000","last_became_active":"2024-03-09T14:38:37.436672+0000","last_became_peered":"2024-03-09T14:38:37.436672+0000","last_unstale":"2024-03-09T15:07:51.673446+0000","last_undegraded":"2024-03-09T15:07:51.673446+0000","last_fullsized":"2024-03-09T15:07:51.673446+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:31:54.627840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1028,"num_write":9,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'8","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.709912+0000","last_change":"2024-03-09T14:38:34.423665+0000","last_active":"2024-03-09T15:07:51.709912+0000","last_peered":"2024-03-09T15:07:51.709912+0000","last_clean":"2024-03-09T15:07:51.709912+0000","last_became_active":"2024-03-09T14:38:34.423136+0000","last_became_peered":"2024-03-09T14:38:34.423136+0000","last_unstale":"2024-03-09T15:07:51.709912+0000","last_undegraded":"2024-03-09T15:07:51.709912+0000","last_fullsized":"2024-03-09T15:07:51.709912+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:45.903637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":17,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'29","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.669118+0000","last_change":"2024-03-09T14:35:41.120249+0000","last_active":"2024-03-09T15:07:16.669118+0000","last_peered":"2024-03-09T15:07:16.669118+0000","last_clean":"2024-03-09T15:07:16.669118+0000","last_became_active":"2024-03-09T14:35:41.119901+0000","last_became_peered":"2024-03-09T14:35:41.119901+0000","last_unstale":"2024-03-09T15:07:16.669118+0000","last_undegraded":"2024-03-09T15:07:16.669118+0000","last_fullsized":"2024-03-09T15:07:16.669118+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:28:37.467123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":86,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715810+0000","last_change":"2024-03-09T14:50:35.510602+0000","last_active":"2024-03-09T15:08:36.715810+0000","last_peered":"2024-03-09T15:08:36.715810+0000","last_clean":"2024-03-09T15:08:36.715810+0000","last_became_active":"2024-03-09T14:50:35.510330+0000","last_became_peered":"2024-03-09T14:50:35.510330+0000","last_unstale":"2024-03-09T15:08:36.715810+0000","last_undegraded":"2024-03-09T15:08:36.715810+0000","last_fullsized":"2024-03-09T15:08:36.715810+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:46.816086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"261'9","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.577422+0000","last_change":"2024-03-09T14:39:04.870290+0000","last_active":"2024-03-09T15:08:21.577422+0000","last_peered":"2024-03-09T15:08:21.577422+0000","last_clean":"2024-03-09T15:08:21.577422+0000","last_became_active":"2024-03-09T14:39:04.819697+0000","last_became_peered":"2024-03-09T14:39:04.819697+0000","last_unstale":"2024-03-09T15:08:21.577422+0000","last_undegraded":"2024-03-09T15:08:21.577422+0000","last_fullsized":"2024-03-09T15:08:21.577422+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:51.693969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":4098,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.d","version":"264'7","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.559668+0000","last_change":"2024-03-09T14:38:34.416788+0000","last_active":"2024-03-09T15:07:51.559668+0000","last_peered":"2024-03-09T15:07:51.559668+0000","last_clean":"2024-03-09T15:07:51.559668+0000","last_became_active":"2024-03-09T14:38:34.416475+0000","last_became_peered":"2024-03-09T14:38:34.416475+0000","last_unstale":"2024-03-09T15:07:51.559668+0000","last_undegraded":"2024-03-09T15:07:51.559668+0000","last_fullsized":"2024-03-09T15:07:51.559668+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:45.337347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":11,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'38","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.585918+0000","last_change":"2024-03-09T14:35:41.120210+0000","last_active":"2024-03-09T15:09:26.585918+0000","last_peered":"2024-03-09T15:09:26.585918+0000","last_clean":"2024-03-09T15:09:26.585918+0000","last_became_active":"2024-03-09T14:35:41.119890+0000","last_became_peered":"2024-03-09T14:35:41.119890+0000","last_unstale":"2024-03-09T15:09:26.585918+0000","last_undegraded":"2024-03-09T15:09:26.585918+0000","last_fullsized":"2024-03-09T15:09:26.585918+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:29.027891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":99,"num_write":64,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.589494+0000","last_change":"2024-03-09T14:50:35.503867+0000","last_active":"2024-03-09T15:07:56.589494+0000","last_peered":"2024-03-09T15:07:56.589494+0000","last_clean":"2024-03-09T15:07:56.589494+0000","last_became_active":"2024-03-09T14:50:35.503207+0000","last_became_peered":"2024-03-09T14:50:35.503207+0000","last_unstale":"2024-03-09T15:07:56.589494+0000","last_undegraded":"2024-03-09T15:07:56.589494+0000","last_fullsized":"2024-03-09T15:07:56.589494+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:56:26.518688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.564787+0000","last_change":"2024-03-09T14:38:37.438790+0000","last_active":"2024-03-09T15:07:56.564787+0000","last_peered":"2024-03-09T15:07:56.564787+0000","last_clean":"2024-03-09T15:07:56.564787+0000","last_became_active":"2024-03-09T14:38:37.438507+0000","last_became_peered":"2024-03-09T14:38:37.438507+0000","last_unstale":"2024-03-09T15:07:56.564787+0000","last_undegraded":"2024-03-09T15:07:56.564787+0000","last_fullsized":"2024-03-09T15:07:56.564787+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:53:53.804104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"261'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.571875+0000","last_change":"2024-03-09T14:38:34.420034+0000","last_active":"2024-03-09T15:07:51.571875+0000","last_peered":"2024-03-09T15:07:51.571875+0000","last_clean":"2024-03-09T15:07:51.571875+0000","last_became_active":"2024-03-09T14:38:34.419043+0000","last_became_peered":"2024-03-09T14:38:34.419043+0000","last_unstale":"2024-03-09T15:07:51.571875+0000","last_undegraded":"2024-03-09T15:07:51.571875+0000","last_fullsized":"2024-03-09T15:07:51.571875+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:11:48.118366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'88","reported_seq":332,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.601567+0000","last_change":"2024-03-09T14:35:41.117878+0000","last_active":"2024-03-09T15:09:26.601567+0000","last_peered":"2024-03-09T15:09:26.601567+0000","last_clean":"2024-03-09T15:09:26.601567+0000","last_became_active":"2024-03-09T14:35:41.117590+0000","last_became_peered":"2024-03-09T14:35:41.117590+0000","last_unstale":"2024-03-09T15:09:26.601567+0000","last_undegraded":"2024-03-09T15:09:26.601567+0000","last_fullsized":"2024-03-09T15:09:26.601567+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:41:31.619759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":440,"num_write":100,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.710572+0000","last_change":"2024-03-09T14:50:35.509165+0000","last_active":"2024-03-09T15:07:56.710572+0000","last_peered":"2024-03-09T15:07:56.710572+0000","last_clean":"2024-03-09T15:07:56.710572+0000","last_became_active":"2024-03-09T14:50:35.508832+0000","last_became_peered":"2024-03-09T14:50:35.508832+0000","last_unstale":"2024-03-09T15:07:56.710572+0000","last_undegraded":"2024-03-09T15:07:56.710572+0000","last_fullsized":"2024-03-09T15:07:56.710572+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:53.394584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.673464+0000","last_change":"2024-03-09T14:38:37.439624+0000","last_active":"2024-03-09T15:07:51.673464+0000","last_peered":"2024-03-09T15:07:51.673464+0000","last_clean":"2024-03-09T15:07:51.673464+0000","last_became_active":"2024-03-09T14:38:37.439177+0000","last_became_peered":"2024-03-09T14:38:37.439177+0000","last_unstale":"2024-03-09T15:07:51.673464+0000","last_undegraded":"2024-03-09T15:07:51.673464+0000","last_fullsized":"2024-03-09T15:07:51.673464+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:54:00.072929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'1","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.564764+0000","last_change":"2024-03-09T14:38:34.421435+0000","last_active":"2024-03-09T15:07:56.564764+0000","last_peered":"2024-03-09T15:07:56.564764+0000","last_clean":"2024-03-09T15:07:56.564764+0000","last_became_active":"2024-03-09T14:38:34.419461+0000","last_became_peered":"2024-03-09T14:38:34.419461+0000","last_unstale":"2024-03-09T15:07:56.564764+0000","last_undegraded":"2024-03-09T15:07:56.564764+0000","last_fullsized":"2024-03-09T15:07:56.564764+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:34:20.395850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'58","reported_seq":192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.570354+0000","last_change":"2024-03-09T14:35:41.116097+0000","last_active":"2024-03-09T15:09:26.570354+0000","last_peered":"2024-03-09T15:09:26.570354+0000","last_clean":"2024-03-09T15:09:26.570354+0000","last_became_active":"2024-03-09T14:35:41.115769+0000","last_became_peered":"2024-03-09T14:35:41.115769+0000","last_unstale":"2024-03-09T15:09:26.570354+0000","last_undegraded":"2024-03-09T15:09:26.570354+0000","last_fullsized":"2024-03-09T15:09:26.570354+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:05:10.170303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":187,"num_write":89,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.680129+0000","last_change":"2024-03-09T14:50:35.512842+0000","last_active":"2024-03-09T15:08:36.680129+0000","last_peered":"2024-03-09T15:08:36.680129+0000","last_clean":"2024-03-09T15:08:36.680129+0000","last_became_active":"2024-03-09T14:50:35.512515+0000","last_became_peered":"2024-03-09T14:50:35.512515+0000","last_unstale":"2024-03-09T15:08:36.680129+0000","last_undegraded":"2024-03-09T15:08:36.680129+0000","last_fullsized":"2024-03-09T15:08:36.680129+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:52:53.532722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'7","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.597014+0000","last_change":"2024-03-09T14:38:37.437989+0000","last_active":"2024-03-09T15:08:56.597014+0000","last_peered":"2024-03-09T15:08:56.597014+0000","last_clean":"2024-03-09T15:08:56.597014+0000","last_became_active":"2024-03-09T14:38:37.437674+0000","last_became_peered":"2024-03-09T14:38:37.437674+0000","last_unstale":"2024-03-09T15:08:56.597014+0000","last_undegraded":"2024-03-09T15:08:56.597014+0000","last_fullsized":"2024-03-09T15:08:56.597014+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:15:44.990882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'9","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.579384+0000","last_change":"2024-03-09T14:38:34.416934+0000","last_active":"2024-03-09T15:08:56.579384+0000","last_peered":"2024-03-09T15:08:56.579384+0000","last_clean":"2024-03-09T15:08:56.579384+0000","last_became_active":"2024-03-09T14:38:34.416635+0000","last_became_peered":"2024-03-09T14:38:34.416635+0000","last_unstale":"2024-03-09T15:08:56.579384+0000","last_undegraded":"2024-03-09T15:08:56.579384+0000","last_fullsized":"2024-03-09T15:08:56.579384+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:04.243246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'78","reported_seq":244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.582617+0000","last_change":"2024-03-09T14:35:41.113581+0000","last_active":"2024-03-09T15:09:26.582617+0000","last_peered":"2024-03-09T15:09:26.582617+0000","last_clean":"2024-03-09T15:09:26.582617+0000","last_became_active":"2024-03-09T14:35:41.113283+0000","last_became_peered":"2024-03-09T14:35:41.113283+0000","last_unstale":"2024-03-09T15:09:26.582617+0000","last_undegraded":"2024-03-09T15:09:26.582617+0000","last_fullsized":"2024-03-09T15:09:26.582617+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:01:48.405901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":352,"num_read_kb":252,"num_write":133,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715876+0000","last_change":"2024-03-09T14:50:35.509538+0000","last_active":"2024-03-09T15:08:36.715876+0000","last_peered":"2024-03-09T15:08:36.715876+0000","last_clean":"2024-03-09T15:08:36.715876+0000","last_became_active":"2024-03-09T14:50:35.509248+0000","last_became_peered":"2024-03-09T14:50:35.509248+0000","last_unstale":"2024-03-09T15:08:36.715876+0000","last_undegraded":"2024-03-09T15:08:36.715876+0000","last_fullsized":"2024-03-09T15:08:36.715876+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:52:29.204507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.718503+0000","last_change":"2024-03-09T14:38:37.432905+0000","last_active":"2024-03-09T15:08:56.718503+0000","last_peered":"2024-03-09T15:08:56.718503+0000","last_clean":"2024-03-09T15:08:56.718503+0000","last_became_active":"2024-03-09T14:38:37.432007+0000","last_became_peered":"2024-03-09T14:38:37.432007+0000","last_unstale":"2024-03-09T15:08:56.718503+0000","last_undegraded":"2024-03-09T15:08:56.718503+0000","last_fullsized":"2024-03-09T15:08:56.718503+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:42.955791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"261'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.571875+0000","last_change":"2024-03-09T14:38:34.421506+0000","last_active":"2024-03-09T15:08:56.571875+0000","last_peered":"2024-03-09T15:08:56.571875+0000","last_clean":"2024-03-09T15:08:56.571875+0000","last_became_active":"2024-03-09T14:38:34.419582+0000","last_became_peered":"2024-03-09T14:38:34.419582+0000","last_unstale":"2024-03-09T15:08:56.571875+0000","last_undegraded":"2024-03-09T15:08:56.571875+0000","last_fullsized":"2024-03-09T15:08:56.571875+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:37.179560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"261'10","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:16.713161+0000","last_change":"2024-03-09T14:35:41.123265+0000","last_active":"2024-03-09T15:08:16.713161+0000","last_peered":"2024-03-09T15:08:16.713161+0000","last_clean":"2024-03-09T15:08:16.713161+0000","last_became_active":"2024-03-09T14:35:41.122670+0000","last_became_peered":"2024-03-09T14:35:41.122670+0000","last_unstale":"2024-03-09T15:08:16.713161+0000","last_undegraded":"2024-03-09T15:08:16.713161+0000","last_fullsized":"2024-03-09T15:08:16.713161+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:24.170437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715833+0000","last_change":"2024-03-09T14:50:35.506808+0000","last_active":"2024-03-09T15:08:36.715833+0000","last_peered":"2024-03-09T15:08:36.715833+0000","last_clean":"2024-03-09T15:08:36.715833+0000","last_became_active":"2024-03-09T14:50:35.506542+0000","last_became_peered":"2024-03-09T14:50:35.506542+0000","last_unstale":"2024-03-09T15:08:36.715833+0000","last_undegraded":"2024-03-09T15:08:36.715833+0000","last_fullsized":"2024-03-09T15:08:36.715833+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:53:55.176426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.564277+0000","last_change":"2024-03-09T14:38:37.439732+0000","last_active":"2024-03-09T15:07:51.564277+0000","last_peered":"2024-03-09T15:07:51.564277+0000","last_clean":"2024-03-09T15:07:51.564277+0000","last_became_active":"2024-03-09T14:38:37.439444+0000","last_became_peered":"2024-03-09T14:38:37.439444+0000","last_unstale":"2024-03-09T15:07:51.564277+0000","last_undegraded":"2024-03-09T15:07:51.564277+0000","last_fullsized":"2024-03-09T15:07:51.564277+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:04:27.690405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'1","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.580438+0000","last_change":"2024-03-09T14:38:34.416466+0000","last_active":"2024-03-09T15:09:06.580438+0000","last_peered":"2024-03-09T15:09:06.580438+0000","last_clean":"2024-03-09T15:09:06.580438+0000","last_became_active":"2024-03-09T14:38:34.416139+0000","last_became_peered":"2024-03-09T14:38:34.416139+0000","last_unstale":"2024-03-09T15:09:06.580438+0000","last_undegraded":"2024-03-09T15:09:06.580438+0000","last_fullsized":"2024-03-09T15:09:06.580438+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:43:48.564982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'57","reported_seq":187,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:59.379012+0000","last_change":"2024-03-09T14:35:41.121118+0000","last_active":"2024-03-09T15:08:59.379012+0000","last_peered":"2024-03-09T15:08:59.379012+0000","last_clean":"2024-03-09T15:08:59.379012+0000","last_became_active":"2024-03-09T14:35:41.120802+0000","last_became_peered":"2024-03-09T14:35:41.120802+0000","last_unstale":"2024-03-09T15:08:59.379012+0000","last_undegraded":"2024-03-09T15:08:59.379012+0000","last_fullsized":"2024-03-09T15:08:59.379012+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:25:26.837573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":244,"num_read_kb":179,"num_write":100,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.577117+0000","last_change":"2024-03-09T14:50:35.505537+0000","last_active":"2024-03-09T15:08:36.577117+0000","last_peered":"2024-03-09T15:08:36.577117+0000","last_clean":"2024-03-09T15:08:36.577117+0000","last_became_active":"2024-03-09T14:50:35.505278+0000","last_became_peered":"2024-03-09T14:50:35.505278+0000","last_unstale":"2024-03-09T15:08:36.577117+0000","last_undegraded":"2024-03-09T15:08:36.577117+0000","last_fullsized":"2024-03-09T15:08:36.577117+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:48:40.487487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.719250+0000","last_change":"2024-03-09T14:38:37.436225+0000","last_active":"2024-03-09T15:09:01.719250+0000","last_peered":"2024-03-09T15:09:01.719250+0000","last_clean":"2024-03-09T15:09:01.719250+0000","last_became_active":"2024-03-09T14:38:37.435952+0000","last_became_peered":"2024-03-09T14:38:37.435952+0000","last_unstale":"2024-03-09T15:09:01.719250+0000","last_undegraded":"2024-03-09T15:09:01.719250+0000","last_fullsized":"2024-03-09T15:09:01.719250+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:45:59.696392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.588961+0000","last_change":"2024-03-09T14:38:34.420726+0000","last_active":"2024-03-09T15:07:51.588961+0000","last_peered":"2024-03-09T15:07:51.588961+0000","last_clean":"2024-03-09T15:07:51.588961+0000","last_became_active":"2024-03-09T14:38:34.420453+0000","last_became_peered":"2024-03-09T14:38:34.420453+0000","last_unstale":"2024-03-09T15:07:51.588961+0000","last_undegraded":"2024-03-09T15:07:51.588961+0000","last_fullsized":"2024-03-09T15:07:51.588961+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:12.244916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4100,"num_write":3,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'47","reported_seq":164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591361+0000","last_change":"2024-03-09T14:35:41.119775+0000","last_active":"2024-03-09T15:08:11.591361+0000","last_peered":"2024-03-09T15:08:11.591361+0000","last_clean":"2024-03-09T15:08:11.591361+0000","last_became_active":"2024-03-09T14:35:41.119481+0000","last_became_peered":"2024-03-09T14:35:41.119481+0000","last_unstale":"2024-03-09T15:08:11.591361+0000","last_undegraded":"2024-03-09T15:08:11.591361+0000","last_fullsized":"2024-03-09T15:08:11.591361+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:09.488004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":141,"num_write":77,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.722037+0000","last_change":"2024-03-09T14:50:35.508997+0000","last_active":"2024-03-09T15:09:21.722037+0000","last_peered":"2024-03-09T15:09:21.722037+0000","last_clean":"2024-03-09T15:09:21.722037+0000","last_became_active":"2024-03-09T14:50:35.508707+0000","last_became_peered":"2024-03-09T14:50:35.508707+0000","last_unstale":"2024-03-09T15:09:21.722037+0000","last_undegraded":"2024-03-09T15:09:21.722037+0000","last_fullsized":"2024-03-09T15:09:21.722037+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:47:02.507364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.572512+0000","last_change":"2024-03-09T14:38:37.444242+0000","last_active":"2024-03-09T15:07:56.572512+0000","last_peered":"2024-03-09T15:07:56.572512+0000","last_clean":"2024-03-09T15:07:56.572512+0000","last_became_active":"2024-03-09T14:38:37.443923+0000","last_became_peered":"2024-03-09T14:38:37.443923+0000","last_unstale":"2024-03-09T15:07:56.572512+0000","last_undegraded":"2024-03-09T15:07:56.572512+0000","last_fullsized":"2024-03-09T15:07:56.572512+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:13:01.825580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'7","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.709361+0000","last_change":"2024-03-09T14:38:34.421417+0000","last_active":"2024-03-09T15:07:46.709361+0000","last_peered":"2024-03-09T15:07:46.709361+0000","last_clean":"2024-03-09T15:07:46.709361+0000","last_became_active":"2024-03-09T14:38:34.421150+0000","last_became_peered":"2024-03-09T14:38:34.421150+0000","last_unstale":"2024-03-09T15:07:46.709361+0000","last_undegraded":"2024-03-09T15:07:46.709361+0000","last_fullsized":"2024-03-09T15:07:46.709361+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:24:24.004077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":20480,"num_write":22,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'56","reported_seq":186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.574223+0000","last_change":"2024-03-09T14:35:41.121720+0000","last_active":"2024-03-09T15:08:11.574223+0000","last_peered":"2024-03-09T15:08:11.574223+0000","last_clean":"2024-03-09T15:08:11.574223+0000","last_became_active":"2024-03-09T14:35:41.121047+0000","last_became_peered":"2024-03-09T14:35:41.121047+0000","last_unstale":"2024-03-09T15:08:11.574223+0000","last_undegraded":"2024-03-09T15:08:11.574223+0000","last_fullsized":"2024-03-09T15:08:11.574223+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:40.334231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":176,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.585246+0000","last_change":"2024-03-09T14:50:35.512833+0000","last_active":"2024-03-09T15:09:21.585246+0000","last_peered":"2024-03-09T15:09:21.585246+0000","last_clean":"2024-03-09T15:09:21.585246+0000","last_became_active":"2024-03-09T14:50:35.512540+0000","last_became_peered":"2024-03-09T14:50:35.512540+0000","last_unstale":"2024-03-09T15:09:21.585246+0000","last_undegraded":"2024-03-09T15:09:21.585246+0000","last_fullsized":"2024-03-09T15:09:21.585246+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:14.133666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"261'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.571314+0000","last_change":"2024-03-09T14:38:37.436520+0000","last_active":"2024-03-09T15:07:46.571314+0000","last_peered":"2024-03-09T15:07:46.571314+0000","last_clean":"2024-03-09T15:07:46.571314+0000","last_became_active":"2024-03-09T14:38:37.436246+0000","last_became_peered":"2024-03-09T14:38:37.436246+0000","last_unstale":"2024-03-09T15:07:46.571314+0000","last_undegraded":"2024-03-09T15:07:46.571314+0000","last_fullsized":"2024-03-09T15:07:46.571314+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:42:32.801291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.560208+0000","last_change":"2024-03-09T14:38:34.417805+0000","last_active":"2024-03-09T15:07:56.560208+0000","last_peered":"2024-03-09T15:07:56.560208+0000","last_clean":"2024-03-09T15:07:56.560208+0000","last_became_active":"2024-03-09T14:38:34.417530+0000","last_became_peered":"2024-03-09T14:38:34.417530+0000","last_unstale":"2024-03-09T15:07:56.560208+0000","last_undegraded":"2024-03-09T15:07:56.560208+0000","last_fullsized":"2024-03-09T15:07:56.560208+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:01.677780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'34","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591468+0000","last_change":"2024-03-09T14:35:41.116363+0000","last_active":"2024-03-09T15:08:11.591468+0000","last_peered":"2024-03-09T15:08:11.591468+0000","last_clean":"2024-03-09T15:08:11.591468+0000","last_became_active":"2024-03-09T14:35:41.116050+0000","last_became_peered":"2024-03-09T14:35:41.116050+0000","last_unstale":"2024-03-09T15:08:11.591468+0000","last_undegraded":"2024-03-09T15:08:11.591468+0000","last_fullsized":"2024-03-09T15:08:11.591468+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:25:09.271246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":98,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.570342+0000","last_change":"2024-03-09T14:50:35.513092+0000","last_active":"2024-03-09T15:08:41.570342+0000","last_peered":"2024-03-09T15:08:41.570342+0000","last_clean":"2024-03-09T15:08:41.570342+0000","last_became_active":"2024-03-09T14:50:35.512533+0000","last_became_peered":"2024-03-09T14:50:35.512533+0000","last_unstale":"2024-03-09T15:08:41.570342+0000","last_undegraded":"2024-03-09T15:08:41.570342+0000","last_fullsized":"2024-03-09T15:08:41.570342+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:04:55.415472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.718635+0000","last_change":"2024-03-09T14:38:37.432938+0000","last_active":"2024-03-09T15:08:56.718635+0000","last_peered":"2024-03-09T15:08:56.718635+0000","last_clean":"2024-03-09T15:08:56.718635+0000","last_became_active":"2024-03-09T14:38:37.432627+0000","last_became_peered":"2024-03-09T14:38:37.432627+0000","last_unstale":"2024-03-09T15:08:56.718635+0000","last_undegraded":"2024-03-09T15:08:56.718635+0000","last_fullsized":"2024-03-09T15:08:56.718635+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:58:51.983213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4119,"num_write":3,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.581912+0000","last_change":"2024-03-09T14:38:34.416562+0000","last_active":"2024-03-09T15:08:56.581912+0000","last_peered":"2024-03-09T15:08:56.581912+0000","last_clean":"2024-03-09T15:08:56.581912+0000","last_became_active":"2024-03-09T14:38:34.415277+0000","last_became_peered":"2024-03-09T14:38:34.415277+0000","last_unstale":"2024-03-09T15:08:56.581912+0000","last_undegraded":"2024-03-09T15:08:56.581912+0000","last_fullsized":"2024-03-09T15:08:56.581912+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:20.801857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'18","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.719901+0000","last_change":"2024-03-09T14:35:41.123833+0000","last_active":"2024-03-09T15:09:06.719901+0000","last_peered":"2024-03-09T15:09:06.719901+0000","last_clean":"2024-03-09T15:09:06.719901+0000","last_became_active":"2024-03-09T14:35:41.123542+0000","last_became_peered":"2024-03-09T14:35:41.123542+0000","last_unstale":"2024-03-09T15:09:06.719901+0000","last_undegraded":"2024-03-09T15:09:06.719901+0000","last_fullsized":"2024-03-09T15:09:06.719901+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:01.200992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":44,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.600834+0000","last_change":"2024-03-09T14:50:35.506612+0000","last_active":"2024-03-09T15:09:21.600834+0000","last_peered":"2024-03-09T15:09:21.600834+0000","last_clean":"2024-03-09T15:09:21.600834+0000","last_became_active":"2024-03-09T14:50:35.506332+0000","last_became_peered":"2024-03-09T14:50:35.506332+0000","last_unstale":"2024-03-09T15:09:21.600834+0000","last_undegraded":"2024-03-09T15:09:21.600834+0000","last_fullsized":"2024-03-09T15:09:21.600834+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:34:03.683363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.597155+0000","last_change":"2024-03-09T14:38:37.438481+0000","last_active":"2024-03-09T15:08:56.597155+0000","last_peered":"2024-03-09T15:08:56.597155+0000","last_clean":"2024-03-09T15:08:56.597155+0000","last_became_active":"2024-03-09T14:38:37.438182+0000","last_became_peered":"2024-03-09T14:38:37.438182+0000","last_unstale":"2024-03-09T15:08:56.597155+0000","last_undegraded":"2024-03-09T15:08:56.597155+0000","last_fullsized":"2024-03-09T15:08:56.597155+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:04.307257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'1","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.718649+0000","last_change":"2024-03-09T14:38:34.423437+0000","last_active":"2024-03-09T15:08:56.718649+0000","last_peered":"2024-03-09T15:08:56.718649+0000","last_clean":"2024-03-09T15:08:56.718649+0000","last_became_active":"2024-03-09T14:38:34.423106+0000","last_became_peered":"2024-03-09T14:38:34.423106+0000","last_unstale":"2024-03-09T15:08:56.718649+0000","last_undegraded":"2024-03-09T15:08:56.718649+0000","last_fullsized":"2024-03-09T15:08:56.718649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:39:42.766455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'25","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.572391+0000","last_change":"2024-03-09T14:35:41.118139+0000","last_active":"2024-03-09T15:09:01.572391+0000","last_peered":"2024-03-09T15:09:01.572391+0000","last_clean":"2024-03-09T15:09:01.572391+0000","last_became_active":"2024-03-09T14:35:41.117841+0000","last_became_peered":"2024-03-09T14:35:41.117841+0000","last_unstale":"2024-03-09T15:09:01.572391+0000","last_undegraded":"2024-03-09T15:09:01.572391+0000","last_fullsized":"2024-03-09T15:09:01.572391+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:59:14.029378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":73,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.560222+0000","last_change":"2024-03-09T14:50:35.509942+0000","last_active":"2024-03-09T15:07:56.560222+0000","last_peered":"2024-03-09T15:07:56.560222+0000","last_clean":"2024-03-09T15:07:56.560222+0000","last_became_active":"2024-03-09T14:50:35.509460+0000","last_became_peered":"2024-03-09T14:50:35.509460+0000","last_unstale":"2024-03-09T15:07:56.560222+0000","last_undegraded":"2024-03-09T15:07:56.560222+0000","last_fullsized":"2024-03-09T15:07:56.560222+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:23:50.413320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.563731+0000","last_change":"2024-03-09T14:38:37.439377+0000","last_active":"2024-03-09T15:07:46.563731+0000","last_peered":"2024-03-09T15:07:46.563731+0000","last_clean":"2024-03-09T15:07:46.563731+0000","last_became_active":"2024-03-09T14:38:37.439087+0000","last_became_peered":"2024-03-09T14:38:37.439087+0000","last_unstale":"2024-03-09T15:07:46.563731+0000","last_undegraded":"2024-03-09T15:07:46.563731+0000","last_fullsized":"2024-03-09T15:07:46.563731+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:58.859594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'1","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.716561+0000","last_change":"2024-03-09T14:38:34.418700+0000","last_active":"2024-03-09T15:08:41.716561+0000","last_peered":"2024-03-09T15:08:41.716561+0000","last_clean":"2024-03-09T15:08:41.716561+0000","last_became_active":"2024-03-09T14:38:34.418453+0000","last_became_peered":"2024-03-09T14:38:34.418453+0000","last_unstale":"2024-03-09T15:08:41.716561+0000","last_undegraded":"2024-03-09T15:08:41.716561+0000","last_fullsized":"2024-03-09T15:08:41.716561+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:34:24.696789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'42","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.582487+0000","last_change":"2024-03-09T14:35:41.119444+0000","last_active":"2024-03-09T15:09:01.582487+0000","last_peered":"2024-03-09T15:09:01.582487+0000","last_clean":"2024-03-09T15:09:01.582487+0000","last_became_active":"2024-03-09T14:35:41.119181+0000","last_became_peered":"2024-03-09T14:35:41.119181+0000","last_unstale":"2024-03-09T15:09:01.582487+0000","last_undegraded":"2024-03-09T15:09:01.582487+0000","last_fullsized":"2024-03-09T15:09:01.582487+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:50:55.417930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":129,"num_write":69,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.572571+0000","last_change":"2024-03-09T14:50:35.504114+0000","last_active":"2024-03-09T15:07:56.572571+0000","last_peered":"2024-03-09T15:07:56.572571+0000","last_clean":"2024-03-09T15:07:56.572571+0000","last_became_active":"2024-03-09T14:50:35.503858+0000","last_became_peered":"2024-03-09T14:50:35.503858+0000","last_unstale":"2024-03-09T15:07:56.572571+0000","last_undegraded":"2024-03-09T15:07:56.572571+0000","last_fullsized":"2024-03-09T15:07:56.572571+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:40:55.004194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.580175+0000","last_change":"2024-03-09T14:38:37.434360+0000","last_active":"2024-03-09T15:08:41.580175+0000","last_peered":"2024-03-09T15:08:41.580175+0000","last_clean":"2024-03-09T15:08:41.580175+0000","last_became_active":"2024-03-09T14:38:37.434065+0000","last_became_peered":"2024-03-09T14:38:37.434065+0000","last_unstale":"2024-03-09T15:08:41.580175+0000","last_undegraded":"2024-03-09T15:08:41.580175+0000","last_fullsized":"2024-03-09T15:08:41.580175+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:19:29.089561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.709323+0000","last_change":"2024-03-09T14:38:34.423457+0000","last_active":"2024-03-09T15:07:46.709323+0000","last_peered":"2024-03-09T15:07:46.709323+0000","last_clean":"2024-03-09T15:07:46.709323+0000","last_became_active":"2024-03-09T14:38:34.423145+0000","last_became_peered":"2024-03-09T14:38:34.423145+0000","last_unstale":"2024-03-09T15:07:46.709323+0000","last_undegraded":"2024-03-09T15:07:46.709323+0000","last_fullsized":"2024-03-09T15:07:46.709323+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:09.464410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'41","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.597881+0000","last_change":"2024-03-09T14:35:41.117904+0000","last_active":"2024-03-09T15:09:01.597881+0000","last_peered":"2024-03-09T15:09:01.597881+0000","last_clean":"2024-03-09T15:09:01.597881+0000","last_became_active":"2024-03-09T14:35:41.117617+0000","last_became_peered":"2024-03-09T14:35:41.117617+0000","last_unstale":"2024-03-09T15:09:01.597881+0000","last_undegraded":"2024-03-09T15:09:01.597881+0000","last_fullsized":"2024-03-09T15:09:01.597881+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:19:10.800608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":72,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.582122+0000","last_change":"2024-03-09T14:50:35.506611+0000","last_active":"2024-03-09T15:09:21.582122+0000","last_peered":"2024-03-09T15:09:21.582122+0000","last_clean":"2024-03-09T15:09:21.582122+0000","last_became_active":"2024-03-09T14:50:35.506356+0000","last_became_peered":"2024-03-09T14:50:35.506356+0000","last_unstale":"2024-03-09T15:09:21.582122+0000","last_undegraded":"2024-03-09T15:09:21.582122+0000","last_fullsized":"2024-03-09T15:09:21.582122+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:42:15.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588120+0000","last_change":"2024-03-09T14:38:37.439826+0000","last_active":"2024-03-09T15:07:46.588120+0000","last_peered":"2024-03-09T15:07:46.588120+0000","last_clean":"2024-03-09T15:07:46.588120+0000","last_became_active":"2024-03-09T14:38:37.439120+0000","last_became_peered":"2024-03-09T14:38:37.439120+0000","last_unstale":"2024-03-09T15:07:46.588120+0000","last_undegraded":"2024-03-09T15:07:46.588120+0000","last_fullsized":"2024-03-09T15:07:46.588120+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:27.748958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"261'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.563759+0000","last_change":"2024-03-09T14:38:34.422928+0000","last_active":"2024-03-09T15:07:46.563759+0000","last_peered":"2024-03-09T15:07:46.563759+0000","last_clean":"2024-03-09T15:07:46.563759+0000","last_became_active":"2024-03-09T14:38:34.422585+0000","last_became_peered":"2024-03-09T14:38:34.422585+0000","last_unstale":"2024-03-09T15:07:46.563759+0000","last_undegraded":"2024-03-09T15:07:46.563759+0000","last_fullsized":"2024-03-09T15:07:46.563759+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:09.827968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'19","reported_seq":94,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.597802+0000","last_change":"2024-03-09T14:35:41.119625+0000","last_active":"2024-03-09T15:09:01.597802+0000","last_peered":"2024-03-09T15:09:01.597802+0000","last_clean":"2024-03-09T15:09:01.597802+0000","last_became_active":"2024-03-09T14:35:41.118425+0000","last_became_peered":"2024-03-09T14:35:41.118425+0000","last_unstale":"2024-03-09T15:09:01.597802+0000","last_undegraded":"2024-03-09T15:09:01.597802+0000","last_fullsized":"2024-03-09T15:09:01.597802+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:23:15.437892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":53,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.722085+0000","last_change":"2024-03-09T14:50:35.505890+0000","last_active":"2024-03-09T15:09:21.722085+0000","last_peered":"2024-03-09T15:09:21.722085+0000","last_clean":"2024-03-09T15:09:21.722085+0000","last_became_active":"2024-03-09T14:50:35.505615+0000","last_became_peered":"2024-03-09T14:50:35.505615+0000","last_unstale":"2024-03-09T15:09:21.722085+0000","last_undegraded":"2024-03-09T15:09:21.722085+0000","last_fullsized":"2024-03-09T15:09:21.722085+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:12.727103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588248+0000","last_change":"2024-03-09T14:38:37.437735+0000","last_active":"2024-03-09T15:07:46.588248+0000","last_peered":"2024-03-09T15:07:46.588248+0000","last_clean":"2024-03-09T15:07:46.588248+0000","last_became_active":"2024-03-09T14:38:37.437417+0000","last_became_peered":"2024-03-09T14:38:37.437417+0000","last_unstale":"2024-03-09T15:07:46.588248+0000","last_undegraded":"2024-03-09T15:07:46.588248+0000","last_fullsized":"2024-03-09T15:07:46.588248+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:55.465162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":9,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"261'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588136+0000","last_change":"2024-03-09T14:38:34.415988+0000","last_active":"2024-03-09T15:07:46.588136+0000","last_peered":"2024-03-09T15:07:46.588136+0000","last_clean":"2024-03-09T15:07:46.588136+0000","last_became_active":"2024-03-09T14:38:34.415722+0000","last_became_peered":"2024-03-09T14:38:34.415722+0000","last_unstale":"2024-03-09T15:07:46.588136+0000","last_undegraded":"2024-03-09T15:07:46.588136+0000","last_fullsized":"2024-03-09T15:07:46.588136+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:07.146194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'34","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.709277+0000","last_change":"2024-03-09T14:35:41.121819+0000","last_active":"2024-03-09T15:07:46.709277+0000","last_peered":"2024-03-09T15:07:46.709277+0000","last_clean":"2024-03-09T15:07:46.709277+0000","last_became_active":"2024-03-09T14:35:41.121524+0000","last_became_peered":"2024-03-09T14:35:41.121524+0000","last_unstale":"2024-03-09T15:07:46.709277+0000","last_undegraded":"2024-03-09T15:07:46.709277+0000","last_fullsized":"2024-03-09T15:07:46.709277+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:28:01.825341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":103,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'177","reported_seq":777,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:10.542951+0000","last_change":"2024-03-09T14:27:03.724626+0000","last_active":"2024-03-09T15:08:10.542951+0000","last_peered":"2024-03-09T15:08:10.542951+0000","last_clean":"2024-03-09T15:08:10.542951+0000","last_became_active":"2024-03-09T14:27:03.724231+0000","last_became_peered":"2024-03-09T14:27:03.724231+0000","last_unstale":"2024-03-09T15:08:10.542951+0000","last_undegraded":"2024-03-09T15:08:10.542951+0000","last_fullsized":"2024-03-09T15:08:10.542951+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:50.020398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18164995,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":328,"num_read_kb":37533,"num_write":989,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'398","reported_seq":1851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:49.452754+0000","last_change":"2024-03-09T14:26:28.649571+0000","last_active":"2024-03-09T15:10:49.452754+0000","last_peered":"2024-03-09T15:10:49.452754+0000","last_clean":"2024-03-09T15:10:49.452754+0000","last_became_active":"2024-03-09T14:26:28.648852+0000","last_became_peered":"2024-03-09T14:26:28.648852+0000","last_unstale":"2024-03-09T15:10:49.452754+0000","last_undegraded":"2024-03-09T15:10:49.452754+0000","last_fullsized":"2024-03-09T15:10:49.452754+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:19.263893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2165,"num_read_kb":2027,"num_write":486,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'158","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:23.774722+0000","last_change":"2024-03-09T14:26:26.636093+0000","last_active":"2024-03-09T15:10:23.774722+0000","last_peered":"2024-03-09T15:10:23.774722+0000","last_clean":"2024-03-09T15:10:23.774722+0000","last_became_active":"2024-03-09T14:26:26.635705+0000","last_became_peered":"2024-03-09T14:26:26.635705+0000","last_unstale":"2024-03-09T15:10:23.774722+0000","last_undegraded":"2024-03-09T15:10:23.774722+0000","last_fullsized":"2024-03-09T15:10:23.774722+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:44.432842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8483879,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":33876,"num_write":830,"num_write_kb":32927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'816","reported_seq":2387,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.199607+0000","last_change":"2024-03-09T14:28:04.197235+0000","last_active":"2024-03-09T15:11:09.199607+0000","last_peered":"2024-03-09T15:11:09.199607+0000","last_clean":"2024-03-09T15:11:09.199607+0000","last_became_active":"2024-03-09T14:28:04.196872+0000","last_became_peered":"2024-03-09T14:28:04.196872+0000","last_unstale":"2024-03-09T15:11:09.199607+0000","last_undegraded":"2024-03-09T15:11:09.199607+0000","last_fullsized":"2024-03-09T15:11:09.199607+0000","mapping_epoch":38,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:48.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3746,"num_read_kb":3347,"num_write":1098,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'203","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.573686+0000","last_change":"2024-03-09T14:26:26.626838+0000","last_active":"2024-03-09T15:08:06.573686+0000","last_peered":"2024-03-09T15:08:06.573686+0000","last_clean":"2024-03-09T15:08:06.573686+0000","last_became_active":"2024-03-09T14:26:26.626521+0000","last_became_peered":"2024-03-09T14:26:26.626521+0000","last_unstale":"2024-03-09T15:08:06.573686+0000","last_undegraded":"2024-03-09T15:08:06.573686+0000","last_fullsized":"2024-03-09T15:08:06.573686+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:37.136696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5829780,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":482,"num_read_kb":60498,"num_write":1102,"num_write_kb":28928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'630","reported_seq":2071,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.123841+0000","last_change":"2024-03-09T14:26:28.649656+0000","last_active":"2024-03-09T15:11:01.123841+0000","last_peered":"2024-03-09T15:11:01.123841+0000","last_clean":"2024-03-09T15:11:01.123841+0000","last_became_active":"2024-03-09T14:26:28.649054+0000","last_became_peered":"2024-03-09T14:26:28.649054+0000","last_unstale":"2024-03-09T15:11:01.123841+0000","last_undegraded":"2024-03-09T15:11:01.123841+0000","last_fullsized":"2024-03-09T15:11:01.123841+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":600,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:52:42.171996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3080,"num_read_kb":2811,"num_write":822,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'175","reported_seq":781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:21.992580+0000","last_change":"2024-03-09T14:26:26.647604+0000","last_active":"2024-03-09T15:10:21.992580+0000","last_peered":"2024-03-09T15:10:21.992580+0000","last_clean":"2024-03-09T15:10:21.992580+0000","last_became_active":"2024-03-09T14:26:26.647183+0000","last_became_peered":"2024-03-09T14:26:26.647183+0000","last_unstale":"2024-03-09T15:10:21.992580+0000","last_undegraded":"2024-03-09T15:10:21.992580+0000","last_fullsized":"2024-03-09T15:10:21.992580+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:57:15.681003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2102091,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":10841,"num_write":989,"num_write_kb":22118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'383","reported_seq":1952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.553788+0000","last_change":"2024-03-09T14:26:28.649519+0000","last_active":"2024-03-09T15:10:54.553788+0000","last_peered":"2024-03-09T15:10:54.553788+0000","last_clean":"2024-03-09T15:10:54.553788+0000","last_became_active":"2024-03-09T14:26:28.649146+0000","last_became_peered":"2024-03-09T14:26:28.649146+0000","last_unstale":"2024-03-09T15:10:54.553788+0000","last_undegraded":"2024-03-09T15:10:54.553788+0000","last_fullsized":"2024-03-09T15:10:54.553788+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:12:07.136106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2286,"num_read_kb":2187,"num_write":441,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'258","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.718584+0000","last_change":"2024-03-09T14:26:26.652067+0000","last_active":"2024-03-09T15:08:56.718584+0000","last_peered":"2024-03-09T15:08:56.718584+0000","last_clean":"2024-03-09T15:08:56.718584+0000","last_became_active":"2024-03-09T14:26:26.651564+0000","last_became_peered":"2024-03-09T14:26:26.651564+0000","last_unstale":"2024-03-09T15:08:56.718584+0000","last_undegraded":"2024-03-09T15:08:56.718584+0000","last_fullsized":"2024-03-09T15:08:56.718584+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:14:35.603518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18185497,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":642,"num_read_kb":37846,"num_write":1526,"num_write_kb":26421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'334","reported_seq":1772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:13.861455+0000","last_change":"2024-03-09T14:26:28.648555+0000","last_active":"2024-03-09T15:09:13.861455+0000","last_peered":"2024-03-09T15:09:13.861455+0000","last_clean":"2024-03-09T15:09:13.861455+0000","last_became_active":"2024-03-09T14:26:28.648259+0000","last_became_peered":"2024-03-09T14:26:28.648259+0000","last_unstale":"2024-03-09T15:09:13.861455+0000","last_undegraded":"2024-03-09T15:09:13.861455+0000","last_fullsized":"2024-03-09T15:09:13.861455+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:13:53.538477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2053,"num_read_kb":1964,"num_write":385,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'167","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:26.458259+0000","last_change":"2024-03-09T14:26:26.649108+0000","last_active":"2024-03-09T15:10:26.458259+0000","last_peered":"2024-03-09T15:10:26.458259+0000","last_clean":"2024-03-09T15:10:26.458259+0000","last_became_active":"2024-03-09T14:26:26.648780+0000","last_became_peered":"2024-03-09T14:26:26.648780+0000","last_unstale":"2024-03-09T15:10:26.458259+0000","last_undegraded":"2024-03-09T15:10:26.458259+0000","last_fullsized":"2024-03-09T15:10:26.458259+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:42.844197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":557887,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":379,"num_read_kb":3119,"num_write":931,"num_write_kb":23902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'461","reported_seq":2006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.310310+0000","last_change":"2024-03-09T14:26:28.650877+0000","last_active":"2024-03-09T15:10:45.310310+0000","last_peered":"2024-03-09T15:10:45.310310+0000","last_clean":"2024-03-09T15:10:45.310310+0000","last_became_active":"2024-03-09T14:26:28.649994+0000","last_became_peered":"2024-03-09T14:26:28.649994+0000","last_unstale":"2024-03-09T15:10:45.310310+0000","last_undegraded":"2024-03-09T15:10:45.310310+0000","last_fullsized":"2024-03-09T15:10:45.310310+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:45:40.976578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2508,"num_read_kb":2326,"num_write":602,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'156","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.386580+0000","last_change":"2024-03-09T14:26:26.652122+0000","last_active":"2024-03-09T15:11:26.386580+0000","last_peered":"2024-03-09T15:11:26.386580+0000","last_clean":"2024-03-09T15:11:26.386580+0000","last_became_active":"2024-03-09T14:26:26.651754+0000","last_became_peered":"2024-03-09T14:26:26.651754+0000","last_unstale":"2024-03-09T15:11:26.386580+0000","last_undegraded":"2024-03-09T15:11:26.386580+0000","last_fullsized":"2024-03-09T15:11:26.386580+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:56:39.902062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25167905,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":425,"num_read_kb":120305,"num_write":884,"num_write_kb":41051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'1264","reported_seq":2891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.180247+0000","last_change":"2024-03-09T14:26:28.652076+0000","last_active":"2024-03-09T15:11:09.180247+0000","last_peered":"2024-03-09T15:11:09.180247+0000","last_clean":"2024-03-09T15:11:09.180247+0000","last_became_active":"2024-03-09T14:26:28.651754+0000","last_became_peered":"2024-03-09T14:26:28.651754+0000","last_unstale":"2024-03-09T15:11:09.180247+0000","last_undegraded":"2024-03-09T15:11:09.180247+0000","last_fullsized":"2024-03-09T15:11:09.180247+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:58.139033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5611,"num_read_kb":4890,"num_write":1803,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'155","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.682372+0000","last_change":"2024-03-09T14:26:26.643565+0000","last_active":"2024-03-09T15:08:56.682372+0000","last_peered":"2024-03-09T15:08:56.682372+0000","last_clean":"2024-03-09T15:08:56.682372+0000","last_became_active":"2024-03-09T14:26:26.643195+0000","last_became_peered":"2024-03-09T14:26:26.643195+0000","last_unstale":"2024-03-09T15:08:56.682372+0000","last_undegraded":"2024-03-09T15:08:56.682372+0000","last_fullsized":"2024-03-09T15:08:56.682372+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:07:00.066934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6997673,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":383,"num_read_kb":7445,"num_write":882,"num_write_kb":17740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'832","reported_seq":2501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.868382+0000","last_change":"2024-03-09T14:26:28.654056+0000","last_active":"2024-03-09T15:11:07.868382+0000","last_peered":"2024-03-09T15:11:07.868382+0000","last_clean":"2024-03-09T15:11:07.868382+0000","last_became_active":"2024-03-09T14:26:28.653778+0000","last_became_peered":"2024-03-09T14:26:28.653778+0000","last_unstale":"2024-03-09T15:11:07.868382+0000","last_undegraded":"2024-03-09T15:11:07.868382+0000","last_fullsized":"2024-03-09T15:11:07.868382+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:38:55.151292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3883,"num_read_kb":3504,"num_write":1111,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'451","reported_seq":2033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.529624+0000","last_change":"2024-03-09T14:26:28.649892+0000","last_active":"2024-03-09T15:10:54.529624+0000","last_peered":"2024-03-09T15:10:54.529624+0000","last_clean":"2024-03-09T15:10:54.529624+0000","last_became_active":"2024-03-09T14:26:28.649128+0000","last_became_peered":"2024-03-09T14:26:28.649128+0000","last_unstale":"2024-03-09T15:10:54.529624+0000","last_undegraded":"2024-03-09T15:10:54.529624+0000","last_fullsized":"2024-03-09T15:10:54.529624+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:11:16.956384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2472,"num_read_kb":2328,"num_write":564,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'186","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:02.923440+0000","last_change":"2024-03-09T14:26:26.651818+0000","last_active":"2024-03-09T15:10:02.923440+0000","last_peered":"2024-03-09T15:10:02.923440+0000","last_clean":"2024-03-09T15:10:02.923440+0000","last_became_active":"2024-03-09T14:26:26.651323+0000","last_became_peered":"2024-03-09T14:26:26.651323+0000","last_unstale":"2024-03-09T15:10:02.923440+0000","last_undegraded":"2024-03-09T15:10:02.923440+0000","last_fullsized":"2024-03-09T15:10:02.923440+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:26.086700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2099339,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":437,"num_read_kb":7847,"num_write":1010,"num_write_kb":34087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'415","reported_seq":1935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:34.444271+0000","last_change":"2024-03-09T14:26:28.646304+0000","last_active":"2024-03-09T15:10:34.444271+0000","last_peered":"2024-03-09T15:10:34.444271+0000","last_clean":"2024-03-09T15:10:34.444271+0000","last_became_active":"2024-03-09T14:26:28.645422+0000","last_became_peered":"2024-03-09T14:26:28.645422+0000","last_unstale":"2024-03-09T15:10:34.444271+0000","last_undegraded":"2024-03-09T15:10:34.444271+0000","last_fullsized":"2024-03-09T15:10:34.444271+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:50:13.964684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2243,"num_read_kb":2118,"num_write":516,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'176","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:27.397246+0000","last_change":"2024-03-09T14:26:26.644904+0000","last_active":"2024-03-09T15:09:27.397246+0000","last_peered":"2024-03-09T15:09:27.397246+0000","last_clean":"2024-03-09T15:09:27.397246+0000","last_became_active":"2024-03-09T14:26:26.644578+0000","last_became_peered":"2024-03-09T14:26:26.644578+0000","last_unstale":"2024-03-09T15:09:27.397246+0000","last_undegraded":"2024-03-09T15:09:27.397246+0000","last_fullsized":"2024-03-09T15:09:27.397246+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:27:29.674744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582928,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":445,"num_read_kb":16041,"num_write":1040,"num_write_kb":25248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'392","reported_seq":2099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.420096+0000","last_change":"2024-03-09T14:26:28.648611+0000","last_active":"2024-03-09T15:11:04.420096+0000","last_peered":"2024-03-09T15:11:04.420096+0000","last_clean":"2024-03-09T15:11:04.420096+0000","last_became_active":"2024-03-09T14:26:28.648115+0000","last_became_peered":"2024-03-09T14:26:28.648115+0000","last_unstale":"2024-03-09T15:11:04.420096+0000","last_undegraded":"2024-03-09T15:11:04.420096+0000","last_fullsized":"2024-03-09T15:11:04.420096+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:30:00.259696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2471,"num_read_kb":2382,"num_write":449,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'202","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:43.589351+0000","last_change":"2024-03-09T14:26:26.647793+0000","last_active":"2024-03-09T15:08:43.589351+0000","last_peered":"2024-03-09T15:08:43.589351+0000","last_clean":"2024-03-09T15:08:43.589351+0000","last_became_active":"2024-03-09T14:26:26.647391+0000","last_became_peered":"2024-03-09T14:26:26.647391+0000","last_unstale":"2024-03-09T15:08:43.589351+0000","last_undegraded":"2024-03-09T15:08:43.589351+0000","last_fullsized":"2024-03-09T15:08:43.589351+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:14.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2846719,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":382,"num_read_kb":14846,"num_write":1052,"num_write_kb":41673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'453","reported_seq":2022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.896057+0000","last_change":"2024-03-09T14:26:28.648170+0000","last_active":"2024-03-09T15:11:07.896057+0000","last_peered":"2024-03-09T15:11:07.896057+0000","last_clean":"2024-03-09T15:11:07.896057+0000","last_became_active":"2024-03-09T14:26:28.647846+0000","last_became_peered":"2024-03-09T14:26:28.647846+0000","last_unstale":"2024-03-09T15:11:07.896057+0000","last_undegraded":"2024-03-09T15:11:07.896057+0000","last_fullsized":"2024-03-09T15:11:07.896057+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:52:23.409112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2382,"num_read_kb":2246,"num_write":552,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'279","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:54.343225+0000","last_change":"2024-03-09T14:26:26.638124+0000","last_active":"2024-03-09T15:08:54.343225+0000","last_peered":"2024-03-09T15:08:54.343225+0000","last_clean":"2024-03-09T15:08:54.343225+0000","last_became_active":"2024-03-09T14:26:26.637767+0000","last_became_peered":"2024-03-09T14:26:26.637767+0000","last_unstale":"2024-03-09T15:08:54.343225+0000","last_undegraded":"2024-03-09T15:08:54.343225+0000","last_fullsized":"2024-03-09T15:08:54.343225+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:29:58.146491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11882780,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":593,"num_read_kb":72489,"num_write":1410,"num_write_kb":47263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'1533","reported_seq":3258,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.873260+0000","last_change":"2024-03-09T14:26:28.654340+0000","last_active":"2024-03-09T15:11:07.873260+0000","last_peered":"2024-03-09T15:11:07.873260+0000","last_clean":"2024-03-09T15:11:07.873260+0000","last_became_active":"2024-03-09T14:26:28.653385+0000","last_became_peered":"2024-03-09T14:26:28.653385+0000","last_unstale":"2024-03-09T15:11:07.873260+0000","last_undegraded":"2024-03-09T15:11:07.873260+0000","last_fullsized":"2024-03-09T15:11:07.873260+0000","mapping_epoch":25,"log_start":"264'1500","ondisk_log_start":"264'1500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:12:04.813024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6446,"num_read_kb":5594,"num_write":2158,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'214","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:22.846291+0000","last_change":"2024-03-09T14:26:26.644011+0000","last_active":"2024-03-09T15:09:22.846291+0000","last_peered":"2024-03-09T15:09:22.846291+0000","last_clean":"2024-03-09T15:09:22.846291+0000","last_became_active":"2024-03-09T14:26:26.643401+0000","last_became_peered":"2024-03-09T14:26:26.643401+0000","last_unstale":"2024-03-09T15:09:22.846291+0000","last_undegraded":"2024-03-09T15:09:22.846291+0000","last_fullsized":"2024-03-09T15:09:22.846291+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:05.752386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10309380,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":458,"num_read_kb":13858,"num_write":1170,"num_write_kb":34499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'726","reported_seq":2205,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.153334+0000","last_change":"2024-03-09T14:26:28.650896+0000","last_active":"2024-03-09T15:11:37.153334+0000","last_peered":"2024-03-09T15:11:37.153334+0000","last_clean":"2024-03-09T15:11:37.153334+0000","last_became_active":"2024-03-09T14:26:28.650334+0000","last_became_peered":"2024-03-09T14:26:28.650334+0000","last_unstale":"2024-03-09T15:11:37.153334+0000","last_undegraded":"2024-03-09T15:11:37.153334+0000","last_fullsized":"2024-03-09T15:11:37.153334+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:18:31.435564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3318,"num_read_kb":2980,"num_write":968,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'135","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.577012+0000","last_change":"2024-03-09T14:26:26.631574+0000","last_active":"2024-03-09T15:08:36.577012+0000","last_peered":"2024-03-09T15:08:36.577012+0000","last_clean":"2024-03-09T15:08:36.577012+0000","last_became_active":"2024-03-09T14:26:26.631203+0000","last_became_peered":"2024-03-09T14:26:26.631203+0000","last_unstale":"2024-03-09T15:08:36.577012+0000","last_undegraded":"2024-03-09T15:08:36.577012+0000","last_fullsized":"2024-03-09T15:08:36.577012+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:18:43.836166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3147062,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":303,"num_read_kb":11988,"num_write":736,"num_write_kb":25932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'99","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.863832+0000","last_change":"2024-03-09T14:26:36.674788+0000","last_active":"2024-03-09T15:11:04.863832+0000","last_peered":"2024-03-09T15:11:04.863832+0000","last_clean":"2024-03-09T15:11:04.863832+0000","last_became_active":"2024-03-09T14:26:36.674500+0000","last_became_peered":"2024-03-09T14:26:36.674500+0000","last_unstale":"2024-03-09T15:11:04.863832+0000","last_undegraded":"2024-03-09T15:11:04.863832+0000","last_fullsized":"2024-03-09T15:11:04.863832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:14:05.988499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":88,"num_write":230,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'372","reported_seq":1772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:44.538039+0000","last_change":"2024-03-09T14:28:03.816157+0000","last_active":"2024-03-09T15:09:44.538039+0000","last_peered":"2024-03-09T15:09:44.538039+0000","last_clean":"2024-03-09T15:09:44.538039+0000","last_became_active":"2024-03-09T14:28:03.815924+0000","last_became_peered":"2024-03-09T14:28:03.815924+0000","last_unstale":"2024-03-09T15:09:44.538039+0000","last_undegraded":"2024-03-09T15:09:44.538039+0000","last_fullsized":"2024-03-09T15:09:44.538039+0000","mapping_epoch":38,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:54:24.380063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1992,"num_read_kb":1883,"num_write":432,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"264'201","reported_seq":807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:54.965731+0000","last_change":"2024-03-09T14:26:26.653743+0000","last_active":"2024-03-09T15:08:54.965731+0000","last_peered":"2024-03-09T15:08:54.965731+0000","last_clean":"2024-03-09T15:08:54.965731+0000","last_became_active":"2024-03-09T14:26:26.652957+0000","last_became_peered":"2024-03-09T14:26:26.652957+0000","last_unstale":"2024-03-09T15:08:54.965731+0000","last_undegraded":"2024-03-09T15:08:54.965731+0000","last_fullsized":"2024-03-09T15:08:54.965731+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:49.440301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5267750,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":418,"num_read_kb":22200,"num_write":1163,"num_write_kb":38864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.572316+0000","last_change":"2024-03-09T14:26:30.655416+0000","last_active":"2024-03-09T15:07:36.572316+0000","last_peered":"2024-03-09T15:07:36.572316+0000","last_clean":"2024-03-09T15:07:36.572316+0000","last_became_active":"2024-03-09T14:26:30.654862+0000","last_became_peered":"2024-03-09T14:26:30.654862+0000","last_unstale":"2024-03-09T15:07:36.572316+0000","last_undegraded":"2024-03-09T15:07:36.572316+0000","last_fullsized":"2024-03-09T15:07:36.572316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:05.895677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'181","reported_seq":779,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.587222+0000","last_change":"2024-03-09T14:26:32.653350+0000","last_active":"2024-03-09T15:10:06.587222+0000","last_peered":"2024-03-09T15:10:06.587222+0000","last_clean":"2024-03-09T15:10:06.587222+0000","last_became_active":"2024-03-09T14:26:32.652879+0000","last_became_peered":"2024-03-09T14:26:32.652879+0000","last_unstale":"2024-03-09T15:10:06.587222+0000","last_undegraded":"2024-03-09T15:10:06.587222+0000","last_fullsized":"2024-03-09T15:10:06.587222+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:22:58.520379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21241,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":242,"num_read_kb":333,"num_write":140,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.708826+0000","last_change":"2024-03-09T14:26:34.670623+0000","last_active":"2024-03-09T15:07:41.708826+0000","last_peered":"2024-03-09T15:07:41.708826+0000","last_clean":"2024-03-09T15:07:41.708826+0000","last_became_active":"2024-03-09T14:26:34.670336+0000","last_became_peered":"2024-03-09T14:26:34.670336+0000","last_unstale":"2024-03-09T15:07:41.708826+0000","last_undegraded":"2024-03-09T15:07:41.708826+0000","last_fullsized":"2024-03-09T15:07:41.708826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:22:58.489151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'168","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.758728+0000","last_change":"2024-03-09T14:26:36.674055+0000","last_active":"2024-03-09T15:10:35.758728+0000","last_peered":"2024-03-09T15:10:35.758728+0000","last_clean":"2024-03-09T15:10:35.758728+0000","last_became_active":"2024-03-09T14:26:36.673806+0000","last_became_peered":"2024-03-09T14:26:36.673806+0000","last_unstale":"2024-03-09T15:10:35.758728+0000","last_undegraded":"2024-03-09T15:10:35.758728+0000","last_fullsized":"2024-03-09T15:10:35.758728+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:17:00.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":385,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'374","reported_seq":1917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.421489+0000","last_change":"2024-03-09T14:26:28.646103+0000","last_active":"2024-03-09T15:11:04.421489+0000","last_peered":"2024-03-09T15:11:04.421489+0000","last_clean":"2024-03-09T15:11:04.421489+0000","last_became_active":"2024-03-09T14:26:28.645537+0000","last_became_peered":"2024-03-09T14:26:28.645537+0000","last_unstale":"2024-03-09T15:11:04.421489+0000","last_undegraded":"2024-03-09T15:11:04.421489+0000","last_fullsized":"2024-03-09T15:11:04.421489+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:56:00.728701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2096,"num_read_kb":2016,"num_write":417,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'221","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:03.654938+0000","last_change":"2024-03-09T14:26:26.644936+0000","last_active":"2024-03-09T15:09:03.654938+0000","last_peered":"2024-03-09T15:09:03.654938+0000","last_clean":"2024-03-09T15:09:03.654938+0000","last_became_active":"2024-03-09T14:26:26.644563+0000","last_became_peered":"2024-03-09T14:26:26.644563+0000","last_unstale":"2024-03-09T15:09:03.654938+0000","last_undegraded":"2024-03-09T15:09:03.654938+0000","last_fullsized":"2024-03-09T15:09:03.654938+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:22:28.065455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9503167,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":457,"num_read_kb":29388,"num_write":1128,"num_write_kb":42312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.679955+0000","last_change":"2024-03-09T14:26:30.651988+0000","last_active":"2024-03-09T15:08:36.679955+0000","last_peered":"2024-03-09T15:08:36.679955+0000","last_clean":"2024-03-09T15:08:36.679955+0000","last_became_active":"2024-03-09T14:26:30.651683+0000","last_became_peered":"2024-03-09T14:26:30.651683+0000","last_unstale":"2024-03-09T15:08:36.679955+0000","last_undegraded":"2024-03-09T15:08:36.679955+0000","last_fullsized":"2024-03-09T15:08:36.679955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:33:21.797293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'81","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.607493+0000","last_change":"2024-03-09T14:26:32.657274+0000","last_active":"2024-03-09T15:10:06.607493+0000","last_peered":"2024-03-09T15:10:06.607493+0000","last_clean":"2024-03-09T15:10:06.607493+0000","last_became_active":"2024-03-09T14:26:32.656995+0000","last_became_peered":"2024-03-09T14:26:32.656995+0000","last_unstale":"2024-03-09T15:10:06.607493+0000","last_undegraded":"2024-03-09T15:10:06.607493+0000","last_fullsized":"2024-03-09T15:10:06.607493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:23:29.312811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":86,"num_read_kb":83,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.587663+0000","last_change":"2024-03-09T14:26:34.666672+0000","last_active":"2024-03-09T15:07:41.587663+0000","last_peered":"2024-03-09T15:07:41.587663+0000","last_clean":"2024-03-09T15:07:41.587663+0000","last_became_active":"2024-03-09T14:26:34.666326+0000","last_became_peered":"2024-03-09T14:26:34.666326+0000","last_unstale":"2024-03-09T15:07:41.587663+0000","last_undegraded":"2024-03-09T15:07:41.587663+0000","last_fullsized":"2024-03-09T15:07:41.587663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:51:24.275827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'111","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:25.702130+0000","last_change":"2024-03-09T14:26:36.671366+0000","last_active":"2024-03-09T15:10:25.702130+0000","last_peered":"2024-03-09T15:10:25.702130+0000","last_clean":"2024-03-09T15:10:25.702130+0000","last_became_active":"2024-03-09T14:26:36.671071+0000","last_became_peered":"2024-03-09T14:26:36.671071+0000","last_unstale":"2024-03-09T15:10:25.702130+0000","last_undegraded":"2024-03-09T15:10:25.702130+0000","last_fullsized":"2024-03-09T15:10:25.702130+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:35.587717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":104,"num_write":246,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'951","reported_seq":2539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.046845+0000","last_change":"2024-03-09T14:26:28.649069+0000","last_active":"2024-03-09T15:10:51.046845+0000","last_peered":"2024-03-09T15:10:51.046845+0000","last_clean":"2024-03-09T15:10:51.046845+0000","last_became_active":"2024-03-09T14:26:28.648586+0000","last_became_peered":"2024-03-09T14:26:28.648586+0000","last_unstale":"2024-03-09T15:10:51.046845+0000","last_undegraded":"2024-03-09T15:10:51.046845+0000","last_fullsized":"2024-03-09T15:10:51.046845+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:43:05.587726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4258,"num_read_kb":3730,"num_write":1359,"num_write_kb":540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'181","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:14.100648+0000","last_change":"2024-03-09T14:26:26.653314+0000","last_active":"2024-03-09T15:09:14.100648+0000","last_peered":"2024-03-09T15:09:14.100648+0000","last_clean":"2024-03-09T15:09:14.100648+0000","last_became_active":"2024-03-09T14:26:26.652803+0000","last_became_peered":"2024-03-09T14:26:26.652803+0000","last_unstale":"2024-03-09T15:09:14.100648+0000","last_undegraded":"2024-03-09T15:09:14.100648+0000","last_fullsized":"2024-03-09T15:09:14.100648+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:35:03.501326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195206,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":380,"num_read_kb":6854,"num_write":968,"num_write_kb":33721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.671581+0000","last_change":"2024-03-09T14:26:30.652950+0000","last_active":"2024-03-09T15:07:36.671581+0000","last_peered":"2024-03-09T15:07:36.671581+0000","last_clean":"2024-03-09T15:07:36.671581+0000","last_became_active":"2024-03-09T14:26:30.652699+0000","last_became_peered":"2024-03-09T14:26:30.652699+0000","last_unstale":"2024-03-09T15:07:36.671581+0000","last_undegraded":"2024-03-09T15:07:36.671581+0000","last_fullsized":"2024-03-09T15:07:36.671581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:39:48.909510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'98","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:22.138446+0000","last_change":"2024-03-09T14:26:32.658656+0000","last_active":"2024-03-09T15:10:22.138446+0000","last_peered":"2024-03-09T15:10:22.138446+0000","last_clean":"2024-03-09T15:10:22.138446+0000","last_became_active":"2024-03-09T14:26:32.658348+0000","last_became_peered":"2024-03-09T14:26:32.658348+0000","last_unstale":"2024-03-09T15:10:22.138446+0000","last_undegraded":"2024-03-09T15:10:22.138446+0000","last_fullsized":"2024-03-09T15:10:22.138446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:46.676833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'528","reported_seq":1962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.638789+0000","last_change":"2024-03-09T14:26:34.674301+0000","last_active":"2024-03-09T15:11:38.638789+0000","last_peered":"2024-03-09T15:11:38.638789+0000","last_clean":"2024-03-09T15:11:38.638789+0000","last_became_active":"2024-03-09T14:26:34.673916+0000","last_became_peered":"2024-03-09T14:26:34.673916+0000","last_unstale":"2024-03-09T15:11:38.638789+0000","last_undegraded":"2024-03-09T15:11:38.638789+0000","last_fullsized":"2024-03-09T15:11:38.638789+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:25:43.485522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'204","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:26.584268+0000","last_change":"2024-03-09T14:26:36.786508+0000","last_active":"2024-03-09T15:10:26.584268+0000","last_peered":"2024-03-09T15:10:26.584268+0000","last_clean":"2024-03-09T15:10:26.584268+0000","last_became_active":"2024-03-09T14:26:36.786202+0000","last_became_peered":"2024-03-09T14:26:36.786202+0000","last_unstale":"2024-03-09T15:10:26.584268+0000","last_undegraded":"2024-03-09T15:10:26.584268+0000","last_fullsized":"2024-03-09T15:10:26.584268+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:32:12.717992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":555,"num_write":450,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'733","reported_seq":2331,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.058929+0000","last_change":"2024-03-09T14:26:28.658592+0000","last_active":"2024-03-09T15:10:51.058929+0000","last_peered":"2024-03-09T15:10:51.058929+0000","last_clean":"2024-03-09T15:10:51.058929+0000","last_became_active":"2024-03-09T14:26:28.657030+0000","last_became_peered":"2024-03-09T14:26:28.657030+0000","last_unstale":"2024-03-09T15:10:51.058929+0000","last_undegraded":"2024-03-09T15:10:51.058929+0000","last_fullsized":"2024-03-09T15:10:51.058929+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:32:55.173962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3495,"num_read_kb":3179,"num_write":956,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'231","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:24.542219+0000","last_change":"2024-03-09T14:26:26.644365+0000","last_active":"2024-03-09T15:11:24.542219+0000","last_peered":"2024-03-09T15:11:24.542219+0000","last_clean":"2024-03-09T15:11:24.542219+0000","last_became_active":"2024-03-09T14:26:26.643877+0000","last_became_peered":"2024-03-09T14:26:26.643877+0000","last_unstale":"2024-03-09T15:11:24.542219+0000","last_undegraded":"2024-03-09T15:11:24.542219+0000","last_fullsized":"2024-03-09T15:11:24.542219+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:57:15.681003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5567527,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":616,"num_read_kb":42109,"num_write":1105,"num_write_kb":38892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.572348+0000","last_change":"2024-03-09T14:26:30.651051+0000","last_active":"2024-03-09T15:07:36.572348+0000","last_peered":"2024-03-09T15:07:36.572348+0000","last_clean":"2024-03-09T15:07:36.572348+0000","last_became_active":"2024-03-09T14:26:30.650741+0000","last_became_peered":"2024-03-09T14:26:30.650741+0000","last_unstale":"2024-03-09T15:07:36.572348+0000","last_undegraded":"2024-03-09T15:07:36.572348+0000","last_fullsized":"2024-03-09T15:07:36.572348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:26.277367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'141","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.083284+0000","last_change":"2024-03-09T14:26:32.869163+0000","last_active":"2024-03-09T15:10:51.083284+0000","last_peered":"2024-03-09T15:10:51.083284+0000","last_clean":"2024-03-09T15:10:51.083284+0000","last_became_active":"2024-03-09T14:26:32.868081+0000","last_became_peered":"2024-03-09T14:26:32.868081+0000","last_unstale":"2024-03-09T15:10:51.083284+0000","last_undegraded":"2024-03-09T15:10:51.083284+0000","last_fullsized":"2024-03-09T15:10:51.083284+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:50:41.428007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9327,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":223,"num_write":98,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'561","reported_seq":4021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.698977+0000","last_change":"2024-03-09T14:26:34.679581+0000","last_active":"2024-03-09T15:11:38.698977+0000","last_peered":"2024-03-09T15:11:38.698977+0000","last_clean":"2024-03-09T15:11:38.698977+0000","last_became_active":"2024-03-09T14:26:34.679280+0000","last_became_peered":"2024-03-09T14:26:34.679280+0000","last_unstale":"2024-03-09T15:11:38.698977+0000","last_undegraded":"2024-03-09T15:11:38.698977+0000","last_fullsized":"2024-03-09T15:11:38.698977+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:22:33.914415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'336","reported_seq":1680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.864421+0000","last_change":"2024-03-09T14:26:28.646029+0000","last_active":"2024-03-09T15:11:07.864421+0000","last_peered":"2024-03-09T15:11:07.864421+0000","last_clean":"2024-03-09T15:11:07.864421+0000","last_became_active":"2024-03-09T14:26:28.645600+0000","last_became_peered":"2024-03-09T14:26:28.645600+0000","last_unstale":"2024-03-09T15:11:07.864421+0000","last_undegraded":"2024-03-09T15:11:07.864421+0000","last_fullsized":"2024-03-09T15:11:07.864421+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:31.580713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1869,"num_read_kb":1759,"num_write":401,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'204","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.047804+0000","last_change":"2024-03-09T14:26:26.652521+0000","last_active":"2024-03-09T15:10:42.047804+0000","last_peered":"2024-03-09T15:10:42.047804+0000","last_clean":"2024-03-09T15:10:42.047804+0000","last_became_active":"2024-03-09T14:26:26.652163+0000","last_became_peered":"2024-03-09T14:26:26.652163+0000","last_unstale":"2024-03-09T15:10:42.047804+0000","last_undegraded":"2024-03-09T15:10:42.047804+0000","last_fullsized":"2024-03-09T15:10:42.047804+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:35.690754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8676548,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":479,"num_read_kb":85490,"num_write":1161,"num_write_kb":31492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.708678+0000","last_change":"2024-03-09T14:26:30.648514+0000","last_active":"2024-03-09T15:07:41.708678+0000","last_peered":"2024-03-09T15:07:41.708678+0000","last_clean":"2024-03-09T15:07:41.708678+0000","last_became_active":"2024-03-09T14:26:30.648227+0000","last_became_peered":"2024-03-09T14:26:30.648227+0000","last_unstale":"2024-03-09T15:07:41.708678+0000","last_undegraded":"2024-03-09T15:07:41.708678+0000","last_fullsized":"2024-03-09T15:07:41.708678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:08:30.571556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'201","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:34.447773+0000","last_change":"2024-03-09T14:26:32.868345+0000","last_active":"2024-03-09T15:10:34.447773+0000","last_peered":"2024-03-09T15:10:34.447773+0000","last_clean":"2024-03-09T15:10:34.447773+0000","last_became_active":"2024-03-09T14:26:32.868020+0000","last_became_peered":"2024-03-09T14:26:32.868020+0000","last_unstale":"2024-03-09T15:10:34.447773+0000","last_undegraded":"2024-03-09T15:10:34.447773+0000","last_fullsized":"2024-03-09T15:10:34.447773+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:16:05.222921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9656,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":269,"num_read_kb":288,"num_write":158,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.574392+0000","last_change":"2024-03-09T14:26:34.666827+0000","last_active":"2024-03-09T15:09:21.574392+0000","last_peered":"2024-03-09T15:09:21.574392+0000","last_clean":"2024-03-09T15:09:21.574392+0000","last_became_active":"2024-03-09T14:26:34.666539+0000","last_became_peered":"2024-03-09T14:26:34.666539+0000","last_unstale":"2024-03-09T15:09:21.574392+0000","last_undegraded":"2024-03-09T15:09:21.574392+0000","last_fullsized":"2024-03-09T15:09:21.574392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:45:05.086023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'537","reported_seq":1343,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.686743+0000","last_change":"2024-03-09T14:26:36.672487+0000","last_active":"2024-03-09T15:11:38.686743+0000","last_peered":"2024-03-09T15:11:38.686743+0000","last_clean":"2024-03-09T15:11:38.686743+0000","last_became_active":"2024-03-09T14:26:36.672173+0000","last_became_peered":"2024-03-09T14:26:36.672173+0000","last_unstale":"2024-03-09T15:11:38.686743+0000","last_undegraded":"2024-03-09T15:11:38.686743+0000","last_fullsized":"2024-03-09T15:11:38.686743+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:51:07.339596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1288,"num_read_kb":1278,"num_write":1107,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'868","reported_seq":2461,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.106159+0000","last_change":"2024-03-09T14:26:28.656027+0000","last_active":"2024-03-09T15:11:01.106159+0000","last_peered":"2024-03-09T15:11:01.106159+0000","last_clean":"2024-03-09T15:11:01.106159+0000","last_became_active":"2024-03-09T14:26:28.655572+0000","last_became_peered":"2024-03-09T14:26:28.655572+0000","last_unstale":"2024-03-09T15:11:01.106159+0000","last_undegraded":"2024-03-09T15:11:01.106159+0000","last_fullsized":"2024-03-09T15:11:01.106159+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:10:40.483371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4137,"num_read_kb":3672,"num_write":1196,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'210","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:49.310102+0000","last_change":"2024-03-09T14:26:26.654328+0000","last_active":"2024-03-09T15:10:49.310102+0000","last_peered":"2024-03-09T15:10:49.310102+0000","last_clean":"2024-03-09T15:10:49.310102+0000","last_became_active":"2024-03-09T14:26:26.653969+0000","last_became_peered":"2024-03-09T14:26:26.653969+0000","last_unstale":"2024-03-09T15:10:49.310102+0000","last_undegraded":"2024-03-09T15:10:49.310102+0000","last_fullsized":"2024-03-09T15:10:49.310102+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:24:44.283252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6616130,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":36496,"num_write":1169,"num_write_kb":46772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.558546+0000","last_change":"2024-03-09T14:26:30.647064+0000","last_active":"2024-03-09T15:07:41.558546+0000","last_peered":"2024-03-09T15:07:41.558546+0000","last_clean":"2024-03-09T15:07:41.558546+0000","last_became_active":"2024-03-09T14:26:30.646765+0000","last_became_peered":"2024-03-09T14:26:30.646765+0000","last_unstale":"2024-03-09T15:07:41.558546+0000","last_undegraded":"2024-03-09T15:07:41.558546+0000","last_fullsized":"2024-03-09T15:07:41.558546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:19.489495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'118","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.490724+0000","last_change":"2024-03-09T14:26:32.655422+0000","last_active":"2024-03-09T15:11:36.490724+0000","last_peered":"2024-03-09T15:11:36.490724+0000","last_clean":"2024-03-09T15:11:36.490724+0000","last_became_active":"2024-03-09T14:26:32.655037+0000","last_became_peered":"2024-03-09T14:26:32.655037+0000","last_unstale":"2024-03-09T15:11:36.490724+0000","last_undegraded":"2024-03-09T15:11:36.490724+0000","last_fullsized":"2024-03-09T15:11:36.490724+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:57:37.124968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":156,"num_write":70,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.673401+0000","last_change":"2024-03-09T14:26:34.678829+0000","last_active":"2024-03-09T15:07:51.673401+0000","last_peered":"2024-03-09T15:07:51.673401+0000","last_clean":"2024-03-09T15:07:51.673401+0000","last_became_active":"2024-03-09T14:26:34.678525+0000","last_became_peered":"2024-03-09T14:26:34.678525+0000","last_unstale":"2024-03-09T15:07:51.673401+0000","last_undegraded":"2024-03-09T15:07:51.673401+0000","last_fullsized":"2024-03-09T15:07:51.673401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:57:05.745633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2463","reported_seq":4879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.372073+0000","last_change":"2024-03-09T14:26:36.671509+0000","last_active":"2024-03-09T15:11:37.372073+0000","last_peered":"2024-03-09T15:11:37.372073+0000","last_clean":"2024-03-09T15:11:37.372073+0000","last_became_active":"2024-03-09T14:26:36.671204+0000","last_became_peered":"2024-03-09T14:26:36.671204+0000","last_unstale":"2024-03-09T15:11:37.372073+0000","last_undegraded":"2024-03-09T15:11:37.372073+0000","last_fullsized":"2024-03-09T15:11:37.372073+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":2400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:54:22.325503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6722,"num_read_kb":6726,"num_write":4987,"num_write_kb":1828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'374","reported_seq":1941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.098113+0000","last_change":"2024-03-09T14:26:28.648968+0000","last_active":"2024-03-09T15:11:01.098113+0000","last_peered":"2024-03-09T15:11:01.098113+0000","last_clean":"2024-03-09T15:11:01.098113+0000","last_became_active":"2024-03-09T14:26:28.648620+0000","last_became_peered":"2024-03-09T14:26:28.648620+0000","last_unstale":"2024-03-09T15:11:01.098113+0000","last_undegraded":"2024-03-09T15:11:01.098113+0000","last_fullsized":"2024-03-09T15:11:01.098113+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:45:55.545173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2195,"num_write":437,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'209","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.383080+0000","last_change":"2024-03-09T14:26:26.653520+0000","last_active":"2024-03-09T15:11:26.383080+0000","last_peered":"2024-03-09T15:11:26.383080+0000","last_clean":"2024-03-09T15:11:26.383080+0000","last_became_active":"2024-03-09T14:26:26.653181+0000","last_became_peered":"2024-03-09T14:26:26.653181+0000","last_unstale":"2024-03-09T15:11:26.383080+0000","last_undegraded":"2024-03-09T15:11:26.383080+0000","last_fullsized":"2024-03-09T15:11:26.383080+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:52.372652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15751382,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1034,"num_read_kb":176274,"num_write":1127,"num_write_kb":52674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.569270+0000","last_change":"2024-03-09T14:26:30.646000+0000","last_active":"2024-03-09T15:09:16.569270+0000","last_peered":"2024-03-09T15:09:16.569270+0000","last_clean":"2024-03-09T15:09:16.569270+0000","last_became_active":"2024-03-09T14:26:30.645656+0000","last_became_peered":"2024-03-09T14:26:30.645656+0000","last_unstale":"2024-03-09T15:09:16.569270+0000","last_undegraded":"2024-03-09T15:09:16.569270+0000","last_fullsized":"2024-03-09T15:09:16.569270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:24:40.309796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'168","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.021145+0000","last_change":"2024-03-09T14:26:32.657586+0000","last_active":"2024-03-09T15:11:37.021145+0000","last_peered":"2024-03-09T15:11:37.021145+0000","last_clean":"2024-03-09T15:11:37.021145+0000","last_became_active":"2024-03-09T14:26:32.657144+0000","last_became_peered":"2024-03-09T14:26:32.657144+0000","last_unstale":"2024-03-09T15:11:37.021145+0000","last_undegraded":"2024-03-09T15:11:37.021145+0000","last_fullsized":"2024-03-09T15:11:37.021145+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:12:23.509222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13623,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":200,"num_read_kb":247,"num_write":114,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'540","reported_seq":1934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.696160+0000","last_change":"2024-03-09T14:26:34.668104+0000","last_active":"2024-03-09T15:11:38.696160+0000","last_peered":"2024-03-09T15:11:38.696160+0000","last_clean":"2024-03-09T15:11:38.696160+0000","last_became_active":"2024-03-09T14:26:34.667795+0000","last_became_peered":"2024-03-09T14:26:34.667795+0000","last_unstale":"2024-03-09T15:11:38.696160+0000","last_undegraded":"2024-03-09T15:11:38.696160+0000","last_fullsized":"2024-03-09T15:11:38.696160+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:54.046352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'109","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:19.855122+0000","last_change":"2024-03-09T14:26:36.671949+0000","last_active":"2024-03-09T15:10:19.855122+0000","last_peered":"2024-03-09T15:10:19.855122+0000","last_clean":"2024-03-09T15:10:19.855122+0000","last_became_active":"2024-03-09T14:26:36.671635+0000","last_became_peered":"2024-03-09T14:26:36.671635+0000","last_unstale":"2024-03-09T15:10:19.855122+0000","last_undegraded":"2024-03-09T15:10:19.855122+0000","last_fullsized":"2024-03-09T15:10:19.855122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:02:06.007889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":89,"num_write":251,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'431","reported_seq":1949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.186291+0000","last_change":"2024-03-09T14:26:28.645748+0000","last_active":"2024-03-09T15:10:42.186291+0000","last_peered":"2024-03-09T15:10:42.186291+0000","last_clean":"2024-03-09T15:10:42.186291+0000","last_became_active":"2024-03-09T14:26:28.645215+0000","last_became_peered":"2024-03-09T14:26:28.645215+0000","last_unstale":"2024-03-09T15:10:42.186291+0000","last_undegraded":"2024-03-09T15:10:42.186291+0000","last_fullsized":"2024-03-09T15:10:42.186291+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:02:01.979402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2276,"num_read_kb":2131,"num_write":518,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'206","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:31.434109+0000","last_change":"2024-03-09T14:26:26.640453+0000","last_active":"2024-03-09T15:10:31.434109+0000","last_peered":"2024-03-09T15:10:31.434109+0000","last_clean":"2024-03-09T15:10:31.434109+0000","last_became_active":"2024-03-09T14:26:26.639784+0000","last_became_peered":"2024-03-09T14:26:26.639784+0000","last_unstale":"2024-03-09T15:10:31.434109+0000","last_undegraded":"2024-03-09T15:10:31.434109+0000","last_fullsized":"2024-03-09T15:10:31.434109+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:31.481843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8443050,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":713,"num_read_kb":41891,"num_write":1157,"num_write_kb":44648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.559614+0000","last_change":"2024-03-09T14:26:30.653007+0000","last_active":"2024-03-09T15:07:51.559614+0000","last_peered":"2024-03-09T15:07:51.559614+0000","last_clean":"2024-03-09T15:07:51.559614+0000","last_became_active":"2024-03-09T14:26:30.652726+0000","last_became_peered":"2024-03-09T14:26:30.652726+0000","last_unstale":"2024-03-09T15:07:51.559614+0000","last_undegraded":"2024-03-09T15:07:51.559614+0000","last_fullsized":"2024-03-09T15:07:51.559614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:39.318802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'175","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.654007+0000","last_change":"2024-03-09T14:26:32.653345+0000","last_active":"2024-03-09T15:11:38.654007+0000","last_peered":"2024-03-09T15:11:38.654007+0000","last_clean":"2024-03-09T15:11:38.654007+0000","last_became_active":"2024-03-09T14:26:32.653026+0000","last_became_peered":"2024-03-09T14:26:32.653026+0000","last_unstale":"2024-03-09T15:11:38.654007+0000","last_undegraded":"2024-03-09T15:11:38.654007+0000","last_fullsized":"2024-03-09T15:11:38.654007+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:27:09.685607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12290,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":235,"num_read_kb":289,"num_write":106,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.559028+0000","last_change":"2024-03-09T14:26:34.673997+0000","last_active":"2024-03-09T15:07:46.559028+0000","last_peered":"2024-03-09T15:07:46.559028+0000","last_clean":"2024-03-09T15:07:46.559028+0000","last_became_active":"2024-03-09T14:26:34.673715+0000","last_became_peered":"2024-03-09T14:26:34.673715+0000","last_unstale":"2024-03-09T15:07:46.559028+0000","last_undegraded":"2024-03-09T15:07:46.559028+0000","last_fullsized":"2024-03-09T15:07:46.559028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:42:47.462483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'121","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:49.854347+0000","last_change":"2024-03-09T14:26:36.673170+0000","last_active":"2024-03-09T15:10:49.854347+0000","last_peered":"2024-03-09T15:10:49.854347+0000","last_clean":"2024-03-09T15:10:49.854347+0000","last_became_active":"2024-03-09T14:26:36.672843+0000","last_became_peered":"2024-03-09T14:26:36.672843+0000","last_unstale":"2024-03-09T15:10:49.854347+0000","last_undegraded":"2024-03-09T15:10:49.854347+0000","last_fullsized":"2024-03-09T15:10:49.854347+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:17:11.123320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":286,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'745","reported_seq":2333,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.200285+0000","last_change":"2024-03-09T14:26:28.657382+0000","last_active":"2024-03-09T15:11:09.200285+0000","last_peered":"2024-03-09T15:11:09.200285+0000","last_clean":"2024-03-09T15:11:09.200285+0000","last_became_active":"2024-03-09T14:26:28.656983+0000","last_became_peered":"2024-03-09T14:26:28.656983+0000","last_unstale":"2024-03-09T15:11:09.200285+0000","last_undegraded":"2024-03-09T15:11:09.200285+0000","last_fullsized":"2024-03-09T15:11:09.200285+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:26.645538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3462,"num_read_kb":3140,"num_write":976,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'175","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.745805+0000","last_change":"2024-03-09T14:27:03.724793+0000","last_active":"2024-03-09T15:11:07.745805+0000","last_peered":"2024-03-09T15:11:07.745805+0000","last_clean":"2024-03-09T15:11:07.745805+0000","last_became_active":"2024-03-09T14:27:03.724370+0000","last_became_peered":"2024-03-09T14:27:03.724370+0000","last_unstale":"2024-03-09T15:11:07.745805+0000","last_undegraded":"2024-03-09T15:11:07.745805+0000","last_fullsized":"2024-03-09T15:11:07.745805+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:39:53.570919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8270984,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":386,"num_read_kb":32223,"num_write":1029,"num_write_kb":26912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.569303+0000","last_change":"2024-03-09T14:26:30.653536+0000","last_active":"2024-03-09T15:09:16.569303+0000","last_peered":"2024-03-09T15:09:16.569303+0000","last_clean":"2024-03-09T15:09:16.569303+0000","last_became_active":"2024-03-09T14:26:30.653184+0000","last_became_peered":"2024-03-09T14:26:30.653184+0000","last_unstale":"2024-03-09T15:09:16.569303+0000","last_undegraded":"2024-03-09T15:09:16.569303+0000","last_fullsized":"2024-03-09T15:09:16.569303+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:52:00.683557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'154","reported_seq":724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.494515+0000","last_change":"2024-03-09T14:26:32.653203+0000","last_active":"2024-03-09T15:11:36.494515+0000","last_peered":"2024-03-09T15:11:36.494515+0000","last_clean":"2024-03-09T15:11:36.494515+0000","last_became_active":"2024-03-09T14:26:32.652956+0000","last_became_peered":"2024-03-09T14:26:32.652956+0000","last_unstale":"2024-03-09T15:11:36.494515+0000","last_undegraded":"2024-03-09T15:11:36.494515+0000","last_fullsized":"2024-03-09T15:11:36.494515+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:40.426986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18074,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":220,"num_read_kb":285,"num_write":176,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.567970+0000","last_change":"2024-03-09T14:26:34.675619+0000","last_active":"2024-03-09T15:07:16.567970+0000","last_peered":"2024-03-09T15:07:16.567970+0000","last_clean":"2024-03-09T15:07:16.567970+0000","last_became_active":"2024-03-09T14:26:34.675354+0000","last_became_peered":"2024-03-09T14:26:34.675354+0000","last_unstale":"2024-03-09T15:07:16.567970+0000","last_undegraded":"2024-03-09T15:07:16.567970+0000","last_fullsized":"2024-03-09T15:07:16.567970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:12:54.378319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'144","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:08.302012+0000","last_change":"2024-03-09T14:26:36.672548+0000","last_active":"2024-03-09T15:11:08.302012+0000","last_peered":"2024-03-09T15:11:08.302012+0000","last_clean":"2024-03-09T15:11:08.302012+0000","last_became_active":"2024-03-09T14:26:36.672111+0000","last_became_peered":"2024-03-09T14:26:36.672111+0000","last_unstale":"2024-03-09T15:11:08.302012+0000","last_undegraded":"2024-03-09T15:11:08.302012+0000","last_fullsized":"2024-03-09T15:11:08.302012+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:18:51.718050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":110,"num_write":237,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'510","reported_seq":1980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:31.567905+0000","last_change":"2024-03-09T14:26:28.651133+0000","last_active":"2024-03-09T15:10:31.567905+0000","last_peered":"2024-03-09T15:10:31.567905+0000","last_clean":"2024-03-09T15:10:31.567905+0000","last_became_active":"2024-03-09T14:26:28.650560+0000","last_became_peered":"2024-03-09T14:26:28.650560+0000","last_unstale":"2024-03-09T15:10:31.567905+0000","last_undegraded":"2024-03-09T15:10:31.567905+0000","last_fullsized":"2024-03-09T15:10:31.567905+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:59:27.981231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2567,"num_read_kb":2395,"num_write":702,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'169","reported_seq":749,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:25.559961+0000","last_change":"2024-03-09T14:26:26.644672+0000","last_active":"2024-03-09T15:10:25.559961+0000","last_peered":"2024-03-09T15:10:25.559961+0000","last_clean":"2024-03-09T15:10:25.559961+0000","last_became_active":"2024-03-09T14:26:26.644347+0000","last_became_peered":"2024-03-09T14:26:26.644347+0000","last_unstale":"2024-03-09T15:10:25.559961+0000","last_undegraded":"2024-03-09T15:10:25.559961+0000","last_fullsized":"2024-03-09T15:10:25.559961+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:38.187729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4479180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":341,"num_read_kb":3953,"num_write":940,"num_write_kb":27527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.573925+0000","last_change":"2024-03-09T14:26:30.654838+0000","last_active":"2024-03-09T15:09:16.573925+0000","last_peered":"2024-03-09T15:09:16.573925+0000","last_clean":"2024-03-09T15:09:16.573925+0000","last_became_active":"2024-03-09T14:26:30.654575+0000","last_became_peered":"2024-03-09T14:26:30.654575+0000","last_unstale":"2024-03-09T15:09:16.573925+0000","last_undegraded":"2024-03-09T15:09:16.573925+0000","last_fullsized":"2024-03-09T15:09:16.573925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:39.725009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'141","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:31.570934+0000","last_change":"2024-03-09T14:26:32.660279+0000","last_active":"2024-03-09T15:09:31.570934+0000","last_peered":"2024-03-09T15:09:31.570934+0000","last_clean":"2024-03-09T15:09:31.570934+0000","last_became_active":"2024-03-09T14:26:32.659984+0000","last_became_peered":"2024-03-09T14:26:32.659984+0000","last_unstale":"2024-03-09T15:09:31.570934+0000","last_undegraded":"2024-03-09T15:09:31.570934+0000","last_fullsized":"2024-03-09T15:09:31.570934+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:08.563248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15183,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":196,"num_read_kb":257,"num_write":108,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'502","reported_seq":2219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.693554+0000","last_change":"2024-03-09T14:26:34.673343+0000","last_active":"2024-03-09T15:11:38.693554+0000","last_peered":"2024-03-09T15:11:38.693554+0000","last_clean":"2024-03-09T15:11:38.693554+0000","last_became_active":"2024-03-09T14:26:34.673054+0000","last_became_peered":"2024-03-09T14:26:34.673054+0000","last_unstale":"2024-03-09T15:11:38.693554+0000","last_undegraded":"2024-03-09T15:11:38.693554+0000","last_fullsized":"2024-03-09T15:11:38.693554+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:53.004843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'97","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.765724+0000","last_change":"2024-03-09T14:26:36.668508+0000","last_active":"2024-03-09T15:10:35.765724+0000","last_peered":"2024-03-09T15:10:35.765724+0000","last_clean":"2024-03-09T15:10:35.765724+0000","last_became_active":"2024-03-09T14:26:36.668217+0000","last_became_peered":"2024-03-09T14:26:36.668217+0000","last_unstale":"2024-03-09T15:10:35.765724+0000","last_undegraded":"2024-03-09T15:10:35.765724+0000","last_fullsized":"2024-03-09T15:10:35.765724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:12:50.274345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":82,"num_write":217,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'678","reported_seq":2377,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.078332+0000","last_change":"2024-03-09T14:26:28.648677+0000","last_active":"2024-03-09T15:10:51.078332+0000","last_peered":"2024-03-09T15:10:51.078332+0000","last_clean":"2024-03-09T15:10:51.078332+0000","last_became_active":"2024-03-09T14:26:28.648408+0000","last_became_peered":"2024-03-09T14:26:28.648408+0000","last_unstale":"2024-03-09T15:10:51.078332+0000","last_undegraded":"2024-03-09T15:10:51.078332+0000","last_fullsized":"2024-03-09T15:10:51.078332+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:36:20.272704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3385,"num_read_kb":3042,"num_write":948,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'218","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.586731+0000","last_change":"2024-03-09T14:26:26.643846+0000","last_active":"2024-03-09T15:07:36.586731+0000","last_peered":"2024-03-09T15:07:36.586731+0000","last_clean":"2024-03-09T15:07:36.586731+0000","last_became_active":"2024-03-09T14:26:26.643522+0000","last_became_peered":"2024-03-09T14:26:26.643522+0000","last_unstale":"2024-03-09T15:07:36.586731+0000","last_undegraded":"2024-03-09T15:07:36.586731+0000","last_fullsized":"2024-03-09T15:07:36.586731+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:35.944430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14178549,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":448,"num_read_kb":51521,"num_write":1231,"num_write_kb":50999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.418039+0000","last_change":"2024-03-09T14:26:30.652855+0000","last_active":"2024-03-09T15:11:38.418039+0000","last_peered":"2024-03-09T15:11:38.418039+0000","last_clean":"2024-03-09T15:11:38.418039+0000","last_became_active":"2024-03-09T14:26:30.652594+0000","last_became_peered":"2024-03-09T14:26:30.652594+0000","last_unstale":"2024-03-09T15:11:38.418039+0000","last_undegraded":"2024-03-09T15:11:38.418039+0000","last_fullsized":"2024-03-09T15:11:38.418039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:25.009722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":626,"num_read_kb":626,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'78","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.685232+0000","last_change":"2024-03-09T14:26:32.868538+0000","last_active":"2024-03-09T15:09:21.685232+0000","last_peered":"2024-03-09T15:09:21.685232+0000","last_clean":"2024-03-09T15:09:21.685232+0000","last_became_active":"2024-03-09T14:26:32.868147+0000","last_became_peered":"2024-03-09T14:26:32.868147+0000","last_unstale":"2024-03-09T15:09:21.685232+0000","last_undegraded":"2024-03-09T15:09:21.685232+0000","last_fullsized":"2024-03-09T15:09:21.685232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:01:35.357782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'531","reported_seq":2283,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.690271+0000","last_change":"2024-03-09T14:26:34.670121+0000","last_active":"2024-03-09T15:11:38.690271+0000","last_peered":"2024-03-09T15:11:38.690271+0000","last_clean":"2024-03-09T15:11:38.690271+0000","last_became_active":"2024-03-09T14:26:34.669695+0000","last_became_peered":"2024-03-09T14:26:34.669695+0000","last_unstale":"2024-03-09T15:11:38.690271+0000","last_undegraded":"2024-03-09T15:11:38.690271+0000","last_fullsized":"2024-03-09T15:11:38.690271+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:34:05.625218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'142","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:52.263284+0000","last_change":"2024-03-09T14:26:36.668658+0000","last_active":"2024-03-09T15:09:52.263284+0000","last_peered":"2024-03-09T15:09:52.263284+0000","last_clean":"2024-03-09T15:09:52.263284+0000","last_became_active":"2024-03-09T14:26:36.668361+0000","last_became_peered":"2024-03-09T14:26:36.668361+0000","last_unstale":"2024-03-09T15:09:52.263284+0000","last_undegraded":"2024-03-09T15:09:52.263284+0000","last_fullsized":"2024-03-09T15:09:52.263284+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:40.438535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":387,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":346,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'485","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.448831+0000","last_change":"2024-03-09T14:26:28.654782+0000","last_active":"2024-03-09T15:11:04.448831+0000","last_peered":"2024-03-09T15:11:04.448831+0000","last_clean":"2024-03-09T15:11:04.448831+0000","last_became_active":"2024-03-09T14:26:28.654325+0000","last_became_peered":"2024-03-09T14:26:28.654325+0000","last_unstale":"2024-03-09T15:11:04.448831+0000","last_undegraded":"2024-03-09T15:11:04.448831+0000","last_fullsized":"2024-03-09T15:11:04.448831+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:42.930737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2761,"num_read_kb":2604,"num_write":649,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'182","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.482602+0000","last_change":"2024-03-09T14:26:26.652669+0000","last_active":"2024-03-09T15:07:45.482602+0000","last_peered":"2024-03-09T15:07:45.482602+0000","last_clean":"2024-03-09T15:07:45.482602+0000","last_became_active":"2024-03-09T14:26:26.652273+0000","last_became_peered":"2024-03-09T14:26:26.652273+0000","last_unstale":"2024-03-09T15:07:45.482602+0000","last_undegraded":"2024-03-09T15:07:45.482602+0000","last_fullsized":"2024-03-09T15:07:45.482602+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:08:00.596097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9022863,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":356,"num_read_kb":15479,"num_write":992,"num_write_kb":26748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.600254+0000","last_change":"2024-03-09T14:26:30.652256+0000","last_active":"2024-03-09T15:09:16.600254+0000","last_peered":"2024-03-09T15:09:16.600254+0000","last_clean":"2024-03-09T15:09:16.600254+0000","last_became_active":"2024-03-09T14:26:30.651949+0000","last_became_peered":"2024-03-09T14:26:30.651949+0000","last_unstale":"2024-03-09T15:09:16.600254+0000","last_undegraded":"2024-03-09T15:09:16.600254+0000","last_fullsized":"2024-03-09T15:09:16.600254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:35.514543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'184","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.604763+0000","last_change":"2024-03-09T14:26:32.658049+0000","last_active":"2024-03-09T15:11:36.604763+0000","last_peered":"2024-03-09T15:11:36.604763+0000","last_clean":"2024-03-09T15:11:36.604763+0000","last_became_active":"2024-03-09T14:26:32.656959+0000","last_became_peered":"2024-03-09T14:26:32.656959+0000","last_unstale":"2024-03-09T15:11:36.604763+0000","last_undegraded":"2024-03-09T15:11:36.604763+0000","last_fullsized":"2024-03-09T15:11:36.604763+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:00:25.716853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12977,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":255,"num_read_kb":308,"num_write":148,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.600784+0000","last_change":"2024-03-09T14:26:34.675814+0000","last_active":"2024-03-09T15:09:21.600784+0000","last_peered":"2024-03-09T15:09:21.600784+0000","last_clean":"2024-03-09T15:09:21.600784+0000","last_became_active":"2024-03-09T14:26:34.675350+0000","last_became_peered":"2024-03-09T14:26:34.675350+0000","last_unstale":"2024-03-09T15:09:21.600784+0000","last_undegraded":"2024-03-09T15:09:21.600784+0000","last_fullsized":"2024-03-09T15:09:21.600784+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:43.105375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'122","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:31.932959+0000","last_change":"2024-03-09T14:26:36.673342+0000","last_active":"2024-03-09T15:10:31.932959+0000","last_peered":"2024-03-09T15:10:31.932959+0000","last_clean":"2024-03-09T15:10:31.932959+0000","last_became_active":"2024-03-09T14:26:36.673059+0000","last_became_peered":"2024-03-09T14:26:36.673059+0000","last_unstale":"2024-03-09T15:10:31.932959+0000","last_undegraded":"2024-03-09T15:10:31.932959+0000","last_fullsized":"2024-03-09T15:10:31.932959+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:24:05.127996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":194,"num_write":274,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'855","reported_seq":2474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.169290+0000","last_change":"2024-03-09T14:26:28.653445+0000","last_active":"2024-03-09T15:11:09.169290+0000","last_peered":"2024-03-09T15:11:09.169290+0000","last_clean":"2024-03-09T15:11:09.169290+0000","last_became_active":"2024-03-09T14:26:28.653261+0000","last_became_peered":"2024-03-09T14:26:28.653261+0000","last_unstale":"2024-03-09T15:11:09.169290+0000","last_undegraded":"2024-03-09T15:11:09.169290+0000","last_fullsized":"2024-03-09T15:11:09.169290+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:52:30.405371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3846,"num_read_kb":3440,"num_write":1147,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.713861+0000","last_change":"2024-03-09T14:26:13.798768+0000","last_active":"2024-03-09T15:08:21.713861+0000","last_peered":"2024-03-09T15:08:21.713861+0000","last_clean":"2024-03-09T15:08:21.713861+0000","last_became_active":"2024-03-09T14:26:13.797817+0000","last_became_peered":"2024-03-09T14:26:13.797817+0000","last_unstale":"2024-03-09T15:08:21.713861+0000","last_undegraded":"2024-03-09T15:08:21.713861+0000","last_fullsized":"2024-03-09T15:08:21.713861+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_clean_scrub_stamp":"2024-03-09T14:26:12.541311+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:56:57.729803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.575317+0000","last_change":"2024-03-09T14:26:18.581955+0000","last_active":"2024-03-09T15:08:01.575317+0000","last_peered":"2024-03-09T15:08:01.575317+0000","last_clean":"2024-03-09T15:08:01.575317+0000","last_became_active":"2024-03-09T14:26:18.581598+0000","last_became_peered":"2024-03-09T14:26:18.581598+0000","last_unstale":"2024-03-09T15:08:01.575317+0000","last_undegraded":"2024-03-09T15:08:01.575317+0000","last_fullsized":"2024-03-09T15:08:01.575317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:38:36.176997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'175","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:52.845578+0000","last_change":"2024-03-09T14:26:26.645174+0000","last_active":"2024-03-09T15:09:52.845578+0000","last_peered":"2024-03-09T15:09:52.845578+0000","last_clean":"2024-03-09T15:09:52.845578+0000","last_became_active":"2024-03-09T14:26:26.644848+0000","last_became_peered":"2024-03-09T14:26:26.644848+0000","last_unstale":"2024-03-09T15:09:52.845578+0000","last_undegraded":"2024-03-09T15:09:52.845578+0000","last_fullsized":"2024-03-09T15:09:52.845578+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:09:13.899449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17619055,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":337,"num_read_kb":37512,"num_write":1000,"num_write_kb":40555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.712568+0000","last_change":"2024-03-09T14:26:30.650647+0000","last_active":"2024-03-09T15:08:11.712568+0000","last_peered":"2024-03-09T15:08:11.712568+0000","last_clean":"2024-03-09T15:08:11.712568+0000","last_became_active":"2024-03-09T14:26:30.650376+0000","last_became_peered":"2024-03-09T14:26:30.650376+0000","last_unstale":"2024-03-09T15:08:11.712568+0000","last_undegraded":"2024-03-09T15:08:11.712568+0000","last_fullsized":"2024-03-09T15:08:11.712568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:35.280770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'290","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.672714+0000","last_change":"2024-03-09T14:26:32.658070+0000","last_active":"2024-03-09T15:11:38.672714+0000","last_peered":"2024-03-09T15:11:38.672714+0000","last_clean":"2024-03-09T15:11:38.672714+0000","last_became_active":"2024-03-09T14:26:32.657752+0000","last_became_peered":"2024-03-09T14:26:32.657752+0000","last_unstale":"2024-03-09T15:11:38.672714+0000","last_undegraded":"2024-03-09T15:11:38.672714+0000","last_fullsized":"2024-03-09T15:11:38.672714+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:31.136392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38712,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":719,"num_write":470,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.571341+0000","last_change":"2024-03-09T14:26:34.671261+0000","last_active":"2024-03-09T15:07:46.571341+0000","last_peered":"2024-03-09T15:07:46.571341+0000","last_clean":"2024-03-09T15:07:46.571341+0000","last_became_active":"2024-03-09T14:26:34.670987+0000","last_became_peered":"2024-03-09T14:26:34.670987+0000","last_unstale":"2024-03-09T15:07:46.571341+0000","last_undegraded":"2024-03-09T15:07:46.571341+0000","last_fullsized":"2024-03-09T15:07:46.571341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:48.297381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'204","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:26.958614+0000","last_change":"2024-03-09T14:26:36.672227+0000","last_active":"2024-03-09T15:10:26.958614+0000","last_peered":"2024-03-09T15:10:26.958614+0000","last_clean":"2024-03-09T15:10:26.958614+0000","last_became_active":"2024-03-09T14:26:36.671941+0000","last_became_peered":"2024-03-09T14:26:36.671941+0000","last_unstale":"2024-03-09T15:10:26.958614+0000","last_undegraded":"2024-03-09T15:10:26.958614+0000","last_fullsized":"2024-03-09T15:10:26.958614+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:49:17.903765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":432,"num_read_kb":416,"num_write":433,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'391","reported_seq":1981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:49.432074+0000","last_change":"2024-03-09T14:26:28.652892+0000","last_active":"2024-03-09T15:10:49.432074+0000","last_peered":"2024-03-09T15:10:49.432074+0000","last_clean":"2024-03-09T15:10:49.432074+0000","last_became_active":"2024-03-09T14:26:28.652611+0000","last_became_peered":"2024-03-09T14:26:28.652611+0000","last_unstale":"2024-03-09T15:10:49.432074+0000","last_undegraded":"2024-03-09T15:10:49.432074+0000","last_fullsized":"2024-03-09T15:10:49.432074+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:02:24.839775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2259,"num_read_kb":2164,"num_write":448,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.714524+0000","last_change":"2024-03-09T14:26:18.582346+0000","last_active":"2024-03-09T15:08:26.714524+0000","last_peered":"2024-03-09T15:08:26.714524+0000","last_clean":"2024-03-09T15:08:26.714524+0000","last_became_active":"2024-03-09T14:26:18.581306+0000","last_became_peered":"2024-03-09T14:26:18.581306+0000","last_unstale":"2024-03-09T15:08:26.714524+0000","last_undegraded":"2024-03-09T15:08:26.714524+0000","last_fullsized":"2024-03-09T15:08:26.714524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:30.980957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'135","reported_seq":734,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.573626+0000","last_change":"2024-03-09T14:26:26.632618+0000","last_active":"2024-03-09T15:08:06.573626+0000","last_peered":"2024-03-09T15:08:06.573626+0000","last_clean":"2024-03-09T15:08:06.573626+0000","last_became_active":"2024-03-09T14:26:26.632272+0000","last_became_peered":"2024-03-09T14:26:26.632272+0000","last_unstale":"2024-03-09T15:08:06.573626+0000","last_undegraded":"2024-03-09T15:08:06.573626+0000","last_fullsized":"2024-03-09T15:08:06.573626+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:03.965638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194333,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":281,"num_read_kb":61756,"num_write":786,"num_write_kb":21716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.573097+0000","last_change":"2024-03-09T14:26:30.655248+0000","last_active":"2024-03-09T15:07:41.573097+0000","last_peered":"2024-03-09T15:07:41.573097+0000","last_clean":"2024-03-09T15:07:41.573097+0000","last_became_active":"2024-03-09T14:26:30.654922+0000","last_became_peered":"2024-03-09T14:26:30.654922+0000","last_unstale":"2024-03-09T15:07:41.573097+0000","last_undegraded":"2024-03-09T15:07:41.573097+0000","last_fullsized":"2024-03-09T15:07:41.573097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:41:46.097520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'681","reported_seq":2057,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.701069+0000","last_change":"2024-03-09T14:26:32.655775+0000","last_active":"2024-03-09T15:11:38.701069+0000","last_peered":"2024-03-09T15:11:38.701069+0000","last_clean":"2024-03-09T15:11:38.701069+0000","last_became_active":"2024-03-09T14:26:32.655430+0000","last_became_peered":"2024-03-09T14:26:32.655430+0000","last_unstale":"2024-03-09T15:11:38.701069+0000","last_undegraded":"2024-03-09T15:11:38.701069+0000","last_fullsized":"2024-03-09T15:11:38.701069+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":600,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:38:38.807873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21406,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":898,"num_read_kb":1030,"num_write":284,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.713974+0000","last_change":"2024-03-09T14:26:34.678707+0000","last_active":"2024-03-09T15:08:21.713974+0000","last_peered":"2024-03-09T15:08:21.713974+0000","last_clean":"2024-03-09T15:08:21.713974+0000","last_became_active":"2024-03-09T14:26:34.678431+0000","last_became_peered":"2024-03-09T14:26:34.678431+0000","last_unstale":"2024-03-09T15:08:21.713974+0000","last_undegraded":"2024-03-09T15:08:21.713974+0000","last_fullsized":"2024-03-09T15:08:21.713974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:25.952912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'162","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:19.730383+0000","last_change":"2024-03-09T14:26:36.785121+0000","last_active":"2024-03-09T15:11:19.730383+0000","last_peered":"2024-03-09T15:11:19.730383+0000","last_clean":"2024-03-09T15:11:19.730383+0000","last_became_active":"2024-03-09T14:26:36.784815+0000","last_became_peered":"2024-03-09T14:26:36.784815+0000","last_unstale":"2024-03-09T15:11:19.730383+0000","last_undegraded":"2024-03-09T15:11:19.730383+0000","last_fullsized":"2024-03-09T15:11:19.730383+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:32:28.804163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":213,"num_read_kb":212,"num_write":359,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'794","reported_seq":2457,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.129970+0000","last_change":"2024-03-09T14:26:28.650746+0000","last_active":"2024-03-09T15:11:37.129970+0000","last_peered":"2024-03-09T15:11:37.129970+0000","last_clean":"2024-03-09T15:11:37.129970+0000","last_became_active":"2024-03-09T14:26:28.650409+0000","last_became_peered":"2024-03-09T14:26:28.650409+0000","last_unstale":"2024-03-09T15:11:37.129970+0000","last_undegraded":"2024-03-09T15:11:37.129970+0000","last_fullsized":"2024-03-09T15:11:37.129970+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:56:59.410066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3830,"num_read_kb":3466,"num_write":1049,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.560159+0000","last_change":"2024-03-09T14:26:18.577541+0000","last_active":"2024-03-09T15:07:56.560159+0000","last_peered":"2024-03-09T15:07:56.560159+0000","last_clean":"2024-03-09T15:07:56.560159+0000","last_became_active":"2024-03-09T14:26:18.577041+0000","last_became_peered":"2024-03-09T14:26:18.577041+0000","last_unstale":"2024-03-09T15:07:56.560159+0000","last_undegraded":"2024-03-09T15:07:56.560159+0000","last_fullsized":"2024-03-09T15:07:56.560159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:35.300799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'173","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.569025+0000","last_change":"2024-03-09T14:26:26.636212+0000","last_active":"2024-03-09T15:08:31.569025+0000","last_peered":"2024-03-09T15:08:31.569025+0000","last_clean":"2024-03-09T15:08:31.569025+0000","last_became_active":"2024-03-09T14:26:26.635771+0000","last_became_peered":"2024-03-09T14:26:26.635771+0000","last_unstale":"2024-03-09T15:08:31.569025+0000","last_undegraded":"2024-03-09T15:08:31.569025+0000","last_fullsized":"2024-03-09T15:08:31.569025+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:05.752386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6276296,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":354,"num_read_kb":5368,"num_write":1011,"num_write_kb":33352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"35'5","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.407443+0000","last_change":"2024-03-09T14:26:30.651034+0000","last_active":"2024-03-09T15:11:38.407443+0000","last_peered":"2024-03-09T15:11:38.407443+0000","last_clean":"2024-03-09T15:11:38.407443+0000","last_became_active":"2024-03-09T14:26:30.650766+0000","last_became_peered":"2024-03-09T14:26:30.650766+0000","last_unstale":"2024-03-09T15:11:38.407443+0000","last_undegraded":"2024-03-09T15:11:38.407443+0000","last_fullsized":"2024-03-09T15:11:38.407443+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:00.425079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1149,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":782,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'246","reported_seq":1320,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.821315+0000","last_change":"2024-03-09T14:26:32.869468+0000","last_active":"2024-03-09T15:11:38.821315+0000","last_peered":"2024-03-09T15:11:38.821315+0000","last_clean":"2024-03-09T15:11:38.821315+0000","last_became_active":"2024-03-09T14:26:32.868092+0000","last_became_peered":"2024-03-09T14:26:32.868092+0000","last_unstale":"2024-03-09T15:11:38.821315+0000","last_undegraded":"2024-03-09T15:11:38.821315+0000","last_fullsized":"2024-03-09T15:11:38.821315+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:31:58.327354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":188,"num_read_kb":180,"num_write":173,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:16.574728+0000","last_change":"2024-03-09T14:26:34.666767+0000","last_active":"2024-03-09T15:08:16.574728+0000","last_peered":"2024-03-09T15:08:16.574728+0000","last_clean":"2024-03-09T15:08:16.574728+0000","last_became_active":"2024-03-09T14:26:34.666484+0000","last_became_peered":"2024-03-09T14:26:34.666484+0000","last_unstale":"2024-03-09T15:08:16.574728+0000","last_undegraded":"2024-03-09T15:08:16.574728+0000","last_fullsized":"2024-03-09T15:08:16.574728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:42:45.793755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'255","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:03.057657+0000","last_change":"2024-03-09T14:26:36.674946+0000","last_active":"2024-03-09T15:10:03.057657+0000","last_peered":"2024-03-09T15:10:03.057657+0000","last_clean":"2024-03-09T15:10:03.057657+0000","last_became_active":"2024-03-09T14:26:36.674637+0000","last_became_peered":"2024-03-09T14:26:36.674637+0000","last_unstale":"2024-03-09T15:10:03.057657+0000","last_undegraded":"2024-03-09T15:10:03.057657+0000","last_fullsized":"2024-03-09T15:10:03.057657+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:25.308980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":491,"num_write":562,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'351","reported_seq":1818,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.871971+0000","last_change":"2024-03-09T14:26:28.646960+0000","last_active":"2024-03-09T15:11:07.871971+0000","last_peered":"2024-03-09T15:11:07.871971+0000","last_clean":"2024-03-09T15:11:07.871971+0000","last_became_active":"2024-03-09T14:26:28.646594+0000","last_became_peered":"2024-03-09T14:26:28.646594+0000","last_unstale":"2024-03-09T15:11:07.871971+0000","last_undegraded":"2024-03-09T15:11:07.871971+0000","last_fullsized":"2024-03-09T15:11:07.871971+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:27:04.392681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1989,"num_read_kb":1907,"num_write":411,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.575282+0000","last_change":"2024-03-09T14:26:18.581769+0000","last_active":"2024-03-09T15:08:01.575282+0000","last_peered":"2024-03-09T15:08:01.575282+0000","last_clean":"2024-03-09T15:08:01.575282+0000","last_became_active":"2024-03-09T14:26:18.581330+0000","last_became_peered":"2024-03-09T14:26:18.581330+0000","last_unstale":"2024-03-09T15:08:01.575282+0000","last_undegraded":"2024-03-09T15:08:01.575282+0000","last_fullsized":"2024-03-09T15:08:01.575282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:58.260466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'262","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:08.456038+0000","last_change":"2024-03-09T14:27:03.720094+0000","last_active":"2024-03-09T15:09:08.456038+0000","last_peered":"2024-03-09T15:09:08.456038+0000","last_clean":"2024-03-09T15:09:08.456038+0000","last_became_active":"2024-03-09T14:27:03.719517+0000","last_became_peered":"2024-03-09T14:27:03.719517+0000","last_unstale":"2024-03-09T15:09:08.456038+0000","last_undegraded":"2024-03-09T15:09:08.456038+0000","last_fullsized":"2024-03-09T15:09:08.456038+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:29:42.092045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8390664,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1104,"num_read_kb":25709,"num_write":1304,"num_write_kb":24224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.575225+0000","last_change":"2024-03-09T14:26:30.646463+0000","last_active":"2024-03-09T15:08:21.575225+0000","last_peered":"2024-03-09T15:08:21.575225+0000","last_clean":"2024-03-09T15:08:21.575225+0000","last_became_active":"2024-03-09T14:26:30.646190+0000","last_became_peered":"2024-03-09T14:26:30.646190+0000","last_unstale":"2024-03-09T15:08:21.575225+0000","last_undegraded":"2024-03-09T15:08:21.575225+0000","last_fullsized":"2024-03-09T15:08:21.575225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:39:12.950657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'108","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:43.733396+0000","last_change":"2024-03-09T14:26:32.650252+0000","last_active":"2024-03-09T15:08:43.733396+0000","last_peered":"2024-03-09T15:08:43.733396+0000","last_clean":"2024-03-09T15:08:43.733396+0000","last_became_active":"2024-03-09T14:26:32.650020+0000","last_became_peered":"2024-03-09T14:26:32.650020+0000","last_unstale":"2024-03-09T15:08:43.733396+0000","last_undegraded":"2024-03-09T15:08:43.733396+0000","last_fullsized":"2024-03-09T15:08:43.733396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:18:23.773127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":130,"num_write":96,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588167+0000","last_change":"2024-03-09T14:26:34.667767+0000","last_active":"2024-03-09T15:07:46.588167+0000","last_peered":"2024-03-09T15:07:46.588167+0000","last_clean":"2024-03-09T15:07:46.588167+0000","last_became_active":"2024-03-09T14:26:34.667409+0000","last_became_peered":"2024-03-09T14:26:34.667409+0000","last_unstale":"2024-03-09T15:07:46.588167+0000","last_undegraded":"2024-03-09T15:07:46.588167+0000","last_fullsized":"2024-03-09T15:07:46.588167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:39:12.935329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'126","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.598323+0000","last_change":"2024-03-09T14:26:36.674661+0000","last_active":"2024-03-09T15:10:42.598323+0000","last_peered":"2024-03-09T15:10:42.598323+0000","last_clean":"2024-03-09T15:10:42.598323+0000","last_became_active":"2024-03-09T14:26:36.674343+0000","last_became_peered":"2024-03-09T14:26:36.674343+0000","last_unstale":"2024-03-09T15:10:42.598323+0000","last_undegraded":"2024-03-09T15:10:42.598323+0000","last_fullsized":"2024-03-09T15:10:42.598323+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:49.926126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":182,"num_write":308,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'425","reported_seq":2180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.316492+0000","last_change":"2024-03-09T14:26:28.656196+0000","last_active":"2024-03-09T15:10:45.316492+0000","last_peered":"2024-03-09T15:10:45.316492+0000","last_clean":"2024-03-09T15:10:45.316492+0000","last_became_active":"2024-03-09T14:26:28.655479+0000","last_became_peered":"2024-03-09T14:26:28.655479+0000","last_unstale":"2024-03-09T15:10:45.316492+0000","last_undegraded":"2024-03-09T15:10:45.316492+0000","last_fullsized":"2024-03-09T15:10:45.316492+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:41.351260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2618,"num_read_kb":2506,"num_write":497,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'269","reported_seq":1002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:52.126933+0000","last_change":"2024-03-09T14:26:26.650096+0000","last_active":"2024-03-09T15:09:52.126933+0000","last_peered":"2024-03-09T15:09:52.126933+0000","last_clean":"2024-03-09T15:09:52.126933+0000","last_became_active":"2024-03-09T14:26:26.649325+0000","last_became_peered":"2024-03-09T14:26:26.649325+0000","last_unstale":"2024-03-09T15:09:52.126933+0000","last_undegraded":"2024-03-09T15:09:52.126933+0000","last_fullsized":"2024-03-09T15:09:52.126933+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:00:26.744072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11172498,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":944,"num_read_kb":64620,"num_write":1392,"num_write_kb":23267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.565283+0000","last_change":"2024-03-09T14:26:18.579051+0000","last_active":"2024-03-09T15:08:01.565283+0000","last_peered":"2024-03-09T15:08:01.565283+0000","last_clean":"2024-03-09T15:08:01.565283+0000","last_became_active":"2024-03-09T14:26:18.578807+0000","last_became_peered":"2024-03-09T14:26:18.578807+0000","last_unstale":"2024-03-09T15:08:01.565283+0000","last_undegraded":"2024-03-09T15:08:01.565283+0000","last_fullsized":"2024-03-09T15:08:01.565283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:16:28.179997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.574166+0000","last_change":"2024-03-09T14:26:30.648960+0000","last_active":"2024-03-09T15:08:11.574166+0000","last_peered":"2024-03-09T15:08:11.574166+0000","last_clean":"2024-03-09T15:08:11.574166+0000","last_became_active":"2024-03-09T14:26:30.648619+0000","last_became_peered":"2024-03-09T14:26:30.648619+0000","last_unstale":"2024-03-09T15:08:11.574166+0000","last_undegraded":"2024-03-09T15:08:11.574166+0000","last_fullsized":"2024-03-09T15:08:11.574166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:18.621839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'266","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.684052+0000","last_change":"2024-03-09T14:26:32.654402+0000","last_active":"2024-03-09T15:11:38.684052+0000","last_peered":"2024-03-09T15:11:38.684052+0000","last_clean":"2024-03-09T15:11:38.684052+0000","last_became_active":"2024-03-09T14:26:32.653912+0000","last_became_peered":"2024-03-09T14:26:32.653912+0000","last_unstale":"2024-03-09T15:11:38.684052+0000","last_undegraded":"2024-03-09T15:11:38.684052+0000","last_fullsized":"2024-03-09T15:11:38.684052+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:56.284532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23916,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":998,"num_read_kb":1067,"num_write":1504,"num_write_kb":1367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:16.591995+0000","last_change":"2024-03-09T14:26:34.675583+0000","last_active":"2024-03-09T15:08:16.591995+0000","last_peered":"2024-03-09T15:08:16.591995+0000","last_clean":"2024-03-09T15:08:16.591995+0000","last_became_active":"2024-03-09T14:26:34.675234+0000","last_became_peered":"2024-03-09T14:26:34.675234+0000","last_unstale":"2024-03-09T15:08:16.591995+0000","last_undegraded":"2024-03-09T15:08:16.591995+0000","last_fullsized":"2024-03-09T15:08:16.591995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:00:48.565032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'165","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.434217+0000","last_change":"2024-03-09T14:26:36.786450+0000","last_active":"2024-03-09T15:11:04.434217+0000","last_peered":"2024-03-09T15:11:04.434217+0000","last_clean":"2024-03-09T15:11:04.434217+0000","last_became_active":"2024-03-09T14:26:36.786088+0000","last_became_peered":"2024-03-09T14:26:36.786088+0000","last_unstale":"2024-03-09T15:11:04.434217+0000","last_undegraded":"2024-03-09T15:11:04.434217+0000","last_fullsized":"2024-03-09T15:11:04.434217+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:44.688510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":687,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":146,"num_write":429,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'835","reported_seq":2538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.876837+0000","last_change":"2024-03-09T14:26:28.646272+0000","last_active":"2024-03-09T15:11:07.876837+0000","last_peered":"2024-03-09T15:11:07.876837+0000","last_clean":"2024-03-09T15:11:07.876837+0000","last_became_active":"2024-03-09T14:26:28.645944+0000","last_became_peered":"2024-03-09T14:26:28.645944+0000","last_unstale":"2024-03-09T15:11:07.876837+0000","last_undegraded":"2024-03-09T15:11:07.876837+0000","last_fullsized":"2024-03-09T15:11:07.876837+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:09.470917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4110,"num_read_kb":3687,"num_write":1137,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'198","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.404922+0000","last_change":"2024-03-09T14:26:26.640197+0000","last_active":"2024-03-09T15:10:54.404922+0000","last_peered":"2024-03-09T15:10:54.404922+0000","last_clean":"2024-03-09T15:10:54.404922+0000","last_became_active":"2024-03-09T14:26:26.639853+0000","last_became_peered":"2024-03-09T14:26:26.639853+0000","last_unstale":"2024-03-09T15:10:54.404922+0000","last_undegraded":"2024-03-09T15:10:54.404922+0000","last_fullsized":"2024-03-09T15:10:54.404922+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:01:10.961843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6188704,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":10153,"num_write":1143,"num_write_kb":29784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.711777+0000","last_change":"2024-03-09T14:26:18.582360+0000","last_active":"2024-03-09T15:08:06.711777+0000","last_peered":"2024-03-09T15:08:06.711777+0000","last_clean":"2024-03-09T15:08:06.711777+0000","last_became_active":"2024-03-09T14:26:18.581750+0000","last_became_peered":"2024-03-09T14:26:18.581750+0000","last_unstale":"2024-03-09T15:08:06.711777+0000","last_undegraded":"2024-03-09T15:08:06.711777+0000","last_fullsized":"2024-03-09T15:08:06.711777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:51.952352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591427+0000","last_change":"2024-03-09T14:26:30.649458+0000","last_active":"2024-03-09T15:08:11.591427+0000","last_peered":"2024-03-09T15:08:11.591427+0000","last_clean":"2024-03-09T15:08:11.591427+0000","last_became_active":"2024-03-09T14:26:30.649176+0000","last_became_peered":"2024-03-09T14:26:30.649176+0000","last_unstale":"2024-03-09T15:08:11.591427+0000","last_undegraded":"2024-03-09T15:08:11.591427+0000","last_fullsized":"2024-03-09T15:08:11.591427+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:32:57.186116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'186","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:12.268768+0000","last_change":"2024-03-09T14:26:32.868553+0000","last_active":"2024-03-09T15:11:12.268768+0000","last_peered":"2024-03-09T15:11:12.268768+0000","last_clean":"2024-03-09T15:11:12.268768+0000","last_became_active":"2024-03-09T14:26:32.868165+0000","last_became_peered":"2024-03-09T14:26:32.868165+0000","last_unstale":"2024-03-09T15:11:12.268768+0000","last_undegraded":"2024-03-09T15:11:12.268768+0000","last_fullsized":"2024-03-09T15:11:12.268768+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:54:17.205454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":224,"num_write":210,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'554","reported_seq":2219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.637557+0000","last_change":"2024-03-09T14:26:34.673130+0000","last_active":"2024-03-09T15:11:38.637557+0000","last_peered":"2024-03-09T15:11:38.637557+0000","last_clean":"2024-03-09T15:11:38.637557+0000","last_became_active":"2024-03-09T14:26:34.672351+0000","last_became_peered":"2024-03-09T14:26:34.672351+0000","last_unstale":"2024-03-09T15:11:38.637557+0000","last_undegraded":"2024-03-09T15:11:38.637557+0000","last_fullsized":"2024-03-09T15:11:38.637557+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:47:41.314294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'119","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.329530+0000","last_change":"2024-03-09T14:26:36.785772+0000","last_active":"2024-03-09T15:10:45.329530+0000","last_peered":"2024-03-09T15:10:45.329530+0000","last_clean":"2024-03-09T15:10:45.329530+0000","last_became_active":"2024-03-09T14:26:36.785453+0000","last_became_peered":"2024-03-09T14:26:36.785453+0000","last_unstale":"2024-03-09T15:10:45.329530+0000","last_undegraded":"2024-03-09T15:10:45.329530+0000","last_fullsized":"2024-03-09T15:10:45.329530+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:52:43.326578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":860,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":155,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'674","reported_seq":2122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.096689+0000","last_change":"2024-03-09T14:26:28.656712+0000","last_active":"2024-03-09T15:11:01.096689+0000","last_peered":"2024-03-09T15:11:01.096689+0000","last_clean":"2024-03-09T15:11:01.096689+0000","last_became_active":"2024-03-09T14:26:28.655904+0000","last_became_peered":"2024-03-09T14:26:28.655904+0000","last_unstale":"2024-03-09T15:11:01.096689+0000","last_undegraded":"2024-03-09T15:11:01.096689+0000","last_fullsized":"2024-03-09T15:11:01.096689+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":600,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:45:14.565089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3203,"num_read_kb":2919,"num_write":883,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'217","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:13.198226+0000","last_change":"2024-03-09T14:26:26.644176+0000","last_active":"2024-03-09T15:09:13.198226+0000","last_peered":"2024-03-09T15:09:13.198226+0000","last_clean":"2024-03-09T15:09:13.198226+0000","last_became_active":"2024-03-09T14:26:26.643087+0000","last_became_peered":"2024-03-09T14:26:26.643087+0000","last_unstale":"2024-03-09T15:09:13.198226+0000","last_undegraded":"2024-03-09T15:09:13.198226+0000","last_fullsized":"2024-03-09T15:09:13.198226+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:46.349094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5550336,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":452,"num_read_kb":60158,"num_write":1084,"num_write_kb":49675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.561646+0000","last_change":"2024-03-09T14:26:18.577844+0000","last_active":"2024-03-09T15:07:26.561646+0000","last_peered":"2024-03-09T15:07:26.561646+0000","last_clean":"2024-03-09T15:07:26.561646+0000","last_became_active":"2024-03-09T14:26:18.577564+0000","last_became_peered":"2024-03-09T14:26:18.577564+0000","last_unstale":"2024-03-09T15:07:26.561646+0000","last_undegraded":"2024-03-09T15:07:26.561646+0000","last_fullsized":"2024-03-09T15:07:26.561646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:23:41.274783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591387+0000","last_change":"2024-03-09T14:26:30.650699+0000","last_active":"2024-03-09T15:08:11.591387+0000","last_peered":"2024-03-09T15:08:11.591387+0000","last_clean":"2024-03-09T15:08:11.591387+0000","last_became_active":"2024-03-09T14:26:30.650370+0000","last_became_peered":"2024-03-09T14:26:30.650370+0000","last_unstale":"2024-03-09T15:08:11.591387+0000","last_undegraded":"2024-03-09T15:08:11.591387+0000","last_fullsized":"2024-03-09T15:08:11.591387+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:48:57.173305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'101","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:44.959697+0000","last_change":"2024-03-09T14:26:32.655602+0000","last_active":"2024-03-09T15:08:44.959697+0000","last_peered":"2024-03-09T15:08:44.959697+0000","last_clean":"2024-03-09T15:08:44.959697+0000","last_became_active":"2024-03-09T14:26:32.655285+0000","last_became_peered":"2024-03-09T14:26:32.655285+0000","last_unstale":"2024-03-09T15:08:44.959697+0000","last_undegraded":"2024-03-09T15:08:44.959697+0000","last_fullsized":"2024-03-09T15:08:44.959697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:00:18.543951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":120,"num_read_kb":114,"num_write":82,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'561","reported_seq":4057,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.642164+0000","last_change":"2024-03-09T14:26:34.678783+0000","last_active":"2024-03-09T15:11:38.642164+0000","last_peered":"2024-03-09T15:11:38.642164+0000","last_clean":"2024-03-09T15:11:38.642164+0000","last_became_active":"2024-03-09T14:26:34.678503+0000","last_became_peered":"2024-03-09T14:26:34.678503+0000","last_unstale":"2024-03-09T15:11:38.642164+0000","last_undegraded":"2024-03-09T15:11:38.642164+0000","last_fullsized":"2024-03-09T15:11:38.642164+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:21:21.377753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'184","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.887085+0000","last_change":"2024-03-09T14:26:36.669037+0000","last_active":"2024-03-09T15:11:07.887085+0000","last_peered":"2024-03-09T15:11:07.887085+0000","last_clean":"2024-03-09T15:11:07.887085+0000","last_became_active":"2024-03-09T14:26:36.668775+0000","last_became_peered":"2024-03-09T14:26:36.668775+0000","last_unstale":"2024-03-09T15:11:07.887085+0000","last_undegraded":"2024-03-09T15:11:07.887085+0000","last_fullsized":"2024-03-09T15:11:07.887085+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:19.439405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":97,"num_write":406,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'321","reported_seq":1657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.428353+0000","last_change":"2024-03-09T14:26:28.653283+0000","last_active":"2024-03-09T15:11:04.428353+0000","last_peered":"2024-03-09T15:11:04.428353+0000","last_clean":"2024-03-09T15:11:04.428353+0000","last_became_active":"2024-03-09T14:26:28.653003+0000","last_became_peered":"2024-03-09T14:26:28.653003+0000","last_unstale":"2024-03-09T15:11:04.428353+0000","last_undegraded":"2024-03-09T15:11:04.428353+0000","last_fullsized":"2024-03-09T15:11:04.428353+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:58:52.458831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1763,"num_read_kb":1672,"num_write":372,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'238","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:24.964533+0000","last_change":"2024-03-09T14:27:03.719767+0000","last_active":"2024-03-09T15:11:24.964533+0000","last_peered":"2024-03-09T15:11:24.964533+0000","last_clean":"2024-03-09T15:11:24.964533+0000","last_became_active":"2024-03-09T14:27:03.719395+0000","last_became_peered":"2024-03-09T14:27:03.719395+0000","last_unstale":"2024-03-09T15:11:24.964533+0000","last_undegraded":"2024-03-09T15:11:24.964533+0000","last_fullsized":"2024-03-09T15:11:24.964533+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:12:44.724715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7559825,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":547,"num_read_kb":20107,"num_write":1290,"num_write_kb":28946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.585979+0000","last_change":"2024-03-09T14:26:18.578318+0000","last_active":"2024-03-09T15:07:31.585979+0000","last_peered":"2024-03-09T15:07:31.585979+0000","last_clean":"2024-03-09T15:07:31.585979+0000","last_became_active":"2024-03-09T14:26:18.577994+0000","last_became_peered":"2024-03-09T14:26:18.577994+0000","last_unstale":"2024-03-09T15:07:31.585979+0000","last_undegraded":"2024-03-09T15:07:31.585979+0000","last_fullsized":"2024-03-09T15:07:31.585979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:01:22.815335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.679647+0000","last_change":"2024-03-09T14:26:30.649199+0000","last_active":"2024-03-09T15:08:36.679647+0000","last_peered":"2024-03-09T15:08:36.679647+0000","last_clean":"2024-03-09T15:08:36.679647+0000","last_became_active":"2024-03-09T14:26:30.648910+0000","last_became_peered":"2024-03-09T14:26:30.648910+0000","last_unstale":"2024-03-09T15:08:36.679647+0000","last_undegraded":"2024-03-09T15:08:36.679647+0000","last_fullsized":"2024-03-09T15:08:36.679647+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:55:35.984723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'298","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.661350+0000","last_change":"2024-03-09T14:26:32.869477+0000","last_active":"2024-03-09T15:11:38.661350+0000","last_peered":"2024-03-09T15:11:38.661350+0000","last_clean":"2024-03-09T15:11:38.661350+0000","last_became_active":"2024-03-09T14:26:32.868370+0000","last_became_peered":"2024-03-09T14:26:32.868370+0000","last_unstale":"2024-03-09T15:11:38.661350+0000","last_undegraded":"2024-03-09T15:11:38.661350+0000","last_fullsized":"2024-03-09T15:11:38.661350+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:40.706622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46826,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":447,"num_read_kb":653,"num_write":234,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:16.676484+0000","last_change":"2024-03-09T14:26:34.673146+0000","last_active":"2024-03-09T15:08:16.676484+0000","last_peered":"2024-03-09T15:08:16.676484+0000","last_clean":"2024-03-09T15:08:16.676484+0000","last_became_active":"2024-03-09T14:26:34.672655+0000","last_became_peered":"2024-03-09T14:26:34.672655+0000","last_unstale":"2024-03-09T15:08:16.676484+0000","last_undegraded":"2024-03-09T15:08:16.676484+0000","last_fullsized":"2024-03-09T15:08:16.676484+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:28:25.637599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'120","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.538977+0000","last_change":"2024-03-09T14:26:36.678909+0000","last_active":"2024-03-09T15:10:54.538977+0000","last_peered":"2024-03-09T15:10:54.538977+0000","last_clean":"2024-03-09T15:10:54.538977+0000","last_became_active":"2024-03-09T14:26:36.678641+0000","last_became_peered":"2024-03-09T14:26:36.678641+0000","last_unstale":"2024-03-09T15:10:54.538977+0000","last_undegraded":"2024-03-09T15:10:54.538977+0000","last_fullsized":"2024-03-09T15:10:54.538977+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:51:04.017437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'140","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:56.494079+0000","last_change":"2024-03-09T14:26:36.672110+0000","last_active":"2024-03-09T15:09:56.494079+0000","last_peered":"2024-03-09T15:09:56.494079+0000","last_clean":"2024-03-09T15:09:56.494079+0000","last_became_active":"2024-03-09T14:26:36.671823+0000","last_became_peered":"2024-03-09T14:26:36.671823+0000","last_unstale":"2024-03-09T15:09:56.494079+0000","last_undegraded":"2024-03-09T15:09:56.494079+0000","last_fullsized":"2024-03-09T15:09:56.494079+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:31:00.040419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":220,"num_write":322,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'409","reported_seq":1969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.135137+0000","last_change":"2024-03-09T14:26:28.650708+0000","last_active":"2024-03-09T15:11:37.135137+0000","last_peered":"2024-03-09T15:11:37.135137+0000","last_clean":"2024-03-09T15:11:37.135137+0000","last_became_active":"2024-03-09T14:26:28.649681+0000","last_became_peered":"2024-03-09T14:26:28.649681+0000","last_unstale":"2024-03-09T15:11:37.135137+0000","last_undegraded":"2024-03-09T15:11:37.135137+0000","last_fullsized":"2024-03-09T15:11:37.135137+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:18:32.826847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2231,"num_read_kb":2115,"num_write":479,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'186","reported_seq":885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:34.295443+0000","last_change":"2024-03-09T14:26:26.644133+0000","last_active":"2024-03-09T15:10:34.295443+0000","last_peered":"2024-03-09T15:10:34.295443+0000","last_clean":"2024-03-09T15:10:34.295443+0000","last_became_active":"2024-03-09T14:26:26.643598+0000","last_became_peered":"2024-03-09T14:26:26.643598+0000","last_unstale":"2024-03-09T15:10:34.295443+0000","last_undegraded":"2024-03-09T15:10:34.295443+0000","last_fullsized":"2024-03-09T15:10:34.295443+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:11.376622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9509681,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":564,"num_read_kb":35501,"num_write":896,"num_write_kb":49168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.569074+0000","last_change":"2024-03-09T14:26:30.651022+0000","last_active":"2024-03-09T15:08:31.569074+0000","last_peered":"2024-03-09T15:08:31.569074+0000","last_clean":"2024-03-09T15:08:31.569074+0000","last_became_active":"2024-03-09T14:26:30.650743+0000","last_became_peered":"2024-03-09T14:26:30.650743+0000","last_unstale":"2024-03-09T15:08:31.569074+0000","last_undegraded":"2024-03-09T15:08:31.569074+0000","last_fullsized":"2024-03-09T15:08:31.569074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:24.403091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'124","reported_seq":684,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.696257+0000","last_change":"2024-03-09T14:26:32.651032+0000","last_active":"2024-03-09T15:10:56.696257+0000","last_peered":"2024-03-09T15:10:56.696257+0000","last_clean":"2024-03-09T15:10:56.696257+0000","last_became_active":"2024-03-09T14:26:32.650770+0000","last_became_peered":"2024-03-09T14:26:32.650770+0000","last_unstale":"2024-03-09T15:10:56.696257+0000","last_undegraded":"2024-03-09T15:10:56.696257+0000","last_fullsized":"2024-03-09T15:10:56.696257+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:42:47.799009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11686,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":164,"num_read_kb":220,"num_write":86,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.679613+0000","last_change":"2024-03-09T14:26:34.679002+0000","last_active":"2024-03-09T15:08:36.679613+0000","last_peered":"2024-03-09T15:08:36.679613+0000","last_clean":"2024-03-09T15:08:36.679613+0000","last_became_active":"2024-03-09T14:26:34.678657+0000","last_became_peered":"2024-03-09T14:26:34.678657+0000","last_unstale":"2024-03-09T15:08:36.679613+0000","last_undegraded":"2024-03-09T15:08:36.679613+0000","last_fullsized":"2024-03-09T15:08:36.679613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:14.990198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'108","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.590925+0000","last_change":"2024-03-09T14:26:36.678524+0000","last_active":"2024-03-09T15:11:01.590925+0000","last_peered":"2024-03-09T15:11:01.590925+0000","last_clean":"2024-03-09T15:11:01.590925+0000","last_became_active":"2024-03-09T14:26:36.678174+0000","last_became_peered":"2024-03-09T14:26:36.678174+0000","last_unstale":"2024-03-09T15:11:01.590925+0000","last_undegraded":"2024-03-09T15:11:01.590925+0000","last_fullsized":"2024-03-09T15:11:01.590925+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:31:59.766233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":96,"num_write":259,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'447","reported_seq":2102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.167849+0000","last_change":"2024-03-09T14:26:28.645383+0000","last_active":"2024-03-09T15:11:09.167849+0000","last_peered":"2024-03-09T15:11:09.167849+0000","last_clean":"2024-03-09T15:11:09.167849+0000","last_became_active":"2024-03-09T14:26:28.644951+0000","last_became_peered":"2024-03-09T14:26:28.644951+0000","last_unstale":"2024-03-09T15:11:09.167849+0000","last_undegraded":"2024-03-09T15:11:09.167849+0000","last_fullsized":"2024-03-09T15:11:09.167849+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:15:07.312913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2607,"num_read_kb":2478,"num_write":564,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'183","reported_seq":795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:46.815399+0000","last_change":"2024-03-09T14:26:26.652608+0000","last_active":"2024-03-09T15:09:46.815399+0000","last_peered":"2024-03-09T15:09:46.815399+0000","last_clean":"2024-03-09T15:09:46.815399+0000","last_became_active":"2024-03-09T14:26:26.652260+0000","last_became_peered":"2024-03-09T14:26:26.652260+0000","last_unstale":"2024-03-09T15:09:46.815399+0000","last_undegraded":"2024-03-09T15:09:46.815399+0000","last_fullsized":"2024-03-09T15:09:46.815399+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:55.237307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698699,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":390,"num_read_kb":5479,"num_write":1047,"num_write_kb":16075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.678739+0000","last_change":"2024-03-09T14:26:30.650065+0000","last_active":"2024-03-09T15:08:31.678739+0000","last_peered":"2024-03-09T15:08:31.678739+0000","last_clean":"2024-03-09T15:08:31.678739+0000","last_became_active":"2024-03-09T14:26:30.649790+0000","last_became_peered":"2024-03-09T14:26:30.649790+0000","last_unstale":"2024-03-09T15:08:31.678739+0000","last_undegraded":"2024-03-09T15:08:31.678739+0000","last_fullsized":"2024-03-09T15:08:31.678739+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:16.289908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'56","reported_seq":562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.592684+0000","last_change":"2024-03-09T14:26:32.655566+0000","last_active":"2024-03-09T15:10:56.592684+0000","last_peered":"2024-03-09T15:10:56.592684+0000","last_clean":"2024-03-09T15:10:56.592684+0000","last_became_active":"2024-03-09T14:26:32.655269+0000","last_became_peered":"2024-03-09T14:26:32.655269+0000","last_unstale":"2024-03-09T15:10:56.592684+0000","last_undegraded":"2024-03-09T15:10:56.592684+0000","last_fullsized":"2024-03-09T15:10:56.592684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:13.374240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715778+0000","last_change":"2024-03-09T14:26:34.671491+0000","last_active":"2024-03-09T15:08:36.715778+0000","last_peered":"2024-03-09T15:08:36.715778+0000","last_clean":"2024-03-09T15:08:36.715778+0000","last_became_active":"2024-03-09T14:26:34.671065+0000","last_became_peered":"2024-03-09T14:26:34.671065+0000","last_unstale":"2024-03-09T15:08:36.715778+0000","last_undegraded":"2024-03-09T15:08:36.715778+0000","last_fullsized":"2024-03-09T15:08:36.715778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:19:07.578080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'188","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:14.235785+0000","last_change":"2024-03-09T14:26:36.667732+0000","last_active":"2024-03-09T15:09:14.235785+0000","last_peered":"2024-03-09T15:09:14.235785+0000","last_clean":"2024-03-09T15:09:14.235785+0000","last_became_active":"2024-03-09T14:26:36.666762+0000","last_became_peered":"2024-03-09T14:26:36.666762+0000","last_unstale":"2024-03-09T15:09:14.235785+0000","last_undegraded":"2024-03-09T15:09:14.235785+0000","last_fullsized":"2024-03-09T15:09:14.235785+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:03:47.792239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":266,"num_read_kb":261,"num_write":413,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'437","reported_seq":2099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.101150+0000","last_change":"2024-03-09T14:26:28.658137+0000","last_active":"2024-03-09T15:11:01.101150+0000","last_peered":"2024-03-09T15:11:01.101150+0000","last_clean":"2024-03-09T15:11:01.101150+0000","last_became_active":"2024-03-09T14:26:28.657024+0000","last_became_peered":"2024-03-09T14:26:28.657024+0000","last_unstale":"2024-03-09T15:11:01.101150+0000","last_undegraded":"2024-03-09T15:11:01.101150+0000","last_fullsized":"2024-03-09T15:11:01.101150+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:04.541686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2592,"num_read_kb":2450,"num_write":527,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'190","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.302084+0000","last_change":"2024-03-09T14:26:26.646837+0000","last_active":"2024-03-09T15:11:04.302084+0000","last_peered":"2024-03-09T15:11:04.302084+0000","last_clean":"2024-03-09T15:11:04.302084+0000","last_became_active":"2024-03-09T14:26:26.646506+0000","last_became_peered":"2024-03-09T14:26:26.646506+0000","last_unstale":"2024-03-09T15:11:04.302084+0000","last_undegraded":"2024-03-09T15:11:04.302084+0000","last_fullsized":"2024-03-09T15:11:04.302084+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:13.870996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23070885,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":392,"num_read_kb":50370,"num_write":984,"num_write_kb":56973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.715107+0000","last_change":"2024-03-09T14:26:30.652971+0000","last_active":"2024-03-09T15:08:31.715107+0000","last_peered":"2024-03-09T15:08:31.715107+0000","last_clean":"2024-03-09T15:08:31.715107+0000","last_became_active":"2024-03-09T14:26:30.652245+0000","last_became_peered":"2024-03-09T14:26:30.652245+0000","last_unstale":"2024-03-09T15:08:31.715107+0000","last_undegraded":"2024-03-09T15:08:31.715107+0000","last_fullsized":"2024-03-09T15:08:31.715107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:24:02.699008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'163","reported_seq":738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.696289+0000","last_change":"2024-03-09T14:26:32.652895+0000","last_active":"2024-03-09T15:10:56.696289+0000","last_peered":"2024-03-09T15:10:56.696289+0000","last_clean":"2024-03-09T15:10:56.696289+0000","last_became_active":"2024-03-09T14:26:32.652610+0000","last_became_peered":"2024-03-09T14:26:32.652610+0000","last_unstale":"2024-03-09T15:10:56.696289+0000","last_undegraded":"2024-03-09T15:10:56.696289+0000","last_fullsized":"2024-03-09T15:10:56.696289+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:38:51.192534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18633,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":211,"num_read_kb":282,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.594468+0000","last_change":"2024-03-09T14:26:34.667654+0000","last_active":"2024-03-09T15:08:36.594468+0000","last_peered":"2024-03-09T15:08:36.594468+0000","last_clean":"2024-03-09T15:08:36.594468+0000","last_became_active":"2024-03-09T14:26:34.667373+0000","last_became_peered":"2024-03-09T14:26:34.667373+0000","last_unstale":"2024-03-09T15:08:36.594468+0000","last_undegraded":"2024-03-09T15:08:36.594468+0000","last_fullsized":"2024-03-09T15:08:36.594468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:15.287538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'134","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.348642+0000","last_change":"2024-03-09T14:26:36.678631+0000","last_active":"2024-03-09T15:10:35.348642+0000","last_peered":"2024-03-09T15:10:35.348642+0000","last_clean":"2024-03-09T15:10:35.348642+0000","last_became_active":"2024-03-09T14:26:36.678306+0000","last_became_peered":"2024-03-09T14:26:36.678306+0000","last_unstale":"2024-03-09T15:10:35.348642+0000","last_undegraded":"2024-03-09T15:10:35.348642+0000","last_fullsized":"2024-03-09T15:10:35.348642+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:33:48.413353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":110,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'432","reported_seq":2096,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.534339+0000","last_change":"2024-03-09T14:26:28.652461+0000","last_active":"2024-03-09T15:10:54.534339+0000","last_peered":"2024-03-09T15:10:54.534339+0000","last_clean":"2024-03-09T15:10:54.534339+0000","last_became_active":"2024-03-09T14:26:28.651640+0000","last_became_peered":"2024-03-09T14:26:28.651640+0000","last_unstale":"2024-03-09T15:10:54.534339+0000","last_undegraded":"2024-03-09T15:10:54.534339+0000","last_fullsized":"2024-03-09T15:10:54.534339+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:46.863189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2590,"num_read_kb":2461,"num_write":546,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'203","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.046619+0000","last_change":"2024-03-09T14:26:26.636955+0000","last_active":"2024-03-09T15:11:09.046619+0000","last_peered":"2024-03-09T15:11:09.046619+0000","last_clean":"2024-03-09T15:11:09.046619+0000","last_became_active":"2024-03-09T14:26:26.636087+0000","last_became_peered":"2024-03-09T14:26:26.636087+0000","last_unstale":"2024-03-09T15:11:09.046619+0000","last_undegraded":"2024-03-09T15:11:09.046619+0000","last_fullsized":"2024-03-09T15:11:09.046619+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:08:49.930168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221125,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":647,"num_read_kb":124750,"num_write":1243,"num_write_kb":18410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.593747+0000","last_change":"2024-03-09T14:26:30.653233+0000","last_active":"2024-03-09T15:08:31.593747+0000","last_peered":"2024-03-09T15:08:31.593747+0000","last_clean":"2024-03-09T15:08:31.593747+0000","last_became_active":"2024-03-09T14:26:30.652925+0000","last_became_peered":"2024-03-09T14:26:30.652925+0000","last_unstale":"2024-03-09T15:08:31.593747+0000","last_undegraded":"2024-03-09T15:08:31.593747+0000","last_fullsized":"2024-03-09T15:08:31.593747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:15:46.808131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'126","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.159039+0000","last_change":"2024-03-09T14:26:32.657556+0000","last_active":"2024-03-09T15:11:37.159039+0000","last_peered":"2024-03-09T15:11:37.159039+0000","last_clean":"2024-03-09T15:11:37.159039+0000","last_became_active":"2024-03-09T14:26:32.657221+0000","last_became_peered":"2024-03-09T14:26:32.657221+0000","last_unstale":"2024-03-09T15:11:37.159039+0000","last_undegraded":"2024-03-09T15:11:37.159039+0000","last_fullsized":"2024-03-09T15:11:37.159039+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:53:32.822261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30241,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":153,"num_read_kb":246,"num_write":80,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.577073+0000","last_change":"2024-03-09T14:26:34.670563+0000","last_active":"2024-03-09T15:08:36.577073+0000","last_peered":"2024-03-09T15:08:36.577073+0000","last_clean":"2024-03-09T15:08:36.577073+0000","last_became_active":"2024-03-09T14:26:34.670283+0000","last_became_peered":"2024-03-09T14:26:34.670283+0000","last_unstale":"2024-03-09T15:08:36.577073+0000","last_undegraded":"2024-03-09T15:08:36.577073+0000","last_fullsized":"2024-03-09T15:08:36.577073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:08:44.244645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'870","reported_seq":2445,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.175205+0000","last_change":"2024-03-09T14:26:28.652528+0000","last_active":"2024-03-09T15:11:09.175205+0000","last_peered":"2024-03-09T15:11:09.175205+0000","last_clean":"2024-03-09T15:11:09.175205+0000","last_became_active":"2024-03-09T14:26:28.651921+0000","last_became_peered":"2024-03-09T14:26:28.651921+0000","last_unstale":"2024-03-09T15:11:09.175205+0000","last_undegraded":"2024-03-09T15:11:09.175205+0000","last_fullsized":"2024-03-09T15:11:09.175205+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:35:33.794890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3929,"num_read_kb":3481,"num_write":1218,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'258","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:02.109115+0000","last_change":"2024-03-09T14:27:03.717196+0000","last_active":"2024-03-09T15:09:02.109115+0000","last_peered":"2024-03-09T15:09:02.109115+0000","last_clean":"2024-03-09T15:09:02.109115+0000","last_became_active":"2024-03-09T14:27:03.716852+0000","last_became_peered":"2024-03-09T14:27:03.716852+0000","last_unstale":"2024-03-09T15:09:02.109115+0000","last_undegraded":"2024-03-09T15:09:02.109115+0000","last_fullsized":"2024-03-09T15:09:02.109115+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:55.331529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621563,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":888,"num_read_kb":7728,"num_write":1382,"num_write_kb":17237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"35'3","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.408491+0000","last_change":"2024-03-09T14:26:30.652021+0000","last_active":"2024-03-09T15:11:38.408491+0000","last_peered":"2024-03-09T15:11:38.408491+0000","last_clean":"2024-03-09T15:11:38.408491+0000","last_became_active":"2024-03-09T14:26:30.651711+0000","last_became_peered":"2024-03-09T14:26:30.651711+0000","last_unstale":"2024-03-09T15:11:38.408491+0000","last_undegraded":"2024-03-09T15:11:38.408491+0000","last_fullsized":"2024-03-09T15:11:38.408491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:37.178573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":479,"num_read_kb":477,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'199","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.657964+0000","last_change":"2024-03-09T14:26:32.655679+0000","last_active":"2024-03-09T15:11:38.657964+0000","last_peered":"2024-03-09T15:11:38.657964+0000","last_clean":"2024-03-09T15:11:38.657964+0000","last_became_active":"2024-03-09T14:26:32.655391+0000","last_became_peered":"2024-03-09T14:26:32.655391+0000","last_unstale":"2024-03-09T15:11:38.657964+0000","last_undegraded":"2024-03-09T15:11:38.657964+0000","last_fullsized":"2024-03-09T15:11:38.657964+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:26:19.532383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47720,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":299,"num_read_kb":492,"num_write":192,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.583116+0000","last_change":"2024-03-09T14:26:34.675539+0000","last_active":"2024-03-09T15:09:06.583116+0000","last_peered":"2024-03-09T15:09:06.583116+0000","last_clean":"2024-03-09T15:09:06.583116+0000","last_became_active":"2024-03-09T14:26:34.675248+0000","last_became_peered":"2024-03-09T14:26:34.675248+0000","last_unstale":"2024-03-09T15:09:06.583116+0000","last_undegraded":"2024-03-09T15:09:06.583116+0000","last_fullsized":"2024-03-09T15:09:06.583116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:43:16.280150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'185","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.696274+0000","last_change":"2024-03-09T14:26:36.786828+0000","last_active":"2024-03-09T15:10:56.696274+0000","last_peered":"2024-03-09T15:10:56.696274+0000","last_clean":"2024-03-09T15:10:56.696274+0000","last_became_active":"2024-03-09T14:26:36.786403+0000","last_became_peered":"2024-03-09T14:26:36.786403+0000","last_unstale":"2024-03-09T15:10:56.696274+0000","last_undegraded":"2024-03-09T15:10:56.696274+0000","last_fullsized":"2024-03-09T15:10:56.696274+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:54:17.134629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1042,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":213,"num_write":429,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'371","reported_seq":1881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.128774+0000","last_change":"2024-03-09T14:26:28.642746+0000","last_active":"2024-03-09T15:11:37.128774+0000","last_peered":"2024-03-09T15:11:37.128774+0000","last_clean":"2024-03-09T15:11:37.128774+0000","last_became_active":"2024-03-09T14:26:28.642452+0000","last_became_peered":"2024-03-09T14:26:28.642452+0000","last_unstale":"2024-03-09T15:11:37.128774+0000","last_undegraded":"2024-03-09T15:11:37.128774+0000","last_fullsized":"2024-03-09T15:11:37.128774+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:40.141256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2046,"num_read_kb":1963,"num_write":419,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'172","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:03.384230+0000","last_change":"2024-03-09T14:27:03.724915+0000","last_active":"2024-03-09T15:09:03.384230+0000","last_peered":"2024-03-09T15:09:03.384230+0000","last_clean":"2024-03-09T15:09:03.384230+0000","last_became_active":"2024-03-09T14:27:03.724521+0000","last_became_peered":"2024-03-09T14:27:03.724521+0000","last_unstale":"2024-03-09T15:09:03.384230+0000","last_undegraded":"2024-03-09T15:09:03.384230+0000","last_fullsized":"2024-03-09T15:09:03.384230+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:32:10.947685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17066132,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":316,"num_read_kb":39345,"num_write":954,"num_write_kb":40541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591483+0000","last_change":"2024-03-09T14:26:30.652505+0000","last_active":"2024-03-09T15:08:11.591483+0000","last_peered":"2024-03-09T15:08:11.591483+0000","last_clean":"2024-03-09T15:08:11.591483+0000","last_became_active":"2024-03-09T14:26:30.652243+0000","last_became_peered":"2024-03-09T14:26:30.652243+0000","last_unstale":"2024-03-09T15:08:11.591483+0000","last_undegraded":"2024-03-09T15:08:11.591483+0000","last_fullsized":"2024-03-09T15:08:11.591483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:42:30.815337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'149","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.617080+0000","last_change":"2024-03-09T14:26:32.658910+0000","last_active":"2024-03-09T15:11:36.617080+0000","last_peered":"2024-03-09T15:11:36.617080+0000","last_clean":"2024-03-09T15:11:36.617080+0000","last_became_active":"2024-03-09T14:26:32.658626+0000","last_became_peered":"2024-03-09T14:26:32.658626+0000","last_unstale":"2024-03-09T15:11:36.617080+0000","last_undegraded":"2024-03-09T15:11:36.617080+0000","last_fullsized":"2024-03-09T15:11:36.617080+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:20.837652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17393,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":278,"num_write":142,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.572913+0000","last_change":"2024-03-09T14:26:34.669777+0000","last_active":"2024-03-09T15:09:06.572913+0000","last_peered":"2024-03-09T15:09:06.572913+0000","last_clean":"2024-03-09T15:09:06.572913+0000","last_became_active":"2024-03-09T14:26:34.669482+0000","last_became_peered":"2024-03-09T14:26:34.669482+0000","last_unstale":"2024-03-09T15:09:06.572913+0000","last_undegraded":"2024-03-09T15:09:06.572913+0000","last_fullsized":"2024-03-09T15:09:06.572913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:44:39.381656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'220","reported_seq":1403,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.414241+0000","last_change":"2024-03-09T14:26:36.678544+0000","last_active":"2024-03-09T15:11:37.414241+0000","last_peered":"2024-03-09T15:11:37.414241+0000","last_clean":"2024-03-09T15:11:37.414241+0000","last_became_active":"2024-03-09T14:26:36.678232+0000","last_became_peered":"2024-03-09T14:26:36.678232+0000","last_unstale":"2024-03-09T15:11:37.414241+0000","last_undegraded":"2024-03-09T15:11:37.414241+0000","last_fullsized":"2024-03-09T15:11:37.414241+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:27.054472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":941,"num_read_kb":939,"num_write":605,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'431","reported_seq":1927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.133871+0000","last_change":"2024-03-09T14:26:28.658740+0000","last_active":"2024-03-09T15:11:37.133871+0000","last_peered":"2024-03-09T15:11:37.133871+0000","last_clean":"2024-03-09T15:11:37.133871+0000","last_became_active":"2024-03-09T14:26:28.657488+0000","last_became_peered":"2024-03-09T14:26:28.657488+0000","last_unstale":"2024-03-09T15:11:37.133871+0000","last_undegraded":"2024-03-09T15:11:37.133871+0000","last_fullsized":"2024-03-09T15:11:37.133871+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:15:44.795978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2287,"num_read_kb":2137,"num_write":511,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'195","reported_seq":801,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.492761+0000","last_change":"2024-03-09T14:26:26.641350+0000","last_active":"2024-03-09T15:11:26.492761+0000","last_peered":"2024-03-09T15:11:26.492761+0000","last_clean":"2024-03-09T15:11:26.492761+0000","last_became_active":"2024-03-09T14:26:26.641003+0000","last_became_peered":"2024-03-09T14:26:26.641003+0000","last_unstale":"2024-03-09T15:11:26.492761+0000","last_undegraded":"2024-03-09T15:11:26.492761+0000","last_fullsized":"2024-03-09T15:11:26.492761+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:10:53.927499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582977,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":372,"num_read_kb":32756,"num_write":1154,"num_write_kb":45988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.597964+0000","last_change":"2024-03-09T14:26:30.654064+0000","last_active":"2024-03-09T15:09:01.597964+0000","last_peered":"2024-03-09T15:09:01.597964+0000","last_clean":"2024-03-09T15:09:01.597964+0000","last_became_active":"2024-03-09T14:26:30.653249+0000","last_became_peered":"2024-03-09T14:26:30.653249+0000","last_unstale":"2024-03-09T15:09:01.597964+0000","last_undegraded":"2024-03-09T15:09:01.597964+0000","last_fullsized":"2024-03-09T15:09:01.597964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:11:30.602441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'124","reported_seq":686,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:21.692304+0000","last_change":"2024-03-09T14:26:32.868697+0000","last_active":"2024-03-09T15:10:21.692304+0000","last_peered":"2024-03-09T15:10:21.692304+0000","last_clean":"2024-03-09T15:10:21.692304+0000","last_became_active":"2024-03-09T14:26:32.868236+0000","last_became_peered":"2024-03-09T14:26:32.868236+0000","last_unstale":"2024-03-09T15:10:21.692304+0000","last_undegraded":"2024-03-09T15:10:21.692304+0000","last_fullsized":"2024-03-09T15:10:21.692304+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:50:04.808478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12376,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":164,"num_read_kb":223,"num_write":86,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.570427+0000","last_change":"2024-03-09T14:26:34.675615+0000","last_active":"2024-03-09T15:08:41.570427+0000","last_peered":"2024-03-09T15:08:41.570427+0000","last_clean":"2024-03-09T15:08:41.570427+0000","last_became_active":"2024-03-09T14:26:34.675120+0000","last_became_peered":"2024-03-09T14:26:34.675120+0000","last_unstale":"2024-03-09T15:08:41.570427+0000","last_undegraded":"2024-03-09T15:08:41.570427+0000","last_fullsized":"2024-03-09T15:08:41.570427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:06.267360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'104","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.686247+0000","last_change":"2024-03-09T14:26:36.678845+0000","last_active":"2024-03-09T15:11:38.686247+0000","last_peered":"2024-03-09T15:11:38.686247+0000","last_clean":"2024-03-09T15:11:38.686247+0000","last_became_active":"2024-03-09T14:26:36.678521+0000","last_became_peered":"2024-03-09T14:26:36.678521+0000","last_unstale":"2024-03-09T15:11:38.686247+0000","last_undegraded":"2024-03-09T15:11:38.686247+0000","last_fullsized":"2024-03-09T15:11:38.686247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:26:18.582752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":103,"num_write":248,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'325","reported_seq":1740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.198591+0000","last_change":"2024-03-09T14:26:28.648512+0000","last_active":"2024-03-09T15:11:09.198591+0000","last_peered":"2024-03-09T15:11:09.198591+0000","last_clean":"2024-03-09T15:11:09.198591+0000","last_became_active":"2024-03-09T14:26:28.648204+0000","last_became_peered":"2024-03-09T14:26:28.648204+0000","last_unstale":"2024-03-09T15:11:09.198591+0000","last_undegraded":"2024-03-09T15:11:09.198591+0000","last_fullsized":"2024-03-09T15:11:09.198591+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:16:38.156513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1841,"num_read_kb":1771,"num_write":371,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'191","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:12.482693+0000","last_change":"2024-03-09T14:27:03.719684+0000","last_active":"2024-03-09T15:09:12.482693+0000","last_peered":"2024-03-09T15:09:12.482693+0000","last_clean":"2024-03-09T15:09:12.482693+0000","last_became_active":"2024-03-09T14:27:03.719292+0000","last_became_peered":"2024-03-09T14:27:03.719292+0000","last_unstale":"2024-03-09T15:09:12.482693+0000","last_undegraded":"2024-03-09T15:09:12.482693+0000","last_fullsized":"2024-03-09T15:09:12.482693+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:28.532681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7024912,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":930,"num_read_kb":86824,"num_write":1013,"num_write_kb":33052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.572422+0000","last_change":"2024-03-09T14:26:30.652463+0000","last_active":"2024-03-09T15:09:01.572422+0000","last_peered":"2024-03-09T15:09:01.572422+0000","last_clean":"2024-03-09T15:09:01.572422+0000","last_became_active":"2024-03-09T14:26:30.652190+0000","last_became_peered":"2024-03-09T14:26:30.652190+0000","last_unstale":"2024-03-09T15:09:01.572422+0000","last_undegraded":"2024-03-09T15:09:01.572422+0000","last_fullsized":"2024-03-09T15:09:01.572422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:52:53.691492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'82","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:46.595898+0000","last_change":"2024-03-09T14:26:32.868321+0000","last_active":"2024-03-09T15:08:46.595898+0000","last_peered":"2024-03-09T15:08:46.595898+0000","last_clean":"2024-03-09T15:08:46.595898+0000","last_became_active":"2024-03-09T14:26:32.867985+0000","last_became_peered":"2024-03-09T14:26:32.867985+0000","last_unstale":"2024-03-09T15:08:46.595898+0000","last_undegraded":"2024-03-09T15:08:46.595898+0000","last_fullsized":"2024-03-09T15:08:46.595898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:20.552555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":100,"num_read_kb":95,"num_write":100,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'531","reported_seq":2041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.691175+0000","last_change":"2024-03-09T14:26:34.665855+0000","last_active":"2024-03-09T15:11:38.691175+0000","last_peered":"2024-03-09T15:11:38.691175+0000","last_clean":"2024-03-09T15:11:38.691175+0000","last_became_active":"2024-03-09T14:26:34.664708+0000","last_became_peered":"2024-03-09T14:26:34.664708+0000","last_unstale":"2024-03-09T15:11:38.691175+0000","last_undegraded":"2024-03-09T15:11:38.691175+0000","last_fullsized":"2024-03-09T15:11:38.691175+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:21:02.162854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'142","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.341774+0000","last_change":"2024-03-09T14:26:36.676199+0000","last_active":"2024-03-09T15:10:35.341774+0000","last_peered":"2024-03-09T15:10:35.341774+0000","last_clean":"2024-03-09T15:10:35.341774+0000","last_became_active":"2024-03-09T14:26:36.675855+0000","last_became_peered":"2024-03-09T14:26:36.675855+0000","last_unstale":"2024-03-09T15:10:35.341774+0000","last_undegraded":"2024-03-09T15:10:35.341774+0000","last_fullsized":"2024-03-09T15:10:35.341774+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:10:54.315090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":194,"num_write":349,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'797","reported_seq":2329,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.448334+0000","last_change":"2024-03-09T14:26:28.657378+0000","last_active":"2024-03-09T15:11:04.448334+0000","last_peered":"2024-03-09T15:11:04.448334+0000","last_clean":"2024-03-09T15:11:04.448334+0000","last_became_active":"2024-03-09T14:26:28.656940+0000","last_became_peered":"2024-03-09T14:26:28.656940+0000","last_unstale":"2024-03-09T15:11:04.448334+0000","last_undegraded":"2024-03-09T15:11:04.448334+0000","last_fullsized":"2024-03-09T15:11:04.448334+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:15:38.996663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3613,"num_read_kb":3222,"num_write":1070,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'206","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.581855+0000","last_change":"2024-03-09T14:26:26.641435+0000","last_active":"2024-03-09T15:08:56.581855+0000","last_peered":"2024-03-09T15:08:56.581855+0000","last_clean":"2024-03-09T15:08:56.581855+0000","last_became_active":"2024-03-09T14:26:26.641031+0000","last_became_peered":"2024-03-09T14:26:26.641031+0000","last_unstale":"2024-03-09T15:08:56.581855+0000","last_undegraded":"2024-03-09T15:08:56.581855+0000","last_fullsized":"2024-03-09T15:08:56.581855+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:53:53.180266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9752665,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":391,"num_read_kb":2692,"num_write":1147,"num_write_kb":40768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.719265+0000","last_change":"2024-03-09T14:26:30.652643+0000","last_active":"2024-03-09T15:09:01.719265+0000","last_peered":"2024-03-09T15:09:01.719265+0000","last_clean":"2024-03-09T15:09:01.719265+0000","last_became_active":"2024-03-09T14:26:30.652315+0000","last_became_peered":"2024-03-09T14:26:30.652315+0000","last_unstale":"2024-03-09T15:09:01.719265+0000","last_undegraded":"2024-03-09T15:09:01.719265+0000","last_fullsized":"2024-03-09T15:09:01.719265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:10.314147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'166","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:11.592429+0000","last_change":"2024-03-09T14:26:32.657278+0000","last_active":"2024-03-09T15:10:11.592429+0000","last_peered":"2024-03-09T15:10:11.592429+0000","last_clean":"2024-03-09T15:10:11.592429+0000","last_became_active":"2024-03-09T14:26:32.656973+0000","last_became_peered":"2024-03-09T14:26:32.656973+0000","last_unstale":"2024-03-09T15:10:11.592429+0000","last_undegraded":"2024-03-09T15:10:11.592429+0000","last_fullsized":"2024-03-09T15:10:11.592429+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:33.380705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11498,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":242,"num_write":114,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.570657+0000","last_change":"2024-03-09T14:26:34.665616+0000","last_active":"2024-03-09T15:07:41.570657+0000","last_peered":"2024-03-09T15:07:41.570657+0000","last_clean":"2024-03-09T15:07:41.570657+0000","last_became_active":"2024-03-09T14:26:34.665208+0000","last_became_peered":"2024-03-09T14:26:34.665208+0000","last_unstale":"2024-03-09T15:07:41.570657+0000","last_undegraded":"2024-03-09T15:07:41.570657+0000","last_fullsized":"2024-03-09T15:07:41.570657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:06:56.886360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'128","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:08.308795+0000","last_change":"2024-03-09T14:26:36.678157+0000","last_active":"2024-03-09T15:11:08.308795+0000","last_peered":"2024-03-09T15:11:08.308795+0000","last_clean":"2024-03-09T15:11:08.308795+0000","last_became_active":"2024-03-09T14:26:36.677867+0000","last_became_peered":"2024-03-09T14:26:36.677867+0000","last_unstale":"2024-03-09T15:11:08.308795+0000","last_undegraded":"2024-03-09T15:11:08.308795+0000","last_fullsized":"2024-03-09T15:11:08.308795+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:04:56.832371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":311,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'823","reported_seq":2497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.123341+0000","last_change":"2024-03-09T14:26:28.657249+0000","last_active":"2024-03-09T15:11:37.123341+0000","last_peered":"2024-03-09T15:11:37.123341+0000","last_clean":"2024-03-09T15:11:37.123341+0000","last_became_active":"2024-03-09T14:26:28.656960+0000","last_became_peered":"2024-03-09T14:26:28.656960+0000","last_unstale":"2024-03-09T15:11:37.123341+0000","last_undegraded":"2024-03-09T15:11:37.123341+0000","last_fullsized":"2024-03-09T15:11:37.123341+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:23.435423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4034,"num_read_kb":3617,"num_write":1125,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'213","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.581881+0000","last_change":"2024-03-09T14:26:26.650356+0000","last_active":"2024-03-09T15:08:56.581881+0000","last_peered":"2024-03-09T15:08:56.581881+0000","last_clean":"2024-03-09T15:08:56.581881+0000","last_became_active":"2024-03-09T14:26:26.649772+0000","last_became_peered":"2024-03-09T14:26:26.649772+0000","last_unstale":"2024-03-09T15:08:56.581881+0000","last_undegraded":"2024-03-09T15:08:56.581881+0000","last_fullsized":"2024-03-09T15:08:56.581881+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:59.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12930210,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":400,"num_read_kb":32014,"num_write":1022,"num_write_kb":48046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.582476+0000","last_change":"2024-03-09T14:26:30.650955+0000","last_active":"2024-03-09T15:09:01.582476+0000","last_peered":"2024-03-09T15:09:01.582476+0000","last_clean":"2024-03-09T15:09:01.582476+0000","last_became_active":"2024-03-09T14:26:30.650674+0000","last_became_peered":"2024-03-09T14:26:30.650674+0000","last_unstale":"2024-03-09T15:09:01.582476+0000","last_undegraded":"2024-03-09T15:09:01.582476+0000","last_fullsized":"2024-03-09T15:09:01.582476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:18.310162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'125","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.587145+0000","last_change":"2024-03-09T14:26:32.653856+0000","last_active":"2024-03-09T15:10:06.587145+0000","last_peered":"2024-03-09T15:10:06.587145+0000","last_clean":"2024-03-09T15:10:06.587145+0000","last_became_active":"2024-03-09T14:26:32.652397+0000","last_became_peered":"2024-03-09T14:26:32.652397+0000","last_unstale":"2024-03-09T15:10:06.587145+0000","last_undegraded":"2024-03-09T15:10:06.587145+0000","last_fullsized":"2024-03-09T15:10:06.587145+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:53:36.740581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17184,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":239,"num_write":84,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.588861+0000","last_change":"2024-03-09T14:26:34.671397+0000","last_active":"2024-03-09T15:07:51.588861+0000","last_peered":"2024-03-09T15:07:51.588861+0000","last_clean":"2024-03-09T15:07:51.588861+0000","last_became_active":"2024-03-09T14:26:34.671029+0000","last_became_peered":"2024-03-09T14:26:34.671029+0000","last_unstale":"2024-03-09T15:07:51.588861+0000","last_undegraded":"2024-03-09T15:07:51.588861+0000","last_fullsized":"2024-03-09T15:07:51.588861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:21:55.027507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'112","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:43.714487+0000","last_change":"2024-03-09T14:26:36.786838+0000","last_active":"2024-03-09T15:08:43.714487+0000","last_peered":"2024-03-09T15:08:43.714487+0000","last_clean":"2024-03-09T15:08:43.714487+0000","last_became_active":"2024-03-09T14:26:36.786449+0000","last_became_peered":"2024-03-09T14:26:36.786449+0000","last_unstale":"2024-03-09T15:08:43.714487+0000","last_undegraded":"2024-03-09T15:08:43.714487+0000","last_fullsized":"2024-03-09T15:08:43.714487+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:16:55.574602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":178,"num_write":287,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'518","reported_seq":2099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.331511+0000","last_change":"2024-03-09T14:26:28.649113+0000","last_active":"2024-03-09T15:10:35.331511+0000","last_peered":"2024-03-09T15:10:35.331511+0000","last_clean":"2024-03-09T15:10:35.331511+0000","last_became_active":"2024-03-09T14:26:28.647178+0000","last_became_peered":"2024-03-09T14:26:28.647178+0000","last_unstale":"2024-03-09T15:10:35.331511+0000","last_undegraded":"2024-03-09T15:10:35.331511+0000","last_fullsized":"2024-03-09T15:10:35.331511+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:45:41.501592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2831,"num_read_kb":2584,"num_write":686,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'265","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:24.832572+0000","last_change":"2024-03-09T14:26:26.643743+0000","last_active":"2024-03-09T15:11:24.832572+0000","last_peered":"2024-03-09T15:11:24.832572+0000","last_clean":"2024-03-09T15:11:24.832572+0000","last_became_active":"2024-03-09T14:26:26.643338+0000","last_became_peered":"2024-03-09T14:26:26.643338+0000","last_unstale":"2024-03-09T15:11:24.832572+0000","last_undegraded":"2024-03-09T15:11:24.832572+0000","last_fullsized":"2024-03-09T15:11:24.832572+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:31.097518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18897035,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":642,"num_read_kb":43219,"num_write":1334,"num_write_kb":45633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.586671+0000","last_change":"2024-03-09T14:26:30.648059+0000","last_active":"2024-03-09T15:07:36.586671+0000","last_peered":"2024-03-09T15:07:36.586671+0000","last_clean":"2024-03-09T15:07:36.586671+0000","last_became_active":"2024-03-09T14:26:30.647466+0000","last_became_peered":"2024-03-09T14:26:30.647466+0000","last_unstale":"2024-03-09T15:07:36.586671+0000","last_undegraded":"2024-03-09T15:07:36.586671+0000","last_fullsized":"2024-03-09T15:07:36.586671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:23:46.397656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'101","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.490736+0000","last_change":"2024-03-09T14:26:32.654369+0000","last_active":"2024-03-09T15:11:36.490736+0000","last_peered":"2024-03-09T15:11:36.490736+0000","last_clean":"2024-03-09T15:11:36.490736+0000","last_became_active":"2024-03-09T14:26:32.654096+0000","last_became_peered":"2024-03-09T14:26:32.654096+0000","last_unstale":"2024-03-09T15:11:36.490736+0000","last_undegraded":"2024-03-09T15:11:36.490736+0000","last_fullsized":"2024-03-09T15:11:36.490736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:18.258039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":160,"num_write":58,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.598713+0000","last_change":"2024-03-09T14:26:34.665772+0000","last_active":"2024-03-09T15:09:06.598713+0000","last_peered":"2024-03-09T15:09:06.598713+0000","last_clean":"2024-03-09T15:09:06.598713+0000","last_became_active":"2024-03-09T14:26:34.665478+0000","last_became_peered":"2024-03-09T14:26:34.665478+0000","last_unstale":"2024-03-09T15:09:06.598713+0000","last_undegraded":"2024-03-09T15:09:06.598713+0000","last_fullsized":"2024-03-09T15:09:06.598713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:56:28.715090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'118","reported_seq":1775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.464880+0000","last_change":"2024-03-09T14:26:36.678308+0000","last_active":"2024-03-09T15:11:37.464880+0000","last_peered":"2024-03-09T15:11:37.464880+0000","last_clean":"2024-03-09T15:11:37.464880+0000","last_became_active":"2024-03-09T14:26:36.677953+0000","last_became_peered":"2024-03-09T14:26:36.677953+0000","last_unstale":"2024-03-09T15:11:37.464880+0000","last_undegraded":"2024-03-09T15:11:37.464880+0000","last_fullsized":"2024-03-09T15:11:37.464880+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:17:40.272125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1291,"num_read_kb":1290,"num_write":257,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'553","reported_seq":2040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.176462+0000","last_change":"2024-03-09T14:26:28.644942+0000","last_active":"2024-03-09T15:11:09.176462+0000","last_peered":"2024-03-09T15:11:09.176462+0000","last_clean":"2024-03-09T15:11:09.176462+0000","last_became_active":"2024-03-09T14:26:28.644628+0000","last_became_peered":"2024-03-09T14:26:28.644628+0000","last_unstale":"2024-03-09T15:11:09.176462+0000","last_undegraded":"2024-03-09T15:11:09.176462+0000","last_fullsized":"2024-03-09T15:11:09.176462+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:08:03.645545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2742,"num_read_kb":2524,"num_write":748,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'198","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:20.871802+0000","last_change":"2024-03-09T14:26:26.637200+0000","last_active":"2024-03-09T15:08:20.871802+0000","last_peered":"2024-03-09T15:08:20.871802+0000","last_clean":"2024-03-09T15:08:20.871802+0000","last_became_active":"2024-03-09T14:26:26.636600+0000","last_became_peered":"2024-03-09T14:26:26.636600+0000","last_unstale":"2024-03-09T15:08:20.871802+0000","last_undegraded":"2024-03-09T15:08:20.871802+0000","last_fullsized":"2024-03-09T15:08:20.871802+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:11:27.327284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2977557,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":472,"num_read_kb":15859,"num_write":1031,"num_write_kb":26682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.563142+0000","last_change":"2024-03-09T14:26:30.651345+0000","last_active":"2024-03-09T15:07:41.563142+0000","last_peered":"2024-03-09T15:07:41.563142+0000","last_clean":"2024-03-09T15:07:41.563142+0000","last_became_active":"2024-03-09T14:26:30.650852+0000","last_became_peered":"2024-03-09T14:26:30.650852+0000","last_unstale":"2024-03-09T15:07:41.563142+0000","last_undegraded":"2024-03-09T15:07:41.563142+0000","last_fullsized":"2024-03-09T15:07:41.563142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:55:54.919531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'148","reported_seq":726,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.494435+0000","last_change":"2024-03-09T14:26:32.655600+0000","last_active":"2024-03-09T15:11:36.494435+0000","last_peered":"2024-03-09T15:11:36.494435+0000","last_clean":"2024-03-09T15:11:36.494435+0000","last_became_active":"2024-03-09T14:26:32.655220+0000","last_became_peered":"2024-03-09T14:26:32.655220+0000","last_unstale":"2024-03-09T15:11:36.494435+0000","last_undegraded":"2024-03-09T15:11:36.494435+0000","last_fullsized":"2024-03-09T15:11:36.494435+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:09:44.324675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8881,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":189,"num_read_kb":206,"num_write":102,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.580477+0000","last_change":"2024-03-09T14:26:34.673862+0000","last_active":"2024-03-09T15:09:06.580477+0000","last_peered":"2024-03-09T15:09:06.580477+0000","last_clean":"2024-03-09T15:09:06.580477+0000","last_became_active":"2024-03-09T14:26:34.673572+0000","last_became_peered":"2024-03-09T14:26:34.673572+0000","last_unstale":"2024-03-09T15:09:06.580477+0000","last_undegraded":"2024-03-09T15:09:06.580477+0000","last_fullsized":"2024-03-09T15:09:06.580477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:59.420732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'131","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:46.595865+0000","last_change":"2024-03-09T14:26:36.668917+0000","last_active":"2024-03-09T15:08:46.595865+0000","last_peered":"2024-03-09T15:08:46.595865+0000","last_clean":"2024-03-09T15:08:46.595865+0000","last_became_active":"2024-03-09T14:26:36.668616+0000","last_became_peered":"2024-03-09T14:26:36.668616+0000","last_unstale":"2024-03-09T15:08:46.595865+0000","last_undegraded":"2024-03-09T15:08:46.595865+0000","last_fullsized":"2024-03-09T15:08:46.595865+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:54:43.806686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":154,"num_write":316,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'645","reported_seq":2232,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.865830+0000","last_change":"2024-03-09T14:26:28.645899+0000","last_active":"2024-03-09T15:11:07.865830+0000","last_peered":"2024-03-09T15:11:07.865830+0000","last_clean":"2024-03-09T15:11:07.865830+0000","last_became_active":"2024-03-09T14:26:28.645626+0000","last_became_peered":"2024-03-09T14:26:28.645626+0000","last_unstale":"2024-03-09T15:11:07.865830+0000","last_undegraded":"2024-03-09T15:11:07.865830+0000","last_fullsized":"2024-03-09T15:11:07.865830+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":600,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:57.043642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3206,"num_read_kb":2874,"num_write":967,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'165","reported_seq":768,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:46.079700+0000","last_change":"2024-03-09T14:26:26.652363+0000","last_active":"2024-03-09T15:09:46.079700+0000","last_peered":"2024-03-09T15:09:46.079700+0000","last_clean":"2024-03-09T15:09:46.079700+0000","last_became_active":"2024-03-09T14:26:26.652050+0000","last_became_peered":"2024-03-09T14:26:26.652050+0000","last_unstale":"2024-03-09T15:09:46.079700+0000","last_undegraded":"2024-03-09T15:09:46.079700+0000","last_fullsized":"2024-03-09T15:09:46.079700+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:42.844197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12023466,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":327,"num_read_kb":46066,"num_write":937,"num_write_kb":31825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'424","reported_seq":2029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.131178+0000","last_change":"2024-03-09T14:26:28.652919+0000","last_active":"2024-03-09T15:11:37.131178+0000","last_peered":"2024-03-09T15:11:37.131178+0000","last_clean":"2024-03-09T15:11:37.131178+0000","last_became_active":"2024-03-09T14:26:28.652474+0000","last_became_peered":"2024-03-09T14:26:28.652474+0000","last_unstale":"2024-03-09T15:11:37.131178+0000","last_undegraded":"2024-03-09T15:11:37.131178+0000","last_fullsized":"2024-03-09T15:11:37.131178+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:16:37.419231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2338,"num_read_kb":2225,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'228","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:24.914180+0000","last_change":"2024-03-09T14:26:26.636278+0000","last_active":"2024-03-09T15:11:24.914180+0000","last_peered":"2024-03-09T15:11:24.914180+0000","last_clean":"2024-03-09T15:11:24.914180+0000","last_became_active":"2024-03-09T14:26:26.635943+0000","last_became_peered":"2024-03-09T14:26:26.635943+0000","last_unstale":"2024-03-09T15:11:24.914180+0000","last_undegraded":"2024-03-09T15:11:24.914180+0000","last_fullsized":"2024-03-09T15:11:24.914180+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:16.699434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340097,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":21029,"num_write":1137,"num_write_kb":21105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'402","reported_seq":1826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.431048+0000","last_change":"2024-03-09T14:26:28.646197+0000","last_active":"2024-03-09T15:11:04.431048+0000","last_peered":"2024-03-09T15:11:04.431048+0000","last_clean":"2024-03-09T15:11:04.431048+0000","last_became_active":"2024-03-09T14:26:28.645917+0000","last_became_peered":"2024-03-09T14:26:28.645917+0000","last_unstale":"2024-03-09T15:11:04.431048+0000","last_undegraded":"2024-03-09T15:11:04.431048+0000","last_fullsized":"2024-03-09T15:11:04.431048+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:35.149765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2143,"num_read_kb":1999,"num_write":476,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'193","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:20.184684+0000","last_change":"2024-03-09T14:26:26.648411+0000","last_active":"2024-03-09T15:08:20.184684+0000","last_peered":"2024-03-09T15:08:20.184684+0000","last_clean":"2024-03-09T15:08:20.184684+0000","last_became_active":"2024-03-09T14:26:26.648084+0000","last_became_peered":"2024-03-09T14:26:26.648084+0000","last_unstale":"2024-03-09T15:08:20.184684+0000","last_undegraded":"2024-03-09T15:08:20.184684+0000","last_fullsized":"2024-03-09T15:08:20.184684+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:33.823275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7394875,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":451,"num_read_kb":30660,"num_write":1031,"num_write_kb":42042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'1285","reported_seq":2878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:27.537784+0000","last_change":"2024-03-09T14:26:28.647203+0000","last_active":"2024-03-09T15:09:27.537784+0000","last_peered":"2024-03-09T15:09:27.537784+0000","last_clean":"2024-03-09T15:09:27.537784+0000","last_became_active":"2024-03-09T14:26:28.646936+0000","last_became_peered":"2024-03-09T14:26:28.646936+0000","last_unstale":"2024-03-09T15:09:27.537784+0000","last_undegraded":"2024-03-09T15:09:27.537784+0000","last_fullsized":"2024-03-09T15:09:27.537784+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:30:25.079154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5472,"num_read_kb":4757,"num_write":1845,"num_write_kb":841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'169","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:58.674844+0000","last_change":"2024-03-09T14:26:26.632719+0000","last_active":"2024-03-09T15:08:58.674844+0000","last_peered":"2024-03-09T15:08:58.674844+0000","last_clean":"2024-03-09T15:08:58.674844+0000","last_became_active":"2024-03-09T14:26:26.632394+0000","last_became_peered":"2024-03-09T14:26:26.632394+0000","last_unstale":"2024-03-09T15:08:58.674844+0000","last_undegraded":"2024-03-09T15:08:58.674844+0000","last_fullsized":"2024-03-09T15:08:58.674844+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:11:31.631305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8412719,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":374,"num_read_kb":61859,"num_write":995,"num_write_kb":24366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'709","reported_seq":2155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.166230+0000","last_change":"2024-03-09T14:26:28.656837+0000","last_active":"2024-03-09T15:10:42.166230+0000","last_peered":"2024-03-09T15:10:42.166230+0000","last_clean":"2024-03-09T15:10:42.166230+0000","last_became_active":"2024-03-09T14:26:28.655549+0000","last_became_peered":"2024-03-09T14:26:28.655549+0000","last_unstale":"2024-03-09T15:10:42.166230+0000","last_undegraded":"2024-03-09T15:10:42.166230+0000","last_fullsized":"2024-03-09T15:10:42.166230+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:44.581756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3228,"num_read_kb":2913,"num_write":936,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'242","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:18.097684+0000","last_change":"2024-03-09T14:26:26.641172+0000","last_active":"2024-03-09T15:08:18.097684+0000","last_peered":"2024-03-09T15:08:18.097684+0000","last_clean":"2024-03-09T15:08:18.097684+0000","last_became_active":"2024-03-09T14:26:26.640874+0000","last_became_peered":"2024-03-09T14:26:26.640874+0000","last_unstale":"2024-03-09T15:08:18.097684+0000","last_undegraded":"2024-03-09T15:08:18.097684+0000","last_fullsized":"2024-03-09T15:08:18.097684+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:53:42.224141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6964972,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":546,"num_read_kb":47489,"num_write":1241,"num_write_kb":60004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'342","reported_seq":1774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.320525+0000","last_change":"2024-03-09T14:26:28.645684+0000","last_active":"2024-03-09T15:10:45.320525+0000","last_peered":"2024-03-09T15:10:45.320525+0000","last_clean":"2024-03-09T15:10:45.320525+0000","last_became_active":"2024-03-09T14:26:28.645393+0000","last_became_peered":"2024-03-09T14:26:28.645393+0000","last_unstale":"2024-03-09T15:10:45.320525+0000","last_undegraded":"2024-03-09T15:10:45.320525+0000","last_fullsized":"2024-03-09T15:10:45.320525+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:56.794238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1972,"num_read_kb":1873,"num_write":396,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'179","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.208070+0000","last_change":"2024-03-09T14:26:26.631389+0000","last_active":"2024-03-09T15:10:35.208070+0000","last_peered":"2024-03-09T15:10:35.208070+0000","last_clean":"2024-03-09T15:10:35.208070+0000","last_became_active":"2024-03-09T14:26:26.631046+0000","last_became_peered":"2024-03-09T14:26:26.631046+0000","last_unstale":"2024-03-09T15:10:35.208070+0000","last_undegraded":"2024-03-09T15:10:35.208070+0000","last_fullsized":"2024-03-09T15:10:35.208070+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:11:06.737937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7710007,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":457,"num_read_kb":18518,"num_write":1078,"num_write_kb":23654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'765","reported_seq":2186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.177793+0000","last_change":"2024-03-09T14:26:28.652220+0000","last_active":"2024-03-09T15:11:09.177793+0000","last_peered":"2024-03-09T15:11:09.177793+0000","last_clean":"2024-03-09T15:11:09.177793+0000","last_became_active":"2024-03-09T14:26:28.651945+0000","last_became_peered":"2024-03-09T14:26:28.651945+0000","last_unstale":"2024-03-09T15:11:09.177793+0000","last_undegraded":"2024-03-09T15:11:09.177793+0000","last_fullsized":"2024-03-09T15:11:09.177793+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:11.189515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3422,"num_read_kb":3025,"num_write":1046,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'207","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:00.970317+0000","last_change":"2024-03-09T14:26:26.645774+0000","last_active":"2024-03-09T15:11:00.970317+0000","last_peered":"2024-03-09T15:11:00.970317+0000","last_clean":"2024-03-09T15:11:00.970317+0000","last_became_active":"2024-03-09T14:26:26.645379+0000","last_became_peered":"2024-03-09T14:26:26.645379+0000","last_unstale":"2024-03-09T15:11:00.970317+0000","last_undegraded":"2024-03-09T15:11:00.970317+0000","last_fullsized":"2024-03-09T15:11:00.970317+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:29:31.655184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11989,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":544,"num_read_kb":953,"num_write":1104,"num_write_kb":19452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'1201","reported_seq":2796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.336817+0000","last_change":"2024-03-09T14:26:28.652319+0000","last_active":"2024-03-09T15:10:35.336817+0000","last_peered":"2024-03-09T15:10:35.336817+0000","last_clean":"2024-03-09T15:10:35.336817+0000","last_became_active":"2024-03-09T14:26:28.651254+0000","last_became_peered":"2024-03-09T14:26:28.651254+0000","last_unstale":"2024-03-09T15:10:35.336817+0000","last_undegraded":"2024-03-09T15:10:35.336817+0000","last_fullsized":"2024-03-09T15:10:35.336817+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":1100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:17:36.798177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5174,"num_read_kb":4521,"num_write":1709,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'209","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:50.564141+0000","last_change":"2024-03-09T14:26:26.640461+0000","last_active":"2024-03-09T15:09:50.564141+0000","last_peered":"2024-03-09T15:09:50.564141+0000","last_clean":"2024-03-09T15:09:50.564141+0000","last_became_active":"2024-03-09T14:26:26.639719+0000","last_became_peered":"2024-03-09T14:26:26.639719+0000","last_unstale":"2024-03-09T15:09:50.564141+0000","last_undegraded":"2024-03-09T15:09:50.564141+0000","last_fullsized":"2024-03-09T15:09:50.564141+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:52.609065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16421214,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":521,"num_read_kb":50172,"num_write":1164,"num_write_kb":33138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1152","reported_seq":2678,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.124689+0000","last_change":"2024-03-09T14:26:28.648946+0000","last_active":"2024-03-09T15:11:37.124689+0000","last_peered":"2024-03-09T15:11:37.124689+0000","last_clean":"2024-03-09T15:11:37.124689+0000","last_became_active":"2024-03-09T14:26:28.648626+0000","last_became_peered":"2024-03-09T14:26:28.648626+0000","last_unstale":"2024-03-09T15:11:37.124689+0000","last_undegraded":"2024-03-09T15:11:37.124689+0000","last_fullsized":"2024-03-09T15:11:37.124689+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:23:27.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4796,"num_read_kb":4189,"num_write":1590,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'182","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.006378+0000","last_change":"2024-03-09T14:26:26.640526+0000","last_active":"2024-03-09T15:11:37.006378+0000","last_peered":"2024-03-09T15:11:37.006378+0000","last_clean":"2024-03-09T15:11:37.006378+0000","last_became_active":"2024-03-09T14:26:26.640157+0000","last_became_peered":"2024-03-09T14:26:26.640157+0000","last_unstale":"2024-03-09T15:11:37.006378+0000","last_undegraded":"2024-03-09T15:11:37.006378+0000","last_fullsized":"2024-03-09T15:11:37.006378+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:22.974524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5571611,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":437,"num_read_kb":19255,"num_write":998,"num_write_kb":28212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'708","reported_seq":2134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.078327+0000","last_change":"2024-03-09T14:26:28.650311+0000","last_active":"2024-03-09T15:10:51.078327+0000","last_peered":"2024-03-09T15:10:51.078327+0000","last_clean":"2024-03-09T15:10:51.078327+0000","last_became_active":"2024-03-09T14:26:28.650013+0000","last_became_peered":"2024-03-09T14:26:28.650013+0000","last_unstale":"2024-03-09T15:10:51.078327+0000","last_undegraded":"2024-03-09T15:10:51.078327+0000","last_fullsized":"2024-03-09T15:10:51.078327+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":600,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:26.543324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3189,"num_read_kb":2865,"num_write":935,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'206","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.469017+0000","last_change":"2024-03-09T14:26:26.642035+0000","last_active":"2024-03-09T15:10:36.469017+0000","last_peered":"2024-03-09T15:10:36.469017+0000","last_clean":"2024-03-09T15:10:36.469017+0000","last_became_active":"2024-03-09T14:26:26.641737+0000","last_became_peered":"2024-03-09T14:26:26.641737+0000","last_unstale":"2024-03-09T15:10:36.469017+0000","last_undegraded":"2024-03-09T15:10:36.469017+0000","last_fullsized":"2024-03-09T15:10:36.469017+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:42:55.138498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5853727,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":491,"num_read_kb":32584,"num_write":1132,"num_write_kb":28426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'421","reported_seq":2053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.552733+0000","last_change":"2024-03-09T14:26:28.644372+0000","last_active":"2024-03-09T15:10:54.552733+0000","last_peered":"2024-03-09T15:10:54.552733+0000","last_clean":"2024-03-09T15:10:54.552733+0000","last_became_active":"2024-03-09T14:26:28.644094+0000","last_became_peered":"2024-03-09T14:26:28.644094+0000","last_unstale":"2024-03-09T15:10:54.552733+0000","last_undegraded":"2024-03-09T15:10:54.552733+0000","last_fullsized":"2024-03-09T15:10:54.552733+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:42.631901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2230,"num_write":484,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'211","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:11.583745+0000","last_change":"2024-03-09T14:26:26.645771+0000","last_active":"2024-03-09T15:09:11.583745+0000","last_peered":"2024-03-09T15:09:11.583745+0000","last_clean":"2024-03-09T15:09:11.583745+0000","last_became_active":"2024-03-09T14:26:26.645413+0000","last_became_peered":"2024-03-09T14:26:26.645413+0000","last_unstale":"2024-03-09T15:09:11.583745+0000","last_undegraded":"2024-03-09T15:09:11.583745+0000","last_fullsized":"2024-03-09T15:09:11.583745+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:23:25.742745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269833,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":456,"num_read_kb":3495,"num_write":1053,"num_write_kb":12293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'790","reported_seq":2457,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.600171+0000","last_change":"2024-03-09T14:26:28.650961+0000","last_active":"2024-03-09T15:09:16.600171+0000","last_peered":"2024-03-09T15:09:16.600171+0000","last_clean":"2024-03-09T15:09:16.600171+0000","last_became_active":"2024-03-09T14:26:28.650629+0000","last_became_peered":"2024-03-09T14:26:28.650629+0000","last_unstale":"2024-03-09T15:09:16.600171+0000","last_undegraded":"2024-03-09T15:09:16.600171+0000","last_fullsized":"2024-03-09T15:09:16.600171+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:53:42.426447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3842,"num_read_kb":3483,"num_write":1039,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'230","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:11.580982+0000","last_change":"2024-03-09T14:26:26.644786+0000","last_active":"2024-03-09T15:09:11.580982+0000","last_peered":"2024-03-09T15:09:11.580982+0000","last_clean":"2024-03-09T15:09:11.580982+0000","last_became_active":"2024-03-09T14:26:26.644358+0000","last_became_peered":"2024-03-09T14:26:26.644358+0000","last_unstale":"2024-03-09T15:09:11.580982+0000","last_undegraded":"2024-03-09T15:09:11.580982+0000","last_fullsized":"2024-03-09T15:09:11.580982+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:25:50.487416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11881660,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":7434,"num_write":1300,"num_write_kb":33527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'509","reported_seq":2075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.121732+0000","last_change":"2024-03-09T14:26:28.655751+0000","last_active":"2024-03-09T15:11:37.121732+0000","last_peered":"2024-03-09T15:11:37.121732+0000","last_clean":"2024-03-09T15:11:37.121732+0000","last_became_active":"2024-03-09T14:26:28.655438+0000","last_became_peered":"2024-03-09T14:26:28.655438+0000","last_unstale":"2024-03-09T15:11:37.121732+0000","last_undegraded":"2024-03-09T15:11:37.121732+0000","last_fullsized":"2024-03-09T15:11:37.121732+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:20:48.282049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2613,"num_read_kb":2408,"num_write":650,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'181","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.493354+0000","last_change":"2024-03-09T14:26:26.649089+0000","last_active":"2024-03-09T15:11:26.493354+0000","last_peered":"2024-03-09T15:11:26.493354+0000","last_clean":"2024-03-09T15:11:26.493354+0000","last_became_active":"2024-03-09T14:26:26.648682+0000","last_became_peered":"2024-03-09T14:26:26.648682+0000","last_unstale":"2024-03-09T15:11:26.493354+0000","last_undegraded":"2024-03-09T15:11:26.493354+0000","last_fullsized":"2024-03-09T15:11:26.493354+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:54:12.434919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2164234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":6066,"num_write":1000,"num_write_kb":27510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'408","reported_seq":2014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.553857+0000","last_change":"2024-03-09T14:26:28.646581+0000","last_active":"2024-03-09T15:10:54.553857+0000","last_peered":"2024-03-09T15:10:54.553857+0000","last_clean":"2024-03-09T15:10:54.553857+0000","last_became_active":"2024-03-09T14:26:28.646239+0000","last_became_peered":"2024-03-09T14:26:28.646239+0000","last_unstale":"2024-03-09T15:10:54.553857+0000","last_undegraded":"2024-03-09T15:10:54.553857+0000","last_fullsized":"2024-03-09T15:10:54.553857+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:05.491938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2327,"num_read_kb":2213,"num_write":484,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'211","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.721377+0000","last_change":"2024-03-09T14:26:26.646103+0000","last_active":"2024-03-09T15:09:16.721377+0000","last_peered":"2024-03-09T15:09:16.721377+0000","last_clean":"2024-03-09T15:09:16.721377+0000","last_became_active":"2024-03-09T14:26:26.645230+0000","last_became_peered":"2024-03-09T14:26:26.645230+0000","last_unstale":"2024-03-09T15:09:16.721377+0000","last_undegraded":"2024-03-09T15:09:16.721377+0000","last_fullsized":"2024-03-09T15:09:16.721377+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:46:59.836355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7622315,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":431,"num_read_kb":27386,"num_write":1082,"num_write_kb":24817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'342","reported_seq":1816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.357304+0000","last_change":"2024-03-09T14:26:28.653452+0000","last_active":"2024-03-09T15:10:35.357304+0000","last_peered":"2024-03-09T15:10:35.357304+0000","last_clean":"2024-03-09T15:10:35.357304+0000","last_became_active":"2024-03-09T14:26:28.653177+0000","last_became_peered":"2024-03-09T14:26:28.653177+0000","last_unstale":"2024-03-09T15:10:35.357304+0000","last_undegraded":"2024-03-09T15:10:35.357304+0000","last_fullsized":"2024-03-09T15:10:35.357304+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:12:43.827174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1954,"num_read_kb":1880,"num_write":380,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'192","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.563634+0000","last_change":"2024-03-09T14:26:26.637956+0000","last_active":"2024-03-09T15:08:26.563634+0000","last_peered":"2024-03-09T15:08:26.563634+0000","last_clean":"2024-03-09T15:08:26.563634+0000","last_became_active":"2024-03-09T14:26:26.637589+0000","last_became_peered":"2024-03-09T14:26:26.637589+0000","last_unstale":"2024-03-09T15:08:26.563634+0000","last_undegraded":"2024-03-09T15:08:26.563634+0000","last_fullsized":"2024-03-09T15:08:26.563634+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:33.711328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10750031,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":377,"num_read_kb":13354,"num_write":1021,"num_write_kb":55720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'1151","reported_seq":2610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.127436+0000","last_change":"2024-03-09T14:26:28.655806+0000","last_active":"2024-03-09T15:11:37.127436+0000","last_peered":"2024-03-09T15:11:37.127436+0000","last_clean":"2024-03-09T15:11:37.127436+0000","last_became_active":"2024-03-09T14:26:28.655383+0000","last_became_peered":"2024-03-09T14:26:28.655383+0000","last_unstale":"2024-03-09T15:11:37.127436+0000","last_undegraded":"2024-03-09T15:11:37.127436+0000","last_fullsized":"2024-03-09T15:11:37.127436+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:09:15.464868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4791,"num_read_kb":4166,"num_write":1605,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'228","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.578230+0000","last_change":"2024-03-09T14:26:26.653398+0000","last_active":"2024-03-09T15:08:26.578230+0000","last_peered":"2024-03-09T15:08:26.578230+0000","last_clean":"2024-03-09T15:08:26.578230+0000","last_became_active":"2024-03-09T14:26:26.652576+0000","last_became_peered":"2024-03-09T14:26:26.652576+0000","last_unstale":"2024-03-09T15:08:26.578230+0000","last_undegraded":"2024-03-09T15:08:26.578230+0000","last_fullsized":"2024-03-09T15:08:26.578230+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:27:29.674744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3830168,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":651,"num_read_kb":5204,"num_write":1019,"num_write_kb":18451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'311","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.578116+0000","last_change":"2024-03-09T14:27:03.716194+0000","last_active":"2024-03-09T15:08:26.578116+0000","last_peered":"2024-03-09T15:08:26.578116+0000","last_clean":"2024-03-09T15:08:26.578116+0000","last_became_active":"2024-03-09T14:27:03.715719+0000","last_became_peered":"2024-03-09T14:27:03.715719+0000","last_unstale":"2024-03-09T15:08:26.578116+0000","last_undegraded":"2024-03-09T15:08:26.578116+0000","last_fullsized":"2024-03-09T15:08:26.578116+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:14.860709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11557044,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":835,"num_read_kb":60306,"num_write":1283,"num_write_kb":31608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'792","reported_seq":2406,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.338529+0000","last_change":"2024-03-09T14:26:28.649429+0000","last_active":"2024-03-09T15:10:35.338529+0000","last_peered":"2024-03-09T15:10:35.338529+0000","last_clean":"2024-03-09T15:10:35.338529+0000","last_became_active":"2024-03-09T14:26:28.649178+0000","last_became_peered":"2024-03-09T14:26:28.649178+0000","last_unstale":"2024-03-09T15:10:35.338529+0000","last_undegraded":"2024-03-09T15:10:35.338529+0000","last_fullsized":"2024-03-09T15:10:35.338529+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:22:23.602537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3684,"num_read_kb":3311,"num_write":1055,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'185","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.568496+0000","last_change":"2024-03-09T14:27:03.721922+0000","last_active":"2024-03-09T15:08:26.568496+0000","last_peered":"2024-03-09T15:08:26.568496+0000","last_clean":"2024-03-09T15:08:26.568496+0000","last_became_active":"2024-03-09T14:27:03.721595+0000","last_became_peered":"2024-03-09T14:27:03.721595+0000","last_unstale":"2024-03-09T15:08:26.568496+0000","last_undegraded":"2024-03-09T15:08:26.568496+0000","last_fullsized":"2024-03-09T15:08:26.568496+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:37:54.615568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12408196,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":487,"num_read_kb":112993,"num_write":1047,"num_write_kb":48480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'387","reported_seq":2043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.590524+0000","last_change":"2024-03-09T14:26:28.645372+0000","last_active":"2024-03-09T15:10:36.590524+0000","last_peered":"2024-03-09T15:10:36.590524+0000","last_clean":"2024-03-09T15:10:36.590524+0000","last_became_active":"2024-03-09T14:26:28.645067+0000","last_became_peered":"2024-03-09T14:26:28.645067+0000","last_unstale":"2024-03-09T15:10:36.590524+0000","last_undegraded":"2024-03-09T15:10:36.590524+0000","last_fullsized":"2024-03-09T15:10:36.590524+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:44:56.178003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2475,"num_read_kb":2383,"num_write":438,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5887,"num_read_kb":4246,"num_write":2185,"num_write_kb":841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1217,"ondisk_log_size":1217,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":12946,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":15495,"num_read_kb":15279,"num_write":16228,"num_write_kb":4747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":507904,"data_stored":25892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1762,"ondisk_log_size":1762,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":408,"ondisk_log_size":408,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":438641,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":7752,"num_read_kb":9480,"num_write":5539,"num_write_kb":2830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":770048,"data_stored":239200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2159,"ondisk_log_size":2159,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1583,"num_read_kb":1885,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":195183,"num_read_kb":178329,"num_write":51691,"num_write_kb":17736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":121,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3837,"ondisk_log_size":3837,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":554823561,"num_objects":519,"num_object_clones":0,"num_object_copies":1557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":519,"num_whiteouts":0,"num_read":32040,"num_read_kb":2319153,"num_write":69560,"num_write_kb":2158516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":835055616,"data_stored":835055616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4404,"ondisk_log_size":4404,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":89222774,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":133,"num_read_kb":164063,"num_write":151,"num_write_kb":125047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":178454528,"data_stored":178445548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":89222774,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":139,"num_read_kb":183429,"num_write":151,"num_write_kb":125047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":178454528,"data_stored":178445548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575400,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444216,"kb_used_data":174256,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93927624,"statfs":{"total":96636764160,"available":96181886976,"internally_reserved":0,"allocated":178438144,"data_stored":176418466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575399,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378896,"kb_used_data":122824,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93992944,"statfs":{"total":96636764160,"available":96248774656,"internally_reserved":0,"allocated":125771776,"data_stored":123793256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575400,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241656,"kb_used_data":156336,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94130184,"statfs":{"total":96636764160,"available":96389308416,"internally_reserved":0,"allocated":160088064,"data_stored":158047167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575398,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":234120,"kb_used_data":148800,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94137720,"statfs":{"total":96636764160,"available":96397025280,"internally_reserved":0,"allocated":152371200,"data_stored":150461065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575399,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409320,"kb_used_data":175456,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93962520,"statfs":{"total":96636764160,"available":96217620480,"internally_reserved":0,"allocated":179666944,"data_stored":177639659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575398,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":210328,"kb_used_data":138896,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94161512,"statfs":{"total":96636764160,"available":96421388288,"internally_reserved":0,"allocated":142229504,"data_stored":140290947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575399,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272976,"kb_used_data":151624,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94098864,"statfs":{"total":96636764160,"available":96357236736,"internally_reserved":0,"allocated":155262976,"data_stored":153295586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575399,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368572,"kb_used_data":130548,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94003268,"statfs":{"total":96636764160,"available":96259346432,"internally_reserved":0,"allocated":133681152,"data_stored":131671448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93069312,"data_stored":93069312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":112103424,"data_stored":112103424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":92852224,"data_stored":92852224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106057728,"data_stored":106057728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":118755328,"data_stored":118755328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":100155392,"data_stored":100155392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":92041216,"data_stored":92041216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":120020992,"data_stored":120020992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":27934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":30982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":16269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":39607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":12830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":35670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":27123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":48785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18927616,"data_stored":18924827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18919424,"data_stored":18917723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19980288,"data_stored":19976613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34603008,"data_stored":34603008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15769600,"data_stored":15768785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19963904,"data_stored":19963089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32559104,"data_stored":32556315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":47243264,"data_stored":47239589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13676544,"data_stored":13674843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:11:47.222 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-09T15:11:47.540 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:47.541 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":264,"fsid":"03df7284-17fe-4d16-b21b-e9f66257a07a","created":"2024-03-09T14:25:58.242538+0000","modified":"2024-03-09T14:50:36.502994+0000","last_up_change":"2024-03-09T14:26:10.535661+0000","last_in_change":"2024-03-09T14:26:01.605867+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-09T14:26:12.498536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-09T14:26:17.375242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-03-09T14:26:24.605270+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-03-09T14:26:26.945780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-03-09T14:26:28.869512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-03-09T14:26:30.913850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-03-09T14:26:32.657678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-03-09T14:26:34.732162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-03-09T14:35:39.807922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"253","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-03-09T14:38:32.558623+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-03-09T14:38:36.116131+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-03-09T14:50:34.108976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"264","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d531a182-caf7-48a3-b1c6-6b1a1d03b78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6801","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6804","nonce":2236481287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6807","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6810","nonce":2236481287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6824","nonce":2236481287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2236481287},{"type":"v1","addr":"172.21.15.88:6818","nonce":2236481287}]},"public_addr":"172.21.15.88:6804/2236481287","cluster_addr":"172.21.15.88:6810/2236481287","heartbeat_back_addr":"172.21.15.88:6824/2236481287","heartbeat_front_addr":"172.21.15.88:6818/2236481287","state":["exists","up"]},{"osd":1,"uuid":"f48391d3-6559-46bc-a653-d5c3fee9d3cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6805","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6809","nonce":1625923178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6813","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6817","nonce":1625923178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6831","nonce":1625923178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1625923178},{"type":"v1","addr":"172.21.15.88:6826","nonce":1625923178}]},"public_addr":"172.21.15.88:6809/1625923178","cluster_addr":"172.21.15.88:6817/1625923178","heartbeat_back_addr":"172.21.15.88:6831/1625923178","heartbeat_front_addr":"172.21.15.88:6826/1625923178","state":["exists","up"]},{"osd":2,"uuid":"5fa8603b-cf11-4b51-804d-c4e50074282a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6803","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6806","nonce":583120953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6815","nonce":583120953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6827","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6830","nonce":583120953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":583120953},{"type":"v1","addr":"172.21.15.88:6823","nonce":583120953}]},"public_addr":"172.21.15.88:6806/583120953","cluster_addr":"172.21.15.88:6815/583120953","heartbeat_back_addr":"172.21.15.88:6830/583120953","heartbeat_front_addr":"172.21.15.88:6823/583120953","state":["exists","up"]},{"osd":3,"uuid":"e48253bd-989b-4c33-8ef7-7653bd46398d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6802","nonce":4216886240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6812","nonce":4216886240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6829","nonce":4216886240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":4216886240},{"type":"v1","addr":"172.21.15.88:6820","nonce":4216886240}]},"public_addr":"172.21.15.88:6802/4216886240","cluster_addr":"172.21.15.88:6812/4216886240","heartbeat_back_addr":"172.21.15.88:6829/4216886240","heartbeat_front_addr":"172.21.15.88:6820/4216886240","state":["exists","up"]},{"osd":4,"uuid":"6a17d606-dc8c-49d4-ab53-e9a159f8c6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6811","nonce":692310395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6813","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6815","nonce":692310395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6822","nonce":692310395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":692310395},{"type":"v1","addr":"172.21.15.132:6819","nonce":692310395}]},"public_addr":"172.21.15.132:6811/692310395","cluster_addr":"172.21.15.132:6815/692310395","heartbeat_back_addr":"172.21.15.132:6822/692310395","heartbeat_front_addr":"172.21.15.132:6819/692310395","state":["exists","up"]},{"osd":5,"uuid":"f37be8a2-bc4d-4e78-8bfa-3c25638c40aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6801","nonce":1549387301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6803","nonce":1549387301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6807","nonce":1549387301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1549387301},{"type":"v1","addr":"172.21.15.132:6805","nonce":1549387301}]},"public_addr":"172.21.15.132:6801/1549387301","cluster_addr":"172.21.15.132:6803/1549387301","heartbeat_back_addr":"172.21.15.132:6807/1549387301","heartbeat_front_addr":"172.21.15.132:6805/1549387301","state":["exists","up"]},{"osd":6,"uuid":"cd0b6340-5c8c-42a3-a243-8844f6835578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6825","nonce":731564406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6827","nonce":731564406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6831","nonce":731564406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":731564406},{"type":"v1","addr":"172.21.15.132:6829","nonce":731564406}]},"public_addr":"172.21.15.132:6825/731564406","cluster_addr":"172.21.15.132:6827/731564406","heartbeat_back_addr":"172.21.15.132:6831/731564406","heartbeat_front_addr":"172.21.15.132:6829/731564406","state":["exists","up"]},{"osd":7,"uuid":"f1b5ac52-e196-4c45-8f7b-ab90275431fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6810","nonce":251080901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6814","nonce":251080901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6823","nonce":251080901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":251080901},{"type":"v1","addr":"172.21.15.132:6818","nonce":251080901}]},"public_addr":"172.21.15.132:6810/251080901","cluster_addr":"172.21.15.132:6814/251080901","heartbeat_back_addr":"172.21.15.132:6823/251080901","heartbeat_front_addr":"172.21.15.132:6818/251080901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.782366+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.849444+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.738463+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.810770+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.780862+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.684764+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.707622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:26:06.740773+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":4,"to":2}]},{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":2},{"from":0,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.1b","mappings":[{"from":4,"to":1}]},{"pgid":"3.30","mappings":[{"from":4,"to":2}]},{"pgid":"3.31","mappings":[{"from":4,"to":2}]},{"pgid":"3.3f","mappings":[{"from":6,"to":1}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":1,"to":5}]},{"pgid":"67.c","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T15:11:48.555 INFO:tasks.ceph:Scrubbing osd.0 2024-03-09T15:11:48.555 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:11:48.706 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T15:11:48.706 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:11:48.707 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T15:11:48.717 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-09T15:11:49.016 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 0 to deep-scrub 2024-03-09T15:11:49.029 INFO:tasks.ceph:Scrubbing osd.1 2024-03-09T15:11:49.029 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:11:49.166 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T15:11:49.166 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:11:49.167 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T15:11:49.177 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-09T15:11:49.475 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 1 to deep-scrub 2024-03-09T15:11:49.489 INFO:tasks.ceph:Scrubbing osd.2 2024-03-09T15:11:49.489 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:11:49.626 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T15:11:49.627 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:11:49.627 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T15:11:49.637 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-09T15:11:49.933 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 2 to deep-scrub 2024-03-09T15:11:49.947 INFO:tasks.ceph:Scrubbing osd.3 2024-03-09T15:11:49.947 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:11:50.085 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T15:11:50.085 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:11:50.086 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T15:11:50.096 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-09T15:11:50.393 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 3 to deep-scrub 2024-03-09T15:11:50.407 INFO:tasks.ceph:Scrubbing osd.4 2024-03-09T15:11:50.408 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:11:50.546 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T15:11:50.547 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:11:50.547 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T15:11:50.558 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-09T15:11:50.859 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 4 to deep-scrub 2024-03-09T15:11:50.872 INFO:tasks.ceph:Scrubbing osd.5 2024-03-09T15:11:50.872 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:11:50.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-03-09T15:11:51.010 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T15:11:51.011 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:11:51.011 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T15:11:51.021 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-09T15:11:51.321 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 5 to deep-scrub 2024-03-09T15:11:51.334 INFO:tasks.ceph:Scrubbing osd.6 2024-03-09T15:11:51.334 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:11:51.473 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T15:11:51.474 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:11:51.474 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T15:11:51.484 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-09T15:11:51.788 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 6 to deep-scrub 2024-03-09T15:11:51.801 INFO:tasks.ceph:Scrubbing osd.7 2024-03-09T15:11:51.801 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:11:51.941 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-03-09T15:11:51.941 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:11:51.941 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-03-09T15:11:51.952 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-09T15:11:52.254 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 7 to deep-scrub 2024-03-09T15:11:52.268 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:11:52.597 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:11:52.608 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-03-09T15:11:52.610 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":1627,"stamp":"2024-03-09T15:11:51.534921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":190210338,"num_objects":676,"num_object_clones":0,"num_object_copies":1593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":676,"num_whiteouts":0,"num_read":259041,"num_read_kb":2876724,"num_write":146172,"num_write_kb":2437235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":166,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13984,"ondisk_log_size":13984,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1756976,"kb_used_data":395232,"kb_used_omap":12,"kb_used_meta":1361267,"kb_avail":753217744,"statfs":{"total":773094113280,"available":771294969856,"internally_reserved":0,"allocated":404717568,"data_stored":389087564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1393937968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-548295695,"num_objects":-352,"num_object_clones":0,"num_object_copies":-983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-352,"num_whiteouts":0,"num_read":887,"num_read_kb":940,"num_write":512,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004921"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.575812+0000","last_change":"2024-03-09T14:50:35.506808+0000","last_active":"2024-03-09T15:08:06.575812+0000","last_peered":"2024-03-09T15:08:06.575812+0000","last_clean":"2024-03-09T15:08:06.575812+0000","last_became_active":"2024-03-09T14:50:35.506543+0000","last_became_peered":"2024-03-09T14:50:35.506543+0000","last_unstale":"2024-03-09T15:08:06.575812+0000","last_undegraded":"2024-03-09T15:08:06.575812+0000","last_fullsized":"2024-03-09T15:08:06.575812+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:58.593691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'7","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.953847+0000","last_change":"2024-03-09T14:38:37.436681+0000","last_active":"2024-03-09T15:11:45.953847+0000","last_peered":"2024-03-09T15:11:45.953847+0000","last_clean":"2024-03-09T15:11:45.953847+0000","last_became_active":"2024-03-09T14:38:37.436381+0000","last_became_peered":"2024-03-09T14:38:37.436381+0000","last_unstale":"2024-03-09T15:11:45.953847+0000","last_undegraded":"2024-03-09T15:11:45.953847+0000","last_fullsized":"2024-03-09T15:11:45.953847+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:00:43.470078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'4","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.112913+0000","last_change":"2024-03-09T15:11:51.112934+0000","last_active":"2024-03-09T15:11:51.112913+0000","last_peered":"2024-03-09T15:11:51.112913+0000","last_clean":"2024-03-09T15:11:51.112913+0000","last_became_active":"2024-03-09T14:38:34.418748+0000","last_became_peered":"2024-03-09T14:38:34.418748+0000","last_unstale":"2024-03-09T15:11:51.112913+0000","last_undegraded":"2024-03-09T15:11:51.112913+0000","last_fullsized":"2024-03-09T15:11:51.112913+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-03-09T15:11:51.112840+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-03-09T15:11:51.112840+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.112840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:50.837065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'22","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.579987+0000","last_change":"2024-03-09T14:35:41.122537+0000","last_active":"2024-03-09T15:09:01.579987+0000","last_peered":"2024-03-09T15:09:01.579987+0000","last_clean":"2024-03-09T15:09:01.579987+0000","last_became_active":"2024-03-09T14:35:41.121412+0000","last_became_peered":"2024-03-09T14:35:41.121412+0000","last_unstale":"2024-03-09T15:09:01.579987+0000","last_undegraded":"2024-03-09T15:09:01.579987+0000","last_fullsized":"2024-03-09T15:09:01.579987+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:26:10.508823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":67,"num_write":35,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.561315+0000","last_change":"2024-03-09T14:50:35.507193+0000","last_active":"2024-03-09T15:08:06.561315+0000","last_peered":"2024-03-09T15:08:06.561315+0000","last_clean":"2024-03-09T15:08:06.561315+0000","last_became_active":"2024-03-09T14:50:35.506905+0000","last_became_peered":"2024-03-09T14:50:35.506905+0000","last_unstale":"2024-03-09T15:08:06.561315+0000","last_undegraded":"2024-03-09T15:08:06.561315+0000","last_fullsized":"2024-03-09T15:08:06.561315+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:36:12.492461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.887380+0000","last_change":"2024-03-09T14:38:37.440992+0000","last_active":"2024-03-09T15:11:45.887380+0000","last_peered":"2024-03-09T15:11:45.887380+0000","last_clean":"2024-03-09T15:11:45.887380+0000","last_became_active":"2024-03-09T14:38:37.440733+0000","last_became_peered":"2024-03-09T14:38:37.440733+0000","last_unstale":"2024-03-09T15:11:45.887380+0000","last_undegraded":"2024-03-09T15:11:45.887380+0000","last_fullsized":"2024-03-09T15:11:45.887380+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:06.585628+0000","last_change":"2024-03-09T14:38:34.426397+0000","last_active":"2024-03-09T15:11:06.585628+0000","last_peered":"2024-03-09T15:11:06.585628+0000","last_clean":"2024-03-09T15:11:06.585628+0000","last_became_active":"2024-03-09T14:38:34.425629+0000","last_became_peered":"2024-03-09T14:38:34.425629+0000","last_unstale":"2024-03-09T15:11:06.585628+0000","last_undegraded":"2024-03-09T15:11:06.585628+0000","last_fullsized":"2024-03-09T15:11:06.585628+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:05.228490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'52","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.559699+0000","last_change":"2024-03-09T14:35:41.118142+0000","last_active":"2024-03-09T15:07:51.559699+0000","last_peered":"2024-03-09T15:07:51.559699+0000","last_clean":"2024-03-09T15:07:51.559699+0000","last_became_active":"2024-03-09T14:35:41.117858+0000","last_became_peered":"2024-03-09T14:35:41.117858+0000","last_unstale":"2024-03-09T15:07:51.559699+0000","last_undegraded":"2024-03-09T15:07:51.559699+0000","last_fullsized":"2024-03-09T15:07:51.559699+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:33:55.309111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":156,"num_write":85,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.585850+0000","last_change":"2024-03-09T14:50:35.506417+0000","last_active":"2024-03-09T15:07:31.585850+0000","last_peered":"2024-03-09T15:07:31.585850+0000","last_clean":"2024-03-09T15:07:31.585850+0000","last_became_active":"2024-03-09T14:50:35.506136+0000","last_became_peered":"2024-03-09T14:50:35.506136+0000","last_unstale":"2024-03-09T15:07:31.585850+0000","last_undegraded":"2024-03-09T15:07:31.585850+0000","last_fullsized":"2024-03-09T15:07:31.585850+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:25:26.999053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"261'9","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.571362+0000","last_change":"2024-03-09T14:38:37.443197+0000","last_active":"2024-03-09T15:07:46.571362+0000","last_peered":"2024-03-09T15:07:46.571362+0000","last_clean":"2024-03-09T15:07:46.571362+0000","last_became_active":"2024-03-09T14:38:37.442906+0000","last_became_peered":"2024-03-09T14:38:37.442906+0000","last_unstale":"2024-03-09T15:07:46.571362+0000","last_undegraded":"2024-03-09T15:07:46.571362+0000","last_fullsized":"2024-03-09T15:07:46.571362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:32:22.327056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":8196,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:46.566095+0000","last_change":"2024-03-09T14:38:34.425940+0000","last_active":"2024-03-09T15:08:46.566095+0000","last_peered":"2024-03-09T15:08:46.566095+0000","last_clean":"2024-03-09T15:08:46.566095+0000","last_became_active":"2024-03-09T14:38:34.425459+0000","last_became_peered":"2024-03-09T14:38:34.425459+0000","last_unstale":"2024-03-09T15:08:46.566095+0000","last_undegraded":"2024-03-09T15:08:46.566095+0000","last_fullsized":"2024-03-09T15:08:46.566095+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:37:12.404902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"261'16","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.574184+0000","last_change":"2024-03-09T14:35:41.123438+0000","last_active":"2024-03-09T15:08:11.574184+0000","last_peered":"2024-03-09T15:08:11.574184+0000","last_clean":"2024-03-09T15:08:11.574184+0000","last_became_active":"2024-03-09T14:35:41.123171+0000","last_became_peered":"2024-03-09T14:35:41.123171+0000","last_unstale":"2024-03-09T15:08:11.574184+0000","last_undegraded":"2024-03-09T15:08:11.574184+0000","last_fullsized":"2024-03-09T15:08:11.574184+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:41:36.543762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":56,"num_write":23,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:56.689372+0000","last_change":"2024-03-09T14:50:35.503396+0000","last_active":"2024-03-09T15:09:56.689372+0000","last_peered":"2024-03-09T15:09:56.689372+0000","last_clean":"2024-03-09T15:09:56.689372+0000","last_became_active":"2024-03-09T14:50:35.503090+0000","last_became_peered":"2024-03-09T14:50:35.503090+0000","last_unstale":"2024-03-09T15:09:56.689372+0000","last_undegraded":"2024-03-09T15:09:56.689372+0000","last_fullsized":"2024-03-09T15:09:56.689372+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.718412+0000","last_change":"2024-03-09T14:38:37.432464+0000","last_active":"2024-03-09T15:11:45.718412+0000","last_peered":"2024-03-09T15:11:45.718412+0000","last_clean":"2024-03-09T15:11:45.718412+0000","last_became_active":"2024-03-09T14:38:37.432089+0000","last_became_peered":"2024-03-09T14:38:37.432089+0000","last_unstale":"2024-03-09T15:11:45.718412+0000","last_undegraded":"2024-03-09T15:11:45.718412+0000","last_fullsized":"2024-03-09T15:11:45.718412+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.827825+0000","last_change":"2024-03-09T14:38:34.417315+0000","last_active":"2024-03-09T15:11:45.827825+0000","last_peered":"2024-03-09T15:11:45.827825+0000","last_clean":"2024-03-09T15:11:45.827825+0000","last_became_active":"2024-03-09T14:38:34.417024+0000","last_became_peered":"2024-03-09T14:38:34.417024+0000","last_unstale":"2024-03-09T15:11:45.827825+0000","last_undegraded":"2024-03-09T15:11:45.827825+0000","last_fullsized":"2024-03-09T15:11:45.827825+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'52","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:41.694398+0000","last_change":"2024-03-09T14:35:41.119245+0000","last_active":"2024-03-09T15:10:41.694398+0000","last_peered":"2024-03-09T15:10:41.694398+0000","last_clean":"2024-03-09T15:10:41.694398+0000","last_became_active":"2024-03-09T14:35:41.118960+0000","last_became_peered":"2024-03-09T14:35:41.118960+0000","last_unstale":"2024-03-09T15:10:41.694398+0000","last_undegraded":"2024-03-09T15:10:41.694398+0000","last_fullsized":"2024-03-09T15:10:41.694398+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":146,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.693833+0000","last_change":"2024-03-09T14:50:35.513378+0000","last_active":"2024-03-09T15:10:36.693833+0000","last_peered":"2024-03-09T15:10:36.693833+0000","last_clean":"2024-03-09T15:10:36.693833+0000","last_became_active":"2024-03-09T14:50:35.512534+0000","last_became_peered":"2024-03-09T14:50:35.512534+0000","last_unstale":"2024-03-09T15:10:36.693833+0000","last_undegraded":"2024-03-09T15:10:36.693833+0000","last_fullsized":"2024-03-09T15:10:36.693833+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.572976+0000","last_change":"2024-03-09T14:38:37.437102+0000","last_active":"2024-03-09T15:07:41.572976+0000","last_peered":"2024-03-09T15:07:41.572976+0000","last_clean":"2024-03-09T15:07:41.572976+0000","last_became_active":"2024-03-09T14:38:37.436829+0000","last_became_peered":"2024-03-09T14:38:37.436829+0000","last_unstale":"2024-03-09T15:07:41.572976+0000","last_undegraded":"2024-03-09T15:07:41.572976+0000","last_fullsized":"2024-03-09T15:07:41.572976+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:50:39.916587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.717178+0000","last_change":"2024-03-09T14:38:34.418873+0000","last_active":"2024-03-09T15:11:45.717178+0000","last_peered":"2024-03-09T15:11:45.717178+0000","last_clean":"2024-03-09T15:11:45.717178+0000","last_became_active":"2024-03-09T14:38:34.418209+0000","last_became_peered":"2024-03-09T14:38:34.418209+0000","last_unstale":"2024-03-09T15:11:45.717178+0000","last_undegraded":"2024-03-09T15:11:45.717178+0000","last_fullsized":"2024-03-09T15:11:45.717178+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:50.765837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6194,"num_write":6,"num_write_kb":5170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'22","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:41.694367+0000","last_change":"2024-03-09T14:35:41.123984+0000","last_active":"2024-03-09T15:10:41.694367+0000","last_peered":"2024-03-09T15:10:41.694367+0000","last_clean":"2024-03-09T15:10:41.694367+0000","last_became_active":"2024-03-09T14:35:41.123715+0000","last_became_peered":"2024-03-09T14:35:41.123715+0000","last_unstale":"2024-03-09T15:10:41.694367+0000","last_undegraded":"2024-03-09T15:10:41.694367+0000","last_fullsized":"2024-03-09T15:10:41.694367+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":62,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.574433+0000","last_change":"2024-03-09T14:50:35.510228+0000","last_active":"2024-03-09T15:09:21.574433+0000","last_peered":"2024-03-09T15:09:21.574433+0000","last_clean":"2024-03-09T15:09:21.574433+0000","last_became_active":"2024-03-09T14:50:35.509938+0000","last_became_peered":"2024-03-09T14:50:35.509938+0000","last_unstale":"2024-03-09T15:09:21.574433+0000","last_undegraded":"2024-03-09T15:09:21.574433+0000","last_fullsized":"2024-03-09T15:09:21.574433+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:07:27.212874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.586636+0000","last_change":"2024-03-09T14:38:37.439503+0000","last_active":"2024-03-09T15:07:36.586636+0000","last_peered":"2024-03-09T15:07:36.586636+0000","last_clean":"2024-03-09T15:07:36.586636+0000","last_became_active":"2024-03-09T14:38:37.439120+0000","last_became_peered":"2024-03-09T14:38:37.439120+0000","last_unstale":"2024-03-09T15:07:36.586636+0000","last_undegraded":"2024-03-09T15:07:36.586636+0000","last_fullsized":"2024-03-09T15:07:36.586636+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:27:16.750464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.936613+0000","last_change":"2024-03-09T14:38:34.418823+0000","last_active":"2024-03-09T15:11:45.936613+0000","last_peered":"2024-03-09T15:11:45.936613+0000","last_clean":"2024-03-09T15:11:45.936613+0000","last_became_active":"2024-03-09T14:38:34.418553+0000","last_became_peered":"2024-03-09T14:38:34.418553+0000","last_unstale":"2024-03-09T15:11:45.936613+0000","last_undegraded":"2024-03-09T15:11:45.936613+0000","last_fullsized":"2024-03-09T15:11:45.936613+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":6,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'47","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591412+0000","last_change":"2024-03-09T14:35:41.124086+0000","last_active":"2024-03-09T15:08:11.591412+0000","last_peered":"2024-03-09T15:08:11.591412+0000","last_clean":"2024-03-09T15:08:11.591412+0000","last_became_active":"2024-03-09T14:35:41.123785+0000","last_became_peered":"2024-03-09T14:35:41.123785+0000","last_unstale":"2024-03-09T15:08:11.591412+0000","last_undegraded":"2024-03-09T15:08:11.591412+0000","last_fullsized":"2024-03-09T15:08:11.591412+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:48:27.983405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":141,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.711751+0000","last_change":"2024-03-09T14:50:35.500344+0000","last_active":"2024-03-09T15:08:06.711751+0000","last_peered":"2024-03-09T15:08:06.711751+0000","last_clean":"2024-03-09T15:08:06.711751+0000","last_became_active":"2024-03-09T14:50:35.499942+0000","last_became_peered":"2024-03-09T14:50:35.499942+0000","last_unstale":"2024-03-09T15:08:06.711751+0000","last_undegraded":"2024-03-09T15:08:06.711751+0000","last_fullsized":"2024-03-09T15:08:06.711751+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:47:17.395153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.594512+0000","last_change":"2024-03-09T14:38:37.438111+0000","last_active":"2024-03-09T15:08:36.594512+0000","last_peered":"2024-03-09T15:08:36.594512+0000","last_clean":"2024-03-09T15:08:36.594512+0000","last_became_active":"2024-03-09T14:38:37.437714+0000","last_became_peered":"2024-03-09T14:38:37.437714+0000","last_unstale":"2024-03-09T15:08:36.594512+0000","last_undegraded":"2024-03-09T15:08:36.594512+0000","last_fullsized":"2024-03-09T15:08:36.594512+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:33.290321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.800601+0000","last_change":"2024-03-09T14:38:34.420968+0000","last_active":"2024-03-09T15:11:45.800601+0000","last_peered":"2024-03-09T15:11:45.800601+0000","last_clean":"2024-03-09T15:11:45.800601+0000","last_became_active":"2024-03-09T14:38:34.420232+0000","last_became_peered":"2024-03-09T14:38:34.420232+0000","last_unstale":"2024-03-09T15:11:45.800601+0000","last_undegraded":"2024-03-09T15:11:45.800601+0000","last_fullsized":"2024-03-09T15:11:45.800601+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'24","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.567871+0000","last_change":"2024-03-09T14:35:41.121844+0000","last_active":"2024-03-09T15:07:16.567871+0000","last_peered":"2024-03-09T15:07:16.567871+0000","last_clean":"2024-03-09T15:07:16.567871+0000","last_became_active":"2024-03-09T14:35:41.121566+0000","last_became_peered":"2024-03-09T14:35:41.121566+0000","last_unstale":"2024-03-09T15:07:16.567871+0000","last_undegraded":"2024-03-09T15:07:16.567871+0000","last_fullsized":"2024-03-09T15:07:16.567871+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:48.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.711796+0000","last_change":"2024-03-09T14:50:35.501732+0000","last_active":"2024-03-09T15:08:06.711796+0000","last_peered":"2024-03-09T15:08:06.711796+0000","last_clean":"2024-03-09T15:08:06.711796+0000","last_became_active":"2024-03-09T14:50:35.501422+0000","last_became_peered":"2024-03-09T14:50:35.501422+0000","last_unstale":"2024-03-09T15:08:06.711796+0000","last_undegraded":"2024-03-09T15:08:06.711796+0000","last_fullsized":"2024-03-09T15:08:06.711796+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:51:45.968049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"264'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.887438+0000","last_change":"2024-03-09T14:38:37.438996+0000","last_active":"2024-03-09T15:11:45.887438+0000","last_peered":"2024-03-09T15:11:45.887438+0000","last_clean":"2024-03-09T15:11:45.887438+0000","last_became_active":"2024-03-09T14:38:37.438685+0000","last_became_peered":"2024-03-09T14:38:37.438685+0000","last_unstale":"2024-03-09T15:11:45.887438+0000","last_undegraded":"2024-03-09T15:11:45.887438+0000","last_fullsized":"2024-03-09T15:11:45.887438+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:06.593809+0000","last_change":"2024-03-09T14:38:34.422906+0000","last_active":"2024-03-09T15:11:06.593809+0000","last_peered":"2024-03-09T15:11:06.593809+0000","last_clean":"2024-03-09T15:11:06.593809+0000","last_became_active":"2024-03-09T14:38:34.422607+0000","last_became_peered":"2024-03-09T14:38:34.422607+0000","last_unstale":"2024-03-09T15:11:06.593809+0000","last_undegraded":"2024-03-09T15:11:06.593809+0000","last_fullsized":"2024-03-09T15:11:06.593809+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:57.914098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'68","reported_seq":223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:06.559342+0000","last_change":"2024-03-09T14:35:41.123207+0000","last_active":"2024-03-09T15:07:06.559342+0000","last_peered":"2024-03-09T15:07:06.559342+0000","last_clean":"2024-03-09T15:07:06.559342+0000","last_became_active":"2024-03-09T14:35:41.122898+0000","last_became_peered":"2024-03-09T14:35:41.122898+0000","last_unstale":"2024-03-09T15:07:06.559342+0000","last_undegraded":"2024-03-09T15:07:06.559342+0000","last_fullsized":"2024-03-09T15:07:06.559342+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:05:14.087935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":238,"num_write":108,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.573887+0000","last_change":"2024-03-09T14:50:35.508995+0000","last_active":"2024-03-09T15:09:16.573887+0000","last_peered":"2024-03-09T15:09:16.573887+0000","last_clean":"2024-03-09T15:09:16.573887+0000","last_became_active":"2024-03-09T14:50:35.508726+0000","last_became_peered":"2024-03-09T14:50:35.508726+0000","last_unstale":"2024-03-09T15:09:16.573887+0000","last_undegraded":"2024-03-09T15:09:16.573887+0000","last_fullsized":"2024-03-09T15:09:16.573887+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:57:02.512282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'8","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.954362+0000","last_change":"2024-03-09T14:38:37.437565+0000","last_active":"2024-03-09T15:11:45.954362+0000","last_peered":"2024-03-09T15:11:45.954362+0000","last_clean":"2024-03-09T15:11:45.954362+0000","last_became_active":"2024-03-09T14:38:37.437039+0000","last_became_peered":"2024-03-09T14:38:37.437039+0000","last_unstale":"2024-03-09T15:11:45.954362+0000","last_undegraded":"2024-03-09T15:11:45.954362+0000","last_fullsized":"2024-03-09T15:11:45.954362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10340,"num_write":8,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"264'6","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.829953+0000","last_change":"2024-03-09T14:38:34.418567+0000","last_active":"2024-03-09T15:11:45.829953+0000","last_peered":"2024-03-09T15:11:45.829953+0000","last_clean":"2024-03-09T15:11:45.829953+0000","last_became_active":"2024-03-09T14:38:34.418269+0000","last_became_peered":"2024-03-09T14:38:34.418269+0000","last_unstale":"2024-03-09T15:11:45.829953+0000","last_undegraded":"2024-03-09T15:11:45.829953+0000","last_fullsized":"2024-03-09T15:11:45.829953+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:37.564267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'38","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.061406+0000","last_change":"2024-03-09T14:35:41.122751+0000","last_active":"2024-03-09T15:07:45.061406+0000","last_peered":"2024-03-09T15:07:45.061406+0000","last_clean":"2024-03-09T15:07:45.061406+0000","last_became_active":"2024-03-09T14:35:41.122257+0000","last_became_peered":"2024-03-09T14:35:41.122257+0000","last_unstale":"2024-03-09T15:07:45.061406+0000","last_undegraded":"2024-03-09T15:07:45.061406+0000","last_fullsized":"2024-03-09T15:07:45.061406+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:47:51.831859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":116,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.569244+0000","last_change":"2024-03-09T14:50:35.503872+0000","last_active":"2024-03-09T15:09:16.569244+0000","last_peered":"2024-03-09T15:09:16.569244+0000","last_clean":"2024-03-09T15:09:16.569244+0000","last_became_active":"2024-03-09T14:50:35.503595+0000","last_became_peered":"2024-03-09T14:50:35.503595+0000","last_unstale":"2024-03-09T15:09:16.569244+0000","last_undegraded":"2024-03-09T15:09:16.569244+0000","last_fullsized":"2024-03-09T15:09:16.569244+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:47.112637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.954807+0000","last_change":"2024-03-09T14:38:37.430250+0000","last_active":"2024-03-09T15:11:45.954807+0000","last_peered":"2024-03-09T15:11:45.954807+0000","last_clean":"2024-03-09T15:11:45.954807+0000","last_became_active":"2024-03-09T14:38:37.429956+0000","last_became_peered":"2024-03-09T14:38:37.429956+0000","last_unstale":"2024-03-09T15:11:45.954807+0000","last_undegraded":"2024-03-09T15:11:45.954807+0000","last_fullsized":"2024-03-09T15:11:45.954807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":11264,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:01.728465+0000","last_change":"2024-03-09T14:38:34.421959+0000","last_active":"2024-03-09T15:10:01.728465+0000","last_peered":"2024-03-09T15:10:01.728465+0000","last_clean":"2024-03-09T15:10:01.728465+0000","last_became_active":"2024-03-09T14:38:34.421678+0000","last_became_peered":"2024-03-09T14:38:34.421678+0000","last_unstale":"2024-03-09T15:10:01.728465+0000","last_undegraded":"2024-03-09T15:10:01.728465+0000","last_fullsized":"2024-03-09T15:10:01.728465+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:48.989741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'25","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:31.686454+0000","last_change":"2024-03-09T14:35:41.121109+0000","last_active":"2024-03-09T15:09:31.686454+0000","last_peered":"2024-03-09T15:09:31.686454+0000","last_clean":"2024-03-09T15:09:31.686454+0000","last_became_active":"2024-03-09T14:35:41.120818+0000","last_became_peered":"2024-03-09T14:35:41.120818+0000","last_unstale":"2024-03-09T15:09:31.686454+0000","last_undegraded":"2024-03-09T15:09:31.686454+0000","last_fullsized":"2024-03-09T15:09:31.686454+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":54,"num_write":56,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.721253+0000","last_change":"2024-03-09T14:50:35.500497+0000","last_active":"2024-03-09T15:09:16.721253+0000","last_peered":"2024-03-09T15:09:16.721253+0000","last_clean":"2024-03-09T15:09:16.721253+0000","last_became_active":"2024-03-09T14:50:35.500196+0000","last_became_peered":"2024-03-09T14:50:35.500196+0000","last_unstale":"2024-03-09T15:09:16.721253+0000","last_undegraded":"2024-03-09T15:09:16.721253+0000","last_fullsized":"2024-03-09T15:09:16.721253+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:59:34.049420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.954146+0000","last_change":"2024-03-09T14:38:37.437194+0000","last_active":"2024-03-09T15:11:45.954146+0000","last_peered":"2024-03-09T15:11:45.954146+0000","last_clean":"2024-03-09T15:11:45.954146+0000","last_became_active":"2024-03-09T14:38:37.436884+0000","last_became_peered":"2024-03-09T14:38:37.436884+0000","last_unstale":"2024-03-09T15:11:45.954146+0000","last_undegraded":"2024-03-09T15:11:45.954146+0000","last_fullsized":"2024-03-09T15:11:45.954146+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.558107+0000","last_change":"2024-03-09T14:38:34.420272+0000","last_active":"2024-03-09T15:07:36.558107+0000","last_peered":"2024-03-09T15:07:36.558107+0000","last_clean":"2024-03-09T15:07:36.558107+0000","last_became_active":"2024-03-09T14:38:34.420002+0000","last_became_peered":"2024-03-09T14:38:34.420002+0000","last_unstale":"2024-03-09T15:07:36.558107+0000","last_undegraded":"2024-03-09T15:07:36.558107+0000","last_fullsized":"2024-03-09T15:07:36.558107+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:05:58.461847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'34","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:06.555328+0000","last_change":"2024-03-09T14:35:41.116727+0000","last_active":"2024-03-09T15:07:06.555328+0000","last_peered":"2024-03-09T15:07:06.555328+0000","last_clean":"2024-03-09T15:07:06.555328+0000","last_became_active":"2024-03-09T14:35:41.116430+0000","last_became_peered":"2024-03-09T14:35:41.116430+0000","last_unstale":"2024-03-09T15:07:06.555328+0000","last_undegraded":"2024-03-09T15:07:06.555328+0000","last_fullsized":"2024-03-09T15:07:06.555328+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:09.089142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":94,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.584576+0000","last_change":"2024-03-09T14:50:35.507650+0000","last_active":"2024-03-09T15:09:16.584576+0000","last_peered":"2024-03-09T15:09:16.584576+0000","last_clean":"2024-03-09T15:09:16.584576+0000","last_became_active":"2024-03-09T14:50:35.506969+0000","last_became_peered":"2024-03-09T14:50:35.506969+0000","last_unstale":"2024-03-09T15:09:16.584576+0000","last_undegraded":"2024-03-09T15:09:16.584576+0000","last_fullsized":"2024-03-09T15:09:16.584576+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:45:43.559282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.778031+0000","last_change":"2024-03-09T14:38:37.436281+0000","last_active":"2024-03-09T15:11:45.778031+0000","last_peered":"2024-03-09T15:11:45.778031+0000","last_clean":"2024-03-09T15:11:45.778031+0000","last_became_active":"2024-03-09T14:38:37.435960+0000","last_became_peered":"2024-03-09T14:38:37.435960+0000","last_unstale":"2024-03-09T15:11:45.778031+0000","last_undegraded":"2024-03-09T15:11:45.778031+0000","last_fullsized":"2024-03-09T15:11:45.778031+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'7","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:01.586706+0000","last_change":"2024-03-09T14:38:34.420846+0000","last_active":"2024-03-09T15:10:01.586706+0000","last_peered":"2024-03-09T15:10:01.586706+0000","last_clean":"2024-03-09T15:10:01.586706+0000","last_became_active":"2024-03-09T14:38:34.420571+0000","last_became_peered":"2024-03-09T14:38:34.420571+0000","last_unstale":"2024-03-09T15:10:01.586706+0000","last_undegraded":"2024-03-09T15:10:01.586706+0000","last_fullsized":"2024-03-09T15:10:01.586706+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:29:07.174232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'36","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.714611+0000","last_change":"2024-03-09T14:35:41.121354+0000","last_active":"2024-03-09T15:08:26.714611+0000","last_peered":"2024-03-09T15:08:26.714611+0000","last_clean":"2024-03-09T15:08:26.714611+0000","last_became_active":"2024-03-09T14:35:41.121060+0000","last_became_peered":"2024-03-09T14:35:41.121060+0000","last_unstale":"2024-03-09T15:08:26.714611+0000","last_undegraded":"2024-03-09T15:08:26.714611+0000","last_fullsized":"2024-03-09T15:08:26.714611+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:59:13.798282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":100,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:56.689470+0000","last_change":"2024-03-09T14:50:35.504223+0000","last_active":"2024-03-09T15:09:56.689470+0000","last_peered":"2024-03-09T15:09:56.689470+0000","last_clean":"2024-03-09T15:09:56.689470+0000","last_became_active":"2024-03-09T14:50:35.503970+0000","last_became_peered":"2024-03-09T14:50:35.503970+0000","last_unstale":"2024-03-09T15:09:56.689470+0000","last_undegraded":"2024-03-09T15:09:56.689470+0000","last_fullsized":"2024-03-09T15:09:56.689470+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:16.586532+0000","last_change":"2024-03-09T14:38:37.438872+0000","last_active":"2024-03-09T15:11:16.586532+0000","last_peered":"2024-03-09T15:11:16.586532+0000","last_clean":"2024-03-09T15:11:16.586532+0000","last_became_active":"2024-03-09T14:38:37.438604+0000","last_became_peered":"2024-03-09T14:38:37.438604+0000","last_unstale":"2024-03-09T15:11:16.586532+0000","last_undegraded":"2024-03-09T15:11:16.586532+0000","last_fullsized":"2024-03-09T15:11:16.586532+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:51.268275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:16.491314+0000","last_change":"2024-03-09T14:38:34.421755+0000","last_active":"2024-03-09T15:11:16.491314+0000","last_peered":"2024-03-09T15:11:16.491314+0000","last_clean":"2024-03-09T15:11:16.491314+0000","last_became_active":"2024-03-09T14:38:34.421476+0000","last_became_peered":"2024-03-09T14:38:34.421476+0000","last_unstale":"2024-03-09T15:11:16.491314+0000","last_undegraded":"2024-03-09T15:11:16.491314+0000","last_fullsized":"2024-03-09T15:11:16.491314+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'114","reported_seq":387,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.713908+0000","last_change":"2024-03-09T14:35:41.125457+0000","last_active":"2024-03-09T15:08:21.713908+0000","last_peered":"2024-03-09T15:08:21.713908+0000","last_clean":"2024-03-09T15:08:21.713908+0000","last_became_active":"2024-03-09T14:35:41.125114+0000","last_became_peered":"2024-03-09T14:35:41.125114+0000","last_unstale":"2024-03-09T15:08:21.713908+0000","last_undegraded":"2024-03-09T15:08:21.713908+0000","last_fullsized":"2024-03-09T15:08:21.713908+0000","mapping_epoch":251,"log_start":"264'100","ondisk_log_start":"264'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:47.982191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":488,"num_write":144,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.569420+0000","last_change":"2024-03-09T14:50:35.510923+0000","last_active":"2024-03-09T15:07:31.569420+0000","last_peered":"2024-03-09T15:07:31.569420+0000","last_clean":"2024-03-09T15:07:31.569420+0000","last_became_active":"2024-03-09T14:50:35.510598+0000","last_became_peered":"2024-03-09T14:50:35.510598+0000","last_unstale":"2024-03-09T15:07:31.569420+0000","last_undegraded":"2024-03-09T15:07:31.569420+0000","last_fullsized":"2024-03-09T15:07:31.569420+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:52:13.398359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.571855+0000","last_change":"2024-03-09T14:38:37.439640+0000","last_active":"2024-03-09T15:08:56.571855+0000","last_peered":"2024-03-09T15:08:56.571855+0000","last_clean":"2024-03-09T15:08:56.571855+0000","last_became_active":"2024-03-09T14:38:37.439360+0000","last_became_peered":"2024-03-09T14:38:37.439360+0000","last_unstale":"2024-03-09T15:08:56.571855+0000","last_undegraded":"2024-03-09T15:08:56.571855+0000","last_fullsized":"2024-03-09T15:08:56.571855+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:24.960393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:16.488418+0000","last_change":"2024-03-09T14:38:34.419720+0000","last_active":"2024-03-09T15:11:16.488418+0000","last_peered":"2024-03-09T15:11:16.488418+0000","last_clean":"2024-03-09T15:11:16.488418+0000","last_became_active":"2024-03-09T14:38:34.419467+0000","last_became_peered":"2024-03-09T14:38:34.419467+0000","last_unstale":"2024-03-09T15:11:16.488418+0000","last_undegraded":"2024-03-09T15:11:16.488418+0000","last_fullsized":"2024-03-09T15:11:16.488418+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'15","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.575178+0000","last_change":"2024-03-09T14:35:41.118830+0000","last_active":"2024-03-09T15:08:21.575178+0000","last_peered":"2024-03-09T15:08:21.575178+0000","last_clean":"2024-03-09T15:08:21.575178+0000","last_became_active":"2024-03-09T14:35:41.118591+0000","last_became_peered":"2024-03-09T14:35:41.118591+0000","last_unstale":"2024-03-09T15:08:21.575178+0000","last_undegraded":"2024-03-09T15:08:21.575178+0000","last_fullsized":"2024-03-09T15:08:21.575178+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:44:14.623143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":42,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.582148+0000","last_change":"2024-03-09T14:50:35.503951+0000","last_active":"2024-03-09T15:09:21.582148+0000","last_peered":"2024-03-09T15:09:21.582148+0000","last_clean":"2024-03-09T15:09:21.582148+0000","last_became_active":"2024-03-09T14:50:35.503274+0000","last_became_peered":"2024-03-09T14:50:35.503274+0000","last_unstale":"2024-03-09T15:09:21.582148+0000","last_undegraded":"2024-03-09T15:09:21.582148+0000","last_fullsized":"2024-03-09T15:09:21.582148+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:51.019829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.954736+0000","last_change":"2024-03-09T14:38:37.436377+0000","last_active":"2024-03-09T15:11:45.954736+0000","last_peered":"2024-03-09T15:11:45.954736+0000","last_clean":"2024-03-09T15:11:45.954736+0000","last_became_active":"2024-03-09T14:38:37.436078+0000","last_became_peered":"2024-03-09T14:38:37.436078+0000","last_unstale":"2024-03-09T15:11:45.954736+0000","last_undegraded":"2024-03-09T15:11:45.954736+0000","last_fullsized":"2024-03-09T15:11:45.954736+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.725636+0000","last_change":"2024-03-09T14:38:34.420240+0000","last_active":"2024-03-09T15:11:45.725636+0000","last_peered":"2024-03-09T15:11:45.725636+0000","last_clean":"2024-03-09T15:11:45.725636+0000","last_became_active":"2024-03-09T14:38:34.419935+0000","last_became_peered":"2024-03-09T14:38:34.419935+0000","last_unstale":"2024-03-09T15:11:45.725636+0000","last_undegraded":"2024-03-09T15:11:45.725636+0000","last_fullsized":"2024-03-09T15:11:45.725636+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:16:59.079986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7208,"num_write":6,"num_write_kb":7208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'26","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:41.612199+0000","last_change":"2024-03-09T14:35:41.117147+0000","last_active":"2024-03-09T15:10:41.612199+0000","last_peered":"2024-03-09T15:10:41.612199+0000","last_clean":"2024-03-09T15:10:41.612199+0000","last_became_active":"2024-03-09T14:35:41.116852+0000","last_became_peered":"2024-03-09T14:35:41.116852+0000","last_unstale":"2024-03-09T15:10:41.612199+0000","last_undegraded":"2024-03-09T15:10:41.612199+0000","last_fullsized":"2024-03-09T15:10:41.612199+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:56.689444+0000","last_change":"2024-03-09T14:50:35.509510+0000","last_active":"2024-03-09T15:09:56.689444+0000","last_peered":"2024-03-09T15:09:56.689444+0000","last_clean":"2024-03-09T15:09:56.689444+0000","last_became_active":"2024-03-09T14:50:35.509202+0000","last_became_peered":"2024-03-09T14:50:35.509202+0000","last_unstale":"2024-03-09T15:09:56.689444+0000","last_undegraded":"2024-03-09T15:09:56.689444+0000","last_fullsized":"2024-03-09T15:09:56.689444+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:16.492276+0000","last_change":"2024-03-09T14:38:37.441897+0000","last_active":"2024-03-09T15:11:16.492276+0000","last_peered":"2024-03-09T15:11:16.492276+0000","last_clean":"2024-03-09T15:11:16.492276+0000","last_became_active":"2024-03-09T14:38:37.441554+0000","last_became_peered":"2024-03-09T14:38:37.441554+0000","last_unstale":"2024-03-09T15:11:16.492276+0000","last_undegraded":"2024-03-09T15:11:16.492276+0000","last_fullsized":"2024-03-09T15:11:16.492276+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:13.709348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:16.601809+0000","last_change":"2024-03-09T14:38:34.424750+0000","last_active":"2024-03-09T15:11:16.601809+0000","last_peered":"2024-03-09T15:11:16.601809+0000","last_clean":"2024-03-09T15:11:16.601809+0000","last_became_active":"2024-03-09T14:38:34.424507+0000","last_became_peered":"2024-03-09T14:38:34.424507+0000","last_unstale":"2024-03-09T15:11:16.601809+0000","last_undegraded":"2024-03-09T15:11:16.601809+0000","last_fullsized":"2024-03-09T15:11:16.601809+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:14:16.729687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'52","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:41.694288+0000","last_change":"2024-03-09T14:35:41.117227+0000","last_active":"2024-03-09T15:10:41.694288+0000","last_peered":"2024-03-09T15:10:41.694288+0000","last_clean":"2024-03-09T15:10:41.694288+0000","last_became_active":"2024-03-09T14:35:41.116932+0000","last_became_peered":"2024-03-09T14:35:41.116932+0000","last_unstale":"2024-03-09T15:10:41.694288+0000","last_undegraded":"2024-03-09T15:10:41.694288+0000","last_fullsized":"2024-03-09T15:10:41.694288+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":147,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.560814+0000","last_change":"2024-03-09T14:50:35.498350+0000","last_active":"2024-03-09T15:08:01.560814+0000","last_peered":"2024-03-09T15:08:01.560814+0000","last_clean":"2024-03-09T15:08:01.560814+0000","last_became_active":"2024-03-09T14:50:35.498045+0000","last_became_peered":"2024-03-09T14:50:35.498045+0000","last_unstale":"2024-03-09T15:08:01.560814+0000","last_undegraded":"2024-03-09T15:08:01.560814+0000","last_fullsized":"2024-03-09T15:08:01.560814+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:36.419114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.685468+0000","last_change":"2024-03-09T14:38:37.437345+0000","last_active":"2024-03-09T15:11:45.685468+0000","last_peered":"2024-03-09T15:11:45.685468+0000","last_clean":"2024-03-09T15:11:45.685468+0000","last_became_active":"2024-03-09T14:38:37.436672+0000","last_became_peered":"2024-03-09T14:38:37.436672+0000","last_unstale":"2024-03-09T15:11:45.685468+0000","last_undegraded":"2024-03-09T15:11:45.685468+0000","last_fullsized":"2024-03-09T15:11:45.685468+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'10","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.725495+0000","last_change":"2024-03-09T14:38:34.423665+0000","last_active":"2024-03-09T15:11:45.725495+0000","last_peered":"2024-03-09T15:11:45.725495+0000","last_clean":"2024-03-09T15:11:45.725495+0000","last_became_active":"2024-03-09T14:38:34.423136+0000","last_became_peered":"2024-03-09T14:38:34.423136+0000","last_unstale":"2024-03-09T15:11:45.725495+0000","last_undegraded":"2024-03-09T15:11:45.725495+0000","last_fullsized":"2024-03-09T15:11:45.725495+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:45.903637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'29","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395537+0000","last_change":"2024-03-09T14:35:41.120249+0000","last_active":"2024-03-09T15:11:50.395537+0000","last_peered":"2024-03-09T15:11:50.395537+0000","last_clean":"2024-03-09T15:11:50.395537+0000","last_became_active":"2024-03-09T14:35:41.119901+0000","last_became_peered":"2024-03-09T14:35:41.119901+0000","last_unstale":"2024-03-09T15:11:50.395537+0000","last_undegraded":"2024-03-09T15:11:50.395537+0000","last_fullsized":"2024-03-09T15:11:50.395537+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":86,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715810+0000","last_change":"2024-03-09T14:50:35.510602+0000","last_active":"2024-03-09T15:08:36.715810+0000","last_peered":"2024-03-09T15:08:36.715810+0000","last_clean":"2024-03-09T15:08:36.715810+0000","last_became_active":"2024-03-09T14:50:35.510330+0000","last_became_peered":"2024-03-09T14:50:35.510330+0000","last_unstale":"2024-03-09T15:08:36.715810+0000","last_undegraded":"2024-03-09T15:08:36.715810+0000","last_fullsized":"2024-03-09T15:08:36.715810+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:46.816086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"261'9","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.577422+0000","last_change":"2024-03-09T14:39:04.870290+0000","last_active":"2024-03-09T15:08:21.577422+0000","last_peered":"2024-03-09T15:08:21.577422+0000","last_clean":"2024-03-09T15:08:21.577422+0000","last_became_active":"2024-03-09T14:39:04.819697+0000","last_became_peered":"2024-03-09T14:39:04.819697+0000","last_unstale":"2024-03-09T15:08:21.577422+0000","last_undegraded":"2024-03-09T15:08:21.577422+0000","last_fullsized":"2024-03-09T15:08:21.577422+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:51.693969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":4098,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.d","version":"264'9","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.778302+0000","last_change":"2024-03-09T14:38:34.416788+0000","last_active":"2024-03-09T15:11:45.778302+0000","last_peered":"2024-03-09T15:11:45.778302+0000","last_clean":"2024-03-09T15:11:45.778302+0000","last_became_active":"2024-03-09T14:38:34.416475+0000","last_became_peered":"2024-03-09T14:38:34.416475+0000","last_unstale":"2024-03-09T15:11:45.778302+0000","last_undegraded":"2024-03-09T15:11:45.778302+0000","last_fullsized":"2024-03-09T15:11:45.778302+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:45.337347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":13,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'38","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.585918+0000","last_change":"2024-03-09T14:35:41.120210+0000","last_active":"2024-03-09T15:09:26.585918+0000","last_peered":"2024-03-09T15:09:26.585918+0000","last_clean":"2024-03-09T15:09:26.585918+0000","last_became_active":"2024-03-09T14:35:41.119890+0000","last_became_peered":"2024-03-09T14:35:41.119890+0000","last_unstale":"2024-03-09T15:09:26.585918+0000","last_undegraded":"2024-03-09T15:09:26.585918+0000","last_fullsized":"2024-03-09T15:09:26.585918+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:29.027891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":99,"num_write":64,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.589494+0000","last_change":"2024-03-09T14:50:35.503867+0000","last_active":"2024-03-09T15:07:56.589494+0000","last_peered":"2024-03-09T15:07:56.589494+0000","last_clean":"2024-03-09T15:07:56.589494+0000","last_became_active":"2024-03-09T14:50:35.503207+0000","last_became_peered":"2024-03-09T14:50:35.503207+0000","last_unstale":"2024-03-09T15:07:56.589494+0000","last_undegraded":"2024-03-09T15:07:56.589494+0000","last_fullsized":"2024-03-09T15:07:56.589494+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:56:26.518688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:11.579763+0000","last_change":"2024-03-09T14:38:37.438790+0000","last_active":"2024-03-09T15:10:11.579763+0000","last_peered":"2024-03-09T15:10:11.579763+0000","last_clean":"2024-03-09T15:10:11.579763+0000","last_became_active":"2024-03-09T14:38:37.438507+0000","last_became_peered":"2024-03-09T14:38:37.438507+0000","last_unstale":"2024-03-09T15:10:11.579763+0000","last_undegraded":"2024-03-09T15:10:11.579763+0000","last_fullsized":"2024-03-09T15:10:11.579763+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:53:53.804104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"261'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.571875+0000","last_change":"2024-03-09T14:38:34.420034+0000","last_active":"2024-03-09T15:07:51.571875+0000","last_peered":"2024-03-09T15:07:51.571875+0000","last_clean":"2024-03-09T15:07:51.571875+0000","last_became_active":"2024-03-09T14:38:34.419043+0000","last_became_peered":"2024-03-09T14:38:34.419043+0000","last_unstale":"2024-03-09T15:07:51.571875+0000","last_undegraded":"2024-03-09T15:07:51.571875+0000","last_fullsized":"2024-03-09T15:07:51.571875+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:11:48.118366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'88","reported_seq":332,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.601567+0000","last_change":"2024-03-09T14:35:41.117878+0000","last_active":"2024-03-09T15:09:26.601567+0000","last_peered":"2024-03-09T15:09:26.601567+0000","last_clean":"2024-03-09T15:09:26.601567+0000","last_became_active":"2024-03-09T14:35:41.117590+0000","last_became_peered":"2024-03-09T14:35:41.117590+0000","last_unstale":"2024-03-09T15:09:26.601567+0000","last_undegraded":"2024-03-09T15:09:26.601567+0000","last_fullsized":"2024-03-09T15:09:26.601567+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:41:31.619759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":440,"num_write":100,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.710572+0000","last_change":"2024-03-09T14:50:35.509165+0000","last_active":"2024-03-09T15:07:56.710572+0000","last_peered":"2024-03-09T15:07:56.710572+0000","last_clean":"2024-03-09T15:07:56.710572+0000","last_became_active":"2024-03-09T14:50:35.508832+0000","last_became_peered":"2024-03-09T14:50:35.508832+0000","last_unstale":"2024-03-09T15:07:56.710572+0000","last_undegraded":"2024-03-09T15:07:56.710572+0000","last_fullsized":"2024-03-09T15:07:56.710572+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:53.394584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'6","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.718904+0000","last_change":"2024-03-09T14:38:37.439624+0000","last_active":"2024-03-09T15:11:45.718904+0000","last_peered":"2024-03-09T15:11:45.718904+0000","last_clean":"2024-03-09T15:11:45.718904+0000","last_became_active":"2024-03-09T14:38:37.439177+0000","last_became_peered":"2024-03-09T14:38:37.439177+0000","last_unstale":"2024-03-09T15:11:45.718904+0000","last_undegraded":"2024-03-09T15:11:45.718904+0000","last_fullsized":"2024-03-09T15:11:45.718904+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:11.579740+0000","last_change":"2024-03-09T14:38:34.421435+0000","last_active":"2024-03-09T15:10:11.579740+0000","last_peered":"2024-03-09T15:10:11.579740+0000","last_clean":"2024-03-09T15:10:11.579740+0000","last_became_active":"2024-03-09T14:38:34.419461+0000","last_became_peered":"2024-03-09T14:38:34.419461+0000","last_unstale":"2024-03-09T15:10:11.579740+0000","last_undegraded":"2024-03-09T15:10:11.579740+0000","last_fullsized":"2024-03-09T15:10:11.579740+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:34:20.395850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'58","reported_seq":192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.570354+0000","last_change":"2024-03-09T14:35:41.116097+0000","last_active":"2024-03-09T15:09:26.570354+0000","last_peered":"2024-03-09T15:09:26.570354+0000","last_clean":"2024-03-09T15:09:26.570354+0000","last_became_active":"2024-03-09T14:35:41.115769+0000","last_became_peered":"2024-03-09T14:35:41.115769+0000","last_unstale":"2024-03-09T15:09:26.570354+0000","last_undegraded":"2024-03-09T15:09:26.570354+0000","last_fullsized":"2024-03-09T15:09:26.570354+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:05:10.170303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":187,"num_write":89,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.695746+0000","last_change":"2024-03-09T14:50:35.512842+0000","last_active":"2024-03-09T15:10:51.695746+0000","last_peered":"2024-03-09T15:10:51.695746+0000","last_clean":"2024-03-09T15:10:51.695746+0000","last_became_active":"2024-03-09T14:50:35.512515+0000","last_became_peered":"2024-03-09T14:50:35.512515+0000","last_unstale":"2024-03-09T15:10:51.695746+0000","last_undegraded":"2024-03-09T15:10:51.695746+0000","last_fullsized":"2024-03-09T15:10:51.695746+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:06.615815+0000","last_change":"2024-03-09T14:38:37.437989+0000","last_active":"2024-03-09T15:11:06.615815+0000","last_peered":"2024-03-09T15:11:06.615815+0000","last_clean":"2024-03-09T15:11:06.615815+0000","last_became_active":"2024-03-09T14:38:37.437674+0000","last_became_peered":"2024-03-09T14:38:37.437674+0000","last_unstale":"2024-03-09T15:11:06.615815+0000","last_undegraded":"2024-03-09T15:11:06.615815+0000","last_fullsized":"2024-03-09T15:11:06.615815+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'9","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.579384+0000","last_change":"2024-03-09T14:38:34.416934+0000","last_active":"2024-03-09T15:08:56.579384+0000","last_peered":"2024-03-09T15:08:56.579384+0000","last_clean":"2024-03-09T15:08:56.579384+0000","last_became_active":"2024-03-09T14:38:34.416635+0000","last_became_peered":"2024-03-09T14:38:34.416635+0000","last_unstale":"2024-03-09T15:08:56.579384+0000","last_undegraded":"2024-03-09T15:08:56.579384+0000","last_fullsized":"2024-03-09T15:08:56.579384+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:04.243246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'78","reported_seq":244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:26.582617+0000","last_change":"2024-03-09T14:35:41.113581+0000","last_active":"2024-03-09T15:09:26.582617+0000","last_peered":"2024-03-09T15:09:26.582617+0000","last_clean":"2024-03-09T15:09:26.582617+0000","last_became_active":"2024-03-09T14:35:41.113283+0000","last_became_peered":"2024-03-09T14:35:41.113283+0000","last_unstale":"2024-03-09T15:09:26.582617+0000","last_undegraded":"2024-03-09T15:09:26.582617+0000","last_fullsized":"2024-03-09T15:09:26.582617+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:01:48.405901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":352,"num_read_kb":252,"num_write":133,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715876+0000","last_change":"2024-03-09T14:50:35.509538+0000","last_active":"2024-03-09T15:08:36.715876+0000","last_peered":"2024-03-09T15:08:36.715876+0000","last_clean":"2024-03-09T15:08:36.715876+0000","last_became_active":"2024-03-09T14:50:35.509248+0000","last_became_peered":"2024-03-09T14:50:35.509248+0000","last_unstale":"2024-03-09T15:08:36.715876+0000","last_undegraded":"2024-03-09T15:08:36.715876+0000","last_fullsized":"2024-03-09T15:08:36.715876+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:52:29.204507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.718503+0000","last_change":"2024-03-09T14:38:37.432905+0000","last_active":"2024-03-09T15:08:56.718503+0000","last_peered":"2024-03-09T15:08:56.718503+0000","last_clean":"2024-03-09T15:08:56.718503+0000","last_became_active":"2024-03-09T14:38:37.432007+0000","last_became_peered":"2024-03-09T14:38:37.432007+0000","last_unstale":"2024-03-09T15:08:56.718503+0000","last_undegraded":"2024-03-09T15:08:56.718503+0000","last_fullsized":"2024-03-09T15:08:56.718503+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:42.955791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"261'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:56.571875+0000","last_change":"2024-03-09T14:38:34.421506+0000","last_active":"2024-03-09T15:08:56.571875+0000","last_peered":"2024-03-09T15:08:56.571875+0000","last_clean":"2024-03-09T15:08:56.571875+0000","last_became_active":"2024-03-09T14:38:34.419582+0000","last_became_peered":"2024-03-09T14:38:34.419582+0000","last_unstale":"2024-03-09T15:08:56.571875+0000","last_undegraded":"2024-03-09T15:08:56.571875+0000","last_fullsized":"2024-03-09T15:08:56.571875+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:37.179560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"261'10","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:16.713161+0000","last_change":"2024-03-09T14:35:41.123265+0000","last_active":"2024-03-09T15:08:16.713161+0000","last_peered":"2024-03-09T15:08:16.713161+0000","last_clean":"2024-03-09T15:08:16.713161+0000","last_became_active":"2024-03-09T14:35:41.122670+0000","last_became_peered":"2024-03-09T14:35:41.122670+0000","last_unstale":"2024-03-09T15:08:16.713161+0000","last_undegraded":"2024-03-09T15:08:16.713161+0000","last_fullsized":"2024-03-09T15:08:16.713161+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:24.170437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715833+0000","last_change":"2024-03-09T14:50:35.506808+0000","last_active":"2024-03-09T15:08:36.715833+0000","last_peered":"2024-03-09T15:08:36.715833+0000","last_clean":"2024-03-09T15:08:36.715833+0000","last_became_active":"2024-03-09T14:50:35.506542+0000","last_became_peered":"2024-03-09T14:50:35.506542+0000","last_unstale":"2024-03-09T15:08:36.715833+0000","last_undegraded":"2024-03-09T15:08:36.715833+0000","last_fullsized":"2024-03-09T15:08:36.715833+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:53:55.176426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.564277+0000","last_change":"2024-03-09T14:38:37.439732+0000","last_active":"2024-03-09T15:07:51.564277+0000","last_peered":"2024-03-09T15:07:51.564277+0000","last_clean":"2024-03-09T15:07:51.564277+0000","last_became_active":"2024-03-09T14:38:37.439444+0000","last_became_peered":"2024-03-09T14:38:37.439444+0000","last_unstale":"2024-03-09T15:07:51.564277+0000","last_undegraded":"2024-03-09T15:07:51.564277+0000","last_fullsized":"2024-03-09T15:07:51.564277+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:04:27.690405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:16.594864+0000","last_change":"2024-03-09T14:38:34.416466+0000","last_active":"2024-03-09T15:11:16.594864+0000","last_peered":"2024-03-09T15:11:16.594864+0000","last_clean":"2024-03-09T15:11:16.594864+0000","last_became_active":"2024-03-09T14:38:34.416139+0000","last_became_peered":"2024-03-09T14:38:34.416139+0000","last_unstale":"2024-03-09T15:11:16.594864+0000","last_undegraded":"2024-03-09T15:11:16.594864+0000","last_fullsized":"2024-03-09T15:11:16.594864+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:43:48.564982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'57","reported_seq":188,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:21.692162+0000","last_change":"2024-03-09T14:35:41.121118+0000","last_active":"2024-03-09T15:10:21.692162+0000","last_peered":"2024-03-09T15:10:21.692162+0000","last_clean":"2024-03-09T15:10:21.692162+0000","last_became_active":"2024-03-09T14:35:41.120802+0000","last_became_peered":"2024-03-09T14:35:41.120802+0000","last_unstale":"2024-03-09T15:10:21.692162+0000","last_undegraded":"2024-03-09T15:10:21.692162+0000","last_fullsized":"2024-03-09T15:10:21.692162+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":244,"num_read_kb":179,"num_write":100,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.577117+0000","last_change":"2024-03-09T14:50:35.505537+0000","last_active":"2024-03-09T15:08:36.577117+0000","last_peered":"2024-03-09T15:08:36.577117+0000","last_clean":"2024-03-09T15:08:36.577117+0000","last_became_active":"2024-03-09T14:50:35.505278+0000","last_became_peered":"2024-03-09T14:50:35.505278+0000","last_unstale":"2024-03-09T15:08:36.577117+0000","last_undegraded":"2024-03-09T15:08:36.577117+0000","last_fullsized":"2024-03-09T15:08:36.577117+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:48:40.487487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:11.738805+0000","last_change":"2024-03-09T14:38:37.436225+0000","last_active":"2024-03-09T15:11:11.738805+0000","last_peered":"2024-03-09T15:11:11.738805+0000","last_clean":"2024-03-09T15:11:11.738805+0000","last_became_active":"2024-03-09T14:38:37.435952+0000","last_became_peered":"2024-03-09T14:38:37.435952+0000","last_unstale":"2024-03-09T15:11:11.738805+0000","last_undegraded":"2024-03-09T15:11:11.738805+0000","last_fullsized":"2024-03-09T15:11:11.738805+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:45:59.696392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'4","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.874577+0000","last_change":"2024-03-09T14:38:34.420726+0000","last_active":"2024-03-09T15:11:45.874577+0000","last_peered":"2024-03-09T15:11:45.874577+0000","last_clean":"2024-03-09T15:11:45.874577+0000","last_became_active":"2024-03-09T14:38:34.420453+0000","last_became_peered":"2024-03-09T14:38:34.420453+0000","last_unstale":"2024-03-09T15:11:45.874577+0000","last_undegraded":"2024-03-09T15:11:45.874577+0000","last_fullsized":"2024-03-09T15:11:45.874577+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":4,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'47","reported_seq":164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591361+0000","last_change":"2024-03-09T14:35:41.119775+0000","last_active":"2024-03-09T15:08:11.591361+0000","last_peered":"2024-03-09T15:08:11.591361+0000","last_clean":"2024-03-09T15:08:11.591361+0000","last_became_active":"2024-03-09T14:35:41.119481+0000","last_became_peered":"2024-03-09T14:35:41.119481+0000","last_unstale":"2024-03-09T15:08:11.591361+0000","last_undegraded":"2024-03-09T15:08:11.591361+0000","last_fullsized":"2024-03-09T15:08:11.591361+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:09.488004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":141,"num_write":77,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.722037+0000","last_change":"2024-03-09T14:50:35.508997+0000","last_active":"2024-03-09T15:09:21.722037+0000","last_peered":"2024-03-09T15:09:21.722037+0000","last_clean":"2024-03-09T15:09:21.722037+0000","last_became_active":"2024-03-09T14:50:35.508707+0000","last_became_peered":"2024-03-09T14:50:35.508707+0000","last_unstale":"2024-03-09T15:09:21.722037+0000","last_undegraded":"2024-03-09T15:09:21.722037+0000","last_fullsized":"2024-03-09T15:09:21.722037+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:47:02.507364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:01.586665+0000","last_change":"2024-03-09T14:38:37.444242+0000","last_active":"2024-03-09T15:10:01.586665+0000","last_peered":"2024-03-09T15:10:01.586665+0000","last_clean":"2024-03-09T15:10:01.586665+0000","last_became_active":"2024-03-09T14:38:37.443923+0000","last_became_peered":"2024-03-09T14:38:37.443923+0000","last_unstale":"2024-03-09T15:10:01.586665+0000","last_undegraded":"2024-03-09T15:10:01.586665+0000","last_fullsized":"2024-03-09T15:10:01.586665+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:13:01.825580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'9","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.770694+0000","last_change":"2024-03-09T14:38:34.421417+0000","last_active":"2024-03-09T15:11:45.770694+0000","last_peered":"2024-03-09T15:11:45.770694+0000","last_clean":"2024-03-09T15:11:45.770694+0000","last_became_active":"2024-03-09T14:38:34.421150+0000","last_became_peered":"2024-03-09T14:38:34.421150+0000","last_unstale":"2024-03-09T15:11:45.770694+0000","last_undegraded":"2024-03-09T15:11:45.770694+0000","last_fullsized":"2024-03-09T15:11:45.770694+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:24:24.004077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":24,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'56","reported_seq":186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.574223+0000","last_change":"2024-03-09T14:35:41.121720+0000","last_active":"2024-03-09T15:08:11.574223+0000","last_peered":"2024-03-09T15:08:11.574223+0000","last_clean":"2024-03-09T15:08:11.574223+0000","last_became_active":"2024-03-09T14:35:41.121047+0000","last_became_peered":"2024-03-09T14:35:41.121047+0000","last_unstale":"2024-03-09T15:08:11.574223+0000","last_undegraded":"2024-03-09T15:08:11.574223+0000","last_fullsized":"2024-03-09T15:08:11.574223+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:40.334231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":176,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.585246+0000","last_change":"2024-03-09T14:50:35.512833+0000","last_active":"2024-03-09T15:09:21.585246+0000","last_peered":"2024-03-09T15:09:21.585246+0000","last_clean":"2024-03-09T15:09:21.585246+0000","last_became_active":"2024-03-09T14:50:35.512540+0000","last_became_peered":"2024-03-09T14:50:35.512540+0000","last_unstale":"2024-03-09T15:09:21.585246+0000","last_undegraded":"2024-03-09T15:09:21.585246+0000","last_fullsized":"2024-03-09T15:09:21.585246+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:14.133666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"261'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.571314+0000","last_change":"2024-03-09T14:38:37.436520+0000","last_active":"2024-03-09T15:07:46.571314+0000","last_peered":"2024-03-09T15:07:46.571314+0000","last_clean":"2024-03-09T15:07:46.571314+0000","last_became_active":"2024-03-09T14:38:37.436246+0000","last_became_peered":"2024-03-09T14:38:37.436246+0000","last_unstale":"2024-03-09T15:07:46.571314+0000","last_undegraded":"2024-03-09T15:07:46.571314+0000","last_fullsized":"2024-03-09T15:07:46.571314+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:42:32.801291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.560208+0000","last_change":"2024-03-09T14:38:34.417805+0000","last_active":"2024-03-09T15:07:56.560208+0000","last_peered":"2024-03-09T15:07:56.560208+0000","last_clean":"2024-03-09T15:07:56.560208+0000","last_became_active":"2024-03-09T14:38:34.417530+0000","last_became_peered":"2024-03-09T14:38:34.417530+0000","last_unstale":"2024-03-09T15:07:56.560208+0000","last_undegraded":"2024-03-09T15:07:56.560208+0000","last_fullsized":"2024-03-09T15:07:56.560208+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:01.677780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'34","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591468+0000","last_change":"2024-03-09T14:35:41.116363+0000","last_active":"2024-03-09T15:08:11.591468+0000","last_peered":"2024-03-09T15:08:11.591468+0000","last_clean":"2024-03-09T15:08:11.591468+0000","last_became_active":"2024-03-09T14:35:41.116050+0000","last_became_peered":"2024-03-09T14:35:41.116050+0000","last_unstale":"2024-03-09T15:08:11.591468+0000","last_undegraded":"2024-03-09T15:08:11.591468+0000","last_fullsized":"2024-03-09T15:08:11.591468+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:25:09.271246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":98,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.570342+0000","last_change":"2024-03-09T14:50:35.513092+0000","last_active":"2024-03-09T15:08:41.570342+0000","last_peered":"2024-03-09T15:08:41.570342+0000","last_clean":"2024-03-09T15:08:41.570342+0000","last_became_active":"2024-03-09T14:50:35.512533+0000","last_became_peered":"2024-03-09T14:50:35.512533+0000","last_unstale":"2024-03-09T15:08:41.570342+0000","last_undegraded":"2024-03-09T15:08:41.570342+0000","last_fullsized":"2024-03-09T15:08:41.570342+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:04:55.415472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:06.738120+0000","last_change":"2024-03-09T14:38:37.432938+0000","last_active":"2024-03-09T15:11:06.738120+0000","last_peered":"2024-03-09T15:11:06.738120+0000","last_clean":"2024-03-09T15:11:06.738120+0000","last_became_active":"2024-03-09T14:38:37.432627+0000","last_became_peered":"2024-03-09T14:38:37.432627+0000","last_unstale":"2024-03-09T15:11:06.738120+0000","last_undegraded":"2024-03-09T15:11:06.738120+0000","last_fullsized":"2024-03-09T15:11:06.738120+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:58:51.983213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:06.600486+0000","last_change":"2024-03-09T14:38:34.416562+0000","last_active":"2024-03-09T15:11:06.600486+0000","last_peered":"2024-03-09T15:11:06.600486+0000","last_clean":"2024-03-09T15:11:06.600486+0000","last_became_active":"2024-03-09T14:38:34.415277+0000","last_became_peered":"2024-03-09T14:38:34.415277+0000","last_unstale":"2024-03-09T15:11:06.600486+0000","last_undegraded":"2024-03-09T15:11:06.600486+0000","last_fullsized":"2024-03-09T15:11:06.600486+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:20.801857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'18","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.719901+0000","last_change":"2024-03-09T14:35:41.123833+0000","last_active":"2024-03-09T15:09:06.719901+0000","last_peered":"2024-03-09T15:09:06.719901+0000","last_clean":"2024-03-09T15:09:06.719901+0000","last_became_active":"2024-03-09T14:35:41.123542+0000","last_became_peered":"2024-03-09T14:35:41.123542+0000","last_unstale":"2024-03-09T15:09:06.719901+0000","last_undegraded":"2024-03-09T15:09:06.719901+0000","last_fullsized":"2024-03-09T15:09:06.719901+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:01.200992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":44,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.492700+0000","last_change":"2024-03-09T14:50:35.506612+0000","last_active":"2024-03-09T15:11:26.492700+0000","last_peered":"2024-03-09T15:11:26.492700+0000","last_clean":"2024-03-09T15:11:26.492700+0000","last_became_active":"2024-03-09T14:50:35.506332+0000","last_became_peered":"2024-03-09T14:50:35.506332+0000","last_unstale":"2024-03-09T15:11:26.492700+0000","last_undegraded":"2024-03-09T15:11:26.492700+0000","last_fullsized":"2024-03-09T15:11:26.492700+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.954128+0000","last_change":"2024-03-09T14:38:37.438481+0000","last_active":"2024-03-09T15:11:45.954128+0000","last_peered":"2024-03-09T15:11:45.954128+0000","last_clean":"2024-03-09T15:11:45.954128+0000","last_became_active":"2024-03-09T14:38:37.438182+0000","last_became_peered":"2024-03-09T14:38:37.438182+0000","last_unstale":"2024-03-09T15:11:45.954128+0000","last_undegraded":"2024-03-09T15:11:45.954128+0000","last_fullsized":"2024-03-09T15:11:45.954128+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:06.738135+0000","last_change":"2024-03-09T14:38:34.423437+0000","last_active":"2024-03-09T15:11:06.738135+0000","last_peered":"2024-03-09T15:11:06.738135+0000","last_clean":"2024-03-09T15:11:06.738135+0000","last_became_active":"2024-03-09T14:38:34.423106+0000","last_became_peered":"2024-03-09T14:38:34.423106+0000","last_unstale":"2024-03-09T15:11:06.738135+0000","last_undegraded":"2024-03-09T15:11:06.738135+0000","last_fullsized":"2024-03-09T15:11:06.738135+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:39:42.766455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'25","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.572391+0000","last_change":"2024-03-09T14:35:41.118139+0000","last_active":"2024-03-09T15:09:01.572391+0000","last_peered":"2024-03-09T15:09:01.572391+0000","last_clean":"2024-03-09T15:09:01.572391+0000","last_became_active":"2024-03-09T14:35:41.117841+0000","last_became_peered":"2024-03-09T14:35:41.117841+0000","last_unstale":"2024-03-09T15:09:01.572391+0000","last_undegraded":"2024-03-09T15:09:01.572391+0000","last_fullsized":"2024-03-09T15:09:01.572391+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:59:14.029378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":73,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.560222+0000","last_change":"2024-03-09T14:50:35.509942+0000","last_active":"2024-03-09T15:07:56.560222+0000","last_peered":"2024-03-09T15:07:56.560222+0000","last_clean":"2024-03-09T15:07:56.560222+0000","last_became_active":"2024-03-09T14:50:35.509460+0000","last_became_peered":"2024-03-09T14:50:35.509460+0000","last_unstale":"2024-03-09T15:07:56.560222+0000","last_undegraded":"2024-03-09T15:07:56.560222+0000","last_fullsized":"2024-03-09T15:07:56.560222+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:23:50.413320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:51.577505+0000","last_change":"2024-03-09T14:38:37.439377+0000","last_active":"2024-03-09T15:09:51.577505+0000","last_peered":"2024-03-09T15:09:51.577505+0000","last_clean":"2024-03-09T15:09:51.577505+0000","last_became_active":"2024-03-09T14:38:37.439087+0000","last_became_peered":"2024-03-09T14:38:37.439087+0000","last_unstale":"2024-03-09T15:09:51.577505+0000","last_undegraded":"2024-03-09T15:09:51.577505+0000","last_fullsized":"2024-03-09T15:09:51.577505+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:58.859594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:41.734221+0000","last_change":"2024-03-09T14:38:34.418700+0000","last_active":"2024-03-09T15:10:41.734221+0000","last_peered":"2024-03-09T15:10:41.734221+0000","last_clean":"2024-03-09T15:10:41.734221+0000","last_became_active":"2024-03-09T14:38:34.418453+0000","last_became_peered":"2024-03-09T14:38:34.418453+0000","last_unstale":"2024-03-09T15:10:41.734221+0000","last_undegraded":"2024-03-09T15:10:41.734221+0000","last_fullsized":"2024-03-09T15:10:41.734221+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:34:24.696789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'42","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.582487+0000","last_change":"2024-03-09T14:35:41.119444+0000","last_active":"2024-03-09T15:09:01.582487+0000","last_peered":"2024-03-09T15:09:01.582487+0000","last_clean":"2024-03-09T15:09:01.582487+0000","last_became_active":"2024-03-09T14:35:41.119181+0000","last_became_peered":"2024-03-09T14:35:41.119181+0000","last_unstale":"2024-03-09T15:09:01.582487+0000","last_undegraded":"2024-03-09T15:09:01.582487+0000","last_fullsized":"2024-03-09T15:09:01.582487+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:50:55.417930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":129,"num_write":69,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.572571+0000","last_change":"2024-03-09T14:50:35.504114+0000","last_active":"2024-03-09T15:07:56.572571+0000","last_peered":"2024-03-09T15:07:56.572571+0000","last_clean":"2024-03-09T15:07:56.572571+0000","last_became_active":"2024-03-09T14:50:35.503858+0000","last_became_peered":"2024-03-09T14:50:35.503858+0000","last_unstale":"2024-03-09T15:07:56.572571+0000","last_undegraded":"2024-03-09T15:07:56.572571+0000","last_fullsized":"2024-03-09T15:07:56.572571+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:40:55.004194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.580175+0000","last_change":"2024-03-09T14:38:37.434360+0000","last_active":"2024-03-09T15:08:41.580175+0000","last_peered":"2024-03-09T15:08:41.580175+0000","last_clean":"2024-03-09T15:08:41.580175+0000","last_became_active":"2024-03-09T14:38:37.434065+0000","last_became_peered":"2024-03-09T14:38:37.434065+0000","last_unstale":"2024-03-09T15:08:41.580175+0000","last_undegraded":"2024-03-09T15:08:41.580175+0000","last_fullsized":"2024-03-09T15:08:41.580175+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:19:29.089561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'4","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:51.726782+0000","last_change":"2024-03-09T14:38:34.423457+0000","last_active":"2024-03-09T15:09:51.726782+0000","last_peered":"2024-03-09T15:09:51.726782+0000","last_clean":"2024-03-09T15:09:51.726782+0000","last_became_active":"2024-03-09T14:38:34.423145+0000","last_became_peered":"2024-03-09T14:38:34.423145+0000","last_unstale":"2024-03-09T15:09:51.726782+0000","last_undegraded":"2024-03-09T15:09:51.726782+0000","last_fullsized":"2024-03-09T15:09:51.726782+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:09.464410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'41","reported_seq":155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.081553+0000","last_change":"2024-03-09T15:11:51.081580+0000","last_active":"2024-03-09T15:11:51.081553+0000","last_peered":"2024-03-09T15:11:51.081553+0000","last_clean":"2024-03-09T15:11:51.081553+0000","last_became_active":"2024-03-09T14:35:41.117617+0000","last_became_peered":"2024-03-09T14:35:41.117617+0000","last_unstale":"2024-03-09T15:11:51.081553+0000","last_undegraded":"2024-03-09T15:11:51.081553+0000","last_fullsized":"2024-03-09T15:11:51.081553+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-03-09T15:11:51.081467+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-03-09T15:11:51.081467+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.081467+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:57:36.656065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":72,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.582122+0000","last_change":"2024-03-09T14:50:35.506611+0000","last_active":"2024-03-09T15:09:21.582122+0000","last_peered":"2024-03-09T15:09:21.582122+0000","last_clean":"2024-03-09T15:09:21.582122+0000","last_became_active":"2024-03-09T14:50:35.506356+0000","last_became_peered":"2024-03-09T14:50:35.506356+0000","last_unstale":"2024-03-09T15:09:21.582122+0000","last_undegraded":"2024-03-09T15:09:21.582122+0000","last_fullsized":"2024-03-09T15:09:21.582122+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:42:15.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.779490+0000","last_change":"2024-03-09T14:38:37.439826+0000","last_active":"2024-03-09T15:11:45.779490+0000","last_peered":"2024-03-09T15:11:45.779490+0000","last_clean":"2024-03-09T15:11:45.779490+0000","last_became_active":"2024-03-09T14:38:37.439120+0000","last_became_peered":"2024-03-09T14:38:37.439120+0000","last_unstale":"2024-03-09T15:11:45.779490+0000","last_undegraded":"2024-03-09T15:11:45.779490+0000","last_fullsized":"2024-03-09T15:11:45.779490+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:27.748958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"261'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.563759+0000","last_change":"2024-03-09T14:38:34.422928+0000","last_active":"2024-03-09T15:07:46.563759+0000","last_peered":"2024-03-09T15:07:46.563759+0000","last_clean":"2024-03-09T15:07:46.563759+0000","last_became_active":"2024-03-09T14:38:34.422585+0000","last_became_peered":"2024-03-09T14:38:34.422585+0000","last_unstale":"2024-03-09T15:07:46.563759+0000","last_undegraded":"2024-03-09T15:07:46.563759+0000","last_fullsized":"2024-03-09T15:07:46.563759+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:09.827968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'19","reported_seq":94,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.597802+0000","last_change":"2024-03-09T14:35:41.119625+0000","last_active":"2024-03-09T15:09:01.597802+0000","last_peered":"2024-03-09T15:09:01.597802+0000","last_clean":"2024-03-09T15:09:01.597802+0000","last_became_active":"2024-03-09T14:35:41.118425+0000","last_became_peered":"2024-03-09T14:35:41.118425+0000","last_unstale":"2024-03-09T15:09:01.597802+0000","last_undegraded":"2024-03-09T15:09:01.597802+0000","last_fullsized":"2024-03-09T15:09:01.597802+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:23:15.437892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":53,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.722085+0000","last_change":"2024-03-09T14:50:35.505890+0000","last_active":"2024-03-09T15:09:21.722085+0000","last_peered":"2024-03-09T15:09:21.722085+0000","last_clean":"2024-03-09T15:09:21.722085+0000","last_became_active":"2024-03-09T14:50:35.505615+0000","last_became_peered":"2024-03-09T14:50:35.505615+0000","last_unstale":"2024-03-09T15:09:21.722085+0000","last_undegraded":"2024-03-09T15:09:21.722085+0000","last_fullsized":"2024-03-09T15:09:21.722085+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:12.727103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.886460+0000","last_change":"2024-03-09T14:38:37.437735+0000","last_active":"2024-03-09T15:11:45.886460+0000","last_peered":"2024-03-09T15:11:45.886460+0000","last_clean":"2024-03-09T15:11:45.886460+0000","last_became_active":"2024-03-09T14:38:37.437417+0000","last_became_peered":"2024-03-09T14:38:37.437417+0000","last_unstale":"2024-03-09T15:11:45.886460+0000","last_undegraded":"2024-03-09T15:11:45.886460+0000","last_fullsized":"2024-03-09T15:11:45.886460+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"261'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588136+0000","last_change":"2024-03-09T14:38:34.415988+0000","last_active":"2024-03-09T15:07:46.588136+0000","last_peered":"2024-03-09T15:07:46.588136+0000","last_clean":"2024-03-09T15:07:46.588136+0000","last_became_active":"2024-03-09T14:38:34.415722+0000","last_became_peered":"2024-03-09T14:38:34.415722+0000","last_unstale":"2024-03-09T15:07:46.588136+0000","last_undegraded":"2024-03-09T15:07:46.588136+0000","last_fullsized":"2024-03-09T15:07:46.588136+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:07.146194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'34","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.709277+0000","last_change":"2024-03-09T14:35:41.121819+0000","last_active":"2024-03-09T15:07:46.709277+0000","last_peered":"2024-03-09T15:07:46.709277+0000","last_clean":"2024-03-09T15:07:46.709277+0000","last_became_active":"2024-03-09T14:35:41.121524+0000","last_became_peered":"2024-03-09T14:35:41.121524+0000","last_unstale":"2024-03-09T15:07:46.709277+0000","last_undegraded":"2024-03-09T15:07:46.709277+0000","last_fullsized":"2024-03-09T15:07:46.709277+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:28:01.825341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":103,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'188","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.938320+0000","last_change":"2024-03-09T14:27:03.724626+0000","last_active":"2024-03-09T15:11:45.938320+0000","last_peered":"2024-03-09T15:11:45.938320+0000","last_clean":"2024-03-09T15:11:45.938320+0000","last_became_active":"2024-03-09T14:27:03.724231+0000","last_became_peered":"2024-03-09T14:27:03.724231+0000","last_unstale":"2024-03-09T15:11:45.938320+0000","last_undegraded":"2024-03-09T15:11:45.938320+0000","last_fullsized":"2024-03-09T15:11:45.938320+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:50.020398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8703114,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":339,"num_read_kb":37539,"num_write":995,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'398","reported_seq":1851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:49.452754+0000","last_change":"2024-03-09T14:26:28.649571+0000","last_active":"2024-03-09T15:10:49.452754+0000","last_peered":"2024-03-09T15:10:49.452754+0000","last_clean":"2024-03-09T15:10:49.452754+0000","last_became_active":"2024-03-09T14:26:28.648852+0000","last_became_peered":"2024-03-09T14:26:28.648852+0000","last_unstale":"2024-03-09T15:10:49.452754+0000","last_undegraded":"2024-03-09T15:10:49.452754+0000","last_fullsized":"2024-03-09T15:10:49.452754+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:19.263893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2165,"num_read_kb":2027,"num_write":486,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'163","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.962702+0000","last_change":"2024-03-09T14:26:26.636093+0000","last_active":"2024-03-09T15:11:45.962702+0000","last_peered":"2024-03-09T15:11:45.962702+0000","last_clean":"2024-03-09T15:11:45.962702+0000","last_became_active":"2024-03-09T14:26:26.635705+0000","last_became_peered":"2024-03-09T14:26:26.635705+0000","last_unstale":"2024-03-09T15:11:45.962702+0000","last_undegraded":"2024-03-09T15:11:45.962702+0000","last_fullsized":"2024-03-09T15:11:45.962702+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:44.432842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":33876,"num_write":835,"num_write_kb":32927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'816","reported_seq":2387,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.199607+0000","last_change":"2024-03-09T14:28:04.197235+0000","last_active":"2024-03-09T15:11:09.199607+0000","last_peered":"2024-03-09T15:11:09.199607+0000","last_clean":"2024-03-09T15:11:09.199607+0000","last_became_active":"2024-03-09T14:28:04.196872+0000","last_became_peered":"2024-03-09T14:28:04.196872+0000","last_unstale":"2024-03-09T15:11:09.199607+0000","last_undegraded":"2024-03-09T15:11:09.199607+0000","last_fullsized":"2024-03-09T15:11:09.199607+0000","mapping_epoch":38,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:48.732249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3746,"num_read_kb":3347,"num_write":1098,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'207","reported_seq":858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.793253+0000","last_change":"2024-03-09T14:26:26.626838+0000","last_active":"2024-03-09T15:11:45.793253+0000","last_peered":"2024-03-09T15:11:45.793253+0000","last_clean":"2024-03-09T15:11:45.793253+0000","last_became_active":"2024-03-09T14:26:26.626521+0000","last_became_peered":"2024-03-09T14:26:26.626521+0000","last_unstale":"2024-03-09T15:11:45.793253+0000","last_undegraded":"2024-03-09T15:11:45.793253+0000","last_fullsized":"2024-03-09T15:11:45.793253+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:37.136696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":486,"num_read_kb":60498,"num_write":1106,"num_write_kb":28928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'630","reported_seq":2072,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.493659+0000","last_change":"2024-03-09T14:26:28.649656+0000","last_active":"2024-03-09T15:11:31.493659+0000","last_peered":"2024-03-09T15:11:31.493659+0000","last_clean":"2024-03-09T15:11:31.493659+0000","last_became_active":"2024-03-09T14:26:28.649054+0000","last_became_peered":"2024-03-09T14:26:28.649054+0000","last_unstale":"2024-03-09T15:11:31.493659+0000","last_undegraded":"2024-03-09T15:11:31.493659+0000","last_fullsized":"2024-03-09T15:11:31.493659+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":600,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3080,"num_read_kb":2811,"num_write":822,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'179","reported_seq":785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.732959+0000","last_change":"2024-03-09T14:26:26.647604+0000","last_active":"2024-03-09T15:11:45.732959+0000","last_peered":"2024-03-09T15:11:45.732959+0000","last_clean":"2024-03-09T15:11:45.732959+0000","last_became_active":"2024-03-09T14:26:26.647183+0000","last_became_peered":"2024-03-09T14:26:26.647183+0000","last_unstale":"2024-03-09T15:11:45.732959+0000","last_undegraded":"2024-03-09T15:11:45.732959+0000","last_fullsized":"2024-03-09T15:11:45.732959+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:57:15.681003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":425,"num_read_kb":10841,"num_write":993,"num_write_kb":22118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'383","reported_seq":1952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.553788+0000","last_change":"2024-03-09T14:26:28.649519+0000","last_active":"2024-03-09T15:10:54.553788+0000","last_peered":"2024-03-09T15:10:54.553788+0000","last_clean":"2024-03-09T15:10:54.553788+0000","last_became_active":"2024-03-09T14:26:28.649146+0000","last_became_peered":"2024-03-09T14:26:28.649146+0000","last_unstale":"2024-03-09T15:10:54.553788+0000","last_undegraded":"2024-03-09T15:10:54.553788+0000","last_fullsized":"2024-03-09T15:10:54.553788+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:12:07.136106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2286,"num_read_kb":2187,"num_write":441,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'274","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.935807+0000","last_change":"2024-03-09T14:26:26.652067+0000","last_active":"2024-03-09T15:11:45.935807+0000","last_peered":"2024-03-09T15:11:45.935807+0000","last_clean":"2024-03-09T15:11:45.935807+0000","last_became_active":"2024-03-09T14:26:26.651564+0000","last_became_peered":"2024-03-09T14:26:26.651564+0000","last_unstale":"2024-03-09T15:11:45.935807+0000","last_undegraded":"2024-03-09T15:11:45.935807+0000","last_fullsized":"2024-03-09T15:11:45.935807+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:14:35.603518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12595319,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":658,"num_read_kb":37858,"num_write":1532,"num_write_kb":26421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'334","reported_seq":1772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:13.861455+0000","last_change":"2024-03-09T14:26:28.648555+0000","last_active":"2024-03-09T15:09:13.861455+0000","last_peered":"2024-03-09T15:09:13.861455+0000","last_clean":"2024-03-09T15:09:13.861455+0000","last_became_active":"2024-03-09T14:26:28.648259+0000","last_became_peered":"2024-03-09T14:26:28.648259+0000","last_unstale":"2024-03-09T15:09:13.861455+0000","last_undegraded":"2024-03-09T15:09:13.861455+0000","last_fullsized":"2024-03-09T15:09:13.861455+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:13:53.538477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2053,"num_read_kb":1964,"num_write":385,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'170","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.963459+0000","last_change":"2024-03-09T14:26:26.649108+0000","last_active":"2024-03-09T15:11:45.963459+0000","last_peered":"2024-03-09T15:11:45.963459+0000","last_clean":"2024-03-09T15:11:45.963459+0000","last_became_active":"2024-03-09T14:26:26.648780+0000","last_became_peered":"2024-03-09T14:26:26.648780+0000","last_unstale":"2024-03-09T15:11:45.963459+0000","last_undegraded":"2024-03-09T15:11:45.963459+0000","last_fullsized":"2024-03-09T15:11:45.963459+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:42.844197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525518,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":382,"num_read_kb":3119,"num_write":934,"num_write_kb":23902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'461","reported_seq":2007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.336838+0000","last_change":"2024-03-09T14:26:28.650877+0000","last_active":"2024-03-09T15:10:45.336838+0000","last_peered":"2024-03-09T15:10:45.336838+0000","last_clean":"2024-03-09T15:10:45.336838+0000","last_became_active":"2024-03-09T14:26:28.649994+0000","last_became_peered":"2024-03-09T14:26:28.649994+0000","last_unstale":"2024-03-09T15:10:45.336838+0000","last_undegraded":"2024-03-09T15:10:45.336838+0000","last_fullsized":"2024-03-09T15:10:45.336838+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2508,"num_read_kb":2326,"num_write":602,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'163","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.963711+0000","last_change":"2024-03-09T14:26:26.652122+0000","last_active":"2024-03-09T15:11:45.963711+0000","last_peered":"2024-03-09T15:11:45.963711+0000","last_clean":"2024-03-09T15:11:45.963711+0000","last_became_active":"2024-03-09T14:26:26.651754+0000","last_became_peered":"2024-03-09T14:26:26.651754+0000","last_unstale":"2024-03-09T15:11:45.963711+0000","last_undegraded":"2024-03-09T15:11:45.963711+0000","last_fullsized":"2024-03-09T15:11:45.963711+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:56:39.902062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":432,"num_read_kb":120305,"num_write":891,"num_write_kb":41051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'1264","reported_seq":2891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.180247+0000","last_change":"2024-03-09T14:26:28.652076+0000","last_active":"2024-03-09T15:11:09.180247+0000","last_peered":"2024-03-09T15:11:09.180247+0000","last_clean":"2024-03-09T15:11:09.180247+0000","last_became_active":"2024-03-09T14:26:28.651754+0000","last_became_peered":"2024-03-09T14:26:28.651754+0000","last_unstale":"2024-03-09T15:11:09.180247+0000","last_undegraded":"2024-03-09T15:11:09.180247+0000","last_fullsized":"2024-03-09T15:11:09.180247+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:58.139033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5611,"num_read_kb":4890,"num_write":1803,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'158","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.962481+0000","last_change":"2024-03-09T14:26:26.643565+0000","last_active":"2024-03-09T15:11:45.962481+0000","last_peered":"2024-03-09T15:11:45.962481+0000","last_clean":"2024-03-09T15:11:45.962481+0000","last_became_active":"2024-03-09T14:26:26.643195+0000","last_became_peered":"2024-03-09T14:26:26.643195+0000","last_unstale":"2024-03-09T15:11:45.962481+0000","last_undegraded":"2024-03-09T15:11:45.962481+0000","last_fullsized":"2024-03-09T15:11:45.962481+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924406,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":386,"num_read_kb":7445,"num_write":885,"num_write_kb":17740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'832","reported_seq":2501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.868382+0000","last_change":"2024-03-09T14:26:28.654056+0000","last_active":"2024-03-09T15:11:07.868382+0000","last_peered":"2024-03-09T15:11:07.868382+0000","last_clean":"2024-03-09T15:11:07.868382+0000","last_became_active":"2024-03-09T14:26:28.653778+0000","last_became_peered":"2024-03-09T14:26:28.653778+0000","last_unstale":"2024-03-09T15:11:07.868382+0000","last_undegraded":"2024-03-09T15:11:07.868382+0000","last_fullsized":"2024-03-09T15:11:07.868382+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:38:55.151292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3883,"num_read_kb":3504,"num_write":1111,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'451","reported_seq":2034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.552231+0000","last_change":"2024-03-09T14:26:28.649892+0000","last_active":"2024-03-09T15:10:54.552231+0000","last_peered":"2024-03-09T15:10:54.552231+0000","last_clean":"2024-03-09T15:10:54.552231+0000","last_became_active":"2024-03-09T14:26:28.649128+0000","last_became_peered":"2024-03-09T14:26:28.649128+0000","last_unstale":"2024-03-09T15:10:54.552231+0000","last_undegraded":"2024-03-09T15:10:54.552231+0000","last_fullsized":"2024-03-09T15:10:54.552231+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2472,"num_read_kb":2328,"num_write":564,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'188","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.790132+0000","last_change":"2024-03-09T14:26:26.651818+0000","last_active":"2024-03-09T15:11:45.790132+0000","last_peered":"2024-03-09T15:11:45.790132+0000","last_clean":"2024-03-09T15:11:45.790132+0000","last_became_active":"2024-03-09T14:26:26.651323+0000","last_became_peered":"2024-03-09T14:26:26.651323+0000","last_unstale":"2024-03-09T15:11:45.790132+0000","last_undegraded":"2024-03-09T15:11:45.790132+0000","last_fullsized":"2024-03-09T15:11:45.790132+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:26.086700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2187,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":439,"num_read_kb":7847,"num_write":1012,"num_write_kb":34087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'415","reported_seq":1935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:34.444271+0000","last_change":"2024-03-09T14:26:28.646304+0000","last_active":"2024-03-09T15:10:34.444271+0000","last_peered":"2024-03-09T15:10:34.444271+0000","last_clean":"2024-03-09T15:10:34.444271+0000","last_became_active":"2024-03-09T14:26:28.645422+0000","last_became_peered":"2024-03-09T14:26:28.645422+0000","last_unstale":"2024-03-09T15:10:34.444271+0000","last_undegraded":"2024-03-09T15:10:34.444271+0000","last_fullsized":"2024-03-09T15:10:34.444271+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:50:13.964684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2243,"num_read_kb":2118,"num_write":516,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'179","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.829553+0000","last_change":"2024-03-09T14:26:26.644904+0000","last_active":"2024-03-09T15:11:45.829553+0000","last_peered":"2024-03-09T15:11:45.829553+0000","last_clean":"2024-03-09T15:11:45.829553+0000","last_became_active":"2024-03-09T14:26:26.644578+0000","last_became_peered":"2024-03-09T14:26:26.644578+0000","last_unstale":"2024-03-09T15:11:45.829553+0000","last_undegraded":"2024-03-09T15:11:45.829553+0000","last_fullsized":"2024-03-09T15:11:45.829553+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:27:29.674744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":16041,"num_write":1043,"num_write_kb":25248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'392","reported_seq":2099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.420096+0000","last_change":"2024-03-09T14:26:28.648611+0000","last_active":"2024-03-09T15:11:04.420096+0000","last_peered":"2024-03-09T15:11:04.420096+0000","last_clean":"2024-03-09T15:11:04.420096+0000","last_became_active":"2024-03-09T14:26:28.648115+0000","last_became_peered":"2024-03-09T14:26:28.648115+0000","last_unstale":"2024-03-09T15:11:04.420096+0000","last_undegraded":"2024-03-09T15:11:04.420096+0000","last_fullsized":"2024-03-09T15:11:04.420096+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:30:00.259696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2471,"num_read_kb":2382,"num_write":449,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'206","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.850303+0000","last_change":"2024-03-09T14:26:26.647793+0000","last_active":"2024-03-09T15:11:45.850303+0000","last_peered":"2024-03-09T15:11:45.850303+0000","last_clean":"2024-03-09T15:11:45.850303+0000","last_became_active":"2024-03-09T14:26:26.647391+0000","last_became_peered":"2024-03-09T14:26:26.647391+0000","last_unstale":"2024-03-09T15:11:45.850303+0000","last_undegraded":"2024-03-09T15:11:45.850303+0000","last_fullsized":"2024-03-09T15:11:45.850303+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:14.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778753,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":14846,"num_write":1056,"num_write_kb":41673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'453","reported_seq":2022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.896057+0000","last_change":"2024-03-09T14:26:28.648170+0000","last_active":"2024-03-09T15:11:07.896057+0000","last_peered":"2024-03-09T15:11:07.896057+0000","last_clean":"2024-03-09T15:11:07.896057+0000","last_became_active":"2024-03-09T14:26:28.647846+0000","last_became_peered":"2024-03-09T14:26:28.647846+0000","last_unstale":"2024-03-09T15:11:07.896057+0000","last_undegraded":"2024-03-09T15:11:07.896057+0000","last_fullsized":"2024-03-09T15:11:07.896057+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:52:23.409112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2382,"num_read_kb":2246,"num_write":552,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'284","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.976624+0000","last_change":"2024-03-09T14:26:26.638124+0000","last_active":"2024-03-09T15:11:45.976624+0000","last_peered":"2024-03-09T15:11:45.976624+0000","last_clean":"2024-03-09T15:11:45.976624+0000","last_became_active":"2024-03-09T14:26:26.637767+0000","last_became_peered":"2024-03-09T14:26:26.637767+0000","last_unstale":"2024-03-09T15:11:45.976624+0000","last_undegraded":"2024-03-09T15:11:45.976624+0000","last_fullsized":"2024-03-09T15:11:45.976624+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4508970,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":598,"num_read_kb":72489,"num_write":1415,"num_write_kb":47263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'1533","reported_seq":3258,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.873260+0000","last_change":"2024-03-09T14:26:28.654340+0000","last_active":"2024-03-09T15:11:07.873260+0000","last_peered":"2024-03-09T15:11:07.873260+0000","last_clean":"2024-03-09T15:11:07.873260+0000","last_became_active":"2024-03-09T14:26:28.653385+0000","last_became_peered":"2024-03-09T14:26:28.653385+0000","last_unstale":"2024-03-09T15:11:07.873260+0000","last_undegraded":"2024-03-09T15:11:07.873260+0000","last_fullsized":"2024-03-09T15:11:07.873260+0000","mapping_epoch":25,"log_start":"264'1500","ondisk_log_start":"264'1500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:12:04.813024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6446,"num_read_kb":5594,"num_write":2158,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'220","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.970605+0000","last_change":"2024-03-09T14:26:26.644011+0000","last_active":"2024-03-09T15:11:45.970605+0000","last_peered":"2024-03-09T15:11:45.970605+0000","last_clean":"2024-03-09T15:11:45.970605+0000","last_became_active":"2024-03-09T14:26:26.643401+0000","last_became_peered":"2024-03-09T14:26:26.643401+0000","last_unstale":"2024-03-09T15:11:45.970605+0000","last_undegraded":"2024-03-09T15:11:45.970605+0000","last_fullsized":"2024-03-09T15:11:45.970605+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":517275,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":464,"num_read_kb":13858,"num_write":1176,"num_write_kb":34499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'726","reported_seq":2206,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.153541+0000","last_change":"2024-03-09T14:26:28.650896+0000","last_active":"2024-03-09T15:11:37.153541+0000","last_peered":"2024-03-09T15:11:37.153541+0000","last_clean":"2024-03-09T15:11:37.153541+0000","last_became_active":"2024-03-09T14:26:28.650334+0000","last_became_peered":"2024-03-09T14:26:28.650334+0000","last_unstale":"2024-03-09T15:11:37.153541+0000","last_undegraded":"2024-03-09T15:11:37.153541+0000","last_fullsized":"2024-03-09T15:11:37.153541+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3318,"num_read_kb":2980,"num_write":968,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'137","reported_seq":727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.875910+0000","last_change":"2024-03-09T14:26:26.631574+0000","last_active":"2024-03-09T15:11:45.875910+0000","last_peered":"2024-03-09T15:11:45.875910+0000","last_clean":"2024-03-09T15:11:45.875910+0000","last_became_active":"2024-03-09T14:26:26.631203+0000","last_became_peered":"2024-03-09T14:26:26.631203+0000","last_unstale":"2024-03-09T15:11:45.875910+0000","last_undegraded":"2024-03-09T15:11:45.875910+0000","last_fullsized":"2024-03-09T15:11:45.875910+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:18:43.836166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049909,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":305,"num_read_kb":11988,"num_write":738,"num_write_kb":25932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'99","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.880953+0000","last_change":"2024-03-09T14:26:36.674788+0000","last_active":"2024-03-09T15:11:07.880953+0000","last_peered":"2024-03-09T15:11:07.880953+0000","last_clean":"2024-03-09T15:11:07.880953+0000","last_became_active":"2024-03-09T14:26:36.674500+0000","last_became_peered":"2024-03-09T14:26:36.674500+0000","last_unstale":"2024-03-09T15:11:07.880953+0000","last_undegraded":"2024-03-09T15:11:07.880953+0000","last_fullsized":"2024-03-09T15:11:07.880953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":88,"num_write":230,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'372","reported_seq":1772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:44.538039+0000","last_change":"2024-03-09T14:28:03.816157+0000","last_active":"2024-03-09T15:09:44.538039+0000","last_peered":"2024-03-09T15:09:44.538039+0000","last_clean":"2024-03-09T15:09:44.538039+0000","last_became_active":"2024-03-09T14:28:03.815924+0000","last_became_peered":"2024-03-09T14:28:03.815924+0000","last_unstale":"2024-03-09T15:09:44.538039+0000","last_undegraded":"2024-03-09T15:09:44.538039+0000","last_fullsized":"2024-03-09T15:09:44.538039+0000","mapping_epoch":38,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:54:24.380063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1992,"num_read_kb":1883,"num_write":432,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"264'204","reported_seq":810,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.867031+0000","last_change":"2024-03-09T14:26:26.653743+0000","last_active":"2024-03-09T15:11:45.867031+0000","last_peered":"2024-03-09T15:11:45.867031+0000","last_clean":"2024-03-09T15:11:45.867031+0000","last_became_active":"2024-03-09T14:26:26.652957+0000","last_became_peered":"2024-03-09T14:26:26.652957+0000","last_unstale":"2024-03-09T15:11:45.867031+0000","last_undegraded":"2024-03-09T15:11:45.867031+0000","last_fullsized":"2024-03-09T15:11:45.867031+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:49.440301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048753,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":421,"num_read_kb":22200,"num_write":1166,"num_write_kb":38864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.572316+0000","last_change":"2024-03-09T14:26:30.655416+0000","last_active":"2024-03-09T15:07:36.572316+0000","last_peered":"2024-03-09T15:07:36.572316+0000","last_clean":"2024-03-09T15:07:36.572316+0000","last_became_active":"2024-03-09T14:26:30.654862+0000","last_became_peered":"2024-03-09T14:26:30.654862+0000","last_unstale":"2024-03-09T15:07:36.572316+0000","last_undegraded":"2024-03-09T15:07:36.572316+0000","last_fullsized":"2024-03-09T15:07:36.572316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:05.895677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'185","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.745095+0000","last_change":"2024-03-09T14:26:32.653350+0000","last_active":"2024-03-09T15:11:45.745095+0000","last_peered":"2024-03-09T15:11:45.745095+0000","last_clean":"2024-03-09T15:11:45.745095+0000","last_became_active":"2024-03-09T14:26:32.652879+0000","last_became_peered":"2024-03-09T14:26:32.652879+0000","last_unstale":"2024-03-09T15:11:45.745095+0000","last_undegraded":"2024-03-09T15:11:45.745095+0000","last_fullsized":"2024-03-09T15:11:45.745095+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:22:58.520379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19668,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":251,"num_read_kb":350,"num_write":144,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.708826+0000","last_change":"2024-03-09T14:26:34.670623+0000","last_active":"2024-03-09T15:07:41.708826+0000","last_peered":"2024-03-09T15:07:41.708826+0000","last_clean":"2024-03-09T15:07:41.708826+0000","last_became_active":"2024-03-09T14:26:34.670336+0000","last_became_peered":"2024-03-09T14:26:34.670336+0000","last_unstale":"2024-03-09T15:07:41.708826+0000","last_undegraded":"2024-03-09T15:07:41.708826+0000","last_fullsized":"2024-03-09T15:07:41.708826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:22:58.489151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'168","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.758728+0000","last_change":"2024-03-09T14:26:36.674055+0000","last_active":"2024-03-09T15:10:35.758728+0000","last_peered":"2024-03-09T15:10:35.758728+0000","last_clean":"2024-03-09T15:10:35.758728+0000","last_became_active":"2024-03-09T14:26:36.673806+0000","last_became_peered":"2024-03-09T14:26:36.673806+0000","last_unstale":"2024-03-09T15:10:35.758728+0000","last_undegraded":"2024-03-09T15:10:35.758728+0000","last_fullsized":"2024-03-09T15:10:35.758728+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:17:00.170276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":385,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'374","reported_seq":1917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.421489+0000","last_change":"2024-03-09T14:26:28.646103+0000","last_active":"2024-03-09T15:11:04.421489+0000","last_peered":"2024-03-09T15:11:04.421489+0000","last_clean":"2024-03-09T15:11:04.421489+0000","last_became_active":"2024-03-09T14:26:28.645537+0000","last_became_peered":"2024-03-09T14:26:28.645537+0000","last_unstale":"2024-03-09T15:11:04.421489+0000","last_undegraded":"2024-03-09T15:11:04.421489+0000","last_fullsized":"2024-03-09T15:11:04.421489+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:56:00.728701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2096,"num_read_kb":2016,"num_write":417,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'227","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.966926+0000","last_change":"2024-03-09T14:26:26.644936+0000","last_active":"2024-03-09T15:11:45.966926+0000","last_peered":"2024-03-09T15:11:45.966926+0000","last_clean":"2024-03-09T15:11:45.966926+0000","last_became_active":"2024-03-09T14:26:26.644563+0000","last_became_peered":"2024-03-09T14:26:26.644563+0000","last_unstale":"2024-03-09T15:11:45.966926+0000","last_undegraded":"2024-03-09T15:11:45.966926+0000","last_fullsized":"2024-03-09T15:11:45.966926+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:22:28.065455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":463,"num_read_kb":29388,"num_write":1134,"num_write_kb":42312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.696319+0000","last_change":"2024-03-09T14:26:30.651988+0000","last_active":"2024-03-09T15:10:56.696319+0000","last_peered":"2024-03-09T15:10:56.696319+0000","last_clean":"2024-03-09T15:10:56.696319+0000","last_became_active":"2024-03-09T14:26:30.651683+0000","last_became_peered":"2024-03-09T14:26:30.651683+0000","last_unstale":"2024-03-09T15:10:56.696319+0000","last_undegraded":"2024-03-09T15:10:56.696319+0000","last_fullsized":"2024-03-09T15:10:56.696319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'81","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.191420+0000","last_change":"2024-03-09T14:26:32.657274+0000","last_active":"2024-03-09T15:10:42.191420+0000","last_peered":"2024-03-09T15:10:42.191420+0000","last_clean":"2024-03-09T15:10:42.191420+0000","last_became_active":"2024-03-09T14:26:32.656995+0000","last_became_peered":"2024-03-09T14:26:32.656995+0000","last_unstale":"2024-03-09T15:10:42.191420+0000","last_undegraded":"2024-03-09T15:10:42.191420+0000","last_fullsized":"2024-03-09T15:10:42.191420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":86,"num_read_kb":83,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.607475+0000","last_change":"2024-03-09T14:26:34.666672+0000","last_active":"2024-03-09T15:10:06.607475+0000","last_peered":"2024-03-09T15:10:06.607475+0000","last_clean":"2024-03-09T15:10:06.607475+0000","last_became_active":"2024-03-09T14:26:34.666326+0000","last_became_peered":"2024-03-09T14:26:34.666326+0000","last_unstale":"2024-03-09T15:10:06.607475+0000","last_undegraded":"2024-03-09T15:10:06.607475+0000","last_fullsized":"2024-03-09T15:10:06.607475+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'111","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:25.702130+0000","last_change":"2024-03-09T14:26:36.671366+0000","last_active":"2024-03-09T15:10:25.702130+0000","last_peered":"2024-03-09T15:10:25.702130+0000","last_clean":"2024-03-09T15:10:25.702130+0000","last_became_active":"2024-03-09T14:26:36.671071+0000","last_became_peered":"2024-03-09T14:26:36.671071+0000","last_unstale":"2024-03-09T15:10:25.702130+0000","last_undegraded":"2024-03-09T15:10:25.702130+0000","last_fullsized":"2024-03-09T15:10:25.702130+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:35.587717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":104,"num_write":246,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'951","reported_seq":2539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.046845+0000","last_change":"2024-03-09T14:26:28.649069+0000","last_active":"2024-03-09T15:10:51.046845+0000","last_peered":"2024-03-09T15:10:51.046845+0000","last_clean":"2024-03-09T15:10:51.046845+0000","last_became_active":"2024-03-09T14:26:28.648586+0000","last_became_peered":"2024-03-09T14:26:28.648586+0000","last_unstale":"2024-03-09T15:10:51.046845+0000","last_undegraded":"2024-03-09T15:10:51.046845+0000","last_fullsized":"2024-03-09T15:10:51.046845+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:43:05.587726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4258,"num_read_kb":3730,"num_write":1359,"num_write_kb":540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'185","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.866774+0000","last_change":"2024-03-09T14:26:26.653314+0000","last_active":"2024-03-09T15:11:45.866774+0000","last_peered":"2024-03-09T15:11:45.866774+0000","last_clean":"2024-03-09T15:11:45.866774+0000","last_became_active":"2024-03-09T14:26:26.652803+0000","last_became_peered":"2024-03-09T14:26:26.652803+0000","last_unstale":"2024-03-09T15:11:45.866774+0000","last_undegraded":"2024-03-09T15:11:45.866774+0000","last_fullsized":"2024-03-09T15:11:45.866774+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:35:03.501326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":6854,"num_write":972,"num_write_kb":33721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:01.690054+0000","last_change":"2024-03-09T14:26:30.652950+0000","last_active":"2024-03-09T15:10:01.690054+0000","last_peered":"2024-03-09T15:10:01.690054+0000","last_clean":"2024-03-09T15:10:01.690054+0000","last_became_active":"2024-03-09T14:26:30.652699+0000","last_became_peered":"2024-03-09T14:26:30.652699+0000","last_unstale":"2024-03-09T15:10:01.690054+0000","last_undegraded":"2024-03-09T15:10:01.690054+0000","last_fullsized":"2024-03-09T15:10:01.690054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'98","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:22.138446+0000","last_change":"2024-03-09T14:26:32.658656+0000","last_active":"2024-03-09T15:10:22.138446+0000","last_peered":"2024-03-09T15:10:22.138446+0000","last_clean":"2024-03-09T15:10:22.138446+0000","last_became_active":"2024-03-09T14:26:32.658348+0000","last_became_peered":"2024-03-09T14:26:32.658348+0000","last_unstale":"2024-03-09T15:10:22.138446+0000","last_undegraded":"2024-03-09T15:10:22.138446+0000","last_fullsized":"2024-03-09T15:10:22.138446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:46.676833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'532","reported_seq":1966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.621375+0000","last_change":"2024-03-09T14:26:34.674301+0000","last_active":"2024-03-09T15:11:45.621375+0000","last_peered":"2024-03-09T15:11:45.621375+0000","last_clean":"2024-03-09T15:11:45.621375+0000","last_became_active":"2024-03-09T14:26:34.673916+0000","last_became_peered":"2024-03-09T14:26:34.673916+0000","last_unstale":"2024-03-09T15:11:45.621375+0000","last_undegraded":"2024-03-09T15:11:45.621375+0000","last_fullsized":"2024-03-09T15:11:45.621375+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:25:43.485522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'204","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.494474+0000","last_change":"2024-03-09T14:26:36.786508+0000","last_active":"2024-03-09T15:11:36.494474+0000","last_peered":"2024-03-09T15:11:36.494474+0000","last_clean":"2024-03-09T15:11:36.494474+0000","last_became_active":"2024-03-09T14:26:36.786202+0000","last_became_peered":"2024-03-09T14:26:36.786202+0000","last_unstale":"2024-03-09T15:11:36.494474+0000","last_undegraded":"2024-03-09T15:11:36.494474+0000","last_fullsized":"2024-03-09T15:11:36.494474+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":555,"num_write":450,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'733","reported_seq":2332,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.076770+0000","last_change":"2024-03-09T14:26:28.658592+0000","last_active":"2024-03-09T15:10:51.076770+0000","last_peered":"2024-03-09T15:10:51.076770+0000","last_clean":"2024-03-09T15:10:51.076770+0000","last_became_active":"2024-03-09T14:26:28.657030+0000","last_became_peered":"2024-03-09T14:26:28.657030+0000","last_unstale":"2024-03-09T15:10:51.076770+0000","last_undegraded":"2024-03-09T15:10:51.076770+0000","last_fullsized":"2024-03-09T15:10:51.076770+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3495,"num_read_kb":3179,"num_write":956,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'234","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.804495+0000","last_change":"2024-03-09T14:26:26.644365+0000","last_active":"2024-03-09T15:11:45.804495+0000","last_peered":"2024-03-09T15:11:45.804495+0000","last_clean":"2024-03-09T15:11:45.804495+0000","last_became_active":"2024-03-09T14:26:26.643877+0000","last_became_peered":"2024-03-09T14:26:26.643877+0000","last_unstale":"2024-03-09T15:11:45.804495+0000","last_undegraded":"2024-03-09T15:11:45.804495+0000","last_fullsized":"2024-03-09T15:11:45.804495+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:57:15.681003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":619,"num_read_kb":42109,"num_write":1108,"num_write_kb":38892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.572348+0000","last_change":"2024-03-09T14:26:30.651051+0000","last_active":"2024-03-09T15:07:36.572348+0000","last_peered":"2024-03-09T15:07:36.572348+0000","last_clean":"2024-03-09T15:07:36.572348+0000","last_became_active":"2024-03-09T14:26:30.650741+0000","last_became_peered":"2024-03-09T14:26:30.650741+0000","last_unstale":"2024-03-09T15:07:36.572348+0000","last_undegraded":"2024-03-09T15:07:36.572348+0000","last_fullsized":"2024-03-09T15:07:36.572348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:26.277367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'145","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.704330+0000","last_change":"2024-03-09T14:26:32.869163+0000","last_active":"2024-03-09T15:11:45.704330+0000","last_peered":"2024-03-09T15:11:45.704330+0000","last_clean":"2024-03-09T15:11:45.704330+0000","last_became_active":"2024-03-09T14:26:32.868081+0000","last_became_peered":"2024-03-09T14:26:32.868081+0000","last_unstale":"2024-03-09T15:11:45.704330+0000","last_undegraded":"2024-03-09T15:11:45.704330+0000","last_fullsized":"2024-03-09T15:11:45.704330+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:50:41.428007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7737,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":240,"num_write":102,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'565","reported_seq":4026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.992124+0000","last_change":"2024-03-09T14:26:34.679581+0000","last_active":"2024-03-09T15:11:45.992124+0000","last_peered":"2024-03-09T15:11:45.992124+0000","last_clean":"2024-03-09T15:11:45.992124+0000","last_became_active":"2024-03-09T14:26:34.679280+0000","last_became_peered":"2024-03-09T14:26:34.679280+0000","last_unstale":"2024-03-09T15:11:45.992124+0000","last_undegraded":"2024-03-09T15:11:45.992124+0000","last_fullsized":"2024-03-09T15:11:45.992124+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'336","reported_seq":1680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.864421+0000","last_change":"2024-03-09T14:26:28.646029+0000","last_active":"2024-03-09T15:11:07.864421+0000","last_peered":"2024-03-09T15:11:07.864421+0000","last_clean":"2024-03-09T15:11:07.864421+0000","last_became_active":"2024-03-09T14:26:28.645600+0000","last_became_peered":"2024-03-09T14:26:28.645600+0000","last_unstale":"2024-03-09T15:11:07.864421+0000","last_undegraded":"2024-03-09T15:11:07.864421+0000","last_fullsized":"2024-03-09T15:11:07.864421+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:31.580713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1869,"num_read_kb":1759,"num_write":401,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'208","reported_seq":858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.866960+0000","last_change":"2024-03-09T14:26:26.652521+0000","last_active":"2024-03-09T15:11:45.866960+0000","last_peered":"2024-03-09T15:11:45.866960+0000","last_clean":"2024-03-09T15:11:45.866960+0000","last_became_active":"2024-03-09T14:26:26.652163+0000","last_became_peered":"2024-03-09T14:26:26.652163+0000","last_unstale":"2024-03-09T15:11:45.866960+0000","last_undegraded":"2024-03-09T15:11:45.866960+0000","last_fullsized":"2024-03-09T15:11:45.866960+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:35.690754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263243,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":85490,"num_write":1165,"num_write_kb":31492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.708678+0000","last_change":"2024-03-09T14:26:30.648514+0000","last_active":"2024-03-09T15:07:41.708678+0000","last_peered":"2024-03-09T15:07:41.708678+0000","last_clean":"2024-03-09T15:07:41.708678+0000","last_became_active":"2024-03-09T14:26:30.648227+0000","last_became_peered":"2024-03-09T14:26:30.648227+0000","last_unstale":"2024-03-09T15:07:41.708678+0000","last_undegraded":"2024-03-09T15:07:41.708678+0000","last_fullsized":"2024-03-09T15:07:41.708678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:08:30.571556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'205","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.784351+0000","last_change":"2024-03-09T14:26:32.868345+0000","last_active":"2024-03-09T15:11:45.784351+0000","last_peered":"2024-03-09T15:11:45.784351+0000","last_clean":"2024-03-09T15:11:45.784351+0000","last_became_active":"2024-03-09T14:26:32.868020+0000","last_became_peered":"2024-03-09T14:26:32.868020+0000","last_unstale":"2024-03-09T15:11:45.784351+0000","last_undegraded":"2024-03-09T15:11:45.784351+0000","last_fullsized":"2024-03-09T15:11:45.784351+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:16:05.222921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":278,"num_read_kb":313,"num_write":162,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.574392+0000","last_change":"2024-03-09T14:26:34.666827+0000","last_active":"2024-03-09T15:09:21.574392+0000","last_peered":"2024-03-09T15:09:21.574392+0000","last_clean":"2024-03-09T15:09:21.574392+0000","last_became_active":"2024-03-09T14:26:34.666539+0000","last_became_peered":"2024-03-09T14:26:34.666539+0000","last_unstale":"2024-03-09T15:09:21.574392+0000","last_undegraded":"2024-03-09T15:09:21.574392+0000","last_fullsized":"2024-03-09T15:09:21.574392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:45:05.086023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'537","reported_seq":1343,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.686743+0000","last_change":"2024-03-09T14:26:36.672487+0000","last_active":"2024-03-09T15:11:38.686743+0000","last_peered":"2024-03-09T15:11:38.686743+0000","last_clean":"2024-03-09T15:11:38.686743+0000","last_became_active":"2024-03-09T14:26:36.672173+0000","last_became_peered":"2024-03-09T14:26:36.672173+0000","last_unstale":"2024-03-09T15:11:38.686743+0000","last_undegraded":"2024-03-09T15:11:38.686743+0000","last_fullsized":"2024-03-09T15:11:38.686743+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:51:07.339596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1288,"num_read_kb":1278,"num_write":1107,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'868","reported_seq":2462,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.125354+0000","last_change":"2024-03-09T14:26:28.656027+0000","last_active":"2024-03-09T15:11:01.125354+0000","last_peered":"2024-03-09T15:11:01.125354+0000","last_clean":"2024-03-09T15:11:01.125354+0000","last_became_active":"2024-03-09T14:26:28.655572+0000","last_became_peered":"2024-03-09T14:26:28.655572+0000","last_unstale":"2024-03-09T15:11:01.125354+0000","last_undegraded":"2024-03-09T15:11:01.125354+0000","last_fullsized":"2024-03-09T15:11:01.125354+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4137,"num_read_kb":3672,"num_write":1196,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'214","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.874280+0000","last_change":"2024-03-09T14:26:26.654328+0000","last_active":"2024-03-09T15:11:45.874280+0000","last_peered":"2024-03-09T15:11:45.874280+0000","last_clean":"2024-03-09T15:11:45.874280+0000","last_became_active":"2024-03-09T14:26:26.653969+0000","last_became_peered":"2024-03-09T14:26:26.653969+0000","last_unstale":"2024-03-09T15:11:45.874280+0000","last_undegraded":"2024-03-09T15:11:45.874280+0000","last_fullsized":"2024-03-09T15:11:45.874280+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:24:44.283252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":36496,"num_write":1173,"num_write_kb":46772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.558546+0000","last_change":"2024-03-09T14:26:30.647064+0000","last_active":"2024-03-09T15:07:41.558546+0000","last_peered":"2024-03-09T15:07:41.558546+0000","last_clean":"2024-03-09T15:07:41.558546+0000","last_became_active":"2024-03-09T14:26:30.646765+0000","last_became_peered":"2024-03-09T14:26:30.646765+0000","last_unstale":"2024-03-09T15:07:41.558546+0000","last_undegraded":"2024-03-09T15:07:41.558546+0000","last_fullsized":"2024-03-09T15:07:41.558546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:19.489495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'122","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.913835+0000","last_change":"2024-03-09T14:26:32.655422+0000","last_active":"2024-03-09T15:11:45.913835+0000","last_peered":"2024-03-09T15:11:45.913835+0000","last_clean":"2024-03-09T15:11:45.913835+0000","last_became_active":"2024-03-09T14:26:32.655037+0000","last_became_peered":"2024-03-09T14:26:32.655037+0000","last_unstale":"2024-03-09T15:11:45.913835+0000","last_undegraded":"2024-03-09T15:11:45.913835+0000","last_fullsized":"2024-03-09T15:11:45.913835+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":177,"num_write":74,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:01.689955+0000","last_change":"2024-03-09T14:26:34.678829+0000","last_active":"2024-03-09T15:10:01.689955+0000","last_peered":"2024-03-09T15:10:01.689955+0000","last_clean":"2024-03-09T15:10:01.689955+0000","last_became_active":"2024-03-09T14:26:34.678525+0000","last_became_peered":"2024-03-09T14:26:34.678525+0000","last_unstale":"2024-03-09T15:10:01.689955+0000","last_undegraded":"2024-03-09T15:10:01.689955+0000","last_fullsized":"2024-03-09T15:10:01.689955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2463","reported_seq":4879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.372073+0000","last_change":"2024-03-09T14:26:36.671509+0000","last_active":"2024-03-09T15:11:37.372073+0000","last_peered":"2024-03-09T15:11:37.372073+0000","last_clean":"2024-03-09T15:11:37.372073+0000","last_became_active":"2024-03-09T14:26:36.671204+0000","last_became_peered":"2024-03-09T14:26:36.671204+0000","last_unstale":"2024-03-09T15:11:37.372073+0000","last_undegraded":"2024-03-09T15:11:37.372073+0000","last_fullsized":"2024-03-09T15:11:37.372073+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":2400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:54:22.325503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6722,"num_read_kb":6726,"num_write":4987,"num_write_kb":1828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'374","reported_seq":1941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.098113+0000","last_change":"2024-03-09T14:26:28.648968+0000","last_active":"2024-03-09T15:11:01.098113+0000","last_peered":"2024-03-09T15:11:01.098113+0000","last_clean":"2024-03-09T15:11:01.098113+0000","last_became_active":"2024-03-09T14:26:28.648620+0000","last_became_peered":"2024-03-09T14:26:28.648620+0000","last_unstale":"2024-03-09T15:11:01.098113+0000","last_undegraded":"2024-03-09T15:11:01.098113+0000","last_fullsized":"2024-03-09T15:11:01.098113+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:45:55.545173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2195,"num_write":437,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'221","reported_seq":1111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.946366+0000","last_change":"2024-03-09T14:26:26.653520+0000","last_active":"2024-03-09T15:11:45.946366+0000","last_peered":"2024-03-09T15:11:45.946366+0000","last_clean":"2024-03-09T15:11:45.946366+0000","last_became_active":"2024-03-09T14:26:26.653181+0000","last_became_peered":"2024-03-09T14:26:26.653181+0000","last_unstale":"2024-03-09T15:11:45.946366+0000","last_undegraded":"2024-03-09T15:11:45.946366+0000","last_fullsized":"2024-03-09T15:11:45.946366+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:52.372652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194373,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1046,"num_read_kb":176280,"num_write":1134,"num_write_kb":52674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.569270+0000","last_change":"2024-03-09T14:26:30.646000+0000","last_active":"2024-03-09T15:09:16.569270+0000","last_peered":"2024-03-09T15:09:16.569270+0000","last_clean":"2024-03-09T15:09:16.569270+0000","last_became_active":"2024-03-09T14:26:30.645656+0000","last_became_peered":"2024-03-09T14:26:30.645656+0000","last_unstale":"2024-03-09T15:09:16.569270+0000","last_undegraded":"2024-03-09T15:09:16.569270+0000","last_fullsized":"2024-03-09T15:09:16.569270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:24:40.309796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'172","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.811795+0000","last_change":"2024-03-09T14:26:32.657586+0000","last_active":"2024-03-09T15:11:45.811795+0000","last_peered":"2024-03-09T15:11:45.811795+0000","last_clean":"2024-03-09T15:11:45.811795+0000","last_became_active":"2024-03-09T14:26:32.657144+0000","last_became_peered":"2024-03-09T14:26:32.657144+0000","last_unstale":"2024-03-09T15:11:45.811795+0000","last_undegraded":"2024-03-09T15:11:45.811795+0000","last_fullsized":"2024-03-09T15:11:45.811795+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:12:23.509222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6043,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":209,"num_read_kb":276,"num_write":118,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'544","reported_seq":1938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.627357+0000","last_change":"2024-03-09T14:26:34.668104+0000","last_active":"2024-03-09T15:11:45.627357+0000","last_peered":"2024-03-09T15:11:45.627357+0000","last_clean":"2024-03-09T15:11:45.627357+0000","last_became_active":"2024-03-09T14:26:34.667795+0000","last_became_peered":"2024-03-09T14:26:34.667795+0000","last_unstale":"2024-03-09T15:11:45.627357+0000","last_undegraded":"2024-03-09T15:11:45.627357+0000","last_fullsized":"2024-03-09T15:11:45.627357+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:54.046352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'109","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:19.855122+0000","last_change":"2024-03-09T14:26:36.671949+0000","last_active":"2024-03-09T15:10:19.855122+0000","last_peered":"2024-03-09T15:10:19.855122+0000","last_clean":"2024-03-09T15:10:19.855122+0000","last_became_active":"2024-03-09T14:26:36.671635+0000","last_became_peered":"2024-03-09T14:26:36.671635+0000","last_unstale":"2024-03-09T15:10:19.855122+0000","last_undegraded":"2024-03-09T15:10:19.855122+0000","last_fullsized":"2024-03-09T15:10:19.855122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:02:06.007889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":89,"num_write":251,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'431","reported_seq":1949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.186291+0000","last_change":"2024-03-09T14:26:28.645748+0000","last_active":"2024-03-09T15:10:42.186291+0000","last_peered":"2024-03-09T15:10:42.186291+0000","last_clean":"2024-03-09T15:10:42.186291+0000","last_became_active":"2024-03-09T14:26:28.645215+0000","last_became_peered":"2024-03-09T14:26:28.645215+0000","last_unstale":"2024-03-09T15:10:42.186291+0000","last_undegraded":"2024-03-09T15:10:42.186291+0000","last_fullsized":"2024-03-09T15:10:42.186291+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:02:01.979402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2276,"num_read_kb":2131,"num_write":518,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'218","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.935808+0000","last_change":"2024-03-09T14:26:26.640453+0000","last_active":"2024-03-09T15:11:45.935808+0000","last_peered":"2024-03-09T15:11:45.935808+0000","last_clean":"2024-03-09T15:11:45.935808+0000","last_became_active":"2024-03-09T14:26:26.639784+0000","last_became_peered":"2024-03-09T14:26:26.639784+0000","last_unstale":"2024-03-09T15:11:45.935808+0000","last_undegraded":"2024-03-09T15:11:45.935808+0000","last_fullsized":"2024-03-09T15:11:45.935808+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:31.481843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048623,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":725,"num_read_kb":41897,"num_write":1164,"num_write_kb":44648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.559614+0000","last_change":"2024-03-09T14:26:30.653007+0000","last_active":"2024-03-09T15:07:51.559614+0000","last_peered":"2024-03-09T15:07:51.559614+0000","last_clean":"2024-03-09T15:07:51.559614+0000","last_became_active":"2024-03-09T14:26:30.652726+0000","last_became_peered":"2024-03-09T14:26:30.652726+0000","last_unstale":"2024-03-09T15:07:51.559614+0000","last_undegraded":"2024-03-09T15:07:51.559614+0000","last_fullsized":"2024-03-09T15:07:51.559614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:39.318802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'182","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.929524+0000","last_change":"2024-03-09T14:26:32.653345+0000","last_active":"2024-03-09T15:11:45.929524+0000","last_peered":"2024-03-09T15:11:45.929524+0000","last_clean":"2024-03-09T15:11:45.929524+0000","last_became_active":"2024-03-09T14:26:32.653026+0000","last_became_peered":"2024-03-09T14:26:32.653026+0000","last_unstale":"2024-03-09T15:11:45.929524+0000","last_undegraded":"2024-03-09T15:11:45.929524+0000","last_fullsized":"2024-03-09T15:11:45.929524+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:27:09.685607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8197,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":250,"num_read_kb":316,"num_write":112,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.559028+0000","last_change":"2024-03-09T14:26:34.673997+0000","last_active":"2024-03-09T15:07:46.559028+0000","last_peered":"2024-03-09T15:07:46.559028+0000","last_clean":"2024-03-09T15:07:46.559028+0000","last_became_active":"2024-03-09T14:26:34.673715+0000","last_became_peered":"2024-03-09T14:26:34.673715+0000","last_unstale":"2024-03-09T15:07:46.559028+0000","last_undegraded":"2024-03-09T15:07:46.559028+0000","last_fullsized":"2024-03-09T15:07:46.559028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:42:47.462483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'121","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:49.854347+0000","last_change":"2024-03-09T14:26:36.673170+0000","last_active":"2024-03-09T15:10:49.854347+0000","last_peered":"2024-03-09T15:10:49.854347+0000","last_clean":"2024-03-09T15:10:49.854347+0000","last_became_active":"2024-03-09T14:26:36.672843+0000","last_became_peered":"2024-03-09T14:26:36.672843+0000","last_unstale":"2024-03-09T15:10:49.854347+0000","last_undegraded":"2024-03-09T15:10:49.854347+0000","last_fullsized":"2024-03-09T15:10:49.854347+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:17:11.123320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":286,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'745","reported_seq":2334,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.493735+0000","last_change":"2024-03-09T14:26:28.657382+0000","last_active":"2024-03-09T15:11:31.493735+0000","last_peered":"2024-03-09T15:11:31.493735+0000","last_clean":"2024-03-09T15:11:31.493735+0000","last_became_active":"2024-03-09T14:26:28.656983+0000","last_became_peered":"2024-03-09T14:26:28.656983+0000","last_unstale":"2024-03-09T15:11:31.493735+0000","last_undegraded":"2024-03-09T15:11:31.493735+0000","last_fullsized":"2024-03-09T15:11:31.493735+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3462,"num_read_kb":3140,"num_write":976,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'178","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.875466+0000","last_change":"2024-03-09T14:27:03.724793+0000","last_active":"2024-03-09T15:11:45.875466+0000","last_peered":"2024-03-09T15:11:45.875466+0000","last_clean":"2024-03-09T15:11:45.875466+0000","last_became_active":"2024-03-09T14:27:03.724370+0000","last_became_peered":"2024-03-09T14:27:03.724370+0000","last_unstale":"2024-03-09T15:11:45.875466+0000","last_undegraded":"2024-03-09T15:11:45.875466+0000","last_fullsized":"2024-03-09T15:11:45.875466+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:39:53.570919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":389,"num_read_kb":32223,"num_write":1032,"num_write_kb":26912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.569303+0000","last_change":"2024-03-09T14:26:30.653536+0000","last_active":"2024-03-09T15:09:16.569303+0000","last_peered":"2024-03-09T15:09:16.569303+0000","last_clean":"2024-03-09T15:09:16.569303+0000","last_became_active":"2024-03-09T14:26:30.653184+0000","last_became_peered":"2024-03-09T14:26:30.653184+0000","last_unstale":"2024-03-09T15:09:16.569303+0000","last_undegraded":"2024-03-09T15:09:16.569303+0000","last_fullsized":"2024-03-09T15:09:16.569303+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:52:00.683557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'158","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.948777+0000","last_change":"2024-03-09T14:26:32.653203+0000","last_active":"2024-03-09T15:11:45.948777+0000","last_peered":"2024-03-09T15:11:45.948777+0000","last_clean":"2024-03-09T15:11:45.948777+0000","last_became_active":"2024-03-09T14:26:32.652956+0000","last_became_peered":"2024-03-09T14:26:32.652956+0000","last_unstale":"2024-03-09T15:11:45.948777+0000","last_undegraded":"2024-03-09T15:11:45.948777+0000","last_fullsized":"2024-03-09T15:11:45.948777+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7924,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":318,"num_write":180,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:31.583361+0000","last_change":"2024-03-09T14:26:34.675619+0000","last_active":"2024-03-09T15:09:31.583361+0000","last_peered":"2024-03-09T15:09:31.583361+0000","last_clean":"2024-03-09T15:09:31.583361+0000","last_became_active":"2024-03-09T14:26:34.675354+0000","last_became_peered":"2024-03-09T14:26:34.675354+0000","last_unstale":"2024-03-09T15:09:31.583361+0000","last_undegraded":"2024-03-09T15:09:31.583361+0000","last_fullsized":"2024-03-09T15:09:31.583361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:12:54.378319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'144","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.192347+0000","last_change":"2024-03-09T14:26:36.672548+0000","last_active":"2024-03-09T15:11:09.192347+0000","last_peered":"2024-03-09T15:11:09.192347+0000","last_clean":"2024-03-09T15:11:09.192347+0000","last_became_active":"2024-03-09T14:26:36.672111+0000","last_became_peered":"2024-03-09T14:26:36.672111+0000","last_unstale":"2024-03-09T15:11:09.192347+0000","last_undegraded":"2024-03-09T15:11:09.192347+0000","last_fullsized":"2024-03-09T15:11:09.192347+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":110,"num_write":237,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'510","reported_seq":1981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.493777+0000","last_change":"2024-03-09T14:26:28.651133+0000","last_active":"2024-03-09T15:11:31.493777+0000","last_peered":"2024-03-09T15:11:31.493777+0000","last_clean":"2024-03-09T15:11:31.493777+0000","last_became_active":"2024-03-09T14:26:28.650560+0000","last_became_peered":"2024-03-09T14:26:28.650560+0000","last_unstale":"2024-03-09T15:11:31.493777+0000","last_undegraded":"2024-03-09T15:11:31.493777+0000","last_fullsized":"2024-03-09T15:11:31.493777+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2567,"num_read_kb":2395,"num_write":702,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'170","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:25.567594+0000","last_change":"2024-03-09T14:26:26.644672+0000","last_active":"2024-03-09T15:10:25.567594+0000","last_peered":"2024-03-09T15:10:25.567594+0000","last_clean":"2024-03-09T15:10:25.567594+0000","last_became_active":"2024-03-09T14:26:26.644347+0000","last_became_peered":"2024-03-09T14:26:26.644347+0000","last_unstale":"2024-03-09T15:10:25.567594+0000","last_undegraded":"2024-03-09T15:10:25.567594+0000","last_fullsized":"2024-03-09T15:10:25.567594+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:38.187729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456529,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":342,"num_read_kb":3953,"num_write":941,"num_write_kb":27527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:16.573925+0000","last_change":"2024-03-09T14:26:30.654838+0000","last_active":"2024-03-09T15:09:16.573925+0000","last_peered":"2024-03-09T15:09:16.573925+0000","last_clean":"2024-03-09T15:09:16.573925+0000","last_became_active":"2024-03-09T14:26:30.654575+0000","last_became_peered":"2024-03-09T14:26:30.654575+0000","last_unstale":"2024-03-09T15:09:16.573925+0000","last_undegraded":"2024-03-09T15:09:16.573925+0000","last_fullsized":"2024-03-09T15:09:16.573925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:39.725009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'145","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.889850+0000","last_change":"2024-03-09T14:26:32.660279+0000","last_active":"2024-03-09T15:11:45.889850+0000","last_peered":"2024-03-09T15:11:45.889850+0000","last_clean":"2024-03-09T15:11:45.889850+0000","last_became_active":"2024-03-09T14:26:32.659984+0000","last_became_peered":"2024-03-09T14:26:32.659984+0000","last_unstale":"2024-03-09T15:11:45.889850+0000","last_undegraded":"2024-03-09T15:11:45.889850+0000","last_fullsized":"2024-03-09T15:11:45.889850+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:08.563248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12965,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":276,"num_write":112,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'506","reported_seq":2223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.622749+0000","last_change":"2024-03-09T14:26:34.673343+0000","last_active":"2024-03-09T15:11:45.622749+0000","last_peered":"2024-03-09T15:11:45.622749+0000","last_clean":"2024-03-09T15:11:45.622749+0000","last_became_active":"2024-03-09T14:26:34.673054+0000","last_became_peered":"2024-03-09T14:26:34.673054+0000","last_unstale":"2024-03-09T15:11:45.622749+0000","last_undegraded":"2024-03-09T15:11:45.622749+0000","last_fullsized":"2024-03-09T15:11:45.622749+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:53.004843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'97","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.765724+0000","last_change":"2024-03-09T14:26:36.668508+0000","last_active":"2024-03-09T15:10:35.765724+0000","last_peered":"2024-03-09T15:10:35.765724+0000","last_clean":"2024-03-09T15:10:35.765724+0000","last_became_active":"2024-03-09T14:26:36.668217+0000","last_became_peered":"2024-03-09T14:26:36.668217+0000","last_unstale":"2024-03-09T15:10:35.765724+0000","last_undegraded":"2024-03-09T15:10:35.765724+0000","last_fullsized":"2024-03-09T15:10:35.765724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:12:50.274345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":82,"num_write":217,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'678","reported_seq":2378,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.493797+0000","last_change":"2024-03-09T14:26:28.648677+0000","last_active":"2024-03-09T15:11:31.493797+0000","last_peered":"2024-03-09T15:11:31.493797+0000","last_clean":"2024-03-09T15:11:31.493797+0000","last_became_active":"2024-03-09T14:26:28.648408+0000","last_became_peered":"2024-03-09T14:26:28.648408+0000","last_unstale":"2024-03-09T15:11:31.493797+0000","last_undegraded":"2024-03-09T15:11:31.493797+0000","last_fullsized":"2024-03-09T15:11:31.493797+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3385,"num_read_kb":3042,"num_write":948,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'222","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.935601+0000","last_change":"2024-03-09T14:26:26.643846+0000","last_active":"2024-03-09T15:11:45.935601+0000","last_peered":"2024-03-09T15:11:45.935601+0000","last_clean":"2024-03-09T15:11:45.935601+0000","last_became_active":"2024-03-09T14:26:26.643522+0000","last_became_peered":"2024-03-09T14:26:26.643522+0000","last_unstale":"2024-03-09T15:11:45.935601+0000","last_undegraded":"2024-03-09T15:11:45.935601+0000","last_fullsized":"2024-03-09T15:11:45.935601+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718714,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":452,"num_read_kb":51521,"num_write":1235,"num_write_kb":50999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.197954+0000","last_change":"2024-03-09T14:26:30.652855+0000","last_active":"2024-03-09T15:11:45.197954+0000","last_peered":"2024-03-09T15:11:45.197954+0000","last_clean":"2024-03-09T15:11:45.197954+0000","last_became_active":"2024-03-09T14:26:30.652594+0000","last_became_peered":"2024-03-09T14:26:30.652594+0000","last_unstale":"2024-03-09T15:11:45.197954+0000","last_undegraded":"2024-03-09T15:11:45.197954+0000","last_fullsized":"2024-03-09T15:11:45.197954+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:25.009722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":630,"num_read_kb":630,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'78","reported_seq":589,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.490757+0000","last_change":"2024-03-09T14:26:32.868538+0000","last_active":"2024-03-09T15:11:36.490757+0000","last_peered":"2024-03-09T15:11:36.490757+0000","last_clean":"2024-03-09T15:11:36.490757+0000","last_became_active":"2024-03-09T14:26:32.868147+0000","last_became_peered":"2024-03-09T14:26:32.868147+0000","last_unstale":"2024-03-09T15:11:36.490757+0000","last_undegraded":"2024-03-09T15:11:36.490757+0000","last_fullsized":"2024-03-09T15:11:36.490757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'535","reported_seq":2287,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.623797+0000","last_change":"2024-03-09T14:26:34.670121+0000","last_active":"2024-03-09T15:11:45.623797+0000","last_peered":"2024-03-09T15:11:45.623797+0000","last_clean":"2024-03-09T15:11:45.623797+0000","last_became_active":"2024-03-09T14:26:34.669695+0000","last_became_peered":"2024-03-09T14:26:34.669695+0000","last_unstale":"2024-03-09T15:11:45.623797+0000","last_undegraded":"2024-03-09T15:11:45.623797+0000","last_fullsized":"2024-03-09T15:11:45.623797+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:34:05.625218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'142","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:21.609598+0000","last_change":"2024-03-09T14:26:36.668658+0000","last_active":"2024-03-09T15:10:21.609598+0000","last_peered":"2024-03-09T15:10:21.609598+0000","last_clean":"2024-03-09T15:10:21.609598+0000","last_became_active":"2024-03-09T14:26:36.668361+0000","last_became_peered":"2024-03-09T14:26:36.668361+0000","last_unstale":"2024-03-09T15:10:21.609598+0000","last_undegraded":"2024-03-09T15:10:21.609598+0000","last_fullsized":"2024-03-09T15:10:21.609598+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":387,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":346,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'485","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.448831+0000","last_change":"2024-03-09T14:26:28.654782+0000","last_active":"2024-03-09T15:11:04.448831+0000","last_peered":"2024-03-09T15:11:04.448831+0000","last_clean":"2024-03-09T15:11:04.448831+0000","last_became_active":"2024-03-09T14:26:28.654325+0000","last_became_peered":"2024-03-09T14:26:28.654325+0000","last_unstale":"2024-03-09T15:11:04.448831+0000","last_undegraded":"2024-03-09T15:11:04.448831+0000","last_fullsized":"2024-03-09T15:11:04.448831+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:42.930737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2761,"num_read_kb":2604,"num_write":649,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'188","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.894253+0000","last_change":"2024-03-09T14:26:26.652669+0000","last_active":"2024-03-09T15:11:45.894253+0000","last_peered":"2024-03-09T15:11:45.894253+0000","last_clean":"2024-03-09T15:11:45.894253+0000","last_became_active":"2024-03-09T14:26:26.652273+0000","last_became_peered":"2024-03-09T14:26:26.652273+0000","last_unstale":"2024-03-09T15:11:45.894253+0000","last_undegraded":"2024-03-09T15:11:45.894253+0000","last_fullsized":"2024-03-09T15:11:45.894253+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262266,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":15479,"num_write":998,"num_write_kb":26748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.493816+0000","last_change":"2024-03-09T14:26:30.652256+0000","last_active":"2024-03-09T15:11:31.493816+0000","last_peered":"2024-03-09T15:11:31.493816+0000","last_clean":"2024-03-09T15:11:31.493816+0000","last_became_active":"2024-03-09T14:26:30.651949+0000","last_became_peered":"2024-03-09T14:26:30.651949+0000","last_unstale":"2024-03-09T15:11:31.493816+0000","last_undegraded":"2024-03-09T15:11:31.493816+0000","last_fullsized":"2024-03-09T15:11:31.493816+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'188","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.754750+0000","last_change":"2024-03-09T14:26:32.658049+0000","last_active":"2024-03-09T15:11:45.754750+0000","last_peered":"2024-03-09T15:11:45.754750+0000","last_clean":"2024-03-09T15:11:45.754750+0000","last_became_active":"2024-03-09T14:26:32.656959+0000","last_became_peered":"2024-03-09T14:26:32.656959+0000","last_unstale":"2024-03-09T15:11:45.754750+0000","last_undegraded":"2024-03-09T15:11:45.754750+0000","last_fullsized":"2024-03-09T15:11:45.754750+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:00:25.716853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9621,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":264,"num_read_kb":329,"num_write":152,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:21.600784+0000","last_change":"2024-03-09T14:26:34.675814+0000","last_active":"2024-03-09T15:09:21.600784+0000","last_peered":"2024-03-09T15:09:21.600784+0000","last_clean":"2024-03-09T15:09:21.600784+0000","last_became_active":"2024-03-09T14:26:34.675350+0000","last_became_peered":"2024-03-09T14:26:34.675350+0000","last_unstale":"2024-03-09T15:09:21.600784+0000","last_undegraded":"2024-03-09T15:09:21.600784+0000","last_fullsized":"2024-03-09T15:09:21.600784+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:43.105375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'122","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:31.932959+0000","last_change":"2024-03-09T14:26:36.673342+0000","last_active":"2024-03-09T15:10:31.932959+0000","last_peered":"2024-03-09T15:10:31.932959+0000","last_clean":"2024-03-09T15:10:31.932959+0000","last_became_active":"2024-03-09T14:26:36.673059+0000","last_became_peered":"2024-03-09T14:26:36.673059+0000","last_unstale":"2024-03-09T15:10:31.932959+0000","last_undegraded":"2024-03-09T15:10:31.932959+0000","last_fullsized":"2024-03-09T15:10:31.932959+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:24:05.127996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":194,"num_write":274,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'855","reported_seq":2474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.169290+0000","last_change":"2024-03-09T14:26:28.653445+0000","last_active":"2024-03-09T15:11:09.169290+0000","last_peered":"2024-03-09T15:11:09.169290+0000","last_clean":"2024-03-09T15:11:09.169290+0000","last_became_active":"2024-03-09T14:26:28.653261+0000","last_became_peered":"2024-03-09T14:26:28.653261+0000","last_unstale":"2024-03-09T15:11:09.169290+0000","last_undegraded":"2024-03-09T15:11:09.169290+0000","last_fullsized":"2024-03-09T15:11:09.169290+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:52:30.405371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3846,"num_read_kb":3440,"num_write":1147,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.713861+0000","last_change":"2024-03-09T14:26:13.798768+0000","last_active":"2024-03-09T15:08:21.713861+0000","last_peered":"2024-03-09T15:08:21.713861+0000","last_clean":"2024-03-09T15:08:21.713861+0000","last_became_active":"2024-03-09T14:26:13.797817+0000","last_became_peered":"2024-03-09T14:26:13.797817+0000","last_unstale":"2024-03-09T15:08:21.713861+0000","last_undegraded":"2024-03-09T15:08:21.713861+0000","last_fullsized":"2024-03-09T15:08:21.713861+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_clean_scrub_stamp":"2024-03-09T14:26:12.541311+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:56:57.729803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.575317+0000","last_change":"2024-03-09T14:26:18.581955+0000","last_active":"2024-03-09T15:08:01.575317+0000","last_peered":"2024-03-09T15:08:01.575317+0000","last_clean":"2024-03-09T15:08:01.575317+0000","last_became_active":"2024-03-09T14:26:18.581598+0000","last_became_peered":"2024-03-09T14:26:18.581598+0000","last_unstale":"2024-03-09T15:08:01.575317+0000","last_undegraded":"2024-03-09T15:08:01.575317+0000","last_fullsized":"2024-03-09T15:08:01.575317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:38:36.176997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'183","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.966795+0000","last_change":"2024-03-09T14:26:26.645174+0000","last_active":"2024-03-09T15:11:45.966795+0000","last_peered":"2024-03-09T15:11:45.966795+0000","last_clean":"2024-03-09T15:11:45.966795+0000","last_became_active":"2024-03-09T14:26:26.644848+0000","last_became_peered":"2024-03-09T14:26:26.644848+0000","last_unstale":"2024-03-09T15:11:45.966795+0000","last_undegraded":"2024-03-09T15:11:45.966795+0000","last_fullsized":"2024-03-09T15:11:45.966795+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992272,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":345,"num_read_kb":37512,"num_write":1008,"num_write_kb":40555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.712568+0000","last_change":"2024-03-09T14:26:30.650647+0000","last_active":"2024-03-09T15:08:11.712568+0000","last_peered":"2024-03-09T15:08:11.712568+0000","last_clean":"2024-03-09T15:08:11.712568+0000","last_became_active":"2024-03-09T14:26:30.650376+0000","last_became_peered":"2024-03-09T14:26:30.650376+0000","last_unstale":"2024-03-09T15:08:11.712568+0000","last_undegraded":"2024-03-09T15:08:11.712568+0000","last_fullsized":"2024-03-09T15:08:11.712568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:35.280770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'302","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.869125+0000","last_change":"2024-03-09T14:26:32.658070+0000","last_active":"2024-03-09T15:11:45.869125+0000","last_peered":"2024-03-09T15:11:45.869125+0000","last_clean":"2024-03-09T15:11:45.869125+0000","last_became_active":"2024-03-09T14:26:32.657752+0000","last_became_peered":"2024-03-09T14:26:32.657752+0000","last_unstale":"2024-03-09T15:11:45.869125+0000","last_undegraded":"2024-03-09T15:11:45.869125+0000","last_fullsized":"2024-03-09T15:11:45.869125+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:31.136392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33862,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":557,"num_read_kb":770,"num_write":482,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.571341+0000","last_change":"2024-03-09T14:26:34.671261+0000","last_active":"2024-03-09T15:07:46.571341+0000","last_peered":"2024-03-09T15:07:46.571341+0000","last_clean":"2024-03-09T15:07:46.571341+0000","last_became_active":"2024-03-09T14:26:34.670987+0000","last_became_peered":"2024-03-09T14:26:34.670987+0000","last_unstale":"2024-03-09T15:07:46.571341+0000","last_undegraded":"2024-03-09T15:07:46.571341+0000","last_fullsized":"2024-03-09T15:07:46.571341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:48.297381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'204","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:26.958614+0000","last_change":"2024-03-09T14:26:36.672227+0000","last_active":"2024-03-09T15:10:26.958614+0000","last_peered":"2024-03-09T15:10:26.958614+0000","last_clean":"2024-03-09T15:10:26.958614+0000","last_became_active":"2024-03-09T14:26:36.671941+0000","last_became_peered":"2024-03-09T14:26:36.671941+0000","last_unstale":"2024-03-09T15:10:26.958614+0000","last_undegraded":"2024-03-09T15:10:26.958614+0000","last_fullsized":"2024-03-09T15:10:26.958614+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:49:17.903765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":432,"num_read_kb":416,"num_write":433,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'391","reported_seq":1981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:49.432074+0000","last_change":"2024-03-09T14:26:28.652892+0000","last_active":"2024-03-09T15:10:49.432074+0000","last_peered":"2024-03-09T15:10:49.432074+0000","last_clean":"2024-03-09T15:10:49.432074+0000","last_became_active":"2024-03-09T14:26:28.652611+0000","last_became_peered":"2024-03-09T14:26:28.652611+0000","last_unstale":"2024-03-09T15:10:49.432074+0000","last_undegraded":"2024-03-09T15:10:49.432074+0000","last_fullsized":"2024-03-09T15:10:49.432074+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:02:24.839775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2259,"num_read_kb":2164,"num_write":448,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:26.714524+0000","last_change":"2024-03-09T14:26:18.582346+0000","last_active":"2024-03-09T15:08:26.714524+0000","last_peered":"2024-03-09T15:08:26.714524+0000","last_clean":"2024-03-09T15:08:26.714524+0000","last_became_active":"2024-03-09T14:26:18.581306+0000","last_became_peered":"2024-03-09T14:26:18.581306+0000","last_unstale":"2024-03-09T15:08:26.714524+0000","last_undegraded":"2024-03-09T15:08:26.714524+0000","last_fullsized":"2024-03-09T15:08:26.714524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:30.980957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'137","reported_seq":736,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.838812+0000","last_change":"2024-03-09T14:26:26.632618+0000","last_active":"2024-03-09T15:11:45.838812+0000","last_peered":"2024-03-09T15:11:45.838812+0000","last_clean":"2024-03-09T15:11:45.838812+0000","last_became_active":"2024-03-09T14:26:26.632272+0000","last_became_peered":"2024-03-09T14:26:26.632272+0000","last_unstale":"2024-03-09T15:11:45.838812+0000","last_undegraded":"2024-03-09T15:11:45.838812+0000","last_fullsized":"2024-03-09T15:11:45.838812+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:03.965638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":283,"num_read_kb":61756,"num_write":788,"num_write_kb":21716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.573097+0000","last_change":"2024-03-09T14:26:30.655248+0000","last_active":"2024-03-09T15:07:41.573097+0000","last_peered":"2024-03-09T15:07:41.573097+0000","last_clean":"2024-03-09T15:07:41.573097+0000","last_became_active":"2024-03-09T14:26:30.654922+0000","last_became_peered":"2024-03-09T14:26:30.654922+0000","last_unstale":"2024-03-09T15:07:41.573097+0000","last_undegraded":"2024-03-09T15:07:41.573097+0000","last_fullsized":"2024-03-09T15:07:41.573097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:41:46.097520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'695","reported_seq":2084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.916547+0000","last_change":"2024-03-09T14:26:32.655775+0000","last_active":"2024-03-09T15:11:45.916547+0000","last_peered":"2024-03-09T15:11:45.916547+0000","last_clean":"2024-03-09T15:11:45.916547+0000","last_became_active":"2024-03-09T14:26:32.655430+0000","last_became_peered":"2024-03-09T14:26:32.655430+0000","last_unstale":"2024-03-09T15:11:45.916547+0000","last_undegraded":"2024-03-09T15:11:45.916547+0000","last_fullsized":"2024-03-09T15:11:45.916547+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":600,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:38:38.807873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17414,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":925,"num_read_kb":1078,"num_write":294,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.713974+0000","last_change":"2024-03-09T14:26:34.678707+0000","last_active":"2024-03-09T15:08:21.713974+0000","last_peered":"2024-03-09T15:08:21.713974+0000","last_clean":"2024-03-09T15:08:21.713974+0000","last_became_active":"2024-03-09T14:26:34.678431+0000","last_became_peered":"2024-03-09T14:26:34.678431+0000","last_unstale":"2024-03-09T15:08:21.713974+0000","last_undegraded":"2024-03-09T15:08:21.713974+0000","last_fullsized":"2024-03-09T15:08:21.713974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:25.952912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'162","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:19.730383+0000","last_change":"2024-03-09T14:26:36.785121+0000","last_active":"2024-03-09T15:11:19.730383+0000","last_peered":"2024-03-09T15:11:19.730383+0000","last_clean":"2024-03-09T15:11:19.730383+0000","last_became_active":"2024-03-09T14:26:36.784815+0000","last_became_peered":"2024-03-09T14:26:36.784815+0000","last_unstale":"2024-03-09T15:11:19.730383+0000","last_undegraded":"2024-03-09T15:11:19.730383+0000","last_fullsized":"2024-03-09T15:11:19.730383+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:32:28.804163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":213,"num_read_kb":212,"num_write":359,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'794","reported_seq":2457,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.129970+0000","last_change":"2024-03-09T14:26:28.650746+0000","last_active":"2024-03-09T15:11:37.129970+0000","last_peered":"2024-03-09T15:11:37.129970+0000","last_clean":"2024-03-09T15:11:37.129970+0000","last_became_active":"2024-03-09T14:26:28.650409+0000","last_became_peered":"2024-03-09T14:26:28.650409+0000","last_unstale":"2024-03-09T15:11:37.129970+0000","last_undegraded":"2024-03-09T15:11:37.129970+0000","last_fullsized":"2024-03-09T15:11:37.129970+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:56:59.410066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3830,"num_read_kb":3466,"num_write":1049,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.560159+0000","last_change":"2024-03-09T14:26:18.577541+0000","last_active":"2024-03-09T15:07:56.560159+0000","last_peered":"2024-03-09T15:07:56.560159+0000","last_clean":"2024-03-09T15:07:56.560159+0000","last_became_active":"2024-03-09T14:26:18.577041+0000","last_became_peered":"2024-03-09T14:26:18.577041+0000","last_unstale":"2024-03-09T15:07:56.560159+0000","last_undegraded":"2024-03-09T15:07:56.560159+0000","last_fullsized":"2024-03-09T15:07:56.560159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:35.300799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'176","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.817237+0000","last_change":"2024-03-09T14:26:26.636212+0000","last_active":"2024-03-09T15:11:45.817237+0000","last_peered":"2024-03-09T15:11:45.817237+0000","last_clean":"2024-03-09T15:11:45.817237+0000","last_became_active":"2024-03-09T14:26:26.635771+0000","last_became_peered":"2024-03-09T14:26:26.635771+0000","last_unstale":"2024-03-09T15:11:45.817237+0000","last_undegraded":"2024-03-09T15:11:45.817237+0000","last_fullsized":"2024-03-09T15:11:45.817237+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:05.752386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730144,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":5368,"num_write":1014,"num_write_kb":33352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"35'5","reported_seq":813,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.187687+0000","last_change":"2024-03-09T14:26:30.651034+0000","last_active":"2024-03-09T15:11:45.187687+0000","last_peered":"2024-03-09T15:11:45.187687+0000","last_clean":"2024-03-09T15:11:45.187687+0000","last_became_active":"2024-03-09T14:26:30.650766+0000","last_became_peered":"2024-03-09T14:26:30.650766+0000","last_unstale":"2024-03-09T15:11:45.187687+0000","last_undegraded":"2024-03-09T15:11:45.187687+0000","last_fullsized":"2024-03-09T15:11:45.187687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:00.425079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1149,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":787,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'246","reported_seq":1320,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.821315+0000","last_change":"2024-03-09T14:26:32.869468+0000","last_active":"2024-03-09T15:11:38.821315+0000","last_peered":"2024-03-09T15:11:38.821315+0000","last_clean":"2024-03-09T15:11:38.821315+0000","last_became_active":"2024-03-09T14:26:32.868092+0000","last_became_peered":"2024-03-09T14:26:32.868092+0000","last_unstale":"2024-03-09T15:11:38.821315+0000","last_undegraded":"2024-03-09T15:11:38.821315+0000","last_fullsized":"2024-03-09T15:11:38.821315+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:31:58.327354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":188,"num_read_kb":180,"num_write":173,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:16.574728+0000","last_change":"2024-03-09T14:26:34.666767+0000","last_active":"2024-03-09T15:08:16.574728+0000","last_peered":"2024-03-09T15:08:16.574728+0000","last_clean":"2024-03-09T15:08:16.574728+0000","last_became_active":"2024-03-09T14:26:34.666484+0000","last_became_peered":"2024-03-09T14:26:34.666484+0000","last_unstale":"2024-03-09T15:08:16.574728+0000","last_undegraded":"2024-03-09T15:08:16.574728+0000","last_fullsized":"2024-03-09T15:08:16.574728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:42:45.793755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'255","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.490702+0000","last_change":"2024-03-09T14:26:36.674946+0000","last_active":"2024-03-09T15:11:36.490702+0000","last_peered":"2024-03-09T15:11:36.490702+0000","last_clean":"2024-03-09T15:11:36.490702+0000","last_became_active":"2024-03-09T14:26:36.674637+0000","last_became_peered":"2024-03-09T14:26:36.674637+0000","last_unstale":"2024-03-09T15:11:36.490702+0000","last_undegraded":"2024-03-09T15:11:36.490702+0000","last_fullsized":"2024-03-09T15:11:36.490702+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":491,"num_write":562,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'351","reported_seq":1818,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.871971+0000","last_change":"2024-03-09T14:26:28.646960+0000","last_active":"2024-03-09T15:11:07.871971+0000","last_peered":"2024-03-09T15:11:07.871971+0000","last_clean":"2024-03-09T15:11:07.871971+0000","last_became_active":"2024-03-09T14:26:28.646594+0000","last_became_peered":"2024-03-09T14:26:28.646594+0000","last_unstale":"2024-03-09T15:11:07.871971+0000","last_undegraded":"2024-03-09T15:11:07.871971+0000","last_fullsized":"2024-03-09T15:11:07.871971+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:27:04.392681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1989,"num_read_kb":1907,"num_write":411,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.575282+0000","last_change":"2024-03-09T14:26:18.581769+0000","last_active":"2024-03-09T15:08:01.575282+0000","last_peered":"2024-03-09T15:08:01.575282+0000","last_clean":"2024-03-09T15:08:01.575282+0000","last_became_active":"2024-03-09T14:26:18.581330+0000","last_became_peered":"2024-03-09T14:26:18.581330+0000","last_unstale":"2024-03-09T15:08:01.575282+0000","last_undegraded":"2024-03-09T15:08:01.575282+0000","last_fullsized":"2024-03-09T15:08:01.575282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:58.260466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'265","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.874834+0000","last_change":"2024-03-09T14:27:03.720094+0000","last_active":"2024-03-09T15:11:45.874834+0000","last_peered":"2024-03-09T15:11:45.874834+0000","last_clean":"2024-03-09T15:11:45.874834+0000","last_became_active":"2024-03-09T14:27:03.719517+0000","last_became_peered":"2024-03-09T14:27:03.719517+0000","last_unstale":"2024-03-09T15:11:45.874834+0000","last_undegraded":"2024-03-09T15:11:45.874834+0000","last_fullsized":"2024-03-09T15:11:45.874834+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:29:42.092045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1107,"num_read_kb":25709,"num_write":1307,"num_write_kb":24224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:21.575225+0000","last_change":"2024-03-09T14:26:30.646463+0000","last_active":"2024-03-09T15:08:21.575225+0000","last_peered":"2024-03-09T15:08:21.575225+0000","last_clean":"2024-03-09T15:08:21.575225+0000","last_became_active":"2024-03-09T14:26:30.646190+0000","last_became_peered":"2024-03-09T14:26:30.646190+0000","last_unstale":"2024-03-09T15:08:21.575225+0000","last_undegraded":"2024-03-09T15:08:21.575225+0000","last_fullsized":"2024-03-09T15:08:21.575225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:39:12.950657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'108","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:56.689483+0000","last_change":"2024-03-09T14:26:32.650252+0000","last_active":"2024-03-09T15:09:56.689483+0000","last_peered":"2024-03-09T15:09:56.689483+0000","last_clean":"2024-03-09T15:09:56.689483+0000","last_became_active":"2024-03-09T14:26:32.650020+0000","last_became_peered":"2024-03-09T14:26:32.650020+0000","last_unstale":"2024-03-09T15:09:56.689483+0000","last_undegraded":"2024-03-09T15:09:56.689483+0000","last_fullsized":"2024-03-09T15:09:56.689483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":130,"num_write":96,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.588167+0000","last_change":"2024-03-09T14:26:34.667767+0000","last_active":"2024-03-09T15:07:46.588167+0000","last_peered":"2024-03-09T15:07:46.588167+0000","last_clean":"2024-03-09T15:07:46.588167+0000","last_became_active":"2024-03-09T14:26:34.667409+0000","last_became_peered":"2024-03-09T14:26:34.667409+0000","last_unstale":"2024-03-09T15:07:46.588167+0000","last_undegraded":"2024-03-09T15:07:46.588167+0000","last_fullsized":"2024-03-09T15:07:46.588167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:39:12.935329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'126","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.598323+0000","last_change":"2024-03-09T14:26:36.674661+0000","last_active":"2024-03-09T15:10:42.598323+0000","last_peered":"2024-03-09T15:10:42.598323+0000","last_clean":"2024-03-09T15:10:42.598323+0000","last_became_active":"2024-03-09T14:26:36.674343+0000","last_became_peered":"2024-03-09T14:26:36.674343+0000","last_unstale":"2024-03-09T15:10:42.598323+0000","last_undegraded":"2024-03-09T15:10:42.598323+0000","last_fullsized":"2024-03-09T15:10:42.598323+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:49.926126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":182,"num_write":308,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'425","reported_seq":2180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.316492+0000","last_change":"2024-03-09T14:26:28.656196+0000","last_active":"2024-03-09T15:10:45.316492+0000","last_peered":"2024-03-09T15:10:45.316492+0000","last_clean":"2024-03-09T15:10:45.316492+0000","last_became_active":"2024-03-09T14:26:28.655479+0000","last_became_peered":"2024-03-09T14:26:28.655479+0000","last_unstale":"2024-03-09T15:10:45.316492+0000","last_undegraded":"2024-03-09T15:10:45.316492+0000","last_fullsized":"2024-03-09T15:10:45.316492+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:41.351260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2618,"num_read_kb":2506,"num_write":497,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'279","reported_seq":1012,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.940275+0000","last_change":"2024-03-09T14:26:26.650096+0000","last_active":"2024-03-09T15:11:45.940275+0000","last_peered":"2024-03-09T15:11:45.940275+0000","last_clean":"2024-03-09T15:11:45.940275+0000","last_became_active":"2024-03-09T14:26:26.649325+0000","last_became_peered":"2024-03-09T14:26:26.649325+0000","last_unstale":"2024-03-09T15:11:45.940275+0000","last_undegraded":"2024-03-09T15:11:45.940275+0000","last_fullsized":"2024-03-09T15:11:45.940275+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:00:26.744072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778712,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":954,"num_read_kb":64626,"num_write":1397,"num_write_kb":23267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.565283+0000","last_change":"2024-03-09T14:26:18.579051+0000","last_active":"2024-03-09T15:08:01.565283+0000","last_peered":"2024-03-09T15:08:01.565283+0000","last_clean":"2024-03-09T15:08:01.565283+0000","last_became_active":"2024-03-09T14:26:18.578807+0000","last_became_peered":"2024-03-09T14:26:18.578807+0000","last_unstale":"2024-03-09T15:08:01.565283+0000","last_undegraded":"2024-03-09T15:08:01.565283+0000","last_fullsized":"2024-03-09T15:08:01.565283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:16:28.179997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.574166+0000","last_change":"2024-03-09T14:26:30.648960+0000","last_active":"2024-03-09T15:08:11.574166+0000","last_peered":"2024-03-09T15:08:11.574166+0000","last_clean":"2024-03-09T15:08:11.574166+0000","last_became_active":"2024-03-09T14:26:30.648619+0000","last_became_peered":"2024-03-09T14:26:30.648619+0000","last_unstale":"2024-03-09T15:08:11.574166+0000","last_undegraded":"2024-03-09T15:08:11.574166+0000","last_fullsized":"2024-03-09T15:08:11.574166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:18.621839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'274","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.882001+0000","last_change":"2024-03-09T14:26:32.654402+0000","last_active":"2024-03-09T15:11:45.882001+0000","last_peered":"2024-03-09T15:11:45.882001+0000","last_clean":"2024-03-09T15:11:45.882001+0000","last_became_active":"2024-03-09T14:26:32.653912+0000","last_became_peered":"2024-03-09T14:26:32.653912+0000","last_unstale":"2024-03-09T15:11:45.882001+0000","last_undegraded":"2024-03-09T15:11:45.882001+0000","last_fullsized":"2024-03-09T15:11:45.882001+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:56.284532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16298,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1016,"num_read_kb":1109,"num_write":1512,"num_write_kb":1369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:21.609550+0000","last_change":"2024-03-09T14:26:34.675583+0000","last_active":"2024-03-09T15:10:21.609550+0000","last_peered":"2024-03-09T15:10:21.609550+0000","last_clean":"2024-03-09T15:10:21.609550+0000","last_became_active":"2024-03-09T14:26:34.675234+0000","last_became_peered":"2024-03-09T14:26:34.675234+0000","last_unstale":"2024-03-09T15:10:21.609550+0000","last_undegraded":"2024-03-09T15:10:21.609550+0000","last_fullsized":"2024-03-09T15:10:21.609550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'165","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.434217+0000","last_change":"2024-03-09T14:26:36.786450+0000","last_active":"2024-03-09T15:11:04.434217+0000","last_peered":"2024-03-09T15:11:04.434217+0000","last_clean":"2024-03-09T15:11:04.434217+0000","last_became_active":"2024-03-09T14:26:36.786088+0000","last_became_peered":"2024-03-09T14:26:36.786088+0000","last_unstale":"2024-03-09T15:11:04.434217+0000","last_undegraded":"2024-03-09T15:11:04.434217+0000","last_fullsized":"2024-03-09T15:11:04.434217+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:44.688510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":687,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":146,"num_write":429,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'835","reported_seq":2538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.876837+0000","last_change":"2024-03-09T14:26:28.646272+0000","last_active":"2024-03-09T15:11:07.876837+0000","last_peered":"2024-03-09T15:11:07.876837+0000","last_clean":"2024-03-09T15:11:07.876837+0000","last_became_active":"2024-03-09T14:26:28.645944+0000","last_became_peered":"2024-03-09T14:26:28.645944+0000","last_unstale":"2024-03-09T15:11:07.876837+0000","last_undegraded":"2024-03-09T15:11:07.876837+0000","last_fullsized":"2024-03-09T15:11:07.876837+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:09.470917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4110,"num_read_kb":3687,"num_write":1137,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'200","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.702622+0000","last_change":"2024-03-09T14:26:26.640197+0000","last_active":"2024-03-09T15:11:45.702622+0000","last_peered":"2024-03-09T15:11:45.702622+0000","last_clean":"2024-03-09T15:11:45.702622+0000","last_became_active":"2024-03-09T14:26:26.639853+0000","last_became_peered":"2024-03-09T14:26:26.639853+0000","last_unstale":"2024-03-09T15:11:45.702622+0000","last_undegraded":"2024-03-09T15:11:45.702622+0000","last_fullsized":"2024-03-09T15:11:45.702622+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:01:10.961843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992354,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":10153,"num_write":1145,"num_write_kb":29784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.711777+0000","last_change":"2024-03-09T14:26:18.582360+0000","last_active":"2024-03-09T15:08:06.711777+0000","last_peered":"2024-03-09T15:08:06.711777+0000","last_clean":"2024-03-09T15:08:06.711777+0000","last_became_active":"2024-03-09T14:26:18.581750+0000","last_became_peered":"2024-03-09T14:26:18.581750+0000","last_unstale":"2024-03-09T15:08:06.711777+0000","last_undegraded":"2024-03-09T15:08:06.711777+0000","last_fullsized":"2024-03-09T15:08:06.711777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:51.952352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591427+0000","last_change":"2024-03-09T14:26:30.649458+0000","last_active":"2024-03-09T15:08:11.591427+0000","last_peered":"2024-03-09T15:08:11.591427+0000","last_clean":"2024-03-09T15:08:11.591427+0000","last_became_active":"2024-03-09T14:26:30.649176+0000","last_became_peered":"2024-03-09T14:26:30.649176+0000","last_unstale":"2024-03-09T15:08:11.591427+0000","last_undegraded":"2024-03-09T15:08:11.591427+0000","last_fullsized":"2024-03-09T15:08:11.591427+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:32:57.186116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'186","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:12.268768+0000","last_change":"2024-03-09T14:26:32.868553+0000","last_active":"2024-03-09T15:11:12.268768+0000","last_peered":"2024-03-09T15:11:12.268768+0000","last_clean":"2024-03-09T15:11:12.268768+0000","last_became_active":"2024-03-09T14:26:32.868165+0000","last_became_peered":"2024-03-09T14:26:32.868165+0000","last_unstale":"2024-03-09T15:11:12.268768+0000","last_undegraded":"2024-03-09T15:11:12.268768+0000","last_fullsized":"2024-03-09T15:11:12.268768+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:54:17.205454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":224,"num_write":210,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'558","reported_seq":2223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.620124+0000","last_change":"2024-03-09T14:26:34.673130+0000","last_active":"2024-03-09T15:11:45.620124+0000","last_peered":"2024-03-09T15:11:45.620124+0000","last_clean":"2024-03-09T15:11:45.620124+0000","last_became_active":"2024-03-09T14:26:34.672351+0000","last_became_peered":"2024-03-09T14:26:34.672351+0000","last_unstale":"2024-03-09T15:11:45.620124+0000","last_undegraded":"2024-03-09T15:11:45.620124+0000","last_fullsized":"2024-03-09T15:11:45.620124+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:47:41.314294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'119","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:46.491838+0000","last_change":"2024-03-09T14:26:36.785772+0000","last_active":"2024-03-09T15:11:46.491838+0000","last_peered":"2024-03-09T15:11:46.491838+0000","last_clean":"2024-03-09T15:11:46.491838+0000","last_became_active":"2024-03-09T14:26:36.785453+0000","last_became_peered":"2024-03-09T14:26:36.785453+0000","last_unstale":"2024-03-09T15:11:46.491838+0000","last_undegraded":"2024-03-09T15:11:46.491838+0000","last_fullsized":"2024-03-09T15:11:46.491838+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":860,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":155,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'674","reported_seq":2123,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.126053+0000","last_change":"2024-03-09T14:26:28.656712+0000","last_active":"2024-03-09T15:11:01.126053+0000","last_peered":"2024-03-09T15:11:01.126053+0000","last_clean":"2024-03-09T15:11:01.126053+0000","last_became_active":"2024-03-09T14:26:28.655904+0000","last_became_peered":"2024-03-09T14:26:28.655904+0000","last_unstale":"2024-03-09T15:11:01.126053+0000","last_undegraded":"2024-03-09T15:11:01.126053+0000","last_fullsized":"2024-03-09T15:11:01.126053+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":600,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3203,"num_read_kb":2919,"num_write":883,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'221","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.793886+0000","last_change":"2024-03-09T14:26:26.644176+0000","last_active":"2024-03-09T15:11:45.793886+0000","last_peered":"2024-03-09T15:11:45.793886+0000","last_clean":"2024-03-09T15:11:45.793886+0000","last_became_active":"2024-03-09T14:26:26.643087+0000","last_became_peered":"2024-03-09T14:26:26.643087+0000","last_unstale":"2024-03-09T15:11:45.793886+0000","last_undegraded":"2024-03-09T15:11:45.793886+0000","last_fullsized":"2024-03-09T15:11:45.793886+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":456,"num_read_kb":60158,"num_write":1088,"num_write_kb":49675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:36.576052+0000","last_change":"2024-03-09T14:26:18.577844+0000","last_active":"2024-03-09T15:09:36.576052+0000","last_peered":"2024-03-09T15:09:36.576052+0000","last_clean":"2024-03-09T15:09:36.576052+0000","last_became_active":"2024-03-09T14:26:18.577564+0000","last_became_peered":"2024-03-09T14:26:18.577564+0000","last_unstale":"2024-03-09T15:09:36.576052+0000","last_undegraded":"2024-03-09T15:09:36.576052+0000","last_fullsized":"2024-03-09T15:09:36.576052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:23:41.274783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:16.608789+0000","last_change":"2024-03-09T14:26:30.650699+0000","last_active":"2024-03-09T15:10:16.608789+0000","last_peered":"2024-03-09T15:10:16.608789+0000","last_clean":"2024-03-09T15:10:16.608789+0000","last_became_active":"2024-03-09T14:26:30.650370+0000","last_became_peered":"2024-03-09T14:26:30.650370+0000","last_unstale":"2024-03-09T15:10:16.608789+0000","last_undegraded":"2024-03-09T15:10:16.608789+0000","last_fullsized":"2024-03-09T15:10:16.608789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'101","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:21.609583+0000","last_change":"2024-03-09T14:26:32.655602+0000","last_active":"2024-03-09T15:10:21.609583+0000","last_peered":"2024-03-09T15:10:21.609583+0000","last_clean":"2024-03-09T15:10:21.609583+0000","last_became_active":"2024-03-09T14:26:32.655285+0000","last_became_peered":"2024-03-09T14:26:32.655285+0000","last_unstale":"2024-03-09T15:10:21.609583+0000","last_undegraded":"2024-03-09T15:10:21.609583+0000","last_fullsized":"2024-03-09T15:10:21.609583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":120,"num_read_kb":114,"num_write":82,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'565","reported_seq":4062,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.991143+0000","last_change":"2024-03-09T14:26:34.678783+0000","last_active":"2024-03-09T15:11:45.991143+0000","last_peered":"2024-03-09T15:11:45.991143+0000","last_clean":"2024-03-09T15:11:45.991143+0000","last_became_active":"2024-03-09T14:26:34.678503+0000","last_became_peered":"2024-03-09T14:26:34.678503+0000","last_unstale":"2024-03-09T15:11:45.991143+0000","last_undegraded":"2024-03-09T15:11:45.991143+0000","last_fullsized":"2024-03-09T15:11:45.991143+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'184","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.887085+0000","last_change":"2024-03-09T14:26:36.669037+0000","last_active":"2024-03-09T15:11:07.887085+0000","last_peered":"2024-03-09T15:11:07.887085+0000","last_clean":"2024-03-09T15:11:07.887085+0000","last_became_active":"2024-03-09T14:26:36.668775+0000","last_became_peered":"2024-03-09T14:26:36.668775+0000","last_unstale":"2024-03-09T15:11:07.887085+0000","last_undegraded":"2024-03-09T15:11:07.887085+0000","last_fullsized":"2024-03-09T15:11:07.887085+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:19.439405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":97,"num_write":406,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'321","reported_seq":1658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.448136+0000","last_change":"2024-03-09T14:26:28.653283+0000","last_active":"2024-03-09T15:11:04.448136+0000","last_peered":"2024-03-09T15:11:04.448136+0000","last_clean":"2024-03-09T15:11:04.448136+0000","last_became_active":"2024-03-09T14:26:28.653003+0000","last_became_peered":"2024-03-09T14:26:28.653003+0000","last_unstale":"2024-03-09T15:11:04.448136+0000","last_undegraded":"2024-03-09T15:11:04.448136+0000","last_fullsized":"2024-03-09T15:11:04.448136+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1763,"num_read_kb":1672,"num_write":372,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'241","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.831763+0000","last_change":"2024-03-09T14:27:03.719767+0000","last_active":"2024-03-09T15:11:45.831763+0000","last_peered":"2024-03-09T15:11:45.831763+0000","last_clean":"2024-03-09T15:11:45.831763+0000","last_became_active":"2024-03-09T14:27:03.719395+0000","last_became_peered":"2024-03-09T14:27:03.719395+0000","last_unstale":"2024-03-09T15:11:45.831763+0000","last_undegraded":"2024-03-09T15:11:45.831763+0000","last_fullsized":"2024-03-09T15:11:45.831763+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:12:44.724715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992298,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":20107,"num_write":1293,"num_write_kb":28946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:41.603733+0000","last_change":"2024-03-09T14:26:18.578318+0000","last_active":"2024-03-09T15:09:41.603733+0000","last_peered":"2024-03-09T15:09:41.603733+0000","last_clean":"2024-03-09T15:09:41.603733+0000","last_became_active":"2024-03-09T14:26:18.577994+0000","last_became_peered":"2024-03-09T14:26:18.577994+0000","last_unstale":"2024-03-09T15:09:41.603733+0000","last_undegraded":"2024-03-09T15:09:41.603733+0000","last_fullsized":"2024-03-09T15:09:41.603733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:01:22.815335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.693743+0000","last_change":"2024-03-09T14:26:30.649199+0000","last_active":"2024-03-09T15:10:36.693743+0000","last_peered":"2024-03-09T15:10:36.693743+0000","last_clean":"2024-03-09T15:10:36.693743+0000","last_became_active":"2024-03-09T14:26:30.648910+0000","last_became_peered":"2024-03-09T14:26:30.648910+0000","last_unstale":"2024-03-09T15:10:36.693743+0000","last_undegraded":"2024-03-09T15:10:36.693743+0000","last_fullsized":"2024-03-09T15:10:36.693743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'310","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.926304+0000","last_change":"2024-03-09T14:26:32.869477+0000","last_active":"2024-03-09T15:11:45.926304+0000","last_peered":"2024-03-09T15:11:45.926304+0000","last_clean":"2024-03-09T15:11:45.926304+0000","last_became_active":"2024-03-09T14:26:32.868370+0000","last_became_peered":"2024-03-09T14:26:32.868370+0000","last_unstale":"2024-03-09T15:11:45.926304+0000","last_undegraded":"2024-03-09T15:11:45.926304+0000","last_fullsized":"2024-03-09T15:11:45.926304+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:40.706622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32196,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":474,"num_read_kb":726,"num_write":246,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:21.692201+0000","last_change":"2024-03-09T14:26:34.673146+0000","last_active":"2024-03-09T15:10:21.692201+0000","last_peered":"2024-03-09T15:10:21.692201+0000","last_clean":"2024-03-09T15:10:21.692201+0000","last_became_active":"2024-03-09T14:26:34.672655+0000","last_became_peered":"2024-03-09T14:26:34.672655+0000","last_unstale":"2024-03-09T15:10:21.692201+0000","last_undegraded":"2024-03-09T15:10:21.692201+0000","last_fullsized":"2024-03-09T15:10:21.692201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'120","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.538977+0000","last_change":"2024-03-09T14:26:36.678909+0000","last_active":"2024-03-09T15:10:54.538977+0000","last_peered":"2024-03-09T15:10:54.538977+0000","last_clean":"2024-03-09T15:10:54.538977+0000","last_became_active":"2024-03-09T14:26:36.678641+0000","last_became_peered":"2024-03-09T14:26:36.678641+0000","last_unstale":"2024-03-09T15:10:54.538977+0000","last_undegraded":"2024-03-09T15:10:54.538977+0000","last_fullsized":"2024-03-09T15:10:54.538977+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:51:04.017437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'140","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:56.494079+0000","last_change":"2024-03-09T14:26:36.672110+0000","last_active":"2024-03-09T15:09:56.494079+0000","last_peered":"2024-03-09T15:09:56.494079+0000","last_clean":"2024-03-09T15:09:56.494079+0000","last_became_active":"2024-03-09T14:26:36.671823+0000","last_became_peered":"2024-03-09T14:26:36.671823+0000","last_unstale":"2024-03-09T15:09:56.494079+0000","last_undegraded":"2024-03-09T15:09:56.494079+0000","last_fullsized":"2024-03-09T15:09:56.494079+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:31:00.040419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":220,"num_write":322,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'409","reported_seq":1970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.152990+0000","last_change":"2024-03-09T14:26:28.650708+0000","last_active":"2024-03-09T15:11:37.152990+0000","last_peered":"2024-03-09T15:11:37.152990+0000","last_clean":"2024-03-09T15:11:37.152990+0000","last_became_active":"2024-03-09T14:26:28.649681+0000","last_became_peered":"2024-03-09T14:26:28.649681+0000","last_unstale":"2024-03-09T15:11:37.152990+0000","last_undegraded":"2024-03-09T15:11:37.152990+0000","last_fullsized":"2024-03-09T15:11:37.152990+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2231,"num_read_kb":2115,"num_write":479,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'192","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.977150+0000","last_change":"2024-03-09T14:26:26.644133+0000","last_active":"2024-03-09T15:11:45.977150+0000","last_peered":"2024-03-09T15:11:45.977150+0000","last_clean":"2024-03-09T15:11:45.977150+0000","last_became_active":"2024-03-09T14:26:26.643598+0000","last_became_peered":"2024-03-09T14:26:26.643598+0000","last_unstale":"2024-03-09T15:11:45.977150+0000","last_undegraded":"2024-03-09T15:11:45.977150+0000","last_fullsized":"2024-03-09T15:11:45.977150+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":35501,"num_write":902,"num_write_kb":49168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.569074+0000","last_change":"2024-03-09T14:26:30.651022+0000","last_active":"2024-03-09T15:08:31.569074+0000","last_peered":"2024-03-09T15:08:31.569074+0000","last_clean":"2024-03-09T15:08:31.569074+0000","last_became_active":"2024-03-09T14:26:30.650743+0000","last_became_peered":"2024-03-09T14:26:30.650743+0000","last_unstale":"2024-03-09T15:08:31.569074+0000","last_undegraded":"2024-03-09T15:08:31.569074+0000","last_fullsized":"2024-03-09T15:08:31.569074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:24.403091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'128","reported_seq":693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.796494+0000","last_change":"2024-03-09T14:26:32.651032+0000","last_active":"2024-03-09T15:11:45.796494+0000","last_peered":"2024-03-09T15:11:45.796494+0000","last_clean":"2024-03-09T15:11:45.796494+0000","last_became_active":"2024-03-09T14:26:32.650770+0000","last_became_peered":"2024-03-09T14:26:32.650770+0000","last_unstale":"2024-03-09T15:11:45.796494+0000","last_undegraded":"2024-03-09T15:11:45.796494+0000","last_fullsized":"2024-03-09T15:11:45.796494+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7550,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":243,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.696218+0000","last_change":"2024-03-09T14:26:34.679002+0000","last_active":"2024-03-09T15:10:56.696218+0000","last_peered":"2024-03-09T15:10:56.696218+0000","last_clean":"2024-03-09T15:10:56.696218+0000","last_became_active":"2024-03-09T14:26:34.678657+0000","last_became_peered":"2024-03-09T14:26:34.678657+0000","last_unstale":"2024-03-09T15:10:56.696218+0000","last_undegraded":"2024-03-09T15:10:56.696218+0000","last_fullsized":"2024-03-09T15:10:56.696218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'108","reported_seq":594,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.440595+0000","last_change":"2024-03-09T14:26:36.678524+0000","last_active":"2024-03-09T15:11:04.440595+0000","last_peered":"2024-03-09T15:11:04.440595+0000","last_clean":"2024-03-09T15:11:04.440595+0000","last_became_active":"2024-03-09T14:26:36.678174+0000","last_became_peered":"2024-03-09T14:26:36.678174+0000","last_unstale":"2024-03-09T15:11:04.440595+0000","last_undegraded":"2024-03-09T15:11:04.440595+0000","last_fullsized":"2024-03-09T15:11:04.440595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":96,"num_write":259,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'447","reported_seq":2102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.167849+0000","last_change":"2024-03-09T14:26:28.645383+0000","last_active":"2024-03-09T15:11:09.167849+0000","last_peered":"2024-03-09T15:11:09.167849+0000","last_clean":"2024-03-09T15:11:09.167849+0000","last_became_active":"2024-03-09T14:26:28.644951+0000","last_became_peered":"2024-03-09T14:26:28.644951+0000","last_unstale":"2024-03-09T15:11:09.167849+0000","last_undegraded":"2024-03-09T15:11:09.167849+0000","last_fullsized":"2024-03-09T15:11:09.167849+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:15:07.312913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2607,"num_read_kb":2478,"num_write":564,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'189","reported_seq":801,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.875431+0000","last_change":"2024-03-09T14:26:26.652608+0000","last_active":"2024-03-09T15:11:45.875431+0000","last_peered":"2024-03-09T15:11:45.875431+0000","last_clean":"2024-03-09T15:11:45.875431+0000","last_became_active":"2024-03-09T14:26:26.652260+0000","last_became_peered":"2024-03-09T14:26:26.652260+0000","last_unstale":"2024-03-09T15:11:45.875431+0000","last_undegraded":"2024-03-09T15:11:45.875431+0000","last_fullsized":"2024-03-09T15:11:45.875431+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:55.237307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":396,"num_read_kb":5479,"num_write":1053,"num_write_kb":16075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.695709+0000","last_change":"2024-03-09T14:26:30.650065+0000","last_active":"2024-03-09T15:10:51.695709+0000","last_peered":"2024-03-09T15:10:51.695709+0000","last_clean":"2024-03-09T15:10:51.695709+0000","last_became_active":"2024-03-09T14:26:30.649790+0000","last_became_peered":"2024-03-09T14:26:30.649790+0000","last_unstale":"2024-03-09T15:10:51.695709+0000","last_undegraded":"2024-03-09T15:10:51.695709+0000","last_fullsized":"2024-03-09T15:10:51.695709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'56","reported_seq":562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.592684+0000","last_change":"2024-03-09T14:26:32.655566+0000","last_active":"2024-03-09T15:10:56.592684+0000","last_peered":"2024-03-09T15:10:56.592684+0000","last_clean":"2024-03-09T15:10:56.592684+0000","last_became_active":"2024-03-09T14:26:32.655269+0000","last_became_peered":"2024-03-09T14:26:32.655269+0000","last_unstale":"2024-03-09T15:10:56.592684+0000","last_undegraded":"2024-03-09T15:10:56.592684+0000","last_fullsized":"2024-03-09T15:10:56.592684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:13.374240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.715778+0000","last_change":"2024-03-09T14:26:34.671491+0000","last_active":"2024-03-09T15:08:36.715778+0000","last_peered":"2024-03-09T15:08:36.715778+0000","last_clean":"2024-03-09T15:08:36.715778+0000","last_became_active":"2024-03-09T14:26:34.671065+0000","last_became_peered":"2024-03-09T14:26:34.671065+0000","last_unstale":"2024-03-09T15:08:36.715778+0000","last_undegraded":"2024-03-09T15:08:36.715778+0000","last_fullsized":"2024-03-09T15:08:36.715778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:19:07.578080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'188","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:14.235785+0000","last_change":"2024-03-09T14:26:36.667732+0000","last_active":"2024-03-09T15:09:14.235785+0000","last_peered":"2024-03-09T15:09:14.235785+0000","last_clean":"2024-03-09T15:09:14.235785+0000","last_became_active":"2024-03-09T14:26:36.666762+0000","last_became_peered":"2024-03-09T14:26:36.666762+0000","last_unstale":"2024-03-09T15:09:14.235785+0000","last_undegraded":"2024-03-09T15:09:14.235785+0000","last_fullsized":"2024-03-09T15:09:14.235785+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:03:47.792239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":266,"num_read_kb":261,"num_write":413,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'437","reported_seq":2100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.126017+0000","last_change":"2024-03-09T14:26:28.658137+0000","last_active":"2024-03-09T15:11:01.126017+0000","last_peered":"2024-03-09T15:11:01.126017+0000","last_clean":"2024-03-09T15:11:01.126017+0000","last_became_active":"2024-03-09T14:26:28.657024+0000","last_became_peered":"2024-03-09T14:26:28.657024+0000","last_unstale":"2024-03-09T15:11:01.126017+0000","last_undegraded":"2024-03-09T15:11:01.126017+0000","last_fullsized":"2024-03-09T15:11:01.126017+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2592,"num_read_kb":2450,"num_write":527,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'200","reported_seq":802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.921209+0000","last_change":"2024-03-09T14:26:26.646837+0000","last_active":"2024-03-09T15:11:45.921209+0000","last_peered":"2024-03-09T15:11:45.921209+0000","last_clean":"2024-03-09T15:11:45.921209+0000","last_became_active":"2024-03-09T14:26:26.646506+0000","last_became_peered":"2024-03-09T14:26:26.646506+0000","last_unstale":"2024-03-09T15:11:45.921209+0000","last_undegraded":"2024-03-09T15:11:45.921209+0000","last_fullsized":"2024-03-09T15:11:45.921209+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:13.870996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680231,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":50376,"num_write":989,"num_write_kb":56973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.715107+0000","last_change":"2024-03-09T14:26:30.652971+0000","last_active":"2024-03-09T15:08:31.715107+0000","last_peered":"2024-03-09T15:08:31.715107+0000","last_clean":"2024-03-09T15:08:31.715107+0000","last_became_active":"2024-03-09T14:26:30.652245+0000","last_became_peered":"2024-03-09T14:26:30.652245+0000","last_unstale":"2024-03-09T15:08:31.715107+0000","last_undegraded":"2024-03-09T15:08:31.715107+0000","last_fullsized":"2024-03-09T15:08:31.715107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:24:02.699008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'167","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.698044+0000","last_change":"2024-03-09T14:26:32.652895+0000","last_active":"2024-03-09T15:11:45.698044+0000","last_peered":"2024-03-09T15:11:45.698044+0000","last_clean":"2024-03-09T15:11:45.698044+0000","last_became_active":"2024-03-09T14:26:32.652610+0000","last_became_peered":"2024-03-09T14:26:32.652610+0000","last_unstale":"2024-03-09T15:11:45.698044+0000","last_undegraded":"2024-03-09T15:11:45.698044+0000","last_fullsized":"2024-03-09T15:11:45.698044+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11381,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":311,"num_write":122,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.594468+0000","last_change":"2024-03-09T14:26:34.667654+0000","last_active":"2024-03-09T15:08:36.594468+0000","last_peered":"2024-03-09T15:08:36.594468+0000","last_clean":"2024-03-09T15:08:36.594468+0000","last_became_active":"2024-03-09T14:26:34.667373+0000","last_became_peered":"2024-03-09T14:26:34.667373+0000","last_unstale":"2024-03-09T15:08:36.594468+0000","last_undegraded":"2024-03-09T15:08:36.594468+0000","last_fullsized":"2024-03-09T15:08:36.594468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:15.287538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'134","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.348642+0000","last_change":"2024-03-09T14:26:36.678631+0000","last_active":"2024-03-09T15:10:35.348642+0000","last_peered":"2024-03-09T15:10:35.348642+0000","last_clean":"2024-03-09T15:10:35.348642+0000","last_became_active":"2024-03-09T14:26:36.678306+0000","last_became_peered":"2024-03-09T14:26:36.678306+0000","last_unstale":"2024-03-09T15:10:35.348642+0000","last_undegraded":"2024-03-09T15:10:35.348642+0000","last_fullsized":"2024-03-09T15:10:35.348642+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:33:48.413353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":110,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'432","reported_seq":2097,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.555652+0000","last_change":"2024-03-09T14:26:28.652461+0000","last_active":"2024-03-09T15:10:54.555652+0000","last_peered":"2024-03-09T15:10:54.555652+0000","last_clean":"2024-03-09T15:10:54.555652+0000","last_became_active":"2024-03-09T14:26:28.651640+0000","last_became_peered":"2024-03-09T14:26:28.651640+0000","last_unstale":"2024-03-09T15:10:54.555652+0000","last_undegraded":"2024-03-09T15:10:54.555652+0000","last_fullsized":"2024-03-09T15:10:54.555652+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2590,"num_read_kb":2461,"num_write":546,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'207","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.789924+0000","last_change":"2024-03-09T14:26:26.636955+0000","last_active":"2024-03-09T15:11:45.789924+0000","last_peered":"2024-03-09T15:11:45.789924+0000","last_clean":"2024-03-09T15:11:45.789924+0000","last_became_active":"2024-03-09T14:26:26.636087+0000","last_became_peered":"2024-03-09T14:26:26.636087+0000","last_unstale":"2024-03-09T15:11:45.789924+0000","last_undegraded":"2024-03-09T15:11:45.789924+0000","last_fullsized":"2024-03-09T15:11:45.789924+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:08:49.930168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":651,"num_read_kb":124750,"num_write":1247,"num_write_kb":18410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:31.593747+0000","last_change":"2024-03-09T14:26:30.653233+0000","last_active":"2024-03-09T15:08:31.593747+0000","last_peered":"2024-03-09T15:08:31.593747+0000","last_clean":"2024-03-09T15:08:31.593747+0000","last_became_active":"2024-03-09T14:26:30.652925+0000","last_became_peered":"2024-03-09T14:26:30.652925+0000","last_unstale":"2024-03-09T15:08:31.593747+0000","last_undegraded":"2024-03-09T15:08:31.593747+0000","last_fullsized":"2024-03-09T15:08:31.593747+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:15:46.808131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'130","reported_seq":693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.971900+0000","last_change":"2024-03-09T14:26:32.657556+0000","last_active":"2024-03-09T15:11:45.971900+0000","last_peered":"2024-03-09T15:11:45.971900+0000","last_clean":"2024-03-09T15:11:45.971900+0000","last_became_active":"2024-03-09T14:26:32.657221+0000","last_became_peered":"2024-03-09T14:26:32.657221+0000","last_unstale":"2024-03-09T15:11:45.971900+0000","last_undegraded":"2024-03-09T15:11:45.971900+0000","last_fullsized":"2024-03-09T15:11:45.971900+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:53:32.822261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24100,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":271,"num_write":84,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:36.577073+0000","last_change":"2024-03-09T14:26:34.670563+0000","last_active":"2024-03-09T15:08:36.577073+0000","last_peered":"2024-03-09T15:08:36.577073+0000","last_clean":"2024-03-09T15:08:36.577073+0000","last_became_active":"2024-03-09T14:26:34.670283+0000","last_became_peered":"2024-03-09T14:26:34.670283+0000","last_unstale":"2024-03-09T15:08:36.577073+0000","last_undegraded":"2024-03-09T15:08:36.577073+0000","last_fullsized":"2024-03-09T15:08:36.577073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:08:44.244645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'870","reported_seq":2445,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.175205+0000","last_change":"2024-03-09T14:26:28.652528+0000","last_active":"2024-03-09T15:11:09.175205+0000","last_peered":"2024-03-09T15:11:09.175205+0000","last_clean":"2024-03-09T15:11:09.175205+0000","last_became_active":"2024-03-09T14:26:28.651921+0000","last_became_peered":"2024-03-09T14:26:28.651921+0000","last_unstale":"2024-03-09T15:11:09.175205+0000","last_undegraded":"2024-03-09T15:11:09.175205+0000","last_fullsized":"2024-03-09T15:11:09.175205+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:35:33.794890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3929,"num_read_kb":3481,"num_write":1218,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'260","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.817620+0000","last_change":"2024-03-09T14:27:03.717196+0000","last_active":"2024-03-09T15:11:45.817620+0000","last_peered":"2024-03-09T15:11:45.817620+0000","last_clean":"2024-03-09T15:11:45.817620+0000","last_became_active":"2024-03-09T14:27:03.716852+0000","last_became_peered":"2024-03-09T14:27:03.716852+0000","last_unstale":"2024-03-09T15:11:45.817620+0000","last_undegraded":"2024-03-09T15:11:45.817620+0000","last_fullsized":"2024-03-09T15:11:45.817620+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:55.331529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524411,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":890,"num_read_kb":7728,"num_write":1384,"num_write_kb":17237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"35'3","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.188657+0000","last_change":"2024-03-09T14:26:30.652021+0000","last_active":"2024-03-09T15:11:45.188657+0000","last_peered":"2024-03-09T15:11:45.188657+0000","last_clean":"2024-03-09T15:11:45.188657+0000","last_became_active":"2024-03-09T14:26:30.651711+0000","last_became_peered":"2024-03-09T14:26:30.651711+0000","last_unstale":"2024-03-09T15:11:45.188657+0000","last_undegraded":"2024-03-09T15:11:45.188657+0000","last_fullsized":"2024-03-09T15:11:45.188657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:37.178573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":482,"num_read_kb":480,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'207","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.957286+0000","last_change":"2024-03-09T14:26:32.655679+0000","last_active":"2024-03-09T15:11:45.957286+0000","last_peered":"2024-03-09T15:11:45.957286+0000","last_clean":"2024-03-09T15:11:45.957286+0000","last_became_active":"2024-03-09T14:26:32.655391+0000","last_became_peered":"2024-03-09T14:26:32.655391+0000","last_unstale":"2024-03-09T15:11:45.957286+0000","last_undegraded":"2024-03-09T15:11:45.957286+0000","last_fullsized":"2024-03-09T15:11:45.957286+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:26:19.532383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39743,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":317,"num_read_kb":534,"num_write":200,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.583116+0000","last_change":"2024-03-09T14:26:34.675539+0000","last_active":"2024-03-09T15:09:06.583116+0000","last_peered":"2024-03-09T15:09:06.583116+0000","last_clean":"2024-03-09T15:09:06.583116+0000","last_became_active":"2024-03-09T14:26:34.675248+0000","last_became_peered":"2024-03-09T14:26:34.675248+0000","last_unstale":"2024-03-09T15:09:06.583116+0000","last_undegraded":"2024-03-09T15:09:06.583116+0000","last_fullsized":"2024-03-09T15:09:06.583116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:43:16.280150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'185","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.117958+0000","last_change":"2024-03-09T14:26:36.786828+0000","last_active":"2024-03-09T15:11:01.117958+0000","last_peered":"2024-03-09T15:11:01.117958+0000","last_clean":"2024-03-09T15:11:01.117958+0000","last_became_active":"2024-03-09T14:26:36.786403+0000","last_became_peered":"2024-03-09T14:26:36.786403+0000","last_unstale":"2024-03-09T15:11:01.117958+0000","last_undegraded":"2024-03-09T15:11:01.117958+0000","last_fullsized":"2024-03-09T15:11:01.117958+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1042,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":213,"num_write":429,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'371","reported_seq":1881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.128774+0000","last_change":"2024-03-09T14:26:28.642746+0000","last_active":"2024-03-09T15:11:37.128774+0000","last_peered":"2024-03-09T15:11:37.128774+0000","last_clean":"2024-03-09T15:11:37.128774+0000","last_became_active":"2024-03-09T14:26:28.642452+0000","last_became_peered":"2024-03-09T14:26:28.642452+0000","last_unstale":"2024-03-09T15:11:37.128774+0000","last_undegraded":"2024-03-09T15:11:37.128774+0000","last_fullsized":"2024-03-09T15:11:37.128774+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:40.141256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2046,"num_read_kb":1963,"num_write":419,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'183","reported_seq":800,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.924243+0000","last_change":"2024-03-09T14:27:03.724915+0000","last_active":"2024-03-09T15:11:45.924243+0000","last_peered":"2024-03-09T15:11:45.924243+0000","last_clean":"2024-03-09T15:11:45.924243+0000","last_became_active":"2024-03-09T14:27:03.724521+0000","last_became_peered":"2024-03-09T14:27:03.724521+0000","last_unstale":"2024-03-09T15:11:45.924243+0000","last_undegraded":"2024-03-09T15:11:45.924243+0000","last_fullsized":"2024-03-09T15:11:45.924243+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:32:10.947685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1070276,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":327,"num_read_kb":39345,"num_write":965,"num_write_kb":40541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.591483+0000","last_change":"2024-03-09T14:26:30.652505+0000","last_active":"2024-03-09T15:08:11.591483+0000","last_peered":"2024-03-09T15:08:11.591483+0000","last_clean":"2024-03-09T15:08:11.591483+0000","last_became_active":"2024-03-09T14:26:30.652243+0000","last_became_peered":"2024-03-09T14:26:30.652243+0000","last_unstale":"2024-03-09T15:08:11.591483+0000","last_undegraded":"2024-03-09T15:08:11.591483+0000","last_fullsized":"2024-03-09T15:08:11.591483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:42:30.815337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'153","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.982300+0000","last_change":"2024-03-09T14:26:32.658910+0000","last_active":"2024-03-09T15:11:45.982300+0000","last_peered":"2024-03-09T15:11:45.982300+0000","last_clean":"2024-03-09T15:11:45.982300+0000","last_became_active":"2024-03-09T14:26:32.658626+0000","last_became_peered":"2024-03-09T14:26:32.658626+0000","last_unstale":"2024-03-09T15:11:45.982300+0000","last_undegraded":"2024-03-09T15:11:45.982300+0000","last_fullsized":"2024-03-09T15:11:45.982300+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:20.837652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13483,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":225,"num_read_kb":299,"num_write":146,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.572913+0000","last_change":"2024-03-09T14:26:34.669777+0000","last_active":"2024-03-09T15:09:06.572913+0000","last_peered":"2024-03-09T15:09:06.572913+0000","last_clean":"2024-03-09T15:09:06.572913+0000","last_became_active":"2024-03-09T14:26:34.669482+0000","last_became_peered":"2024-03-09T14:26:34.669482+0000","last_unstale":"2024-03-09T15:09:06.572913+0000","last_undegraded":"2024-03-09T15:09:06.572913+0000","last_fullsized":"2024-03-09T15:09:06.572913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:44:39.381656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'220","reported_seq":1403,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.414241+0000","last_change":"2024-03-09T14:26:36.678544+0000","last_active":"2024-03-09T15:11:37.414241+0000","last_peered":"2024-03-09T15:11:37.414241+0000","last_clean":"2024-03-09T15:11:37.414241+0000","last_became_active":"2024-03-09T14:26:36.678232+0000","last_became_peered":"2024-03-09T14:26:36.678232+0000","last_unstale":"2024-03-09T15:11:37.414241+0000","last_undegraded":"2024-03-09T15:11:37.414241+0000","last_fullsized":"2024-03-09T15:11:37.414241+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:27.054472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":941,"num_read_kb":939,"num_write":605,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'431","reported_seq":1928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.151571+0000","last_change":"2024-03-09T14:26:28.658740+0000","last_active":"2024-03-09T15:11:37.151571+0000","last_peered":"2024-03-09T15:11:37.151571+0000","last_clean":"2024-03-09T15:11:37.151571+0000","last_became_active":"2024-03-09T14:26:28.657488+0000","last_became_peered":"2024-03-09T14:26:28.657488+0000","last_unstale":"2024-03-09T15:11:37.151571+0000","last_undegraded":"2024-03-09T15:11:37.151571+0000","last_fullsized":"2024-03-09T15:11:37.151571+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2287,"num_read_kb":2137,"num_write":511,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'198","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.809101+0000","last_change":"2024-03-09T14:26:26.641350+0000","last_active":"2024-03-09T15:11:45.809101+0000","last_peered":"2024-03-09T15:11:45.809101+0000","last_clean":"2024-03-09T15:11:45.809101+0000","last_became_active":"2024-03-09T14:26:26.641003+0000","last_became_peered":"2024-03-09T14:26:26.641003+0000","last_unstale":"2024-03-09T15:11:45.809101+0000","last_undegraded":"2024-03-09T15:11:45.809101+0000","last_fullsized":"2024-03-09T15:11:45.809101+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":32756,"num_write":1157,"num_write_kb":45988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.493753+0000","last_change":"2024-03-09T14:26:30.654064+0000","last_active":"2024-03-09T15:11:31.493753+0000","last_peered":"2024-03-09T15:11:31.493753+0000","last_clean":"2024-03-09T15:11:31.493753+0000","last_became_active":"2024-03-09T14:26:30.653249+0000","last_became_peered":"2024-03-09T14:26:30.653249+0000","last_unstale":"2024-03-09T15:11:31.493753+0000","last_undegraded":"2024-03-09T15:11:31.493753+0000","last_fullsized":"2024-03-09T15:11:31.493753+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'128","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.846117+0000","last_change":"2024-03-09T14:26:32.868697+0000","last_active":"2024-03-09T15:11:45.846117+0000","last_peered":"2024-03-09T15:11:45.846117+0000","last_clean":"2024-03-09T15:11:45.846117+0000","last_became_active":"2024-03-09T14:26:32.868236+0000","last_became_peered":"2024-03-09T14:26:32.868236+0000","last_unstale":"2024-03-09T15:11:45.846117+0000","last_undegraded":"2024-03-09T15:11:45.846117+0000","last_fullsized":"2024-03-09T15:11:45.846117+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7847,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":246,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:41.570427+0000","last_change":"2024-03-09T14:26:34.675615+0000","last_active":"2024-03-09T15:08:41.570427+0000","last_peered":"2024-03-09T15:08:41.570427+0000","last_clean":"2024-03-09T15:08:41.570427+0000","last_became_active":"2024-03-09T14:26:34.675120+0000","last_became_peered":"2024-03-09T14:26:34.675120+0000","last_unstale":"2024-03-09T15:08:41.570427+0000","last_undegraded":"2024-03-09T15:08:41.570427+0000","last_fullsized":"2024-03-09T15:08:41.570427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:06.267360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'104","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.686247+0000","last_change":"2024-03-09T14:26:36.678845+0000","last_active":"2024-03-09T15:11:38.686247+0000","last_peered":"2024-03-09T15:11:38.686247+0000","last_clean":"2024-03-09T15:11:38.686247+0000","last_became_active":"2024-03-09T14:26:36.678521+0000","last_became_peered":"2024-03-09T14:26:36.678521+0000","last_unstale":"2024-03-09T15:11:38.686247+0000","last_undegraded":"2024-03-09T15:11:38.686247+0000","last_fullsized":"2024-03-09T15:11:38.686247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:26:18.582752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":103,"num_write":248,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'325","reported_seq":1740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.198591+0000","last_change":"2024-03-09T14:26:28.648512+0000","last_active":"2024-03-09T15:11:09.198591+0000","last_peered":"2024-03-09T15:11:09.198591+0000","last_clean":"2024-03-09T15:11:09.198591+0000","last_became_active":"2024-03-09T14:26:28.648204+0000","last_became_peered":"2024-03-09T14:26:28.648204+0000","last_unstale":"2024-03-09T15:11:09.198591+0000","last_undegraded":"2024-03-09T15:11:09.198591+0000","last_fullsized":"2024-03-09T15:11:09.198591+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:16:38.156513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1841,"num_read_kb":1771,"num_write":371,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'202","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.962881+0000","last_change":"2024-03-09T14:27:03.719684+0000","last_active":"2024-03-09T15:11:45.962881+0000","last_peered":"2024-03-09T15:11:45.962881+0000","last_clean":"2024-03-09T15:11:45.962881+0000","last_became_active":"2024-03-09T14:27:03.719292+0000","last_became_peered":"2024-03-09T14:27:03.719292+0000","last_unstale":"2024-03-09T15:11:45.962881+0000","last_undegraded":"2024-03-09T15:11:45.962881+0000","last_fullsized":"2024-03-09T15:11:45.962881+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:28.532681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778707,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":941,"num_read_kb":86830,"num_write":1019,"num_write_kb":33052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.572422+0000","last_change":"2024-03-09T14:26:30.652463+0000","last_active":"2024-03-09T15:09:01.572422+0000","last_peered":"2024-03-09T15:09:01.572422+0000","last_clean":"2024-03-09T15:09:01.572422+0000","last_became_active":"2024-03-09T14:26:30.652190+0000","last_became_peered":"2024-03-09T14:26:30.652190+0000","last_unstale":"2024-03-09T15:09:01.572422+0000","last_undegraded":"2024-03-09T15:09:01.572422+0000","last_fullsized":"2024-03-09T15:09:01.572422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:52:53.691492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'82","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:46.613011+0000","last_change":"2024-03-09T14:26:32.868321+0000","last_active":"2024-03-09T15:10:46.613011+0000","last_peered":"2024-03-09T15:10:46.613011+0000","last_clean":"2024-03-09T15:10:46.613011+0000","last_became_active":"2024-03-09T14:26:32.867985+0000","last_became_peered":"2024-03-09T14:26:32.867985+0000","last_unstale":"2024-03-09T15:10:46.613011+0000","last_undegraded":"2024-03-09T15:10:46.613011+0000","last_fullsized":"2024-03-09T15:10:46.613011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":100,"num_read_kb":95,"num_write":100,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'535","reported_seq":2045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.618883+0000","last_change":"2024-03-09T14:26:34.665855+0000","last_active":"2024-03-09T15:11:45.618883+0000","last_peered":"2024-03-09T15:11:45.618883+0000","last_clean":"2024-03-09T15:11:45.618883+0000","last_became_active":"2024-03-09T14:26:34.664708+0000","last_became_peered":"2024-03-09T14:26:34.664708+0000","last_unstale":"2024-03-09T15:11:45.618883+0000","last_undegraded":"2024-03-09T15:11:45.618883+0000","last_fullsized":"2024-03-09T15:11:45.618883+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:21:02.162854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'142","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.341774+0000","last_change":"2024-03-09T14:26:36.676199+0000","last_active":"2024-03-09T15:10:35.341774+0000","last_peered":"2024-03-09T15:10:35.341774+0000","last_clean":"2024-03-09T15:10:35.341774+0000","last_became_active":"2024-03-09T14:26:36.675855+0000","last_became_peered":"2024-03-09T14:26:36.675855+0000","last_unstale":"2024-03-09T15:10:35.341774+0000","last_undegraded":"2024-03-09T15:10:35.341774+0000","last_fullsized":"2024-03-09T15:10:35.341774+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:10:54.315090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":194,"num_write":349,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'797","reported_seq":2330,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.493689+0000","last_change":"2024-03-09T14:26:28.657378+0000","last_active":"2024-03-09T15:11:31.493689+0000","last_peered":"2024-03-09T15:11:31.493689+0000","last_clean":"2024-03-09T15:11:31.493689+0000","last_became_active":"2024-03-09T14:26:28.656940+0000","last_became_peered":"2024-03-09T14:26:28.656940+0000","last_unstale":"2024-03-09T15:11:31.493689+0000","last_undegraded":"2024-03-09T15:11:31.493689+0000","last_fullsized":"2024-03-09T15:11:31.493689+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3613,"num_read_kb":3222,"num_write":1070,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'213","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.955690+0000","last_change":"2024-03-09T14:26:26.641435+0000","last_active":"2024-03-09T15:11:45.955690+0000","last_peered":"2024-03-09T15:11:45.955690+0000","last_clean":"2024-03-09T15:11:45.955690+0000","last_became_active":"2024-03-09T14:26:26.641031+0000","last_became_peered":"2024-03-09T14:26:26.641031+0000","last_unstale":"2024-03-09T15:11:45.955690+0000","last_undegraded":"2024-03-09T15:11:45.955690+0000","last_fullsized":"2024-03-09T15:11:45.955690+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:53:53.180266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651867,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":2692,"num_write":1154,"num_write_kb":40768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.719265+0000","last_change":"2024-03-09T14:26:30.652643+0000","last_active":"2024-03-09T15:09:01.719265+0000","last_peered":"2024-03-09T15:09:01.719265+0000","last_clean":"2024-03-09T15:09:01.719265+0000","last_became_active":"2024-03-09T14:26:30.652315+0000","last_became_peered":"2024-03-09T14:26:30.652315+0000","last_unstale":"2024-03-09T15:09:01.719265+0000","last_undegraded":"2024-03-09T15:09:01.719265+0000","last_fullsized":"2024-03-09T15:09:01.719265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:10.314147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'170","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.896902+0000","last_change":"2024-03-09T14:26:32.657278+0000","last_active":"2024-03-09T15:11:45.896902+0000","last_peered":"2024-03-09T15:11:45.896902+0000","last_clean":"2024-03-09T15:11:45.896902+0000","last_became_active":"2024-03-09T14:26:32.656973+0000","last_became_peered":"2024-03-09T14:26:32.656973+0000","last_unstale":"2024-03-09T15:11:45.896902+0000","last_undegraded":"2024-03-09T15:11:45.896902+0000","last_fullsized":"2024-03-09T15:11:45.896902+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:33.380705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9391,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":206,"num_read_kb":261,"num_write":118,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.570657+0000","last_change":"2024-03-09T14:26:34.665616+0000","last_active":"2024-03-09T15:07:41.570657+0000","last_peered":"2024-03-09T15:07:41.570657+0000","last_clean":"2024-03-09T15:07:41.570657+0000","last_became_active":"2024-03-09T14:26:34.665208+0000","last_became_peered":"2024-03-09T14:26:34.665208+0000","last_unstale":"2024-03-09T15:07:41.570657+0000","last_undegraded":"2024-03-09T15:07:41.570657+0000","last_fullsized":"2024-03-09T15:07:41.570657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:06:56.886360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'128","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:08.308795+0000","last_change":"2024-03-09T14:26:36.678157+0000","last_active":"2024-03-09T15:11:08.308795+0000","last_peered":"2024-03-09T15:11:08.308795+0000","last_clean":"2024-03-09T15:11:08.308795+0000","last_became_active":"2024-03-09T14:26:36.677867+0000","last_became_peered":"2024-03-09T14:26:36.677867+0000","last_unstale":"2024-03-09T15:11:08.308795+0000","last_undegraded":"2024-03-09T15:11:08.308795+0000","last_fullsized":"2024-03-09T15:11:08.308795+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:04:56.832371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":311,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'823","reported_seq":2498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.152933+0000","last_change":"2024-03-09T14:26:28.657249+0000","last_active":"2024-03-09T15:11:37.152933+0000","last_peered":"2024-03-09T15:11:37.152933+0000","last_clean":"2024-03-09T15:11:37.152933+0000","last_became_active":"2024-03-09T14:26:28.656960+0000","last_became_peered":"2024-03-09T14:26:28.656960+0000","last_unstale":"2024-03-09T15:11:37.152933+0000","last_undegraded":"2024-03-09T15:11:37.152933+0000","last_fullsized":"2024-03-09T15:11:37.152933+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4034,"num_read_kb":3617,"num_write":1125,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'217","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.942545+0000","last_change":"2024-03-09T14:26:26.650356+0000","last_active":"2024-03-09T15:11:45.942545+0000","last_peered":"2024-03-09T15:11:45.942545+0000","last_clean":"2024-03-09T15:11:45.942545+0000","last_became_active":"2024-03-09T14:26:26.649772+0000","last_became_peered":"2024-03-09T14:26:26.649772+0000","last_unstale":"2024-03-09T15:11:45.942545+0000","last_undegraded":"2024-03-09T15:11:45.942545+0000","last_fullsized":"2024-03-09T15:11:45.942545+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:59.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":404,"num_read_kb":32014,"num_write":1026,"num_write_kb":48046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:01.582476+0000","last_change":"2024-03-09T14:26:30.650955+0000","last_active":"2024-03-09T15:09:01.582476+0000","last_peered":"2024-03-09T15:09:01.582476+0000","last_clean":"2024-03-09T15:09:01.582476+0000","last_became_active":"2024-03-09T14:26:30.650674+0000","last_became_peered":"2024-03-09T14:26:30.650674+0000","last_unstale":"2024-03-09T15:09:01.582476+0000","last_undegraded":"2024-03-09T15:09:01.582476+0000","last_fullsized":"2024-03-09T15:09:01.582476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:18.310162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'129","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.904615+0000","last_change":"2024-03-09T14:26:32.653856+0000","last_active":"2024-03-09T15:11:45.904615+0000","last_peered":"2024-03-09T15:11:45.904615+0000","last_clean":"2024-03-09T15:11:45.904615+0000","last_became_active":"2024-03-09T14:26:32.652397+0000","last_became_peered":"2024-03-09T14:26:32.652397+0000","last_unstale":"2024-03-09T15:11:45.904615+0000","last_undegraded":"2024-03-09T15:11:45.904615+0000","last_fullsized":"2024-03-09T15:11:45.904615+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:53:36.740581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14802,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":258,"num_write":88,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.588861+0000","last_change":"2024-03-09T14:26:34.671397+0000","last_active":"2024-03-09T15:07:51.588861+0000","last_peered":"2024-03-09T15:07:51.588861+0000","last_clean":"2024-03-09T15:07:51.588861+0000","last_became_active":"2024-03-09T14:26:34.671029+0000","last_became_peered":"2024-03-09T14:26:34.671029+0000","last_unstale":"2024-03-09T15:07:51.588861+0000","last_undegraded":"2024-03-09T15:07:51.588861+0000","last_fullsized":"2024-03-09T15:07:51.588861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:21:55.027507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'112","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.690601+0000","last_change":"2024-03-09T14:26:36.786838+0000","last_active":"2024-03-09T15:10:06.690601+0000","last_peered":"2024-03-09T15:10:06.690601+0000","last_clean":"2024-03-09T15:10:06.690601+0000","last_became_active":"2024-03-09T14:26:36.786449+0000","last_became_peered":"2024-03-09T14:26:36.786449+0000","last_unstale":"2024-03-09T15:10:06.690601+0000","last_undegraded":"2024-03-09T15:10:06.690601+0000","last_fullsized":"2024-03-09T15:10:06.690601+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":178,"num_write":287,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'518","reported_seq":2100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.356877+0000","last_change":"2024-03-09T14:26:28.649113+0000","last_active":"2024-03-09T15:10:35.356877+0000","last_peered":"2024-03-09T15:10:35.356877+0000","last_clean":"2024-03-09T15:10:35.356877+0000","last_became_active":"2024-03-09T14:26:28.647178+0000","last_became_peered":"2024-03-09T14:26:28.647178+0000","last_unstale":"2024-03-09T15:10:35.356877+0000","last_undegraded":"2024-03-09T15:10:35.356877+0000","last_fullsized":"2024-03-09T15:10:35.356877+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2831,"num_read_kb":2584,"num_write":686,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'273","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.978422+0000","last_change":"2024-03-09T14:26:26.643743+0000","last_active":"2024-03-09T15:11:45.978422+0000","last_peered":"2024-03-09T15:11:45.978422+0000","last_clean":"2024-03-09T15:11:45.978422+0000","last_became_active":"2024-03-09T14:26:26.643338+0000","last_became_peered":"2024-03-09T14:26:26.643338+0000","last_unstale":"2024-03-09T15:11:45.978422+0000","last_undegraded":"2024-03-09T15:11:45.978422+0000","last_fullsized":"2024-03-09T15:11:45.978422+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":43219,"num_write":1342,"num_write_kb":45633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:01.606624+0000","last_change":"2024-03-09T14:26:30.648059+0000","last_active":"2024-03-09T15:10:01.606624+0000","last_peered":"2024-03-09T15:10:01.606624+0000","last_clean":"2024-03-09T15:10:01.606624+0000","last_became_active":"2024-03-09T14:26:30.647466+0000","last_became_peered":"2024-03-09T14:26:30.647466+0000","last_unstale":"2024-03-09T15:10:01.606624+0000","last_undegraded":"2024-03-09T15:10:01.606624+0000","last_fullsized":"2024-03-09T15:10:01.606624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'105","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.822921+0000","last_change":"2024-03-09T14:26:32.654369+0000","last_active":"2024-03-09T15:11:45.822921+0000","last_peered":"2024-03-09T15:11:45.822921+0000","last_clean":"2024-03-09T15:11:45.822921+0000","last_became_active":"2024-03-09T14:26:32.654096+0000","last_became_peered":"2024-03-09T14:26:32.654096+0000","last_unstale":"2024-03-09T15:11:45.822921+0000","last_undegraded":"2024-03-09T15:11:45.822921+0000","last_fullsized":"2024-03-09T15:11:45.822921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5925,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":181,"num_write":62,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.494461+0000","last_change":"2024-03-09T14:26:34.665772+0000","last_active":"2024-03-09T15:11:36.494461+0000","last_peered":"2024-03-09T15:11:36.494461+0000","last_clean":"2024-03-09T15:11:36.494461+0000","last_became_active":"2024-03-09T14:26:34.665478+0000","last_became_peered":"2024-03-09T14:26:34.665478+0000","last_unstale":"2024-03-09T15:11:36.494461+0000","last_undegraded":"2024-03-09T15:11:36.494461+0000","last_fullsized":"2024-03-09T15:11:36.494461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'118","reported_seq":1775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.464880+0000","last_change":"2024-03-09T14:26:36.678308+0000","last_active":"2024-03-09T15:11:37.464880+0000","last_peered":"2024-03-09T15:11:37.464880+0000","last_clean":"2024-03-09T15:11:37.464880+0000","last_became_active":"2024-03-09T14:26:36.677953+0000","last_became_peered":"2024-03-09T14:26:36.677953+0000","last_unstale":"2024-03-09T15:11:37.464880+0000","last_undegraded":"2024-03-09T15:11:37.464880+0000","last_fullsized":"2024-03-09T15:11:37.464880+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:17:40.272125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1291,"num_read_kb":1290,"num_write":257,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'553","reported_seq":2041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.200467+0000","last_change":"2024-03-09T14:26:28.644942+0000","last_active":"2024-03-09T15:11:09.200467+0000","last_peered":"2024-03-09T15:11:09.200467+0000","last_clean":"2024-03-09T15:11:09.200467+0000","last_became_active":"2024-03-09T14:26:28.644628+0000","last_became_peered":"2024-03-09T14:26:28.644628+0000","last_unstale":"2024-03-09T15:11:09.200467+0000","last_undegraded":"2024-03-09T15:11:09.200467+0000","last_fullsized":"2024-03-09T15:11:09.200467+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2742,"num_read_kb":2524,"num_write":748,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'204","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.839766+0000","last_change":"2024-03-09T14:26:26.637200+0000","last_active":"2024-03-09T15:11:45.839766+0000","last_peered":"2024-03-09T15:11:45.839766+0000","last_clean":"2024-03-09T15:11:45.839766+0000","last_became_active":"2024-03-09T14:26:26.636600+0000","last_became_peered":"2024-03-09T14:26:26.636600+0000","last_unstale":"2024-03-09T15:11:45.839766+0000","last_undegraded":"2024-03-09T15:11:45.839766+0000","last_fullsized":"2024-03-09T15:11:45.839766+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:11:27.327284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":15859,"num_write":1037,"num_write_kb":26682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.563142+0000","last_change":"2024-03-09T14:26:30.651345+0000","last_active":"2024-03-09T15:07:41.563142+0000","last_peered":"2024-03-09T15:07:41.563142+0000","last_clean":"2024-03-09T15:07:41.563142+0000","last_became_active":"2024-03-09T14:26:30.650852+0000","last_became_peered":"2024-03-09T14:26:30.650852+0000","last_unstale":"2024-03-09T15:07:41.563142+0000","last_undegraded":"2024-03-09T15:07:41.563142+0000","last_fullsized":"2024-03-09T15:07:41.563142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:55:54.919531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'152","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.854030+0000","last_change":"2024-03-09T14:26:32.655600+0000","last_active":"2024-03-09T15:11:45.854030+0000","last_peered":"2024-03-09T15:11:45.854030+0000","last_clean":"2024-03-09T15:11:45.854030+0000","last_became_active":"2024-03-09T14:26:32.655220+0000","last_became_peered":"2024-03-09T14:26:32.655220+0000","last_unstale":"2024-03-09T15:11:45.854030+0000","last_undegraded":"2024-03-09T15:11:45.854030+0000","last_fullsized":"2024-03-09T15:11:45.854030+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6421,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":225,"num_write":106,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:06.580477+0000","last_change":"2024-03-09T14:26:34.673862+0000","last_active":"2024-03-09T15:09:06.580477+0000","last_peered":"2024-03-09T15:09:06.580477+0000","last_clean":"2024-03-09T15:09:06.580477+0000","last_became_active":"2024-03-09T14:26:34.673572+0000","last_became_peered":"2024-03-09T14:26:34.673572+0000","last_unstale":"2024-03-09T15:09:06.580477+0000","last_undegraded":"2024-03-09T15:09:06.580477+0000","last_fullsized":"2024-03-09T15:09:06.580477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:59.420732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'131","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:06.615978+0000","last_change":"2024-03-09T14:26:36.668917+0000","last_active":"2024-03-09T15:11:06.615978+0000","last_peered":"2024-03-09T15:11:06.615978+0000","last_clean":"2024-03-09T15:11:06.615978+0000","last_became_active":"2024-03-09T14:26:36.668616+0000","last_became_peered":"2024-03-09T14:26:36.668616+0000","last_unstale":"2024-03-09T15:11:06.615978+0000","last_undegraded":"2024-03-09T15:11:06.615978+0000","last_fullsized":"2024-03-09T15:11:06.615978+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":154,"num_write":316,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'645","reported_seq":2232,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.865830+0000","last_change":"2024-03-09T14:26:28.645899+0000","last_active":"2024-03-09T15:11:07.865830+0000","last_peered":"2024-03-09T15:11:07.865830+0000","last_clean":"2024-03-09T15:11:07.865830+0000","last_became_active":"2024-03-09T14:26:28.645626+0000","last_became_peered":"2024-03-09T14:26:28.645626+0000","last_unstale":"2024-03-09T15:11:07.865830+0000","last_undegraded":"2024-03-09T15:11:07.865830+0000","last_fullsized":"2024-03-09T15:11:07.865830+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":600,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:57.043642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3206,"num_read_kb":2874,"num_write":967,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'167","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.790243+0000","last_change":"2024-03-09T14:26:26.652363+0000","last_active":"2024-03-09T15:11:45.790243+0000","last_peered":"2024-03-09T15:11:45.790243+0000","last_clean":"2024-03-09T15:11:45.790243+0000","last_became_active":"2024-03-09T14:26:26.652050+0000","last_became_peered":"2024-03-09T14:26:26.652050+0000","last_unstale":"2024-03-09T15:11:45.790243+0000","last_undegraded":"2024-03-09T15:11:45.790243+0000","last_fullsized":"2024-03-09T15:11:45.790243+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:42.844197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3634858,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":329,"num_read_kb":46066,"num_write":939,"num_write_kb":31825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'424","reported_seq":2029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.131178+0000","last_change":"2024-03-09T14:26:28.652919+0000","last_active":"2024-03-09T15:11:37.131178+0000","last_peered":"2024-03-09T15:11:37.131178+0000","last_clean":"2024-03-09T15:11:37.131178+0000","last_became_active":"2024-03-09T14:26:28.652474+0000","last_became_peered":"2024-03-09T14:26:28.652474+0000","last_unstale":"2024-03-09T15:11:37.131178+0000","last_undegraded":"2024-03-09T15:11:37.131178+0000","last_fullsized":"2024-03-09T15:11:37.131178+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:16:37.419231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2338,"num_read_kb":2225,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'237","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.923970+0000","last_change":"2024-03-09T14:26:26.636278+0000","last_active":"2024-03-09T15:11:45.923970+0000","last_peered":"2024-03-09T15:11:45.923970+0000","last_clean":"2024-03-09T15:11:45.923970+0000","last_became_active":"2024-03-09T14:26:26.635943+0000","last_became_peered":"2024-03-09T14:26:26.635943+0000","last_unstale":"2024-03-09T15:11:45.923970+0000","last_undegraded":"2024-03-09T15:11:45.923970+0000","last_fullsized":"2024-03-09T15:11:45.923970+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:16.699434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048641,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":547,"num_read_kb":21035,"num_write":1141,"num_write_kb":21105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'402","reported_seq":1826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.431048+0000","last_change":"2024-03-09T14:26:28.646197+0000","last_active":"2024-03-09T15:11:04.431048+0000","last_peered":"2024-03-09T15:11:04.431048+0000","last_clean":"2024-03-09T15:11:04.431048+0000","last_became_active":"2024-03-09T14:26:28.645917+0000","last_became_peered":"2024-03-09T14:26:28.645917+0000","last_unstale":"2024-03-09T15:11:04.431048+0000","last_undegraded":"2024-03-09T15:11:04.431048+0000","last_fullsized":"2024-03-09T15:11:04.431048+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:35.149765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2143,"num_read_kb":1999,"num_write":476,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'197","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.880358+0000","last_change":"2024-03-09T14:26:26.648411+0000","last_active":"2024-03-09T15:11:45.880358+0000","last_peered":"2024-03-09T15:11:45.880358+0000","last_clean":"2024-03-09T15:11:45.880358+0000","last_became_active":"2024-03-09T14:26:26.648084+0000","last_became_peered":"2024-03-09T14:26:26.648084+0000","last_unstale":"2024-03-09T15:11:45.880358+0000","last_undegraded":"2024-03-09T15:11:45.880358+0000","last_fullsized":"2024-03-09T15:11:45.880358+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:33.823275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097599,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":455,"num_read_kb":30660,"num_write":1035,"num_write_kb":42042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'1285","reported_seq":2878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:27.537784+0000","last_change":"2024-03-09T14:26:28.647203+0000","last_active":"2024-03-09T15:09:27.537784+0000","last_peered":"2024-03-09T15:09:27.537784+0000","last_clean":"2024-03-09T15:09:27.537784+0000","last_became_active":"2024-03-09T14:26:28.646936+0000","last_became_peered":"2024-03-09T14:26:28.646936+0000","last_unstale":"2024-03-09T15:09:27.537784+0000","last_undegraded":"2024-03-09T15:09:27.537784+0000","last_fullsized":"2024-03-09T15:09:27.537784+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:30:25.079154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5472,"num_read_kb":4757,"num_write":1845,"num_write_kb":841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'173","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.911651+0000","last_change":"2024-03-09T14:26:26.632719+0000","last_active":"2024-03-09T15:11:45.911651+0000","last_peered":"2024-03-09T15:11:45.911651+0000","last_clean":"2024-03-09T15:11:45.911651+0000","last_became_active":"2024-03-09T14:26:26.632394+0000","last_became_peered":"2024-03-09T14:26:26.632394+0000","last_unstale":"2024-03-09T15:11:45.911651+0000","last_undegraded":"2024-03-09T15:11:45.911651+0000","last_fullsized":"2024-03-09T15:11:45.911651+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:11:31.631305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194317,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":61859,"num_write":999,"num_write_kb":24366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'709","reported_seq":2156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.186762+0000","last_change":"2024-03-09T14:26:28.656837+0000","last_active":"2024-03-09T15:10:42.186762+0000","last_peered":"2024-03-09T15:10:42.186762+0000","last_clean":"2024-03-09T15:10:42.186762+0000","last_became_active":"2024-03-09T14:26:28.655549+0000","last_became_peered":"2024-03-09T14:26:28.655549+0000","last_unstale":"2024-03-09T15:10:42.186762+0000","last_undegraded":"2024-03-09T15:10:42.186762+0000","last_fullsized":"2024-03-09T15:10:42.186762+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3228,"num_read_kb":2913,"num_write":936,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'248","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.945286+0000","last_change":"2024-03-09T14:26:26.641172+0000","last_active":"2024-03-09T15:11:45.945286+0000","last_peered":"2024-03-09T15:11:45.945286+0000","last_clean":"2024-03-09T15:11:45.945286+0000","last_became_active":"2024-03-09T14:26:26.640874+0000","last_became_peered":"2024-03-09T14:26:26.640874+0000","last_unstale":"2024-03-09T15:11:45.945286+0000","last_undegraded":"2024-03-09T15:11:45.945286+0000","last_fullsized":"2024-03-09T15:11:45.945286+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4477257,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":552,"num_read_kb":47489,"num_write":1247,"num_write_kb":60004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'342","reported_seq":1775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.336750+0000","last_change":"2024-03-09T14:26:28.645684+0000","last_active":"2024-03-09T15:10:45.336750+0000","last_peered":"2024-03-09T15:10:45.336750+0000","last_clean":"2024-03-09T15:10:45.336750+0000","last_became_active":"2024-03-09T14:26:28.645393+0000","last_became_peered":"2024-03-09T14:26:28.645393+0000","last_unstale":"2024-03-09T15:10:45.336750+0000","last_undegraded":"2024-03-09T15:10:45.336750+0000","last_fullsized":"2024-03-09T15:10:45.336750+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1972,"num_read_kb":1873,"num_write":396,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'185","reported_seq":818,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.978933+0000","last_change":"2024-03-09T14:26:26.631389+0000","last_active":"2024-03-09T15:11:45.978933+0000","last_peered":"2024-03-09T15:11:45.978933+0000","last_clean":"2024-03-09T15:11:45.978933+0000","last_became_active":"2024-03-09T14:26:26.631046+0000","last_became_peered":"2024-03-09T14:26:26.631046+0000","last_unstale":"2024-03-09T15:11:45.978933+0000","last_undegraded":"2024-03-09T15:11:45.978933+0000","last_fullsized":"2024-03-09T15:11:45.978933+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:11:06.737937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":463,"num_read_kb":18518,"num_write":1084,"num_write_kb":23654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'765","reported_seq":2187,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.200343+0000","last_change":"2024-03-09T14:26:28.652220+0000","last_active":"2024-03-09T15:11:09.200343+0000","last_peered":"2024-03-09T15:11:09.200343+0000","last_clean":"2024-03-09T15:11:09.200343+0000","last_became_active":"2024-03-09T14:26:28.651945+0000","last_became_peered":"2024-03-09T14:26:28.651945+0000","last_unstale":"2024-03-09T15:11:09.200343+0000","last_undegraded":"2024-03-09T15:11:09.200343+0000","last_fullsized":"2024-03-09T15:11:09.200343+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3422,"num_read_kb":3025,"num_write":1046,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'210","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.923678+0000","last_change":"2024-03-09T14:26:26.645774+0000","last_active":"2024-03-09T15:11:45.923678+0000","last_peered":"2024-03-09T15:11:45.923678+0000","last_clean":"2024-03-09T15:11:45.923678+0000","last_became_active":"2024-03-09T14:26:26.645379+0000","last_became_peered":"2024-03-09T14:26:26.645379+0000","last_unstale":"2024-03-09T15:11:45.923678+0000","last_undegraded":"2024-03-09T15:11:45.923678+0000","last_fullsized":"2024-03-09T15:11:45.923678+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:29:31.655184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2265,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":547,"num_read_kb":953,"num_write":1107,"num_write_kb":19452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'1201","reported_seq":2796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.336817+0000","last_change":"2024-03-09T14:26:28.652319+0000","last_active":"2024-03-09T15:10:35.336817+0000","last_peered":"2024-03-09T15:10:35.336817+0000","last_clean":"2024-03-09T15:10:35.336817+0000","last_became_active":"2024-03-09T14:26:28.651254+0000","last_became_peered":"2024-03-09T14:26:28.651254+0000","last_unstale":"2024-03-09T15:10:35.336817+0000","last_undegraded":"2024-03-09T15:10:35.336817+0000","last_fullsized":"2024-03-09T15:10:35.336817+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":1100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:17:36.798177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5174,"num_read_kb":4521,"num_write":1709,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'218","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.944024+0000","last_change":"2024-03-09T14:26:26.640461+0000","last_active":"2024-03-09T15:11:45.944024+0000","last_peered":"2024-03-09T15:11:45.944024+0000","last_clean":"2024-03-09T15:11:45.944024+0000","last_became_active":"2024-03-09T14:26:26.639719+0000","last_became_peered":"2024-03-09T14:26:26.639719+0000","last_unstale":"2024-03-09T15:11:45.944024+0000","last_undegraded":"2024-03-09T15:11:45.944024+0000","last_fullsized":"2024-03-09T15:11:45.944024+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3186960,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":530,"num_read_kb":50172,"num_write":1173,"num_write_kb":33138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1152","reported_seq":2678,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.124689+0000","last_change":"2024-03-09T14:26:28.648946+0000","last_active":"2024-03-09T15:11:37.124689+0000","last_peered":"2024-03-09T15:11:37.124689+0000","last_clean":"2024-03-09T15:11:37.124689+0000","last_became_active":"2024-03-09T14:26:28.648626+0000","last_became_peered":"2024-03-09T14:26:28.648626+0000","last_unstale":"2024-03-09T15:11:37.124689+0000","last_undegraded":"2024-03-09T15:11:37.124689+0000","last_fullsized":"2024-03-09T15:11:37.124689+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:23:27.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4796,"num_read_kb":4189,"num_write":1590,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'192","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.939246+0000","last_change":"2024-03-09T14:26:26.640526+0000","last_active":"2024-03-09T15:11:45.939246+0000","last_peered":"2024-03-09T15:11:45.939246+0000","last_clean":"2024-03-09T15:11:45.939246+0000","last_became_active":"2024-03-09T14:26:26.640157+0000","last_became_peered":"2024-03-09T14:26:26.640157+0000","last_unstale":"2024-03-09T15:11:45.939246+0000","last_undegraded":"2024-03-09T15:11:45.939246+0000","last_fullsized":"2024-03-09T15:11:45.939246+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:22.974524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":19261,"num_write":1003,"num_write_kb":28212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'708","reported_seq":2135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.613705+0000","last_change":"2024-03-09T14:26:28.650311+0000","last_active":"2024-03-09T15:10:51.613705+0000","last_peered":"2024-03-09T15:10:51.613705+0000","last_clean":"2024-03-09T15:10:51.613705+0000","last_became_active":"2024-03-09T14:26:28.650013+0000","last_became_peered":"2024-03-09T14:26:28.650013+0000","last_unstale":"2024-03-09T15:10:51.613705+0000","last_undegraded":"2024-03-09T15:10:51.613705+0000","last_fullsized":"2024-03-09T15:10:51.613705+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":600,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3189,"num_read_kb":2865,"num_write":935,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'212","reported_seq":858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.981234+0000","last_change":"2024-03-09T14:26:26.642035+0000","last_active":"2024-03-09T15:11:45.981234+0000","last_peered":"2024-03-09T15:11:45.981234+0000","last_clean":"2024-03-09T15:11:45.981234+0000","last_became_active":"2024-03-09T14:26:26.641737+0000","last_became_peered":"2024-03-09T14:26:26.641737+0000","last_unstale":"2024-03-09T15:11:45.981234+0000","last_undegraded":"2024-03-09T15:11:45.981234+0000","last_fullsized":"2024-03-09T15:11:45.981234+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262754,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":32584,"num_write":1138,"num_write_kb":28426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'421","reported_seq":2053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.552733+0000","last_change":"2024-03-09T14:26:28.644372+0000","last_active":"2024-03-09T15:10:54.552733+0000","last_peered":"2024-03-09T15:10:54.552733+0000","last_clean":"2024-03-09T15:10:54.552733+0000","last_became_active":"2024-03-09T14:26:28.644094+0000","last_became_peered":"2024-03-09T14:26:28.644094+0000","last_unstale":"2024-03-09T15:10:54.552733+0000","last_undegraded":"2024-03-09T15:10:54.552733+0000","last_fullsized":"2024-03-09T15:10:54.552733+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:42.631901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2230,"num_write":484,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'212","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.603129+0000","last_change":"2024-03-09T14:26:26.645771+0000","last_active":"2024-03-09T15:11:26.603129+0000","last_peered":"2024-03-09T15:11:26.603129+0000","last_clean":"2024-03-09T15:11:26.603129+0000","last_became_active":"2024-03-09T14:26:26.645413+0000","last_became_peered":"2024-03-09T14:26:26.645413+0000","last_unstale":"2024-03-09T15:11:26.603129+0000","last_undegraded":"2024-03-09T15:11:26.603129+0000","last_fullsized":"2024-03-09T15:11:26.603129+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:23:25.742745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262161,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":457,"num_read_kb":3495,"num_write":1054,"num_write_kb":12293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'790","reported_seq":2458,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.493713+0000","last_change":"2024-03-09T14:26:28.650961+0000","last_active":"2024-03-09T15:11:31.493713+0000","last_peered":"2024-03-09T15:11:31.493713+0000","last_clean":"2024-03-09T15:11:31.493713+0000","last_became_active":"2024-03-09T14:26:28.650629+0000","last_became_peered":"2024-03-09T14:26:28.650629+0000","last_unstale":"2024-03-09T15:11:31.493713+0000","last_undegraded":"2024-03-09T15:11:31.493713+0000","last_fullsized":"2024-03-09T15:11:31.493713+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3842,"num_read_kb":3483,"num_write":1039,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'234","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.875835+0000","last_change":"2024-03-09T14:26:26.644786+0000","last_active":"2024-03-09T15:11:45.875835+0000","last_peered":"2024-03-09T15:11:45.875835+0000","last_clean":"2024-03-09T15:11:45.875835+0000","last_became_active":"2024-03-09T14:26:26.644358+0000","last_became_peered":"2024-03-09T14:26:26.644358+0000","last_unstale":"2024-03-09T15:11:45.875835+0000","last_undegraded":"2024-03-09T15:11:45.875835+0000","last_fullsized":"2024-03-09T15:11:45.875835+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:25:50.487416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":7434,"num_write":1304,"num_write_kb":33527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'509","reported_seq":2075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.121732+0000","last_change":"2024-03-09T14:26:28.655751+0000","last_active":"2024-03-09T15:11:37.121732+0000","last_peered":"2024-03-09T15:11:37.121732+0000","last_clean":"2024-03-09T15:11:37.121732+0000","last_became_active":"2024-03-09T14:26:28.655438+0000","last_became_peered":"2024-03-09T14:26:28.655438+0000","last_unstale":"2024-03-09T15:11:37.121732+0000","last_undegraded":"2024-03-09T15:11:37.121732+0000","last_fullsized":"2024-03-09T15:11:37.121732+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:20:48.282049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2613,"num_read_kb":2408,"num_write":650,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'184","reported_seq":802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.808346+0000","last_change":"2024-03-09T14:26:26.649089+0000","last_active":"2024-03-09T15:11:45.808346+0000","last_peered":"2024-03-09T15:11:45.808346+0000","last_clean":"2024-03-09T15:11:45.808346+0000","last_became_active":"2024-03-09T14:26:26.648682+0000","last_became_peered":"2024-03-09T14:26:26.648682+0000","last_unstale":"2024-03-09T15:11:45.808346+0000","last_undegraded":"2024-03-09T15:11:45.808346+0000","last_fullsized":"2024-03-09T15:11:45.808346+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:54:12.434919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":448,"num_read_kb":6066,"num_write":1003,"num_write_kb":27510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'408","reported_seq":2014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.553857+0000","last_change":"2024-03-09T14:26:28.646581+0000","last_active":"2024-03-09T15:10:54.553857+0000","last_peered":"2024-03-09T15:10:54.553857+0000","last_clean":"2024-03-09T15:10:54.553857+0000","last_became_active":"2024-03-09T14:26:28.646239+0000","last_became_peered":"2024-03-09T14:26:28.646239+0000","last_unstale":"2024-03-09T15:10:54.553857+0000","last_undegraded":"2024-03-09T15:10:54.553857+0000","last_fullsized":"2024-03-09T15:10:54.553857+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:05.491938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2327,"num_read_kb":2213,"num_write":484,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'215","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.839993+0000","last_change":"2024-03-09T14:26:26.646103+0000","last_active":"2024-03-09T15:11:45.839993+0000","last_peered":"2024-03-09T15:11:45.839993+0000","last_clean":"2024-03-09T15:11:45.839993+0000","last_became_active":"2024-03-09T14:26:26.645230+0000","last_became_peered":"2024-03-09T14:26:26.645230+0000","last_unstale":"2024-03-09T15:11:45.839993+0000","last_undegraded":"2024-03-09T15:11:45.839993+0000","last_fullsized":"2024-03-09T15:11:45.839993+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:46:59.836355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":27386,"num_write":1086,"num_write_kb":24817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'342","reported_seq":1817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.490167+0000","last_change":"2024-03-09T14:26:28.653452+0000","last_active":"2024-03-09T15:11:31.490167+0000","last_peered":"2024-03-09T15:11:31.490167+0000","last_clean":"2024-03-09T15:11:31.490167+0000","last_became_active":"2024-03-09T14:26:28.653177+0000","last_became_peered":"2024-03-09T14:26:28.653177+0000","last_unstale":"2024-03-09T15:11:31.490167+0000","last_undegraded":"2024-03-09T15:11:31.490167+0000","last_fullsized":"2024-03-09T15:11:31.490167+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1954,"num_read_kb":1880,"num_write":380,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'196","reported_seq":800,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.831869+0000","last_change":"2024-03-09T14:26:26.637956+0000","last_active":"2024-03-09T15:11:45.831869+0000","last_peered":"2024-03-09T15:11:45.831869+0000","last_clean":"2024-03-09T15:11:45.831869+0000","last_became_active":"2024-03-09T14:26:26.637589+0000","last_became_peered":"2024-03-09T14:26:26.637589+0000","last_unstale":"2024-03-09T15:11:45.831869+0000","last_undegraded":"2024-03-09T15:11:45.831869+0000","last_fullsized":"2024-03-09T15:11:45.831869+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:33.711328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456529,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":381,"num_read_kb":13354,"num_write":1025,"num_write_kb":55720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'1151","reported_seq":2610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.127436+0000","last_change":"2024-03-09T14:26:28.655806+0000","last_active":"2024-03-09T15:11:37.127436+0000","last_peered":"2024-03-09T15:11:37.127436+0000","last_clean":"2024-03-09T15:11:37.127436+0000","last_became_active":"2024-03-09T14:26:28.655383+0000","last_became_peered":"2024-03-09T14:26:28.655383+0000","last_unstale":"2024-03-09T15:11:37.127436+0000","last_undegraded":"2024-03-09T15:11:37.127436+0000","last_fullsized":"2024-03-09T15:11:37.127436+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:09:15.464868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4791,"num_read_kb":4166,"num_write":1605,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'231","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.735943+0000","last_change":"2024-03-09T14:26:26.653398+0000","last_active":"2024-03-09T15:11:45.735943+0000","last_peered":"2024-03-09T15:11:45.735943+0000","last_clean":"2024-03-09T15:11:45.735943+0000","last_became_active":"2024-03-09T14:26:26.652576+0000","last_became_peered":"2024-03-09T14:26:26.652576+0000","last_unstale":"2024-03-09T15:11:45.735943+0000","last_undegraded":"2024-03-09T15:11:45.735943+0000","last_fullsized":"2024-03-09T15:11:45.735943+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:27:29.674744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460219,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":654,"num_read_kb":5204,"num_write":1022,"num_write_kb":18451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'327","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.939815+0000","last_change":"2024-03-09T14:27:03.716194+0000","last_active":"2024-03-09T15:11:45.939815+0000","last_peered":"2024-03-09T15:11:45.939815+0000","last_clean":"2024-03-09T15:11:45.939815+0000","last_became_active":"2024-03-09T14:27:03.715719+0000","last_became_peered":"2024-03-09T14:27:03.715719+0000","last_unstale":"2024-03-09T15:11:45.939815+0000","last_undegraded":"2024-03-09T15:11:45.939815+0000","last_fullsized":"2024-03-09T15:11:45.939815+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:14.860709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388665,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":851,"num_read_kb":60318,"num_write":1289,"num_write_kb":31608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'792","reported_seq":2406,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.338529+0000","last_change":"2024-03-09T14:26:28.649429+0000","last_active":"2024-03-09T15:10:35.338529+0000","last_peered":"2024-03-09T15:10:35.338529+0000","last_clean":"2024-03-09T15:10:35.338529+0000","last_became_active":"2024-03-09T14:26:28.649178+0000","last_became_peered":"2024-03-09T14:26:28.649178+0000","last_unstale":"2024-03-09T15:10:35.338529+0000","last_undegraded":"2024-03-09T15:10:35.338529+0000","last_fullsized":"2024-03-09T15:10:35.338529+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:22:23.602537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3684,"num_read_kb":3311,"num_write":1055,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'191","reported_seq":870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.878870+0000","last_change":"2024-03-09T14:27:03.721922+0000","last_active":"2024-03-09T15:11:45.878870+0000","last_peered":"2024-03-09T15:11:45.878870+0000","last_clean":"2024-03-09T15:11:45.878870+0000","last_became_active":"2024-03-09T14:27:03.721595+0000","last_became_peered":"2024-03-09T14:27:03.721595+0000","last_unstale":"2024-03-09T15:11:45.878870+0000","last_undegraded":"2024-03-09T15:11:45.878870+0000","last_fullsized":"2024-03-09T15:11:45.878870+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:37:54.615568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815977,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":112993,"num_write":1053,"num_write_kb":48480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'387","reported_seq":2043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.590524+0000","last_change":"2024-03-09T14:26:28.645372+0000","last_active":"2024-03-09T15:10:36.590524+0000","last_peered":"2024-03-09T15:10:36.590524+0000","last_clean":"2024-03-09T15:10:36.590524+0000","last_became_active":"2024-03-09T14:26:28.645067+0000","last_became_peered":"2024-03-09T14:26:28.645067+0000","last_unstale":"2024-03-09T15:10:36.590524+0000","last_undegraded":"2024-03-09T15:10:36.590524+0000","last_fullsized":"2024-03-09T15:10:36.590524+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:44:56.178003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2475,"num_read_kb":2383,"num_write":438,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5887,"num_read_kb":4246,"num_write":2185,"num_write_kb":841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1217,"ondisk_log_size":1217,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":12946,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":15495,"num_read_kb":15279,"num_write":16228,"num_write_kb":4747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":507904,"data_stored":25892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1762,"ondisk_log_size":1762,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":440,"ondisk_log_size":440,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":322743,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8037,"num_read_kb":10144,"num_write":5663,"num_write_kb":2860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1593,"num_read_kb":1897,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":195183,"num_read_kb":178329,"num_write":51691,"num_write_kb":17736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":121,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3837,"ondisk_log_size":3837,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":155728130,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":241,"num_whiteouts":0,"num_read":32390,"num_read_kb":2319225,"num_write":69850,"num_write_kb":2158516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":235536384,"data_stored":235536384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4154,"ondisk_log_size":4154,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":164063,"num_write":179,"num_write_kb":125047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":167,"num_read_kb":183429,"num_write":179,"num_write_kb":125047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575401,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320868,"kb_used_data":50812,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94050972,"statfs":{"total":96636764160,"available":96308195328,"internally_reserved":0,"allocated":52031488,"data_stored":50062803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575401,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279852,"kb_used_data":23780,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94091988,"statfs":{"total":96636764160,"available":96350195712,"internally_reserved":0,"allocated":24350720,"data_stored":22401655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575401,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139368,"kb_used_data":53972,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94232472,"statfs":{"total":96636764160,"available":96494051328,"internally_reserved":0,"allocated":55267328,"data_stored":53270043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575400,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121228,"kb_used_data":35884,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94250612,"statfs":{"total":96636764160,"available":96512626688,"internally_reserved":0,"allocated":36745216,"data_stored":34850722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575401,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272768,"kb_used_data":38820,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94099072,"statfs":{"total":96636764160,"available":96357449728,"internally_reserved":0,"allocated":39751680,"data_stored":37775689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575399,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":178124,"kb_used_data":106692,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94193716,"statfs":{"total":96636764160,"available":96454365184,"internally_reserved":0,"allocated":109252608,"data_stored":107314051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575400,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164540,"kb_used_data":43128,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94207300,"statfs":{"total":96636764160,"available":96468275200,"internally_reserved":0,"allocated":44163072,"data_stored":42229674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575400,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280228,"kb_used_data":42144,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94091612,"statfs":{"total":96636764160,"available":96349810688,"internally_reserved":0,"allocated":43155456,"data_stored":41182927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24678400,"data_stored":24678400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34705408,"data_stored":34705408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29638656,"data_stored":29638656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25006080,"data_stored":25006080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":31522816,"data_stored":31522816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36306944,"data_stored":36306944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":19070976,"data_stored":19070976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":34607104,"data_stored":34607104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:11:52.627 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.627 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.627 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.627 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.627 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.628 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.628 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.628 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.628 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.628 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.628 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.629 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.629 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.629 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.629 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.629 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.629 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.629 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.630 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.630 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.630 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.630 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.631 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.631 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.631 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.631 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.631 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.631 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.631 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.632 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.632 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.632 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.632 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.632 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.632 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.633 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.633 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.633 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.633 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.633 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.633 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.634 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.634 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.634 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.634 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.634 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.634 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.635 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.635 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.635 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.635 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.635 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.635 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.636 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.636 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.636 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.636 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.636 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.636 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.636 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.637 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.637 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.637 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.637 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.637 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.637 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.637 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.638 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.638 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.638 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.638 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.638 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.638 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.639 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.639 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.639 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.639 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.639 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.639 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.639 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.640 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.640 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.640 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.640 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.640 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.640 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.641 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.641 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.641 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.641 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.641 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.641 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.641 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.642 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.642 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.642 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.642 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.642 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.642 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.643 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.643 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.643 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.643 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.643 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.643 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.644 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.644 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.644 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.644 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.644 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.644 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.645 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.645 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.645 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.645 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.645 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.645 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.645 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.646 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.646 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.646 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.646 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.646 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.646 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.647 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.647 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.647 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.647 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.647 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.647 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.648 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.648 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.648 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.648 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.648 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.648 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.648 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.649 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.649 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.649 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.649 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.649 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.649 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.650 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.650 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.650 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.650 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.650 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.650 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.651 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.651 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.651 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.651 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.651 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.651 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.651 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.652 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.652 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.652 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.652 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.652 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.652 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.652 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.653 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.653 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.653 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.653 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.653 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.653 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.654 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.654 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.654 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.654 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.654 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.654 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.655 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.655 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.655 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.655 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.655 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.655 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.655 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.656 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.656 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.656 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.656 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.656 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.656 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.657 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.657 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.657 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.657 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.657 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.657 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.658 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.658 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.658 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.658 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.658 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.658 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.659 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.659 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.659 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.659 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.659 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.659 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.660 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.660 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.660 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.660 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.660 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.660 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.660 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.661 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.661 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.661 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.661 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.661 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.661 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.662 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.662 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.662 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.662 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.662 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.662 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.663 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.663 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.663 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-09T14:26:12.541311+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=12, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.663 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.663 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.663 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.663 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.664 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.664 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.664 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.664 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.664 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.664 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.665 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.665 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.665 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.665 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.665 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.665 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.665 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.666 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.666 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.666 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.666 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.666 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.667 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.667 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.667 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.667 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.667 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.667 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.667 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.668 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.668 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.668 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.668 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.668 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.668 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.669 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.669 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.669 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.669 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.669 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.669 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.669 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.670 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.670 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.670 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.670 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.670 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.670 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.671 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.671 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.671 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.671 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.671 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.671 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.672 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.672 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.672 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.672 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.672 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.672 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.672 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.673 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.673 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.673 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.673 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.673 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.673 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.674 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.674 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.674 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.674 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.674 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.674 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.675 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.675 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.675 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.675 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.675 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.675 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.676 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.676 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.676 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.676 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.676 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.676 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.676 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.677 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.677 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.677 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.677 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.677 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.677 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.678 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.678 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.678 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.678 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.678 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.678 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.679 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.679 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.679 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.679 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.679 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.679 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.679 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.680 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.680 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.680 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.680 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.680 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.680 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.681 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.681 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.681 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.681 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.681 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.681 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.682 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.682 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.682 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.682 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.682 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.682 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.683 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.683 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.683 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.683 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.683 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.683 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.684 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.684 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.684 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.684 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.684 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.684 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.684 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.685 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.685 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.685 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.685 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.685 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.685 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.686 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.686 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.686 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.686 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.686 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.686 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.687 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.687 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.687 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.687 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.687 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.687 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.687 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.688 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.688 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.688 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.688 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.688 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.688 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.689 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.689 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:11:52.689 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-09T15:12:12.690 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:12:13.036 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:12:13.049 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-03-09T15:12:13.051 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":1637,"stamp":"2024-03-09T15:12:11.543883+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":190210338,"num_objects":676,"num_object_clones":0,"num_object_copies":1593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":676,"num_whiteouts":0,"num_read":259041,"num_read_kb":2876724,"num_write":146172,"num_write_kb":2437235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":166,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":125607,"num_omap_keys":328,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13832,"ondisk_log_size":13832,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1709176,"kb_used_data":329784,"kb_used_omap":12,"kb_used_meta":1379315,"kb_avail":753265544,"statfs":{"total":773094113280,"available":771343917056,"internally_reserved":0,"allocated":337698816,"data_stored":322084334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1412419120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":120882,"num_omap_keys":317,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005155"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.595983+0000","last_change":"2024-03-09T14:50:35.506808+0000","last_active":"2024-03-09T15:10:36.595983+0000","last_peered":"2024-03-09T15:10:36.595983+0000","last_clean":"2024-03-09T15:10:36.595983+0000","last_became_active":"2024-03-09T14:50:35.506543+0000","last_became_peered":"2024-03-09T14:50:35.506543+0000","last_unstale":"2024-03-09T15:10:36.595983+0000","last_undegraded":"2024-03-09T15:10:36.595983+0000","last_fullsized":"2024-03-09T15:10:36.595983+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'7","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.954275+0000","last_change":"2024-03-09T14:38:37.436681+0000","last_active":"2024-03-09T15:11:45.954275+0000","last_peered":"2024-03-09T15:11:45.954275+0000","last_clean":"2024-03-09T15:11:45.954275+0000","last_became_active":"2024-03-09T14:38:37.436381+0000","last_became_peered":"2024-03-09T14:38:37.436381+0000","last_unstale":"2024-03-09T15:11:45.954275+0000","last_undegraded":"2024-03-09T15:11:45.954275+0000","last_fullsized":"2024-03-09T15:11:45.954275+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'4","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.112913+0000","last_change":"2024-03-09T15:11:51.112934+0000","last_active":"2024-03-09T15:11:51.112913+0000","last_peered":"2024-03-09T15:11:51.112913+0000","last_clean":"2024-03-09T15:11:51.112913+0000","last_became_active":"2024-03-09T14:38:34.418748+0000","last_became_peered":"2024-03-09T14:38:34.418748+0000","last_unstale":"2024-03-09T15:11:51.112913+0000","last_undegraded":"2024-03-09T15:11:51.112913+0000","last_fullsized":"2024-03-09T15:11:51.112913+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-03-09T15:11:51.112840+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-03-09T15:11:51.112840+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.112840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:50.837065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'22","reported_seq":112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.476708+0000","last_change":"2024-03-09T15:11:52.476729+0000","last_active":"2024-03-09T15:11:52.476708+0000","last_peered":"2024-03-09T15:11:52.476708+0000","last_clean":"2024-03-09T15:11:52.476708+0000","last_became_active":"2024-03-09T14:35:41.121412+0000","last_became_peered":"2024-03-09T14:35:41.121412+0000","last_unstale":"2024-03-09T15:11:52.476708+0000","last_undegraded":"2024-03-09T15:11:52.476708+0000","last_fullsized":"2024-03-09T15:11:52.476708+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-03-09T15:11:52.476636+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-03-09T15:11:52.476636+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.476636+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:24:35.562139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":67,"num_write":35,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.577535+0000","last_change":"2024-03-09T14:50:35.507193+0000","last_active":"2024-03-09T15:10:36.577535+0000","last_peered":"2024-03-09T15:10:36.577535+0000","last_clean":"2024-03-09T15:10:36.577535+0000","last_became_active":"2024-03-09T14:50:35.506905+0000","last_became_peered":"2024-03-09T14:50:35.506905+0000","last_unstale":"2024-03-09T15:10:36.577535+0000","last_undegraded":"2024-03-09T15:10:36.577535+0000","last_fullsized":"2024-03-09T15:10:36.577535+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.887380+0000","last_change":"2024-03-09T14:38:37.440992+0000","last_active":"2024-03-09T15:11:45.887380+0000","last_peered":"2024-03-09T15:11:45.887380+0000","last_clean":"2024-03-09T15:11:45.887380+0000","last_became_active":"2024-03-09T14:38:37.440733+0000","last_became_peered":"2024-03-09T14:38:37.440733+0000","last_unstale":"2024-03-09T15:11:45.887380+0000","last_undegraded":"2024-03-09T15:11:45.887380+0000","last_fullsized":"2024-03-09T15:11:45.887380+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.046428+0000","last_change":"2024-03-09T15:11:56.046457+0000","last_active":"2024-03-09T15:11:56.046428+0000","last_peered":"2024-03-09T15:11:56.046428+0000","last_clean":"2024-03-09T15:11:56.046428+0000","last_became_active":"2024-03-09T14:38:34.425629+0000","last_became_peered":"2024-03-09T14:38:34.425629+0000","last_unstale":"2024-03-09T15:11:56.046428+0000","last_undegraded":"2024-03-09T15:11:56.046428+0000","last_fullsized":"2024-03-09T15:11:56.046428+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:11:56.046346+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:11:56.046346+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.046346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:00:15.566941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'52","reported_seq":177,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.935611+0000","last_change":"2024-03-09T14:35:41.118142+0000","last_active":"2024-03-09T15:11:49.935611+0000","last_peered":"2024-03-09T15:11:49.935611+0000","last_clean":"2024-03-09T15:11:49.935611+0000","last_became_active":"2024-03-09T14:35:41.117858+0000","last_became_peered":"2024-03-09T14:35:41.117858+0000","last_unstale":"2024-03-09T15:11:49.935611+0000","last_undegraded":"2024-03-09T15:11:49.935611+0000","last_fullsized":"2024-03-09T15:11:49.935611+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:40.099960+0000","last_clean_scrub_stamp":"2024-03-09T14:35:40.099960+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":156,"num_write":85,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:56.605770+0000","last_change":"2024-03-09T14:50:35.506417+0000","last_active":"2024-03-09T15:09:56.605770+0000","last_peered":"2024-03-09T15:09:56.605770+0000","last_clean":"2024-03-09T15:09:56.605770+0000","last_became_active":"2024-03-09T14:50:35.506136+0000","last_became_peered":"2024-03-09T14:50:35.506136+0000","last_unstale":"2024-03-09T15:09:56.605770+0000","last_undegraded":"2024-03-09T15:09:56.605770+0000","last_fullsized":"2024-03-09T15:09:56.605770+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"261'9","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.018124+0000","last_change":"2024-03-09T14:38:37.443197+0000","last_active":"2024-03-09T15:11:49.018124+0000","last_peered":"2024-03-09T15:11:49.018124+0000","last_clean":"2024-03-09T15:11:49.018124+0000","last_became_active":"2024-03-09T14:38:37.442906+0000","last_became_peered":"2024-03-09T14:38:37.442906+0000","last_unstale":"2024-03-09T15:11:49.018124+0000","last_undegraded":"2024-03-09T15:11:49.018124+0000","last_fullsized":"2024-03-09T15:11:49.018124+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":8196,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"261'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:46.578734+0000","last_change":"2024-03-09T14:38:34.425940+0000","last_active":"2024-03-09T15:10:46.578734+0000","last_peered":"2024-03-09T15:10:46.578734+0000","last_clean":"2024-03-09T15:10:46.578734+0000","last_became_active":"2024-03-09T14:38:34.425459+0000","last_became_peered":"2024-03-09T14:38:34.425459+0000","last_unstale":"2024-03-09T15:10:46.578734+0000","last_undegraded":"2024-03-09T15:10:46.578734+0000","last_fullsized":"2024-03-09T15:10:46.578734+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"261'16","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.432500+0000","last_change":"2024-03-09T15:11:49.432531+0000","last_active":"2024-03-09T15:11:49.432500+0000","last_peered":"2024-03-09T15:11:49.432500+0000","last_clean":"2024-03-09T15:11:49.432500+0000","last_became_active":"2024-03-09T14:35:41.123171+0000","last_became_peered":"2024-03-09T14:35:41.123171+0000","last_unstale":"2024-03-09T15:11:49.432500+0000","last_undegraded":"2024-03-09T15:11:49.432500+0000","last_fullsized":"2024-03-09T15:11:49.432500+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'16","last_scrub_stamp":"2024-03-09T15:11:49.432421+0000","last_deep_scrub":"261'16","last_deep_scrub_stamp":"2024-03-09T15:11:49.432421+0000","last_clean_scrub_stamp":"2024-03-09T15:11:49.432421+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:33:27.802202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":56,"num_write":23,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:56.689372+0000","last_change":"2024-03-09T14:50:35.503396+0000","last_active":"2024-03-09T15:09:56.689372+0000","last_peered":"2024-03-09T15:09:56.689372+0000","last_clean":"2024-03-09T15:09:56.689372+0000","last_became_active":"2024-03-09T14:50:35.503090+0000","last_became_peered":"2024-03-09T14:50:35.503090+0000","last_unstale":"2024-03-09T15:09:56.689372+0000","last_undegraded":"2024-03-09T15:09:56.689372+0000","last_fullsized":"2024-03-09T15:09:56.689372+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'2","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.095477+0000","last_change":"2024-03-09T15:12:02.095521+0000","last_active":"2024-03-09T15:12:02.095477+0000","last_peered":"2024-03-09T15:12:02.095477+0000","last_clean":"2024-03-09T15:12:02.095477+0000","last_became_active":"2024-03-09T14:38:37.432089+0000","last_became_peered":"2024-03-09T14:38:37.432089+0000","last_unstale":"2024-03-09T15:12:02.095477+0000","last_undegraded":"2024-03-09T15:12:02.095477+0000","last_fullsized":"2024-03-09T15:12:02.095477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:02.095344+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:02.095344+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.095344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:06:26.800542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.165978+0000","last_change":"2024-03-09T15:11:54.165978+0000","last_active":"2024-03-09T15:11:54.165978+0000","last_peered":"2024-03-09T15:11:54.165978+0000","last_clean":"2024-03-09T15:11:54.165978+0000","last_became_active":"2024-03-09T14:38:34.417024+0000","last_became_peered":"2024-03-09T14:38:34.417024+0000","last_unstale":"2024-03-09T15:11:54.165978+0000","last_undegraded":"2024-03-09T15:11:54.165978+0000","last_fullsized":"2024-03-09T15:11:54.165978+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:54.165851+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:54.165851+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.165851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:07:17.408333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'52","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.159931+0000","last_change":"2024-03-09T15:11:57.159971+0000","last_active":"2024-03-09T15:11:57.159931+0000","last_peered":"2024-03-09T15:11:57.159931+0000","last_clean":"2024-03-09T15:11:57.159931+0000","last_became_active":"2024-03-09T14:35:41.118960+0000","last_became_peered":"2024-03-09T14:35:41.118960+0000","last_unstale":"2024-03-09T15:11:57.159931+0000","last_undegraded":"2024-03-09T15:11:57.159931+0000","last_fullsized":"2024-03-09T15:11:57.159931+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-03-09T15:11:57.159825+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-03-09T15:11:57.159825+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.159825+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:17:22.468521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":146,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.693833+0000","last_change":"2024-03-09T14:50:35.513378+0000","last_active":"2024-03-09T15:10:36.693833+0000","last_peered":"2024-03-09T15:10:36.693833+0000","last_clean":"2024-03-09T15:10:36.693833+0000","last_became_active":"2024-03-09T14:50:35.512534+0000","last_became_peered":"2024-03-09T14:50:35.512534+0000","last_unstale":"2024-03-09T15:10:36.693833+0000","last_undegraded":"2024-03-09T15:10:36.693833+0000","last_fullsized":"2024-03-09T15:10:36.693833+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'6","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.591559+0000","last_change":"2024-03-09T14:38:37.437102+0000","last_active":"2024-03-09T15:10:06.591559+0000","last_peered":"2024-03-09T15:10:06.591559+0000","last_clean":"2024-03-09T15:10:06.591559+0000","last_became_active":"2024-03-09T14:38:37.436829+0000","last_became_peered":"2024-03-09T14:38:37.436829+0000","last_unstale":"2024-03-09T15:10:06.591559+0000","last_undegraded":"2024-03-09T15:10:06.591559+0000","last_fullsized":"2024-03-09T15:10:06.591559+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'6","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.433509+0000","last_change":"2024-03-09T15:11:59.433537+0000","last_active":"2024-03-09T15:11:59.433509+0000","last_peered":"2024-03-09T15:11:59.433509+0000","last_clean":"2024-03-09T15:11:59.433509+0000","last_became_active":"2024-03-09T14:38:34.418209+0000","last_became_peered":"2024-03-09T14:38:34.418209+0000","last_unstale":"2024-03-09T15:11:59.433509+0000","last_undegraded":"2024-03-09T15:11:59.433509+0000","last_fullsized":"2024-03-09T15:11:59.433509+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:11:59.433411+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:11:59.433411+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.433411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:32.542902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6194,"num_write":6,"num_write_kb":5170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'22","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.103062+0000","last_change":"2024-03-09T15:11:52.103111+0000","last_active":"2024-03-09T15:11:52.103062+0000","last_peered":"2024-03-09T15:11:52.103062+0000","last_clean":"2024-03-09T15:11:52.103062+0000","last_became_active":"2024-03-09T14:35:41.123715+0000","last_became_peered":"2024-03-09T14:35:41.123715+0000","last_unstale":"2024-03-09T15:11:52.103062+0000","last_undegraded":"2024-03-09T15:11:52.103062+0000","last_fullsized":"2024-03-09T15:11:52.103062+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-03-09T15:11:52.102969+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-03-09T15:11:52.102969+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.102969+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:05:50.481258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":62,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.587558+0000","last_change":"2024-03-09T14:50:35.510228+0000","last_active":"2024-03-09T15:11:26.587558+0000","last_peered":"2024-03-09T15:11:26.587558+0000","last_clean":"2024-03-09T15:11:26.587558+0000","last_became_active":"2024-03-09T14:50:35.509938+0000","last_became_peered":"2024-03-09T14:50:35.509938+0000","last_unstale":"2024-03-09T15:11:26.587558+0000","last_undegraded":"2024-03-09T15:11:26.587558+0000","last_fullsized":"2024-03-09T15:11:26.587558+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:01.606532+0000","last_change":"2024-03-09T14:38:37.439503+0000","last_active":"2024-03-09T15:10:01.606532+0000","last_peered":"2024-03-09T15:10:01.606532+0000","last_clean":"2024-03-09T15:10:01.606532+0000","last_became_active":"2024-03-09T14:38:37.439120+0000","last_became_peered":"2024-03-09T14:38:37.439120+0000","last_unstale":"2024-03-09T15:10:01.606532+0000","last_undegraded":"2024-03-09T15:10:01.606532+0000","last_fullsized":"2024-03-09T15:10:01.606532+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.212446+0000","last_change":"2024-03-09T15:11:58.212474+0000","last_active":"2024-03-09T15:11:58.212446+0000","last_peered":"2024-03-09T15:11:58.212446+0000","last_clean":"2024-03-09T15:11:58.212446+0000","last_became_active":"2024-03-09T14:38:34.418553+0000","last_became_peered":"2024-03-09T14:38:34.418553+0000","last_unstale":"2024-03-09T15:11:58.212446+0000","last_undegraded":"2024-03-09T15:11:58.212446+0000","last_fullsized":"2024-03-09T15:11:58.212446+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:11:58.212359+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:11:58.212359+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.212359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:05.878755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":6,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'47","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.218080+0000","last_change":"2024-03-09T15:11:52.218122+0000","last_active":"2024-03-09T15:11:52.218080+0000","last_peered":"2024-03-09T15:11:52.218080+0000","last_clean":"2024-03-09T15:11:52.218080+0000","last_became_active":"2024-03-09T14:35:41.123785+0000","last_became_peered":"2024-03-09T14:35:41.123785+0000","last_unstale":"2024-03-09T15:11:52.218080+0000","last_undegraded":"2024-03-09T15:11:52.218080+0000","last_fullsized":"2024-03-09T15:11:52.218080+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-03-09T15:11:52.217928+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-03-09T15:11:52.217928+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.217928+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:33.071186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":141,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.733539+0000","last_change":"2024-03-09T14:50:35.500344+0000","last_active":"2024-03-09T15:10:36.733539+0000","last_peered":"2024-03-09T15:10:36.733539+0000","last_clean":"2024-03-09T15:10:36.733539+0000","last_became_active":"2024-03-09T14:50:35.499942+0000","last_became_peered":"2024-03-09T14:50:35.499942+0000","last_unstale":"2024-03-09T15:10:36.733539+0000","last_undegraded":"2024-03-09T15:10:36.733539+0000","last_fullsized":"2024-03-09T15:10:36.733539+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:06.615753+0000","last_change":"2024-03-09T14:38:37.438111+0000","last_active":"2024-03-09T15:11:06.615753+0000","last_peered":"2024-03-09T15:11:06.615753+0000","last_clean":"2024-03-09T15:11:06.615753+0000","last_became_active":"2024-03-09T14:38:37.437714+0000","last_became_peered":"2024-03-09T14:38:37.437714+0000","last_unstale":"2024-03-09T15:11:06.615753+0000","last_undegraded":"2024-03-09T15:11:06.615753+0000","last_fullsized":"2024-03-09T15:11:06.615753+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.028592+0000","last_change":"2024-03-09T15:12:06.028618+0000","last_active":"2024-03-09T15:12:06.028592+0000","last_peered":"2024-03-09T15:12:06.028592+0000","last_clean":"2024-03-09T15:12:06.028592+0000","last_became_active":"2024-03-09T14:38:34.420232+0000","last_became_peered":"2024-03-09T14:38:34.420232+0000","last_unstale":"2024-03-09T15:12:06.028592+0000","last_undegraded":"2024-03-09T15:12:06.028592+0000","last_fullsized":"2024-03-09T15:12:06.028592+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:06.028501+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:06.028501+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.028501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:00:04.885173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'24","reported_seq":113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.465788+0000","last_change":"2024-03-09T15:11:53.465788+0000","last_active":"2024-03-09T15:11:53.465788+0000","last_peered":"2024-03-09T15:11:53.465788+0000","last_clean":"2024-03-09T15:11:53.465788+0000","last_became_active":"2024-03-09T14:35:41.121566+0000","last_became_peered":"2024-03-09T14:35:41.121566+0000","last_unstale":"2024-03-09T15:11:53.465788+0000","last_undegraded":"2024-03-09T15:11:53.465788+0000","last_fullsized":"2024-03-09T15:11:53.465788+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-03-09T15:11:53.465689+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-03-09T15:11:53.465689+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.465689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:20.850766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.733582+0000","last_change":"2024-03-09T14:50:35.501732+0000","last_active":"2024-03-09T15:10:36.733582+0000","last_peered":"2024-03-09T15:10:36.733582+0000","last_clean":"2024-03-09T15:10:36.733582+0000","last_became_active":"2024-03-09T14:50:35.501422+0000","last_became_peered":"2024-03-09T14:50:35.501422+0000","last_unstale":"2024-03-09T15:10:36.733582+0000","last_undegraded":"2024-03-09T15:10:36.733582+0000","last_fullsized":"2024-03-09T15:10:36.733582+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"264'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.887438+0000","last_change":"2024-03-09T14:38:37.438996+0000","last_active":"2024-03-09T15:11:45.887438+0000","last_peered":"2024-03-09T15:11:45.887438+0000","last_clean":"2024-03-09T15:11:45.887438+0000","last_became_active":"2024-03-09T14:38:37.438685+0000","last_became_peered":"2024-03-09T14:38:37.438685+0000","last_unstale":"2024-03-09T15:11:45.887438+0000","last_undegraded":"2024-03-09T15:11:45.887438+0000","last_fullsized":"2024-03-09T15:11:45.887438+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.779194+0000","last_change":"2024-03-09T14:38:34.422906+0000","last_active":"2024-03-09T15:11:45.779194+0000","last_peered":"2024-03-09T15:11:45.779194+0000","last_clean":"2024-03-09T15:11:45.779194+0000","last_became_active":"2024-03-09T14:38:34.422607+0000","last_became_peered":"2024-03-09T14:38:34.422607+0000","last_unstale":"2024-03-09T15:11:45.779194+0000","last_undegraded":"2024-03-09T15:11:45.779194+0000","last_fullsized":"2024-03-09T15:11:45.779194+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'68","reported_seq":233,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.058888+0000","last_change":"2024-03-09T15:11:53.058888+0000","last_active":"2024-03-09T15:11:53.058888+0000","last_peered":"2024-03-09T15:11:53.058888+0000","last_clean":"2024-03-09T15:11:53.058888+0000","last_became_active":"2024-03-09T14:35:41.122898+0000","last_became_peered":"2024-03-09T14:35:41.122898+0000","last_unstale":"2024-03-09T15:11:53.058888+0000","last_undegraded":"2024-03-09T15:11:53.058888+0000","last_fullsized":"2024-03-09T15:11:53.058888+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'68","last_scrub_stamp":"2024-03-09T15:11:53.058785+0000","last_deep_scrub":"264'68","last_deep_scrub_stamp":"2024-03-09T15:11:53.058785+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.058785+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:18:11.685762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":238,"num_write":108,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.588485+0000","last_change":"2024-03-09T14:50:35.508995+0000","last_active":"2024-03-09T15:11:36.588485+0000","last_peered":"2024-03-09T15:11:36.588485+0000","last_clean":"2024-03-09T15:11:36.588485+0000","last_became_active":"2024-03-09T14:50:35.508726+0000","last_became_peered":"2024-03-09T14:50:35.508726+0000","last_unstale":"2024-03-09T15:11:36.588485+0000","last_undegraded":"2024-03-09T15:11:36.588485+0000","last_fullsized":"2024-03-09T15:11:36.588485+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'8","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.954362+0000","last_change":"2024-03-09T14:38:37.437565+0000","last_active":"2024-03-09T15:11:45.954362+0000","last_peered":"2024-03-09T15:11:45.954362+0000","last_clean":"2024-03-09T15:11:45.954362+0000","last_became_active":"2024-03-09T14:38:37.437039+0000","last_became_peered":"2024-03-09T14:38:37.437039+0000","last_unstale":"2024-03-09T15:11:45.954362+0000","last_undegraded":"2024-03-09T15:11:45.954362+0000","last_fullsized":"2024-03-09T15:11:45.954362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10340,"num_write":8,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"264'6","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.314908+0000","last_change":"2024-03-09T15:12:03.314950+0000","last_active":"2024-03-09T15:12:03.314908+0000","last_peered":"2024-03-09T15:12:03.314908+0000","last_clean":"2024-03-09T15:12:03.314908+0000","last_became_active":"2024-03-09T14:38:34.418269+0000","last_became_peered":"2024-03-09T14:38:34.418269+0000","last_unstale":"2024-03-09T15:12:03.314908+0000","last_undegraded":"2024-03-09T15:12:03.314908+0000","last_fullsized":"2024-03-09T15:12:03.314908+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:12:03.314754+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:12:03.314754+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.314754+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:24:52.192811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'38","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.441547+0000","last_change":"2024-03-09T15:11:50.441547+0000","last_active":"2024-03-09T15:11:50.441547+0000","last_peered":"2024-03-09T15:11:50.441547+0000","last_clean":"2024-03-09T15:11:50.441547+0000","last_became_active":"2024-03-09T14:35:41.122257+0000","last_became_peered":"2024-03-09T14:35:41.122257+0000","last_unstale":"2024-03-09T15:11:50.441547+0000","last_undegraded":"2024-03-09T15:11:50.441547+0000","last_fullsized":"2024-03-09T15:11:50.441547+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-03-09T15:11:50.441402+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-03-09T15:11:50.441402+0000","last_clean_scrub_stamp":"2024-03-09T15:11:50.441402+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:44.539083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":116,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.583825+0000","last_change":"2024-03-09T14:50:35.503872+0000","last_active":"2024-03-09T15:11:36.583825+0000","last_peered":"2024-03-09T15:11:36.583825+0000","last_clean":"2024-03-09T15:11:36.583825+0000","last_became_active":"2024-03-09T14:50:35.503595+0000","last_became_peered":"2024-03-09T14:50:35.503595+0000","last_unstale":"2024-03-09T15:11:36.583825+0000","last_undegraded":"2024-03-09T15:11:36.583825+0000","last_fullsized":"2024-03-09T15:11:36.583825+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'5","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.169969+0000","last_change":"2024-03-09T15:11:58.170016+0000","last_active":"2024-03-09T15:11:58.169969+0000","last_peered":"2024-03-09T15:11:58.169969+0000","last_clean":"2024-03-09T15:11:58.169969+0000","last_became_active":"2024-03-09T14:38:37.429956+0000","last_became_peered":"2024-03-09T14:38:37.429956+0000","last_unstale":"2024-03-09T15:11:58.169969+0000","last_undegraded":"2024-03-09T15:11:58.169969+0000","last_fullsized":"2024-03-09T15:11:58.169969+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:11:58.169839+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:11:58.169839+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.169839+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:56:13.470034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":11264,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.097777+0000","last_change":"2024-03-09T15:11:55.097802+0000","last_active":"2024-03-09T15:11:55.097777+0000","last_peered":"2024-03-09T15:11:55.097777+0000","last_clean":"2024-03-09T15:11:55.097777+0000","last_became_active":"2024-03-09T14:38:34.421678+0000","last_became_peered":"2024-03-09T14:38:34.421678+0000","last_unstale":"2024-03-09T15:11:55.097777+0000","last_undegraded":"2024-03-09T15:11:55.097777+0000","last_fullsized":"2024-03-09T15:11:55.097777+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:55.097675+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:55.097675+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.097675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:06.648401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'25","reported_seq":108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.192215+0000","last_change":"2024-03-09T15:11:55.192215+0000","last_active":"2024-03-09T15:11:55.192215+0000","last_peered":"2024-03-09T15:11:55.192215+0000","last_clean":"2024-03-09T15:11:55.192215+0000","last_became_active":"2024-03-09T14:35:41.120818+0000","last_became_peered":"2024-03-09T14:35:41.120818+0000","last_unstale":"2024-03-09T15:11:55.192215+0000","last_undegraded":"2024-03-09T15:11:55.192215+0000","last_fullsized":"2024-03-09T15:11:55.192215+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-03-09T15:11:55.192100+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-03-09T15:11:55.192100+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.192100+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:56:16.097474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":54,"num_write":56,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.616967+0000","last_change":"2024-03-09T14:50:35.500497+0000","last_active":"2024-03-09T15:11:36.616967+0000","last_peered":"2024-03-09T15:11:36.616967+0000","last_clean":"2024-03-09T15:11:36.616967+0000","last_became_active":"2024-03-09T14:50:35.500196+0000","last_became_peered":"2024-03-09T14:50:35.500196+0000","last_unstale":"2024-03-09T15:11:36.616967+0000","last_undegraded":"2024-03-09T15:11:36.616967+0000","last_fullsized":"2024-03-09T15:11:36.616967+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.062952+0000","last_change":"2024-03-09T15:12:10.062995+0000","last_active":"2024-03-09T15:12:10.062952+0000","last_peered":"2024-03-09T15:12:10.062952+0000","last_clean":"2024-03-09T15:12:10.062952+0000","last_became_active":"2024-03-09T14:38:37.436884+0000","last_became_peered":"2024-03-09T14:38:37.436884+0000","last_unstale":"2024-03-09T15:12:10.062952+0000","last_undegraded":"2024-03-09T15:12:10.062952+0000","last_fullsized":"2024-03-09T15:12:10.062952+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:10.062853+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:10.062853+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.062853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:49:41.996594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:01.573892+0000","last_change":"2024-03-09T14:38:34.420272+0000","last_active":"2024-03-09T15:10:01.573892+0000","last_peered":"2024-03-09T15:10:01.573892+0000","last_clean":"2024-03-09T15:10:01.573892+0000","last_became_active":"2024-03-09T14:38:34.420002+0000","last_became_peered":"2024-03-09T14:38:34.420002+0000","last_unstale":"2024-03-09T15:10:01.573892+0000","last_undegraded":"2024-03-09T15:10:01.573892+0000","last_fullsized":"2024-03-09T15:10:01.573892+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'34","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.947754+0000","last_change":"2024-03-09T15:12:05.947778+0000","last_active":"2024-03-09T15:12:05.947754+0000","last_peered":"2024-03-09T15:12:05.947754+0000","last_clean":"2024-03-09T15:12:05.947754+0000","last_became_active":"2024-03-09T14:35:41.116430+0000","last_became_peered":"2024-03-09T14:35:41.116430+0000","last_unstale":"2024-03-09T15:12:05.947754+0000","last_undegraded":"2024-03-09T15:12:05.947754+0000","last_fullsized":"2024-03-09T15:12:05.947754+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-03-09T15:12:05.947669+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-03-09T15:12:05.947669+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.947669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:39:25.396644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":94,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.604642+0000","last_change":"2024-03-09T14:50:35.507650+0000","last_active":"2024-03-09T15:11:36.604642+0000","last_peered":"2024-03-09T15:11:36.604642+0000","last_clean":"2024-03-09T15:11:36.604642+0000","last_became_active":"2024-03-09T14:50:35.506969+0000","last_became_peered":"2024-03-09T14:50:35.506969+0000","last_unstale":"2024-03-09T15:11:36.604642+0000","last_undegraded":"2024-03-09T15:11:36.604642+0000","last_fullsized":"2024-03-09T15:11:36.604642+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.778031+0000","last_change":"2024-03-09T14:38:37.436281+0000","last_active":"2024-03-09T15:11:45.778031+0000","last_peered":"2024-03-09T15:11:45.778031+0000","last_clean":"2024-03-09T15:11:45.778031+0000","last_became_active":"2024-03-09T14:38:37.435960+0000","last_became_peered":"2024-03-09T14:38:37.435960+0000","last_unstale":"2024-03-09T15:11:45.778031+0000","last_undegraded":"2024-03-09T15:11:45.778031+0000","last_fullsized":"2024-03-09T15:11:45.778031+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'7","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.768923+0000","last_change":"2024-03-09T14:38:34.420846+0000","last_active":"2024-03-09T15:11:45.768923+0000","last_peered":"2024-03-09T15:11:45.768923+0000","last_clean":"2024-03-09T15:11:45.768923+0000","last_became_active":"2024-03-09T14:38:34.420571+0000","last_became_peered":"2024-03-09T14:38:34.420571+0000","last_unstale":"2024-03-09T15:11:45.768923+0000","last_undegraded":"2024-03-09T15:11:45.768923+0000","last_fullsized":"2024-03-09T15:11:45.768923+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'36","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.028960+0000","last_change":"2024-03-09T15:12:04.029007+0000","last_active":"2024-03-09T15:12:04.028960+0000","last_peered":"2024-03-09T15:12:04.028960+0000","last_clean":"2024-03-09T15:12:04.028960+0000","last_became_active":"2024-03-09T14:35:41.121060+0000","last_became_peered":"2024-03-09T14:35:41.121060+0000","last_unstale":"2024-03-09T15:12:04.028960+0000","last_undegraded":"2024-03-09T15:12:04.028960+0000","last_fullsized":"2024-03-09T15:12:04.028960+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-03-09T15:12:04.028848+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-03-09T15:12:04.028848+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.028848+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:40:13.122787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":100,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:56.689470+0000","last_change":"2024-03-09T14:50:35.504223+0000","last_active":"2024-03-09T15:09:56.689470+0000","last_peered":"2024-03-09T15:09:56.689470+0000","last_clean":"2024-03-09T15:09:56.689470+0000","last_became_active":"2024-03-09T14:50:35.503970+0000","last_became_peered":"2024-03-09T14:50:35.503970+0000","last_unstale":"2024-03-09T15:09:56.689470+0000","last_undegraded":"2024-03-09T15:09:56.689470+0000","last_fullsized":"2024-03-09T15:09:56.689470+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.953901+0000","last_change":"2024-03-09T14:38:37.438872+0000","last_active":"2024-03-09T15:11:45.953901+0000","last_peered":"2024-03-09T15:11:45.953901+0000","last_clean":"2024-03-09T15:11:45.953901+0000","last_became_active":"2024-03-09T14:38:37.438604+0000","last_became_peered":"2024-03-09T14:38:37.438604+0000","last_unstale":"2024-03-09T15:11:45.953901+0000","last_undegraded":"2024-03-09T15:11:45.953901+0000","last_fullsized":"2024-03-09T15:11:45.953901+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:16.491314+0000","last_change":"2024-03-09T14:38:34.421755+0000","last_active":"2024-03-09T15:11:16.491314+0000","last_peered":"2024-03-09T15:11:16.491314+0000","last_clean":"2024-03-09T15:11:16.491314+0000","last_became_active":"2024-03-09T14:38:34.421476+0000","last_became_peered":"2024-03-09T14:38:34.421476+0000","last_unstale":"2024-03-09T15:11:16.491314+0000","last_undegraded":"2024-03-09T15:11:16.491314+0000","last_fullsized":"2024-03-09T15:11:16.491314+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'115","reported_seq":397,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.153883+0000","last_change":"2024-03-09T15:11:59.153935+0000","last_active":"2024-03-09T15:11:59.153883+0000","last_peered":"2024-03-09T15:11:59.153883+0000","last_clean":"2024-03-09T15:11:59.153883+0000","last_became_active":"2024-03-09T14:35:41.125114+0000","last_became_peered":"2024-03-09T14:35:41.125114+0000","last_unstale":"2024-03-09T15:11:59.153883+0000","last_undegraded":"2024-03-09T15:11:59.153883+0000","last_fullsized":"2024-03-09T15:11:59.153883+0000","mapping_epoch":251,"log_start":"264'100","ondisk_log_start":"264'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-03-09T15:11:59.153761+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-03-09T15:11:59.153761+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.153761+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:13:38.381151+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":488,"num_write":144,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4176,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:56.586201+0000","last_change":"2024-03-09T14:50:35.510923+0000","last_active":"2024-03-09T15:09:56.586201+0000","last_peered":"2024-03-09T15:09:56.586201+0000","last_clean":"2024-03-09T15:09:56.586201+0000","last_became_active":"2024-03-09T14:50:35.510598+0000","last_became_peered":"2024-03-09T14:50:35.510598+0000","last_unstale":"2024-03-09T15:09:56.586201+0000","last_undegraded":"2024-03-09T15:09:56.586201+0000","last_fullsized":"2024-03-09T15:09:56.586201+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:16.586508+0000","last_change":"2024-03-09T14:38:37.439640+0000","last_active":"2024-03-09T15:11:16.586508+0000","last_peered":"2024-03-09T15:11:16.586508+0000","last_clean":"2024-03-09T15:11:16.586508+0000","last_became_active":"2024-03-09T14:38:37.439360+0000","last_became_peered":"2024-03-09T14:38:37.439360+0000","last_unstale":"2024-03-09T15:11:16.586508+0000","last_undegraded":"2024-03-09T15:11:16.586508+0000","last_fullsized":"2024-03-09T15:11:16.586508+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.165524+0000","last_change":"2024-03-09T15:11:54.165560+0000","last_active":"2024-03-09T15:11:54.165524+0000","last_peered":"2024-03-09T15:11:54.165524+0000","last_clean":"2024-03-09T15:11:54.165524+0000","last_became_active":"2024-03-09T14:38:34.419467+0000","last_became_peered":"2024-03-09T14:38:34.419467+0000","last_unstale":"2024-03-09T15:11:54.165524+0000","last_undegraded":"2024-03-09T15:11:54.165524+0000","last_fullsized":"2024-03-09T15:11:54.165524+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:11:54.165424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:11:54.165424+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.165424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:20:22.550276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'15","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.415399+0000","last_change":"2024-03-09T15:11:56.415425+0000","last_active":"2024-03-09T15:11:56.415399+0000","last_peered":"2024-03-09T15:11:56.415399+0000","last_clean":"2024-03-09T15:11:56.415399+0000","last_became_active":"2024-03-09T14:35:41.118591+0000","last_became_peered":"2024-03-09T14:35:41.118591+0000","last_unstale":"2024-03-09T15:11:56.415399+0000","last_undegraded":"2024-03-09T15:11:56.415399+0000","last_fullsized":"2024-03-09T15:11:56.415399+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'15","last_scrub_stamp":"2024-03-09T15:11:56.415294+0000","last_deep_scrub":"264'15","last_deep_scrub_stamp":"2024-03-09T15:11:56.415294+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.415294+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:22:01.480650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":42,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:41.598025+0000","last_change":"2024-03-09T14:50:35.503951+0000","last_active":"2024-03-09T15:11:41.598025+0000","last_peered":"2024-03-09T15:11:41.598025+0000","last_clean":"2024-03-09T15:11:41.598025+0000","last_became_active":"2024-03-09T14:50:35.503274+0000","last_became_peered":"2024-03-09T14:50:35.503274+0000","last_unstale":"2024-03-09T15:11:41.598025+0000","last_undegraded":"2024-03-09T15:11:41.598025+0000","last_fullsized":"2024-03-09T15:11:41.598025+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'6","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.104713+0000","last_change":"2024-03-09T15:12:06.104765+0000","last_active":"2024-03-09T15:12:06.104713+0000","last_peered":"2024-03-09T15:12:06.104713+0000","last_clean":"2024-03-09T15:12:06.104713+0000","last_became_active":"2024-03-09T14:38:37.436078+0000","last_became_peered":"2024-03-09T14:38:37.436078+0000","last_unstale":"2024-03-09T15:12:06.104713+0000","last_undegraded":"2024-03-09T15:12:06.104713+0000","last_fullsized":"2024-03-09T15:12:06.104713+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:12:06.104603+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:12:06.104603+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.104603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:59:01.145657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'6","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.849434+0000","last_change":"2024-03-09T14:38:34.420240+0000","last_active":"2024-03-09T15:11:45.849434+0000","last_peered":"2024-03-09T15:11:45.849434+0000","last_clean":"2024-03-09T15:11:45.849434+0000","last_became_active":"2024-03-09T14:38:34.419935+0000","last_became_peered":"2024-03-09T14:38:34.419935+0000","last_unstale":"2024-03-09T15:11:45.849434+0000","last_undegraded":"2024-03-09T15:11:45.849434+0000","last_fullsized":"2024-03-09T15:11:45.849434+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7208,"num_write":6,"num_write_kb":7208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'26","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.111431+0000","last_change":"2024-03-09T15:11:52.111489+0000","last_active":"2024-03-09T15:11:52.111431+0000","last_peered":"2024-03-09T15:11:52.111431+0000","last_clean":"2024-03-09T15:11:52.111431+0000","last_became_active":"2024-03-09T14:35:41.116852+0000","last_became_peered":"2024-03-09T14:35:41.116852+0000","last_unstale":"2024-03-09T15:11:52.111431+0000","last_undegraded":"2024-03-09T15:11:52.111431+0000","last_fullsized":"2024-03-09T15:11:52.111431+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-03-09T15:11:52.111320+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-03-09T15:11:52.111320+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.111320+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:02:00.553764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:09:56.689444+0000","last_change":"2024-03-09T14:50:35.509510+0000","last_active":"2024-03-09T15:09:56.689444+0000","last_peered":"2024-03-09T15:09:56.689444+0000","last_clean":"2024-03-09T15:09:56.689444+0000","last_became_active":"2024-03-09T14:50:35.509202+0000","last_became_peered":"2024-03-09T14:50:35.509202+0000","last_unstale":"2024-03-09T15:09:56.689444+0000","last_undegraded":"2024-03-09T15:09:56.689444+0000","last_fullsized":"2024-03-09T15:09:56.689444+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.952329+0000","last_change":"2024-03-09T14:38:37.441897+0000","last_active":"2024-03-09T15:11:45.952329+0000","last_peered":"2024-03-09T15:11:45.952329+0000","last_clean":"2024-03-09T15:11:45.952329+0000","last_became_active":"2024-03-09T14:38:37.441554+0000","last_became_peered":"2024-03-09T14:38:37.441554+0000","last_unstale":"2024-03-09T15:11:45.952329+0000","last_undegraded":"2024-03-09T15:11:45.952329+0000","last_fullsized":"2024-03-09T15:11:45.952329+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.954016+0000","last_change":"2024-03-09T14:38:34.424750+0000","last_active":"2024-03-09T15:11:45.954016+0000","last_peered":"2024-03-09T15:11:45.954016+0000","last_clean":"2024-03-09T15:11:45.954016+0000","last_became_active":"2024-03-09T14:38:34.424507+0000","last_became_peered":"2024-03-09T14:38:34.424507+0000","last_unstale":"2024-03-09T15:11:45.954016+0000","last_undegraded":"2024-03-09T15:11:45.954016+0000","last_fullsized":"2024-03-09T15:11:45.954016+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'52","reported_seq":178,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.134229+0000","last_change":"2024-03-09T15:11:59.134272+0000","last_active":"2024-03-09T15:11:59.134229+0000","last_peered":"2024-03-09T15:11:59.134229+0000","last_clean":"2024-03-09T15:11:59.134229+0000","last_became_active":"2024-03-09T14:35:41.116932+0000","last_became_peered":"2024-03-09T14:35:41.116932+0000","last_unstale":"2024-03-09T15:11:59.134229+0000","last_undegraded":"2024-03-09T15:11:59.134229+0000","last_fullsized":"2024-03-09T15:11:59.134229+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-03-09T15:11:59.134102+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-03-09T15:11:59.134102+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.134102+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:37.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":147,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:11.574874+0000","last_change":"2024-03-09T14:50:35.498350+0000","last_active":"2024-03-09T15:10:11.574874+0000","last_peered":"2024-03-09T15:10:11.574874+0000","last_clean":"2024-03-09T15:10:11.574874+0000","last_became_active":"2024-03-09T14:50:35.498045+0000","last_became_peered":"2024-03-09T14:50:35.498045+0000","last_unstale":"2024-03-09T15:10:11.574874+0000","last_undegraded":"2024-03-09T15:10:11.574874+0000","last_fullsized":"2024-03-09T15:10:11.574874+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.685468+0000","last_change":"2024-03-09T14:38:37.437345+0000","last_active":"2024-03-09T15:11:45.685468+0000","last_peered":"2024-03-09T15:11:45.685468+0000","last_clean":"2024-03-09T15:11:45.685468+0000","last_became_active":"2024-03-09T14:38:37.436672+0000","last_became_peered":"2024-03-09T14:38:37.436672+0000","last_unstale":"2024-03-09T15:11:45.685468+0000","last_undegraded":"2024-03-09T15:11:45.685468+0000","last_fullsized":"2024-03-09T15:11:45.685468+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'11","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.086237+0000","last_change":"2024-03-09T15:11:57.086271+0000","last_active":"2024-03-09T15:11:57.086237+0000","last_peered":"2024-03-09T15:11:57.086237+0000","last_clean":"2024-03-09T15:11:57.086237+0000","last_became_active":"2024-03-09T14:38:34.423136+0000","last_became_peered":"2024-03-09T14:38:34.423136+0000","last_unstale":"2024-03-09T15:11:57.086237+0000","last_undegraded":"2024-03-09T15:11:57.086237+0000","last_fullsized":"2024-03-09T15:11:57.086237+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-03-09T15:11:57.086146+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-03-09T15:11:57.086146+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.086146+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:08:25.289761+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'29","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.181901+0000","last_change":"2024-03-09T15:11:56.181925+0000","last_active":"2024-03-09T15:11:56.181901+0000","last_peered":"2024-03-09T15:11:56.181901+0000","last_clean":"2024-03-09T15:11:56.181901+0000","last_became_active":"2024-03-09T14:35:41.119901+0000","last_became_peered":"2024-03-09T14:35:41.119901+0000","last_unstale":"2024-03-09T15:11:56.181901+0000","last_undegraded":"2024-03-09T15:11:56.181901+0000","last_fullsized":"2024-03-09T15:11:56.181901+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-03-09T15:11:56.181805+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-03-09T15:11:56.181805+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.181805+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:32.492795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":86,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.735667+0000","last_change":"2024-03-09T14:50:35.510602+0000","last_active":"2024-03-09T15:10:51.735667+0000","last_peered":"2024-03-09T15:10:51.735667+0000","last_clean":"2024-03-09T15:10:51.735667+0000","last_became_active":"2024-03-09T14:50:35.510330+0000","last_became_peered":"2024-03-09T14:50:35.510330+0000","last_unstale":"2024-03-09T15:10:51.735667+0000","last_undegraded":"2024-03-09T15:10:51.735667+0000","last_fullsized":"2024-03-09T15:10:51.735667+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"261'9","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.596046+0000","last_change":"2024-03-09T14:39:04.870290+0000","last_active":"2024-03-09T15:10:36.596046+0000","last_peered":"2024-03-09T15:10:36.596046+0000","last_clean":"2024-03-09T15:10:36.596046+0000","last_became_active":"2024-03-09T14:39:04.819697+0000","last_became_peered":"2024-03-09T14:39:04.819697+0000","last_unstale":"2024-03-09T15:10:36.596046+0000","last_undegraded":"2024-03-09T15:10:36.596046+0000","last_fullsized":"2024-03-09T15:10:36.596046+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":4098,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.d","version":"264'10","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.752035+0000","last_change":"2024-03-09T15:11:50.752089+0000","last_active":"2024-03-09T15:11:50.752035+0000","last_peered":"2024-03-09T15:11:50.752035+0000","last_clean":"2024-03-09T15:11:50.752035+0000","last_became_active":"2024-03-09T14:38:34.416475+0000","last_became_peered":"2024-03-09T14:38:34.416475+0000","last_unstale":"2024-03-09T15:11:50.752035+0000","last_undegraded":"2024-03-09T15:11:50.752035+0000","last_fullsized":"2024-03-09T15:11:50.752035+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-03-09T15:11:50.751954+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-03-09T15:11:50.751954+0000","last_clean_scrub_stamp":"2024-03-09T15:11:50.751954+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:13:41.632453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":13,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'38","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.323693+0000","last_change":"2024-03-09T15:11:55.323720+0000","last_active":"2024-03-09T15:11:55.323693+0000","last_peered":"2024-03-09T15:11:55.323693+0000","last_clean":"2024-03-09T15:11:55.323693+0000","last_became_active":"2024-03-09T14:35:41.119890+0000","last_became_peered":"2024-03-09T14:35:41.119890+0000","last_unstale":"2024-03-09T15:11:55.323693+0000","last_undegraded":"2024-03-09T15:11:55.323693+0000","last_fullsized":"2024-03-09T15:11:55.323693+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-03-09T15:11:55.323577+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-03-09T15:11:55.323577+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.323577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:32:34.891547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":99,"num_write":64,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.607269+0000","last_change":"2024-03-09T14:50:35.503867+0000","last_active":"2024-03-09T15:10:06.607269+0000","last_peered":"2024-03-09T15:10:06.607269+0000","last_clean":"2024-03-09T15:10:06.607269+0000","last_became_active":"2024-03-09T14:50:35.503207+0000","last_became_peered":"2024-03-09T14:50:35.503207+0000","last_unstale":"2024-03-09T15:10:06.607269+0000","last_undegraded":"2024-03-09T15:10:06.607269+0000","last_fullsized":"2024-03-09T15:10:06.607269+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.947755+0000","last_change":"2024-03-09T15:11:59.947805+0000","last_active":"2024-03-09T15:11:59.947755+0000","last_peered":"2024-03-09T15:11:59.947755+0000","last_clean":"2024-03-09T15:11:59.947755+0000","last_became_active":"2024-03-09T14:38:37.438507+0000","last_became_peered":"2024-03-09T14:38:37.438507+0000","last_unstale":"2024-03-09T15:11:59.947755+0000","last_undegraded":"2024-03-09T15:11:59.947755+0000","last_fullsized":"2024-03-09T15:11:59.947755+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:59.947646+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:59.947646+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.947646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:49:38.139594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"261'2","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.416764+0000","last_change":"2024-03-09T15:12:03.416790+0000","last_active":"2024-03-09T15:12:03.416764+0000","last_peered":"2024-03-09T15:12:03.416764+0000","last_clean":"2024-03-09T15:12:03.416764+0000","last_became_active":"2024-03-09T14:38:34.419043+0000","last_became_peered":"2024-03-09T14:38:34.419043+0000","last_unstale":"2024-03-09T15:12:03.416764+0000","last_undegraded":"2024-03-09T15:12:03.416764+0000","last_fullsized":"2024-03-09T15:12:03.416764+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:12:03.416671+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:12:03.416671+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.416671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:13.207851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'89","reported_seq":342,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.286986+0000","last_change":"2024-03-09T15:11:55.287018+0000","last_active":"2024-03-09T15:11:55.286986+0000","last_peered":"2024-03-09T15:11:55.286986+0000","last_clean":"2024-03-09T15:11:55.286986+0000","last_became_active":"2024-03-09T14:35:41.117590+0000","last_became_peered":"2024-03-09T14:35:41.117590+0000","last_unstale":"2024-03-09T15:11:55.286986+0000","last_undegraded":"2024-03-09T15:11:55.286986+0000","last_fullsized":"2024-03-09T15:11:55.286986+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'89","last_scrub_stamp":"2024-03-09T15:11:55.286893+0000","last_deep_scrub":"264'89","last_deep_scrub_stamp":"2024-03-09T15:11:55.286893+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.286893+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:09.078407+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":440,"num_write":100,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4491,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.729316+0000","last_change":"2024-03-09T14:50:35.509165+0000","last_active":"2024-03-09T15:10:06.729316+0000","last_peered":"2024-03-09T15:10:06.729316+0000","last_clean":"2024-03-09T15:10:06.729316+0000","last_became_active":"2024-03-09T14:50:35.508832+0000","last_became_peered":"2024-03-09T14:50:35.508832+0000","last_unstale":"2024-03-09T15:10:06.729316+0000","last_undegraded":"2024-03-09T15:10:06.729316+0000","last_fullsized":"2024-03-09T15:10:06.729316+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'6","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.718904+0000","last_change":"2024-03-09T14:38:37.439624+0000","last_active":"2024-03-09T15:11:45.718904+0000","last_peered":"2024-03-09T15:11:45.718904+0000","last_clean":"2024-03-09T15:11:45.718904+0000","last_became_active":"2024-03-09T14:38:37.439177+0000","last_became_peered":"2024-03-09T14:38:37.439177+0000","last_unstale":"2024-03-09T15:11:45.718904+0000","last_undegraded":"2024-03-09T15:11:45.718904+0000","last_fullsized":"2024-03-09T15:11:45.718904+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.077556+0000","last_change":"2024-03-09T15:11:51.077579+0000","last_active":"2024-03-09T15:11:51.077556+0000","last_peered":"2024-03-09T15:11:51.077556+0000","last_clean":"2024-03-09T15:11:51.077556+0000","last_became_active":"2024-03-09T14:38:34.419461+0000","last_became_peered":"2024-03-09T14:38:34.419461+0000","last_unstale":"2024-03-09T15:11:51.077556+0000","last_undegraded":"2024-03-09T15:11:51.077556+0000","last_fullsized":"2024-03-09T15:11:51.077556+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:51.077473+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:51.077473+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.077473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:06:44.961094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'58","reported_seq":201,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.923615+0000","last_change":"2024-03-09T15:12:03.923641+0000","last_active":"2024-03-09T15:12:03.923615+0000","last_peered":"2024-03-09T15:12:03.923615+0000","last_clean":"2024-03-09T15:12:03.923615+0000","last_became_active":"2024-03-09T14:35:41.115769+0000","last_became_peered":"2024-03-09T14:35:41.115769+0000","last_unstale":"2024-03-09T15:12:03.923615+0000","last_undegraded":"2024-03-09T15:12:03.923615+0000","last_fullsized":"2024-03-09T15:12:03.923615+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'58","last_scrub_stamp":"2024-03-09T15:12:03.923518+0000","last_deep_scrub":"264'58","last_deep_scrub_stamp":"2024-03-09T15:12:03.923518+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.923518+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:51:21.138456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":187,"num_write":89,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.695746+0000","last_change":"2024-03-09T14:50:35.512842+0000","last_active":"2024-03-09T15:10:51.695746+0000","last_peered":"2024-03-09T15:10:51.695746+0000","last_clean":"2024-03-09T15:10:51.695746+0000","last_became_active":"2024-03-09T14:50:35.512515+0000","last_became_peered":"2024-03-09T14:50:35.512515+0000","last_unstale":"2024-03-09T15:10:51.695746+0000","last_undegraded":"2024-03-09T15:10:51.695746+0000","last_fullsized":"2024-03-09T15:10:51.695746+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:06.615815+0000","last_change":"2024-03-09T14:38:37.437989+0000","last_active":"2024-03-09T15:11:06.615815+0000","last_peered":"2024-03-09T15:11:06.615815+0000","last_clean":"2024-03-09T15:11:06.615815+0000","last_became_active":"2024-03-09T14:38:37.437674+0000","last_became_peered":"2024-03-09T14:38:37.437674+0000","last_unstale":"2024-03-09T15:11:06.615815+0000","last_undegraded":"2024-03-09T15:11:06.615815+0000","last_fullsized":"2024-03-09T15:11:06.615815+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'11","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.443513+0000","last_change":"2024-03-09T15:11:55.443557+0000","last_active":"2024-03-09T15:11:55.443513+0000","last_peered":"2024-03-09T15:11:55.443513+0000","last_clean":"2024-03-09T15:11:55.443513+0000","last_became_active":"2024-03-09T14:38:34.416635+0000","last_became_peered":"2024-03-09T14:38:34.416635+0000","last_unstale":"2024-03-09T15:11:55.443513+0000","last_undegraded":"2024-03-09T15:11:55.443513+0000","last_fullsized":"2024-03-09T15:11:55.443513+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-03-09T15:11:55.443427+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-03-09T15:11:55.443427+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.443427+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:28:32.324995+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'78","reported_seq":253,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.439208+0000","last_change":"2024-03-09T15:11:57.439251+0000","last_active":"2024-03-09T15:11:57.439208+0000","last_peered":"2024-03-09T15:11:57.439208+0000","last_clean":"2024-03-09T15:11:57.439208+0000","last_became_active":"2024-03-09T14:35:41.113283+0000","last_became_peered":"2024-03-09T14:35:41.113283+0000","last_unstale":"2024-03-09T15:11:57.439208+0000","last_undegraded":"2024-03-09T15:11:57.439208+0000","last_fullsized":"2024-03-09T15:11:57.439208+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'78","last_scrub_stamp":"2024-03-09T15:11:57.439095+0000","last_deep_scrub":"264'78","last_deep_scrub_stamp":"2024-03-09T15:11:57.439095+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.439095+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:21:29.929734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":352,"num_read_kb":252,"num_write":133,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.735729+0000","last_change":"2024-03-09T14:50:35.509538+0000","last_active":"2024-03-09T15:10:51.735729+0000","last_peered":"2024-03-09T15:10:51.735729+0000","last_clean":"2024-03-09T15:10:51.735729+0000","last_became_active":"2024-03-09T14:50:35.509248+0000","last_became_peered":"2024-03-09T14:50:35.509248+0000","last_unstale":"2024-03-09T15:10:51.735729+0000","last_undegraded":"2024-03-09T15:10:51.735729+0000","last_fullsized":"2024-03-09T15:10:51.735729+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.080140+0000","last_change":"2024-03-09T15:12:05.080203+0000","last_active":"2024-03-09T15:12:05.080140+0000","last_peered":"2024-03-09T15:12:05.080140+0000","last_clean":"2024-03-09T15:12:05.080140+0000","last_became_active":"2024-03-09T14:38:37.432007+0000","last_became_peered":"2024-03-09T14:38:37.432007+0000","last_unstale":"2024-03-09T15:12:05.080140+0000","last_undegraded":"2024-03-09T15:12:05.080140+0000","last_fullsized":"2024-03-09T15:12:05.080140+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:12:05.080028+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:12:05.080028+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.080028+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:16:23.673108+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"261'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.059541+0000","last_change":"2024-03-09T15:11:50.059591+0000","last_active":"2024-03-09T15:11:50.059541+0000","last_peered":"2024-03-09T15:11:50.059541+0000","last_clean":"2024-03-09T15:11:50.059541+0000","last_became_active":"2024-03-09T14:38:34.419582+0000","last_became_peered":"2024-03-09T14:38:34.419582+0000","last_unstale":"2024-03-09T15:11:50.059541+0000","last_undegraded":"2024-03-09T15:11:50.059541+0000","last_fullsized":"2024-03-09T15:11:50.059541+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:11:50.059454+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:11:50.059454+0000","last_clean_scrub_stamp":"2024-03-09T15:11:50.059454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:11.962230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"261'10","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.067831+0000","last_change":"2024-03-09T15:12:02.067857+0000","last_active":"2024-03-09T15:12:02.067831+0000","last_peered":"2024-03-09T15:12:02.067831+0000","last_clean":"2024-03-09T15:12:02.067831+0000","last_became_active":"2024-03-09T14:35:41.122670+0000","last_became_peered":"2024-03-09T14:35:41.122670+0000","last_unstale":"2024-03-09T15:12:02.067831+0000","last_undegraded":"2024-03-09T15:12:02.067831+0000","last_fullsized":"2024-03-09T15:12:02.067831+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'10","last_scrub_stamp":"2024-03-09T15:12:02.067736+0000","last_deep_scrub":"261'10","last_deep_scrub_stamp":"2024-03-09T15:12:02.067736+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.067736+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:30.445400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.735689+0000","last_change":"2024-03-09T14:50:35.506808+0000","last_active":"2024-03-09T15:10:51.735689+0000","last_peered":"2024-03-09T15:10:51.735689+0000","last_clean":"2024-03-09T15:10:51.735689+0000","last_became_active":"2024-03-09T14:50:35.506542+0000","last_became_peered":"2024-03-09T14:50:35.506542+0000","last_unstale":"2024-03-09T15:10:51.735689+0000","last_undegraded":"2024-03-09T15:10:51.735689+0000","last_fullsized":"2024-03-09T15:10:51.735689+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.579053+0000","last_change":"2024-03-09T14:38:37.439732+0000","last_active":"2024-03-09T15:10:06.579053+0000","last_peered":"2024-03-09T15:10:06.579053+0000","last_clean":"2024-03-09T15:10:06.579053+0000","last_became_active":"2024-03-09T14:38:37.439444+0000","last_became_peered":"2024-03-09T14:38:37.439444+0000","last_unstale":"2024-03-09T15:10:06.579053+0000","last_undegraded":"2024-03-09T15:10:06.579053+0000","last_fullsized":"2024-03-09T15:10:06.579053+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.434628+0000","last_change":"2024-03-09T15:11:51.434678+0000","last_active":"2024-03-09T15:11:51.434628+0000","last_peered":"2024-03-09T15:11:51.434628+0000","last_clean":"2024-03-09T15:11:51.434628+0000","last_became_active":"2024-03-09T14:38:34.416139+0000","last_became_peered":"2024-03-09T14:38:34.416139+0000","last_unstale":"2024-03-09T15:11:51.434628+0000","last_undegraded":"2024-03-09T15:11:51.434628+0000","last_fullsized":"2024-03-09T15:11:51.434628+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:51.434539+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:51.434539+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.434539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:58:52.717684+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'57","reported_seq":196,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.131465+0000","last_change":"2024-03-09T15:11:53.131507+0000","last_active":"2024-03-09T15:11:53.131465+0000","last_peered":"2024-03-09T15:11:53.131465+0000","last_clean":"2024-03-09T15:11:53.131465+0000","last_became_active":"2024-03-09T14:35:41.120802+0000","last_became_peered":"2024-03-09T14:35:41.120802+0000","last_unstale":"2024-03-09T15:11:53.131465+0000","last_undegraded":"2024-03-09T15:11:53.131465+0000","last_fullsized":"2024-03-09T15:11:53.131465+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'57","last_scrub_stamp":"2024-03-09T15:11:53.131366+0000","last_deep_scrub":"264'57","last_deep_scrub_stamp":"2024-03-09T15:11:53.131366+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.131366+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:33.973786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":244,"num_read_kb":179,"num_write":100,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.592239+0000","last_change":"2024-03-09T14:50:35.505537+0000","last_active":"2024-03-09T15:10:51.592239+0000","last_peered":"2024-03-09T15:10:51.592239+0000","last_clean":"2024-03-09T15:10:51.592239+0000","last_became_active":"2024-03-09T14:50:35.505278+0000","last_became_peered":"2024-03-09T14:50:35.505278+0000","last_unstale":"2024-03-09T15:10:51.592239+0000","last_undegraded":"2024-03-09T15:10:51.592239+0000","last_fullsized":"2024-03-09T15:10:51.592239+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.711000+0000","last_change":"2024-03-09T14:38:37.436225+0000","last_active":"2024-03-09T15:11:45.711000+0000","last_peered":"2024-03-09T15:11:45.711000+0000","last_clean":"2024-03-09T15:11:45.711000+0000","last_became_active":"2024-03-09T14:38:37.435952+0000","last_became_peered":"2024-03-09T14:38:37.435952+0000","last_unstale":"2024-03-09T15:11:45.711000+0000","last_undegraded":"2024-03-09T15:11:45.711000+0000","last_fullsized":"2024-03-09T15:11:45.711000+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'4","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.117159+0000","last_change":"2024-03-09T15:12:02.117193+0000","last_active":"2024-03-09T15:12:02.117159+0000","last_peered":"2024-03-09T15:12:02.117159+0000","last_clean":"2024-03-09T15:12:02.117159+0000","last_became_active":"2024-03-09T14:38:34.420453+0000","last_became_peered":"2024-03-09T14:38:34.420453+0000","last_unstale":"2024-03-09T15:12:02.117159+0000","last_undegraded":"2024-03-09T15:12:02.117159+0000","last_fullsized":"2024-03-09T15:12:02.117159+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:12:02.117071+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:12:02.117071+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.117071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:07:29.454344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":4,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'47","reported_seq":173,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.237134+0000","last_change":"2024-03-09T15:11:53.237161+0000","last_active":"2024-03-09T15:11:53.237134+0000","last_peered":"2024-03-09T15:11:53.237134+0000","last_clean":"2024-03-09T15:11:53.237134+0000","last_became_active":"2024-03-09T14:35:41.119481+0000","last_became_peered":"2024-03-09T14:35:41.119481+0000","last_unstale":"2024-03-09T15:11:53.237134+0000","last_undegraded":"2024-03-09T15:11:53.237134+0000","last_fullsized":"2024-03-09T15:11:53.237134+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-03-09T15:11:53.237044+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-03-09T15:11:53.237044+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.237044+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:14.411457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":141,"num_write":77,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.615458+0000","last_change":"2024-03-09T14:50:35.508997+0000","last_active":"2024-03-09T15:11:26.615458+0000","last_peered":"2024-03-09T15:11:26.615458+0000","last_clean":"2024-03-09T15:11:26.615458+0000","last_became_active":"2024-03-09T14:50:35.508707+0000","last_became_peered":"2024-03-09T14:50:35.508707+0000","last_unstale":"2024-03-09T15:11:26.615458+0000","last_undegraded":"2024-03-09T15:11:26.615458+0000","last_fullsized":"2024-03-09T15:11:26.615458+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.018171+0000","last_change":"2024-03-09T14:38:37.444242+0000","last_active":"2024-03-09T15:11:49.018171+0000","last_peered":"2024-03-09T15:11:49.018171+0000","last_clean":"2024-03-09T15:11:49.018171+0000","last_became_active":"2024-03-09T14:38:37.443923+0000","last_became_peered":"2024-03-09T14:38:37.443923+0000","last_unstale":"2024-03-09T15:11:49.018171+0000","last_undegraded":"2024-03-09T15:11:49.018171+0000","last_fullsized":"2024-03-09T15:11:49.018171+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'9","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.106603+0000","last_change":"2024-03-09T15:11:56.106603+0000","last_active":"2024-03-09T15:11:56.106603+0000","last_peered":"2024-03-09T15:11:56.106603+0000","last_clean":"2024-03-09T15:11:56.106603+0000","last_became_active":"2024-03-09T14:38:34.421150+0000","last_became_peered":"2024-03-09T14:38:34.421150+0000","last_unstale":"2024-03-09T15:11:56.106603+0000","last_undegraded":"2024-03-09T15:11:56.106603+0000","last_fullsized":"2024-03-09T15:11:56.106603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-03-09T15:11:56.106469+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-03-09T15:11:56.106469+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.106469+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:26.682205+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":24,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'56","reported_seq":195,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.445210+0000","last_change":"2024-03-09T15:11:54.445236+0000","last_active":"2024-03-09T15:11:54.445210+0000","last_peered":"2024-03-09T15:11:54.445210+0000","last_clean":"2024-03-09T15:11:54.445210+0000","last_became_active":"2024-03-09T14:35:41.121047+0000","last_became_peered":"2024-03-09T14:35:41.121047+0000","last_unstale":"2024-03-09T15:11:54.445210+0000","last_undegraded":"2024-03-09T15:11:54.445210+0000","last_fullsized":"2024-03-09T15:11:54.445210+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'56","last_scrub_stamp":"2024-03-09T15:11:54.445106+0000","last_deep_scrub":"264'56","last_deep_scrub_stamp":"2024-03-09T15:11:54.445106+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.445106+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:18:07.884126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":176,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.603164+0000","last_change":"2024-03-09T14:50:35.512833+0000","last_active":"2024-03-09T15:11:26.603164+0000","last_peered":"2024-03-09T15:11:26.603164+0000","last_clean":"2024-03-09T15:11:26.603164+0000","last_became_active":"2024-03-09T14:50:35.512540+0000","last_became_peered":"2024-03-09T14:50:35.512540+0000","last_unstale":"2024-03-09T15:11:26.603164+0000","last_undegraded":"2024-03-09T15:11:26.603164+0000","last_fullsized":"2024-03-09T15:11:26.603164+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.018117+0000","last_change":"2024-03-09T14:38:37.436520+0000","last_active":"2024-03-09T15:11:49.018117+0000","last_peered":"2024-03-09T15:11:49.018117+0000","last_clean":"2024-03-09T15:11:49.018117+0000","last_became_active":"2024-03-09T14:38:37.436246+0000","last_became_peered":"2024-03-09T14:38:37.436246+0000","last_unstale":"2024-03-09T15:11:49.018117+0000","last_undegraded":"2024-03-09T15:11:49.018117+0000","last_fullsized":"2024-03-09T15:11:49.018117+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.935666+0000","last_change":"2024-03-09T14:38:34.417805+0000","last_active":"2024-03-09T15:11:49.935666+0000","last_peered":"2024-03-09T15:11:49.935666+0000","last_clean":"2024-03-09T15:11:49.935666+0000","last_became_active":"2024-03-09T14:38:34.417530+0000","last_became_peered":"2024-03-09T14:38:34.417530+0000","last_unstale":"2024-03-09T15:11:49.935666+0000","last_undegraded":"2024-03-09T15:11:49.935666+0000","last_fullsized":"2024-03-09T15:11:49.935666+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'34","reported_seq":139,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.290205+0000","last_change":"2024-03-09T15:11:57.290231+0000","last_active":"2024-03-09T15:11:57.290205+0000","last_peered":"2024-03-09T15:11:57.290205+0000","last_clean":"2024-03-09T15:11:57.290205+0000","last_became_active":"2024-03-09T14:35:41.116050+0000","last_became_peered":"2024-03-09T14:35:41.116050+0000","last_unstale":"2024-03-09T15:11:57.290205+0000","last_undegraded":"2024-03-09T15:11:57.290205+0000","last_fullsized":"2024-03-09T15:11:57.290205+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-03-09T15:11:57.290111+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-03-09T15:11:57.290111+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.290111+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:40:12.008655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":98,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:41.582882+0000","last_change":"2024-03-09T14:50:35.513092+0000","last_active":"2024-03-09T15:10:41.582882+0000","last_peered":"2024-03-09T15:10:41.582882+0000","last_clean":"2024-03-09T15:10:41.582882+0000","last_became_active":"2024-03-09T14:50:35.512533+0000","last_became_peered":"2024-03-09T14:50:35.512533+0000","last_unstale":"2024-03-09T15:10:41.582882+0000","last_undegraded":"2024-03-09T15:10:41.582882+0000","last_fullsized":"2024-03-09T15:10:41.582882+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.082439+0000","last_change":"2024-03-09T15:12:01.082464+0000","last_active":"2024-03-09T15:12:01.082439+0000","last_peered":"2024-03-09T15:12:01.082439+0000","last_clean":"2024-03-09T15:12:01.082439+0000","last_became_active":"2024-03-09T14:38:37.432627+0000","last_became_peered":"2024-03-09T14:38:37.432627+0000","last_unstale":"2024-03-09T15:12:01.082439+0000","last_undegraded":"2024-03-09T15:12:01.082439+0000","last_fullsized":"2024-03-09T15:12:01.082439+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:12:01.082349+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:12:01.082349+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.082349+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:29:35.802601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.329616+0000","last_change":"2024-03-09T15:11:59.329643+0000","last_active":"2024-03-09T15:11:59.329616+0000","last_peered":"2024-03-09T15:11:59.329616+0000","last_clean":"2024-03-09T15:11:59.329616+0000","last_became_active":"2024-03-09T14:38:34.415277+0000","last_became_peered":"2024-03-09T14:38:34.415277+0000","last_unstale":"2024-03-09T15:11:59.329616+0000","last_undegraded":"2024-03-09T15:11:59.329616+0000","last_fullsized":"2024-03-09T15:11:59.329616+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:11:59.329530+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:11:59.329530+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.329530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:30:14.001843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'18","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.111501+0000","last_change":"2024-03-09T15:12:00.111526+0000","last_active":"2024-03-09T15:12:00.111501+0000","last_peered":"2024-03-09T15:12:00.111501+0000","last_clean":"2024-03-09T15:12:00.111501+0000","last_became_active":"2024-03-09T14:35:41.123542+0000","last_became_peered":"2024-03-09T14:35:41.123542+0000","last_unstale":"2024-03-09T15:12:00.111501+0000","last_undegraded":"2024-03-09T15:12:00.111501+0000","last_fullsized":"2024-03-09T15:12:00.111501+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-03-09T15:12:00.111408+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-03-09T15:12:00.111408+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.111408+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:58:58.676620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":44,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.492700+0000","last_change":"2024-03-09T14:50:35.506612+0000","last_active":"2024-03-09T15:11:26.492700+0000","last_peered":"2024-03-09T15:11:26.492700+0000","last_clean":"2024-03-09T15:11:26.492700+0000","last_became_active":"2024-03-09T14:50:35.506332+0000","last_became_peered":"2024-03-09T14:50:35.506332+0000","last_unstale":"2024-03-09T15:11:26.492700+0000","last_undegraded":"2024-03-09T15:11:26.492700+0000","last_fullsized":"2024-03-09T15:11:26.492700+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.954128+0000","last_change":"2024-03-09T14:38:37.438481+0000","last_active":"2024-03-09T15:11:45.954128+0000","last_peered":"2024-03-09T15:11:45.954128+0000","last_clean":"2024-03-09T15:11:45.954128+0000","last_became_active":"2024-03-09T14:38:37.438182+0000","last_became_peered":"2024-03-09T14:38:37.438182+0000","last_unstale":"2024-03-09T15:11:45.954128+0000","last_undegraded":"2024-03-09T15:11:45.954128+0000","last_fullsized":"2024-03-09T15:11:45.954128+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.060938+0000","last_change":"2024-03-09T15:11:54.060989+0000","last_active":"2024-03-09T15:11:54.060938+0000","last_peered":"2024-03-09T15:11:54.060938+0000","last_clean":"2024-03-09T15:11:54.060938+0000","last_became_active":"2024-03-09T14:38:34.423106+0000","last_became_peered":"2024-03-09T14:38:34.423106+0000","last_unstale":"2024-03-09T15:11:54.060938+0000","last_undegraded":"2024-03-09T15:11:54.060938+0000","last_fullsized":"2024-03-09T15:11:54.060938+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:54.060823+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:54.060823+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.060823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:12:09.238327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'25","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.105170+0000","last_change":"2024-03-09T15:11:54.105214+0000","last_active":"2024-03-09T15:11:54.105170+0000","last_peered":"2024-03-09T15:11:54.105170+0000","last_clean":"2024-03-09T15:11:54.105170+0000","last_became_active":"2024-03-09T14:35:41.117841+0000","last_became_peered":"2024-03-09T14:35:41.117841+0000","last_unstale":"2024-03-09T15:11:54.105170+0000","last_undegraded":"2024-03-09T15:11:54.105170+0000","last_fullsized":"2024-03-09T15:11:54.105170+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-03-09T15:11:54.105043+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-03-09T15:11:54.105043+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.105043+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:41.171924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":73,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.574434+0000","last_change":"2024-03-09T14:50:35.509942+0000","last_active":"2024-03-09T15:10:06.574434+0000","last_peered":"2024-03-09T15:10:06.574434+0000","last_clean":"2024-03-09T15:10:06.574434+0000","last_became_active":"2024-03-09T14:50:35.509460+0000","last_became_peered":"2024-03-09T14:50:35.509460+0000","last_unstale":"2024-03-09T15:10:06.574434+0000","last_undegraded":"2024-03-09T15:10:06.574434+0000","last_fullsized":"2024-03-09T15:10:06.574434+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.477050+0000","last_change":"2024-03-09T14:38:37.439377+0000","last_active":"2024-03-09T15:11:49.477050+0000","last_peered":"2024-03-09T15:11:49.477050+0000","last_clean":"2024-03-09T15:11:49.477050+0000","last_became_active":"2024-03-09T14:38:37.439087+0000","last_became_peered":"2024-03-09T14:38:37.439087+0000","last_unstale":"2024-03-09T15:11:49.477050+0000","last_undegraded":"2024-03-09T15:11:49.477050+0000","last_fullsized":"2024-03-09T15:11:49.477050+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.105014+0000","last_change":"2024-03-09T15:11:58.105040+0000","last_active":"2024-03-09T15:11:58.105014+0000","last_peered":"2024-03-09T15:11:58.105014+0000","last_clean":"2024-03-09T15:11:58.105014+0000","last_became_active":"2024-03-09T14:38:34.418453+0000","last_became_peered":"2024-03-09T14:38:34.418453+0000","last_unstale":"2024-03-09T15:11:58.105014+0000","last_undegraded":"2024-03-09T15:11:58.105014+0000","last_fullsized":"2024-03-09T15:11:58.105014+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:58.104921+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:58.104921+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.104921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:02:06.522978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'42","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.368598+0000","last_change":"2024-03-09T15:11:51.368625+0000","last_active":"2024-03-09T15:11:51.368598+0000","last_peered":"2024-03-09T15:11:51.368598+0000","last_clean":"2024-03-09T15:11:51.368598+0000","last_became_active":"2024-03-09T14:35:41.119181+0000","last_became_peered":"2024-03-09T14:35:41.119181+0000","last_unstale":"2024-03-09T15:11:51.368598+0000","last_undegraded":"2024-03-09T15:11:51.368598+0000","last_fullsized":"2024-03-09T15:11:51.368598+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-03-09T15:11:51.368508+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-03-09T15:11:51.368508+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.368508+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:30:47.169740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":129,"num_write":69,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.587252+0000","last_change":"2024-03-09T14:50:35.504114+0000","last_active":"2024-03-09T15:10:06.587252+0000","last_peered":"2024-03-09T15:10:06.587252+0000","last_clean":"2024-03-09T15:10:06.587252+0000","last_became_active":"2024-03-09T14:50:35.503858+0000","last_became_peered":"2024-03-09T14:50:35.503858+0000","last_unstale":"2024-03-09T15:10:06.587252+0000","last_undegraded":"2024-03-09T15:10:06.587252+0000","last_fullsized":"2024-03-09T15:10:06.587252+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:41.596596+0000","last_change":"2024-03-09T14:38:37.434360+0000","last_active":"2024-03-09T15:10:41.596596+0000","last_peered":"2024-03-09T15:10:41.596596+0000","last_clean":"2024-03-09T15:10:41.596596+0000","last_became_active":"2024-03-09T14:38:37.434065+0000","last_became_peered":"2024-03-09T14:38:37.434065+0000","last_unstale":"2024-03-09T15:10:41.596596+0000","last_undegraded":"2024-03-09T15:10:41.596596+0000","last_fullsized":"2024-03-09T15:10:41.596596+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.108634+0000","last_change":"2024-03-09T15:11:53.108634+0000","last_active":"2024-03-09T15:11:53.108634+0000","last_peered":"2024-03-09T15:11:53.108634+0000","last_clean":"2024-03-09T15:11:53.108634+0000","last_became_active":"2024-03-09T14:38:34.423145+0000","last_became_peered":"2024-03-09T14:38:34.423145+0000","last_unstale":"2024-03-09T15:11:53.108634+0000","last_undegraded":"2024-03-09T15:11:53.108634+0000","last_fullsized":"2024-03-09T15:11:53.108634+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:11:53.108507+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:11:53.108507+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.108507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:06:47.906719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'41","reported_seq":155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.081553+0000","last_change":"2024-03-09T15:11:51.081580+0000","last_active":"2024-03-09T15:11:51.081553+0000","last_peered":"2024-03-09T15:11:51.081553+0000","last_clean":"2024-03-09T15:11:51.081553+0000","last_became_active":"2024-03-09T14:35:41.117617+0000","last_became_peered":"2024-03-09T14:35:41.117617+0000","last_unstale":"2024-03-09T15:11:51.081553+0000","last_undegraded":"2024-03-09T15:11:51.081553+0000","last_fullsized":"2024-03-09T15:11:51.081553+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-03-09T15:11:51.081467+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-03-09T15:11:51.081467+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.081467+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:57:36.656065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":72,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.596036+0000","last_change":"2024-03-09T14:50:35.506611+0000","last_active":"2024-03-09T15:11:26.596036+0000","last_peered":"2024-03-09T15:11:26.596036+0000","last_clean":"2024-03-09T15:11:26.596036+0000","last_became_active":"2024-03-09T14:50:35.506356+0000","last_became_peered":"2024-03-09T14:50:35.506356+0000","last_unstale":"2024-03-09T15:11:26.596036+0000","last_undegraded":"2024-03-09T15:11:26.596036+0000","last_fullsized":"2024-03-09T15:11:26.596036+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.789680+0000","last_change":"2024-03-09T14:38:37.439826+0000","last_active":"2024-03-09T15:11:51.789680+0000","last_peered":"2024-03-09T15:11:51.789680+0000","last_clean":"2024-03-09T15:11:51.789680+0000","last_became_active":"2024-03-09T14:38:37.439120+0000","last_became_peered":"2024-03-09T14:38:37.439120+0000","last_unstale":"2024-03-09T15:11:51.789680+0000","last_undegraded":"2024-03-09T15:11:51.789680+0000","last_fullsized":"2024-03-09T15:11:51.789680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'5","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.071993+0000","last_change":"2024-03-09T15:11:52.071993+0000","last_active":"2024-03-09T15:11:52.071993+0000","last_peered":"2024-03-09T15:11:52.071993+0000","last_clean":"2024-03-09T15:11:52.071993+0000","last_became_active":"2024-03-09T14:38:34.422585+0000","last_became_peered":"2024-03-09T14:38:34.422585+0000","last_unstale":"2024-03-09T15:11:52.071993+0000","last_undegraded":"2024-03-09T15:11:52.071993+0000","last_fullsized":"2024-03-09T15:11:52.071993+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:11:52.071888+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:11:52.071888+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.071888+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:53:01.363827+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'19","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.256100+0000","last_change":"2024-03-09T15:11:54.256127+0000","last_active":"2024-03-09T15:11:54.256100+0000","last_peered":"2024-03-09T15:11:54.256100+0000","last_clean":"2024-03-09T15:11:54.256100+0000","last_became_active":"2024-03-09T14:35:41.118425+0000","last_became_peered":"2024-03-09T14:35:41.118425+0000","last_unstale":"2024-03-09T15:11:54.256100+0000","last_undegraded":"2024-03-09T15:11:54.256100+0000","last_fullsized":"2024-03-09T15:11:54.256100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'19","last_scrub_stamp":"2024-03-09T15:11:54.256010+0000","last_deep_scrub":"264'19","last_deep_scrub_stamp":"2024-03-09T15:11:54.256010+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.256010+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:26.207996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":53,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.616380+0000","last_change":"2024-03-09T14:50:35.505890+0000","last_active":"2024-03-09T15:11:31.616380+0000","last_peered":"2024-03-09T15:11:31.616380+0000","last_clean":"2024-03-09T15:11:31.616380+0000","last_became_active":"2024-03-09T14:50:35.505615+0000","last_became_peered":"2024-03-09T14:50:35.505615+0000","last_unstale":"2024-03-09T15:11:31.616380+0000","last_undegraded":"2024-03-09T15:11:31.616380+0000","last_fullsized":"2024-03-09T15:11:31.616380+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.861341+0000","last_change":"2024-03-09T14:38:37.437735+0000","last_active":"2024-03-09T15:11:50.861341+0000","last_peered":"2024-03-09T15:11:50.861341+0000","last_clean":"2024-03-09T15:11:50.861341+0000","last_became_active":"2024-03-09T14:38:37.437417+0000","last_became_peered":"2024-03-09T14:38:37.437417+0000","last_unstale":"2024-03-09T15:11:50.861341+0000","last_undegraded":"2024-03-09T15:11:50.861341+0000","last_fullsized":"2024-03-09T15:11:50.861341+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"261'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.271804+0000","last_change":"2024-03-09T15:11:56.271804+0000","last_active":"2024-03-09T15:11:56.271804+0000","last_peered":"2024-03-09T15:11:56.271804+0000","last_clean":"2024-03-09T15:11:56.271804+0000","last_became_active":"2024-03-09T14:38:34.415722+0000","last_became_peered":"2024-03-09T14:38:34.415722+0000","last_unstale":"2024-03-09T15:11:56.271804+0000","last_undegraded":"2024-03-09T15:11:56.271804+0000","last_fullsized":"2024-03-09T15:11:56.271804+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:11:56.271674+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:11:56.271674+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.271674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:48:05.171502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'34","reported_seq":142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.068920+0000","last_change":"2024-03-09T15:12:03.068946+0000","last_active":"2024-03-09T15:12:03.068920+0000","last_peered":"2024-03-09T15:12:03.068920+0000","last_clean":"2024-03-09T15:12:03.068920+0000","last_became_active":"2024-03-09T14:35:41.121524+0000","last_became_peered":"2024-03-09T14:35:41.121524+0000","last_unstale":"2024-03-09T15:12:03.068920+0000","last_undegraded":"2024-03-09T15:12:03.068920+0000","last_fullsized":"2024-03-09T15:12:03.068920+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-03-09T15:12:03.068812+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-03-09T15:12:03.068812+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.068812+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:02:49.962553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":103,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'188","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.977231+0000","last_change":"2024-03-09T14:27:03.724626+0000","last_active":"2024-03-09T15:11:45.977231+0000","last_peered":"2024-03-09T15:11:45.977231+0000","last_clean":"2024-03-09T15:11:45.977231+0000","last_became_active":"2024-03-09T14:27:03.724231+0000","last_became_peered":"2024-03-09T14:27:03.724231+0000","last_unstale":"2024-03-09T15:11:45.977231+0000","last_undegraded":"2024-03-09T15:11:45.977231+0000","last_fullsized":"2024-03-09T15:11:45.977231+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8703114,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":339,"num_read_kb":37539,"num_write":995,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'398","reported_seq":1852,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.603949+0000","last_change":"2024-03-09T14:26:28.649571+0000","last_active":"2024-03-09T15:11:31.603949+0000","last_peered":"2024-03-09T15:11:31.603949+0000","last_clean":"2024-03-09T15:11:31.603949+0000","last_became_active":"2024-03-09T14:26:28.648852+0000","last_became_peered":"2024-03-09T14:26:28.648852+0000","last_unstale":"2024-03-09T15:11:31.603949+0000","last_undegraded":"2024-03-09T15:11:31.603949+0000","last_fullsized":"2024-03-09T15:11:31.603949+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2165,"num_read_kb":2027,"num_write":486,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'163","reported_seq":781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.968979+0000","last_change":"2024-03-09T14:26:26.636093+0000","last_active":"2024-03-09T15:11:45.968979+0000","last_peered":"2024-03-09T15:11:45.968979+0000","last_clean":"2024-03-09T15:11:45.968979+0000","last_became_active":"2024-03-09T14:26:26.635705+0000","last_became_peered":"2024-03-09T14:26:26.635705+0000","last_unstale":"2024-03-09T15:11:45.968979+0000","last_undegraded":"2024-03-09T15:11:45.968979+0000","last_fullsized":"2024-03-09T15:11:45.968979+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":33876,"num_write":835,"num_write_kb":32927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'819","reported_seq":2399,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.044391+0000","last_change":"2024-03-09T15:12:06.044426+0000","last_active":"2024-03-09T15:12:06.044391+0000","last_peered":"2024-03-09T15:12:06.044391+0000","last_clean":"2024-03-09T15:12:06.044391+0000","last_became_active":"2024-03-09T14:28:04.196872+0000","last_became_peered":"2024-03-09T14:28:04.196872+0000","last_unstale":"2024-03-09T15:12:06.044391+0000","last_undegraded":"2024-03-09T15:12:06.044391+0000","last_fullsized":"2024-03-09T15:12:06.044391+0000","mapping_epoch":38,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'819","last_scrub_stamp":"2024-03-09T15:12:06.044299+0000","last_deep_scrub":"264'819","last_deep_scrub_stamp":"2024-03-09T15:12:06.044299+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.044299+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:04.510091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3746,"num_read_kb":3347,"num_write":1098,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'207","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.879542+0000","last_change":"2024-03-09T14:26:26.626838+0000","last_active":"2024-03-09T15:11:45.879542+0000","last_peered":"2024-03-09T15:11:45.879542+0000","last_clean":"2024-03-09T15:11:45.879542+0000","last_became_active":"2024-03-09T14:26:26.626521+0000","last_became_peered":"2024-03-09T14:26:26.626521+0000","last_unstale":"2024-03-09T15:11:45.879542+0000","last_undegraded":"2024-03-09T15:11:45.879542+0000","last_fullsized":"2024-03-09T15:11:45.879542+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":486,"num_read_kb":60498,"num_write":1106,"num_write_kb":28928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'630","reported_seq":2072,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.493659+0000","last_change":"2024-03-09T14:26:28.649656+0000","last_active":"2024-03-09T15:11:31.493659+0000","last_peered":"2024-03-09T15:11:31.493659+0000","last_clean":"2024-03-09T15:11:31.493659+0000","last_became_active":"2024-03-09T14:26:28.649054+0000","last_became_peered":"2024-03-09T14:26:28.649054+0000","last_unstale":"2024-03-09T15:11:31.493659+0000","last_undegraded":"2024-03-09T15:11:31.493659+0000","last_fullsized":"2024-03-09T15:11:31.493659+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":600,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3080,"num_read_kb":2811,"num_write":822,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'179","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.782617+0000","last_change":"2024-03-09T14:26:26.647604+0000","last_active":"2024-03-09T15:11:45.782617+0000","last_peered":"2024-03-09T15:11:45.782617+0000","last_clean":"2024-03-09T15:11:45.782617+0000","last_became_active":"2024-03-09T14:26:26.647183+0000","last_became_peered":"2024-03-09T14:26:26.647183+0000","last_unstale":"2024-03-09T15:11:45.782617+0000","last_undegraded":"2024-03-09T15:11:45.782617+0000","last_fullsized":"2024-03-09T15:11:45.782617+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":425,"num_read_kb":10841,"num_write":993,"num_write_kb":22118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'383","reported_seq":1953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.596728+0000","last_change":"2024-03-09T14:26:28.649519+0000","last_active":"2024-03-09T15:11:31.596728+0000","last_peered":"2024-03-09T15:11:31.596728+0000","last_clean":"2024-03-09T15:11:31.596728+0000","last_became_active":"2024-03-09T14:26:28.649146+0000","last_became_peered":"2024-03-09T14:26:28.649146+0000","last_unstale":"2024-03-09T15:11:31.596728+0000","last_undegraded":"2024-03-09T15:11:31.596728+0000","last_fullsized":"2024-03-09T15:11:31.596728+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2286,"num_read_kb":2187,"num_write":441,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'274","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.938369+0000","last_change":"2024-03-09T14:26:26.652067+0000","last_active":"2024-03-09T15:11:45.938369+0000","last_peered":"2024-03-09T15:11:45.938369+0000","last_clean":"2024-03-09T15:11:45.938369+0000","last_became_active":"2024-03-09T14:26:26.651564+0000","last_became_peered":"2024-03-09T14:26:26.651564+0000","last_unstale":"2024-03-09T15:11:45.938369+0000","last_undegraded":"2024-03-09T15:11:45.938369+0000","last_fullsized":"2024-03-09T15:11:45.938369+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12595319,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":658,"num_read_kb":37858,"num_write":1532,"num_write_kb":26421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'334","reported_seq":1773,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:41.612140+0000","last_change":"2024-03-09T14:26:28.648555+0000","last_active":"2024-03-09T15:10:41.612140+0000","last_peered":"2024-03-09T15:10:41.612140+0000","last_clean":"2024-03-09T15:10:41.612140+0000","last_became_active":"2024-03-09T14:26:28.648259+0000","last_became_peered":"2024-03-09T14:26:28.648259+0000","last_unstale":"2024-03-09T15:10:41.612140+0000","last_undegraded":"2024-03-09T15:10:41.612140+0000","last_fullsized":"2024-03-09T15:10:41.612140+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2053,"num_read_kb":1964,"num_write":385,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'170","reported_seq":776,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.965445+0000","last_change":"2024-03-09T14:26:26.649108+0000","last_active":"2024-03-09T15:11:45.965445+0000","last_peered":"2024-03-09T15:11:45.965445+0000","last_clean":"2024-03-09T15:11:45.965445+0000","last_became_active":"2024-03-09T14:26:26.648780+0000","last_became_peered":"2024-03-09T14:26:26.648780+0000","last_unstale":"2024-03-09T15:11:45.965445+0000","last_undegraded":"2024-03-09T15:11:45.965445+0000","last_fullsized":"2024-03-09T15:11:45.965445+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525518,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":382,"num_read_kb":3119,"num_write":934,"num_write_kb":23902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'461","reported_seq":2007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.336838+0000","last_change":"2024-03-09T14:26:28.650877+0000","last_active":"2024-03-09T15:10:45.336838+0000","last_peered":"2024-03-09T15:10:45.336838+0000","last_clean":"2024-03-09T15:10:45.336838+0000","last_became_active":"2024-03-09T14:26:28.649994+0000","last_became_peered":"2024-03-09T14:26:28.649994+0000","last_unstale":"2024-03-09T15:10:45.336838+0000","last_undegraded":"2024-03-09T15:10:45.336838+0000","last_fullsized":"2024-03-09T15:10:45.336838+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2508,"num_read_kb":2326,"num_write":602,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'163","reported_seq":813,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.963912+0000","last_change":"2024-03-09T14:26:26.652122+0000","last_active":"2024-03-09T15:11:45.963912+0000","last_peered":"2024-03-09T15:11:45.963912+0000","last_clean":"2024-03-09T15:11:45.963912+0000","last_became_active":"2024-03-09T14:26:26.651754+0000","last_became_peered":"2024-03-09T14:26:26.651754+0000","last_unstale":"2024-03-09T15:11:45.963912+0000","last_undegraded":"2024-03-09T15:11:45.963912+0000","last_fullsized":"2024-03-09T15:11:45.963912+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":432,"num_read_kb":120305,"num_write":891,"num_write_kb":41051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'1264","reported_seq":2892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.199725+0000","last_change":"2024-03-09T14:26:28.652076+0000","last_active":"2024-03-09T15:11:09.199725+0000","last_peered":"2024-03-09T15:11:09.199725+0000","last_clean":"2024-03-09T15:11:09.199725+0000","last_became_active":"2024-03-09T14:26:28.651754+0000","last_became_peered":"2024-03-09T14:26:28.651754+0000","last_unstale":"2024-03-09T15:11:09.199725+0000","last_undegraded":"2024-03-09T15:11:09.199725+0000","last_fullsized":"2024-03-09T15:11:09.199725+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5611,"num_read_kb":4890,"num_write":1803,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'158","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.962481+0000","last_change":"2024-03-09T14:26:26.643565+0000","last_active":"2024-03-09T15:11:45.962481+0000","last_peered":"2024-03-09T15:11:45.962481+0000","last_clean":"2024-03-09T15:11:45.962481+0000","last_became_active":"2024-03-09T14:26:26.643195+0000","last_became_peered":"2024-03-09T14:26:26.643195+0000","last_unstale":"2024-03-09T15:11:45.962481+0000","last_undegraded":"2024-03-09T15:11:45.962481+0000","last_fullsized":"2024-03-09T15:11:45.962481+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924406,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":386,"num_read_kb":7445,"num_write":885,"num_write_kb":17740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'832","reported_seq":2502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.895814+0000","last_change":"2024-03-09T14:26:28.654056+0000","last_active":"2024-03-09T15:11:07.895814+0000","last_peered":"2024-03-09T15:11:07.895814+0000","last_clean":"2024-03-09T15:11:07.895814+0000","last_became_active":"2024-03-09T14:26:28.653778+0000","last_became_peered":"2024-03-09T14:26:28.653778+0000","last_unstale":"2024-03-09T15:11:07.895814+0000","last_undegraded":"2024-03-09T15:11:07.895814+0000","last_fullsized":"2024-03-09T15:11:07.895814+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3883,"num_read_kb":3504,"num_write":1111,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'451","reported_seq":2034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.552231+0000","last_change":"2024-03-09T14:26:28.649892+0000","last_active":"2024-03-09T15:10:54.552231+0000","last_peered":"2024-03-09T15:10:54.552231+0000","last_clean":"2024-03-09T15:10:54.552231+0000","last_became_active":"2024-03-09T14:26:28.649128+0000","last_became_peered":"2024-03-09T14:26:28.649128+0000","last_unstale":"2024-03-09T15:10:54.552231+0000","last_undegraded":"2024-03-09T15:10:54.552231+0000","last_fullsized":"2024-03-09T15:10:54.552231+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2472,"num_read_kb":2328,"num_write":564,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'188","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.967396+0000","last_change":"2024-03-09T14:26:26.651818+0000","last_active":"2024-03-09T15:11:45.967396+0000","last_peered":"2024-03-09T15:11:45.967396+0000","last_clean":"2024-03-09T15:11:45.967396+0000","last_became_active":"2024-03-09T14:26:26.651323+0000","last_became_peered":"2024-03-09T14:26:26.651323+0000","last_unstale":"2024-03-09T15:11:45.967396+0000","last_undegraded":"2024-03-09T15:11:45.967396+0000","last_fullsized":"2024-03-09T15:11:45.967396+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2187,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":439,"num_read_kb":7847,"num_write":1012,"num_write_kb":34087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'415","reported_seq":1936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.735630+0000","last_change":"2024-03-09T14:26:28.646304+0000","last_active":"2024-03-09T15:10:51.735630+0000","last_peered":"2024-03-09T15:10:51.735630+0000","last_clean":"2024-03-09T15:10:51.735630+0000","last_became_active":"2024-03-09T14:26:28.645422+0000","last_became_peered":"2024-03-09T14:26:28.645422+0000","last_unstale":"2024-03-09T15:10:51.735630+0000","last_undegraded":"2024-03-09T15:10:51.735630+0000","last_fullsized":"2024-03-09T15:10:51.735630+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2243,"num_read_kb":2118,"num_write":516,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'179","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.893835+0000","last_change":"2024-03-09T14:26:26.644904+0000","last_active":"2024-03-09T15:11:45.893835+0000","last_peered":"2024-03-09T15:11:45.893835+0000","last_clean":"2024-03-09T15:11:45.893835+0000","last_became_active":"2024-03-09T14:26:26.644578+0000","last_became_peered":"2024-03-09T14:26:26.644578+0000","last_unstale":"2024-03-09T15:11:45.893835+0000","last_undegraded":"2024-03-09T15:11:45.893835+0000","last_fullsized":"2024-03-09T15:11:45.893835+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":16041,"num_write":1043,"num_write_kb":25248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'392","reported_seq":2100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.447417+0000","last_change":"2024-03-09T14:26:28.648611+0000","last_active":"2024-03-09T15:11:04.447417+0000","last_peered":"2024-03-09T15:11:04.447417+0000","last_clean":"2024-03-09T15:11:04.447417+0000","last_became_active":"2024-03-09T14:26:28.648115+0000","last_became_peered":"2024-03-09T14:26:28.648115+0000","last_unstale":"2024-03-09T15:11:04.447417+0000","last_undegraded":"2024-03-09T15:11:04.447417+0000","last_fullsized":"2024-03-09T15:11:04.447417+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2471,"num_read_kb":2382,"num_write":449,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'206","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.939775+0000","last_change":"2024-03-09T14:26:26.647793+0000","last_active":"2024-03-09T15:11:45.939775+0000","last_peered":"2024-03-09T15:11:45.939775+0000","last_clean":"2024-03-09T15:11:45.939775+0000","last_became_active":"2024-03-09T14:26:26.647391+0000","last_became_peered":"2024-03-09T14:26:26.647391+0000","last_unstale":"2024-03-09T15:11:45.939775+0000","last_undegraded":"2024-03-09T15:11:45.939775+0000","last_fullsized":"2024-03-09T15:11:45.939775+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778753,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":14846,"num_write":1056,"num_write_kb":41673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'453","reported_seq":2023,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.896439+0000","last_change":"2024-03-09T14:26:28.648170+0000","last_active":"2024-03-09T15:11:07.896439+0000","last_peered":"2024-03-09T15:11:07.896439+0000","last_clean":"2024-03-09T15:11:07.896439+0000","last_became_active":"2024-03-09T14:26:28.647846+0000","last_became_peered":"2024-03-09T14:26:28.647846+0000","last_unstale":"2024-03-09T15:11:07.896439+0000","last_undegraded":"2024-03-09T15:11:07.896439+0000","last_fullsized":"2024-03-09T15:11:07.896439+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2382,"num_read_kb":2246,"num_write":552,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'284","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.976624+0000","last_change":"2024-03-09T14:26:26.638124+0000","last_active":"2024-03-09T15:11:45.976624+0000","last_peered":"2024-03-09T15:11:45.976624+0000","last_clean":"2024-03-09T15:11:45.976624+0000","last_became_active":"2024-03-09T14:26:26.637767+0000","last_became_peered":"2024-03-09T14:26:26.637767+0000","last_unstale":"2024-03-09T15:11:45.976624+0000","last_undegraded":"2024-03-09T15:11:45.976624+0000","last_fullsized":"2024-03-09T15:11:45.976624+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4508970,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":598,"num_read_kb":72489,"num_write":1415,"num_write_kb":47263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'1533","reported_seq":3259,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.896047+0000","last_change":"2024-03-09T14:26:28.654340+0000","last_active":"2024-03-09T15:11:07.896047+0000","last_peered":"2024-03-09T15:11:07.896047+0000","last_clean":"2024-03-09T15:11:07.896047+0000","last_became_active":"2024-03-09T14:26:28.653385+0000","last_became_peered":"2024-03-09T14:26:28.653385+0000","last_unstale":"2024-03-09T15:11:07.896047+0000","last_undegraded":"2024-03-09T15:11:07.896047+0000","last_fullsized":"2024-03-09T15:11:07.896047+0000","mapping_epoch":25,"log_start":"264'1500","ondisk_log_start":"264'1500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6446,"num_read_kb":5594,"num_write":2158,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'220","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.970605+0000","last_change":"2024-03-09T14:26:26.644011+0000","last_active":"2024-03-09T15:11:45.970605+0000","last_peered":"2024-03-09T15:11:45.970605+0000","last_clean":"2024-03-09T15:11:45.970605+0000","last_became_active":"2024-03-09T14:26:26.643401+0000","last_became_peered":"2024-03-09T14:26:26.643401+0000","last_unstale":"2024-03-09T15:11:45.970605+0000","last_undegraded":"2024-03-09T15:11:45.970605+0000","last_fullsized":"2024-03-09T15:11:45.970605+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":517275,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":464,"num_read_kb":13858,"num_write":1176,"num_write_kb":34499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'726","reported_seq":2206,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.153541+0000","last_change":"2024-03-09T14:26:28.650896+0000","last_active":"2024-03-09T15:11:37.153541+0000","last_peered":"2024-03-09T15:11:37.153541+0000","last_clean":"2024-03-09T15:11:37.153541+0000","last_became_active":"2024-03-09T14:26:28.650334+0000","last_became_peered":"2024-03-09T14:26:28.650334+0000","last_unstale":"2024-03-09T15:11:37.153541+0000","last_undegraded":"2024-03-09T15:11:37.153541+0000","last_fullsized":"2024-03-09T15:11:37.153541+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3318,"num_read_kb":2980,"num_write":968,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'137","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.968739+0000","last_change":"2024-03-09T14:26:26.631574+0000","last_active":"2024-03-09T15:11:45.968739+0000","last_peered":"2024-03-09T15:11:45.968739+0000","last_clean":"2024-03-09T15:11:45.968739+0000","last_became_active":"2024-03-09T14:26:26.631203+0000","last_became_peered":"2024-03-09T14:26:26.631203+0000","last_unstale":"2024-03-09T15:11:45.968739+0000","last_undegraded":"2024-03-09T15:11:45.968739+0000","last_fullsized":"2024-03-09T15:11:45.968739+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049909,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":305,"num_read_kb":11988,"num_write":738,"num_write_kb":25932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'99","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.165528+0000","last_change":"2024-03-09T15:11:55.165554+0000","last_active":"2024-03-09T15:11:55.165528+0000","last_peered":"2024-03-09T15:11:55.165528+0000","last_clean":"2024-03-09T15:11:55.165528+0000","last_became_active":"2024-03-09T14:26:36.674500+0000","last_became_peered":"2024-03-09T14:26:36.674500+0000","last_unstale":"2024-03-09T15:11:55.165528+0000","last_undegraded":"2024-03-09T15:11:55.165528+0000","last_fullsized":"2024-03-09T15:11:55.165528+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'99","last_scrub_stamp":"2024-03-09T15:11:55.165436+0000","last_deep_scrub":"264'99","last_deep_scrub_stamp":"2024-03-09T15:11:55.165436+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.165436+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:59.949962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":88,"num_write":230,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'373","reported_seq":1782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.860735+0000","last_change":"2024-03-09T15:12:01.860775+0000","last_active":"2024-03-09T15:12:01.860735+0000","last_peered":"2024-03-09T15:12:01.860735+0000","last_clean":"2024-03-09T15:12:01.860735+0000","last_became_active":"2024-03-09T14:28:03.815924+0000","last_became_peered":"2024-03-09T14:28:03.815924+0000","last_unstale":"2024-03-09T15:12:01.860735+0000","last_undegraded":"2024-03-09T15:12:01.860735+0000","last_fullsized":"2024-03-09T15:12:01.860735+0000","mapping_epoch":38,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-03-09T15:12:01.860643+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-03-09T15:12:01.860643+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.860643+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:05.270001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1992,"num_read_kb":1883,"num_write":432,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"264'204","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.976920+0000","last_change":"2024-03-09T14:26:26.653743+0000","last_active":"2024-03-09T15:11:45.976920+0000","last_peered":"2024-03-09T15:11:45.976920+0000","last_clean":"2024-03-09T15:11:45.976920+0000","last_became_active":"2024-03-09T14:26:26.652957+0000","last_became_peered":"2024-03-09T14:26:26.652957+0000","last_unstale":"2024-03-09T15:11:45.976920+0000","last_undegraded":"2024-03-09T15:11:45.976920+0000","last_fullsized":"2024-03-09T15:11:45.976920+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048753,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":421,"num_read_kb":22200,"num_write":1166,"num_write_kb":38864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:01.590889+0000","last_change":"2024-03-09T14:26:30.655416+0000","last_active":"2024-03-09T15:10:01.590889+0000","last_peered":"2024-03-09T15:10:01.590889+0000","last_clean":"2024-03-09T15:10:01.590889+0000","last_became_active":"2024-03-09T14:26:30.654862+0000","last_became_peered":"2024-03-09T14:26:30.654862+0000","last_unstale":"2024-03-09T15:10:01.590889+0000","last_undegraded":"2024-03-09T15:10:01.590889+0000","last_fullsized":"2024-03-09T15:10:01.590889+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'185","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.746208+0000","last_change":"2024-03-09T14:26:32.653350+0000","last_active":"2024-03-09T15:11:45.746208+0000","last_peered":"2024-03-09T15:11:45.746208+0000","last_clean":"2024-03-09T15:11:45.746208+0000","last_became_active":"2024-03-09T14:26:32.652879+0000","last_became_peered":"2024-03-09T14:26:32.652879+0000","last_unstale":"2024-03-09T15:11:45.746208+0000","last_undegraded":"2024-03-09T15:11:45.746208+0000","last_fullsized":"2024-03-09T15:11:45.746208+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19668,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":251,"num_read_kb":350,"num_write":144,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.729471+0000","last_change":"2024-03-09T14:26:34.670623+0000","last_active":"2024-03-09T15:10:06.729471+0000","last_peered":"2024-03-09T15:10:06.729471+0000","last_clean":"2024-03-09T15:10:06.729471+0000","last_became_active":"2024-03-09T14:26:34.670336+0000","last_became_peered":"2024-03-09T14:26:34.670336+0000","last_unstale":"2024-03-09T15:10:06.729471+0000","last_undegraded":"2024-03-09T15:10:06.729471+0000","last_fullsized":"2024-03-09T15:10:06.729471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'171","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.364367+0000","last_change":"2024-03-09T15:11:58.364403+0000","last_active":"2024-03-09T15:11:58.364367+0000","last_peered":"2024-03-09T15:11:58.364367+0000","last_clean":"2024-03-09T15:11:58.364367+0000","last_became_active":"2024-03-09T14:26:36.673806+0000","last_became_peered":"2024-03-09T14:26:36.673806+0000","last_unstale":"2024-03-09T15:11:58.364367+0000","last_undegraded":"2024-03-09T15:11:58.364367+0000","last_fullsized":"2024-03-09T15:11:58.364367+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-03-09T15:11:58.364272+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-03-09T15:11:58.364272+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.364272+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:00:50.536210+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":385,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'374","reported_seq":1918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:04.447473+0000","last_change":"2024-03-09T14:26:28.646103+0000","last_active":"2024-03-09T15:11:04.447473+0000","last_peered":"2024-03-09T15:11:04.447473+0000","last_clean":"2024-03-09T15:11:04.447473+0000","last_became_active":"2024-03-09T14:26:28.645537+0000","last_became_peered":"2024-03-09T14:26:28.645537+0000","last_unstale":"2024-03-09T15:11:04.447473+0000","last_undegraded":"2024-03-09T15:11:04.447473+0000","last_fullsized":"2024-03-09T15:11:04.447473+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2096,"num_read_kb":2016,"num_write":417,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'227","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.969882+0000","last_change":"2024-03-09T14:26:26.644936+0000","last_active":"2024-03-09T15:11:45.969882+0000","last_peered":"2024-03-09T15:11:45.969882+0000","last_clean":"2024-03-09T15:11:45.969882+0000","last_became_active":"2024-03-09T14:26:26.644563+0000","last_became_peered":"2024-03-09T14:26:26.644563+0000","last_unstale":"2024-03-09T15:11:45.969882+0000","last_undegraded":"2024-03-09T15:11:45.969882+0000","last_fullsized":"2024-03-09T15:11:45.969882+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":463,"num_read_kb":29388,"num_write":1134,"num_write_kb":42312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.696319+0000","last_change":"2024-03-09T14:26:30.651988+0000","last_active":"2024-03-09T15:10:56.696319+0000","last_peered":"2024-03-09T15:10:56.696319+0000","last_clean":"2024-03-09T15:10:56.696319+0000","last_became_active":"2024-03-09T14:26:30.651683+0000","last_became_peered":"2024-03-09T14:26:30.651683+0000","last_unstale":"2024-03-09T15:10:56.696319+0000","last_undegraded":"2024-03-09T15:10:56.696319+0000","last_fullsized":"2024-03-09T15:10:56.696319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'84","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.126855+0000","last_change":"2024-03-09T15:12:04.126890+0000","last_active":"2024-03-09T15:12:04.126855+0000","last_peered":"2024-03-09T15:12:04.126855+0000","last_clean":"2024-03-09T15:12:04.126855+0000","last_became_active":"2024-03-09T14:26:32.656995+0000","last_became_peered":"2024-03-09T14:26:32.656995+0000","last_unstale":"2024-03-09T15:12:04.126855+0000","last_undegraded":"2024-03-09T15:12:04.126855+0000","last_fullsized":"2024-03-09T15:12:04.126855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-03-09T15:12:04.126765+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-03-09T15:12:04.126765+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.126765+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:29:25.687030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":86,"num_read_kb":83,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.143170+0000","last_change":"2024-03-09T15:12:00.143212+0000","last_active":"2024-03-09T15:12:00.143170+0000","last_peered":"2024-03-09T15:12:00.143170+0000","last_clean":"2024-03-09T15:12:00.143170+0000","last_became_active":"2024-03-09T14:26:34.666326+0000","last_became_peered":"2024-03-09T14:26:34.666326+0000","last_unstale":"2024-03-09T15:12:00.143170+0000","last_undegraded":"2024-03-09T15:12:00.143170+0000","last_fullsized":"2024-03-09T15:12:00.143170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:00.143034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:00.143034+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.143034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:46:46.627453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'117","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.468997+0000","last_change":"2024-03-09T15:12:04.469035+0000","last_active":"2024-03-09T15:12:04.468997+0000","last_peered":"2024-03-09T15:12:04.468997+0000","last_clean":"2024-03-09T15:12:04.468997+0000","last_became_active":"2024-03-09T14:26:36.671071+0000","last_became_peered":"2024-03-09T14:26:36.671071+0000","last_unstale":"2024-03-09T15:12:04.468997+0000","last_undegraded":"2024-03-09T15:12:04.468997+0000","last_fullsized":"2024-03-09T15:12:04.468997+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-03-09T15:12:04.468905+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-03-09T15:12:04.468905+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.468905+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:59:52.388940+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":104,"num_write":246,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'951","reported_seq":2540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.077403+0000","last_change":"2024-03-09T14:26:28.649069+0000","last_active":"2024-03-09T15:10:51.077403+0000","last_peered":"2024-03-09T15:10:51.077403+0000","last_clean":"2024-03-09T15:10:51.077403+0000","last_became_active":"2024-03-09T14:26:28.648586+0000","last_became_peered":"2024-03-09T14:26:28.648586+0000","last_unstale":"2024-03-09T15:10:51.077403+0000","last_undegraded":"2024-03-09T15:10:51.077403+0000","last_fullsized":"2024-03-09T15:10:51.077403+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4258,"num_read_kb":3730,"num_write":1359,"num_write_kb":540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'185","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.895563+0000","last_change":"2024-03-09T14:26:26.653314+0000","last_active":"2024-03-09T15:11:45.895563+0000","last_peered":"2024-03-09T15:11:45.895563+0000","last_clean":"2024-03-09T15:11:45.895563+0000","last_became_active":"2024-03-09T14:26:26.652803+0000","last_became_peered":"2024-03-09T14:26:26.652803+0000","last_unstale":"2024-03-09T15:11:45.895563+0000","last_undegraded":"2024-03-09T15:11:45.895563+0000","last_fullsized":"2024-03-09T15:11:45.895563+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":6854,"num_write":972,"num_write_kb":33721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:01.690054+0000","last_change":"2024-03-09T14:26:30.652950+0000","last_active":"2024-03-09T15:10:01.690054+0000","last_peered":"2024-03-09T15:10:01.690054+0000","last_clean":"2024-03-09T15:10:01.690054+0000","last_became_active":"2024-03-09T14:26:30.652699+0000","last_became_peered":"2024-03-09T14:26:30.652699+0000","last_unstale":"2024-03-09T15:10:01.690054+0000","last_undegraded":"2024-03-09T15:10:01.690054+0000","last_fullsized":"2024-03-09T15:10:01.690054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'103","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.845603+0000","last_change":"2024-03-09T15:11:56.845640+0000","last_active":"2024-03-09T15:11:56.845603+0000","last_peered":"2024-03-09T15:11:56.845603+0000","last_clean":"2024-03-09T15:11:56.845603+0000","last_became_active":"2024-03-09T14:26:32.658348+0000","last_became_peered":"2024-03-09T14:26:32.658348+0000","last_unstale":"2024-03-09T15:11:56.845603+0000","last_undegraded":"2024-03-09T15:11:56.845603+0000","last_fullsized":"2024-03-09T15:11:56.845603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'103","last_scrub_stamp":"2024-03-09T15:11:56.845520+0000","last_deep_scrub":"264'103","last_deep_scrub_stamp":"2024-03-09T15:11:56.845520+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.845520+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:59:30.263896+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'532","reported_seq":1967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.988103+0000","last_change":"2024-03-09T14:26:34.674301+0000","last_active":"2024-03-09T15:11:45.988103+0000","last_peered":"2024-03-09T15:11:45.988103+0000","last_clean":"2024-03-09T15:11:45.988103+0000","last_became_active":"2024-03-09T14:26:34.673916+0000","last_became_peered":"2024-03-09T14:26:34.673916+0000","last_unstale":"2024-03-09T15:11:45.988103+0000","last_undegraded":"2024-03-09T15:11:45.988103+0000","last_fullsized":"2024-03-09T15:11:45.988103+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'207","reported_seq":1018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.154737+0000","last_change":"2024-03-09T15:11:53.154775+0000","last_active":"2024-03-09T15:11:53.154737+0000","last_peered":"2024-03-09T15:11:53.154737+0000","last_clean":"2024-03-09T15:11:53.154737+0000","last_became_active":"2024-03-09T14:26:36.786202+0000","last_became_peered":"2024-03-09T14:26:36.786202+0000","last_unstale":"2024-03-09T15:11:53.154737+0000","last_undegraded":"2024-03-09T15:11:53.154737+0000","last_fullsized":"2024-03-09T15:11:53.154737+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-03-09T15:11:53.154651+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-03-09T15:11:53.154651+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.154651+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:25:55.897162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":555,"num_write":450,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'733","reported_seq":2332,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.076770+0000","last_change":"2024-03-09T14:26:28.658592+0000","last_active":"2024-03-09T15:10:51.076770+0000","last_peered":"2024-03-09T15:10:51.076770+0000","last_clean":"2024-03-09T15:10:51.076770+0000","last_became_active":"2024-03-09T14:26:28.657030+0000","last_became_peered":"2024-03-09T14:26:28.657030+0000","last_unstale":"2024-03-09T15:10:51.076770+0000","last_undegraded":"2024-03-09T15:10:51.076770+0000","last_fullsized":"2024-03-09T15:10:51.076770+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3495,"num_read_kb":3179,"num_write":956,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'234","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.939789+0000","last_change":"2024-03-09T14:26:26.644365+0000","last_active":"2024-03-09T15:11:45.939789+0000","last_peered":"2024-03-09T15:11:45.939789+0000","last_clean":"2024-03-09T15:11:45.939789+0000","last_became_active":"2024-03-09T14:26:26.643877+0000","last_became_peered":"2024-03-09T14:26:26.643877+0000","last_unstale":"2024-03-09T15:11:45.939789+0000","last_undegraded":"2024-03-09T15:11:45.939789+0000","last_fullsized":"2024-03-09T15:11:45.939789+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":619,"num_read_kb":42109,"num_write":1108,"num_write_kb":38892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:01.590918+0000","last_change":"2024-03-09T14:26:30.651051+0000","last_active":"2024-03-09T15:10:01.590918+0000","last_peered":"2024-03-09T15:10:01.590918+0000","last_clean":"2024-03-09T15:10:01.590918+0000","last_became_active":"2024-03-09T14:26:30.650741+0000","last_became_peered":"2024-03-09T14:26:30.650741+0000","last_unstale":"2024-03-09T15:10:01.590918+0000","last_undegraded":"2024-03-09T15:10:01.590918+0000","last_fullsized":"2024-03-09T15:10:01.590918+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'145","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.705297+0000","last_change":"2024-03-09T14:26:32.869163+0000","last_active":"2024-03-09T15:11:45.705297+0000","last_peered":"2024-03-09T15:11:45.705297+0000","last_clean":"2024-03-09T15:11:45.705297+0000","last_became_active":"2024-03-09T14:26:32.868081+0000","last_became_peered":"2024-03-09T14:26:32.868081+0000","last_unstale":"2024-03-09T15:11:45.705297+0000","last_undegraded":"2024-03-09T15:11:45.705297+0000","last_fullsized":"2024-03-09T15:11:45.705297+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7737,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":240,"num_write":102,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'565","reported_seq":4034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.044373+0000","last_change":"2024-03-09T15:12:08.044409+0000","last_active":"2024-03-09T15:12:08.044373+0000","last_peered":"2024-03-09T15:12:08.044373+0000","last_clean":"2024-03-09T15:12:08.044373+0000","last_became_active":"2024-03-09T14:26:34.679280+0000","last_became_peered":"2024-03-09T14:26:34.679280+0000","last_unstale":"2024-03-09T15:12:08.044373+0000","last_undegraded":"2024-03-09T15:12:08.044373+0000","last_fullsized":"2024-03-09T15:12:08.044373+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'565","last_scrub_stamp":"2024-03-09T15:12:08.044279+0000","last_deep_scrub":"264'565","last_deep_scrub_stamp":"2024-03-09T15:12:08.044279+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.044279+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:14.925666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'336","reported_seq":1682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.322511+0000","last_change":"2024-03-09T14:26:28.646029+0000","last_active":"2024-03-09T15:11:51.322511+0000","last_peered":"2024-03-09T15:11:51.322511+0000","last_clean":"2024-03-09T15:11:51.322511+0000","last_became_active":"2024-03-09T14:26:28.645600+0000","last_became_peered":"2024-03-09T14:26:28.645600+0000","last_unstale":"2024-03-09T15:11:51.322511+0000","last_undegraded":"2024-03-09T15:11:51.322511+0000","last_fullsized":"2024-03-09T15:11:51.322511+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1869,"num_read_kb":1759,"num_write":401,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'208","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.874455+0000","last_change":"2024-03-09T14:26:26.652521+0000","last_active":"2024-03-09T15:11:45.874455+0000","last_peered":"2024-03-09T15:11:45.874455+0000","last_clean":"2024-03-09T15:11:45.874455+0000","last_became_active":"2024-03-09T14:26:26.652163+0000","last_became_peered":"2024-03-09T14:26:26.652163+0000","last_unstale":"2024-03-09T15:11:45.874455+0000","last_undegraded":"2024-03-09T15:11:45.874455+0000","last_fullsized":"2024-03-09T15:11:45.874455+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263243,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":85490,"num_write":1165,"num_write_kb":31492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.256345+0000","last_change":"2024-03-09T14:26:30.648514+0000","last_active":"2024-03-09T15:11:52.256345+0000","last_peered":"2024-03-09T15:11:52.256345+0000","last_clean":"2024-03-09T15:11:52.256345+0000","last_became_active":"2024-03-09T14:26:30.648227+0000","last_became_peered":"2024-03-09T14:26:30.648227+0000","last_unstale":"2024-03-09T15:11:52.256345+0000","last_undegraded":"2024-03-09T15:11:52.256345+0000","last_fullsized":"2024-03-09T15:11:52.256345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'213","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.363997+0000","last_change":"2024-03-09T15:12:04.364047+0000","last_active":"2024-03-09T15:12:04.363997+0000","last_peered":"2024-03-09T15:12:04.363997+0000","last_clean":"2024-03-09T15:12:04.363997+0000","last_became_active":"2024-03-09T14:26:32.868020+0000","last_became_peered":"2024-03-09T14:26:32.868020+0000","last_unstale":"2024-03-09T15:12:04.363997+0000","last_undegraded":"2024-03-09T15:12:04.363997+0000","last_fullsized":"2024-03-09T15:12:04.363997+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-03-09T15:12:04.363892+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-03-09T15:12:04.363892+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.363892+0000","objects_scrubbed":9,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:51:51.117538+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":278,"num_read_kb":313,"num_write":162,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.588513+0000","last_change":"2024-03-09T14:26:34.666827+0000","last_active":"2024-03-09T15:11:36.588513+0000","last_peered":"2024-03-09T15:11:36.588513+0000","last_clean":"2024-03-09T15:11:36.588513+0000","last_became_active":"2024-03-09T14:26:34.666539+0000","last_became_peered":"2024-03-09T14:26:34.666539+0000","last_unstale":"2024-03-09T15:11:36.588513+0000","last_undegraded":"2024-03-09T15:11:36.588513+0000","last_fullsized":"2024-03-09T15:11:36.588513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'540","reported_seq":1355,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.359325+0000","last_change":"2024-03-09T15:12:00.359359+0000","last_active":"2024-03-09T15:12:00.359325+0000","last_peered":"2024-03-09T15:12:00.359325+0000","last_clean":"2024-03-09T15:12:00.359325+0000","last_became_active":"2024-03-09T14:26:36.672173+0000","last_became_peered":"2024-03-09T14:26:36.672173+0000","last_unstale":"2024-03-09T15:12:00.359325+0000","last_undegraded":"2024-03-09T15:12:00.359325+0000","last_fullsized":"2024-03-09T15:12:00.359325+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'540","last_scrub_stamp":"2024-03-09T15:12:00.359237+0000","last_deep_scrub":"264'540","last_deep_scrub_stamp":"2024-03-09T15:12:00.359237+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.359237+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:34:05.613372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1288,"num_read_kb":1278,"num_write":1107,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'870","reported_seq":2473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.072798+0000","last_change":"2024-03-09T15:12:08.072839+0000","last_active":"2024-03-09T15:12:08.072798+0000","last_peered":"2024-03-09T15:12:08.072798+0000","last_clean":"2024-03-09T15:12:08.072798+0000","last_became_active":"2024-03-09T14:26:28.655572+0000","last_became_peered":"2024-03-09T14:26:28.655572+0000","last_unstale":"2024-03-09T15:12:08.072798+0000","last_undegraded":"2024-03-09T15:12:08.072798+0000","last_fullsized":"2024-03-09T15:12:08.072798+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'870","last_scrub_stamp":"2024-03-09T15:12:08.072716+0000","last_deep_scrub":"264'870","last_deep_scrub_stamp":"2024-03-09T15:12:08.072716+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.072716+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:03:01.925355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4137,"num_read_kb":3672,"num_write":1196,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1528,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'214","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.941304+0000","last_change":"2024-03-09T14:26:26.654328+0000","last_active":"2024-03-09T15:11:45.941304+0000","last_peered":"2024-03-09T15:11:45.941304+0000","last_clean":"2024-03-09T15:11:45.941304+0000","last_became_active":"2024-03-09T14:26:26.653969+0000","last_became_peered":"2024-03-09T14:26:26.653969+0000","last_unstale":"2024-03-09T15:11:45.941304+0000","last_undegraded":"2024-03-09T15:11:45.941304+0000","last_fullsized":"2024-03-09T15:11:45.941304+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":36496,"num_write":1173,"num_write_kb":46772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.901424+0000","last_change":"2024-03-09T15:12:04.901453+0000","last_active":"2024-03-09T15:12:04.901424+0000","last_peered":"2024-03-09T15:12:04.901424+0000","last_clean":"2024-03-09T15:12:04.901424+0000","last_became_active":"2024-03-09T14:26:30.646765+0000","last_became_peered":"2024-03-09T14:26:30.646765+0000","last_unstale":"2024-03-09T15:12:04.901424+0000","last_undegraded":"2024-03-09T15:12:04.901424+0000","last_fullsized":"2024-03-09T15:12:04.901424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:04.901323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:04.901323+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.901323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:29:11.810512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'122","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.913835+0000","last_change":"2024-03-09T14:26:32.655422+0000","last_active":"2024-03-09T15:11:45.913835+0000","last_peered":"2024-03-09T15:11:45.913835+0000","last_clean":"2024-03-09T15:11:45.913835+0000","last_became_active":"2024-03-09T14:26:32.655037+0000","last_became_peered":"2024-03-09T14:26:32.655037+0000","last_unstale":"2024-03-09T15:11:45.913835+0000","last_undegraded":"2024-03-09T15:11:45.913835+0000","last_fullsized":"2024-03-09T15:11:45.913835+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":177,"num_write":74,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.054160+0000","last_change":"2024-03-09T15:12:11.054199+0000","last_active":"2024-03-09T15:12:11.054160+0000","last_peered":"2024-03-09T15:12:11.054160+0000","last_clean":"2024-03-09T15:12:11.054160+0000","last_became_active":"2024-03-09T14:26:34.678525+0000","last_became_peered":"2024-03-09T14:26:34.678525+0000","last_unstale":"2024-03-09T15:12:11.054160+0000","last_undegraded":"2024-03-09T15:12:11.054160+0000","last_fullsized":"2024-03-09T15:12:11.054160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:11.054057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:11.054057+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.054057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:04:56.057745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2466","reported_seq":4891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.275932+0000","last_change":"2024-03-09T15:12:10.275999+0000","last_active":"2024-03-09T15:12:10.275932+0000","last_peered":"2024-03-09T15:12:10.275932+0000","last_clean":"2024-03-09T15:12:10.275932+0000","last_became_active":"2024-03-09T14:26:36.671204+0000","last_became_peered":"2024-03-09T14:26:36.671204+0000","last_unstale":"2024-03-09T15:12:10.275932+0000","last_undegraded":"2024-03-09T15:12:10.275932+0000","last_fullsized":"2024-03-09T15:12:10.275932+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2466","last_scrub_stamp":"2024-03-09T15:12:10.275825+0000","last_deep_scrub":"264'2466","last_deep_scrub_stamp":"2024-03-09T15:12:10.275825+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.275825+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":2400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:58.222088+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6722,"num_read_kb":6726,"num_write":4987,"num_write_kb":1828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'375","reported_seq":1951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.268535+0000","last_change":"2024-03-09T15:12:11.268564+0000","last_active":"2024-03-09T15:12:11.268535+0000","last_peered":"2024-03-09T15:12:11.268535+0000","last_clean":"2024-03-09T15:12:11.268535+0000","last_became_active":"2024-03-09T14:26:28.648620+0000","last_became_peered":"2024-03-09T14:26:28.648620+0000","last_unstale":"2024-03-09T15:12:11.268535+0000","last_undegraded":"2024-03-09T15:12:11.268535+0000","last_fullsized":"2024-03-09T15:12:11.268535+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-03-09T15:12:11.268447+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-03-09T15:12:11.268447+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.268447+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:36.954188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2195,"num_write":437,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'221","reported_seq":1112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.978358+0000","last_change":"2024-03-09T14:26:26.653520+0000","last_active":"2024-03-09T15:11:45.978358+0000","last_peered":"2024-03-09T15:11:45.978358+0000","last_clean":"2024-03-09T15:11:45.978358+0000","last_became_active":"2024-03-09T14:26:26.653181+0000","last_became_peered":"2024-03-09T14:26:26.653181+0000","last_unstale":"2024-03-09T15:11:45.978358+0000","last_undegraded":"2024-03-09T15:11:45.978358+0000","last_fullsized":"2024-03-09T15:11:45.978358+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194373,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1046,"num_read_kb":176280,"num_write":1134,"num_write_kb":52674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.583348+0000","last_change":"2024-03-09T14:26:30.646000+0000","last_active":"2024-03-09T15:11:31.583348+0000","last_peered":"2024-03-09T15:11:31.583348+0000","last_clean":"2024-03-09T15:11:31.583348+0000","last_became_active":"2024-03-09T14:26:30.645656+0000","last_became_peered":"2024-03-09T14:26:30.645656+0000","last_unstale":"2024-03-09T15:11:31.583348+0000","last_undegraded":"2024-03-09T15:11:31.583348+0000","last_fullsized":"2024-03-09T15:11:31.583348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'172","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.256426+0000","last_change":"2024-03-09T14:26:32.657586+0000","last_active":"2024-03-09T15:11:52.256426+0000","last_peered":"2024-03-09T15:11:52.256426+0000","last_clean":"2024-03-09T15:11:52.256426+0000","last_became_active":"2024-03-09T14:26:32.657144+0000","last_became_peered":"2024-03-09T14:26:32.657144+0000","last_unstale":"2024-03-09T15:11:52.256426+0000","last_undegraded":"2024-03-09T15:11:52.256426+0000","last_fullsized":"2024-03-09T15:11:52.256426+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6043,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":209,"num_read_kb":276,"num_write":118,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'544","reported_seq":1940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.017842+0000","last_change":"2024-03-09T14:26:34.668104+0000","last_active":"2024-03-09T15:11:49.017842+0000","last_peered":"2024-03-09T15:11:49.017842+0000","last_clean":"2024-03-09T15:11:49.017842+0000","last_became_active":"2024-03-09T14:26:34.667795+0000","last_became_peered":"2024-03-09T14:26:34.667795+0000","last_unstale":"2024-03-09T15:11:49.017842+0000","last_undegraded":"2024-03-09T15:11:49.017842+0000","last_fullsized":"2024-03-09T15:11:49.017842+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'112","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.443257+0000","last_change":"2024-03-09T15:12:02.443257+0000","last_active":"2024-03-09T15:12:02.443257+0000","last_peered":"2024-03-09T15:12:02.443257+0000","last_clean":"2024-03-09T15:12:02.443257+0000","last_became_active":"2024-03-09T14:26:36.671635+0000","last_became_peered":"2024-03-09T14:26:36.671635+0000","last_unstale":"2024-03-09T15:12:02.443257+0000","last_undegraded":"2024-03-09T15:12:02.443257+0000","last_fullsized":"2024-03-09T15:12:02.443257+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-03-09T15:12:02.443069+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-03-09T15:12:02.443069+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.443069+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:03:53.401726+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":89,"num_write":251,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'431","reported_seq":1950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.596704+0000","last_change":"2024-03-09T14:26:28.645748+0000","last_active":"2024-03-09T15:11:31.596704+0000","last_peered":"2024-03-09T15:11:31.596704+0000","last_clean":"2024-03-09T15:11:31.596704+0000","last_became_active":"2024-03-09T14:26:28.645215+0000","last_became_peered":"2024-03-09T14:26:28.645215+0000","last_unstale":"2024-03-09T15:11:31.596704+0000","last_undegraded":"2024-03-09T15:11:31.596704+0000","last_fullsized":"2024-03-09T15:11:31.596704+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2276,"num_read_kb":2131,"num_write":518,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'218","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.936482+0000","last_change":"2024-03-09T14:26:26.640453+0000","last_active":"2024-03-09T15:11:45.936482+0000","last_peered":"2024-03-09T15:11:45.936482+0000","last_clean":"2024-03-09T15:11:45.936482+0000","last_became_active":"2024-03-09T14:26:26.639784+0000","last_became_peered":"2024-03-09T14:26:26.639784+0000","last_unstale":"2024-03-09T15:11:45.936482+0000","last_undegraded":"2024-03-09T15:11:45.936482+0000","last_fullsized":"2024-03-09T15:11:45.936482+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048623,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":725,"num_read_kb":41897,"num_write":1164,"num_write_kb":44648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.880769+0000","last_change":"2024-03-09T15:12:00.880795+0000","last_active":"2024-03-09T15:12:00.880769+0000","last_peered":"2024-03-09T15:12:00.880769+0000","last_clean":"2024-03-09T15:12:00.880769+0000","last_became_active":"2024-03-09T14:26:30.652726+0000","last_became_peered":"2024-03-09T14:26:30.652726+0000","last_unstale":"2024-03-09T15:12:00.880769+0000","last_undegraded":"2024-03-09T15:12:00.880769+0000","last_fullsized":"2024-03-09T15:12:00.880769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:00.880676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:00.880676+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.880676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:24:25.796674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'182","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.017701+0000","last_change":"2024-03-09T14:26:32.653345+0000","last_active":"2024-03-09T15:11:49.017701+0000","last_peered":"2024-03-09T15:11:49.017701+0000","last_clean":"2024-03-09T15:11:49.017701+0000","last_became_active":"2024-03-09T14:26:32.653026+0000","last_became_peered":"2024-03-09T14:26:32.653026+0000","last_unstale":"2024-03-09T15:11:49.017701+0000","last_undegraded":"2024-03-09T15:11:49.017701+0000","last_fullsized":"2024-03-09T15:11:49.017701+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8197,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":250,"num_read_kb":316,"num_write":112,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.758985+0000","last_change":"2024-03-09T15:11:51.758985+0000","last_active":"2024-03-09T15:11:51.758985+0000","last_peered":"2024-03-09T15:11:51.758985+0000","last_clean":"2024-03-09T15:11:51.758985+0000","last_became_active":"2024-03-09T14:26:34.673715+0000","last_became_peered":"2024-03-09T14:26:34.673715+0000","last_unstale":"2024-03-09T15:11:51.758985+0000","last_undegraded":"2024-03-09T15:11:51.758985+0000","last_fullsized":"2024-03-09T15:11:51.758985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:11:51.758812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:11:51.758812+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.758812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:01:51.947493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'123","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.928141+0000","last_change":"2024-03-09T15:12:00.928141+0000","last_active":"2024-03-09T15:12:00.928141+0000","last_peered":"2024-03-09T15:12:00.928141+0000","last_clean":"2024-03-09T15:12:00.928141+0000","last_became_active":"2024-03-09T14:26:36.672843+0000","last_became_peered":"2024-03-09T14:26:36.672843+0000","last_unstale":"2024-03-09T15:12:00.928141+0000","last_undegraded":"2024-03-09T15:12:00.928141+0000","last_fullsized":"2024-03-09T15:12:00.928141+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'123","last_scrub_stamp":"2024-03-09T15:12:00.928002+0000","last_deep_scrub":"264'123","last_deep_scrub_stamp":"2024-03-09T15:12:00.928002+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.928002+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:02:24.575451+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":286,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'745","reported_seq":2334,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.493735+0000","last_change":"2024-03-09T14:26:28.657382+0000","last_active":"2024-03-09T15:11:31.493735+0000","last_peered":"2024-03-09T15:11:31.493735+0000","last_clean":"2024-03-09T15:11:31.493735+0000","last_became_active":"2024-03-09T14:26:28.656983+0000","last_became_peered":"2024-03-09T14:26:28.656983+0000","last_unstale":"2024-03-09T15:11:31.493735+0000","last_undegraded":"2024-03-09T15:11:31.493735+0000","last_fullsized":"2024-03-09T15:11:31.493735+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3462,"num_read_kb":3140,"num_write":976,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'178","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.896895+0000","last_change":"2024-03-09T15:11:59.896895+0000","last_active":"2024-03-09T15:11:59.896895+0000","last_peered":"2024-03-09T15:11:59.896895+0000","last_clean":"2024-03-09T15:11:59.896895+0000","last_became_active":"2024-03-09T14:27:03.724370+0000","last_became_peered":"2024-03-09T14:27:03.724370+0000","last_unstale":"2024-03-09T15:11:59.896895+0000","last_undegraded":"2024-03-09T15:11:59.896895+0000","last_fullsized":"2024-03-09T15:11:59.896895+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-03-09T15:11:59.896739+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-03-09T15:11:59.896739+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.896739+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:55:55.773250+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":389,"num_read_kb":32223,"num_write":1032,"num_write_kb":26912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.896555+0000","last_change":"2024-03-09T15:11:58.896581+0000","last_active":"2024-03-09T15:11:58.896555+0000","last_peered":"2024-03-09T15:11:58.896555+0000","last_clean":"2024-03-09T15:11:58.896555+0000","last_became_active":"2024-03-09T14:26:30.653184+0000","last_became_peered":"2024-03-09T14:26:30.653184+0000","last_unstale":"2024-03-09T15:11:58.896555+0000","last_undegraded":"2024-03-09T15:11:58.896555+0000","last_fullsized":"2024-03-09T15:11:58.896555+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:11:58.896456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:11:58.896456+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.896456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:41:39.300580+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'158","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.948777+0000","last_change":"2024-03-09T14:26:32.653203+0000","last_active":"2024-03-09T15:11:45.948777+0000","last_peered":"2024-03-09T15:11:45.948777+0000","last_clean":"2024-03-09T15:11:45.948777+0000","last_became_active":"2024-03-09T14:26:32.652956+0000","last_became_peered":"2024-03-09T14:26:32.652956+0000","last_unstale":"2024-03-09T15:11:45.948777+0000","last_undegraded":"2024-03-09T15:11:45.948777+0000","last_fullsized":"2024-03-09T15:11:45.948777+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7924,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":318,"num_write":180,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:46.598623+0000","last_change":"2024-03-09T14:26:34.675619+0000","last_active":"2024-03-09T15:11:46.598623+0000","last_peered":"2024-03-09T15:11:46.598623+0000","last_clean":"2024-03-09T15:11:46.598623+0000","last_became_active":"2024-03-09T14:26:34.675354+0000","last_became_peered":"2024-03-09T14:26:34.675354+0000","last_unstale":"2024-03-09T15:11:46.598623+0000","last_undegraded":"2024-03-09T15:11:46.598623+0000","last_fullsized":"2024-03-09T15:11:46.598623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'147","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.084705+0000","last_change":"2024-03-09T15:12:07.084756+0000","last_active":"2024-03-09T15:12:07.084705+0000","last_peered":"2024-03-09T15:12:07.084705+0000","last_clean":"2024-03-09T15:12:07.084705+0000","last_became_active":"2024-03-09T14:26:36.672111+0000","last_became_peered":"2024-03-09T14:26:36.672111+0000","last_unstale":"2024-03-09T15:12:07.084705+0000","last_undegraded":"2024-03-09T15:12:07.084705+0000","last_fullsized":"2024-03-09T15:12:07.084705+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-03-09T15:12:07.084592+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-03-09T15:12:07.084592+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.084592+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:46:57.461652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":110,"num_write":237,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'512","reported_seq":1991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.102653+0000","last_change":"2024-03-09T15:12:11.102714+0000","last_active":"2024-03-09T15:12:11.102653+0000","last_peered":"2024-03-09T15:12:11.102653+0000","last_clean":"2024-03-09T15:12:11.102653+0000","last_became_active":"2024-03-09T14:26:28.650560+0000","last_became_peered":"2024-03-09T14:26:28.650560+0000","last_unstale":"2024-03-09T15:12:11.102653+0000","last_undegraded":"2024-03-09T15:12:11.102653+0000","last_fullsized":"2024-03-09T15:12:11.102653+0000","mapping_epoch":25,"log_start":"264'501","ondisk_log_start":"264'501","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'512","last_scrub_stamp":"2024-03-09T15:12:11.102538+0000","last_deep_scrub":"264'512","last_deep_scrub_stamp":"2024-03-09T15:12:11.102538+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.102538+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":501,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:13:10.878275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2567,"num_read_kb":2395,"num_write":702,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'170","reported_seq":752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.789038+0000","last_change":"2024-03-09T14:26:26.644672+0000","last_active":"2024-03-09T15:11:51.789038+0000","last_peered":"2024-03-09T15:11:51.789038+0000","last_clean":"2024-03-09T15:11:51.789038+0000","last_became_active":"2024-03-09T14:26:26.644347+0000","last_became_peered":"2024-03-09T14:26:26.644347+0000","last_unstale":"2024-03-09T15:11:51.789038+0000","last_undegraded":"2024-03-09T15:11:51.789038+0000","last_fullsized":"2024-03-09T15:11:51.789038+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456529,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":342,"num_read_kb":3953,"num_write":941,"num_write_kb":27527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.930413+0000","last_change":"2024-03-09T15:12:03.930452+0000","last_active":"2024-03-09T15:12:03.930413+0000","last_peered":"2024-03-09T15:12:03.930413+0000","last_clean":"2024-03-09T15:12:03.930413+0000","last_became_active":"2024-03-09T14:26:30.654575+0000","last_became_peered":"2024-03-09T14:26:30.654575+0000","last_unstale":"2024-03-09T15:12:03.930413+0000","last_undegraded":"2024-03-09T15:12:03.930413+0000","last_fullsized":"2024-03-09T15:12:03.930413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:03.930331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:03.930331+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.930331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:07:07.118362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'151","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.795915+0000","last_change":"2024-03-09T15:11:54.795964+0000","last_active":"2024-03-09T15:11:54.795915+0000","last_peered":"2024-03-09T15:11:54.795915+0000","last_clean":"2024-03-09T15:11:54.795915+0000","last_became_active":"2024-03-09T14:26:32.659984+0000","last_became_peered":"2024-03-09T14:26:32.659984+0000","last_unstale":"2024-03-09T15:11:54.795915+0000","last_undegraded":"2024-03-09T15:11:54.795915+0000","last_fullsized":"2024-03-09T15:11:54.795915+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-03-09T15:11:54.795827+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-03-09T15:11:54.795827+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.795827+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:07.483041+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12965,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":276,"num_write":112,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'506","reported_seq":2232,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.759668+0000","last_change":"2024-03-09T15:11:52.759691+0000","last_active":"2024-03-09T15:11:52.759668+0000","last_peered":"2024-03-09T15:11:52.759668+0000","last_clean":"2024-03-09T15:11:52.759668+0000","last_became_active":"2024-03-09T14:26:34.673054+0000","last_became_peered":"2024-03-09T14:26:34.673054+0000","last_unstale":"2024-03-09T15:11:52.759668+0000","last_undegraded":"2024-03-09T15:11:52.759668+0000","last_fullsized":"2024-03-09T15:11:52.759668+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'506","last_scrub_stamp":"2024-03-09T15:11:52.759595+0000","last_deep_scrub":"264'506","last_deep_scrub_stamp":"2024-03-09T15:11:52.759595+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.759595+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:53.620306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'97","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.594765+0000","last_change":"2024-03-09T14:26:36.668508+0000","last_active":"2024-03-09T15:10:36.594765+0000","last_peered":"2024-03-09T15:10:36.594765+0000","last_clean":"2024-03-09T15:10:36.594765+0000","last_became_active":"2024-03-09T14:26:36.668217+0000","last_became_peered":"2024-03-09T14:26:36.668217+0000","last_unstale":"2024-03-09T15:10:36.594765+0000","last_undegraded":"2024-03-09T15:10:36.594765+0000","last_fullsized":"2024-03-09T15:10:36.594765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":82,"num_write":217,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'678","reported_seq":2378,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.493797+0000","last_change":"2024-03-09T14:26:28.648677+0000","last_active":"2024-03-09T15:11:31.493797+0000","last_peered":"2024-03-09T15:11:31.493797+0000","last_clean":"2024-03-09T15:11:31.493797+0000","last_became_active":"2024-03-09T14:26:28.648408+0000","last_became_peered":"2024-03-09T14:26:28.648408+0000","last_unstale":"2024-03-09T15:11:31.493797+0000","last_undegraded":"2024-03-09T15:11:31.493797+0000","last_fullsized":"2024-03-09T15:11:31.493797+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3385,"num_read_kb":3042,"num_write":948,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'222","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.860588+0000","last_change":"2024-03-09T14:26:26.643846+0000","last_active":"2024-03-09T15:11:50.860588+0000","last_peered":"2024-03-09T15:11:50.860588+0000","last_clean":"2024-03-09T15:11:50.860588+0000","last_became_active":"2024-03-09T14:26:26.643522+0000","last_became_peered":"2024-03-09T14:26:26.643522+0000","last_unstale":"2024-03-09T15:11:50.860588+0000","last_undegraded":"2024-03-09T15:11:50.860588+0000","last_fullsized":"2024-03-09T15:11:50.860588+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718714,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":452,"num_read_kb":51521,"num_write":1235,"num_write_kb":50999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.614676+0000","last_change":"2024-03-09T14:26:30.652855+0000","last_active":"2024-03-09T15:11:45.614676+0000","last_peered":"2024-03-09T15:11:45.614676+0000","last_clean":"2024-03-09T15:11:45.614676+0000","last_became_active":"2024-03-09T14:26:30.652594+0000","last_became_peered":"2024-03-09T14:26:30.652594+0000","last_unstale":"2024-03-09T15:11:45.614676+0000","last_undegraded":"2024-03-09T15:11:45.614676+0000","last_fullsized":"2024-03-09T15:11:45.614676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":630,"num_read_kb":630,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'78","reported_seq":589,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.490757+0000","last_change":"2024-03-09T14:26:32.868538+0000","last_active":"2024-03-09T15:11:36.490757+0000","last_peered":"2024-03-09T15:11:36.490757+0000","last_clean":"2024-03-09T15:11:36.490757+0000","last_became_active":"2024-03-09T14:26:32.868147+0000","last_became_peered":"2024-03-09T14:26:32.868147+0000","last_unstale":"2024-03-09T15:11:36.490757+0000","last_undegraded":"2024-03-09T15:11:36.490757+0000","last_fullsized":"2024-03-09T15:11:36.490757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'535","reported_seq":2296,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.309739+0000","last_change":"2024-03-09T15:12:04.309767+0000","last_active":"2024-03-09T15:12:04.309739+0000","last_peered":"2024-03-09T15:12:04.309739+0000","last_clean":"2024-03-09T15:12:04.309739+0000","last_became_active":"2024-03-09T14:26:34.669695+0000","last_became_peered":"2024-03-09T14:26:34.669695+0000","last_unstale":"2024-03-09T15:12:04.309739+0000","last_undegraded":"2024-03-09T15:12:04.309739+0000","last_fullsized":"2024-03-09T15:12:04.309739+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'535","last_scrub_stamp":"2024-03-09T15:12:04.309652+0000","last_deep_scrub":"264'535","last_deep_scrub_stamp":"2024-03-09T15:12:04.309652+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.309652+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:43:08.557837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'143","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.218119+0000","last_change":"2024-03-09T15:11:57.218148+0000","last_active":"2024-03-09T15:11:57.218119+0000","last_peered":"2024-03-09T15:11:57.218119+0000","last_clean":"2024-03-09T15:11:57.218119+0000","last_became_active":"2024-03-09T14:26:36.668361+0000","last_became_peered":"2024-03-09T14:26:36.668361+0000","last_unstale":"2024-03-09T15:11:57.218119+0000","last_undegraded":"2024-03-09T15:11:57.218119+0000","last_fullsized":"2024-03-09T15:11:57.218119+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'143","last_scrub_stamp":"2024-03-09T15:11:57.218031+0000","last_deep_scrub":"264'143","last_deep_scrub_stamp":"2024-03-09T15:11:57.218031+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.218031+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:15:02.428364+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":387,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":346,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'485","reported_seq":2117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.588569+0000","last_change":"2024-03-09T14:26:28.654782+0000","last_active":"2024-03-09T15:11:36.588569+0000","last_peered":"2024-03-09T15:11:36.588569+0000","last_clean":"2024-03-09T15:11:36.588569+0000","last_became_active":"2024-03-09T14:26:28.654325+0000","last_became_peered":"2024-03-09T14:26:28.654325+0000","last_unstale":"2024-03-09T15:11:36.588569+0000","last_undegraded":"2024-03-09T15:11:36.588569+0000","last_fullsized":"2024-03-09T15:11:36.588569+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2761,"num_read_kb":2604,"num_write":649,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'188","reported_seq":779,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395058+0000","last_change":"2024-03-09T14:26:26.652669+0000","last_active":"2024-03-09T15:11:50.395058+0000","last_peered":"2024-03-09T15:11:50.395058+0000","last_clean":"2024-03-09T15:11:50.395058+0000","last_became_active":"2024-03-09T14:26:26.652273+0000","last_became_peered":"2024-03-09T14:26:26.652273+0000","last_unstale":"2024-03-09T15:11:50.395058+0000","last_undegraded":"2024-03-09T15:11:50.395058+0000","last_fullsized":"2024-03-09T15:11:50.395058+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262266,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":15479,"num_write":998,"num_write_kb":26748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.493816+0000","last_change":"2024-03-09T14:26:30.652256+0000","last_active":"2024-03-09T15:11:31.493816+0000","last_peered":"2024-03-09T15:11:31.493816+0000","last_clean":"2024-03-09T15:11:31.493816+0000","last_became_active":"2024-03-09T14:26:30.651949+0000","last_became_peered":"2024-03-09T14:26:30.651949+0000","last_unstale":"2024-03-09T15:11:31.493816+0000","last_undegraded":"2024-03-09T15:11:31.493816+0000","last_fullsized":"2024-03-09T15:11:31.493816+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'195","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.406588+0000","last_change":"2024-03-09T15:12:06.406637+0000","last_active":"2024-03-09T15:12:06.406588+0000","last_peered":"2024-03-09T15:12:06.406588+0000","last_clean":"2024-03-09T15:12:06.406588+0000","last_became_active":"2024-03-09T14:26:32.656959+0000","last_became_peered":"2024-03-09T14:26:32.656959+0000","last_unstale":"2024-03-09T15:12:06.406588+0000","last_undegraded":"2024-03-09T15:12:06.406588+0000","last_fullsized":"2024-03-09T15:12:06.406588+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-03-09T15:12:06.406501+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-03-09T15:12:06.406501+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.406501+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:57:07.294016+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9621,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":264,"num_read_kb":329,"num_write":152,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.297468+0000","last_change":"2024-03-09T15:12:08.297491+0000","last_active":"2024-03-09T15:12:08.297468+0000","last_peered":"2024-03-09T15:12:08.297468+0000","last_clean":"2024-03-09T15:12:08.297468+0000","last_became_active":"2024-03-09T14:26:34.675350+0000","last_became_peered":"2024-03-09T14:26:34.675350+0000","last_unstale":"2024-03-09T15:12:08.297468+0000","last_undegraded":"2024-03-09T15:12:08.297468+0000","last_fullsized":"2024-03-09T15:12:08.297468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:08.297379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:08.297379+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.297379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:13:35.442572+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'124","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.981904+0000","last_change":"2024-03-09T15:11:58.981933+0000","last_active":"2024-03-09T15:11:58.981904+0000","last_peered":"2024-03-09T15:11:58.981904+0000","last_clean":"2024-03-09T15:11:58.981904+0000","last_became_active":"2024-03-09T14:26:36.673059+0000","last_became_peered":"2024-03-09T14:26:36.673059+0000","last_unstale":"2024-03-09T15:11:58.981904+0000","last_undegraded":"2024-03-09T15:11:58.981904+0000","last_fullsized":"2024-03-09T15:11:58.981904+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:11:58.981820+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:11:58.981820+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.981820+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:12.931239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":194,"num_write":274,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'858","reported_seq":2486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.276912+0000","last_change":"2024-03-09T15:12:05.276948+0000","last_active":"2024-03-09T15:12:05.276912+0000","last_peered":"2024-03-09T15:12:05.276912+0000","last_clean":"2024-03-09T15:12:05.276912+0000","last_became_active":"2024-03-09T14:26:28.653261+0000","last_became_peered":"2024-03-09T14:26:28.653261+0000","last_unstale":"2024-03-09T15:12:05.276912+0000","last_undegraded":"2024-03-09T15:12:05.276912+0000","last_fullsized":"2024-03-09T15:12:05.276912+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'858","last_scrub_stamp":"2024-03-09T15:12:05.276825+0000","last_deep_scrub":"264'858","last_deep_scrub_stamp":"2024-03-09T15:12:05.276825+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.276825+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:38:48.151292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3846,"num_read_kb":3440,"num_write":1147,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:21.731439+0000","last_change":"2024-03-09T14:26:13.798768+0000","last_active":"2024-03-09T15:10:21.731439+0000","last_peered":"2024-03-09T15:10:21.731439+0000","last_clean":"2024-03-09T15:10:21.731439+0000","last_became_active":"2024-03-09T14:26:13.797817+0000","last_became_peered":"2024-03-09T14:26:13.797817+0000","last_unstale":"2024-03-09T15:10:21.731439+0000","last_undegraded":"2024-03-09T15:10:21.731439+0000","last_fullsized":"2024-03-09T15:10:21.731439+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_clean_scrub_stamp":"2024-03-09T14:26:12.541311+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.591630+0000","last_change":"2024-03-09T14:26:18.581955+0000","last_active":"2024-03-09T15:10:06.591630+0000","last_peered":"2024-03-09T15:10:06.591630+0000","last_clean":"2024-03-09T15:10:06.591630+0000","last_became_active":"2024-03-09T14:26:18.581598+0000","last_became_peered":"2024-03-09T14:26:18.581598+0000","last_unstale":"2024-03-09T15:10:06.591630+0000","last_undegraded":"2024-03-09T15:10:06.591630+0000","last_fullsized":"2024-03-09T15:10:06.591630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'183","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.966795+0000","last_change":"2024-03-09T14:26:26.645174+0000","last_active":"2024-03-09T15:11:45.966795+0000","last_peered":"2024-03-09T15:11:45.966795+0000","last_clean":"2024-03-09T15:11:45.966795+0000","last_became_active":"2024-03-09T14:26:26.644848+0000","last_became_peered":"2024-03-09T14:26:26.644848+0000","last_unstale":"2024-03-09T15:11:45.966795+0000","last_undegraded":"2024-03-09T15:11:45.966795+0000","last_fullsized":"2024-03-09T15:11:45.966795+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992272,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":345,"num_read_kb":37512,"num_write":1008,"num_write_kb":40555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:16.730779+0000","last_change":"2024-03-09T14:26:30.650647+0000","last_active":"2024-03-09T15:10:16.730779+0000","last_peered":"2024-03-09T15:10:16.730779+0000","last_clean":"2024-03-09T15:10:16.730779+0000","last_became_active":"2024-03-09T14:26:30.650376+0000","last_became_peered":"2024-03-09T14:26:30.650376+0000","last_unstale":"2024-03-09T15:10:16.730779+0000","last_undegraded":"2024-03-09T15:10:16.730779+0000","last_fullsized":"2024-03-09T15:10:16.730779+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'306","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.380281+0000","last_change":"2024-03-09T15:12:05.380281+0000","last_active":"2024-03-09T15:12:05.380281+0000","last_peered":"2024-03-09T15:12:05.380281+0000","last_clean":"2024-03-09T15:12:05.380281+0000","last_became_active":"2024-03-09T14:26:32.657752+0000","last_became_peered":"2024-03-09T14:26:32.657752+0000","last_unstale":"2024-03-09T15:12:05.380281+0000","last_undegraded":"2024-03-09T15:12:05.380281+0000","last_fullsized":"2024-03-09T15:12:05.380281+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-03-09T15:12:05.380113+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-03-09T15:12:05.380113+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.380113+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:03:36.952007+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33862,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":557,"num_read_kb":770,"num_write":482,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89050,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.017831+0000","last_change":"2024-03-09T14:26:34.671261+0000","last_active":"2024-03-09T15:11:49.017831+0000","last_peered":"2024-03-09T15:11:49.017831+0000","last_clean":"2024-03-09T15:11:49.017831+0000","last_became_active":"2024-03-09T14:26:34.670987+0000","last_became_peered":"2024-03-09T14:26:34.670987+0000","last_unstale":"2024-03-09T15:11:49.017831+0000","last_undegraded":"2024-03-09T15:11:49.017831+0000","last_fullsized":"2024-03-09T15:11:49.017831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'204","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.789426+0000","last_change":"2024-03-09T14:26:36.672227+0000","last_active":"2024-03-09T15:11:51.789426+0000","last_peered":"2024-03-09T15:11:51.789426+0000","last_clean":"2024-03-09T15:11:51.789426+0000","last_became_active":"2024-03-09T14:26:36.671941+0000","last_became_peered":"2024-03-09T14:26:36.671941+0000","last_unstale":"2024-03-09T15:11:51.789426+0000","last_undegraded":"2024-03-09T15:11:51.789426+0000","last_fullsized":"2024-03-09T15:11:51.789426+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":432,"num_read_kb":416,"num_write":433,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'391","reported_seq":1983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.017559+0000","last_change":"2024-03-09T14:26:28.652892+0000","last_active":"2024-03-09T15:11:49.017559+0000","last_peered":"2024-03-09T15:11:49.017559+0000","last_clean":"2024-03-09T15:11:49.017559+0000","last_became_active":"2024-03-09T14:26:28.652611+0000","last_became_peered":"2024-03-09T14:26:28.652611+0000","last_unstale":"2024-03-09T15:11:49.017559+0000","last_undegraded":"2024-03-09T15:11:49.017559+0000","last_fullsized":"2024-03-09T15:11:49.017559+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2259,"num_read_kb":2164,"num_write":448,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:26.732356+0000","last_change":"2024-03-09T14:26:18.582346+0000","last_active":"2024-03-09T15:10:26.732356+0000","last_peered":"2024-03-09T15:10:26.732356+0000","last_clean":"2024-03-09T15:10:26.732356+0000","last_became_active":"2024-03-09T14:26:18.581306+0000","last_became_peered":"2024-03-09T14:26:18.581306+0000","last_unstale":"2024-03-09T15:10:26.732356+0000","last_undegraded":"2024-03-09T15:10:26.732356+0000","last_fullsized":"2024-03-09T15:10:26.732356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'137","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.977345+0000","last_change":"2024-03-09T14:26:26.632618+0000","last_active":"2024-03-09T15:11:45.977345+0000","last_peered":"2024-03-09T15:11:45.977345+0000","last_clean":"2024-03-09T15:11:45.977345+0000","last_became_active":"2024-03-09T14:26:26.632272+0000","last_became_peered":"2024-03-09T14:26:26.632272+0000","last_unstale":"2024-03-09T15:11:45.977345+0000","last_undegraded":"2024-03-09T15:11:45.977345+0000","last_fullsized":"2024-03-09T15:11:45.977345+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":283,"num_read_kb":61756,"num_write":788,"num_write_kb":21716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.322656+0000","last_change":"2024-03-09T14:26:30.655248+0000","last_active":"2024-03-09T15:11:51.322656+0000","last_peered":"2024-03-09T15:11:51.322656+0000","last_clean":"2024-03-09T15:11:51.322656+0000","last_became_active":"2024-03-09T14:26:30.654922+0000","last_became_peered":"2024-03-09T14:26:30.654922+0000","last_unstale":"2024-03-09T15:11:51.322656+0000","last_undegraded":"2024-03-09T15:11:51.322656+0000","last_fullsized":"2024-03-09T15:11:51.322656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'702","reported_seq":2100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.942948+0000","last_change":"2024-03-09T15:12:05.943001+0000","last_active":"2024-03-09T15:12:05.942948+0000","last_peered":"2024-03-09T15:12:05.942948+0000","last_clean":"2024-03-09T15:12:05.942948+0000","last_became_active":"2024-03-09T14:26:32.655430+0000","last_became_peered":"2024-03-09T14:26:32.655430+0000","last_unstale":"2024-03-09T15:12:05.942948+0000","last_undegraded":"2024-03-09T15:12:05.942948+0000","last_fullsized":"2024-03-09T15:12:05.942948+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'702","last_scrub_stamp":"2024-03-09T15:12:05.942851+0000","last_deep_scrub":"264'702","last_deep_scrub_stamp":"2024-03-09T15:12:05.942851+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.942851+0000","objects_scrubbed":12,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:10:41.864242+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17414,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":925,"num_read_kb":1078,"num_write":294,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:26.732454+0000","last_change":"2024-03-09T14:26:34.678707+0000","last_active":"2024-03-09T15:10:26.732454+0000","last_peered":"2024-03-09T15:10:26.732454+0000","last_clean":"2024-03-09T15:10:26.732454+0000","last_became_active":"2024-03-09T14:26:34.678431+0000","last_became_peered":"2024-03-09T14:26:34.678431+0000","last_unstale":"2024-03-09T15:10:26.732454+0000","last_undegraded":"2024-03-09T15:10:26.732454+0000","last_fullsized":"2024-03-09T15:10:26.732454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'165","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.020941+0000","last_change":"2024-03-09T15:11:58.020974+0000","last_active":"2024-03-09T15:11:58.020941+0000","last_peered":"2024-03-09T15:11:58.020941+0000","last_clean":"2024-03-09T15:11:58.020941+0000","last_became_active":"2024-03-09T14:26:36.784815+0000","last_became_peered":"2024-03-09T14:26:36.784815+0000","last_unstale":"2024-03-09T15:11:58.020941+0000","last_undegraded":"2024-03-09T15:11:58.020941+0000","last_fullsized":"2024-03-09T15:11:58.020941+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-03-09T15:11:58.020857+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-03-09T15:11:58.020857+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.020857+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:55:16.554222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":213,"num_read_kb":212,"num_write":359,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'794","reported_seq":2459,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.476655+0000","last_change":"2024-03-09T14:26:28.650746+0000","last_active":"2024-03-09T15:11:49.476655+0000","last_peered":"2024-03-09T15:11:49.476655+0000","last_clean":"2024-03-09T15:11:49.476655+0000","last_became_active":"2024-03-09T14:26:28.650409+0000","last_became_peered":"2024-03-09T14:26:28.650409+0000","last_unstale":"2024-03-09T15:11:49.476655+0000","last_undegraded":"2024-03-09T15:11:49.476655+0000","last_fullsized":"2024-03-09T15:11:49.476655+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3830,"num_read_kb":3466,"num_write":1049,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.935160+0000","last_change":"2024-03-09T14:26:18.577541+0000","last_active":"2024-03-09T15:11:49.935160+0000","last_peered":"2024-03-09T15:11:49.935160+0000","last_clean":"2024-03-09T15:11:49.935160+0000","last_became_active":"2024-03-09T14:26:18.577041+0000","last_became_peered":"2024-03-09T14:26:18.577041+0000","last_unstale":"2024-03-09T15:11:49.935160+0000","last_undegraded":"2024-03-09T15:11:49.935160+0000","last_fullsized":"2024-03-09T15:11:49.935160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'176","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.901952+0000","last_change":"2024-03-09T14:26:26.636212+0000","last_active":"2024-03-09T15:11:45.901952+0000","last_peered":"2024-03-09T15:11:45.901952+0000","last_clean":"2024-03-09T15:11:45.901952+0000","last_became_active":"2024-03-09T14:26:26.635771+0000","last_became_peered":"2024-03-09T14:26:26.635771+0000","last_unstale":"2024-03-09T15:11:45.901952+0000","last_undegraded":"2024-03-09T15:11:45.901952+0000","last_fullsized":"2024-03-09T15:11:45.901952+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730144,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":5368,"num_write":1014,"num_write_kb":33352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'7","reported_seq":825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.910474+0000","last_change":"2024-03-09T15:12:02.910518+0000","last_active":"2024-03-09T15:12:02.910474+0000","last_peered":"2024-03-09T15:12:02.910474+0000","last_clean":"2024-03-09T15:12:02.910474+0000","last_became_active":"2024-03-09T14:26:30.650766+0000","last_became_peered":"2024-03-09T14:26:30.650766+0000","last_unstale":"2024-03-09T15:12:02.910474+0000","last_undegraded":"2024-03-09T15:12:02.910474+0000","last_fullsized":"2024-03-09T15:12:02.910474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-03-09T15:12:02.910368+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-03-09T15:12:02.910368+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.910368+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:27.066749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1149,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":787,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'246","reported_seq":1321,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.838335+0000","last_change":"2024-03-09T14:26:32.869468+0000","last_active":"2024-03-09T15:11:38.838335+0000","last_peered":"2024-03-09T15:11:38.838335+0000","last_clean":"2024-03-09T15:11:38.838335+0000","last_became_active":"2024-03-09T14:26:32.868092+0000","last_became_peered":"2024-03-09T14:26:32.868092+0000","last_unstale":"2024-03-09T15:11:38.838335+0000","last_undegraded":"2024-03-09T15:11:38.838335+0000","last_fullsized":"2024-03-09T15:11:38.838335+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":188,"num_read_kb":180,"num_write":173,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:21.588817+0000","last_change":"2024-03-09T14:26:34.666767+0000","last_active":"2024-03-09T15:10:21.588817+0000","last_peered":"2024-03-09T15:10:21.588817+0000","last_clean":"2024-03-09T15:10:21.588817+0000","last_became_active":"2024-03-09T14:26:34.666484+0000","last_became_peered":"2024-03-09T14:26:34.666484+0000","last_unstale":"2024-03-09T15:10:21.588817+0000","last_undegraded":"2024-03-09T15:10:21.588817+0000","last_fullsized":"2024-03-09T15:10:21.588817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'257","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.108568+0000","last_change":"2024-03-09T15:12:05.108604+0000","last_active":"2024-03-09T15:12:05.108568+0000","last_peered":"2024-03-09T15:12:05.108568+0000","last_clean":"2024-03-09T15:12:05.108568+0000","last_became_active":"2024-03-09T14:26:36.674637+0000","last_became_peered":"2024-03-09T14:26:36.674637+0000","last_unstale":"2024-03-09T15:12:05.108568+0000","last_undegraded":"2024-03-09T15:12:05.108568+0000","last_fullsized":"2024-03-09T15:12:05.108568+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-03-09T15:12:05.108478+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-03-09T15:12:05.108478+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.108478+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:01.447168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":491,"num_write":562,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'351","reported_seq":1819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.893714+0000","last_change":"2024-03-09T14:26:28.646960+0000","last_active":"2024-03-09T15:11:07.893714+0000","last_peered":"2024-03-09T15:11:07.893714+0000","last_clean":"2024-03-09T15:11:07.893714+0000","last_became_active":"2024-03-09T14:26:28.646594+0000","last_became_peered":"2024-03-09T14:26:28.646594+0000","last_unstale":"2024-03-09T15:11:07.893714+0000","last_undegraded":"2024-03-09T15:11:07.893714+0000","last_fullsized":"2024-03-09T15:11:07.893714+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1989,"num_read_kb":1907,"num_write":411,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.591588+0000","last_change":"2024-03-09T14:26:18.581769+0000","last_active":"2024-03-09T15:10:06.591588+0000","last_peered":"2024-03-09T15:10:06.591588+0000","last_clean":"2024-03-09T15:10:06.591588+0000","last_became_active":"2024-03-09T14:26:18.581330+0000","last_became_peered":"2024-03-09T14:26:18.581330+0000","last_unstale":"2024-03-09T15:10:06.591588+0000","last_undegraded":"2024-03-09T15:10:06.591588+0000","last_fullsized":"2024-03-09T15:10:06.591588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'265","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.797515+0000","last_change":"2024-03-09T15:11:55.797567+0000","last_active":"2024-03-09T15:11:55.797515+0000","last_peered":"2024-03-09T15:11:55.797515+0000","last_clean":"2024-03-09T15:11:55.797515+0000","last_became_active":"2024-03-09T14:27:03.719517+0000","last_became_peered":"2024-03-09T14:27:03.719517+0000","last_unstale":"2024-03-09T15:11:55.797515+0000","last_undegraded":"2024-03-09T15:11:55.797515+0000","last_fullsized":"2024-03-09T15:11:55.797515+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'265","last_scrub_stamp":"2024-03-09T15:11:55.797417+0000","last_deep_scrub":"264'265","last_deep_scrub_stamp":"2024-03-09T15:11:55.797417+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.797417+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:46:48.759059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1107,"num_read_kb":25709,"num_write":1307,"num_write_kb":24224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:26.589575+0000","last_change":"2024-03-09T14:26:30.646463+0000","last_active":"2024-03-09T15:10:26.589575+0000","last_peered":"2024-03-09T15:10:26.589575+0000","last_clean":"2024-03-09T15:10:26.589575+0000","last_became_active":"2024-03-09T14:26:30.646190+0000","last_became_peered":"2024-03-09T14:26:30.646190+0000","last_unstale":"2024-03-09T15:10:26.589575+0000","last_undegraded":"2024-03-09T15:10:26.589575+0000","last_fullsized":"2024-03-09T15:10:26.589575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'108","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395456+0000","last_change":"2024-03-09T14:26:32.650252+0000","last_active":"2024-03-09T15:11:50.395456+0000","last_peered":"2024-03-09T15:11:50.395456+0000","last_clean":"2024-03-09T15:11:50.395456+0000","last_became_active":"2024-03-09T14:26:32.650020+0000","last_became_peered":"2024-03-09T14:26:32.650020+0000","last_unstale":"2024-03-09T15:11:50.395456+0000","last_undegraded":"2024-03-09T15:11:50.395456+0000","last_fullsized":"2024-03-09T15:11:50.395456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":130,"num_write":96,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.256440+0000","last_change":"2024-03-09T15:12:02.256440+0000","last_active":"2024-03-09T15:12:02.256440+0000","last_peered":"2024-03-09T15:12:02.256440+0000","last_clean":"2024-03-09T15:12:02.256440+0000","last_became_active":"2024-03-09T14:26:34.667409+0000","last_became_peered":"2024-03-09T14:26:34.667409+0000","last_unstale":"2024-03-09T15:12:02.256440+0000","last_undegraded":"2024-03-09T15:12:02.256440+0000","last_fullsized":"2024-03-09T15:12:02.256440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:02.256293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:02.256293+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.256293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:53:04.069399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'129","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.326603+0000","last_change":"2024-03-09T15:11:57.326603+0000","last_active":"2024-03-09T15:11:57.326603+0000","last_peered":"2024-03-09T15:11:57.326603+0000","last_clean":"2024-03-09T15:11:57.326603+0000","last_became_active":"2024-03-09T14:26:36.674343+0000","last_became_peered":"2024-03-09T14:26:36.674343+0000","last_unstale":"2024-03-09T15:11:57.326603+0000","last_undegraded":"2024-03-09T15:11:57.326603+0000","last_fullsized":"2024-03-09T15:11:57.326603+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-03-09T15:11:57.326430+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-03-09T15:11:57.326430+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.326430+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:42.536388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":182,"num_write":308,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'425","reported_seq":2181,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.337931+0000","last_change":"2024-03-09T14:26:28.656196+0000","last_active":"2024-03-09T15:10:45.337931+0000","last_peered":"2024-03-09T15:10:45.337931+0000","last_clean":"2024-03-09T15:10:45.337931+0000","last_became_active":"2024-03-09T14:26:28.655479+0000","last_became_peered":"2024-03-09T14:26:28.655479+0000","last_unstale":"2024-03-09T15:10:45.337931+0000","last_undegraded":"2024-03-09T15:10:45.337931+0000","last_fullsized":"2024-03-09T15:10:45.337931+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2618,"num_read_kb":2506,"num_write":497,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'279","reported_seq":1013,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.943622+0000","last_change":"2024-03-09T14:26:26.650096+0000","last_active":"2024-03-09T15:11:45.943622+0000","last_peered":"2024-03-09T15:11:45.943622+0000","last_clean":"2024-03-09T15:11:45.943622+0000","last_became_active":"2024-03-09T14:26:26.649325+0000","last_became_peered":"2024-03-09T14:26:26.649325+0000","last_unstale":"2024-03-09T15:11:45.943622+0000","last_undegraded":"2024-03-09T15:11:45.943622+0000","last_fullsized":"2024-03-09T15:11:45.943622+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778712,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":954,"num_read_kb":64626,"num_write":1397,"num_write_kb":23267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.579064+0000","last_change":"2024-03-09T14:26:18.579051+0000","last_active":"2024-03-09T15:10:06.579064+0000","last_peered":"2024-03-09T15:10:06.579064+0000","last_clean":"2024-03-09T15:10:06.579064+0000","last_became_active":"2024-03-09T14:26:18.578807+0000","last_became_peered":"2024-03-09T14:26:18.578807+0000","last_unstale":"2024-03-09T15:10:06.579064+0000","last_undegraded":"2024-03-09T15:10:06.579064+0000","last_fullsized":"2024-03-09T15:10:06.579064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:16.588275+0000","last_change":"2024-03-09T14:26:30.648960+0000","last_active":"2024-03-09T15:10:16.588275+0000","last_peered":"2024-03-09T15:10:16.588275+0000","last_clean":"2024-03-09T15:10:16.588275+0000","last_became_active":"2024-03-09T14:26:30.648619+0000","last_became_peered":"2024-03-09T14:26:30.648619+0000","last_unstale":"2024-03-09T15:10:16.588275+0000","last_undegraded":"2024-03-09T15:10:16.588275+0000","last_fullsized":"2024-03-09T15:10:16.588275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'274","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.883082+0000","last_change":"2024-03-09T14:26:32.654402+0000","last_active":"2024-03-09T15:11:45.883082+0000","last_peered":"2024-03-09T15:11:45.883082+0000","last_clean":"2024-03-09T15:11:45.883082+0000","last_became_active":"2024-03-09T14:26:32.653912+0000","last_became_peered":"2024-03-09T14:26:32.653912+0000","last_unstale":"2024-03-09T15:11:45.883082+0000","last_undegraded":"2024-03-09T15:11:45.883082+0000","last_fullsized":"2024-03-09T15:11:45.883082+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16298,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1016,"num_read_kb":1109,"num_write":1512,"num_write_kb":1369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.186036+0000","last_change":"2024-03-09T15:11:59.186062+0000","last_active":"2024-03-09T15:11:59.186036+0000","last_peered":"2024-03-09T15:11:59.186036+0000","last_clean":"2024-03-09T15:11:59.186036+0000","last_became_active":"2024-03-09T14:26:34.675234+0000","last_became_peered":"2024-03-09T14:26:34.675234+0000","last_unstale":"2024-03-09T15:11:59.186036+0000","last_undegraded":"2024-03-09T15:11:59.186036+0000","last_fullsized":"2024-03-09T15:11:59.186036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:11:59.185947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:11:59.185947+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.185947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:15.640797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'167","reported_seq":679,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.426525+0000","last_change":"2024-03-09T15:12:00.426559+0000","last_active":"2024-03-09T15:12:00.426525+0000","last_peered":"2024-03-09T15:12:00.426525+0000","last_clean":"2024-03-09T15:12:00.426525+0000","last_became_active":"2024-03-09T14:26:36.786088+0000","last_became_peered":"2024-03-09T14:26:36.786088+0000","last_unstale":"2024-03-09T15:12:00.426525+0000","last_undegraded":"2024-03-09T15:12:00.426525+0000","last_fullsized":"2024-03-09T15:12:00.426525+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'167","last_scrub_stamp":"2024-03-09T15:12:00.426423+0000","last_deep_scrub":"264'167","last_deep_scrub_stamp":"2024-03-09T15:12:00.426423+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.426423+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:03:18.704412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":687,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":146,"num_write":429,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'835","reported_seq":2539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:07.895106+0000","last_change":"2024-03-09T14:26:28.646272+0000","last_active":"2024-03-09T15:11:07.895106+0000","last_peered":"2024-03-09T15:11:07.895106+0000","last_clean":"2024-03-09T15:11:07.895106+0000","last_became_active":"2024-03-09T14:26:28.645944+0000","last_became_peered":"2024-03-09T14:26:28.645944+0000","last_unstale":"2024-03-09T15:11:07.895106+0000","last_undegraded":"2024-03-09T15:11:07.895106+0000","last_fullsized":"2024-03-09T15:11:07.895106+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4110,"num_read_kb":3687,"num_write":1137,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'200","reported_seq":834,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.828475+0000","last_change":"2024-03-09T14:26:26.640197+0000","last_active":"2024-03-09T15:11:45.828475+0000","last_peered":"2024-03-09T15:11:45.828475+0000","last_clean":"2024-03-09T15:11:45.828475+0000","last_became_active":"2024-03-09T14:26:26.639853+0000","last_became_peered":"2024-03-09T14:26:26.639853+0000","last_unstale":"2024-03-09T15:11:45.828475+0000","last_undegraded":"2024-03-09T15:11:45.828475+0000","last_fullsized":"2024-03-09T15:11:45.828475+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992354,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":10153,"num_write":1145,"num_write_kb":29784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:11.730114+0000","last_change":"2024-03-09T14:26:18.582360+0000","last_active":"2024-03-09T15:10:11.730114+0000","last_peered":"2024-03-09T15:10:11.730114+0000","last_clean":"2024-03-09T15:10:11.730114+0000","last_became_active":"2024-03-09T14:26:18.581750+0000","last_became_peered":"2024-03-09T14:26:18.581750+0000","last_unstale":"2024-03-09T15:10:11.730114+0000","last_undegraded":"2024-03-09T15:10:11.730114+0000","last_fullsized":"2024-03-09T15:10:11.730114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.293255+0000","last_change":"2024-03-09T15:12:03.293296+0000","last_active":"2024-03-09T15:12:03.293255+0000","last_peered":"2024-03-09T15:12:03.293255+0000","last_clean":"2024-03-09T15:12:03.293255+0000","last_became_active":"2024-03-09T14:26:30.649176+0000","last_became_peered":"2024-03-09T14:26:30.649176+0000","last_unstale":"2024-03-09T15:12:03.293255+0000","last_undegraded":"2024-03-09T15:12:03.293255+0000","last_fullsized":"2024-03-09T15:12:03.293255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:03.293087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:03.293087+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.293087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:24.818377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'186","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.840399+0000","last_change":"2024-03-09T14:26:32.868553+0000","last_active":"2024-03-09T15:11:38.840399+0000","last_peered":"2024-03-09T15:11:38.840399+0000","last_clean":"2024-03-09T15:11:38.840399+0000","last_became_active":"2024-03-09T14:26:32.868165+0000","last_became_peered":"2024-03-09T14:26:32.868165+0000","last_unstale":"2024-03-09T15:11:38.840399+0000","last_undegraded":"2024-03-09T15:11:38.840399+0000","last_fullsized":"2024-03-09T15:11:38.840399+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":224,"num_write":210,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'558","reported_seq":2232,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.361436+0000","last_change":"2024-03-09T15:12:02.361470+0000","last_active":"2024-03-09T15:12:02.361436+0000","last_peered":"2024-03-09T15:12:02.361436+0000","last_clean":"2024-03-09T15:12:02.361436+0000","last_became_active":"2024-03-09T14:26:34.672351+0000","last_became_peered":"2024-03-09T14:26:34.672351+0000","last_unstale":"2024-03-09T15:12:02.361436+0000","last_undegraded":"2024-03-09T15:12:02.361436+0000","last_fullsized":"2024-03-09T15:12:02.361436+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'558","last_scrub_stamp":"2024-03-09T15:12:02.361345+0000","last_deep_scrub":"264'558","last_deep_scrub_stamp":"2024-03-09T15:12:02.361345+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.361345+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:21:04.025240+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'124","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.082707+0000","last_change":"2024-03-09T15:12:03.082748+0000","last_active":"2024-03-09T15:12:03.082707+0000","last_peered":"2024-03-09T15:12:03.082707+0000","last_clean":"2024-03-09T15:12:03.082707+0000","last_became_active":"2024-03-09T14:26:36.785453+0000","last_became_peered":"2024-03-09T14:26:36.785453+0000","last_unstale":"2024-03-09T15:12:03.082707+0000","last_undegraded":"2024-03-09T15:12:03.082707+0000","last_fullsized":"2024-03-09T15:12:03.082707+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:12:03.082612+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:12:03.082612+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.082612+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:56.726690+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":860,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":155,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'674","reported_seq":2123,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.126053+0000","last_change":"2024-03-09T14:26:28.656712+0000","last_active":"2024-03-09T15:11:01.126053+0000","last_peered":"2024-03-09T15:11:01.126053+0000","last_clean":"2024-03-09T15:11:01.126053+0000","last_became_active":"2024-03-09T14:26:28.655904+0000","last_became_peered":"2024-03-09T14:26:28.655904+0000","last_unstale":"2024-03-09T15:11:01.126053+0000","last_undegraded":"2024-03-09T15:11:01.126053+0000","last_fullsized":"2024-03-09T15:11:01.126053+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":600,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3203,"num_read_kb":2919,"num_write":883,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'221","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395053+0000","last_change":"2024-03-09T14:26:26.644176+0000","last_active":"2024-03-09T15:11:50.395053+0000","last_peered":"2024-03-09T15:11:50.395053+0000","last_clean":"2024-03-09T15:11:50.395053+0000","last_became_active":"2024-03-09T14:26:26.643087+0000","last_became_peered":"2024-03-09T14:26:26.643087+0000","last_unstale":"2024-03-09T15:11:50.395053+0000","last_undegraded":"2024-03-09T15:11:50.395053+0000","last_fullsized":"2024-03-09T15:11:50.395053+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":456,"num_read_kb":60158,"num_write":1088,"num_write_kb":49675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:46.589738+0000","last_change":"2024-03-09T14:26:18.577844+0000","last_active":"2024-03-09T15:11:46.589738+0000","last_peered":"2024-03-09T15:11:46.589738+0000","last_clean":"2024-03-09T15:11:46.589738+0000","last_became_active":"2024-03-09T14:26:18.577564+0000","last_became_peered":"2024-03-09T14:26:18.577564+0000","last_unstale":"2024-03-09T15:11:46.589738+0000","last_undegraded":"2024-03-09T15:11:46.589738+0000","last_fullsized":"2024-03-09T15:11:46.589738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:16.608789+0000","last_change":"2024-03-09T14:26:30.650699+0000","last_active":"2024-03-09T15:10:16.608789+0000","last_peered":"2024-03-09T15:10:16.608789+0000","last_clean":"2024-03-09T15:10:16.608789+0000","last_became_active":"2024-03-09T14:26:30.650370+0000","last_became_peered":"2024-03-09T14:26:30.650370+0000","last_unstale":"2024-03-09T15:10:16.608789+0000","last_undegraded":"2024-03-09T15:10:16.608789+0000","last_fullsized":"2024-03-09T15:10:16.608789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'107","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.081386+0000","last_change":"2024-03-09T15:12:05.081426+0000","last_active":"2024-03-09T15:12:05.081386+0000","last_peered":"2024-03-09T15:12:05.081386+0000","last_clean":"2024-03-09T15:12:05.081386+0000","last_became_active":"2024-03-09T14:26:32.655285+0000","last_became_peered":"2024-03-09T14:26:32.655285+0000","last_unstale":"2024-03-09T15:12:05.081386+0000","last_undegraded":"2024-03-09T15:12:05.081386+0000","last_fullsized":"2024-03-09T15:12:05.081386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-03-09T15:12:05.081295+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-03-09T15:12:05.081295+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.081295+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:35.530675+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":120,"num_read_kb":114,"num_write":82,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'565","reported_seq":4062,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.991143+0000","last_change":"2024-03-09T14:26:34.678783+0000","last_active":"2024-03-09T15:11:45.991143+0000","last_peered":"2024-03-09T15:11:45.991143+0000","last_clean":"2024-03-09T15:11:45.991143+0000","last_became_active":"2024-03-09T14:26:34.678503+0000","last_became_peered":"2024-03-09T14:26:34.678503+0000","last_unstale":"2024-03-09T15:11:45.991143+0000","last_undegraded":"2024-03-09T15:11:45.991143+0000","last_fullsized":"2024-03-09T15:11:45.991143+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'187","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.442621+0000","last_change":"2024-03-09T15:12:05.442677+0000","last_active":"2024-03-09T15:12:05.442621+0000","last_peered":"2024-03-09T15:12:05.442621+0000","last_clean":"2024-03-09T15:12:05.442621+0000","last_became_active":"2024-03-09T14:26:36.668775+0000","last_became_peered":"2024-03-09T14:26:36.668775+0000","last_unstale":"2024-03-09T15:12:05.442621+0000","last_undegraded":"2024-03-09T15:12:05.442621+0000","last_fullsized":"2024-03-09T15:12:05.442621+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-03-09T15:12:05.442512+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-03-09T15:12:05.442512+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.442512+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:06:37.514099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":97,"num_write":406,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'323","reported_seq":1668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.039206+0000","last_change":"2024-03-09T15:12:09.039241+0000","last_active":"2024-03-09T15:12:09.039206+0000","last_peered":"2024-03-09T15:12:09.039206+0000","last_clean":"2024-03-09T15:12:09.039206+0000","last_became_active":"2024-03-09T14:26:28.653003+0000","last_became_peered":"2024-03-09T14:26:28.653003+0000","last_unstale":"2024-03-09T15:12:09.039206+0000","last_undegraded":"2024-03-09T15:12:09.039206+0000","last_fullsized":"2024-03-09T15:12:09.039206+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-03-09T15:12:09.039101+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-03-09T15:12:09.039101+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.039101+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:16:44.029365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1763,"num_read_kb":1672,"num_write":372,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'241","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.881001+0000","last_change":"2024-03-09T15:11:57.881045+0000","last_active":"2024-03-09T15:11:57.881001+0000","last_peered":"2024-03-09T15:11:57.881001+0000","last_clean":"2024-03-09T15:11:57.881001+0000","last_became_active":"2024-03-09T14:27:03.719395+0000","last_became_peered":"2024-03-09T14:27:03.719395+0000","last_unstale":"2024-03-09T15:11:57.881001+0000","last_undegraded":"2024-03-09T15:11:57.881001+0000","last_fullsized":"2024-03-09T15:11:57.881001+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'241","last_scrub_stamp":"2024-03-09T15:11:57.880900+0000","last_deep_scrub":"264'241","last_deep_scrub_stamp":"2024-03-09T15:11:57.880900+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.880900+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:07:39.960326+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992298,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":20107,"num_write":1293,"num_write_kb":28946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.496786+0000","last_change":"2024-03-09T14:26:18.578318+0000","last_active":"2024-03-09T15:11:51.496786+0000","last_peered":"2024-03-09T15:11:51.496786+0000","last_clean":"2024-03-09T15:11:51.496786+0000","last_became_active":"2024-03-09T14:26:18.577994+0000","last_became_peered":"2024-03-09T14:26:18.577994+0000","last_unstale":"2024-03-09T15:11:51.496786+0000","last_undegraded":"2024-03-09T15:11:51.496786+0000","last_fullsized":"2024-03-09T15:11:51.496786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.693743+0000","last_change":"2024-03-09T14:26:30.649199+0000","last_active":"2024-03-09T15:10:36.693743+0000","last_peered":"2024-03-09T15:10:36.693743+0000","last_clean":"2024-03-09T15:10:36.693743+0000","last_became_active":"2024-03-09T14:26:30.648910+0000","last_became_peered":"2024-03-09T14:26:30.648910+0000","last_unstale":"2024-03-09T15:10:36.693743+0000","last_undegraded":"2024-03-09T15:10:36.693743+0000","last_fullsized":"2024-03-09T15:10:36.693743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'310","reported_seq":1021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.927254+0000","last_change":"2024-03-09T14:26:32.869477+0000","last_active":"2024-03-09T15:11:45.927254+0000","last_peered":"2024-03-09T15:11:45.927254+0000","last_clean":"2024-03-09T15:11:45.927254+0000","last_became_active":"2024-03-09T14:26:32.868370+0000","last_became_peered":"2024-03-09T14:26:32.868370+0000","last_unstale":"2024-03-09T15:11:45.927254+0000","last_undegraded":"2024-03-09T15:11:45.927254+0000","last_fullsized":"2024-03-09T15:11:45.927254+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32196,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":474,"num_read_kb":726,"num_write":246,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:21.692201+0000","last_change":"2024-03-09T14:26:34.673146+0000","last_active":"2024-03-09T15:10:21.692201+0000","last_peered":"2024-03-09T15:10:21.692201+0000","last_clean":"2024-03-09T15:10:21.692201+0000","last_became_active":"2024-03-09T14:26:34.672655+0000","last_became_peered":"2024-03-09T14:26:34.672655+0000","last_unstale":"2024-03-09T15:10:21.692201+0000","last_undegraded":"2024-03-09T15:10:21.692201+0000","last_fullsized":"2024-03-09T15:10:21.692201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'122","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.365413+0000","last_change":"2024-03-09T15:11:53.365460+0000","last_active":"2024-03-09T15:11:53.365413+0000","last_peered":"2024-03-09T15:11:53.365413+0000","last_clean":"2024-03-09T15:11:53.365413+0000","last_became_active":"2024-03-09T14:26:36.678641+0000","last_became_peered":"2024-03-09T14:26:36.678641+0000","last_unstale":"2024-03-09T15:11:53.365413+0000","last_undegraded":"2024-03-09T15:11:53.365413+0000","last_fullsized":"2024-03-09T15:11:53.365413+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'122","last_scrub_stamp":"2024-03-09T15:11:53.365321+0000","last_deep_scrub":"264'122","last_deep_scrub_stamp":"2024-03-09T15:11:53.365321+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.365321+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:24:39.835900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'142","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.442102+0000","last_change":"2024-03-09T15:12:01.442131+0000","last_active":"2024-03-09T15:12:01.442102+0000","last_peered":"2024-03-09T15:12:01.442102+0000","last_clean":"2024-03-09T15:12:01.442102+0000","last_became_active":"2024-03-09T14:26:36.671823+0000","last_became_peered":"2024-03-09T14:26:36.671823+0000","last_unstale":"2024-03-09T15:12:01.442102+0000","last_undegraded":"2024-03-09T15:12:01.442102+0000","last_fullsized":"2024-03-09T15:12:01.442102+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-03-09T15:12:01.441992+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-03-09T15:12:01.441992+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.441992+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:57:30.083070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":220,"num_write":322,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'409","reported_seq":1970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.152990+0000","last_change":"2024-03-09T14:26:28.650708+0000","last_active":"2024-03-09T15:11:37.152990+0000","last_peered":"2024-03-09T15:11:37.152990+0000","last_clean":"2024-03-09T15:11:37.152990+0000","last_became_active":"2024-03-09T14:26:28.649681+0000","last_became_peered":"2024-03-09T14:26:28.649681+0000","last_unstale":"2024-03-09T15:11:37.152990+0000","last_undegraded":"2024-03-09T15:11:37.152990+0000","last_fullsized":"2024-03-09T15:11:37.152990+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2231,"num_read_kb":2115,"num_write":479,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'192","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.977150+0000","last_change":"2024-03-09T14:26:26.644133+0000","last_active":"2024-03-09T15:11:45.977150+0000","last_peered":"2024-03-09T15:11:45.977150+0000","last_clean":"2024-03-09T15:11:45.977150+0000","last_became_active":"2024-03-09T14:26:26.643598+0000","last_became_peered":"2024-03-09T14:26:26.643598+0000","last_unstale":"2024-03-09T15:11:45.977150+0000","last_undegraded":"2024-03-09T15:11:45.977150+0000","last_fullsized":"2024-03-09T15:11:45.977150+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":35501,"num_write":902,"num_write_kb":49168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.942015+0000","last_change":"2024-03-09T15:12:04.942055+0000","last_active":"2024-03-09T15:12:04.942015+0000","last_peered":"2024-03-09T15:12:04.942015+0000","last_clean":"2024-03-09T15:12:04.942015+0000","last_became_active":"2024-03-09T14:26:30.650743+0000","last_became_peered":"2024-03-09T14:26:30.650743+0000","last_unstale":"2024-03-09T15:12:04.942015+0000","last_undegraded":"2024-03-09T15:12:04.942015+0000","last_fullsized":"2024-03-09T15:12:04.942015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:04.941908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:04.941908+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.941908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:48:42.425183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'128","reported_seq":693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.796494+0000","last_change":"2024-03-09T14:26:32.651032+0000","last_active":"2024-03-09T15:11:45.796494+0000","last_peered":"2024-03-09T15:11:45.796494+0000","last_clean":"2024-03-09T15:11:45.796494+0000","last_became_active":"2024-03-09T14:26:32.650770+0000","last_became_peered":"2024-03-09T14:26:32.650770+0000","last_unstale":"2024-03-09T15:11:45.796494+0000","last_undegraded":"2024-03-09T15:11:45.796494+0000","last_fullsized":"2024-03-09T15:11:45.796494+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7550,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":243,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.025231+0000","last_change":"2024-03-09T15:12:09.025268+0000","last_active":"2024-03-09T15:12:09.025231+0000","last_peered":"2024-03-09T15:12:09.025231+0000","last_clean":"2024-03-09T15:12:09.025231+0000","last_became_active":"2024-03-09T14:26:34.678657+0000","last_became_peered":"2024-03-09T14:26:34.678657+0000","last_unstale":"2024-03-09T15:12:09.025231+0000","last_undegraded":"2024-03-09T15:12:09.025231+0000","last_fullsized":"2024-03-09T15:12:09.025231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:09.025137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:09.025137+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.025137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:30:35.785925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'109","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.100876+0000","last_change":"2024-03-09T15:12:04.100945+0000","last_active":"2024-03-09T15:12:04.100876+0000","last_peered":"2024-03-09T15:12:04.100876+0000","last_clean":"2024-03-09T15:12:04.100876+0000","last_became_active":"2024-03-09T14:26:36.678174+0000","last_became_peered":"2024-03-09T14:26:36.678174+0000","last_unstale":"2024-03-09T15:12:04.100876+0000","last_undegraded":"2024-03-09T15:12:04.100876+0000","last_fullsized":"2024-03-09T15:12:04.100876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-03-09T15:12:04.100776+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-03-09T15:12:04.100776+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.100776+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:06:28.140547+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":96,"num_write":259,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'447","reported_seq":2103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.198464+0000","last_change":"2024-03-09T14:26:28.645383+0000","last_active":"2024-03-09T15:11:09.198464+0000","last_peered":"2024-03-09T15:11:09.198464+0000","last_clean":"2024-03-09T15:11:09.198464+0000","last_became_active":"2024-03-09T14:26:28.644951+0000","last_became_peered":"2024-03-09T14:26:28.644951+0000","last_unstale":"2024-03-09T15:11:09.198464+0000","last_undegraded":"2024-03-09T15:11:09.198464+0000","last_fullsized":"2024-03-09T15:11:09.198464+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2607,"num_read_kb":2478,"num_write":564,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'189","reported_seq":802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.924080+0000","last_change":"2024-03-09T14:26:26.652608+0000","last_active":"2024-03-09T15:11:45.924080+0000","last_peered":"2024-03-09T15:11:45.924080+0000","last_clean":"2024-03-09T15:11:45.924080+0000","last_became_active":"2024-03-09T14:26:26.652260+0000","last_became_peered":"2024-03-09T14:26:26.652260+0000","last_unstale":"2024-03-09T15:11:45.924080+0000","last_undegraded":"2024-03-09T15:11:45.924080+0000","last_fullsized":"2024-03-09T15:11:45.924080+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":396,"num_read_kb":5479,"num_write":1053,"num_write_kb":16075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.695709+0000","last_change":"2024-03-09T14:26:30.650065+0000","last_active":"2024-03-09T15:10:51.695709+0000","last_peered":"2024-03-09T15:10:51.695709+0000","last_clean":"2024-03-09T15:10:51.695709+0000","last_became_active":"2024-03-09T14:26:30.649790+0000","last_became_peered":"2024-03-09T14:26:30.649790+0000","last_unstale":"2024-03-09T15:10:51.695709+0000","last_undegraded":"2024-03-09T15:10:51.695709+0000","last_fullsized":"2024-03-09T15:10:51.695709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'56","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.205086+0000","last_change":"2024-03-09T14:26:32.655566+0000","last_active":"2024-03-09T15:11:09.205086+0000","last_peered":"2024-03-09T15:11:09.205086+0000","last_clean":"2024-03-09T15:11:09.205086+0000","last_became_active":"2024-03-09T14:26:32.655269+0000","last_became_peered":"2024-03-09T14:26:32.655269+0000","last_unstale":"2024-03-09T15:11:09.205086+0000","last_undegraded":"2024-03-09T15:11:09.205086+0000","last_fullsized":"2024-03-09T15:11:09.205086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.736470+0000","last_change":"2024-03-09T14:26:34.671491+0000","last_active":"2024-03-09T15:10:56.736470+0000","last_peered":"2024-03-09T15:10:56.736470+0000","last_clean":"2024-03-09T15:10:56.736470+0000","last_became_active":"2024-03-09T14:26:34.671065+0000","last_became_peered":"2024-03-09T14:26:34.671065+0000","last_unstale":"2024-03-09T15:10:56.736470+0000","last_undegraded":"2024-03-09T15:10:56.736470+0000","last_fullsized":"2024-03-09T15:10:56.736470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'189","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.464645+0000","last_change":"2024-03-09T15:12:06.464674+0000","last_active":"2024-03-09T15:12:06.464645+0000","last_peered":"2024-03-09T15:12:06.464645+0000","last_clean":"2024-03-09T15:12:06.464645+0000","last_became_active":"2024-03-09T14:26:36.666762+0000","last_became_peered":"2024-03-09T14:26:36.666762+0000","last_unstale":"2024-03-09T15:12:06.464645+0000","last_undegraded":"2024-03-09T15:12:06.464645+0000","last_fullsized":"2024-03-09T15:12:06.464645+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-03-09T15:12:06.464544+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-03-09T15:12:06.464544+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.464544+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:57:59.260932+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":266,"num_read_kb":261,"num_write":413,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'437","reported_seq":2100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:01.126017+0000","last_change":"2024-03-09T14:26:28.658137+0000","last_active":"2024-03-09T15:11:01.126017+0000","last_peered":"2024-03-09T15:11:01.126017+0000","last_clean":"2024-03-09T15:11:01.126017+0000","last_became_active":"2024-03-09T14:26:28.657024+0000","last_became_peered":"2024-03-09T14:26:28.657024+0000","last_unstale":"2024-03-09T15:11:01.126017+0000","last_undegraded":"2024-03-09T15:11:01.126017+0000","last_fullsized":"2024-03-09T15:11:01.126017+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2592,"num_read_kb":2450,"num_write":527,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'200","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.936056+0000","last_change":"2024-03-09T14:26:26.646837+0000","last_active":"2024-03-09T15:11:45.936056+0000","last_peered":"2024-03-09T15:11:45.936056+0000","last_clean":"2024-03-09T15:11:45.936056+0000","last_became_active":"2024-03-09T14:26:26.646506+0000","last_became_peered":"2024-03-09T14:26:26.646506+0000","last_unstale":"2024-03-09T15:11:45.936056+0000","last_undegraded":"2024-03-09T15:11:45.936056+0000","last_fullsized":"2024-03-09T15:11:45.936056+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680231,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":50376,"num_write":989,"num_write_kb":56973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.735602+0000","last_change":"2024-03-09T14:26:30.652971+0000","last_active":"2024-03-09T15:10:51.735602+0000","last_peered":"2024-03-09T15:10:51.735602+0000","last_clean":"2024-03-09T15:10:51.735602+0000","last_became_active":"2024-03-09T14:26:30.652245+0000","last_became_peered":"2024-03-09T14:26:30.652245+0000","last_unstale":"2024-03-09T15:10:51.735602+0000","last_undegraded":"2024-03-09T15:10:51.735602+0000","last_fullsized":"2024-03-09T15:10:51.735602+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'167","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.698044+0000","last_change":"2024-03-09T14:26:32.652895+0000","last_active":"2024-03-09T15:11:45.698044+0000","last_peered":"2024-03-09T15:11:45.698044+0000","last_clean":"2024-03-09T15:11:45.698044+0000","last_became_active":"2024-03-09T14:26:32.652610+0000","last_became_peered":"2024-03-09T14:26:32.652610+0000","last_unstale":"2024-03-09T15:11:45.698044+0000","last_undegraded":"2024-03-09T15:11:45.698044+0000","last_fullsized":"2024-03-09T15:11:45.698044+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11381,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":311,"num_write":122,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.237273+0000","last_change":"2024-03-09T15:12:00.237310+0000","last_active":"2024-03-09T15:12:00.237273+0000","last_peered":"2024-03-09T15:12:00.237273+0000","last_clean":"2024-03-09T15:12:00.237273+0000","last_became_active":"2024-03-09T14:26:34.667373+0000","last_became_peered":"2024-03-09T14:26:34.667373+0000","last_unstale":"2024-03-09T15:12:00.237273+0000","last_undegraded":"2024-03-09T15:12:00.237273+0000","last_fullsized":"2024-03-09T15:12:00.237273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:00.237122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:00.237122+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.237122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:48:22.922919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'135","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.293978+0000","last_change":"2024-03-09T15:11:56.294011+0000","last_active":"2024-03-09T15:11:56.293978+0000","last_peered":"2024-03-09T15:11:56.293978+0000","last_clean":"2024-03-09T15:11:56.293978+0000","last_became_active":"2024-03-09T14:26:36.678306+0000","last_became_peered":"2024-03-09T14:26:36.678306+0000","last_unstale":"2024-03-09T15:11:56.293978+0000","last_undegraded":"2024-03-09T15:11:56.293978+0000","last_fullsized":"2024-03-09T15:11:56.293978+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'135","last_scrub_stamp":"2024-03-09T15:11:56.293887+0000","last_deep_scrub":"264'135","last_deep_scrub_stamp":"2024-03-09T15:11:56.293887+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.293887+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:56.519336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":110,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'432","reported_seq":2097,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:54.555652+0000","last_change":"2024-03-09T14:26:28.652461+0000","last_active":"2024-03-09T15:10:54.555652+0000","last_peered":"2024-03-09T15:10:54.555652+0000","last_clean":"2024-03-09T15:10:54.555652+0000","last_became_active":"2024-03-09T14:26:28.651640+0000","last_became_peered":"2024-03-09T14:26:28.651640+0000","last_unstale":"2024-03-09T15:10:54.555652+0000","last_undegraded":"2024-03-09T15:10:54.555652+0000","last_fullsized":"2024-03-09T15:10:54.555652+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2590,"num_read_kb":2461,"num_write":546,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'207","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.820233+0000","last_change":"2024-03-09T14:26:26.636955+0000","last_active":"2024-03-09T15:11:45.820233+0000","last_peered":"2024-03-09T15:11:45.820233+0000","last_clean":"2024-03-09T15:11:45.820233+0000","last_became_active":"2024-03-09T14:26:26.636087+0000","last_became_peered":"2024-03-09T14:26:26.636087+0000","last_unstale":"2024-03-09T15:11:45.820233+0000","last_undegraded":"2024-03-09T15:11:45.820233+0000","last_fullsized":"2024-03-09T15:11:45.820233+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":651,"num_read_kb":124750,"num_write":1247,"num_write_kb":18410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.229265+0000","last_change":"2024-03-09T15:11:59.229293+0000","last_active":"2024-03-09T15:11:59.229265+0000","last_peered":"2024-03-09T15:11:59.229265+0000","last_clean":"2024-03-09T15:11:59.229265+0000","last_became_active":"2024-03-09T14:26:30.652925+0000","last_became_peered":"2024-03-09T14:26:30.652925+0000","last_unstale":"2024-03-09T15:11:59.229265+0000","last_undegraded":"2024-03-09T15:11:59.229265+0000","last_fullsized":"2024-03-09T15:11:59.229265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:11:59.229150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:11:59.229150+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.229150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:26:08.349262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'130","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.972783+0000","last_change":"2024-03-09T14:26:32.657556+0000","last_active":"2024-03-09T15:11:45.972783+0000","last_peered":"2024-03-09T15:11:45.972783+0000","last_clean":"2024-03-09T15:11:45.972783+0000","last_became_active":"2024-03-09T14:26:32.657221+0000","last_became_peered":"2024-03-09T14:26:32.657221+0000","last_unstale":"2024-03-09T15:11:45.972783+0000","last_undegraded":"2024-03-09T15:11:45.972783+0000","last_fullsized":"2024-03-09T15:11:45.972783+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24100,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":271,"num_write":84,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.592768+0000","last_change":"2024-03-09T14:26:34.670563+0000","last_active":"2024-03-09T15:10:56.592768+0000","last_peered":"2024-03-09T15:10:56.592768+0000","last_clean":"2024-03-09T15:10:56.592768+0000","last_became_active":"2024-03-09T14:26:34.670283+0000","last_became_peered":"2024-03-09T14:26:34.670283+0000","last_unstale":"2024-03-09T15:10:56.592768+0000","last_undegraded":"2024-03-09T15:10:56.592768+0000","last_fullsized":"2024-03-09T15:10:56.592768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'871","reported_seq":2455,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.263031+0000","last_change":"2024-03-09T15:12:07.263071+0000","last_active":"2024-03-09T15:12:07.263031+0000","last_peered":"2024-03-09T15:12:07.263031+0000","last_clean":"2024-03-09T15:12:07.263031+0000","last_became_active":"2024-03-09T14:26:28.651921+0000","last_became_peered":"2024-03-09T14:26:28.651921+0000","last_unstale":"2024-03-09T15:12:07.263031+0000","last_undegraded":"2024-03-09T15:12:07.263031+0000","last_fullsized":"2024-03-09T15:12:07.263031+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'871","last_scrub_stamp":"2024-03-09T15:12:07.262941+0000","last_deep_scrub":"264'871","last_deep_scrub_stamp":"2024-03-09T15:12:07.262941+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.262941+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:58:27.987184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3929,"num_read_kb":3481,"num_write":1218,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'260","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.768224+0000","last_change":"2024-03-09T15:11:53.768349+0000","last_active":"2024-03-09T15:11:53.768224+0000","last_peered":"2024-03-09T15:11:53.768224+0000","last_clean":"2024-03-09T15:11:53.768224+0000","last_became_active":"2024-03-09T14:27:03.716852+0000","last_became_peered":"2024-03-09T14:27:03.716852+0000","last_unstale":"2024-03-09T15:11:53.768224+0000","last_undegraded":"2024-03-09T15:11:53.768224+0000","last_fullsized":"2024-03-09T15:11:53.768224+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'260","last_scrub_stamp":"2024-03-09T15:11:53.768142+0000","last_deep_scrub":"264'260","last_deep_scrub_stamp":"2024-03-09T15:11:53.768142+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.768142+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:03:13.404383+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524411,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":890,"num_read_kb":7728,"num_write":1384,"num_write_kb":17237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"35'3","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.615124+0000","last_change":"2024-03-09T14:26:30.652021+0000","last_active":"2024-03-09T15:11:45.615124+0000","last_peered":"2024-03-09T15:11:45.615124+0000","last_clean":"2024-03-09T15:11:45.615124+0000","last_became_active":"2024-03-09T14:26:30.651711+0000","last_became_peered":"2024-03-09T14:26:30.651711+0000","last_unstale":"2024-03-09T15:11:45.615124+0000","last_undegraded":"2024-03-09T15:11:45.615124+0000","last_fullsized":"2024-03-09T15:11:45.615124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":482,"num_read_kb":480,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'207","reported_seq":834,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.958130+0000","last_change":"2024-03-09T14:26:32.655679+0000","last_active":"2024-03-09T15:11:45.958130+0000","last_peered":"2024-03-09T15:11:45.958130+0000","last_clean":"2024-03-09T15:11:45.958130+0000","last_became_active":"2024-03-09T14:26:32.655391+0000","last_became_peered":"2024-03-09T14:26:32.655391+0000","last_unstale":"2024-03-09T15:11:45.958130+0000","last_undegraded":"2024-03-09T15:11:45.958130+0000","last_fullsized":"2024-03-09T15:11:45.958130+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39743,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":317,"num_read_kb":534,"num_write":200,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.333298+0000","last_change":"2024-03-09T15:12:01.333337+0000","last_active":"2024-03-09T15:12:01.333298+0000","last_peered":"2024-03-09T15:12:01.333298+0000","last_clean":"2024-03-09T15:12:01.333298+0000","last_became_active":"2024-03-09T14:26:34.675248+0000","last_became_peered":"2024-03-09T14:26:34.675248+0000","last_unstale":"2024-03-09T15:12:01.333298+0000","last_undegraded":"2024-03-09T15:12:01.333298+0000","last_fullsized":"2024-03-09T15:12:01.333298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:01.333180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:01.333180+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.333180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:15.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'188","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.120569+0000","last_change":"2024-03-09T15:12:01.120602+0000","last_active":"2024-03-09T15:12:01.120569+0000","last_peered":"2024-03-09T15:12:01.120569+0000","last_clean":"2024-03-09T15:12:01.120569+0000","last_became_active":"2024-03-09T14:26:36.786403+0000","last_became_peered":"2024-03-09T14:26:36.786403+0000","last_unstale":"2024-03-09T15:12:01.120569+0000","last_undegraded":"2024-03-09T15:12:01.120569+0000","last_fullsized":"2024-03-09T15:12:01.120569+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'188","last_scrub_stamp":"2024-03-09T15:12:01.120487+0000","last_deep_scrub":"264'188","last_deep_scrub_stamp":"2024-03-09T15:12:01.120487+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.120487+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:57:04.326385+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1042,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":213,"num_write":429,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'371","reported_seq":1882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.152663+0000","last_change":"2024-03-09T14:26:28.642746+0000","last_active":"2024-03-09T15:11:37.152663+0000","last_peered":"2024-03-09T15:11:37.152663+0000","last_clean":"2024-03-09T15:11:37.152663+0000","last_became_active":"2024-03-09T14:26:28.642452+0000","last_became_peered":"2024-03-09T14:26:28.642452+0000","last_unstale":"2024-03-09T15:11:37.152663+0000","last_undegraded":"2024-03-09T15:11:37.152663+0000","last_fullsized":"2024-03-09T15:11:37.152663+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2046,"num_read_kb":1963,"num_write":419,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'183","reported_seq":809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.086348+0000","last_change":"2024-03-09T15:11:55.086406+0000","last_active":"2024-03-09T15:11:55.086348+0000","last_peered":"2024-03-09T15:11:55.086348+0000","last_clean":"2024-03-09T15:11:55.086348+0000","last_became_active":"2024-03-09T14:27:03.724521+0000","last_became_peered":"2024-03-09T14:27:03.724521+0000","last_unstale":"2024-03-09T15:11:55.086348+0000","last_undegraded":"2024-03-09T15:11:55.086348+0000","last_fullsized":"2024-03-09T15:11:55.086348+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'183","last_scrub_stamp":"2024-03-09T15:11:55.086218+0000","last_deep_scrub":"264'183","last_deep_scrub_stamp":"2024-03-09T15:11:55.086218+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.086218+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:33:58.839877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1070276,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":327,"num_read_kb":39345,"num_write":965,"num_write_kb":40541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.210029+0000","last_change":"2024-03-09T15:12:01.210053+0000","last_active":"2024-03-09T15:12:01.210029+0000","last_peered":"2024-03-09T15:12:01.210029+0000","last_clean":"2024-03-09T15:12:01.210029+0000","last_became_active":"2024-03-09T14:26:30.652243+0000","last_became_peered":"2024-03-09T14:26:30.652243+0000","last_unstale":"2024-03-09T15:12:01.210029+0000","last_undegraded":"2024-03-09T15:12:01.210029+0000","last_fullsized":"2024-03-09T15:12:01.210029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:01.209942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:01.209942+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.209942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:41:59.901072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'153","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.983215+0000","last_change":"2024-03-09T14:26:32.658910+0000","last_active":"2024-03-09T15:11:45.983215+0000","last_peered":"2024-03-09T15:11:45.983215+0000","last_clean":"2024-03-09T15:11:45.983215+0000","last_became_active":"2024-03-09T14:26:32.658626+0000","last_became_peered":"2024-03-09T14:26:32.658626+0000","last_unstale":"2024-03-09T15:11:45.983215+0000","last_undegraded":"2024-03-09T15:11:45.983215+0000","last_fullsized":"2024-03-09T15:11:45.983215+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13483,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":225,"num_read_kb":299,"num_write":146,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.588536+0000","last_change":"2024-03-09T14:26:34.669777+0000","last_active":"2024-03-09T15:11:36.588536+0000","last_peered":"2024-03-09T15:11:36.588536+0000","last_clean":"2024-03-09T15:11:36.588536+0000","last_became_active":"2024-03-09T14:26:34.669482+0000","last_became_peered":"2024-03-09T14:26:34.669482+0000","last_unstale":"2024-03-09T15:11:36.588536+0000","last_undegraded":"2024-03-09T15:11:36.588536+0000","last_fullsized":"2024-03-09T15:11:36.588536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'220","reported_seq":1404,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.483787+0000","last_change":"2024-03-09T14:26:36.678544+0000","last_active":"2024-03-09T15:11:37.483787+0000","last_peered":"2024-03-09T15:11:37.483787+0000","last_clean":"2024-03-09T15:11:37.483787+0000","last_became_active":"2024-03-09T14:26:36.678232+0000","last_became_peered":"2024-03-09T14:26:36.678232+0000","last_unstale":"2024-03-09T15:11:37.483787+0000","last_undegraded":"2024-03-09T15:11:37.483787+0000","last_fullsized":"2024-03-09T15:11:37.483787+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":941,"num_read_kb":939,"num_write":605,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'431","reported_seq":1928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.151571+0000","last_change":"2024-03-09T14:26:28.658740+0000","last_active":"2024-03-09T15:11:37.151571+0000","last_peered":"2024-03-09T15:11:37.151571+0000","last_clean":"2024-03-09T15:11:37.151571+0000","last_became_active":"2024-03-09T14:26:28.657488+0000","last_became_peered":"2024-03-09T14:26:28.657488+0000","last_unstale":"2024-03-09T15:11:37.151571+0000","last_undegraded":"2024-03-09T15:11:37.151571+0000","last_fullsized":"2024-03-09T15:11:37.151571+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2287,"num_read_kb":2137,"num_write":511,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'198","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.809101+0000","last_change":"2024-03-09T14:26:26.641350+0000","last_active":"2024-03-09T15:11:45.809101+0000","last_peered":"2024-03-09T15:11:45.809101+0000","last_clean":"2024-03-09T15:11:45.809101+0000","last_became_active":"2024-03-09T14:26:26.641003+0000","last_became_peered":"2024-03-09T14:26:26.641003+0000","last_unstale":"2024-03-09T15:11:45.809101+0000","last_undegraded":"2024-03-09T15:11:45.809101+0000","last_fullsized":"2024-03-09T15:11:45.809101+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":32756,"num_write":1157,"num_write_kb":45988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.493753+0000","last_change":"2024-03-09T14:26:30.654064+0000","last_active":"2024-03-09T15:11:31.493753+0000","last_peered":"2024-03-09T15:11:31.493753+0000","last_clean":"2024-03-09T15:11:31.493753+0000","last_became_active":"2024-03-09T14:26:30.653249+0000","last_became_peered":"2024-03-09T14:26:30.653249+0000","last_unstale":"2024-03-09T15:11:31.493753+0000","last_undegraded":"2024-03-09T15:11:31.493753+0000","last_fullsized":"2024-03-09T15:11:31.493753+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'128","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.846117+0000","last_change":"2024-03-09T14:26:32.868697+0000","last_active":"2024-03-09T15:11:45.846117+0000","last_peered":"2024-03-09T15:11:45.846117+0000","last_clean":"2024-03-09T15:11:45.846117+0000","last_became_active":"2024-03-09T14:26:32.868236+0000","last_became_peered":"2024-03-09T14:26:32.868236+0000","last_unstale":"2024-03-09T15:11:45.846117+0000","last_undegraded":"2024-03-09T15:11:45.846117+0000","last_fullsized":"2024-03-09T15:11:45.846117+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7847,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":246,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:41.582957+0000","last_change":"2024-03-09T14:26:34.675615+0000","last_active":"2024-03-09T15:10:41.582957+0000","last_peered":"2024-03-09T15:10:41.582957+0000","last_clean":"2024-03-09T15:10:41.582957+0000","last_became_active":"2024-03-09T14:26:34.675120+0000","last_became_peered":"2024-03-09T14:26:34.675120+0000","last_unstale":"2024-03-09T15:10:41.582957+0000","last_undegraded":"2024-03-09T15:10:41.582957+0000","last_fullsized":"2024-03-09T15:10:41.582957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'107","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.317205+0000","last_change":"2024-03-09T15:11:54.317247+0000","last_active":"2024-03-09T15:11:54.317205+0000","last_peered":"2024-03-09T15:11:54.317205+0000","last_clean":"2024-03-09T15:11:54.317205+0000","last_became_active":"2024-03-09T14:26:36.678521+0000","last_became_peered":"2024-03-09T14:26:36.678521+0000","last_unstale":"2024-03-09T15:11:54.317205+0000","last_undegraded":"2024-03-09T15:11:54.317205+0000","last_fullsized":"2024-03-09T15:11:54.317205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-03-09T15:11:54.317104+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-03-09T15:11:54.317104+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.317104+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:54:32.730793+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":103,"num_write":248,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'325","reported_seq":1741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.583374+0000","last_change":"2024-03-09T14:26:28.648512+0000","last_active":"2024-03-09T15:11:31.583374+0000","last_peered":"2024-03-09T15:11:31.583374+0000","last_clean":"2024-03-09T15:11:31.583374+0000","last_became_active":"2024-03-09T14:26:28.648204+0000","last_became_peered":"2024-03-09T14:26:28.648204+0000","last_unstale":"2024-03-09T15:11:31.583374+0000","last_undegraded":"2024-03-09T15:11:31.583374+0000","last_fullsized":"2024-03-09T15:11:31.583374+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1841,"num_read_kb":1771,"num_write":371,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'202","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.395271+0000","last_change":"2024-03-09T15:11:58.395346+0000","last_active":"2024-03-09T15:11:58.395271+0000","last_peered":"2024-03-09T15:11:58.395271+0000","last_clean":"2024-03-09T15:11:58.395271+0000","last_became_active":"2024-03-09T14:27:03.719292+0000","last_became_peered":"2024-03-09T14:27:03.719292+0000","last_unstale":"2024-03-09T15:11:58.395271+0000","last_undegraded":"2024-03-09T15:11:58.395271+0000","last_fullsized":"2024-03-09T15:11:58.395271+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'202","last_scrub_stamp":"2024-03-09T15:11:58.395179+0000","last_deep_scrub":"264'202","last_deep_scrub_stamp":"2024-03-09T15:11:58.395179+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.395179+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:08.784732+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778707,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":941,"num_read_kb":86830,"num_write":1019,"num_write_kb":33052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.975665+0000","last_change":"2024-03-09T15:12:01.975725+0000","last_active":"2024-03-09T15:12:01.975665+0000","last_peered":"2024-03-09T15:12:01.975665+0000","last_clean":"2024-03-09T15:12:01.975665+0000","last_became_active":"2024-03-09T14:26:30.652190+0000","last_became_peered":"2024-03-09T14:26:30.652190+0000","last_unstale":"2024-03-09T15:12:01.975665+0000","last_undegraded":"2024-03-09T15:12:01.975665+0000","last_fullsized":"2024-03-09T15:12:01.975665+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:01.975568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:01.975568+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.975568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:24.946938+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'89","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.145304+0000","last_change":"2024-03-09T15:12:03.145341+0000","last_active":"2024-03-09T15:12:03.145304+0000","last_peered":"2024-03-09T15:12:03.145304+0000","last_clean":"2024-03-09T15:12:03.145304+0000","last_became_active":"2024-03-09T14:26:32.867985+0000","last_became_peered":"2024-03-09T14:26:32.867985+0000","last_unstale":"2024-03-09T15:12:03.145304+0000","last_undegraded":"2024-03-09T15:12:03.145304+0000","last_fullsized":"2024-03-09T15:12:03.145304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'89","last_scrub_stamp":"2024-03-09T15:12:03.145219+0000","last_deep_scrub":"264'89","last_deep_scrub_stamp":"2024-03-09T15:12:03.145219+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.145219+0000","objects_scrubbed":7,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:52:51.643446+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":100,"num_read_kb":95,"num_write":100,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11222,"num_omap_keys":30,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'535","reported_seq":2054,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.242025+0000","last_change":"2024-03-09T15:11:58.242069+0000","last_active":"2024-03-09T15:11:58.242025+0000","last_peered":"2024-03-09T15:11:58.242025+0000","last_clean":"2024-03-09T15:11:58.242025+0000","last_became_active":"2024-03-09T14:26:34.664708+0000","last_became_peered":"2024-03-09T14:26:34.664708+0000","last_unstale":"2024-03-09T15:11:58.242025+0000","last_undegraded":"2024-03-09T15:11:58.242025+0000","last_fullsized":"2024-03-09T15:11:58.242025+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'535","last_scrub_stamp":"2024-03-09T15:11:58.241917+0000","last_deep_scrub":"264'535","last_deep_scrub_stamp":"2024-03-09T15:11:58.241917+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.241917+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:14.531917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'142","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:56.736432+0000","last_change":"2024-03-09T14:26:36.676199+0000","last_active":"2024-03-09T15:10:56.736432+0000","last_peered":"2024-03-09T15:10:56.736432+0000","last_clean":"2024-03-09T15:10:56.736432+0000","last_became_active":"2024-03-09T14:26:36.675855+0000","last_became_peered":"2024-03-09T14:26:36.675855+0000","last_unstale":"2024-03-09T15:10:56.736432+0000","last_undegraded":"2024-03-09T15:10:56.736432+0000","last_fullsized":"2024-03-09T15:10:56.736432+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":194,"num_write":349,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'797","reported_seq":2330,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.493689+0000","last_change":"2024-03-09T14:26:28.657378+0000","last_active":"2024-03-09T15:11:31.493689+0000","last_peered":"2024-03-09T15:11:31.493689+0000","last_clean":"2024-03-09T15:11:31.493689+0000","last_became_active":"2024-03-09T14:26:28.656940+0000","last_became_peered":"2024-03-09T14:26:28.656940+0000","last_unstale":"2024-03-09T15:11:31.493689+0000","last_undegraded":"2024-03-09T15:11:31.493689+0000","last_fullsized":"2024-03-09T15:11:31.493689+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3613,"num_read_kb":3222,"num_write":1070,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'213","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.962305+0000","last_change":"2024-03-09T14:26:26.641435+0000","last_active":"2024-03-09T15:11:45.962305+0000","last_peered":"2024-03-09T15:11:45.962305+0000","last_clean":"2024-03-09T15:11:45.962305+0000","last_became_active":"2024-03-09T14:26:26.641031+0000","last_became_peered":"2024-03-09T14:26:26.641031+0000","last_unstale":"2024-03-09T15:11:45.962305+0000","last_undegraded":"2024-03-09T15:11:45.962305+0000","last_fullsized":"2024-03-09T15:11:45.962305+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651867,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":2692,"num_write":1154,"num_write_kb":40768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.616333+0000","last_change":"2024-03-09T14:26:30.652643+0000","last_active":"2024-03-09T15:11:31.616333+0000","last_peered":"2024-03-09T15:11:31.616333+0000","last_clean":"2024-03-09T15:11:31.616333+0000","last_became_active":"2024-03-09T14:26:30.652315+0000","last_became_peered":"2024-03-09T14:26:30.652315+0000","last_unstale":"2024-03-09T15:11:31.616333+0000","last_undegraded":"2024-03-09T15:11:31.616333+0000","last_fullsized":"2024-03-09T15:11:31.616333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'170","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.897778+0000","last_change":"2024-03-09T14:26:32.657278+0000","last_active":"2024-03-09T15:11:45.897778+0000","last_peered":"2024-03-09T15:11:45.897778+0000","last_clean":"2024-03-09T15:11:45.897778+0000","last_became_active":"2024-03-09T14:26:32.656973+0000","last_became_peered":"2024-03-09T14:26:32.656973+0000","last_unstale":"2024-03-09T15:11:45.897778+0000","last_undegraded":"2024-03-09T15:11:45.897778+0000","last_fullsized":"2024-03-09T15:11:45.897778+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9391,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":206,"num_read_kb":261,"num_write":118,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.587162+0000","last_change":"2024-03-09T14:26:34.665616+0000","last_active":"2024-03-09T15:10:06.587162+0000","last_peered":"2024-03-09T15:10:06.587162+0000","last_clean":"2024-03-09T15:10:06.587162+0000","last_became_active":"2024-03-09T14:26:34.665208+0000","last_became_peered":"2024-03-09T14:26:34.665208+0000","last_unstale":"2024-03-09T15:10:06.587162+0000","last_undegraded":"2024-03-09T15:10:06.587162+0000","last_fullsized":"2024-03-09T15:10:06.587162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'128","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.184479+0000","last_change":"2024-03-09T14:26:36.678157+0000","last_active":"2024-03-09T15:11:09.184479+0000","last_peered":"2024-03-09T15:11:09.184479+0000","last_clean":"2024-03-09T15:11:09.184479+0000","last_became_active":"2024-03-09T14:26:36.677867+0000","last_became_peered":"2024-03-09T14:26:36.677867+0000","last_unstale":"2024-03-09T15:11:09.184479+0000","last_undegraded":"2024-03-09T15:11:09.184479+0000","last_fullsized":"2024-03-09T15:11:09.184479+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":311,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'826","reported_seq":2509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.082915+0000","last_change":"2024-03-09T15:12:10.082953+0000","last_active":"2024-03-09T15:12:10.082915+0000","last_peered":"2024-03-09T15:12:10.082915+0000","last_clean":"2024-03-09T15:12:10.082915+0000","last_became_active":"2024-03-09T14:26:28.656960+0000","last_became_peered":"2024-03-09T14:26:28.656960+0000","last_unstale":"2024-03-09T15:12:10.082915+0000","last_undegraded":"2024-03-09T15:12:10.082915+0000","last_fullsized":"2024-03-09T15:12:10.082915+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'826","last_scrub_stamp":"2024-03-09T15:12:10.082835+0000","last_deep_scrub":"264'826","last_deep_scrub_stamp":"2024-03-09T15:12:10.082835+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.082835+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:10:39.844814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4034,"num_read_kb":3617,"num_write":1125,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3995,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'217","reported_seq":825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.942875+0000","last_change":"2024-03-09T14:26:26.650356+0000","last_active":"2024-03-09T15:11:45.942875+0000","last_peered":"2024-03-09T15:11:45.942875+0000","last_clean":"2024-03-09T15:11:45.942875+0000","last_became_active":"2024-03-09T14:26:26.649772+0000","last_became_peered":"2024-03-09T14:26:26.649772+0000","last_unstale":"2024-03-09T15:11:45.942875+0000","last_undegraded":"2024-03-09T15:11:45.942875+0000","last_fullsized":"2024-03-09T15:11:45.942875+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":404,"num_read_kb":32014,"num_write":1026,"num_write_kb":48046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.604001+0000","last_change":"2024-03-09T14:26:30.650955+0000","last_active":"2024-03-09T15:11:31.604001+0000","last_peered":"2024-03-09T15:11:31.604001+0000","last_clean":"2024-03-09T15:11:31.604001+0000","last_became_active":"2024-03-09T14:26:30.650674+0000","last_became_peered":"2024-03-09T14:26:30.650674+0000","last_unstale":"2024-03-09T15:11:31.604001+0000","last_undegraded":"2024-03-09T15:11:31.604001+0000","last_fullsized":"2024-03-09T15:11:31.604001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'129","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.905586+0000","last_change":"2024-03-09T14:26:32.653856+0000","last_active":"2024-03-09T15:11:45.905586+0000","last_peered":"2024-03-09T15:11:45.905586+0000","last_clean":"2024-03-09T15:11:45.905586+0000","last_became_active":"2024-03-09T14:26:32.652397+0000","last_became_peered":"2024-03-09T14:26:32.652397+0000","last_unstale":"2024-03-09T15:11:45.905586+0000","last_undegraded":"2024-03-09T15:11:45.905586+0000","last_fullsized":"2024-03-09T15:11:45.905586+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14802,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":258,"num_write":88,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.230076+0000","last_change":"2024-03-09T15:12:06.230103+0000","last_active":"2024-03-09T15:12:06.230076+0000","last_peered":"2024-03-09T15:12:06.230076+0000","last_clean":"2024-03-09T15:12:06.230076+0000","last_became_active":"2024-03-09T14:26:34.671029+0000","last_became_peered":"2024-03-09T14:26:34.671029+0000","last_unstale":"2024-03-09T15:12:06.230076+0000","last_undegraded":"2024-03-09T15:12:06.230076+0000","last_fullsized":"2024-03-09T15:12:06.230076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:06.229979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:06.229979+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.229979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:24:48.116811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'114","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.126415+0000","last_change":"2024-03-09T15:12:00.126469+0000","last_active":"2024-03-09T15:12:00.126415+0000","last_peered":"2024-03-09T15:12:00.126415+0000","last_clean":"2024-03-09T15:12:00.126415+0000","last_became_active":"2024-03-09T14:26:36.786449+0000","last_became_peered":"2024-03-09T14:26:36.786449+0000","last_unstale":"2024-03-09T15:12:00.126415+0000","last_undegraded":"2024-03-09T15:12:00.126415+0000","last_fullsized":"2024-03-09T15:12:00.126415+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-03-09T15:12:00.126288+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-03-09T15:12:00.126288+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.126288+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:22.457832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":178,"num_write":287,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'518","reported_seq":2100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.356877+0000","last_change":"2024-03-09T14:26:28.649113+0000","last_active":"2024-03-09T15:10:35.356877+0000","last_peered":"2024-03-09T15:10:35.356877+0000","last_clean":"2024-03-09T15:10:35.356877+0000","last_became_active":"2024-03-09T14:26:28.647178+0000","last_became_peered":"2024-03-09T14:26:28.647178+0000","last_unstale":"2024-03-09T15:10:35.356877+0000","last_undegraded":"2024-03-09T15:10:35.356877+0000","last_fullsized":"2024-03-09T15:10:35.356877+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2831,"num_read_kb":2584,"num_write":686,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'273","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.978422+0000","last_change":"2024-03-09T14:26:26.643743+0000","last_active":"2024-03-09T15:11:45.978422+0000","last_peered":"2024-03-09T15:11:45.978422+0000","last_clean":"2024-03-09T15:11:45.978422+0000","last_became_active":"2024-03-09T14:26:26.643338+0000","last_became_peered":"2024-03-09T14:26:26.643338+0000","last_unstale":"2024-03-09T15:11:45.978422+0000","last_undegraded":"2024-03-09T15:11:45.978422+0000","last_fullsized":"2024-03-09T15:11:45.978422+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":43219,"num_write":1342,"num_write_kb":45633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:01.606624+0000","last_change":"2024-03-09T14:26:30.648059+0000","last_active":"2024-03-09T15:10:01.606624+0000","last_peered":"2024-03-09T15:10:01.606624+0000","last_clean":"2024-03-09T15:10:01.606624+0000","last_became_active":"2024-03-09T14:26:30.647466+0000","last_became_peered":"2024-03-09T14:26:30.647466+0000","last_unstale":"2024-03-09T15:10:01.606624+0000","last_undegraded":"2024-03-09T15:10:01.606624+0000","last_fullsized":"2024-03-09T15:10:01.606624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'105","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.822921+0000","last_change":"2024-03-09T14:26:32.654369+0000","last_active":"2024-03-09T15:11:45.822921+0000","last_peered":"2024-03-09T15:11:45.822921+0000","last_clean":"2024-03-09T15:11:45.822921+0000","last_became_active":"2024-03-09T14:26:32.654096+0000","last_became_peered":"2024-03-09T14:26:32.654096+0000","last_unstale":"2024-03-09T15:11:45.822921+0000","last_undegraded":"2024-03-09T15:11:45.822921+0000","last_fullsized":"2024-03-09T15:11:45.822921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5925,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":181,"num_write":62,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.101718+0000","last_change":"2024-03-09T15:12:01.101744+0000","last_active":"2024-03-09T15:12:01.101718+0000","last_peered":"2024-03-09T15:12:01.101718+0000","last_clean":"2024-03-09T15:12:01.101718+0000","last_became_active":"2024-03-09T14:26:34.665478+0000","last_became_peered":"2024-03-09T14:26:34.665478+0000","last_unstale":"2024-03-09T15:12:01.101718+0000","last_undegraded":"2024-03-09T15:12:01.101718+0000","last_fullsized":"2024-03-09T15:12:01.101718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:01.101624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:01.101624+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.101624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:26.220172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'118","reported_seq":1776,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.688096+0000","last_change":"2024-03-09T14:26:36.678308+0000","last_active":"2024-03-09T15:11:38.688096+0000","last_peered":"2024-03-09T15:11:38.688096+0000","last_clean":"2024-03-09T15:11:38.688096+0000","last_became_active":"2024-03-09T14:26:36.677953+0000","last_became_peered":"2024-03-09T14:26:36.677953+0000","last_unstale":"2024-03-09T15:11:38.688096+0000","last_undegraded":"2024-03-09T15:11:38.688096+0000","last_fullsized":"2024-03-09T15:11:38.688096+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:35.654136+0000","last_clean_scrub_stamp":"2024-03-09T14:26:35.654136+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1291,"num_read_kb":1290,"num_write":257,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'553","reported_seq":2041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.200467+0000","last_change":"2024-03-09T14:26:28.644942+0000","last_active":"2024-03-09T15:11:09.200467+0000","last_peered":"2024-03-09T15:11:09.200467+0000","last_clean":"2024-03-09T15:11:09.200467+0000","last_became_active":"2024-03-09T14:26:28.644628+0000","last_became_peered":"2024-03-09T14:26:28.644628+0000","last_unstale":"2024-03-09T15:11:09.200467+0000","last_undegraded":"2024-03-09T15:11:09.200467+0000","last_fullsized":"2024-03-09T15:11:09.200467+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2742,"num_read_kb":2524,"num_write":748,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'204","reported_seq":845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.943621+0000","last_change":"2024-03-09T14:26:26.637200+0000","last_active":"2024-03-09T15:11:45.943621+0000","last_peered":"2024-03-09T15:11:45.943621+0000","last_clean":"2024-03-09T15:11:45.943621+0000","last_became_active":"2024-03-09T14:26:26.636600+0000","last_became_peered":"2024-03-09T14:26:26.636600+0000","last_unstale":"2024-03-09T15:11:45.943621+0000","last_undegraded":"2024-03-09T15:11:45.943621+0000","last_fullsized":"2024-03-09T15:11:45.943621+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":15859,"num_write":1037,"num_write_kb":26682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.934512+0000","last_change":"2024-03-09T15:12:02.934542+0000","last_active":"2024-03-09T15:12:02.934512+0000","last_peered":"2024-03-09T15:12:02.934512+0000","last_clean":"2024-03-09T15:12:02.934512+0000","last_became_active":"2024-03-09T14:26:30.650852+0000","last_became_peered":"2024-03-09T14:26:30.650852+0000","last_unstale":"2024-03-09T15:12:02.934512+0000","last_undegraded":"2024-03-09T15:12:02.934512+0000","last_fullsized":"2024-03-09T15:12:02.934512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:02.934422+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:02.934422+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.934422+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:48.652578+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'155","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.026213+0000","last_change":"2024-03-09T15:12:07.026256+0000","last_active":"2024-03-09T15:12:07.026213+0000","last_peered":"2024-03-09T15:12:07.026213+0000","last_clean":"2024-03-09T15:12:07.026213+0000","last_became_active":"2024-03-09T14:26:32.655220+0000","last_became_peered":"2024-03-09T14:26:32.655220+0000","last_unstale":"2024-03-09T15:12:07.026213+0000","last_undegraded":"2024-03-09T15:12:07.026213+0000","last_fullsized":"2024-03-09T15:12:07.026213+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'155","last_scrub_stamp":"2024-03-09T15:12:07.026079+0000","last_deep_scrub":"264'155","last_deep_scrub_stamp":"2024-03-09T15:12:07.026079+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.026079+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:36:29.946374+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6421,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":225,"num_write":106,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.597326+0000","last_change":"2024-03-09T14:26:34.673862+0000","last_active":"2024-03-09T15:11:36.597326+0000","last_peered":"2024-03-09T15:11:36.597326+0000","last_clean":"2024-03-09T15:11:36.597326+0000","last_became_active":"2024-03-09T14:26:34.673572+0000","last_became_peered":"2024-03-09T14:26:34.673572+0000","last_unstale":"2024-03-09T15:11:36.597326+0000","last_undegraded":"2024-03-09T15:11:36.597326+0000","last_fullsized":"2024-03-09T15:11:36.597326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:33.650565+0000","last_clean_scrub_stamp":"2024-03-09T14:26:33.650565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'131","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.183377+0000","last_change":"2024-03-09T15:11:56.183425+0000","last_active":"2024-03-09T15:11:56.183377+0000","last_peered":"2024-03-09T15:11:56.183377+0000","last_clean":"2024-03-09T15:11:56.183377+0000","last_became_active":"2024-03-09T14:26:36.668616+0000","last_became_peered":"2024-03-09T14:26:36.668616+0000","last_unstale":"2024-03-09T15:11:56.183377+0000","last_undegraded":"2024-03-09T15:11:56.183377+0000","last_fullsized":"2024-03-09T15:11:56.183377+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-03-09T15:11:56.183293+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-03-09T15:11:56.183293+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.183293+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:50:57.423599+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":154,"num_write":316,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'645","reported_seq":2234,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.476740+0000","last_change":"2024-03-09T14:26:28.645899+0000","last_active":"2024-03-09T15:11:49.476740+0000","last_peered":"2024-03-09T15:11:49.476740+0000","last_clean":"2024-03-09T15:11:49.476740+0000","last_became_active":"2024-03-09T14:26:28.645626+0000","last_became_peered":"2024-03-09T14:26:28.645626+0000","last_unstale":"2024-03-09T15:11:49.476740+0000","last_undegraded":"2024-03-09T15:11:49.476740+0000","last_fullsized":"2024-03-09T15:11:49.476740+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":600,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3206,"num_read_kb":2874,"num_write":967,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'167","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.793849+0000","last_change":"2024-03-09T14:26:26.652363+0000","last_active":"2024-03-09T15:11:45.793849+0000","last_peered":"2024-03-09T15:11:45.793849+0000","last_clean":"2024-03-09T15:11:45.793849+0000","last_became_active":"2024-03-09T14:26:26.652050+0000","last_became_peered":"2024-03-09T14:26:26.652050+0000","last_unstale":"2024-03-09T15:11:45.793849+0000","last_undegraded":"2024-03-09T15:11:45.793849+0000","last_fullsized":"2024-03-09T15:11:45.793849+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3634858,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":329,"num_read_kb":46066,"num_write":939,"num_write_kb":31825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'424","reported_seq":2031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.476690+0000","last_change":"2024-03-09T14:26:28.652919+0000","last_active":"2024-03-09T15:11:49.476690+0000","last_peered":"2024-03-09T15:11:49.476690+0000","last_clean":"2024-03-09T15:11:49.476690+0000","last_became_active":"2024-03-09T14:26:28.652474+0000","last_became_peered":"2024-03-09T14:26:28.652474+0000","last_unstale":"2024-03-09T15:11:49.476690+0000","last_undegraded":"2024-03-09T15:11:49.476690+0000","last_fullsized":"2024-03-09T15:11:49.476690+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2338,"num_read_kb":2225,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'237","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.939788+0000","last_change":"2024-03-09T14:26:26.636278+0000","last_active":"2024-03-09T15:11:45.939788+0000","last_peered":"2024-03-09T15:11:45.939788+0000","last_clean":"2024-03-09T15:11:45.939788+0000","last_became_active":"2024-03-09T14:26:26.635943+0000","last_became_peered":"2024-03-09T14:26:26.635943+0000","last_unstale":"2024-03-09T15:11:45.939788+0000","last_undegraded":"2024-03-09T15:11:45.939788+0000","last_fullsized":"2024-03-09T15:11:45.939788+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048641,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":547,"num_read_kb":21035,"num_write":1141,"num_write_kb":21105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'402","reported_seq":1828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.322538+0000","last_change":"2024-03-09T14:26:28.646197+0000","last_active":"2024-03-09T15:11:51.322538+0000","last_peered":"2024-03-09T15:11:51.322538+0000","last_clean":"2024-03-09T15:11:51.322538+0000","last_became_active":"2024-03-09T14:26:28.645917+0000","last_became_peered":"2024-03-09T14:26:28.645917+0000","last_unstale":"2024-03-09T15:11:51.322538+0000","last_undegraded":"2024-03-09T15:11:51.322538+0000","last_fullsized":"2024-03-09T15:11:51.322538+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2143,"num_read_kb":1999,"num_write":476,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'197","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.903082+0000","last_change":"2024-03-09T14:26:26.648411+0000","last_active":"2024-03-09T15:11:45.903082+0000","last_peered":"2024-03-09T15:11:45.903082+0000","last_clean":"2024-03-09T15:11:45.903082+0000","last_became_active":"2024-03-09T14:26:26.648084+0000","last_became_peered":"2024-03-09T14:26:26.648084+0000","last_unstale":"2024-03-09T15:11:45.903082+0000","last_undegraded":"2024-03-09T15:11:45.903082+0000","last_fullsized":"2024-03-09T15:11:45.903082+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097599,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":455,"num_read_kb":30660,"num_write":1035,"num_write_kb":42042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'1285","reported_seq":2880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.476695+0000","last_change":"2024-03-09T14:26:28.647203+0000","last_active":"2024-03-09T15:11:49.476695+0000","last_peered":"2024-03-09T15:11:49.476695+0000","last_clean":"2024-03-09T15:11:49.476695+0000","last_became_active":"2024-03-09T14:26:28.646936+0000","last_became_peered":"2024-03-09T14:26:28.646936+0000","last_unstale":"2024-03-09T15:11:49.476695+0000","last_undegraded":"2024-03-09T15:11:49.476695+0000","last_fullsized":"2024-03-09T15:11:49.476695+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5472,"num_read_kb":4757,"num_write":1845,"num_write_kb":841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'173","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.980147+0000","last_change":"2024-03-09T14:26:26.632719+0000","last_active":"2024-03-09T15:11:45.980147+0000","last_peered":"2024-03-09T15:11:45.980147+0000","last_clean":"2024-03-09T15:11:45.980147+0000","last_became_active":"2024-03-09T14:26:26.632394+0000","last_became_peered":"2024-03-09T14:26:26.632394+0000","last_unstale":"2024-03-09T15:11:45.980147+0000","last_undegraded":"2024-03-09T15:11:45.980147+0000","last_fullsized":"2024-03-09T15:11:45.980147+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194317,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":61859,"num_write":999,"num_write_kb":24366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'709","reported_seq":2156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:42.186762+0000","last_change":"2024-03-09T14:26:28.656837+0000","last_active":"2024-03-09T15:10:42.186762+0000","last_peered":"2024-03-09T15:10:42.186762+0000","last_clean":"2024-03-09T15:10:42.186762+0000","last_became_active":"2024-03-09T14:26:28.655549+0000","last_became_peered":"2024-03-09T14:26:28.655549+0000","last_unstale":"2024-03-09T15:10:42.186762+0000","last_undegraded":"2024-03-09T15:10:42.186762+0000","last_fullsized":"2024-03-09T15:10:42.186762+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3228,"num_read_kb":2913,"num_write":936,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'248","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395073+0000","last_change":"2024-03-09T14:26:26.641172+0000","last_active":"2024-03-09T15:11:50.395073+0000","last_peered":"2024-03-09T15:11:50.395073+0000","last_clean":"2024-03-09T15:11:50.395073+0000","last_became_active":"2024-03-09T14:26:26.640874+0000","last_became_peered":"2024-03-09T14:26:26.640874+0000","last_unstale":"2024-03-09T15:11:50.395073+0000","last_undegraded":"2024-03-09T15:11:50.395073+0000","last_fullsized":"2024-03-09T15:11:50.395073+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4477257,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":552,"num_read_kb":47489,"num_write":1247,"num_write_kb":60004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'342","reported_seq":1775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:45.336750+0000","last_change":"2024-03-09T14:26:28.645684+0000","last_active":"2024-03-09T15:10:45.336750+0000","last_peered":"2024-03-09T15:10:45.336750+0000","last_clean":"2024-03-09T15:10:45.336750+0000","last_became_active":"2024-03-09T14:26:28.645393+0000","last_became_peered":"2024-03-09T14:26:28.645393+0000","last_unstale":"2024-03-09T15:10:45.336750+0000","last_undegraded":"2024-03-09T15:10:45.336750+0000","last_fullsized":"2024-03-09T15:10:45.336750+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1972,"num_read_kb":1873,"num_write":396,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'185","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.476543+0000","last_change":"2024-03-09T14:26:26.631389+0000","last_active":"2024-03-09T15:11:49.476543+0000","last_peered":"2024-03-09T15:11:49.476543+0000","last_clean":"2024-03-09T15:11:49.476543+0000","last_became_active":"2024-03-09T14:26:26.631046+0000","last_became_peered":"2024-03-09T14:26:26.631046+0000","last_unstale":"2024-03-09T15:11:49.476543+0000","last_undegraded":"2024-03-09T15:11:49.476543+0000","last_fullsized":"2024-03-09T15:11:49.476543+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":463,"num_read_kb":18518,"num_write":1084,"num_write_kb":23654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'765","reported_seq":2187,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.200343+0000","last_change":"2024-03-09T14:26:28.652220+0000","last_active":"2024-03-09T15:11:09.200343+0000","last_peered":"2024-03-09T15:11:09.200343+0000","last_clean":"2024-03-09T15:11:09.200343+0000","last_became_active":"2024-03-09T14:26:28.651945+0000","last_became_peered":"2024-03-09T14:26:28.651945+0000","last_unstale":"2024-03-09T15:11:09.200343+0000","last_undegraded":"2024-03-09T15:11:09.200343+0000","last_fullsized":"2024-03-09T15:11:09.200343+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3422,"num_read_kb":3025,"num_write":1046,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'210","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.789107+0000","last_change":"2024-03-09T14:26:26.645774+0000","last_active":"2024-03-09T15:11:51.789107+0000","last_peered":"2024-03-09T15:11:51.789107+0000","last_clean":"2024-03-09T15:11:51.789107+0000","last_became_active":"2024-03-09T14:26:26.645379+0000","last_became_peered":"2024-03-09T14:26:26.645379+0000","last_unstale":"2024-03-09T15:11:51.789107+0000","last_undegraded":"2024-03-09T15:11:51.789107+0000","last_fullsized":"2024-03-09T15:11:51.789107+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2265,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":547,"num_read_kb":953,"num_write":1107,"num_write_kb":19452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'1203","reported_seq":2807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.279208+0000","last_change":"2024-03-09T15:12:09.279239+0000","last_active":"2024-03-09T15:12:09.279208+0000","last_peered":"2024-03-09T15:12:09.279208+0000","last_clean":"2024-03-09T15:12:09.279208+0000","last_became_active":"2024-03-09T14:26:28.651254+0000","last_became_peered":"2024-03-09T14:26:28.651254+0000","last_unstale":"2024-03-09T15:12:09.279208+0000","last_undegraded":"2024-03-09T15:12:09.279208+0000","last_fullsized":"2024-03-09T15:12:09.279208+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1203","last_scrub_stamp":"2024-03-09T15:12:09.279118+0000","last_deep_scrub":"264'1203","last_deep_scrub_stamp":"2024-03-09T15:12:09.279118+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.279118+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":1100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:59:28.674500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5174,"num_read_kb":4521,"num_write":1709,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'218","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395143+0000","last_change":"2024-03-09T14:26:26.640461+0000","last_active":"2024-03-09T15:11:50.395143+0000","last_peered":"2024-03-09T15:11:50.395143+0000","last_clean":"2024-03-09T15:11:50.395143+0000","last_became_active":"2024-03-09T14:26:26.639719+0000","last_became_peered":"2024-03-09T14:26:26.639719+0000","last_unstale":"2024-03-09T15:11:50.395143+0000","last_undegraded":"2024-03-09T15:11:50.395143+0000","last_fullsized":"2024-03-09T15:11:50.395143+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3186960,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":530,"num_read_kb":50172,"num_write":1173,"num_write_kb":33138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1152","reported_seq":2679,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.152434+0000","last_change":"2024-03-09T14:26:28.648946+0000","last_active":"2024-03-09T15:11:37.152434+0000","last_peered":"2024-03-09T15:11:37.152434+0000","last_clean":"2024-03-09T15:11:37.152434+0000","last_became_active":"2024-03-09T14:26:28.648626+0000","last_became_peered":"2024-03-09T14:26:28.648626+0000","last_unstale":"2024-03-09T15:11:37.152434+0000","last_undegraded":"2024-03-09T15:11:37.152434+0000","last_fullsized":"2024-03-09T15:11:37.152434+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4796,"num_read_kb":4189,"num_write":1590,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'192","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.322376+0000","last_change":"2024-03-09T14:26:26.640526+0000","last_active":"2024-03-09T15:11:51.322376+0000","last_peered":"2024-03-09T15:11:51.322376+0000","last_clean":"2024-03-09T15:11:51.322376+0000","last_became_active":"2024-03-09T14:26:26.640157+0000","last_became_peered":"2024-03-09T14:26:26.640157+0000","last_unstale":"2024-03-09T15:11:51.322376+0000","last_undegraded":"2024-03-09T15:11:51.322376+0000","last_fullsized":"2024-03-09T15:11:51.322376+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":19261,"num_write":1003,"num_write_kb":28212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'708","reported_seq":2135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.613705+0000","last_change":"2024-03-09T14:26:28.650311+0000","last_active":"2024-03-09T15:10:51.613705+0000","last_peered":"2024-03-09T15:10:51.613705+0000","last_clean":"2024-03-09T15:10:51.613705+0000","last_became_active":"2024-03-09T14:26:28.650013+0000","last_became_peered":"2024-03-09T14:26:28.650013+0000","last_unstale":"2024-03-09T15:10:51.613705+0000","last_undegraded":"2024-03-09T15:10:51.613705+0000","last_fullsized":"2024-03-09T15:10:51.613705+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":600,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3189,"num_read_kb":2865,"num_write":935,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'212","reported_seq":858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.981234+0000","last_change":"2024-03-09T14:26:26.642035+0000","last_active":"2024-03-09T15:11:45.981234+0000","last_peered":"2024-03-09T15:11:45.981234+0000","last_clean":"2024-03-09T15:11:45.981234+0000","last_became_active":"2024-03-09T14:26:26.641737+0000","last_became_peered":"2024-03-09T14:26:26.641737+0000","last_unstale":"2024-03-09T15:11:45.981234+0000","last_undegraded":"2024-03-09T15:11:45.981234+0000","last_fullsized":"2024-03-09T15:11:45.981234+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262754,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":32584,"num_write":1138,"num_write_kb":28426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'421","reported_seq":2054,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:41.584419+0000","last_change":"2024-03-09T14:26:28.644372+0000","last_active":"2024-03-09T15:11:41.584419+0000","last_peered":"2024-03-09T15:11:41.584419+0000","last_clean":"2024-03-09T15:11:41.584419+0000","last_became_active":"2024-03-09T14:26:28.644094+0000","last_became_peered":"2024-03-09T14:26:28.644094+0000","last_unstale":"2024-03-09T15:11:41.584419+0000","last_undegraded":"2024-03-09T15:11:41.584419+0000","last_fullsized":"2024-03-09T15:11:41.584419+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2230,"num_write":484,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'212","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.817171+0000","last_change":"2024-03-09T14:26:26.645771+0000","last_active":"2024-03-09T15:11:45.817171+0000","last_peered":"2024-03-09T15:11:45.817171+0000","last_clean":"2024-03-09T15:11:45.817171+0000","last_became_active":"2024-03-09T14:26:26.645413+0000","last_became_peered":"2024-03-09T14:26:26.645413+0000","last_unstale":"2024-03-09T15:11:45.817171+0000","last_undegraded":"2024-03-09T15:11:45.817171+0000","last_fullsized":"2024-03-09T15:11:45.817171+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262161,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":457,"num_read_kb":3495,"num_write":1054,"num_write_kb":12293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'790","reported_seq":2458,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.493713+0000","last_change":"2024-03-09T14:26:28.650961+0000","last_active":"2024-03-09T15:11:31.493713+0000","last_peered":"2024-03-09T15:11:31.493713+0000","last_clean":"2024-03-09T15:11:31.493713+0000","last_became_active":"2024-03-09T14:26:28.650629+0000","last_became_peered":"2024-03-09T14:26:28.650629+0000","last_unstale":"2024-03-09T15:11:31.493713+0000","last_undegraded":"2024-03-09T15:11:31.493713+0000","last_fullsized":"2024-03-09T15:11:31.493713+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3842,"num_read_kb":3483,"num_write":1039,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'234","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.977735+0000","last_change":"2024-03-09T14:26:26.644786+0000","last_active":"2024-03-09T15:11:45.977735+0000","last_peered":"2024-03-09T15:11:45.977735+0000","last_clean":"2024-03-09T15:11:45.977735+0000","last_became_active":"2024-03-09T14:26:26.644358+0000","last_became_peered":"2024-03-09T14:26:26.644358+0000","last_unstale":"2024-03-09T15:11:45.977735+0000","last_undegraded":"2024-03-09T15:11:45.977735+0000","last_fullsized":"2024-03-09T15:11:45.977735+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":7434,"num_write":1304,"num_write_kb":33527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'509","reported_seq":2076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.151806+0000","last_change":"2024-03-09T14:26:28.655751+0000","last_active":"2024-03-09T15:11:37.151806+0000","last_peered":"2024-03-09T15:11:37.151806+0000","last_clean":"2024-03-09T15:11:37.151806+0000","last_became_active":"2024-03-09T14:26:28.655438+0000","last_became_peered":"2024-03-09T14:26:28.655438+0000","last_unstale":"2024-03-09T15:11:37.151806+0000","last_undegraded":"2024-03-09T15:11:37.151806+0000","last_fullsized":"2024-03-09T15:11:37.151806+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2613,"num_read_kb":2408,"num_write":650,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'184","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.838943+0000","last_change":"2024-03-09T14:26:26.649089+0000","last_active":"2024-03-09T15:11:45.838943+0000","last_peered":"2024-03-09T15:11:45.838943+0000","last_clean":"2024-03-09T15:11:45.838943+0000","last_became_active":"2024-03-09T14:26:26.648682+0000","last_became_peered":"2024-03-09T14:26:26.648682+0000","last_unstale":"2024-03-09T15:11:45.838943+0000","last_undegraded":"2024-03-09T15:11:45.838943+0000","last_fullsized":"2024-03-09T15:11:45.838943+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":448,"num_read_kb":6066,"num_write":1003,"num_write_kb":27510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'408","reported_seq":2015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.596663+0000","last_change":"2024-03-09T14:26:28.646581+0000","last_active":"2024-03-09T15:11:31.596663+0000","last_peered":"2024-03-09T15:11:31.596663+0000","last_clean":"2024-03-09T15:11:31.596663+0000","last_became_active":"2024-03-09T14:26:28.646239+0000","last_became_peered":"2024-03-09T14:26:28.646239+0000","last_unstale":"2024-03-09T15:11:31.596663+0000","last_undegraded":"2024-03-09T15:11:31.596663+0000","last_fullsized":"2024-03-09T15:11:31.596663+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2327,"num_read_kb":2213,"num_write":484,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'215","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.874655+0000","last_change":"2024-03-09T14:26:26.646103+0000","last_active":"2024-03-09T15:11:45.874655+0000","last_peered":"2024-03-09T15:11:45.874655+0000","last_clean":"2024-03-09T15:11:45.874655+0000","last_became_active":"2024-03-09T14:26:26.645230+0000","last_became_peered":"2024-03-09T14:26:26.645230+0000","last_unstale":"2024-03-09T15:11:45.874655+0000","last_undegraded":"2024-03-09T15:11:45.874655+0000","last_fullsized":"2024-03-09T15:11:45.874655+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":27386,"num_write":1086,"num_write_kb":24817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'342","reported_seq":1817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.490167+0000","last_change":"2024-03-09T14:26:28.653452+0000","last_active":"2024-03-09T15:11:31.490167+0000","last_peered":"2024-03-09T15:11:31.490167+0000","last_clean":"2024-03-09T15:11:31.490167+0000","last_became_active":"2024-03-09T14:26:28.653177+0000","last_became_peered":"2024-03-09T14:26:28.653177+0000","last_unstale":"2024-03-09T15:11:31.490167+0000","last_undegraded":"2024-03-09T15:11:31.490167+0000","last_fullsized":"2024-03-09T15:11:31.490167+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1954,"num_read_kb":1880,"num_write":380,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'196","reported_seq":801,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.893919+0000","last_change":"2024-03-09T14:26:26.637956+0000","last_active":"2024-03-09T15:11:45.893919+0000","last_peered":"2024-03-09T15:11:45.893919+0000","last_clean":"2024-03-09T15:11:45.893919+0000","last_became_active":"2024-03-09T14:26:26.637589+0000","last_became_peered":"2024-03-09T14:26:26.637589+0000","last_unstale":"2024-03-09T15:11:45.893919+0000","last_undegraded":"2024-03-09T15:11:45.893919+0000","last_fullsized":"2024-03-09T15:11:45.893919+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456529,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":381,"num_read_kb":13354,"num_write":1025,"num_write_kb":55720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'1151","reported_seq":2611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.151772+0000","last_change":"2024-03-09T14:26:28.655806+0000","last_active":"2024-03-09T15:11:37.151772+0000","last_peered":"2024-03-09T15:11:37.151772+0000","last_clean":"2024-03-09T15:11:37.151772+0000","last_became_active":"2024-03-09T14:26:28.655383+0000","last_became_peered":"2024-03-09T14:26:28.655383+0000","last_unstale":"2024-03-09T15:11:37.151772+0000","last_undegraded":"2024-03-09T15:11:37.151772+0000","last_fullsized":"2024-03-09T15:11:37.151772+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4791,"num_read_kb":4166,"num_write":1605,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'231","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.943577+0000","last_change":"2024-03-09T14:26:26.653398+0000","last_active":"2024-03-09T15:11:45.943577+0000","last_peered":"2024-03-09T15:11:45.943577+0000","last_clean":"2024-03-09T15:11:45.943577+0000","last_became_active":"2024-03-09T14:26:26.652576+0000","last_became_peered":"2024-03-09T14:26:26.652576+0000","last_unstale":"2024-03-09T15:11:45.943577+0000","last_undegraded":"2024-03-09T15:11:45.943577+0000","last_fullsized":"2024-03-09T15:11:45.943577+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460219,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":654,"num_read_kb":5204,"num_write":1022,"num_write_kb":18451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'327","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.419358+0000","last_change":"2024-03-09T15:11:52.419449+0000","last_active":"2024-03-09T15:11:52.419358+0000","last_peered":"2024-03-09T15:11:52.419358+0000","last_clean":"2024-03-09T15:11:52.419358+0000","last_became_active":"2024-03-09T14:27:03.715719+0000","last_became_peered":"2024-03-09T14:27:03.715719+0000","last_unstale":"2024-03-09T15:11:52.419358+0000","last_undegraded":"2024-03-09T15:11:52.419358+0000","last_fullsized":"2024-03-09T15:11:52.419358+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'327","last_scrub_stamp":"2024-03-09T15:11:52.419247+0000","last_deep_scrub":"264'327","last_deep_scrub_stamp":"2024-03-09T15:11:52.419247+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.419247+0000","objects_scrubbed":7,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:53.358056+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388665,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":851,"num_read_kb":60318,"num_write":1289,"num_write_kb":31608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'792","reported_seq":2407,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.356795+0000","last_change":"2024-03-09T14:26:28.649429+0000","last_active":"2024-03-09T15:10:35.356795+0000","last_peered":"2024-03-09T15:10:35.356795+0000","last_clean":"2024-03-09T15:10:35.356795+0000","last_became_active":"2024-03-09T14:26:28.649178+0000","last_became_peered":"2024-03-09T14:26:28.649178+0000","last_unstale":"2024-03-09T15:10:35.356795+0000","last_undegraded":"2024-03-09T15:10:35.356795+0000","last_fullsized":"2024-03-09T15:10:35.356795+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3684,"num_read_kb":3311,"num_write":1055,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'191","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.037655+0000","last_change":"2024-03-09T15:11:57.037713+0000","last_active":"2024-03-09T15:11:57.037655+0000","last_peered":"2024-03-09T15:11:57.037655+0000","last_clean":"2024-03-09T15:11:57.037655+0000","last_became_active":"2024-03-09T14:27:03.721595+0000","last_became_peered":"2024-03-09T14:27:03.721595+0000","last_unstale":"2024-03-09T15:11:57.037655+0000","last_undegraded":"2024-03-09T15:11:57.037655+0000","last_fullsized":"2024-03-09T15:11:57.037655+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'191","last_scrub_stamp":"2024-03-09T15:11:57.037513+0000","last_deep_scrub":"264'191","last_deep_scrub_stamp":"2024-03-09T15:11:57.037513+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.037513+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:18:55.396406+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815977,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":112993,"num_write":1053,"num_write_kb":48480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'387","reported_seq":2044,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.609369+0000","last_change":"2024-03-09T14:26:28.645372+0000","last_active":"2024-03-09T15:10:36.609369+0000","last_peered":"2024-03-09T15:10:36.609369+0000","last_clean":"2024-03-09T15:10:36.609369+0000","last_became_active":"2024-03-09T14:26:28.645067+0000","last_became_peered":"2024-03-09T14:26:28.645067+0000","last_unstale":"2024-03-09T15:10:36.609369+0000","last_undegraded":"2024-03-09T15:10:36.609369+0000","last_fullsized":"2024-03-09T15:10:36.609369+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2475,"num_read_kb":2383,"num_write":438,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5887,"num_read_kb":4246,"num_write":2185,"num_write_kb":841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8667,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1219,"ondisk_log_size":1219,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":12946,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":15495,"num_read_kb":15279,"num_write":16228,"num_write_kb":4747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2104,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":507904,"data_stored":25892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1724,"ondisk_log_size":1724,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":440,"ondisk_log_size":440,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":322743,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8037,"num_read_kb":10144,"num_write":5663,"num_write_kb":2860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106510,"num_omap_keys":262,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2244,"ondisk_log_size":2244,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1593,"num_read_kb":1897,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":195183,"num_read_kb":178329,"num_write":51691,"num_write_kb":17736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":121,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8326,"num_omap_keys":35,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3756,"ondisk_log_size":3756,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":155728130,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":241,"num_whiteouts":0,"num_read":32390,"num_read_kb":2319225,"num_write":69850,"num_write_kb":2158516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":235536384,"data_stored":235536384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4154,"ondisk_log_size":4154,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":164063,"num_write":179,"num_write_kb":125047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":167,"num_read_kb":183429,"num_write":179,"num_write_kb":125047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575405,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320772,"kb_used_data":50812,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94051068,"statfs":{"total":96636764160,"available":96308293632,"internally_reserved":0,"allocated":52031488,"data_stored":50062803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575405,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279852,"kb_used_data":23780,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94091988,"statfs":{"total":96636764160,"available":96350195712,"internally_reserved":0,"allocated":24350720,"data_stored":22401655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575405,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139292,"kb_used_data":53972,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94232548,"statfs":{"total":96636764160,"available":96494129152,"internally_reserved":0,"allocated":55267328,"data_stored":53270043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575404,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139252,"kb_used_data":35884,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94232588,"statfs":{"total":96636764160,"available":96494170112,"internally_reserved":0,"allocated":36745216,"data_stored":34850722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575405,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272684,"kb_used_data":38820,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94099156,"statfs":{"total":96636764160,"available":96357535744,"internally_reserved":0,"allocated":39751680,"data_stored":37775689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575403,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112676,"kb_used_data":41244,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94259164,"statfs":{"total":96636764160,"available":96521383936,"internally_reserved":0,"allocated":42233856,"data_stored":40310821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575404,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164480,"kb_used_data":43128,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94207360,"statfs":{"total":96636764160,"available":96468336640,"internally_reserved":0,"allocated":44163072,"data_stored":42229674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575404,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280168,"kb_used_data":42144,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94091672,"statfs":{"total":96636764160,"available":96349872128,"internally_reserved":0,"allocated":43155456,"data_stored":41182927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24678400,"data_stored":24678400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34705408,"data_stored":34705408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29638656,"data_stored":29638656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25006080,"data_stored":25006080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":31522816,"data_stored":31522816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36306944,"data_stored":36306944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":19070976,"data_stored":19070976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":34607104,"data_stored":34607104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:12:13.068 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.068 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.068 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.068 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.069 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-03-09T14:35:40.099960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.069 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.069 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.069 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.069 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.070 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.070 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.070 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.070 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.070 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.071 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.071 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.071 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.071 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.071 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.072 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.072 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.072 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.072 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.072 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.073 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.073 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.073 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.073 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.073 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.074 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.074 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.074 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.074 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.074 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.075 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.075 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.075 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.075 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.075 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.076 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.076 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.076 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.076 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.076 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.076 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.077 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.077 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.077 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.077 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.078 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.078 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.078 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.078 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.078 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.079 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.079 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.079 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.079 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.079 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.080 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.080 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.080 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.080 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.080 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.081 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.081 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.081 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.081 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.081 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.081 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.082 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.082 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.082 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.082 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.082 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.083 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.083 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.083 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.083 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.083 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.084 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.084 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.084 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.084 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.084 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.084 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.085 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.085 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.085 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.085 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.085 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.085 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.086 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.086 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.086 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.086 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.086 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.087 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.087 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.087 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.087 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.088 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.088 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.088 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.088 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.088 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.089 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.089 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.089 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.089 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.089 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.090 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.090 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.090 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.090 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.090 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.091 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.091 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.091 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.091 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.091 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.092 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.092 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.092 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.092 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.092 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.093 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.093 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.093 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.093 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.094 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.094 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.094 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.094 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-09T14:26:12.541311+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=12, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.094 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.095 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.095 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.095 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.095 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.095 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.095 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.096 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.096 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.096 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.096 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.097 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.097 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.097 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.097 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.097 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.097 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.098 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.098 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.098 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.098 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.099 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.099 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.099 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.099 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.099 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.100 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.100 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.100 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.100 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.100 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.101 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.101 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.101 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.101 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.101 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.102 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.102 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.102 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.102 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.103 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.103 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.103 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.103 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.103 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.103 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.104 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.104 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.104 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.104 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.104 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.105 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.105 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.105 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.105 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.105 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.106 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.106 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.106 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.106 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.106 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.107 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.107 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.107 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.107 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.107 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.108 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.108 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.108 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.108 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.108 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.109 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.109 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.109 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.109 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.109 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.110 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.110 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.110 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.110 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-03-09T14:26:35.654136+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.110 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.110 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.111 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-03-09T14:26:33.650565+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.111 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.111 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.111 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.111 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.112 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.112 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.112 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.112 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.112 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.112 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.113 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.113 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.113 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.113 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.113 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.114 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.114 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.114 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.114 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.114 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.114 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.115 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.115 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.115 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.115 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.115 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.115 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.116 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.116 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.116 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.116 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.116 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.117 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:13.117 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-09T15:12:33.118 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:12:33.461 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:12:33.475 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-03-09T15:12:33.478 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":1647,"stamp":"2024-03-09T15:12:31.553029+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":190210338,"num_objects":676,"num_object_clones":0,"num_object_copies":1593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":676,"num_whiteouts":0,"num_read":259041,"num_read_kb":2876724,"num_write":146172,"num_write_kb":2437235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":166,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":175759,"num_omap_keys":479,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13596,"ondisk_log_size":13596,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1709176,"kb_used_data":329784,"kb_used_omap":12,"kb_used_meta":1379315,"kb_avail":753265544,"statfs":{"total":773094113280,"available":771343917056,"internally_reserved":0,"allocated":337698816,"data_stored":322084334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1412419120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8591,"num_omap_keys":38,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005019"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.595983+0000","last_change":"2024-03-09T14:50:35.506808+0000","last_active":"2024-03-09T15:10:36.595983+0000","last_peered":"2024-03-09T15:10:36.595983+0000","last_clean":"2024-03-09T15:10:36.595983+0000","last_became_active":"2024-03-09T14:50:35.506543+0000","last_became_peered":"2024-03-09T14:50:35.506543+0000","last_unstale":"2024-03-09T15:10:36.595983+0000","last_undegraded":"2024-03-09T15:10:36.595983+0000","last_fullsized":"2024-03-09T15:10:36.595983+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'7","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.954275+0000","last_change":"2024-03-09T14:38:37.436681+0000","last_active":"2024-03-09T15:11:45.954275+0000","last_peered":"2024-03-09T15:11:45.954275+0000","last_clean":"2024-03-09T15:11:45.954275+0000","last_became_active":"2024-03-09T14:38:37.436381+0000","last_became_peered":"2024-03-09T14:38:37.436381+0000","last_unstale":"2024-03-09T15:11:45.954275+0000","last_undegraded":"2024-03-09T15:11:45.954275+0000","last_fullsized":"2024-03-09T15:11:45.954275+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'4","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.112913+0000","last_change":"2024-03-09T15:11:51.112934+0000","last_active":"2024-03-09T15:11:51.112913+0000","last_peered":"2024-03-09T15:11:51.112913+0000","last_clean":"2024-03-09T15:11:51.112913+0000","last_became_active":"2024-03-09T14:38:34.418748+0000","last_became_peered":"2024-03-09T14:38:34.418748+0000","last_unstale":"2024-03-09T15:11:51.112913+0000","last_undegraded":"2024-03-09T15:11:51.112913+0000","last_fullsized":"2024-03-09T15:11:51.112913+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-03-09T15:11:51.112840+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-03-09T15:11:51.112840+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.112840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:50.837065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'22","reported_seq":112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.476708+0000","last_change":"2024-03-09T15:11:52.476729+0000","last_active":"2024-03-09T15:11:52.476708+0000","last_peered":"2024-03-09T15:11:52.476708+0000","last_clean":"2024-03-09T15:11:52.476708+0000","last_became_active":"2024-03-09T14:35:41.121412+0000","last_became_peered":"2024-03-09T14:35:41.121412+0000","last_unstale":"2024-03-09T15:11:52.476708+0000","last_undegraded":"2024-03-09T15:11:52.476708+0000","last_fullsized":"2024-03-09T15:11:52.476708+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-03-09T15:11:52.476636+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-03-09T15:11:52.476636+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.476636+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:24:35.562139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":67,"num_write":35,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.043978+0000","last_change":"2024-03-09T15:12:22.044000+0000","last_active":"2024-03-09T15:12:22.043978+0000","last_peered":"2024-03-09T15:12:22.043978+0000","last_clean":"2024-03-09T15:12:22.043978+0000","last_became_active":"2024-03-09T14:50:35.506905+0000","last_became_peered":"2024-03-09T14:50:35.506905+0000","last_unstale":"2024-03-09T15:12:22.043978+0000","last_undegraded":"2024-03-09T15:12:22.043978+0000","last_fullsized":"2024-03-09T15:12:22.043978+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:22.043886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:22.043886+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.043886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:03:33.511711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.887380+0000","last_change":"2024-03-09T14:38:37.440992+0000","last_active":"2024-03-09T15:11:45.887380+0000","last_peered":"2024-03-09T15:11:45.887380+0000","last_clean":"2024-03-09T15:11:45.887380+0000","last_became_active":"2024-03-09T14:38:37.440733+0000","last_became_peered":"2024-03-09T14:38:37.440733+0000","last_unstale":"2024-03-09T15:11:45.887380+0000","last_undegraded":"2024-03-09T15:11:45.887380+0000","last_fullsized":"2024-03-09T15:11:45.887380+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.046428+0000","last_change":"2024-03-09T15:11:56.046457+0000","last_active":"2024-03-09T15:11:56.046428+0000","last_peered":"2024-03-09T15:11:56.046428+0000","last_clean":"2024-03-09T15:11:56.046428+0000","last_became_active":"2024-03-09T14:38:34.425629+0000","last_became_peered":"2024-03-09T14:38:34.425629+0000","last_unstale":"2024-03-09T15:11:56.046428+0000","last_undegraded":"2024-03-09T15:11:56.046428+0000","last_fullsized":"2024-03-09T15:11:56.046428+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:11:56.046346+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:11:56.046346+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.046346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:00:15.566941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'52","reported_seq":185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.943868+0000","last_change":"2024-03-09T15:12:15.943911+0000","last_active":"2024-03-09T15:12:15.943868+0000","last_peered":"2024-03-09T15:12:15.943868+0000","last_clean":"2024-03-09T15:12:15.943868+0000","last_became_active":"2024-03-09T14:35:41.117858+0000","last_became_peered":"2024-03-09T14:35:41.117858+0000","last_unstale":"2024-03-09T15:12:15.943868+0000","last_undegraded":"2024-03-09T15:12:15.943868+0000","last_fullsized":"2024-03-09T15:12:15.943868+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-03-09T15:12:15.943743+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-03-09T15:12:15.943743+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.943743+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:01.919651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":156,"num_write":85,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:29.306982+0000","last_change":"2024-03-09T15:12:29.307005+0000","last_active":"2024-03-09T15:12:29.306982+0000","last_peered":"2024-03-09T15:12:29.306982+0000","last_clean":"2024-03-09T15:12:29.306982+0000","last_became_active":"2024-03-09T14:50:35.506136+0000","last_became_peered":"2024-03-09T14:50:35.506136+0000","last_unstale":"2024-03-09T15:12:29.306982+0000","last_undegraded":"2024-03-09T15:12:29.306982+0000","last_fullsized":"2024-03-09T15:12:29.306982+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:29.306861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:29.306861+0000","last_clean_scrub_stamp":"2024-03-09T15:12:29.306861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:06:17.572533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"261'9","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.018124+0000","last_change":"2024-03-09T14:38:37.443197+0000","last_active":"2024-03-09T15:11:49.018124+0000","last_peered":"2024-03-09T15:11:49.018124+0000","last_clean":"2024-03-09T15:11:49.018124+0000","last_became_active":"2024-03-09T14:38:37.442906+0000","last_became_peered":"2024-03-09T14:38:37.442906+0000","last_unstale":"2024-03-09T15:11:49.018124+0000","last_undegraded":"2024-03-09T15:11:49.018124+0000","last_fullsized":"2024-03-09T15:11:49.018124+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":8196,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'6","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.960695+0000","last_change":"2024-03-09T15:12:18.960735+0000","last_active":"2024-03-09T15:12:18.960695+0000","last_peered":"2024-03-09T15:12:18.960695+0000","last_clean":"2024-03-09T15:12:18.960695+0000","last_became_active":"2024-03-09T14:38:34.425459+0000","last_became_peered":"2024-03-09T14:38:34.425459+0000","last_unstale":"2024-03-09T15:12:18.960695+0000","last_undegraded":"2024-03-09T15:12:18.960695+0000","last_fullsized":"2024-03-09T15:12:18.960695+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:12:18.960606+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:12:18.960606+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.960606+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:15:27.077248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"261'16","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.432500+0000","last_change":"2024-03-09T15:11:49.432531+0000","last_active":"2024-03-09T15:11:49.432500+0000","last_peered":"2024-03-09T15:11:49.432500+0000","last_clean":"2024-03-09T15:11:49.432500+0000","last_became_active":"2024-03-09T14:35:41.123171+0000","last_became_peered":"2024-03-09T14:35:41.123171+0000","last_unstale":"2024-03-09T15:11:49.432500+0000","last_undegraded":"2024-03-09T15:11:49.432500+0000","last_fullsized":"2024-03-09T15:11:49.432500+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'16","last_scrub_stamp":"2024-03-09T15:11:49.432421+0000","last_deep_scrub":"261'16","last_deep_scrub_stamp":"2024-03-09T15:11:49.432421+0000","last_clean_scrub_stamp":"2024-03-09T15:11:49.432421+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:33:27.802202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":56,"num_write":23,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395863+0000","last_change":"2024-03-09T14:50:35.503396+0000","last_active":"2024-03-09T15:11:50.395863+0000","last_peered":"2024-03-09T15:11:50.395863+0000","last_clean":"2024-03-09T15:11:50.395863+0000","last_became_active":"2024-03-09T14:50:35.503090+0000","last_became_peered":"2024-03-09T14:50:35.503090+0000","last_unstale":"2024-03-09T15:11:50.395863+0000","last_undegraded":"2024-03-09T15:11:50.395863+0000","last_fullsized":"2024-03-09T15:11:50.395863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'2","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.095477+0000","last_change":"2024-03-09T15:12:02.095521+0000","last_active":"2024-03-09T15:12:02.095477+0000","last_peered":"2024-03-09T15:12:02.095477+0000","last_clean":"2024-03-09T15:12:02.095477+0000","last_became_active":"2024-03-09T14:38:37.432089+0000","last_became_peered":"2024-03-09T14:38:37.432089+0000","last_unstale":"2024-03-09T15:12:02.095477+0000","last_undegraded":"2024-03-09T15:12:02.095477+0000","last_fullsized":"2024-03-09T15:12:02.095477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:02.095344+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:02.095344+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.095344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:06:26.800542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.165978+0000","last_change":"2024-03-09T15:11:54.165978+0000","last_active":"2024-03-09T15:11:54.165978+0000","last_peered":"2024-03-09T15:11:54.165978+0000","last_clean":"2024-03-09T15:11:54.165978+0000","last_became_active":"2024-03-09T14:38:34.417024+0000","last_became_peered":"2024-03-09T14:38:34.417024+0000","last_unstale":"2024-03-09T15:11:54.165978+0000","last_undegraded":"2024-03-09T15:11:54.165978+0000","last_fullsized":"2024-03-09T15:11:54.165978+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:54.165851+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:54.165851+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.165851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:07:17.408333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'52","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.159931+0000","last_change":"2024-03-09T15:11:57.159971+0000","last_active":"2024-03-09T15:11:57.159931+0000","last_peered":"2024-03-09T15:11:57.159931+0000","last_clean":"2024-03-09T15:11:57.159931+0000","last_became_active":"2024-03-09T14:35:41.118960+0000","last_became_peered":"2024-03-09T14:35:41.118960+0000","last_unstale":"2024-03-09T15:11:57.159931+0000","last_undegraded":"2024-03-09T15:11:57.159931+0000","last_fullsized":"2024-03-09T15:11:57.159931+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-03-09T15:11:57.159825+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-03-09T15:11:57.159825+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.159825+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:17:22.468521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":146,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.693833+0000","last_change":"2024-03-09T14:50:35.513378+0000","last_active":"2024-03-09T15:10:36.693833+0000","last_peered":"2024-03-09T15:10:36.693833+0000","last_clean":"2024-03-09T15:10:36.693833+0000","last_became_active":"2024-03-09T14:50:35.512534+0000","last_became_peered":"2024-03-09T14:50:35.512534+0000","last_unstale":"2024-03-09T15:10:36.693833+0000","last_undegraded":"2024-03-09T15:10:36.693833+0000","last_fullsized":"2024-03-09T15:10:36.693833+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'6","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:06.591559+0000","last_change":"2024-03-09T14:38:37.437102+0000","last_active":"2024-03-09T15:10:06.591559+0000","last_peered":"2024-03-09T15:10:06.591559+0000","last_clean":"2024-03-09T15:10:06.591559+0000","last_became_active":"2024-03-09T14:38:37.436829+0000","last_became_peered":"2024-03-09T14:38:37.436829+0000","last_unstale":"2024-03-09T15:10:06.591559+0000","last_undegraded":"2024-03-09T15:10:06.591559+0000","last_fullsized":"2024-03-09T15:10:06.591559+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'6","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.433537+0000","last_change":"2024-03-09T15:11:59.433537+0000","last_active":"2024-03-09T15:11:59.433537+0000","last_peered":"2024-03-09T15:11:59.433537+0000","last_clean":"2024-03-09T15:11:59.433537+0000","last_became_active":"2024-03-09T14:38:34.418209+0000","last_became_peered":"2024-03-09T14:38:34.418209+0000","last_unstale":"2024-03-09T15:11:59.433537+0000","last_undegraded":"2024-03-09T15:11:59.433537+0000","last_fullsized":"2024-03-09T15:11:59.433537+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:11:59.433411+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:11:59.433411+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.433411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:32.542902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6194,"num_write":6,"num_write_kb":5170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'22","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.103062+0000","last_change":"2024-03-09T15:11:52.103111+0000","last_active":"2024-03-09T15:11:52.103062+0000","last_peered":"2024-03-09T15:11:52.103062+0000","last_clean":"2024-03-09T15:11:52.103062+0000","last_became_active":"2024-03-09T14:35:41.123715+0000","last_became_peered":"2024-03-09T14:35:41.123715+0000","last_unstale":"2024-03-09T15:11:52.103062+0000","last_undegraded":"2024-03-09T15:11:52.103062+0000","last_fullsized":"2024-03-09T15:11:52.103062+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-03-09T15:11:52.102969+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-03-09T15:11:52.102969+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.102969+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:05:50.481258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":62,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.587558+0000","last_change":"2024-03-09T14:50:35.510228+0000","last_active":"2024-03-09T15:11:26.587558+0000","last_peered":"2024-03-09T15:11:26.587558+0000","last_clean":"2024-03-09T15:11:26.587558+0000","last_became_active":"2024-03-09T14:50:35.509938+0000","last_became_peered":"2024-03-09T14:50:35.509938+0000","last_unstale":"2024-03-09T15:11:26.587558+0000","last_undegraded":"2024-03-09T15:11:26.587558+0000","last_fullsized":"2024-03-09T15:11:26.587558+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:25.406233+0000","last_change":"2024-03-09T15:12:25.406233+0000","last_active":"2024-03-09T15:12:25.406233+0000","last_peered":"2024-03-09T15:12:25.406233+0000","last_clean":"2024-03-09T15:12:25.406233+0000","last_became_active":"2024-03-09T14:38:37.439120+0000","last_became_peered":"2024-03-09T14:38:37.439120+0000","last_unstale":"2024-03-09T15:12:25.406233+0000","last_undegraded":"2024-03-09T15:12:25.406233+0000","last_fullsized":"2024-03-09T15:12:25.406233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:25.406108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:25.406108+0000","last_clean_scrub_stamp":"2024-03-09T15:12:25.406108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:48:51.911943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.212446+0000","last_change":"2024-03-09T15:11:58.212474+0000","last_active":"2024-03-09T15:11:58.212446+0000","last_peered":"2024-03-09T15:11:58.212446+0000","last_clean":"2024-03-09T15:11:58.212446+0000","last_became_active":"2024-03-09T14:38:34.418553+0000","last_became_peered":"2024-03-09T14:38:34.418553+0000","last_unstale":"2024-03-09T15:11:58.212446+0000","last_undegraded":"2024-03-09T15:11:58.212446+0000","last_fullsized":"2024-03-09T15:11:58.212446+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:11:58.212359+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:11:58.212359+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.212359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:05.878755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":6,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'47","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.218080+0000","last_change":"2024-03-09T15:11:52.218122+0000","last_active":"2024-03-09T15:11:52.218080+0000","last_peered":"2024-03-09T15:11:52.218080+0000","last_clean":"2024-03-09T15:11:52.218080+0000","last_became_active":"2024-03-09T14:35:41.123785+0000","last_became_peered":"2024-03-09T14:35:41.123785+0000","last_unstale":"2024-03-09T15:11:52.218080+0000","last_undegraded":"2024-03-09T15:11:52.218080+0000","last_fullsized":"2024-03-09T15:11:52.218080+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-03-09T15:11:52.217928+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-03-09T15:11:52.217928+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.217928+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:33.071186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":141,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.911915+0000","last_change":"2024-03-09T15:12:12.911945+0000","last_active":"2024-03-09T15:12:12.911915+0000","last_peered":"2024-03-09T15:12:12.911915+0000","last_clean":"2024-03-09T15:12:12.911915+0000","last_became_active":"2024-03-09T14:50:35.499942+0000","last_became_peered":"2024-03-09T14:50:35.499942+0000","last_unstale":"2024-03-09T15:12:12.911915+0000","last_undegraded":"2024-03-09T15:12:12.911915+0000","last_fullsized":"2024-03-09T15:12:12.911915+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:12.911833+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:12.911833+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.911833+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:04:45.866722+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:24.416282+0000","last_change":"2024-03-09T15:12:24.416347+0000","last_active":"2024-03-09T15:12:24.416282+0000","last_peered":"2024-03-09T15:12:24.416282+0000","last_clean":"2024-03-09T15:12:24.416282+0000","last_became_active":"2024-03-09T14:38:37.437714+0000","last_became_peered":"2024-03-09T14:38:37.437714+0000","last_unstale":"2024-03-09T15:12:24.416282+0000","last_undegraded":"2024-03-09T15:12:24.416282+0000","last_fullsized":"2024-03-09T15:12:24.416282+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:12:24.416065+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:12:24.416065+0000","last_clean_scrub_stamp":"2024-03-09T15:12:24.416065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:10.539890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.028592+0000","last_change":"2024-03-09T15:12:06.028618+0000","last_active":"2024-03-09T15:12:06.028592+0000","last_peered":"2024-03-09T15:12:06.028592+0000","last_clean":"2024-03-09T15:12:06.028592+0000","last_became_active":"2024-03-09T14:38:34.420232+0000","last_became_peered":"2024-03-09T14:38:34.420232+0000","last_unstale":"2024-03-09T15:12:06.028592+0000","last_undegraded":"2024-03-09T15:12:06.028592+0000","last_fullsized":"2024-03-09T15:12:06.028592+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:06.028501+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:06.028501+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.028501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:00:04.885173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'24","reported_seq":113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.465788+0000","last_change":"2024-03-09T15:11:53.465788+0000","last_active":"2024-03-09T15:11:53.465788+0000","last_peered":"2024-03-09T15:11:53.465788+0000","last_clean":"2024-03-09T15:11:53.465788+0000","last_became_active":"2024-03-09T14:35:41.121566+0000","last_became_peered":"2024-03-09T14:35:41.121566+0000","last_unstale":"2024-03-09T15:11:53.465788+0000","last_undegraded":"2024-03-09T15:11:53.465788+0000","last_fullsized":"2024-03-09T15:11:53.465788+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-03-09T15:11:53.465689+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-03-09T15:11:53.465689+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.465689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:20.850766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.733582+0000","last_change":"2024-03-09T14:50:35.501732+0000","last_active":"2024-03-09T15:10:36.733582+0000","last_peered":"2024-03-09T15:10:36.733582+0000","last_clean":"2024-03-09T15:10:36.733582+0000","last_became_active":"2024-03-09T14:50:35.501422+0000","last_became_peered":"2024-03-09T14:50:35.501422+0000","last_unstale":"2024-03-09T15:10:36.733582+0000","last_undegraded":"2024-03-09T15:10:36.733582+0000","last_fullsized":"2024-03-09T15:10:36.733582+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"264'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.887438+0000","last_change":"2024-03-09T14:38:37.438996+0000","last_active":"2024-03-09T15:11:45.887438+0000","last_peered":"2024-03-09T15:11:45.887438+0000","last_clean":"2024-03-09T15:11:45.887438+0000","last_became_active":"2024-03-09T14:38:37.438685+0000","last_became_peered":"2024-03-09T14:38:37.438685+0000","last_unstale":"2024-03-09T15:11:45.887438+0000","last_undegraded":"2024-03-09T15:11:45.887438+0000","last_fullsized":"2024-03-09T15:11:45.887438+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.451884+0000","last_change":"2024-03-09T15:12:11.451910+0000","last_active":"2024-03-09T15:12:11.451884+0000","last_peered":"2024-03-09T15:12:11.451884+0000","last_clean":"2024-03-09T15:12:11.451884+0000","last_became_active":"2024-03-09T14:38:34.422607+0000","last_became_peered":"2024-03-09T14:38:34.422607+0000","last_unstale":"2024-03-09T15:12:11.451884+0000","last_undegraded":"2024-03-09T15:12:11.451884+0000","last_fullsized":"2024-03-09T15:12:11.451884+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:12:11.451792+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:12:11.451792+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.451792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:22:45.795308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'68","reported_seq":233,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.058888+0000","last_change":"2024-03-09T15:11:53.058888+0000","last_active":"2024-03-09T15:11:53.058888+0000","last_peered":"2024-03-09T15:11:53.058888+0000","last_clean":"2024-03-09T15:11:53.058888+0000","last_became_active":"2024-03-09T14:35:41.122898+0000","last_became_peered":"2024-03-09T14:35:41.122898+0000","last_unstale":"2024-03-09T15:11:53.058888+0000","last_undegraded":"2024-03-09T15:11:53.058888+0000","last_fullsized":"2024-03-09T15:11:53.058888+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'68","last_scrub_stamp":"2024-03-09T15:11:53.058785+0000","last_deep_scrub":"264'68","last_deep_scrub_stamp":"2024-03-09T15:11:53.058785+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.058785+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:18:11.685762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":238,"num_write":108,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.588485+0000","last_change":"2024-03-09T14:50:35.508995+0000","last_active":"2024-03-09T15:11:36.588485+0000","last_peered":"2024-03-09T15:11:36.588485+0000","last_clean":"2024-03-09T15:11:36.588485+0000","last_became_active":"2024-03-09T14:50:35.508726+0000","last_became_peered":"2024-03-09T14:50:35.508726+0000","last_unstale":"2024-03-09T15:11:36.588485+0000","last_undegraded":"2024-03-09T15:11:36.588485+0000","last_fullsized":"2024-03-09T15:11:36.588485+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'8","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.148764+0000","last_change":"2024-03-09T15:12:18.148764+0000","last_active":"2024-03-09T15:12:18.148764+0000","last_peered":"2024-03-09T15:12:18.148764+0000","last_clean":"2024-03-09T15:12:18.148764+0000","last_became_active":"2024-03-09T14:38:37.437039+0000","last_became_peered":"2024-03-09T14:38:37.437039+0000","last_unstale":"2024-03-09T15:12:18.148764+0000","last_undegraded":"2024-03-09T15:12:18.148764+0000","last_fullsized":"2024-03-09T15:12:18.148764+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-03-09T15:12:18.148637+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-03-09T15:12:18.148637+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.148637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:44:42.949509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10340,"num_write":8,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"264'6","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.314908+0000","last_change":"2024-03-09T15:12:03.314950+0000","last_active":"2024-03-09T15:12:03.314908+0000","last_peered":"2024-03-09T15:12:03.314908+0000","last_clean":"2024-03-09T15:12:03.314908+0000","last_became_active":"2024-03-09T14:38:34.418269+0000","last_became_peered":"2024-03-09T14:38:34.418269+0000","last_unstale":"2024-03-09T15:12:03.314908+0000","last_undegraded":"2024-03-09T15:12:03.314908+0000","last_fullsized":"2024-03-09T15:12:03.314908+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:12:03.314754+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:12:03.314754+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.314754+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:24:52.192811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'38","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.441547+0000","last_change":"2024-03-09T15:11:50.441547+0000","last_active":"2024-03-09T15:11:50.441547+0000","last_peered":"2024-03-09T15:11:50.441547+0000","last_clean":"2024-03-09T15:11:50.441547+0000","last_became_active":"2024-03-09T14:35:41.122257+0000","last_became_peered":"2024-03-09T14:35:41.122257+0000","last_unstale":"2024-03-09T15:11:50.441547+0000","last_undegraded":"2024-03-09T15:11:50.441547+0000","last_fullsized":"2024-03-09T15:11:50.441547+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-03-09T15:11:50.441402+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-03-09T15:11:50.441402+0000","last_clean_scrub_stamp":"2024-03-09T15:11:50.441402+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:44.539083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":116,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.023321+0000","last_change":"2024-03-09T15:12:21.023369+0000","last_active":"2024-03-09T15:12:21.023321+0000","last_peered":"2024-03-09T15:12:21.023321+0000","last_clean":"2024-03-09T15:12:21.023321+0000","last_became_active":"2024-03-09T14:50:35.503595+0000","last_became_peered":"2024-03-09T14:50:35.503595+0000","last_unstale":"2024-03-09T15:12:21.023321+0000","last_undegraded":"2024-03-09T15:12:21.023321+0000","last_fullsized":"2024-03-09T15:12:21.023321+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:21.023181+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:21.023181+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.023181+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:01:30.969392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'5","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.169969+0000","last_change":"2024-03-09T15:11:58.170016+0000","last_active":"2024-03-09T15:11:58.169969+0000","last_peered":"2024-03-09T15:11:58.169969+0000","last_clean":"2024-03-09T15:11:58.169969+0000","last_became_active":"2024-03-09T14:38:37.429956+0000","last_became_peered":"2024-03-09T14:38:37.429956+0000","last_unstale":"2024-03-09T15:11:58.169969+0000","last_undegraded":"2024-03-09T15:11:58.169969+0000","last_fullsized":"2024-03-09T15:11:58.169969+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:11:58.169839+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:11:58.169839+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.169839+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:56:13.470034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":11264,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.097802+0000","last_change":"2024-03-09T15:11:55.097802+0000","last_active":"2024-03-09T15:11:55.097802+0000","last_peered":"2024-03-09T15:11:55.097802+0000","last_clean":"2024-03-09T15:11:55.097802+0000","last_became_active":"2024-03-09T14:38:34.421678+0000","last_became_peered":"2024-03-09T14:38:34.421678+0000","last_unstale":"2024-03-09T15:11:55.097802+0000","last_undegraded":"2024-03-09T15:11:55.097802+0000","last_fullsized":"2024-03-09T15:11:55.097802+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:55.097675+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:55.097675+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.097675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:06.648401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'25","reported_seq":108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.192215+0000","last_change":"2024-03-09T15:11:55.192215+0000","last_active":"2024-03-09T15:11:55.192215+0000","last_peered":"2024-03-09T15:11:55.192215+0000","last_clean":"2024-03-09T15:11:55.192215+0000","last_became_active":"2024-03-09T14:35:41.120818+0000","last_became_peered":"2024-03-09T14:35:41.120818+0000","last_unstale":"2024-03-09T15:11:55.192215+0000","last_undegraded":"2024-03-09T15:11:55.192215+0000","last_fullsized":"2024-03-09T15:11:55.192215+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-03-09T15:11:55.192100+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-03-09T15:11:55.192100+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.192100+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:56:16.097474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":54,"num_write":56,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.901991+0000","last_change":"2024-03-09T15:12:16.902013+0000","last_active":"2024-03-09T15:12:16.901991+0000","last_peered":"2024-03-09T15:12:16.901991+0000","last_clean":"2024-03-09T15:12:16.901991+0000","last_became_active":"2024-03-09T14:50:35.500196+0000","last_became_peered":"2024-03-09T14:50:35.500196+0000","last_unstale":"2024-03-09T15:12:16.901991+0000","last_undegraded":"2024-03-09T15:12:16.901991+0000","last_fullsized":"2024-03-09T15:12:16.901991+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:16.901895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:16.901895+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.901895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:28:45.708776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.062995+0000","last_change":"2024-03-09T15:12:10.062995+0000","last_active":"2024-03-09T15:12:10.062995+0000","last_peered":"2024-03-09T15:12:10.062995+0000","last_clean":"2024-03-09T15:12:10.062995+0000","last_became_active":"2024-03-09T14:38:37.436884+0000","last_became_peered":"2024-03-09T14:38:37.436884+0000","last_unstale":"2024-03-09T15:12:10.062995+0000","last_undegraded":"2024-03-09T15:12:10.062995+0000","last_fullsized":"2024-03-09T15:12:10.062995+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:10.062853+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:10.062853+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.062853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:49:41.996594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.934492+0000","last_change":"2024-03-09T15:12:17.934492+0000","last_active":"2024-03-09T15:12:17.934492+0000","last_peered":"2024-03-09T15:12:17.934492+0000","last_clean":"2024-03-09T15:12:17.934492+0000","last_became_active":"2024-03-09T14:38:34.420002+0000","last_became_peered":"2024-03-09T14:38:34.420002+0000","last_unstale":"2024-03-09T15:12:17.934492+0000","last_undegraded":"2024-03-09T15:12:17.934492+0000","last_fullsized":"2024-03-09T15:12:17.934492+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:17.934379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:17.934379+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.934379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:54:49.231163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'34","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.947754+0000","last_change":"2024-03-09T15:12:05.947778+0000","last_active":"2024-03-09T15:12:05.947754+0000","last_peered":"2024-03-09T15:12:05.947754+0000","last_clean":"2024-03-09T15:12:05.947754+0000","last_became_active":"2024-03-09T14:35:41.116430+0000","last_became_peered":"2024-03-09T14:35:41.116430+0000","last_unstale":"2024-03-09T15:12:05.947754+0000","last_undegraded":"2024-03-09T15:12:05.947754+0000","last_fullsized":"2024-03-09T15:12:05.947754+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-03-09T15:12:05.947669+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-03-09T15:12:05.947669+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.947669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:39:25.396644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":94,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:36.604642+0000","last_change":"2024-03-09T14:50:35.507650+0000","last_active":"2024-03-09T15:11:36.604642+0000","last_peered":"2024-03-09T15:11:36.604642+0000","last_clean":"2024-03-09T15:11:36.604642+0000","last_became_active":"2024-03-09T14:50:35.506969+0000","last_became_peered":"2024-03-09T14:50:35.506969+0000","last_unstale":"2024-03-09T15:11:36.604642+0000","last_undegraded":"2024-03-09T15:11:36.604642+0000","last_fullsized":"2024-03-09T15:11:36.604642+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.861347+0000","last_change":"2024-03-09T14:38:37.436281+0000","last_active":"2024-03-09T15:11:50.861347+0000","last_peered":"2024-03-09T15:11:50.861347+0000","last_clean":"2024-03-09T15:11:50.861347+0000","last_became_active":"2024-03-09T14:38:37.435960+0000","last_became_peered":"2024-03-09T14:38:37.435960+0000","last_unstale":"2024-03-09T15:11:50.861347+0000","last_undegraded":"2024-03-09T15:11:50.861347+0000","last_fullsized":"2024-03-09T15:11:50.861347+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'8","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.504210+0000","last_change":"2024-03-09T15:12:07.504210+0000","last_active":"2024-03-09T15:12:07.504210+0000","last_peered":"2024-03-09T15:12:07.504210+0000","last_clean":"2024-03-09T15:12:07.504210+0000","last_became_active":"2024-03-09T14:38:34.420571+0000","last_became_peered":"2024-03-09T14:38:34.420571+0000","last_unstale":"2024-03-09T15:12:07.504210+0000","last_undegraded":"2024-03-09T15:12:07.504210+0000","last_fullsized":"2024-03-09T15:12:07.504210+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-03-09T15:12:07.504039+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-03-09T15:12:07.504039+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.504039+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:59.430132+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'36","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.028960+0000","last_change":"2024-03-09T15:12:04.029007+0000","last_active":"2024-03-09T15:12:04.028960+0000","last_peered":"2024-03-09T15:12:04.028960+0000","last_clean":"2024-03-09T15:12:04.028960+0000","last_became_active":"2024-03-09T14:35:41.121060+0000","last_became_peered":"2024-03-09T14:35:41.121060+0000","last_unstale":"2024-03-09T15:12:04.028960+0000","last_undegraded":"2024-03-09T15:12:04.028960+0000","last_fullsized":"2024-03-09T15:12:04.028960+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-03-09T15:12:04.028848+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-03-09T15:12:04.028848+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.028848+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:40:13.122787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":100,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395863+0000","last_change":"2024-03-09T14:50:35.504223+0000","last_active":"2024-03-09T15:11:50.395863+0000","last_peered":"2024-03-09T15:11:50.395863+0000","last_clean":"2024-03-09T15:11:50.395863+0000","last_became_active":"2024-03-09T14:50:35.503970+0000","last_became_peered":"2024-03-09T14:50:35.503970+0000","last_unstale":"2024-03-09T15:11:50.395863+0000","last_undegraded":"2024-03-09T15:11:50.395863+0000","last_fullsized":"2024-03-09T15:11:50.395863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.953901+0000","last_change":"2024-03-09T14:38:37.438872+0000","last_active":"2024-03-09T15:11:45.953901+0000","last_peered":"2024-03-09T15:11:45.953901+0000","last_clean":"2024-03-09T15:11:45.953901+0000","last_became_active":"2024-03-09T14:38:37.438604+0000","last_became_peered":"2024-03-09T14:38:37.438604+0000","last_unstale":"2024-03-09T15:11:45.953901+0000","last_undegraded":"2024-03-09T15:11:45.953901+0000","last_fullsized":"2024-03-09T15:11:45.953901+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:16.491314+0000","last_change":"2024-03-09T14:38:34.421755+0000","last_active":"2024-03-09T15:11:16.491314+0000","last_peered":"2024-03-09T15:11:16.491314+0000","last_clean":"2024-03-09T15:11:16.491314+0000","last_became_active":"2024-03-09T14:38:34.421476+0000","last_became_peered":"2024-03-09T14:38:34.421476+0000","last_unstale":"2024-03-09T15:11:16.491314+0000","last_undegraded":"2024-03-09T15:11:16.491314+0000","last_fullsized":"2024-03-09T15:11:16.491314+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:33.392879+0000","last_clean_scrub_stamp":"2024-03-09T14:38:33.392879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'115","reported_seq":397,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.153883+0000","last_change":"2024-03-09T15:11:59.153935+0000","last_active":"2024-03-09T15:11:59.153883+0000","last_peered":"2024-03-09T15:11:59.153883+0000","last_clean":"2024-03-09T15:11:59.153883+0000","last_became_active":"2024-03-09T14:35:41.125114+0000","last_became_peered":"2024-03-09T14:35:41.125114+0000","last_unstale":"2024-03-09T15:11:59.153883+0000","last_undegraded":"2024-03-09T15:11:59.153883+0000","last_fullsized":"2024-03-09T15:11:59.153883+0000","mapping_epoch":251,"log_start":"264'100","ondisk_log_start":"264'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-03-09T15:11:59.153761+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-03-09T15:11:59.153761+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.153761+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:13:38.381151+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":488,"num_write":144,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4176,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.018273+0000","last_change":"2024-03-09T14:50:35.510923+0000","last_active":"2024-03-09T15:11:49.018273+0000","last_peered":"2024-03-09T15:11:49.018273+0000","last_clean":"2024-03-09T15:11:49.018273+0000","last_became_active":"2024-03-09T14:50:35.510598+0000","last_became_peered":"2024-03-09T14:50:35.510598+0000","last_unstale":"2024-03-09T15:11:49.018273+0000","last_undegraded":"2024-03-09T15:11:49.018273+0000","last_fullsized":"2024-03-09T15:11:49.018273+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:16.586508+0000","last_change":"2024-03-09T14:38:37.439640+0000","last_active":"2024-03-09T15:11:16.586508+0000","last_peered":"2024-03-09T15:11:16.586508+0000","last_clean":"2024-03-09T15:11:16.586508+0000","last_became_active":"2024-03-09T14:38:37.439360+0000","last_became_peered":"2024-03-09T14:38:37.439360+0000","last_unstale":"2024-03-09T15:11:16.586508+0000","last_undegraded":"2024-03-09T15:11:16.586508+0000","last_fullsized":"2024-03-09T15:11:16.586508+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.165524+0000","last_change":"2024-03-09T15:11:54.165560+0000","last_active":"2024-03-09T15:11:54.165524+0000","last_peered":"2024-03-09T15:11:54.165524+0000","last_clean":"2024-03-09T15:11:54.165524+0000","last_became_active":"2024-03-09T14:38:34.419467+0000","last_became_peered":"2024-03-09T14:38:34.419467+0000","last_unstale":"2024-03-09T15:11:54.165524+0000","last_undegraded":"2024-03-09T15:11:54.165524+0000","last_fullsized":"2024-03-09T15:11:54.165524+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:11:54.165424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:11:54.165424+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.165424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:20:22.550276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'15","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.415399+0000","last_change":"2024-03-09T15:11:56.415425+0000","last_active":"2024-03-09T15:11:56.415399+0000","last_peered":"2024-03-09T15:11:56.415399+0000","last_clean":"2024-03-09T15:11:56.415399+0000","last_became_active":"2024-03-09T14:35:41.118591+0000","last_became_peered":"2024-03-09T14:35:41.118591+0000","last_unstale":"2024-03-09T15:11:56.415399+0000","last_undegraded":"2024-03-09T15:11:56.415399+0000","last_fullsized":"2024-03-09T15:11:56.415399+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'15","last_scrub_stamp":"2024-03-09T15:11:56.415294+0000","last_deep_scrub":"264'15","last_deep_scrub_stamp":"2024-03-09T15:11:56.415294+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.415294+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:22:01.480650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":42,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:41.598025+0000","last_change":"2024-03-09T14:50:35.503951+0000","last_active":"2024-03-09T15:11:41.598025+0000","last_peered":"2024-03-09T15:11:41.598025+0000","last_clean":"2024-03-09T15:11:41.598025+0000","last_became_active":"2024-03-09T14:50:35.503274+0000","last_became_peered":"2024-03-09T14:50:35.503274+0000","last_unstale":"2024-03-09T15:11:41.598025+0000","last_undegraded":"2024-03-09T15:11:41.598025+0000","last_fullsized":"2024-03-09T15:11:41.598025+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'6","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.104713+0000","last_change":"2024-03-09T15:12:06.104765+0000","last_active":"2024-03-09T15:12:06.104713+0000","last_peered":"2024-03-09T15:12:06.104713+0000","last_clean":"2024-03-09T15:12:06.104713+0000","last_became_active":"2024-03-09T14:38:37.436078+0000","last_became_peered":"2024-03-09T14:38:37.436078+0000","last_unstale":"2024-03-09T15:12:06.104713+0000","last_undegraded":"2024-03-09T15:12:06.104713+0000","last_fullsized":"2024-03-09T15:12:06.104713+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:12:06.104603+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:12:06.104603+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.104603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:59:01.145657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'6","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.368271+0000","last_change":"2024-03-09T15:12:23.368339+0000","last_active":"2024-03-09T15:12:23.368271+0000","last_peered":"2024-03-09T15:12:23.368271+0000","last_clean":"2024-03-09T15:12:23.368271+0000","last_became_active":"2024-03-09T14:38:34.419935+0000","last_became_peered":"2024-03-09T14:38:34.419935+0000","last_unstale":"2024-03-09T15:12:23.368271+0000","last_undegraded":"2024-03-09T15:12:23.368271+0000","last_fullsized":"2024-03-09T15:12:23.368271+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:12:23.368156+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:12:23.368156+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.368156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:27:10.114365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7208,"num_write":6,"num_write_kb":7208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'26","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.111431+0000","last_change":"2024-03-09T15:11:52.111489+0000","last_active":"2024-03-09T15:11:52.111431+0000","last_peered":"2024-03-09T15:11:52.111431+0000","last_clean":"2024-03-09T15:11:52.111431+0000","last_became_active":"2024-03-09T14:35:41.116852+0000","last_became_peered":"2024-03-09T14:35:41.116852+0000","last_unstale":"2024-03-09T15:11:52.111431+0000","last_undegraded":"2024-03-09T15:11:52.111431+0000","last_fullsized":"2024-03-09T15:11:52.111431+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-03-09T15:11:52.111320+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-03-09T15:11:52.111320+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.111320+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:02:00.553764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395848+0000","last_change":"2024-03-09T14:50:35.509510+0000","last_active":"2024-03-09T15:11:50.395848+0000","last_peered":"2024-03-09T15:11:50.395848+0000","last_clean":"2024-03-09T15:11:50.395848+0000","last_became_active":"2024-03-09T14:50:35.509202+0000","last_became_peered":"2024-03-09T14:50:35.509202+0000","last_unstale":"2024-03-09T15:11:50.395848+0000","last_undegraded":"2024-03-09T15:11:50.395848+0000","last_fullsized":"2024-03-09T15:11:50.395848+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:27.346421+0000","last_change":"2024-03-09T15:12:27.346480+0000","last_active":"2024-03-09T15:12:27.346421+0000","last_peered":"2024-03-09T15:12:27.346421+0000","last_clean":"2024-03-09T15:12:27.346421+0000","last_became_active":"2024-03-09T14:38:37.441554+0000","last_became_peered":"2024-03-09T14:38:37.441554+0000","last_unstale":"2024-03-09T15:12:27.346421+0000","last_undegraded":"2024-03-09T15:12:27.346421+0000","last_fullsized":"2024-03-09T15:12:27.346421+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:27.346300+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:27.346300+0000","last_clean_scrub_stamp":"2024-03-09T15:12:27.346300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:55:13.522607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'2","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.424983+0000","last_change":"2024-03-09T15:12:07.425009+0000","last_active":"2024-03-09T15:12:07.424983+0000","last_peered":"2024-03-09T15:12:07.424983+0000","last_clean":"2024-03-09T15:12:07.424983+0000","last_became_active":"2024-03-09T14:38:34.424507+0000","last_became_peered":"2024-03-09T14:38:34.424507+0000","last_unstale":"2024-03-09T15:12:07.424983+0000","last_undegraded":"2024-03-09T15:12:07.424983+0000","last_fullsized":"2024-03-09T15:12:07.424983+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:07.424892+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:07.424892+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.424892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:44:56.004033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'52","reported_seq":178,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.134229+0000","last_change":"2024-03-09T15:11:59.134272+0000","last_active":"2024-03-09T15:11:59.134229+0000","last_peered":"2024-03-09T15:11:59.134229+0000","last_clean":"2024-03-09T15:11:59.134229+0000","last_became_active":"2024-03-09T14:35:41.116932+0000","last_became_peered":"2024-03-09T14:35:41.116932+0000","last_unstale":"2024-03-09T15:11:59.134229+0000","last_undegraded":"2024-03-09T15:11:59.134229+0000","last_fullsized":"2024-03-09T15:11:59.134229+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-03-09T15:11:59.134102+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-03-09T15:11:59.134102+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.134102+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:37.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":147,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.988650+0000","last_change":"2024-03-09T15:12:19.988650+0000","last_active":"2024-03-09T15:12:19.988650+0000","last_peered":"2024-03-09T15:12:19.988650+0000","last_clean":"2024-03-09T15:12:19.988650+0000","last_became_active":"2024-03-09T14:50:35.498045+0000","last_became_peered":"2024-03-09T14:50:35.498045+0000","last_unstale":"2024-03-09T15:12:19.988650+0000","last_undegraded":"2024-03-09T15:12:19.988650+0000","last_fullsized":"2024-03-09T15:12:19.988650+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:19.988501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:19.988501+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.988501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:24:29.592291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.107598+0000","last_change":"2024-03-09T15:12:14.107598+0000","last_active":"2024-03-09T15:12:14.107598+0000","last_peered":"2024-03-09T15:12:14.107598+0000","last_clean":"2024-03-09T15:12:14.107598+0000","last_became_active":"2024-03-09T14:38:37.436672+0000","last_became_peered":"2024-03-09T14:38:37.436672+0000","last_unstale":"2024-03-09T15:12:14.107598+0000","last_undegraded":"2024-03-09T15:12:14.107598+0000","last_fullsized":"2024-03-09T15:12:14.107598+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:12:14.107494+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:12:14.107494+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.107494+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:26.057559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'11","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.086271+0000","last_change":"2024-03-09T15:11:57.086271+0000","last_active":"2024-03-09T15:11:57.086271+0000","last_peered":"2024-03-09T15:11:57.086271+0000","last_clean":"2024-03-09T15:11:57.086271+0000","last_became_active":"2024-03-09T14:38:34.423136+0000","last_became_peered":"2024-03-09T14:38:34.423136+0000","last_unstale":"2024-03-09T15:11:57.086271+0000","last_undegraded":"2024-03-09T15:11:57.086271+0000","last_fullsized":"2024-03-09T15:11:57.086271+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-03-09T15:11:57.086146+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-03-09T15:11:57.086146+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.086146+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:08:25.289761+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'29","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.181901+0000","last_change":"2024-03-09T15:11:56.181925+0000","last_active":"2024-03-09T15:11:56.181901+0000","last_peered":"2024-03-09T15:11:56.181901+0000","last_clean":"2024-03-09T15:11:56.181901+0000","last_became_active":"2024-03-09T14:35:41.119901+0000","last_became_peered":"2024-03-09T14:35:41.119901+0000","last_unstale":"2024-03-09T15:11:56.181901+0000","last_undegraded":"2024-03-09T15:11:56.181901+0000","last_fullsized":"2024-03-09T15:11:56.181901+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-03-09T15:11:56.181805+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-03-09T15:11:56.181805+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.181805+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:32.492795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":86,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.735667+0000","last_change":"2024-03-09T14:50:35.510602+0000","last_active":"2024-03-09T15:10:51.735667+0000","last_peered":"2024-03-09T15:10:51.735667+0000","last_clean":"2024-03-09T15:10:51.735667+0000","last_became_active":"2024-03-09T14:50:35.510330+0000","last_became_peered":"2024-03-09T14:50:35.510330+0000","last_unstale":"2024-03-09T15:10:51.735667+0000","last_undegraded":"2024-03-09T15:10:51.735667+0000","last_fullsized":"2024-03-09T15:10:51.735667+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"261'9","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:36.596046+0000","last_change":"2024-03-09T14:39:04.870290+0000","last_active":"2024-03-09T15:10:36.596046+0000","last_peered":"2024-03-09T15:10:36.596046+0000","last_clean":"2024-03-09T15:10:36.596046+0000","last_became_active":"2024-03-09T14:39:04.819697+0000","last_became_peered":"2024-03-09T14:39:04.819697+0000","last_unstale":"2024-03-09T15:10:36.596046+0000","last_undegraded":"2024-03-09T15:10:36.596046+0000","last_fullsized":"2024-03-09T15:10:36.596046+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":4098,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.d","version":"264'10","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.752089+0000","last_change":"2024-03-09T15:11:50.752089+0000","last_active":"2024-03-09T15:11:50.752089+0000","last_peered":"2024-03-09T15:11:50.752089+0000","last_clean":"2024-03-09T15:11:50.752089+0000","last_became_active":"2024-03-09T14:38:34.416475+0000","last_became_peered":"2024-03-09T14:38:34.416475+0000","last_unstale":"2024-03-09T15:11:50.752089+0000","last_undegraded":"2024-03-09T15:11:50.752089+0000","last_fullsized":"2024-03-09T15:11:50.752089+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-03-09T15:11:50.751954+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-03-09T15:11:50.751954+0000","last_clean_scrub_stamp":"2024-03-09T15:11:50.751954+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:13:41.632453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":13,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'38","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.323693+0000","last_change":"2024-03-09T15:11:55.323720+0000","last_active":"2024-03-09T15:11:55.323693+0000","last_peered":"2024-03-09T15:11:55.323693+0000","last_clean":"2024-03-09T15:11:55.323693+0000","last_became_active":"2024-03-09T14:35:41.119890+0000","last_became_peered":"2024-03-09T14:35:41.119890+0000","last_unstale":"2024-03-09T15:11:55.323693+0000","last_undegraded":"2024-03-09T15:11:55.323693+0000","last_fullsized":"2024-03-09T15:11:55.323693+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-03-09T15:11:55.323577+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-03-09T15:11:55.323577+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.323577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:32:34.891547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":99,"num_write":64,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:28.316997+0000","last_change":"2024-03-09T15:12:28.317038+0000","last_active":"2024-03-09T15:12:28.316997+0000","last_peered":"2024-03-09T15:12:28.316997+0000","last_clean":"2024-03-09T15:12:28.316997+0000","last_became_active":"2024-03-09T14:50:35.503207+0000","last_became_peered":"2024-03-09T14:50:35.503207+0000","last_unstale":"2024-03-09T15:12:28.316997+0000","last_undegraded":"2024-03-09T15:12:28.316997+0000","last_fullsized":"2024-03-09T15:12:28.316997+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:28.316902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:28.316902+0000","last_clean_scrub_stamp":"2024-03-09T15:12:28.316902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:36:59.795683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.947805+0000","last_change":"2024-03-09T15:11:59.947805+0000","last_active":"2024-03-09T15:11:59.947805+0000","last_peered":"2024-03-09T15:11:59.947805+0000","last_clean":"2024-03-09T15:11:59.947805+0000","last_became_active":"2024-03-09T14:38:37.438507+0000","last_became_peered":"2024-03-09T14:38:37.438507+0000","last_unstale":"2024-03-09T15:11:59.947805+0000","last_undegraded":"2024-03-09T15:11:59.947805+0000","last_fullsized":"2024-03-09T15:11:59.947805+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:59.947646+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:59.947646+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.947646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:49:38.139594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"261'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.416790+0000","last_change":"2024-03-09T15:12:03.416790+0000","last_active":"2024-03-09T15:12:03.416790+0000","last_peered":"2024-03-09T15:12:03.416790+0000","last_clean":"2024-03-09T15:12:03.416790+0000","last_became_active":"2024-03-09T14:38:34.419043+0000","last_became_peered":"2024-03-09T14:38:34.419043+0000","last_unstale":"2024-03-09T15:12:03.416790+0000","last_undegraded":"2024-03-09T15:12:03.416790+0000","last_fullsized":"2024-03-09T15:12:03.416790+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:12:03.416671+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:12:03.416671+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.416671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:13.207851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'89","reported_seq":342,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.286986+0000","last_change":"2024-03-09T15:11:55.287018+0000","last_active":"2024-03-09T15:11:55.286986+0000","last_peered":"2024-03-09T15:11:55.286986+0000","last_clean":"2024-03-09T15:11:55.286986+0000","last_became_active":"2024-03-09T14:35:41.117590+0000","last_became_peered":"2024-03-09T14:35:41.117590+0000","last_unstale":"2024-03-09T15:11:55.286986+0000","last_undegraded":"2024-03-09T15:11:55.286986+0000","last_fullsized":"2024-03-09T15:11:55.286986+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'89","last_scrub_stamp":"2024-03-09T15:11:55.286893+0000","last_deep_scrub":"264'89","last_deep_scrub_stamp":"2024-03-09T15:11:55.286893+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.286893+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:09.078407+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":440,"num_write":100,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4491,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.256855+0000","last_change":"2024-03-09T14:50:35.509165+0000","last_active":"2024-03-09T15:11:52.256855+0000","last_peered":"2024-03-09T15:11:52.256855+0000","last_clean":"2024-03-09T15:11:52.256855+0000","last_became_active":"2024-03-09T14:50:35.508832+0000","last_became_peered":"2024-03-09T14:50:35.508832+0000","last_unstale":"2024-03-09T15:11:52.256855+0000","last_undegraded":"2024-03-09T15:11:52.256855+0000","last_fullsized":"2024-03-09T15:11:52.256855+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395712+0000","last_change":"2024-03-09T14:38:37.439624+0000","last_active":"2024-03-09T15:11:50.395712+0000","last_peered":"2024-03-09T15:11:50.395712+0000","last_clean":"2024-03-09T15:11:50.395712+0000","last_became_active":"2024-03-09T14:38:37.439177+0000","last_became_peered":"2024-03-09T14:38:37.439177+0000","last_unstale":"2024-03-09T15:11:50.395712+0000","last_undegraded":"2024-03-09T15:11:50.395712+0000","last_fullsized":"2024-03-09T15:11:50.395712+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'2","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.077579+0000","last_change":"2024-03-09T15:11:51.077579+0000","last_active":"2024-03-09T15:11:51.077579+0000","last_peered":"2024-03-09T15:11:51.077579+0000","last_clean":"2024-03-09T15:11:51.077579+0000","last_became_active":"2024-03-09T14:38:34.419461+0000","last_became_peered":"2024-03-09T14:38:34.419461+0000","last_unstale":"2024-03-09T15:11:51.077579+0000","last_undegraded":"2024-03-09T15:11:51.077579+0000","last_fullsized":"2024-03-09T15:11:51.077579+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:51.077473+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:51.077473+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.077473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:06:44.961094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'58","reported_seq":201,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.923615+0000","last_change":"2024-03-09T15:12:03.923641+0000","last_active":"2024-03-09T15:12:03.923615+0000","last_peered":"2024-03-09T15:12:03.923615+0000","last_clean":"2024-03-09T15:12:03.923615+0000","last_became_active":"2024-03-09T14:35:41.115769+0000","last_became_peered":"2024-03-09T14:35:41.115769+0000","last_unstale":"2024-03-09T15:12:03.923615+0000","last_undegraded":"2024-03-09T15:12:03.923615+0000","last_fullsized":"2024-03-09T15:12:03.923615+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'58","last_scrub_stamp":"2024-03-09T15:12:03.923518+0000","last_deep_scrub":"264'58","last_deep_scrub_stamp":"2024-03-09T15:12:03.923518+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.923518+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:51:21.138456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":187,"num_write":89,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.695746+0000","last_change":"2024-03-09T14:50:35.512842+0000","last_active":"2024-03-09T15:10:51.695746+0000","last_peered":"2024-03-09T15:10:51.695746+0000","last_clean":"2024-03-09T15:10:51.695746+0000","last_became_active":"2024-03-09T14:50:35.512515+0000","last_became_peered":"2024-03-09T14:50:35.512515+0000","last_unstale":"2024-03-09T15:10:51.695746+0000","last_undegraded":"2024-03-09T15:10:51.695746+0000","last_fullsized":"2024-03-09T15:10:51.695746+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:06.615815+0000","last_change":"2024-03-09T14:38:37.437989+0000","last_active":"2024-03-09T15:11:06.615815+0000","last_peered":"2024-03-09T15:11:06.615815+0000","last_clean":"2024-03-09T15:11:06.615815+0000","last_became_active":"2024-03-09T14:38:37.437674+0000","last_became_peered":"2024-03-09T14:38:37.437674+0000","last_unstale":"2024-03-09T15:11:06.615815+0000","last_undegraded":"2024-03-09T15:11:06.615815+0000","last_fullsized":"2024-03-09T15:11:06.615815+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'11","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.443513+0000","last_change":"2024-03-09T15:11:55.443557+0000","last_active":"2024-03-09T15:11:55.443513+0000","last_peered":"2024-03-09T15:11:55.443513+0000","last_clean":"2024-03-09T15:11:55.443513+0000","last_became_active":"2024-03-09T14:38:34.416635+0000","last_became_peered":"2024-03-09T14:38:34.416635+0000","last_unstale":"2024-03-09T15:11:55.443513+0000","last_undegraded":"2024-03-09T15:11:55.443513+0000","last_fullsized":"2024-03-09T15:11:55.443513+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-03-09T15:11:55.443427+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-03-09T15:11:55.443427+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.443427+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:28:32.324995+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'78","reported_seq":253,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.439208+0000","last_change":"2024-03-09T15:11:57.439251+0000","last_active":"2024-03-09T15:11:57.439208+0000","last_peered":"2024-03-09T15:11:57.439208+0000","last_clean":"2024-03-09T15:11:57.439208+0000","last_became_active":"2024-03-09T14:35:41.113283+0000","last_became_peered":"2024-03-09T14:35:41.113283+0000","last_unstale":"2024-03-09T15:11:57.439208+0000","last_undegraded":"2024-03-09T15:11:57.439208+0000","last_fullsized":"2024-03-09T15:11:57.439208+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'78","last_scrub_stamp":"2024-03-09T15:11:57.439095+0000","last_deep_scrub":"264'78","last_deep_scrub_stamp":"2024-03-09T15:11:57.439095+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.439095+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:21:29.929734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":352,"num_read_kb":252,"num_write":133,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.735729+0000","last_change":"2024-03-09T14:50:35.509538+0000","last_active":"2024-03-09T15:10:51.735729+0000","last_peered":"2024-03-09T15:10:51.735729+0000","last_clean":"2024-03-09T15:10:51.735729+0000","last_became_active":"2024-03-09T14:50:35.509248+0000","last_became_peered":"2024-03-09T14:50:35.509248+0000","last_unstale":"2024-03-09T15:10:51.735729+0000","last_undegraded":"2024-03-09T15:10:51.735729+0000","last_fullsized":"2024-03-09T15:10:51.735729+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.080140+0000","last_change":"2024-03-09T15:12:05.080203+0000","last_active":"2024-03-09T15:12:05.080140+0000","last_peered":"2024-03-09T15:12:05.080140+0000","last_clean":"2024-03-09T15:12:05.080140+0000","last_became_active":"2024-03-09T14:38:37.432007+0000","last_became_peered":"2024-03-09T14:38:37.432007+0000","last_unstale":"2024-03-09T15:12:05.080140+0000","last_undegraded":"2024-03-09T15:12:05.080140+0000","last_fullsized":"2024-03-09T15:12:05.080140+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:12:05.080028+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:12:05.080028+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.080028+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:16:23.673108+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"261'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.059541+0000","last_change":"2024-03-09T15:11:50.059591+0000","last_active":"2024-03-09T15:11:50.059541+0000","last_peered":"2024-03-09T15:11:50.059541+0000","last_clean":"2024-03-09T15:11:50.059541+0000","last_became_active":"2024-03-09T14:38:34.419582+0000","last_became_peered":"2024-03-09T14:38:34.419582+0000","last_unstale":"2024-03-09T15:11:50.059541+0000","last_undegraded":"2024-03-09T15:11:50.059541+0000","last_fullsized":"2024-03-09T15:11:50.059541+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:11:50.059454+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:11:50.059454+0000","last_clean_scrub_stamp":"2024-03-09T15:11:50.059454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:11.962230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"261'10","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.067831+0000","last_change":"2024-03-09T15:12:02.067857+0000","last_active":"2024-03-09T15:12:02.067831+0000","last_peered":"2024-03-09T15:12:02.067831+0000","last_clean":"2024-03-09T15:12:02.067831+0000","last_became_active":"2024-03-09T14:35:41.122670+0000","last_became_peered":"2024-03-09T14:35:41.122670+0000","last_unstale":"2024-03-09T15:12:02.067831+0000","last_undegraded":"2024-03-09T15:12:02.067831+0000","last_fullsized":"2024-03-09T15:12:02.067831+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'10","last_scrub_stamp":"2024-03-09T15:12:02.067736+0000","last_deep_scrub":"261'10","last_deep_scrub_stamp":"2024-03-09T15:12:02.067736+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.067736+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:30.445400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.735689+0000","last_change":"2024-03-09T14:50:35.506808+0000","last_active":"2024-03-09T15:10:51.735689+0000","last_peered":"2024-03-09T15:10:51.735689+0000","last_clean":"2024-03-09T15:10:51.735689+0000","last_became_active":"2024-03-09T14:50:35.506542+0000","last_became_peered":"2024-03-09T14:50:35.506542+0000","last_unstale":"2024-03-09T15:10:51.735689+0000","last_undegraded":"2024-03-09T15:10:51.735689+0000","last_fullsized":"2024-03-09T15:10:51.735689+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.477067+0000","last_change":"2024-03-09T14:38:37.439732+0000","last_active":"2024-03-09T15:11:49.477067+0000","last_peered":"2024-03-09T15:11:49.477067+0000","last_clean":"2024-03-09T15:11:49.477067+0000","last_became_active":"2024-03-09T14:38:37.439444+0000","last_became_peered":"2024-03-09T14:38:37.439444+0000","last_unstale":"2024-03-09T15:11:49.477067+0000","last_undegraded":"2024-03-09T15:11:49.477067+0000","last_fullsized":"2024-03-09T15:11:49.477067+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.434628+0000","last_change":"2024-03-09T15:11:51.434678+0000","last_active":"2024-03-09T15:11:51.434628+0000","last_peered":"2024-03-09T15:11:51.434628+0000","last_clean":"2024-03-09T15:11:51.434628+0000","last_became_active":"2024-03-09T14:38:34.416139+0000","last_became_peered":"2024-03-09T14:38:34.416139+0000","last_unstale":"2024-03-09T15:11:51.434628+0000","last_undegraded":"2024-03-09T15:11:51.434628+0000","last_fullsized":"2024-03-09T15:11:51.434628+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:51.434539+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:51.434539+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.434539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:58:52.717684+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'57","reported_seq":197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.131507+0000","last_change":"2024-03-09T15:11:53.131507+0000","last_active":"2024-03-09T15:11:53.131507+0000","last_peered":"2024-03-09T15:11:53.131507+0000","last_clean":"2024-03-09T15:11:53.131507+0000","last_became_active":"2024-03-09T14:35:41.120802+0000","last_became_peered":"2024-03-09T14:35:41.120802+0000","last_unstale":"2024-03-09T15:11:53.131507+0000","last_undegraded":"2024-03-09T15:11:53.131507+0000","last_fullsized":"2024-03-09T15:11:53.131507+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'57","last_scrub_stamp":"2024-03-09T15:11:53.131366+0000","last_deep_scrub":"264'57","last_deep_scrub_stamp":"2024-03-09T15:11:53.131366+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.131366+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:33.973786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":244,"num_read_kb":179,"num_write":100,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:51.592239+0000","last_change":"2024-03-09T14:50:35.505537+0000","last_active":"2024-03-09T15:10:51.592239+0000","last_peered":"2024-03-09T15:10:51.592239+0000","last_clean":"2024-03-09T15:10:51.592239+0000","last_became_active":"2024-03-09T14:50:35.505278+0000","last_became_peered":"2024-03-09T14:50:35.505278+0000","last_unstale":"2024-03-09T15:10:51.592239+0000","last_undegraded":"2024-03-09T15:10:51.592239+0000","last_fullsized":"2024-03-09T15:10:51.592239+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.021464+0000","last_change":"2024-03-09T15:12:09.021489+0000","last_active":"2024-03-09T15:12:09.021464+0000","last_peered":"2024-03-09T15:12:09.021464+0000","last_clean":"2024-03-09T15:12:09.021464+0000","last_became_active":"2024-03-09T14:38:37.435952+0000","last_became_peered":"2024-03-09T14:38:37.435952+0000","last_unstale":"2024-03-09T15:12:09.021464+0000","last_undegraded":"2024-03-09T15:12:09.021464+0000","last_fullsized":"2024-03-09T15:12:09.021464+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:09.021368+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:09.021368+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.021368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:24.869644+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.117193+0000","last_change":"2024-03-09T15:12:02.117193+0000","last_active":"2024-03-09T15:12:02.117193+0000","last_peered":"2024-03-09T15:12:02.117193+0000","last_clean":"2024-03-09T15:12:02.117193+0000","last_became_active":"2024-03-09T14:38:34.420453+0000","last_became_peered":"2024-03-09T14:38:34.420453+0000","last_unstale":"2024-03-09T15:12:02.117193+0000","last_undegraded":"2024-03-09T15:12:02.117193+0000","last_fullsized":"2024-03-09T15:12:02.117193+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:12:02.117071+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:12:02.117071+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.117071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:07:29.454344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":4,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'47","reported_seq":174,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.237161+0000","last_change":"2024-03-09T15:11:53.237161+0000","last_active":"2024-03-09T15:11:53.237161+0000","last_peered":"2024-03-09T15:11:53.237161+0000","last_clean":"2024-03-09T15:11:53.237161+0000","last_became_active":"2024-03-09T14:35:41.119481+0000","last_became_peered":"2024-03-09T14:35:41.119481+0000","last_unstale":"2024-03-09T15:11:53.237161+0000","last_undegraded":"2024-03-09T15:11:53.237161+0000","last_fullsized":"2024-03-09T15:11:53.237161+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-03-09T15:11:53.237044+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-03-09T15:11:53.237044+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.237044+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:14.411457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":141,"num_write":77,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.615458+0000","last_change":"2024-03-09T14:50:35.508997+0000","last_active":"2024-03-09T15:11:26.615458+0000","last_peered":"2024-03-09T15:11:26.615458+0000","last_clean":"2024-03-09T15:11:26.615458+0000","last_became_active":"2024-03-09T14:50:35.508707+0000","last_became_peered":"2024-03-09T14:50:35.508707+0000","last_unstale":"2024-03-09T15:11:26.615458+0000","last_undegraded":"2024-03-09T15:11:26.615458+0000","last_fullsized":"2024-03-09T15:11:26.615458+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.018171+0000","last_change":"2024-03-09T14:38:37.444242+0000","last_active":"2024-03-09T15:11:49.018171+0000","last_peered":"2024-03-09T15:11:49.018171+0000","last_clean":"2024-03-09T15:11:49.018171+0000","last_became_active":"2024-03-09T14:38:37.443923+0000","last_became_peered":"2024-03-09T14:38:37.443923+0000","last_unstale":"2024-03-09T15:11:49.018171+0000","last_undegraded":"2024-03-09T15:11:49.018171+0000","last_fullsized":"2024-03-09T15:11:49.018171+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'9","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.106603+0000","last_change":"2024-03-09T15:11:56.106603+0000","last_active":"2024-03-09T15:11:56.106603+0000","last_peered":"2024-03-09T15:11:56.106603+0000","last_clean":"2024-03-09T15:11:56.106603+0000","last_became_active":"2024-03-09T14:38:34.421150+0000","last_became_peered":"2024-03-09T14:38:34.421150+0000","last_unstale":"2024-03-09T15:11:56.106603+0000","last_undegraded":"2024-03-09T15:11:56.106603+0000","last_fullsized":"2024-03-09T15:11:56.106603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-03-09T15:11:56.106469+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-03-09T15:11:56.106469+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.106469+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:26.682205+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":24,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'56","reported_seq":195,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.445210+0000","last_change":"2024-03-09T15:11:54.445236+0000","last_active":"2024-03-09T15:11:54.445210+0000","last_peered":"2024-03-09T15:11:54.445210+0000","last_clean":"2024-03-09T15:11:54.445210+0000","last_became_active":"2024-03-09T14:35:41.121047+0000","last_became_peered":"2024-03-09T14:35:41.121047+0000","last_unstale":"2024-03-09T15:11:54.445210+0000","last_undegraded":"2024-03-09T15:11:54.445210+0000","last_fullsized":"2024-03-09T15:11:54.445210+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'56","last_scrub_stamp":"2024-03-09T15:11:54.445106+0000","last_deep_scrub":"264'56","last_deep_scrub_stamp":"2024-03-09T15:11:54.445106+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.445106+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:18:07.884126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":176,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.603164+0000","last_change":"2024-03-09T14:50:35.512833+0000","last_active":"2024-03-09T15:11:26.603164+0000","last_peered":"2024-03-09T15:11:26.603164+0000","last_clean":"2024-03-09T15:11:26.603164+0000","last_became_active":"2024-03-09T14:50:35.512540+0000","last_became_peered":"2024-03-09T14:50:35.512540+0000","last_unstale":"2024-03-09T15:11:26.603164+0000","last_undegraded":"2024-03-09T15:11:26.603164+0000","last_fullsized":"2024-03-09T15:11:26.603164+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"261'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.547837+0000","last_change":"2024-03-09T15:12:15.547863+0000","last_active":"2024-03-09T15:12:15.547837+0000","last_peered":"2024-03-09T15:12:15.547837+0000","last_clean":"2024-03-09T15:12:15.547837+0000","last_became_active":"2024-03-09T14:38:37.436246+0000","last_became_peered":"2024-03-09T14:38:37.436246+0000","last_unstale":"2024-03-09T15:12:15.547837+0000","last_undegraded":"2024-03-09T15:12:15.547837+0000","last_fullsized":"2024-03-09T15:12:15.547837+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:12:15.547748+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:12:15.547748+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.547748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:43.692708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.937352+0000","last_change":"2024-03-09T15:12:16.937392+0000","last_active":"2024-03-09T15:12:16.937352+0000","last_peered":"2024-03-09T15:12:16.937352+0000","last_clean":"2024-03-09T15:12:16.937352+0000","last_became_active":"2024-03-09T14:38:34.417530+0000","last_became_peered":"2024-03-09T14:38:34.417530+0000","last_unstale":"2024-03-09T15:12:16.937352+0000","last_undegraded":"2024-03-09T15:12:16.937352+0000","last_fullsized":"2024-03-09T15:12:16.937352+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:16.937207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:16.937207+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.937207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:40:55.122603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'34","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.290231+0000","last_change":"2024-03-09T15:11:57.290231+0000","last_active":"2024-03-09T15:11:57.290231+0000","last_peered":"2024-03-09T15:11:57.290231+0000","last_clean":"2024-03-09T15:11:57.290231+0000","last_became_active":"2024-03-09T14:35:41.116050+0000","last_became_peered":"2024-03-09T14:35:41.116050+0000","last_unstale":"2024-03-09T15:11:57.290231+0000","last_undegraded":"2024-03-09T15:11:57.290231+0000","last_fullsized":"2024-03-09T15:11:57.290231+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-03-09T15:11:57.290111+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-03-09T15:11:57.290111+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.290111+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:40:12.008655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":98,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:41.582882+0000","last_change":"2024-03-09T14:50:35.513092+0000","last_active":"2024-03-09T15:10:41.582882+0000","last_peered":"2024-03-09T15:10:41.582882+0000","last_clean":"2024-03-09T15:10:41.582882+0000","last_became_active":"2024-03-09T14:50:35.512533+0000","last_became_peered":"2024-03-09T14:50:35.512533+0000","last_unstale":"2024-03-09T15:10:41.582882+0000","last_undegraded":"2024-03-09T15:10:41.582882+0000","last_fullsized":"2024-03-09T15:10:41.582882+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.082439+0000","last_change":"2024-03-09T15:12:01.082464+0000","last_active":"2024-03-09T15:12:01.082439+0000","last_peered":"2024-03-09T15:12:01.082439+0000","last_clean":"2024-03-09T15:12:01.082439+0000","last_became_active":"2024-03-09T14:38:37.432627+0000","last_became_peered":"2024-03-09T14:38:37.432627+0000","last_unstale":"2024-03-09T15:12:01.082439+0000","last_undegraded":"2024-03-09T15:12:01.082439+0000","last_fullsized":"2024-03-09T15:12:01.082439+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:12:01.082349+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:12:01.082349+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.082349+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:29:35.802601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.329616+0000","last_change":"2024-03-09T15:11:59.329643+0000","last_active":"2024-03-09T15:11:59.329616+0000","last_peered":"2024-03-09T15:11:59.329616+0000","last_clean":"2024-03-09T15:11:59.329616+0000","last_became_active":"2024-03-09T14:38:34.415277+0000","last_became_peered":"2024-03-09T14:38:34.415277+0000","last_unstale":"2024-03-09T15:11:59.329616+0000","last_undegraded":"2024-03-09T15:11:59.329616+0000","last_fullsized":"2024-03-09T15:11:59.329616+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:11:59.329530+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:11:59.329530+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.329530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:30:14.001843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'18","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.111501+0000","last_change":"2024-03-09T15:12:00.111526+0000","last_active":"2024-03-09T15:12:00.111501+0000","last_peered":"2024-03-09T15:12:00.111501+0000","last_clean":"2024-03-09T15:12:00.111501+0000","last_became_active":"2024-03-09T14:35:41.123542+0000","last_became_peered":"2024-03-09T14:35:41.123542+0000","last_unstale":"2024-03-09T15:12:00.111501+0000","last_undegraded":"2024-03-09T15:12:00.111501+0000","last_fullsized":"2024-03-09T15:12:00.111501+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-03-09T15:12:00.111408+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-03-09T15:12:00.111408+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.111408+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:58:58.676620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":44,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.492700+0000","last_change":"2024-03-09T14:50:35.506612+0000","last_active":"2024-03-09T15:11:26.492700+0000","last_peered":"2024-03-09T15:11:26.492700+0000","last_clean":"2024-03-09T15:11:26.492700+0000","last_became_active":"2024-03-09T14:50:35.506332+0000","last_became_peered":"2024-03-09T14:50:35.506332+0000","last_unstale":"2024-03-09T15:11:26.492700+0000","last_undegraded":"2024-03-09T15:11:26.492700+0000","last_fullsized":"2024-03-09T15:11:26.492700+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.954128+0000","last_change":"2024-03-09T14:38:37.438481+0000","last_active":"2024-03-09T15:11:45.954128+0000","last_peered":"2024-03-09T15:11:45.954128+0000","last_clean":"2024-03-09T15:11:45.954128+0000","last_became_active":"2024-03-09T14:38:37.438182+0000","last_became_peered":"2024-03-09T14:38:37.438182+0000","last_unstale":"2024-03-09T15:11:45.954128+0000","last_undegraded":"2024-03-09T15:11:45.954128+0000","last_fullsized":"2024-03-09T15:11:45.954128+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.060938+0000","last_change":"2024-03-09T15:11:54.060989+0000","last_active":"2024-03-09T15:11:54.060938+0000","last_peered":"2024-03-09T15:11:54.060938+0000","last_clean":"2024-03-09T15:11:54.060938+0000","last_became_active":"2024-03-09T14:38:34.423106+0000","last_became_peered":"2024-03-09T14:38:34.423106+0000","last_unstale":"2024-03-09T15:11:54.060938+0000","last_undegraded":"2024-03-09T15:11:54.060938+0000","last_fullsized":"2024-03-09T15:11:54.060938+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:54.060823+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:54.060823+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.060823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:12:09.238327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'25","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.105170+0000","last_change":"2024-03-09T15:11:54.105214+0000","last_active":"2024-03-09T15:11:54.105170+0000","last_peered":"2024-03-09T15:11:54.105170+0000","last_clean":"2024-03-09T15:11:54.105170+0000","last_became_active":"2024-03-09T14:35:41.117841+0000","last_became_peered":"2024-03-09T14:35:41.117841+0000","last_unstale":"2024-03-09T15:11:54.105170+0000","last_undegraded":"2024-03-09T15:11:54.105170+0000","last_fullsized":"2024-03-09T15:11:54.105170+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-03-09T15:11:54.105043+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-03-09T15:11:54.105043+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.105043+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:41.171924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":73,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.053058+0000","last_change":"2024-03-09T15:12:23.053090+0000","last_active":"2024-03-09T15:12:23.053058+0000","last_peered":"2024-03-09T15:12:23.053058+0000","last_clean":"2024-03-09T15:12:23.053058+0000","last_became_active":"2024-03-09T14:50:35.509460+0000","last_became_peered":"2024-03-09T14:50:35.509460+0000","last_unstale":"2024-03-09T15:12:23.053058+0000","last_undegraded":"2024-03-09T15:12:23.053058+0000","last_fullsized":"2024-03-09T15:12:23.053058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:23.052971+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:23.052971+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.052971+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:24:39.241271+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.477050+0000","last_change":"2024-03-09T14:38:37.439377+0000","last_active":"2024-03-09T15:11:49.477050+0000","last_peered":"2024-03-09T15:11:49.477050+0000","last_clean":"2024-03-09T15:11:49.477050+0000","last_became_active":"2024-03-09T14:38:37.439087+0000","last_became_peered":"2024-03-09T14:38:37.439087+0000","last_unstale":"2024-03-09T15:11:49.477050+0000","last_undegraded":"2024-03-09T15:11:49.477050+0000","last_fullsized":"2024-03-09T15:11:49.477050+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.105014+0000","last_change":"2024-03-09T15:11:58.105040+0000","last_active":"2024-03-09T15:11:58.105014+0000","last_peered":"2024-03-09T15:11:58.105014+0000","last_clean":"2024-03-09T15:11:58.105014+0000","last_became_active":"2024-03-09T14:38:34.418453+0000","last_became_peered":"2024-03-09T14:38:34.418453+0000","last_unstale":"2024-03-09T15:11:58.105014+0000","last_undegraded":"2024-03-09T15:11:58.105014+0000","last_fullsized":"2024-03-09T15:11:58.105014+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:58.104921+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:58.104921+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.104921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:02:06.522978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'42","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.368598+0000","last_change":"2024-03-09T15:11:51.368625+0000","last_active":"2024-03-09T15:11:51.368598+0000","last_peered":"2024-03-09T15:11:51.368598+0000","last_clean":"2024-03-09T15:11:51.368598+0000","last_became_active":"2024-03-09T14:35:41.119181+0000","last_became_peered":"2024-03-09T14:35:41.119181+0000","last_unstale":"2024-03-09T15:11:51.368598+0000","last_undegraded":"2024-03-09T15:11:51.368598+0000","last_fullsized":"2024-03-09T15:11:51.368598+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-03-09T15:11:51.368508+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-03-09T15:11:51.368508+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.368508+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:30:47.169740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":129,"num_write":69,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.018250+0000","last_change":"2024-03-09T14:50:35.504114+0000","last_active":"2024-03-09T15:11:49.018250+0000","last_peered":"2024-03-09T15:11:49.018250+0000","last_clean":"2024-03-09T15:11:49.018250+0000","last_became_active":"2024-03-09T14:50:35.503858+0000","last_became_peered":"2024-03-09T14:50:35.503858+0000","last_unstale":"2024-03-09T15:11:49.018250+0000","last_undegraded":"2024-03-09T15:11:49.018250+0000","last_fullsized":"2024-03-09T15:11:49.018250+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:41.596596+0000","last_change":"2024-03-09T14:38:37.434360+0000","last_active":"2024-03-09T15:10:41.596596+0000","last_peered":"2024-03-09T15:10:41.596596+0000","last_clean":"2024-03-09T15:10:41.596596+0000","last_became_active":"2024-03-09T14:38:37.434065+0000","last_became_peered":"2024-03-09T14:38:37.434065+0000","last_unstale":"2024-03-09T15:10:41.596596+0000","last_undegraded":"2024-03-09T15:10:41.596596+0000","last_fullsized":"2024-03-09T15:10:41.596596+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.108634+0000","last_change":"2024-03-09T15:11:53.108634+0000","last_active":"2024-03-09T15:11:53.108634+0000","last_peered":"2024-03-09T15:11:53.108634+0000","last_clean":"2024-03-09T15:11:53.108634+0000","last_became_active":"2024-03-09T14:38:34.423145+0000","last_became_peered":"2024-03-09T14:38:34.423145+0000","last_unstale":"2024-03-09T15:11:53.108634+0000","last_undegraded":"2024-03-09T15:11:53.108634+0000","last_fullsized":"2024-03-09T15:11:53.108634+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:11:53.108507+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:11:53.108507+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.108507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:06:47.906719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'41","reported_seq":155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.081553+0000","last_change":"2024-03-09T15:11:51.081580+0000","last_active":"2024-03-09T15:11:51.081553+0000","last_peered":"2024-03-09T15:11:51.081553+0000","last_clean":"2024-03-09T15:11:51.081553+0000","last_became_active":"2024-03-09T14:35:41.117617+0000","last_became_peered":"2024-03-09T14:35:41.117617+0000","last_unstale":"2024-03-09T15:11:51.081553+0000","last_undegraded":"2024-03-09T15:11:51.081553+0000","last_fullsized":"2024-03-09T15:11:51.081553+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-03-09T15:11:51.081467+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-03-09T15:11:51.081467+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.081467+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:57:36.656065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":72,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:26.596036+0000","last_change":"2024-03-09T14:50:35.506611+0000","last_active":"2024-03-09T15:11:26.596036+0000","last_peered":"2024-03-09T15:11:26.596036+0000","last_clean":"2024-03-09T15:11:26.596036+0000","last_became_active":"2024-03-09T14:50:35.506356+0000","last_became_peered":"2024-03-09T14:50:35.506356+0000","last_unstale":"2024-03-09T15:11:26.596036+0000","last_undegraded":"2024-03-09T15:11:26.596036+0000","last_fullsized":"2024-03-09T15:11:26.596036+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:26.357066+0000","last_change":"2024-03-09T15:12:26.357094+0000","last_active":"2024-03-09T15:12:26.357066+0000","last_peered":"2024-03-09T15:12:26.357066+0000","last_clean":"2024-03-09T15:12:26.357066+0000","last_became_active":"2024-03-09T14:38:37.439120+0000","last_became_peered":"2024-03-09T14:38:37.439120+0000","last_unstale":"2024-03-09T15:12:26.357066+0000","last_undegraded":"2024-03-09T15:12:26.357066+0000","last_fullsized":"2024-03-09T15:12:26.357066+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:12:26.356975+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:12:26.356975+0000","last_clean_scrub_stamp":"2024-03-09T15:12:26.356975+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:20:30.951668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'5","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.071993+0000","last_change":"2024-03-09T15:11:52.071993+0000","last_active":"2024-03-09T15:11:52.071993+0000","last_peered":"2024-03-09T15:11:52.071993+0000","last_clean":"2024-03-09T15:11:52.071993+0000","last_became_active":"2024-03-09T14:38:34.422585+0000","last_became_peered":"2024-03-09T14:38:34.422585+0000","last_unstale":"2024-03-09T15:11:52.071993+0000","last_undegraded":"2024-03-09T15:11:52.071993+0000","last_fullsized":"2024-03-09T15:11:52.071993+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:11:52.071888+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:11:52.071888+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.071888+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:53:01.363827+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'19","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.256100+0000","last_change":"2024-03-09T15:11:54.256127+0000","last_active":"2024-03-09T15:11:54.256100+0000","last_peered":"2024-03-09T15:11:54.256100+0000","last_clean":"2024-03-09T15:11:54.256100+0000","last_became_active":"2024-03-09T14:35:41.118425+0000","last_became_peered":"2024-03-09T14:35:41.118425+0000","last_unstale":"2024-03-09T15:11:54.256100+0000","last_undegraded":"2024-03-09T15:11:54.256100+0000","last_fullsized":"2024-03-09T15:11:54.256100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'19","last_scrub_stamp":"2024-03-09T15:11:54.256010+0000","last_deep_scrub":"264'19","last_deep_scrub_stamp":"2024-03-09T15:11:54.256010+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.256010+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:26.207996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":53,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":23,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.616380+0000","last_change":"2024-03-09T14:50:35.505890+0000","last_active":"2024-03-09T15:11:31.616380+0000","last_peered":"2024-03-09T15:11:31.616380+0000","last_clean":"2024-03-09T15:11:31.616380+0000","last_became_active":"2024-03-09T14:50:35.505615+0000","last_became_peered":"2024-03-09T14:50:35.505615+0000","last_unstale":"2024-03-09T15:11:31.616380+0000","last_undegraded":"2024-03-09T15:11:31.616380+0000","last_fullsized":"2024-03-09T15:11:31.616380+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:34.485135+0000","last_clean_scrub_stamp":"2024-03-09T14:50:34.485135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.861341+0000","last_change":"2024-03-09T14:38:37.437735+0000","last_active":"2024-03-09T15:11:50.861341+0000","last_peered":"2024-03-09T15:11:50.861341+0000","last_clean":"2024-03-09T15:11:50.861341+0000","last_became_active":"2024-03-09T14:38:37.437417+0000","last_became_peered":"2024-03-09T14:38:37.437417+0000","last_unstale":"2024-03-09T15:11:50.861341+0000","last_undegraded":"2024-03-09T15:11:50.861341+0000","last_fullsized":"2024-03-09T15:11:50.861341+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:38:36.416798+0000","last_clean_scrub_stamp":"2024-03-09T14:38:36.416798+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"261'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.271804+0000","last_change":"2024-03-09T15:11:56.271804+0000","last_active":"2024-03-09T15:11:56.271804+0000","last_peered":"2024-03-09T15:11:56.271804+0000","last_clean":"2024-03-09T15:11:56.271804+0000","last_became_active":"2024-03-09T14:38:34.415722+0000","last_became_peered":"2024-03-09T14:38:34.415722+0000","last_unstale":"2024-03-09T15:11:56.271804+0000","last_undegraded":"2024-03-09T15:11:56.271804+0000","last_fullsized":"2024-03-09T15:11:56.271804+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:11:56.271674+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:11:56.271674+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.271674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:48:05.171502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'34","reported_seq":142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.068920+0000","last_change":"2024-03-09T15:12:03.068946+0000","last_active":"2024-03-09T15:12:03.068920+0000","last_peered":"2024-03-09T15:12:03.068920+0000","last_clean":"2024-03-09T15:12:03.068920+0000","last_became_active":"2024-03-09T14:35:41.121524+0000","last_became_peered":"2024-03-09T14:35:41.121524+0000","last_unstale":"2024-03-09T15:12:03.068920+0000","last_undegraded":"2024-03-09T15:12:03.068920+0000","last_fullsized":"2024-03-09T15:12:03.068920+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-03-09T15:12:03.068812+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-03-09T15:12:03.068812+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.068812+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:02:49.962553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":103,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'188","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.019914+0000","last_change":"2024-03-09T15:12:07.019914+0000","last_active":"2024-03-09T15:12:07.019914+0000","last_peered":"2024-03-09T15:12:07.019914+0000","last_clean":"2024-03-09T15:12:07.019914+0000","last_became_active":"2024-03-09T14:27:03.724231+0000","last_became_peered":"2024-03-09T14:27:03.724231+0000","last_unstale":"2024-03-09T15:12:07.019914+0000","last_undegraded":"2024-03-09T15:12:07.019914+0000","last_fullsized":"2024-03-09T15:12:07.019914+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'188","last_scrub_stamp":"2024-03-09T15:12:07.019764+0000","last_deep_scrub":"264'188","last_deep_scrub_stamp":"2024-03-09T15:12:07.019764+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.019764+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:52:58.541169+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8703114,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":339,"num_read_kb":37539,"num_write":995,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'402","reported_seq":1864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.467931+0000","last_change":"2024-03-09T15:12:13.467968+0000","last_active":"2024-03-09T15:12:13.467931+0000","last_peered":"2024-03-09T15:12:13.467931+0000","last_clean":"2024-03-09T15:12:13.467931+0000","last_became_active":"2024-03-09T14:26:28.648852+0000","last_became_peered":"2024-03-09T14:26:28.648852+0000","last_unstale":"2024-03-09T15:12:13.467931+0000","last_undegraded":"2024-03-09T15:12:13.467931+0000","last_fullsized":"2024-03-09T15:12:13.467931+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'402","last_scrub_stamp":"2024-03-09T15:12:13.467846+0000","last_deep_scrub":"264'402","last_deep_scrub_stamp":"2024-03-09T15:12:13.467846+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.467846+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:17:36.060526+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2165,"num_read_kb":2027,"num_write":486,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'163","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:20.788947+0000","last_change":"2024-03-09T15:12:20.788986+0000","last_active":"2024-03-09T15:12:20.788947+0000","last_peered":"2024-03-09T15:12:20.788947+0000","last_clean":"2024-03-09T15:12:20.788947+0000","last_became_active":"2024-03-09T14:26:26.635705+0000","last_became_peered":"2024-03-09T14:26:26.635705+0000","last_unstale":"2024-03-09T15:12:20.788947+0000","last_undegraded":"2024-03-09T15:12:20.788947+0000","last_fullsized":"2024-03-09T15:12:20.788947+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-03-09T15:12:20.788850+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-03-09T15:12:20.788850+0000","last_clean_scrub_stamp":"2024-03-09T15:12:20.788850+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:33.866862+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":33876,"num_write":835,"num_write_kb":32927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'819","reported_seq":2399,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.044391+0000","last_change":"2024-03-09T15:12:06.044426+0000","last_active":"2024-03-09T15:12:06.044391+0000","last_peered":"2024-03-09T15:12:06.044391+0000","last_clean":"2024-03-09T15:12:06.044391+0000","last_became_active":"2024-03-09T14:28:04.196872+0000","last_became_peered":"2024-03-09T14:28:04.196872+0000","last_unstale":"2024-03-09T15:12:06.044391+0000","last_undegraded":"2024-03-09T15:12:06.044391+0000","last_fullsized":"2024-03-09T15:12:06.044391+0000","mapping_epoch":38,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'819","last_scrub_stamp":"2024-03-09T15:12:06.044299+0000","last_deep_scrub":"264'819","last_deep_scrub_stamp":"2024-03-09T15:12:06.044299+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.044299+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:04.510091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3746,"num_read_kb":3347,"num_write":1098,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'207","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.017537+0000","last_change":"2024-03-09T14:26:26.626838+0000","last_active":"2024-03-09T15:11:49.017537+0000","last_peered":"2024-03-09T15:11:49.017537+0000","last_clean":"2024-03-09T15:11:49.017537+0000","last_became_active":"2024-03-09T14:26:26.626521+0000","last_became_peered":"2024-03-09T14:26:26.626521+0000","last_unstale":"2024-03-09T15:11:49.017537+0000","last_undegraded":"2024-03-09T15:11:49.017537+0000","last_fullsized":"2024-03-09T15:11:49.017537+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":486,"num_read_kb":60498,"num_write":1106,"num_write_kb":28928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'632","reported_seq":2082,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.931304+0000","last_change":"2024-03-09T15:12:22.931338+0000","last_active":"2024-03-09T15:12:22.931304+0000","last_peered":"2024-03-09T15:12:22.931304+0000","last_clean":"2024-03-09T15:12:22.931304+0000","last_became_active":"2024-03-09T14:26:28.649054+0000","last_became_peered":"2024-03-09T14:26:28.649054+0000","last_unstale":"2024-03-09T15:12:22.931304+0000","last_undegraded":"2024-03-09T15:12:22.931304+0000","last_fullsized":"2024-03-09T15:12:22.931304+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'632","last_scrub_stamp":"2024-03-09T15:12:22.931212+0000","last_deep_scrub":"264'632","last_deep_scrub_stamp":"2024-03-09T15:12:22.931212+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.931212+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":600,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:25.197345+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3080,"num_read_kb":2811,"num_write":822,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'179","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.782617+0000","last_change":"2024-03-09T14:26:26.647604+0000","last_active":"2024-03-09T15:11:45.782617+0000","last_peered":"2024-03-09T15:11:45.782617+0000","last_clean":"2024-03-09T15:11:45.782617+0000","last_became_active":"2024-03-09T14:26:26.647183+0000","last_became_peered":"2024-03-09T14:26:26.647183+0000","last_unstale":"2024-03-09T15:11:45.782617+0000","last_undegraded":"2024-03-09T15:11:45.782617+0000","last_fullsized":"2024-03-09T15:11:45.782617+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":425,"num_read_kb":10841,"num_write":993,"num_write_kb":22118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'384","reported_seq":1962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.556416+0000","last_change":"2024-03-09T15:12:18.556442+0000","last_active":"2024-03-09T15:12:18.556416+0000","last_peered":"2024-03-09T15:12:18.556416+0000","last_clean":"2024-03-09T15:12:18.556416+0000","last_became_active":"2024-03-09T14:26:28.649146+0000","last_became_peered":"2024-03-09T14:26:28.649146+0000","last_unstale":"2024-03-09T15:12:18.556416+0000","last_undegraded":"2024-03-09T15:12:18.556416+0000","last_fullsized":"2024-03-09T15:12:18.556416+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-03-09T15:12:18.556329+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-03-09T15:12:18.556329+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.556329+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:08:15.222991+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2286,"num_read_kb":2187,"num_write":441,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'274","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.938369+0000","last_change":"2024-03-09T14:26:26.652067+0000","last_active":"2024-03-09T15:11:45.938369+0000","last_peered":"2024-03-09T15:11:45.938369+0000","last_clean":"2024-03-09T15:11:45.938369+0000","last_became_active":"2024-03-09T14:26:26.651564+0000","last_became_peered":"2024-03-09T14:26:26.651564+0000","last_unstale":"2024-03-09T15:11:45.938369+0000","last_undegraded":"2024-03-09T15:11:45.938369+0000","last_fullsized":"2024-03-09T15:11:45.938369+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12595319,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":658,"num_read_kb":37858,"num_write":1532,"num_write_kb":26421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'337","reported_seq":1784,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.262885+0000","last_change":"2024-03-09T15:12:13.262925+0000","last_active":"2024-03-09T15:12:13.262885+0000","last_peered":"2024-03-09T15:12:13.262885+0000","last_clean":"2024-03-09T15:12:13.262885+0000","last_became_active":"2024-03-09T14:26:28.648259+0000","last_became_peered":"2024-03-09T14:26:28.648259+0000","last_unstale":"2024-03-09T15:12:13.262885+0000","last_undegraded":"2024-03-09T15:12:13.262885+0000","last_fullsized":"2024-03-09T15:12:13.262885+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-03-09T15:12:13.262759+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-03-09T15:12:13.262759+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.262759+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:11:10.276881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2053,"num_read_kb":1964,"num_write":385,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'170","reported_seq":784,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.414633+0000","last_change":"2024-03-09T15:12:22.414716+0000","last_active":"2024-03-09T15:12:22.414633+0000","last_peered":"2024-03-09T15:12:22.414633+0000","last_clean":"2024-03-09T15:12:22.414633+0000","last_became_active":"2024-03-09T14:26:26.648780+0000","last_became_peered":"2024-03-09T14:26:26.648780+0000","last_unstale":"2024-03-09T15:12:22.414633+0000","last_undegraded":"2024-03-09T15:12:22.414633+0000","last_fullsized":"2024-03-09T15:12:22.414633+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'170","last_scrub_stamp":"2024-03-09T15:12:22.414534+0000","last_deep_scrub":"264'170","last_deep_scrub_stamp":"2024-03-09T15:12:22.414534+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.414534+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:29.029481+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525518,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":382,"num_read_kb":3119,"num_write":934,"num_write_kb":23902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'464","reported_seq":2019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.075942+0000","last_change":"2024-03-09T15:12:17.075942+0000","last_active":"2024-03-09T15:12:17.075942+0000","last_peered":"2024-03-09T15:12:17.075942+0000","last_clean":"2024-03-09T15:12:17.075942+0000","last_became_active":"2024-03-09T14:26:28.649994+0000","last_became_peered":"2024-03-09T14:26:28.649994+0000","last_unstale":"2024-03-09T15:12:17.075942+0000","last_undegraded":"2024-03-09T15:12:17.075942+0000","last_fullsized":"2024-03-09T15:12:17.075942+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'464","last_scrub_stamp":"2024-03-09T15:12:17.075802+0000","last_deep_scrub":"264'464","last_deep_scrub_stamp":"2024-03-09T15:12:17.075802+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.075802+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:27:58.383959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2508,"num_read_kb":2326,"num_write":602,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'163","reported_seq":813,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.963912+0000","last_change":"2024-03-09T14:26:26.652122+0000","last_active":"2024-03-09T15:11:45.963912+0000","last_peered":"2024-03-09T15:11:45.963912+0000","last_clean":"2024-03-09T15:11:45.963912+0000","last_became_active":"2024-03-09T14:26:26.651754+0000","last_became_peered":"2024-03-09T14:26:26.651754+0000","last_unstale":"2024-03-09T15:11:45.963912+0000","last_undegraded":"2024-03-09T15:11:45.963912+0000","last_fullsized":"2024-03-09T15:11:45.963912+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":432,"num_read_kb":120305,"num_write":891,"num_write_kb":41051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'1265","reported_seq":2902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.461205+0000","last_change":"2024-03-09T15:12:15.461205+0000","last_active":"2024-03-09T15:12:15.461205+0000","last_peered":"2024-03-09T15:12:15.461205+0000","last_clean":"2024-03-09T15:12:15.461205+0000","last_became_active":"2024-03-09T14:26:28.651754+0000","last_became_peered":"2024-03-09T14:26:28.651754+0000","last_unstale":"2024-03-09T15:12:15.461205+0000","last_undegraded":"2024-03-09T15:12:15.461205+0000","last_fullsized":"2024-03-09T15:12:15.461205+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1265","last_scrub_stamp":"2024-03-09T15:12:15.461028+0000","last_deep_scrub":"264'1265","last_deep_scrub_stamp":"2024-03-09T15:12:15.461028+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.461028+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":1200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:48.502160+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5611,"num_read_kb":4890,"num_write":1803,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'158","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.962481+0000","last_change":"2024-03-09T14:26:26.643565+0000","last_active":"2024-03-09T15:11:45.962481+0000","last_peered":"2024-03-09T15:11:45.962481+0000","last_clean":"2024-03-09T15:11:45.962481+0000","last_became_active":"2024-03-09T14:26:26.643195+0000","last_became_peered":"2024-03-09T14:26:26.643195+0000","last_unstale":"2024-03-09T15:11:45.962481+0000","last_undegraded":"2024-03-09T15:11:45.962481+0000","last_fullsized":"2024-03-09T15:11:45.962481+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924406,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":386,"num_read_kb":7445,"num_write":885,"num_write_kb":17740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'832","reported_seq":2511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.968241+0000","last_change":"2024-03-09T15:12:13.968241+0000","last_active":"2024-03-09T15:12:13.968241+0000","last_peered":"2024-03-09T15:12:13.968241+0000","last_clean":"2024-03-09T15:12:13.968241+0000","last_became_active":"2024-03-09T14:26:28.653778+0000","last_became_peered":"2024-03-09T14:26:28.653778+0000","last_unstale":"2024-03-09T15:12:13.968241+0000","last_undegraded":"2024-03-09T15:12:13.968241+0000","last_fullsized":"2024-03-09T15:12:13.968241+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'832","last_scrub_stamp":"2024-03-09T15:12:13.968142+0000","last_deep_scrub":"264'832","last_deep_scrub_stamp":"2024-03-09T15:12:13.968142+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.968142+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:13.118115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3883,"num_read_kb":3504,"num_write":1111,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'453","reported_seq":2044,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:30.890107+0000","last_change":"2024-03-09T15:12:30.890157+0000","last_active":"2024-03-09T15:12:30.890107+0000","last_peered":"2024-03-09T15:12:30.890107+0000","last_clean":"2024-03-09T15:12:30.890107+0000","last_became_active":"2024-03-09T14:26:28.649128+0000","last_became_peered":"2024-03-09T14:26:28.649128+0000","last_unstale":"2024-03-09T15:12:30.890107+0000","last_undegraded":"2024-03-09T15:12:30.890107+0000","last_fullsized":"2024-03-09T15:12:30.890107+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'453","last_scrub_stamp":"2024-03-09T15:12:30.889994+0000","last_deep_scrub":"264'453","last_deep_scrub_stamp":"2024-03-09T15:12:30.889994+0000","last_clean_scrub_stamp":"2024-03-09T15:12:30.889994+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:21.035252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2472,"num_read_kb":2328,"num_write":564,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'188","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.967396+0000","last_change":"2024-03-09T14:26:26.651818+0000","last_active":"2024-03-09T15:11:45.967396+0000","last_peered":"2024-03-09T15:11:45.967396+0000","last_clean":"2024-03-09T15:11:45.967396+0000","last_became_active":"2024-03-09T14:26:26.651323+0000","last_became_peered":"2024-03-09T14:26:26.651323+0000","last_unstale":"2024-03-09T15:11:45.967396+0000","last_undegraded":"2024-03-09T15:11:45.967396+0000","last_fullsized":"2024-03-09T15:11:45.967396+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2187,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":439,"num_read_kb":7847,"num_write":1012,"num_write_kb":34087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'418","reported_seq":1947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.752910+0000","last_change":"2024-03-09T15:12:23.752943+0000","last_active":"2024-03-09T15:12:23.752910+0000","last_peered":"2024-03-09T15:12:23.752910+0000","last_clean":"2024-03-09T15:12:23.752910+0000","last_became_active":"2024-03-09T14:26:28.645422+0000","last_became_peered":"2024-03-09T14:26:28.645422+0000","last_unstale":"2024-03-09T15:12:23.752910+0000","last_undegraded":"2024-03-09T15:12:23.752910+0000","last_fullsized":"2024-03-09T15:12:23.752910+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'418","last_scrub_stamp":"2024-03-09T15:12:23.752791+0000","last_deep_scrub":"264'418","last_deep_scrub_stamp":"2024-03-09T15:12:23.752791+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.752791+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:07:21.902125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2243,"num_read_kb":2118,"num_write":516,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'179","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.298486+0000","last_change":"2024-03-09T15:12:17.298486+0000","last_active":"2024-03-09T15:12:17.298486+0000","last_peered":"2024-03-09T15:12:17.298486+0000","last_clean":"2024-03-09T15:12:17.298486+0000","last_became_active":"2024-03-09T14:26:26.644578+0000","last_became_peered":"2024-03-09T14:26:26.644578+0000","last_unstale":"2024-03-09T15:12:17.298486+0000","last_undegraded":"2024-03-09T15:12:17.298486+0000","last_fullsized":"2024-03-09T15:12:17.298486+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-03-09T15:12:17.298329+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-03-09T15:12:17.298329+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.298329+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:38.437013+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":16041,"num_write":1043,"num_write_kb":25248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'395","reported_seq":2111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.422714+0000","last_change":"2024-03-09T15:12:11.422749+0000","last_active":"2024-03-09T15:12:11.422714+0000","last_peered":"2024-03-09T15:12:11.422714+0000","last_clean":"2024-03-09T15:12:11.422714+0000","last_became_active":"2024-03-09T14:26:28.648115+0000","last_became_peered":"2024-03-09T14:26:28.648115+0000","last_unstale":"2024-03-09T15:12:11.422714+0000","last_undegraded":"2024-03-09T15:12:11.422714+0000","last_fullsized":"2024-03-09T15:12:11.422714+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-03-09T15:12:11.422623+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-03-09T15:12:11.422623+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.422623+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:31.095264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2471,"num_read_kb":2382,"num_write":449,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2442,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'206","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.250411+0000","last_change":"2024-03-09T15:12:19.250411+0000","last_active":"2024-03-09T15:12:19.250411+0000","last_peered":"2024-03-09T15:12:19.250411+0000","last_clean":"2024-03-09T15:12:19.250411+0000","last_became_active":"2024-03-09T14:26:26.647391+0000","last_became_peered":"2024-03-09T14:26:26.647391+0000","last_unstale":"2024-03-09T15:12:19.250411+0000","last_undegraded":"2024-03-09T15:12:19.250411+0000","last_fullsized":"2024-03-09T15:12:19.250411+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-03-09T15:12:19.250204+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-03-09T15:12:19.250204+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.250204+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:12:14.352167+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778753,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":14846,"num_write":1056,"num_write_kb":41673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'455","reported_seq":2034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.979611+0000","last_change":"2024-03-09T15:12:11.979611+0000","last_active":"2024-03-09T15:12:11.979611+0000","last_peered":"2024-03-09T15:12:11.979611+0000","last_clean":"2024-03-09T15:12:11.979611+0000","last_became_active":"2024-03-09T14:26:28.647846+0000","last_became_peered":"2024-03-09T14:26:28.647846+0000","last_unstale":"2024-03-09T15:12:11.979611+0000","last_undegraded":"2024-03-09T15:12:11.979611+0000","last_fullsized":"2024-03-09T15:12:11.979611+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'455","last_scrub_stamp":"2024-03-09T15:12:11.979455+0000","last_deep_scrub":"264'455","last_deep_scrub_stamp":"2024-03-09T15:12:11.979455+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.979455+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:12:48.086252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2382,"num_read_kb":2246,"num_write":552,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":961,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'284","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.915543+0000","last_change":"2024-03-09T15:12:23.915596+0000","last_active":"2024-03-09T15:12:23.915543+0000","last_peered":"2024-03-09T15:12:23.915543+0000","last_clean":"2024-03-09T15:12:23.915543+0000","last_became_active":"2024-03-09T14:26:26.637767+0000","last_became_peered":"2024-03-09T14:26:26.637767+0000","last_unstale":"2024-03-09T15:12:23.915543+0000","last_undegraded":"2024-03-09T15:12:23.915543+0000","last_fullsized":"2024-03-09T15:12:23.915543+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'284","last_scrub_stamp":"2024-03-09T15:12:23.915441+0000","last_deep_scrub":"264'284","last_deep_scrub_stamp":"2024-03-09T15:12:23.915441+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.915441+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:28:30.522143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4508970,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":598,"num_read_kb":72489,"num_write":1415,"num_write_kb":47263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'1536","reported_seq":3271,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.976389+0000","last_change":"2024-03-09T15:12:14.976389+0000","last_active":"2024-03-09T15:12:14.976389+0000","last_peered":"2024-03-09T15:12:14.976389+0000","last_clean":"2024-03-09T15:12:14.976389+0000","last_became_active":"2024-03-09T14:26:28.653385+0000","last_became_peered":"2024-03-09T14:26:28.653385+0000","last_unstale":"2024-03-09T15:12:14.976389+0000","last_undegraded":"2024-03-09T15:12:14.976389+0000","last_fullsized":"2024-03-09T15:12:14.976389+0000","mapping_epoch":25,"log_start":"264'1500","ondisk_log_start":"264'1500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1536","last_scrub_stamp":"2024-03-09T15:12:14.976254+0000","last_deep_scrub":"264'1536","last_deep_scrub_stamp":"2024-03-09T15:12:14.976254+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.976254+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":1500,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:52:46.633280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6446,"num_read_kb":5594,"num_write":2158,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'220","reported_seq":858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395144+0000","last_change":"2024-03-09T14:26:26.644011+0000","last_active":"2024-03-09T15:11:50.395144+0000","last_peered":"2024-03-09T15:11:50.395144+0000","last_clean":"2024-03-09T15:11:50.395144+0000","last_became_active":"2024-03-09T14:26:26.643401+0000","last_became_peered":"2024-03-09T14:26:26.643401+0000","last_unstale":"2024-03-09T15:11:50.395144+0000","last_undegraded":"2024-03-09T15:11:50.395144+0000","last_fullsized":"2024-03-09T15:11:50.395144+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":517275,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":464,"num_read_kb":13858,"num_write":1176,"num_write_kb":34499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'728","reported_seq":2217,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.070669+0000","last_change":"2024-03-09T15:12:15.070669+0000","last_active":"2024-03-09T15:12:15.070669+0000","last_peered":"2024-03-09T15:12:15.070669+0000","last_clean":"2024-03-09T15:12:15.070669+0000","last_became_active":"2024-03-09T14:26:28.650334+0000","last_became_peered":"2024-03-09T14:26:28.650334+0000","last_unstale":"2024-03-09T15:12:15.070669+0000","last_undegraded":"2024-03-09T15:12:15.070669+0000","last_fullsized":"2024-03-09T15:12:15.070669+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'728","last_scrub_stamp":"2024-03-09T15:12:15.070486+0000","last_deep_scrub":"264'728","last_deep_scrub_stamp":"2024-03-09T15:12:15.070486+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.070486+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:09:57.328921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3318,"num_read_kb":2980,"num_write":968,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'137","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.968739+0000","last_change":"2024-03-09T14:26:26.631574+0000","last_active":"2024-03-09T15:11:45.968739+0000","last_peered":"2024-03-09T15:11:45.968739+0000","last_clean":"2024-03-09T15:11:45.968739+0000","last_became_active":"2024-03-09T14:26:26.631203+0000","last_became_peered":"2024-03-09T14:26:26.631203+0000","last_unstale":"2024-03-09T15:11:45.968739+0000","last_undegraded":"2024-03-09T15:11:45.968739+0000","last_fullsized":"2024-03-09T15:11:45.968739+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049909,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":305,"num_read_kb":11988,"num_write":738,"num_write_kb":25932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'99","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.165554+0000","last_change":"2024-03-09T15:11:55.165554+0000","last_active":"2024-03-09T15:11:55.165554+0000","last_peered":"2024-03-09T15:11:55.165554+0000","last_clean":"2024-03-09T15:11:55.165554+0000","last_became_active":"2024-03-09T14:26:36.674500+0000","last_became_peered":"2024-03-09T14:26:36.674500+0000","last_unstale":"2024-03-09T15:11:55.165554+0000","last_undegraded":"2024-03-09T15:11:55.165554+0000","last_fullsized":"2024-03-09T15:11:55.165554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'99","last_scrub_stamp":"2024-03-09T15:11:55.165436+0000","last_deep_scrub":"264'99","last_deep_scrub_stamp":"2024-03-09T15:11:55.165436+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.165436+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:59.949962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":88,"num_write":230,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'373","reported_seq":1782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.860735+0000","last_change":"2024-03-09T15:12:01.860775+0000","last_active":"2024-03-09T15:12:01.860735+0000","last_peered":"2024-03-09T15:12:01.860735+0000","last_clean":"2024-03-09T15:12:01.860735+0000","last_became_active":"2024-03-09T14:28:03.815924+0000","last_became_peered":"2024-03-09T14:28:03.815924+0000","last_unstale":"2024-03-09T15:12:01.860735+0000","last_undegraded":"2024-03-09T15:12:01.860735+0000","last_fullsized":"2024-03-09T15:12:01.860735+0000","mapping_epoch":38,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-03-09T15:12:01.860643+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-03-09T15:12:01.860643+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.860643+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:05.270001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1992,"num_read_kb":1883,"num_write":432,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"264'204","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.976920+0000","last_change":"2024-03-09T14:26:26.653743+0000","last_active":"2024-03-09T15:11:45.976920+0000","last_peered":"2024-03-09T15:11:45.976920+0000","last_clean":"2024-03-09T15:11:45.976920+0000","last_became_active":"2024-03-09T14:26:26.652957+0000","last_became_peered":"2024-03-09T14:26:26.652957+0000","last_unstale":"2024-03-09T15:11:45.976920+0000","last_undegraded":"2024-03-09T15:11:45.976920+0000","last_fullsized":"2024-03-09T15:11:45.976920+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048753,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":421,"num_read_kb":22200,"num_write":1166,"num_write_kb":38864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.322698+0000","last_change":"2024-03-09T14:26:30.655416+0000","last_active":"2024-03-09T15:11:51.322698+0000","last_peered":"2024-03-09T15:11:51.322698+0000","last_clean":"2024-03-09T15:11:51.322698+0000","last_became_active":"2024-03-09T14:26:30.654862+0000","last_became_peered":"2024-03-09T14:26:30.654862+0000","last_unstale":"2024-03-09T15:11:51.322698+0000","last_undegraded":"2024-03-09T15:11:51.322698+0000","last_fullsized":"2024-03-09T15:11:51.322698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:29.627088+0000","last_clean_scrub_stamp":"2024-03-09T14:26:29.627088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'185","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.746208+0000","last_change":"2024-03-09T14:26:32.653350+0000","last_active":"2024-03-09T15:11:45.746208+0000","last_peered":"2024-03-09T15:11:45.746208+0000","last_clean":"2024-03-09T15:11:45.746208+0000","last_became_active":"2024-03-09T14:26:32.652879+0000","last_became_peered":"2024-03-09T14:26:32.652879+0000","last_unstale":"2024-03-09T15:11:45.746208+0000","last_undegraded":"2024-03-09T15:11:45.746208+0000","last_fullsized":"2024-03-09T15:11:45.746208+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19668,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":251,"num_read_kb":350,"num_write":144,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.916776+0000","last_change":"2024-03-09T15:12:15.916819+0000","last_active":"2024-03-09T15:12:15.916776+0000","last_peered":"2024-03-09T15:12:15.916776+0000","last_clean":"2024-03-09T15:12:15.916776+0000","last_became_active":"2024-03-09T14:26:34.670336+0000","last_became_peered":"2024-03-09T14:26:34.670336+0000","last_unstale":"2024-03-09T15:12:15.916776+0000","last_undegraded":"2024-03-09T15:12:15.916776+0000","last_fullsized":"2024-03-09T15:12:15.916776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:15.916655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:15.916655+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.916655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:43:07.942906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'171","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.364367+0000","last_change":"2024-03-09T15:11:58.364403+0000","last_active":"2024-03-09T15:11:58.364367+0000","last_peered":"2024-03-09T15:11:58.364367+0000","last_clean":"2024-03-09T15:11:58.364367+0000","last_became_active":"2024-03-09T14:26:36.673806+0000","last_became_peered":"2024-03-09T14:26:36.673806+0000","last_unstale":"2024-03-09T15:11:58.364367+0000","last_undegraded":"2024-03-09T15:11:58.364367+0000","last_fullsized":"2024-03-09T15:11:58.364367+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-03-09T15:11:58.364272+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-03-09T15:11:58.364272+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.364272+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:00:50.536210+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":385,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'375","reported_seq":1928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.469674+0000","last_change":"2024-03-09T15:12:10.469674+0000","last_active":"2024-03-09T15:12:10.469674+0000","last_peered":"2024-03-09T15:12:10.469674+0000","last_clean":"2024-03-09T15:12:10.469674+0000","last_became_active":"2024-03-09T14:26:28.645537+0000","last_became_peered":"2024-03-09T14:26:28.645537+0000","last_unstale":"2024-03-09T15:12:10.469674+0000","last_undegraded":"2024-03-09T15:12:10.469674+0000","last_fullsized":"2024-03-09T15:12:10.469674+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-03-09T15:12:10.469530+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-03-09T15:12:10.469530+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.469530+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:06:26.190793+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2096,"num_read_kb":2016,"num_write":417,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'227","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.969882+0000","last_change":"2024-03-09T14:26:26.644936+0000","last_active":"2024-03-09T15:11:45.969882+0000","last_peered":"2024-03-09T15:11:45.969882+0000","last_clean":"2024-03-09T15:11:45.969882+0000","last_became_active":"2024-03-09T14:26:26.644563+0000","last_became_peered":"2024-03-09T14:26:26.644563+0000","last_unstale":"2024-03-09T15:11:45.969882+0000","last_undegraded":"2024-03-09T15:11:45.969882+0000","last_fullsized":"2024-03-09T15:11:45.969882+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":463,"num_read_kb":29388,"num_write":1134,"num_write_kb":42312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:28.080657+0000","last_change":"2024-03-09T15:12:28.080682+0000","last_active":"2024-03-09T15:12:28.080657+0000","last_peered":"2024-03-09T15:12:28.080657+0000","last_clean":"2024-03-09T15:12:28.080657+0000","last_became_active":"2024-03-09T14:26:30.651683+0000","last_became_peered":"2024-03-09T14:26:30.651683+0000","last_unstale":"2024-03-09T15:12:28.080657+0000","last_undegraded":"2024-03-09T15:12:28.080657+0000","last_fullsized":"2024-03-09T15:12:28.080657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:28.080528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:28.080528+0000","last_clean_scrub_stamp":"2024-03-09T15:12:28.080528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:32.203719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'84","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.126890+0000","last_change":"2024-03-09T15:12:04.126890+0000","last_active":"2024-03-09T15:12:04.126890+0000","last_peered":"2024-03-09T15:12:04.126890+0000","last_clean":"2024-03-09T15:12:04.126890+0000","last_became_active":"2024-03-09T14:26:32.656995+0000","last_became_peered":"2024-03-09T14:26:32.656995+0000","last_unstale":"2024-03-09T15:12:04.126890+0000","last_undegraded":"2024-03-09T15:12:04.126890+0000","last_fullsized":"2024-03-09T15:12:04.126890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-03-09T15:12:04.126765+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-03-09T15:12:04.126765+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.126765+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:29:25.687030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":86,"num_read_kb":83,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.143212+0000","last_change":"2024-03-09T15:12:00.143212+0000","last_active":"2024-03-09T15:12:00.143212+0000","last_peered":"2024-03-09T15:12:00.143212+0000","last_clean":"2024-03-09T15:12:00.143212+0000","last_became_active":"2024-03-09T14:26:34.666326+0000","last_became_peered":"2024-03-09T14:26:34.666326+0000","last_unstale":"2024-03-09T15:12:00.143212+0000","last_undegraded":"2024-03-09T15:12:00.143212+0000","last_fullsized":"2024-03-09T15:12:00.143212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:00.143034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:00.143034+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.143034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:46:46.627453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'117","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.468997+0000","last_change":"2024-03-09T15:12:04.469035+0000","last_active":"2024-03-09T15:12:04.468997+0000","last_peered":"2024-03-09T15:12:04.468997+0000","last_clean":"2024-03-09T15:12:04.468997+0000","last_became_active":"2024-03-09T14:26:36.671071+0000","last_became_peered":"2024-03-09T14:26:36.671071+0000","last_unstale":"2024-03-09T15:12:04.468997+0000","last_undegraded":"2024-03-09T15:12:04.468997+0000","last_fullsized":"2024-03-09T15:12:04.468997+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-03-09T15:12:04.468905+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-03-09T15:12:04.468905+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.468905+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:59:52.388940+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":104,"num_write":246,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'952","reported_seq":2550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.532483+0000","last_change":"2024-03-09T15:12:22.532483+0000","last_active":"2024-03-09T15:12:22.532483+0000","last_peered":"2024-03-09T15:12:22.532483+0000","last_clean":"2024-03-09T15:12:22.532483+0000","last_became_active":"2024-03-09T14:26:28.648586+0000","last_became_peered":"2024-03-09T14:26:28.648586+0000","last_unstale":"2024-03-09T15:12:22.532483+0000","last_undegraded":"2024-03-09T15:12:22.532483+0000","last_fullsized":"2024-03-09T15:12:22.532483+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'952","last_scrub_stamp":"2024-03-09T15:12:22.532310+0000","last_deep_scrub":"264'952","last_deep_scrub_stamp":"2024-03-09T15:12:22.532310+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.532310+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":900,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:38.666020+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4258,"num_read_kb":3730,"num_write":1359,"num_write_kb":540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'185","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.895563+0000","last_change":"2024-03-09T14:26:26.653314+0000","last_active":"2024-03-09T15:11:45.895563+0000","last_peered":"2024-03-09T15:11:45.895563+0000","last_clean":"2024-03-09T15:11:45.895563+0000","last_became_active":"2024-03-09T14:26:26.652803+0000","last_became_peered":"2024-03-09T14:26:26.652803+0000","last_unstale":"2024-03-09T15:11:45.895563+0000","last_undegraded":"2024-03-09T15:11:45.895563+0000","last_fullsized":"2024-03-09T15:11:45.895563+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":6854,"num_write":972,"num_write_kb":33721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:30.077868+0000","last_change":"2024-03-09T15:12:30.077892+0000","last_active":"2024-03-09T15:12:30.077868+0000","last_peered":"2024-03-09T15:12:30.077868+0000","last_clean":"2024-03-09T15:12:30.077868+0000","last_became_active":"2024-03-09T14:26:30.652699+0000","last_became_peered":"2024-03-09T14:26:30.652699+0000","last_unstale":"2024-03-09T15:12:30.077868+0000","last_undegraded":"2024-03-09T15:12:30.077868+0000","last_fullsized":"2024-03-09T15:12:30.077868+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:30.077770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:30.077770+0000","last_clean_scrub_stamp":"2024-03-09T15:12:30.077770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:46.459602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'103","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.845603+0000","last_change":"2024-03-09T15:11:56.845640+0000","last_active":"2024-03-09T15:11:56.845603+0000","last_peered":"2024-03-09T15:11:56.845603+0000","last_clean":"2024-03-09T15:11:56.845603+0000","last_became_active":"2024-03-09T14:26:32.658348+0000","last_became_peered":"2024-03-09T14:26:32.658348+0000","last_unstale":"2024-03-09T15:11:56.845603+0000","last_undegraded":"2024-03-09T15:11:56.845603+0000","last_fullsized":"2024-03-09T15:11:56.845603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'103","last_scrub_stamp":"2024-03-09T15:11:56.845520+0000","last_deep_scrub":"264'103","last_deep_scrub_stamp":"2024-03-09T15:11:56.845520+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.845520+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:59:30.263896+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'532","reported_seq":1975,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.894493+0000","last_change":"2024-03-09T15:12:13.894519+0000","last_active":"2024-03-09T15:12:13.894493+0000","last_peered":"2024-03-09T15:12:13.894493+0000","last_clean":"2024-03-09T15:12:13.894493+0000","last_became_active":"2024-03-09T14:26:34.673916+0000","last_became_peered":"2024-03-09T14:26:34.673916+0000","last_unstale":"2024-03-09T15:12:13.894493+0000","last_undegraded":"2024-03-09T15:12:13.894493+0000","last_fullsized":"2024-03-09T15:12:13.894493+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'532","last_scrub_stamp":"2024-03-09T15:12:13.894406+0000","last_deep_scrub":"264'532","last_deep_scrub_stamp":"2024-03-09T15:12:13.894406+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.894406+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:30.354650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'207","reported_seq":1018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.154737+0000","last_change":"2024-03-09T15:11:53.154775+0000","last_active":"2024-03-09T15:11:53.154737+0000","last_peered":"2024-03-09T15:11:53.154737+0000","last_clean":"2024-03-09T15:11:53.154737+0000","last_became_active":"2024-03-09T14:26:36.786202+0000","last_became_peered":"2024-03-09T14:26:36.786202+0000","last_unstale":"2024-03-09T15:11:53.154737+0000","last_undegraded":"2024-03-09T15:11:53.154737+0000","last_fullsized":"2024-03-09T15:11:53.154737+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-03-09T15:11:53.154651+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-03-09T15:11:53.154651+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.154651+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:25:55.897162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":555,"num_write":450,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'734","reported_seq":2342,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:20.129347+0000","last_change":"2024-03-09T15:12:20.129347+0000","last_active":"2024-03-09T15:12:20.129347+0000","last_peered":"2024-03-09T15:12:20.129347+0000","last_clean":"2024-03-09T15:12:20.129347+0000","last_became_active":"2024-03-09T14:26:28.657030+0000","last_became_peered":"2024-03-09T14:26:28.657030+0000","last_unstale":"2024-03-09T15:12:20.129347+0000","last_undegraded":"2024-03-09T15:12:20.129347+0000","last_fullsized":"2024-03-09T15:12:20.129347+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'734","last_scrub_stamp":"2024-03-09T15:12:20.129217+0000","last_deep_scrub":"264'734","last_deep_scrub_stamp":"2024-03-09T15:12:20.129217+0000","last_clean_scrub_stamp":"2024-03-09T15:12:20.129217+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:40:57.058857+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3495,"num_read_kb":3179,"num_write":956,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'234","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.300268+0000","last_change":"2024-03-09T15:12:15.300299+0000","last_active":"2024-03-09T15:12:15.300268+0000","last_peered":"2024-03-09T15:12:15.300268+0000","last_clean":"2024-03-09T15:12:15.300268+0000","last_became_active":"2024-03-09T14:26:26.643877+0000","last_became_peered":"2024-03-09T14:26:26.643877+0000","last_unstale":"2024-03-09T15:12:15.300268+0000","last_undegraded":"2024-03-09T15:12:15.300268+0000","last_fullsized":"2024-03-09T15:12:15.300268+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'234","last_scrub_stamp":"2024-03-09T15:12:15.300170+0000","last_deep_scrub":"264'234","last_deep_scrub_stamp":"2024-03-09T15:12:15.300170+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.300170+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:44.155158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":619,"num_read_kb":42109,"num_write":1108,"num_write_kb":38892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.404059+0000","last_change":"2024-03-09T15:12:19.404059+0000","last_active":"2024-03-09T15:12:19.404059+0000","last_peered":"2024-03-09T15:12:19.404059+0000","last_clean":"2024-03-09T15:12:19.404059+0000","last_became_active":"2024-03-09T14:26:30.650741+0000","last_became_peered":"2024-03-09T14:26:30.650741+0000","last_unstale":"2024-03-09T15:12:19.404059+0000","last_undegraded":"2024-03-09T15:12:19.404059+0000","last_fullsized":"2024-03-09T15:12:19.404059+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:19.403955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:19.403955+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.403955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:13:04.415182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'145","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.705297+0000","last_change":"2024-03-09T14:26:32.869163+0000","last_active":"2024-03-09T15:11:45.705297+0000","last_peered":"2024-03-09T15:11:45.705297+0000","last_clean":"2024-03-09T15:11:45.705297+0000","last_became_active":"2024-03-09T14:26:32.868081+0000","last_became_peered":"2024-03-09T14:26:32.868081+0000","last_unstale":"2024-03-09T15:11:45.705297+0000","last_undegraded":"2024-03-09T15:11:45.705297+0000","last_fullsized":"2024-03-09T15:11:45.705297+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7737,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":240,"num_write":102,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'565","reported_seq":4034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.044373+0000","last_change":"2024-03-09T15:12:08.044409+0000","last_active":"2024-03-09T15:12:08.044373+0000","last_peered":"2024-03-09T15:12:08.044373+0000","last_clean":"2024-03-09T15:12:08.044373+0000","last_became_active":"2024-03-09T14:26:34.679280+0000","last_became_peered":"2024-03-09T14:26:34.679280+0000","last_unstale":"2024-03-09T15:12:08.044373+0000","last_undegraded":"2024-03-09T15:12:08.044373+0000","last_fullsized":"2024-03-09T15:12:08.044373+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'565","last_scrub_stamp":"2024-03-09T15:12:08.044279+0000","last_deep_scrub":"264'565","last_deep_scrub_stamp":"2024-03-09T15:12:08.044279+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.044279+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:14.925666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'337","reported_seq":1691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.424274+0000","last_change":"2024-03-09T15:12:12.424303+0000","last_active":"2024-03-09T15:12:12.424274+0000","last_peered":"2024-03-09T15:12:12.424274+0000","last_clean":"2024-03-09T15:12:12.424274+0000","last_became_active":"2024-03-09T14:26:28.645600+0000","last_became_peered":"2024-03-09T14:26:28.645600+0000","last_unstale":"2024-03-09T15:12:12.424274+0000","last_undegraded":"2024-03-09T15:12:12.424274+0000","last_fullsized":"2024-03-09T15:12:12.424274+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-03-09T15:12:12.424154+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-03-09T15:12:12.424154+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.424154+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:54:05.390153+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1869,"num_read_kb":1759,"num_write":401,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'208","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.874455+0000","last_change":"2024-03-09T14:26:26.652521+0000","last_active":"2024-03-09T15:11:45.874455+0000","last_peered":"2024-03-09T15:11:45.874455+0000","last_clean":"2024-03-09T15:11:45.874455+0000","last_became_active":"2024-03-09T14:26:26.652163+0000","last_became_peered":"2024-03-09T14:26:26.652163+0000","last_unstale":"2024-03-09T15:11:45.874455+0000","last_undegraded":"2024-03-09T15:11:45.874455+0000","last_fullsized":"2024-03-09T15:11:45.874455+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263243,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":85490,"num_write":1165,"num_write_kb":31492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.883702+0000","last_change":"2024-03-09T15:12:18.883731+0000","last_active":"2024-03-09T15:12:18.883702+0000","last_peered":"2024-03-09T15:12:18.883702+0000","last_clean":"2024-03-09T15:12:18.883702+0000","last_became_active":"2024-03-09T14:26:30.648227+0000","last_became_peered":"2024-03-09T14:26:30.648227+0000","last_unstale":"2024-03-09T15:12:18.883702+0000","last_undegraded":"2024-03-09T15:12:18.883702+0000","last_fullsized":"2024-03-09T15:12:18.883702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:18.883596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:18.883596+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.883596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:13:04.286704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'213","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.364047+0000","last_change":"2024-03-09T15:12:04.364047+0000","last_active":"2024-03-09T15:12:04.364047+0000","last_peered":"2024-03-09T15:12:04.364047+0000","last_clean":"2024-03-09T15:12:04.364047+0000","last_became_active":"2024-03-09T14:26:32.868020+0000","last_became_peered":"2024-03-09T14:26:32.868020+0000","last_unstale":"2024-03-09T15:12:04.364047+0000","last_undegraded":"2024-03-09T15:12:04.364047+0000","last_fullsized":"2024-03-09T15:12:04.364047+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-03-09T15:12:04.363892+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-03-09T15:12:04.363892+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.363892+0000","objects_scrubbed":9,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:51:51.117538+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":278,"num_read_kb":313,"num_write":162,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.867852+0000","last_change":"2024-03-09T15:12:11.867877+0000","last_active":"2024-03-09T15:12:11.867852+0000","last_peered":"2024-03-09T15:12:11.867852+0000","last_clean":"2024-03-09T15:12:11.867852+0000","last_became_active":"2024-03-09T14:26:34.666539+0000","last_became_peered":"2024-03-09T14:26:34.666539+0000","last_unstale":"2024-03-09T15:12:11.867852+0000","last_undegraded":"2024-03-09T15:12:11.867852+0000","last_fullsized":"2024-03-09T15:12:11.867852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:11.867738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:11.867738+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.867738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:34:22.712191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'540","reported_seq":1356,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.359359+0000","last_change":"2024-03-09T15:12:00.359359+0000","last_active":"2024-03-09T15:12:00.359359+0000","last_peered":"2024-03-09T15:12:00.359359+0000","last_clean":"2024-03-09T15:12:00.359359+0000","last_became_active":"2024-03-09T14:26:36.672173+0000","last_became_peered":"2024-03-09T14:26:36.672173+0000","last_unstale":"2024-03-09T15:12:00.359359+0000","last_undegraded":"2024-03-09T15:12:00.359359+0000","last_fullsized":"2024-03-09T15:12:00.359359+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'540","last_scrub_stamp":"2024-03-09T15:12:00.359237+0000","last_deep_scrub":"264'540","last_deep_scrub_stamp":"2024-03-09T15:12:00.359237+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.359237+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:34:05.613372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1288,"num_read_kb":1278,"num_write":1107,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'870","reported_seq":2473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.072798+0000","last_change":"2024-03-09T15:12:08.072839+0000","last_active":"2024-03-09T15:12:08.072798+0000","last_peered":"2024-03-09T15:12:08.072798+0000","last_clean":"2024-03-09T15:12:08.072798+0000","last_became_active":"2024-03-09T14:26:28.655572+0000","last_became_peered":"2024-03-09T14:26:28.655572+0000","last_unstale":"2024-03-09T15:12:08.072798+0000","last_undegraded":"2024-03-09T15:12:08.072798+0000","last_fullsized":"2024-03-09T15:12:08.072798+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'870","last_scrub_stamp":"2024-03-09T15:12:08.072716+0000","last_deep_scrub":"264'870","last_deep_scrub_stamp":"2024-03-09T15:12:08.072716+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.072716+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:03:01.925355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4137,"num_read_kb":3672,"num_write":1196,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1528,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'214","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:25.766961+0000","last_change":"2024-03-09T15:12:25.767040+0000","last_active":"2024-03-09T15:12:25.766961+0000","last_peered":"2024-03-09T15:12:25.766961+0000","last_clean":"2024-03-09T15:12:25.766961+0000","last_became_active":"2024-03-09T14:26:26.653969+0000","last_became_peered":"2024-03-09T14:26:26.653969+0000","last_unstale":"2024-03-09T15:12:25.766961+0000","last_undegraded":"2024-03-09T15:12:25.766961+0000","last_fullsized":"2024-03-09T15:12:25.766961+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-03-09T15:12:25.766830+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-03-09T15:12:25.766830+0000","last_clean_scrub_stamp":"2024-03-09T15:12:25.766830+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:26:57.223737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":36496,"num_write":1173,"num_write_kb":46772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.901424+0000","last_change":"2024-03-09T15:12:04.901453+0000","last_active":"2024-03-09T15:12:04.901424+0000","last_peered":"2024-03-09T15:12:04.901424+0000","last_clean":"2024-03-09T15:12:04.901424+0000","last_became_active":"2024-03-09T14:26:30.646765+0000","last_became_peered":"2024-03-09T14:26:30.646765+0000","last_unstale":"2024-03-09T15:12:04.901424+0000","last_undegraded":"2024-03-09T15:12:04.901424+0000","last_fullsized":"2024-03-09T15:12:04.901424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:04.901323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:04.901323+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.901323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:29:11.810512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'126","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.103514+0000","last_change":"2024-03-09T15:12:17.103592+0000","last_active":"2024-03-09T15:12:17.103514+0000","last_peered":"2024-03-09T15:12:17.103514+0000","last_clean":"2024-03-09T15:12:17.103514+0000","last_became_active":"2024-03-09T14:26:32.655037+0000","last_became_peered":"2024-03-09T14:26:32.655037+0000","last_unstale":"2024-03-09T15:12:17.103514+0000","last_undegraded":"2024-03-09T15:12:17.103514+0000","last_fullsized":"2024-03-09T15:12:17.103514+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-03-09T15:12:17.103410+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-03-09T15:12:17.103410+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.103410+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:24:03.182443+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":177,"num_write":74,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.054199+0000","last_change":"2024-03-09T15:12:11.054199+0000","last_active":"2024-03-09T15:12:11.054199+0000","last_peered":"2024-03-09T15:12:11.054199+0000","last_clean":"2024-03-09T15:12:11.054199+0000","last_became_active":"2024-03-09T14:26:34.678525+0000","last_became_peered":"2024-03-09T14:26:34.678525+0000","last_unstale":"2024-03-09T15:12:11.054199+0000","last_undegraded":"2024-03-09T15:12:11.054199+0000","last_fullsized":"2024-03-09T15:12:11.054199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:11.054057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:11.054057+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.054057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:04:56.057745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2466","reported_seq":4891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.275932+0000","last_change":"2024-03-09T15:12:10.275999+0000","last_active":"2024-03-09T15:12:10.275932+0000","last_peered":"2024-03-09T15:12:10.275932+0000","last_clean":"2024-03-09T15:12:10.275932+0000","last_became_active":"2024-03-09T14:26:36.671204+0000","last_became_peered":"2024-03-09T14:26:36.671204+0000","last_unstale":"2024-03-09T15:12:10.275932+0000","last_undegraded":"2024-03-09T15:12:10.275932+0000","last_fullsized":"2024-03-09T15:12:10.275932+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2466","last_scrub_stamp":"2024-03-09T15:12:10.275825+0000","last_deep_scrub":"264'2466","last_deep_scrub_stamp":"2024-03-09T15:12:10.275825+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.275825+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":2400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:58.222088+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6722,"num_read_kb":6726,"num_write":4987,"num_write_kb":1828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'375","reported_seq":1952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.268564+0000","last_change":"2024-03-09T15:12:11.268564+0000","last_active":"2024-03-09T15:12:11.268564+0000","last_peered":"2024-03-09T15:12:11.268564+0000","last_clean":"2024-03-09T15:12:11.268564+0000","last_became_active":"2024-03-09T14:26:28.648620+0000","last_became_peered":"2024-03-09T14:26:28.648620+0000","last_unstale":"2024-03-09T15:12:11.268564+0000","last_undegraded":"2024-03-09T15:12:11.268564+0000","last_fullsized":"2024-03-09T15:12:11.268564+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-03-09T15:12:11.268447+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-03-09T15:12:11.268447+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.268447+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:36.954188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2195,"num_write":437,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'221","reported_seq":1112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.978358+0000","last_change":"2024-03-09T14:26:26.653520+0000","last_active":"2024-03-09T15:11:45.978358+0000","last_peered":"2024-03-09T15:11:45.978358+0000","last_clean":"2024-03-09T15:11:45.978358+0000","last_became_active":"2024-03-09T14:26:26.653181+0000","last_became_peered":"2024-03-09T14:26:26.653181+0000","last_unstale":"2024-03-09T15:11:45.978358+0000","last_undegraded":"2024-03-09T15:11:45.978358+0000","last_fullsized":"2024-03-09T15:11:45.978358+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194373,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1046,"num_read_kb":176280,"num_write":1134,"num_write_kb":52674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.919675+0000","last_change":"2024-03-09T15:12:06.919699+0000","last_active":"2024-03-09T15:12:06.919675+0000","last_peered":"2024-03-09T15:12:06.919675+0000","last_clean":"2024-03-09T15:12:06.919675+0000","last_became_active":"2024-03-09T14:26:30.645656+0000","last_became_peered":"2024-03-09T14:26:30.645656+0000","last_unstale":"2024-03-09T15:12:06.919675+0000","last_undegraded":"2024-03-09T15:12:06.919675+0000","last_fullsized":"2024-03-09T15:12:06.919675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:06.919571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:06.919571+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.919571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:29:49.003185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'172","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.256426+0000","last_change":"2024-03-09T14:26:32.657586+0000","last_active":"2024-03-09T15:11:52.256426+0000","last_peered":"2024-03-09T15:11:52.256426+0000","last_clean":"2024-03-09T15:11:52.256426+0000","last_became_active":"2024-03-09T14:26:32.657144+0000","last_became_peered":"2024-03-09T14:26:32.657144+0000","last_unstale":"2024-03-09T15:11:52.256426+0000","last_undegraded":"2024-03-09T15:11:52.256426+0000","last_fullsized":"2024-03-09T15:11:52.256426+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6043,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":209,"num_read_kb":276,"num_write":118,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'544","reported_seq":1948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.521595+0000","last_change":"2024-03-09T15:12:13.521619+0000","last_active":"2024-03-09T15:12:13.521595+0000","last_peered":"2024-03-09T15:12:13.521595+0000","last_clean":"2024-03-09T15:12:13.521595+0000","last_became_active":"2024-03-09T14:26:34.667795+0000","last_became_peered":"2024-03-09T14:26:34.667795+0000","last_unstale":"2024-03-09T15:12:13.521595+0000","last_undegraded":"2024-03-09T15:12:13.521595+0000","last_fullsized":"2024-03-09T15:12:13.521595+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'544","last_scrub_stamp":"2024-03-09T15:12:13.521519+0000","last_deep_scrub":"264'544","last_deep_scrub_stamp":"2024-03-09T15:12:13.521519+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.521519+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:21:54.107680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'112","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.443257+0000","last_change":"2024-03-09T15:12:02.443257+0000","last_active":"2024-03-09T15:12:02.443257+0000","last_peered":"2024-03-09T15:12:02.443257+0000","last_clean":"2024-03-09T15:12:02.443257+0000","last_became_active":"2024-03-09T14:26:36.671635+0000","last_became_peered":"2024-03-09T14:26:36.671635+0000","last_unstale":"2024-03-09T15:12:02.443257+0000","last_undegraded":"2024-03-09T15:12:02.443257+0000","last_fullsized":"2024-03-09T15:12:02.443257+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-03-09T15:12:02.443069+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-03-09T15:12:02.443069+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.443069+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:03:53.401726+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":89,"num_write":251,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'431","reported_seq":1950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:31.596704+0000","last_change":"2024-03-09T14:26:28.645748+0000","last_active":"2024-03-09T15:11:31.596704+0000","last_peered":"2024-03-09T15:11:31.596704+0000","last_clean":"2024-03-09T15:11:31.596704+0000","last_became_active":"2024-03-09T14:26:28.645215+0000","last_became_peered":"2024-03-09T14:26:28.645215+0000","last_unstale":"2024-03-09T15:11:31.596704+0000","last_undegraded":"2024-03-09T15:11:31.596704+0000","last_fullsized":"2024-03-09T15:11:31.596704+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2276,"num_read_kb":2131,"num_write":518,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'218","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.936482+0000","last_change":"2024-03-09T14:26:26.640453+0000","last_active":"2024-03-09T15:11:45.936482+0000","last_peered":"2024-03-09T15:11:45.936482+0000","last_clean":"2024-03-09T15:11:45.936482+0000","last_became_active":"2024-03-09T14:26:26.639784+0000","last_became_peered":"2024-03-09T14:26:26.639784+0000","last_unstale":"2024-03-09T15:11:45.936482+0000","last_undegraded":"2024-03-09T15:11:45.936482+0000","last_fullsized":"2024-03-09T15:11:45.936482+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048623,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":725,"num_read_kb":41897,"num_write":1164,"num_write_kb":44648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.880795+0000","last_change":"2024-03-09T15:12:00.880795+0000","last_active":"2024-03-09T15:12:00.880795+0000","last_peered":"2024-03-09T15:12:00.880795+0000","last_clean":"2024-03-09T15:12:00.880795+0000","last_became_active":"2024-03-09T14:26:30.652726+0000","last_became_peered":"2024-03-09T14:26:30.652726+0000","last_unstale":"2024-03-09T15:12:00.880795+0000","last_undegraded":"2024-03-09T15:12:00.880795+0000","last_fullsized":"2024-03-09T15:12:00.880795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:00.880676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:00.880676+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.880676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:24:25.796674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'187","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:25.550124+0000","last_change":"2024-03-09T15:12:25.550170+0000","last_active":"2024-03-09T15:12:25.550124+0000","last_peered":"2024-03-09T15:12:25.550124+0000","last_clean":"2024-03-09T15:12:25.550124+0000","last_became_active":"2024-03-09T14:26:32.653026+0000","last_became_peered":"2024-03-09T14:26:32.653026+0000","last_unstale":"2024-03-09T15:12:25.550124+0000","last_undegraded":"2024-03-09T15:12:25.550124+0000","last_fullsized":"2024-03-09T15:12:25.550124+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-03-09T15:12:25.550031+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-03-09T15:12:25.550031+0000","last_clean_scrub_stamp":"2024-03-09T15:12:25.550031+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:07:07.970128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8197,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":250,"num_read_kb":316,"num_write":112,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.758985+0000","last_change":"2024-03-09T15:11:51.758985+0000","last_active":"2024-03-09T15:11:51.758985+0000","last_peered":"2024-03-09T15:11:51.758985+0000","last_clean":"2024-03-09T15:11:51.758985+0000","last_became_active":"2024-03-09T14:26:34.673715+0000","last_became_peered":"2024-03-09T14:26:34.673715+0000","last_unstale":"2024-03-09T15:11:51.758985+0000","last_undegraded":"2024-03-09T15:11:51.758985+0000","last_fullsized":"2024-03-09T15:11:51.758985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:11:51.758812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:11:51.758812+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.758812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:01:51.947493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'123","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.928141+0000","last_change":"2024-03-09T15:12:00.928141+0000","last_active":"2024-03-09T15:12:00.928141+0000","last_peered":"2024-03-09T15:12:00.928141+0000","last_clean":"2024-03-09T15:12:00.928141+0000","last_became_active":"2024-03-09T14:26:36.672843+0000","last_became_peered":"2024-03-09T14:26:36.672843+0000","last_unstale":"2024-03-09T15:12:00.928141+0000","last_undegraded":"2024-03-09T15:12:00.928141+0000","last_fullsized":"2024-03-09T15:12:00.928141+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'123","last_scrub_stamp":"2024-03-09T15:12:00.928002+0000","last_deep_scrub":"264'123","last_deep_scrub_stamp":"2024-03-09T15:12:00.928002+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.928002+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:02:24.575451+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":286,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'746","reported_seq":2343,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.055219+0000","last_change":"2024-03-09T15:12:14.055269+0000","last_active":"2024-03-09T15:12:14.055219+0000","last_peered":"2024-03-09T15:12:14.055219+0000","last_clean":"2024-03-09T15:12:14.055219+0000","last_became_active":"2024-03-09T14:26:28.656983+0000","last_became_peered":"2024-03-09T14:26:28.656983+0000","last_unstale":"2024-03-09T15:12:14.055219+0000","last_undegraded":"2024-03-09T15:12:14.055219+0000","last_fullsized":"2024-03-09T15:12:14.055219+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'746","last_scrub_stamp":"2024-03-09T15:12:14.055099+0000","last_deep_scrub":"264'746","last_deep_scrub_stamp":"2024-03-09T15:12:14.055099+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.055099+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:50:19.578653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3462,"num_read_kb":3140,"num_write":976,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'178","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.896895+0000","last_change":"2024-03-09T15:11:59.896895+0000","last_active":"2024-03-09T15:11:59.896895+0000","last_peered":"2024-03-09T15:11:59.896895+0000","last_clean":"2024-03-09T15:11:59.896895+0000","last_became_active":"2024-03-09T14:27:03.724370+0000","last_became_peered":"2024-03-09T14:27:03.724370+0000","last_unstale":"2024-03-09T15:11:59.896895+0000","last_undegraded":"2024-03-09T15:11:59.896895+0000","last_fullsized":"2024-03-09T15:11:59.896895+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-03-09T15:11:59.896739+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-03-09T15:11:59.896739+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.896739+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:55:55.773250+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":389,"num_read_kb":32223,"num_write":1032,"num_write_kb":26912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.896555+0000","last_change":"2024-03-09T15:11:58.896581+0000","last_active":"2024-03-09T15:11:58.896555+0000","last_peered":"2024-03-09T15:11:58.896555+0000","last_clean":"2024-03-09T15:11:58.896555+0000","last_became_active":"2024-03-09T14:26:30.653184+0000","last_became_peered":"2024-03-09T14:26:30.653184+0000","last_unstale":"2024-03-09T15:11:58.896555+0000","last_undegraded":"2024-03-09T15:11:58.896555+0000","last_fullsized":"2024-03-09T15:11:58.896555+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:11:58.896456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:11:58.896456+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.896456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:41:39.300580+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'158","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.948777+0000","last_change":"2024-03-09T14:26:32.653203+0000","last_active":"2024-03-09T15:11:45.948777+0000","last_peered":"2024-03-09T15:11:45.948777+0000","last_clean":"2024-03-09T15:11:45.948777+0000","last_became_active":"2024-03-09T14:26:32.652956+0000","last_became_peered":"2024-03-09T14:26:32.652956+0000","last_unstale":"2024-03-09T15:11:45.948777+0000","last_undegraded":"2024-03-09T15:11:45.948777+0000","last_fullsized":"2024-03-09T15:11:45.948777+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7924,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":318,"num_write":180,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.454267+0000","last_change":"2024-03-09T15:12:08.454294+0000","last_active":"2024-03-09T15:12:08.454267+0000","last_peered":"2024-03-09T15:12:08.454267+0000","last_clean":"2024-03-09T15:12:08.454267+0000","last_became_active":"2024-03-09T14:26:34.675354+0000","last_became_peered":"2024-03-09T14:26:34.675354+0000","last_unstale":"2024-03-09T15:12:08.454267+0000","last_undegraded":"2024-03-09T15:12:08.454267+0000","last_fullsized":"2024-03-09T15:12:08.454267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:08.454125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:08.454125+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.454125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:39:33.417972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'147","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.084705+0000","last_change":"2024-03-09T15:12:07.084756+0000","last_active":"2024-03-09T15:12:07.084705+0000","last_peered":"2024-03-09T15:12:07.084705+0000","last_clean":"2024-03-09T15:12:07.084705+0000","last_became_active":"2024-03-09T14:26:36.672111+0000","last_became_peered":"2024-03-09T14:26:36.672111+0000","last_unstale":"2024-03-09T15:12:07.084705+0000","last_undegraded":"2024-03-09T15:12:07.084705+0000","last_fullsized":"2024-03-09T15:12:07.084705+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-03-09T15:12:07.084592+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-03-09T15:12:07.084592+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.084592+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:46:57.461652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":110,"num_write":237,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'512","reported_seq":1991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.102653+0000","last_change":"2024-03-09T15:12:11.102714+0000","last_active":"2024-03-09T15:12:11.102653+0000","last_peered":"2024-03-09T15:12:11.102653+0000","last_clean":"2024-03-09T15:12:11.102653+0000","last_became_active":"2024-03-09T14:26:28.650560+0000","last_became_peered":"2024-03-09T14:26:28.650560+0000","last_unstale":"2024-03-09T15:12:11.102653+0000","last_undegraded":"2024-03-09T15:12:11.102653+0000","last_fullsized":"2024-03-09T15:12:11.102653+0000","mapping_epoch":25,"log_start":"264'501","ondisk_log_start":"264'501","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'512","last_scrub_stamp":"2024-03-09T15:12:11.102538+0000","last_deep_scrub":"264'512","last_deep_scrub_stamp":"2024-03-09T15:12:11.102538+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.102538+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":501,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:13:10.878275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2567,"num_read_kb":2395,"num_write":702,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'170","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.300923+0000","last_change":"2024-03-09T15:12:16.301007+0000","last_active":"2024-03-09T15:12:16.300923+0000","last_peered":"2024-03-09T15:12:16.300923+0000","last_clean":"2024-03-09T15:12:16.300923+0000","last_became_active":"2024-03-09T14:26:26.644347+0000","last_became_peered":"2024-03-09T14:26:26.644347+0000","last_unstale":"2024-03-09T15:12:16.300923+0000","last_undegraded":"2024-03-09T15:12:16.300923+0000","last_fullsized":"2024-03-09T15:12:16.300923+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'170","last_scrub_stamp":"2024-03-09T15:12:16.300820+0000","last_deep_scrub":"264'170","last_deep_scrub_stamp":"2024-03-09T15:12:16.300820+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.300820+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:43:04.619237+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456529,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":342,"num_read_kb":3953,"num_write":941,"num_write_kb":27527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.930413+0000","last_change":"2024-03-09T15:12:03.930452+0000","last_active":"2024-03-09T15:12:03.930413+0000","last_peered":"2024-03-09T15:12:03.930413+0000","last_clean":"2024-03-09T15:12:03.930413+0000","last_became_active":"2024-03-09T14:26:30.654575+0000","last_became_peered":"2024-03-09T14:26:30.654575+0000","last_unstale":"2024-03-09T15:12:03.930413+0000","last_undegraded":"2024-03-09T15:12:03.930413+0000","last_fullsized":"2024-03-09T15:12:03.930413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:03.930331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:03.930331+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.930331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:07:07.118362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'151","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.795915+0000","last_change":"2024-03-09T15:11:54.795964+0000","last_active":"2024-03-09T15:11:54.795915+0000","last_peered":"2024-03-09T15:11:54.795915+0000","last_clean":"2024-03-09T15:11:54.795915+0000","last_became_active":"2024-03-09T14:26:32.659984+0000","last_became_peered":"2024-03-09T14:26:32.659984+0000","last_unstale":"2024-03-09T15:11:54.795915+0000","last_undegraded":"2024-03-09T15:11:54.795915+0000","last_fullsized":"2024-03-09T15:11:54.795915+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-03-09T15:11:54.795827+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-03-09T15:11:54.795827+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.795827+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:07.483041+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12965,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":276,"num_write":112,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'506","reported_seq":2232,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.759668+0000","last_change":"2024-03-09T15:11:52.759691+0000","last_active":"2024-03-09T15:11:52.759668+0000","last_peered":"2024-03-09T15:11:52.759668+0000","last_clean":"2024-03-09T15:11:52.759668+0000","last_became_active":"2024-03-09T14:26:34.673054+0000","last_became_peered":"2024-03-09T14:26:34.673054+0000","last_unstale":"2024-03-09T15:11:52.759668+0000","last_undegraded":"2024-03-09T15:11:52.759668+0000","last_fullsized":"2024-03-09T15:11:52.759668+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'506","last_scrub_stamp":"2024-03-09T15:11:52.759595+0000","last_deep_scrub":"264'506","last_deep_scrub_stamp":"2024-03-09T15:11:52.759595+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.759595+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:53.620306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'100","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:25.704316+0000","last_change":"2024-03-09T15:12:25.704316+0000","last_active":"2024-03-09T15:12:25.704316+0000","last_peered":"2024-03-09T15:12:25.704316+0000","last_clean":"2024-03-09T15:12:25.704316+0000","last_became_active":"2024-03-09T14:26:36.668217+0000","last_became_peered":"2024-03-09T14:26:36.668217+0000","last_unstale":"2024-03-09T15:12:25.704316+0000","last_undegraded":"2024-03-09T15:12:25.704316+0000","last_fullsized":"2024-03-09T15:12:25.704316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-03-09T15:12:25.704178+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-03-09T15:12:25.704178+0000","last_clean_scrub_stamp":"2024-03-09T15:12:25.704178+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:49:07.289847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":82,"num_write":217,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'680","reported_seq":2388,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:29.919841+0000","last_change":"2024-03-09T15:12:29.919877+0000","last_active":"2024-03-09T15:12:29.919841+0000","last_peered":"2024-03-09T15:12:29.919841+0000","last_clean":"2024-03-09T15:12:29.919841+0000","last_became_active":"2024-03-09T14:26:28.648408+0000","last_became_peered":"2024-03-09T14:26:28.648408+0000","last_unstale":"2024-03-09T15:12:29.919841+0000","last_undegraded":"2024-03-09T15:12:29.919841+0000","last_fullsized":"2024-03-09T15:12:29.919841+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'680","last_scrub_stamp":"2024-03-09T15:12:29.919760+0000","last_deep_scrub":"264'680","last_deep_scrub_stamp":"2024-03-09T15:12:29.919760+0000","last_clean_scrub_stamp":"2024-03-09T15:12:29.919760+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":600,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:18:48.593828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3385,"num_read_kb":3042,"num_write":948,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'222","reported_seq":870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:25.895621+0000","last_change":"2024-03-09T15:12:25.895705+0000","last_active":"2024-03-09T15:12:25.895621+0000","last_peered":"2024-03-09T15:12:25.895621+0000","last_clean":"2024-03-09T15:12:25.895621+0000","last_became_active":"2024-03-09T14:26:26.643522+0000","last_became_peered":"2024-03-09T14:26:26.643522+0000","last_unstale":"2024-03-09T15:12:25.895621+0000","last_undegraded":"2024-03-09T15:12:25.895621+0000","last_fullsized":"2024-03-09T15:12:25.895621+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'222","last_scrub_stamp":"2024-03-09T15:12:25.895505+0000","last_deep_scrub":"264'222","last_deep_scrub_stamp":"2024-03-09T15:12:25.895505+0000","last_clean_scrub_stamp":"2024-03-09T15:12:25.895505+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:32:48.798666+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718714,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":452,"num_read_kb":51521,"num_write":1235,"num_write_kb":50999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.399793+0000","last_change":"2024-03-09T15:12:21.399833+0000","last_active":"2024-03-09T15:12:21.399793+0000","last_peered":"2024-03-09T15:12:21.399793+0000","last_clean":"2024-03-09T15:12:21.399793+0000","last_became_active":"2024-03-09T14:26:30.652594+0000","last_became_peered":"2024-03-09T14:26:30.652594+0000","last_unstale":"2024-03-09T15:12:21.399793+0000","last_undegraded":"2024-03-09T15:12:21.399793+0000","last_fullsized":"2024-03-09T15:12:21.399793+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:12:21.399692+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:12:21.399692+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.399692+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:01:42.826952+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":630,"num_read_kb":630,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'83","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.083255+0000","last_change":"2024-03-09T15:12:16.083290+0000","last_active":"2024-03-09T15:12:16.083255+0000","last_peered":"2024-03-09T15:12:16.083255+0000","last_clean":"2024-03-09T15:12:16.083255+0000","last_became_active":"2024-03-09T14:26:32.868147+0000","last_became_peered":"2024-03-09T14:26:32.868147+0000","last_unstale":"2024-03-09T15:12:16.083255+0000","last_undegraded":"2024-03-09T15:12:16.083255+0000","last_fullsized":"2024-03-09T15:12:16.083255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'83","last_scrub_stamp":"2024-03-09T15:12:16.083169+0000","last_deep_scrub":"264'83","last_deep_scrub_stamp":"2024-03-09T15:12:16.083169+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.083169+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:33:58.823306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'535","reported_seq":2296,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.309739+0000","last_change":"2024-03-09T15:12:04.309767+0000","last_active":"2024-03-09T15:12:04.309739+0000","last_peered":"2024-03-09T15:12:04.309739+0000","last_clean":"2024-03-09T15:12:04.309739+0000","last_became_active":"2024-03-09T14:26:34.669695+0000","last_became_peered":"2024-03-09T14:26:34.669695+0000","last_unstale":"2024-03-09T15:12:04.309739+0000","last_undegraded":"2024-03-09T15:12:04.309739+0000","last_fullsized":"2024-03-09T15:12:04.309739+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'535","last_scrub_stamp":"2024-03-09T15:12:04.309652+0000","last_deep_scrub":"264'535","last_deep_scrub_stamp":"2024-03-09T15:12:04.309652+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.309652+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:43:08.557837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'143","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.218148+0000","last_change":"2024-03-09T15:11:57.218148+0000","last_active":"2024-03-09T15:11:57.218148+0000","last_peered":"2024-03-09T15:11:57.218148+0000","last_clean":"2024-03-09T15:11:57.218148+0000","last_became_active":"2024-03-09T14:26:36.668361+0000","last_became_peered":"2024-03-09T14:26:36.668361+0000","last_unstale":"2024-03-09T15:11:57.218148+0000","last_undegraded":"2024-03-09T15:11:57.218148+0000","last_fullsized":"2024-03-09T15:11:57.218148+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'143","last_scrub_stamp":"2024-03-09T15:11:57.218031+0000","last_deep_scrub":"264'143","last_deep_scrub_stamp":"2024-03-09T15:11:57.218031+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.218031+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:15:02.428364+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":387,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":346,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'486","reported_seq":2126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.973394+0000","last_change":"2024-03-09T15:12:08.973424+0000","last_active":"2024-03-09T15:12:08.973394+0000","last_peered":"2024-03-09T15:12:08.973394+0000","last_clean":"2024-03-09T15:12:08.973394+0000","last_became_active":"2024-03-09T14:26:28.654325+0000","last_became_peered":"2024-03-09T14:26:28.654325+0000","last_unstale":"2024-03-09T15:12:08.973394+0000","last_undegraded":"2024-03-09T15:12:08.973394+0000","last_fullsized":"2024-03-09T15:12:08.973394+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'486","last_scrub_stamp":"2024-03-09T15:12:08.973311+0000","last_deep_scrub":"264'486","last_deep_scrub_stamp":"2024-03-09T15:12:08.973311+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.973311+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:49.023731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2761,"num_read_kb":2604,"num_write":649,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'188","reported_seq":779,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395058+0000","last_change":"2024-03-09T14:26:26.652669+0000","last_active":"2024-03-09T15:11:50.395058+0000","last_peered":"2024-03-09T15:11:50.395058+0000","last_clean":"2024-03-09T15:11:50.395058+0000","last_became_active":"2024-03-09T14:26:26.652273+0000","last_became_peered":"2024-03-09T14:26:26.652273+0000","last_unstale":"2024-03-09T15:11:50.395058+0000","last_undegraded":"2024-03-09T15:11:50.395058+0000","last_fullsized":"2024-03-09T15:11:50.395058+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262266,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":15479,"num_write":998,"num_write_kb":26748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.955802+0000","last_change":"2024-03-09T15:12:19.955827+0000","last_active":"2024-03-09T15:12:19.955802+0000","last_peered":"2024-03-09T15:12:19.955802+0000","last_clean":"2024-03-09T15:12:19.955802+0000","last_became_active":"2024-03-09T14:26:30.651949+0000","last_became_peered":"2024-03-09T14:26:30.651949+0000","last_unstale":"2024-03-09T15:12:19.955802+0000","last_undegraded":"2024-03-09T15:12:19.955802+0000","last_fullsized":"2024-03-09T15:12:19.955802+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:19.955707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:19.955707+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.955707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:53.400693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'195","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.406588+0000","last_change":"2024-03-09T15:12:06.406637+0000","last_active":"2024-03-09T15:12:06.406588+0000","last_peered":"2024-03-09T15:12:06.406588+0000","last_clean":"2024-03-09T15:12:06.406588+0000","last_became_active":"2024-03-09T14:26:32.656959+0000","last_became_peered":"2024-03-09T14:26:32.656959+0000","last_unstale":"2024-03-09T15:12:06.406588+0000","last_undegraded":"2024-03-09T15:12:06.406588+0000","last_fullsized":"2024-03-09T15:12:06.406588+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-03-09T15:12:06.406501+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-03-09T15:12:06.406501+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.406501+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:57:07.294016+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9621,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":264,"num_read_kb":329,"num_write":152,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.297468+0000","last_change":"2024-03-09T15:12:08.297491+0000","last_active":"2024-03-09T15:12:08.297468+0000","last_peered":"2024-03-09T15:12:08.297468+0000","last_clean":"2024-03-09T15:12:08.297468+0000","last_became_active":"2024-03-09T14:26:34.675350+0000","last_became_peered":"2024-03-09T14:26:34.675350+0000","last_unstale":"2024-03-09T15:12:08.297468+0000","last_undegraded":"2024-03-09T15:12:08.297468+0000","last_fullsized":"2024-03-09T15:12:08.297468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:08.297379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:08.297379+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.297379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:13:35.442572+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'124","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.981933+0000","last_change":"2024-03-09T15:11:58.981933+0000","last_active":"2024-03-09T15:11:58.981933+0000","last_peered":"2024-03-09T15:11:58.981933+0000","last_clean":"2024-03-09T15:11:58.981933+0000","last_became_active":"2024-03-09T14:26:36.673059+0000","last_became_peered":"2024-03-09T14:26:36.673059+0000","last_unstale":"2024-03-09T15:11:58.981933+0000","last_undegraded":"2024-03-09T15:11:58.981933+0000","last_fullsized":"2024-03-09T15:11:58.981933+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:11:58.981820+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:11:58.981820+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.981820+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:12.931239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":194,"num_write":274,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'858","reported_seq":2486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.276912+0000","last_change":"2024-03-09T15:12:05.276948+0000","last_active":"2024-03-09T15:12:05.276912+0000","last_peered":"2024-03-09T15:12:05.276912+0000","last_clean":"2024-03-09T15:12:05.276912+0000","last_became_active":"2024-03-09T14:26:28.653261+0000","last_became_peered":"2024-03-09T14:26:28.653261+0000","last_unstale":"2024-03-09T15:12:05.276912+0000","last_undegraded":"2024-03-09T15:12:05.276912+0000","last_fullsized":"2024-03-09T15:12:05.276912+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'858","last_scrub_stamp":"2024-03-09T15:12:05.276825+0000","last_deep_scrub":"264'858","last_deep_scrub_stamp":"2024-03-09T15:12:05.276825+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.276825+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:38:48.151292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3846,"num_read_kb":3440,"num_write":1147,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.255955+0000","last_change":"2024-03-09T14:26:13.798768+0000","last_active":"2024-03-09T15:11:52.255955+0000","last_peered":"2024-03-09T15:11:52.255955+0000","last_clean":"2024-03-09T15:11:52.255955+0000","last_became_active":"2024-03-09T14:26:13.797817+0000","last_became_peered":"2024-03-09T14:26:13.797817+0000","last_unstale":"2024-03-09T15:11:52.255955+0000","last_undegraded":"2024-03-09T15:11:52.255955+0000","last_fullsized":"2024-03-09T15:11:52.255955+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:12.541311+0000","last_clean_scrub_stamp":"2024-03-09T14:26:12.541311+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:26.345288+0000","last_change":"2024-03-09T15:12:26.345312+0000","last_active":"2024-03-09T15:12:26.345288+0000","last_peered":"2024-03-09T15:12:26.345288+0000","last_clean":"2024-03-09T15:12:26.345288+0000","last_became_active":"2024-03-09T14:26:18.581598+0000","last_became_peered":"2024-03-09T14:26:18.581598+0000","last_unstale":"2024-03-09T15:12:26.345288+0000","last_undegraded":"2024-03-09T15:12:26.345288+0000","last_fullsized":"2024-03-09T15:12:26.345288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:26.345178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:26.345178+0000","last_clean_scrub_stamp":"2024-03-09T15:12:26.345178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:12:25.158203+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'183","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395047+0000","last_change":"2024-03-09T14:26:26.645174+0000","last_active":"2024-03-09T15:11:50.395047+0000","last_peered":"2024-03-09T15:11:50.395047+0000","last_clean":"2024-03-09T15:11:50.395047+0000","last_became_active":"2024-03-09T14:26:26.644848+0000","last_became_peered":"2024-03-09T14:26:26.644848+0000","last_unstale":"2024-03-09T15:11:50.395047+0000","last_undegraded":"2024-03-09T15:11:50.395047+0000","last_fullsized":"2024-03-09T15:11:50.395047+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992272,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":345,"num_read_kb":37512,"num_write":1008,"num_write_kb":40555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:20.808700+0000","last_change":"2024-03-09T15:12:20.808700+0000","last_active":"2024-03-09T15:12:20.808700+0000","last_peered":"2024-03-09T15:12:20.808700+0000","last_clean":"2024-03-09T15:12:20.808700+0000","last_became_active":"2024-03-09T14:26:30.650376+0000","last_became_peered":"2024-03-09T14:26:30.650376+0000","last_unstale":"2024-03-09T15:12:20.808700+0000","last_undegraded":"2024-03-09T15:12:20.808700+0000","last_fullsized":"2024-03-09T15:12:20.808700+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:20.808590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:20.808590+0000","last_clean_scrub_stamp":"2024-03-09T15:12:20.808590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:23:26.881934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'306","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.380281+0000","last_change":"2024-03-09T15:12:05.380281+0000","last_active":"2024-03-09T15:12:05.380281+0000","last_peered":"2024-03-09T15:12:05.380281+0000","last_clean":"2024-03-09T15:12:05.380281+0000","last_became_active":"2024-03-09T14:26:32.657752+0000","last_became_peered":"2024-03-09T14:26:32.657752+0000","last_unstale":"2024-03-09T15:12:05.380281+0000","last_undegraded":"2024-03-09T15:12:05.380281+0000","last_fullsized":"2024-03-09T15:12:05.380281+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-03-09T15:12:05.380113+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-03-09T15:12:05.380113+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.380113+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:03:36.952007+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33862,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":557,"num_read_kb":770,"num_write":482,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89050,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.449244+0000","last_change":"2024-03-09T15:12:10.449266+0000","last_active":"2024-03-09T15:12:10.449244+0000","last_peered":"2024-03-09T15:12:10.449244+0000","last_clean":"2024-03-09T15:12:10.449244+0000","last_became_active":"2024-03-09T14:26:34.670987+0000","last_became_peered":"2024-03-09T14:26:34.670987+0000","last_unstale":"2024-03-09T15:12:10.449244+0000","last_undegraded":"2024-03-09T15:12:10.449244+0000","last_fullsized":"2024-03-09T15:12:10.449244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:10.449117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:10.449117+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.449117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:23:14.231544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'207","reported_seq":905,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.254554+0000","last_change":"2024-03-09T15:12:12.254604+0000","last_active":"2024-03-09T15:12:12.254554+0000","last_peered":"2024-03-09T15:12:12.254554+0000","last_clean":"2024-03-09T15:12:12.254554+0000","last_became_active":"2024-03-09T14:26:36.671941+0000","last_became_peered":"2024-03-09T14:26:36.671941+0000","last_unstale":"2024-03-09T15:12:12.254554+0000","last_undegraded":"2024-03-09T15:12:12.254554+0000","last_fullsized":"2024-03-09T15:12:12.254554+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-03-09T15:12:12.254464+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-03-09T15:12:12.254464+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.254464+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:34.424401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":432,"num_read_kb":416,"num_write":433,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'396","reported_seq":1996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.566469+0000","last_change":"2024-03-09T15:12:17.566505+0000","last_active":"2024-03-09T15:12:17.566469+0000","last_peered":"2024-03-09T15:12:17.566469+0000","last_clean":"2024-03-09T15:12:17.566469+0000","last_became_active":"2024-03-09T14:26:28.652611+0000","last_became_peered":"2024-03-09T14:26:28.652611+0000","last_unstale":"2024-03-09T15:12:17.566469+0000","last_undegraded":"2024-03-09T15:12:17.566469+0000","last_fullsized":"2024-03-09T15:12:17.566469+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'396","last_scrub_stamp":"2024-03-09T15:12:17.566379+0000","last_deep_scrub":"264'396","last_deep_scrub_stamp":"2024-03-09T15:12:17.566379+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.566379+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:41.776537+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2259,"num_read_kb":2164,"num_write":448,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:26.732356+0000","last_change":"2024-03-09T14:26:18.582346+0000","last_active":"2024-03-09T15:10:26.732356+0000","last_peered":"2024-03-09T15:10:26.732356+0000","last_clean":"2024-03-09T15:10:26.732356+0000","last_became_active":"2024-03-09T14:26:18.581306+0000","last_became_peered":"2024-03-09T14:26:18.581306+0000","last_unstale":"2024-03-09T15:10:26.732356+0000","last_undegraded":"2024-03-09T15:10:26.732356+0000","last_fullsized":"2024-03-09T15:10:26.732356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'137","reported_seq":738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.017401+0000","last_change":"2024-03-09T14:26:26.632618+0000","last_active":"2024-03-09T15:11:49.017401+0000","last_peered":"2024-03-09T15:11:49.017401+0000","last_clean":"2024-03-09T15:11:49.017401+0000","last_became_active":"2024-03-09T14:26:26.632272+0000","last_became_peered":"2024-03-09T14:26:26.632272+0000","last_unstale":"2024-03-09T15:11:49.017401+0000","last_undegraded":"2024-03-09T15:11:49.017401+0000","last_fullsized":"2024-03-09T15:11:49.017401+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":283,"num_read_kb":61756,"num_write":788,"num_write_kb":21716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.403929+0000","last_change":"2024-03-09T15:12:23.403954+0000","last_active":"2024-03-09T15:12:23.403929+0000","last_peered":"2024-03-09T15:12:23.403929+0000","last_clean":"2024-03-09T15:12:23.403929+0000","last_became_active":"2024-03-09T14:26:30.654922+0000","last_became_peered":"2024-03-09T14:26:30.654922+0000","last_unstale":"2024-03-09T15:12:23.403929+0000","last_undegraded":"2024-03-09T15:12:23.403929+0000","last_fullsized":"2024-03-09T15:12:23.403929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:23.403834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:23.403834+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.403834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:25:02.787238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'702","reported_seq":2101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.943001+0000","last_change":"2024-03-09T15:12:05.943001+0000","last_active":"2024-03-09T15:12:05.943001+0000","last_peered":"2024-03-09T15:12:05.943001+0000","last_clean":"2024-03-09T15:12:05.943001+0000","last_became_active":"2024-03-09T14:26:32.655430+0000","last_became_peered":"2024-03-09T14:26:32.655430+0000","last_unstale":"2024-03-09T15:12:05.943001+0000","last_undegraded":"2024-03-09T15:12:05.943001+0000","last_fullsized":"2024-03-09T15:12:05.943001+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'702","last_scrub_stamp":"2024-03-09T15:12:05.942851+0000","last_deep_scrub":"264'702","last_deep_scrub_stamp":"2024-03-09T15:12:05.942851+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.942851+0000","objects_scrubbed":12,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:10:41.864242+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17414,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":925,"num_read_kb":1078,"num_write":294,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.949150+0000","last_change":"2024-03-09T15:12:11.949202+0000","last_active":"2024-03-09T15:12:11.949150+0000","last_peered":"2024-03-09T15:12:11.949150+0000","last_clean":"2024-03-09T15:12:11.949150+0000","last_became_active":"2024-03-09T14:26:34.678431+0000","last_became_peered":"2024-03-09T14:26:34.678431+0000","last_unstale":"2024-03-09T15:12:11.949150+0000","last_undegraded":"2024-03-09T15:12:11.949150+0000","last_fullsized":"2024-03-09T15:12:11.949150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:11.949038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:11.949038+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.949038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:12:06.095596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'165","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.020974+0000","last_change":"2024-03-09T15:11:58.020974+0000","last_active":"2024-03-09T15:11:58.020974+0000","last_peered":"2024-03-09T15:11:58.020974+0000","last_clean":"2024-03-09T15:11:58.020974+0000","last_became_active":"2024-03-09T14:26:36.784815+0000","last_became_peered":"2024-03-09T14:26:36.784815+0000","last_unstale":"2024-03-09T15:11:58.020974+0000","last_undegraded":"2024-03-09T15:11:58.020974+0000","last_fullsized":"2024-03-09T15:11:58.020974+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-03-09T15:11:58.020857+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-03-09T15:11:58.020857+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.020857+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:55:16.554222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":213,"num_read_kb":212,"num_write":359,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'798","reported_seq":2471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.840843+0000","last_change":"2024-03-09T15:12:12.840888+0000","last_active":"2024-03-09T15:12:12.840843+0000","last_peered":"2024-03-09T15:12:12.840843+0000","last_clean":"2024-03-09T15:12:12.840843+0000","last_became_active":"2024-03-09T14:26:28.650409+0000","last_became_peered":"2024-03-09T14:26:28.650409+0000","last_unstale":"2024-03-09T15:12:12.840843+0000","last_undegraded":"2024-03-09T15:12:12.840843+0000","last_fullsized":"2024-03-09T15:12:12.840843+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'798","last_scrub_stamp":"2024-03-09T15:12:12.840759+0000","last_deep_scrub":"264'798","last_deep_scrub_stamp":"2024-03-09T15:12:12.840759+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.840759+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:47:58.312223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3830,"num_read_kb":3466,"num_write":1049,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2681,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.921226+0000","last_change":"2024-03-09T15:12:07.921250+0000","last_active":"2024-03-09T15:12:07.921226+0000","last_peered":"2024-03-09T15:12:07.921226+0000","last_clean":"2024-03-09T15:12:07.921226+0000","last_became_active":"2024-03-09T14:26:18.577041+0000","last_became_peered":"2024-03-09T14:26:18.577041+0000","last_unstale":"2024-03-09T15:12:07.921226+0000","last_undegraded":"2024-03-09T15:12:07.921226+0000","last_fullsized":"2024-03-09T15:12:07.921226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:07.921131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:07.921131+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.921131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:13:44.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'176","reported_seq":795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.824694+0000","last_change":"2024-03-09T15:12:21.824760+0000","last_active":"2024-03-09T15:12:21.824694+0000","last_peered":"2024-03-09T15:12:21.824694+0000","last_clean":"2024-03-09T15:12:21.824694+0000","last_became_active":"2024-03-09T14:26:26.635771+0000","last_became_peered":"2024-03-09T14:26:26.635771+0000","last_unstale":"2024-03-09T15:12:21.824694+0000","last_undegraded":"2024-03-09T15:12:21.824694+0000","last_fullsized":"2024-03-09T15:12:21.824694+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'176","last_scrub_stamp":"2024-03-09T15:12:21.824568+0000","last_deep_scrub":"264'176","last_deep_scrub_stamp":"2024-03-09T15:12:21.824568+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.824568+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:13:46.172168+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730144,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":5368,"num_write":1014,"num_write_kb":33352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'7","reported_seq":825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.910474+0000","last_change":"2024-03-09T15:12:02.910518+0000","last_active":"2024-03-09T15:12:02.910474+0000","last_peered":"2024-03-09T15:12:02.910474+0000","last_clean":"2024-03-09T15:12:02.910474+0000","last_became_active":"2024-03-09T14:26:30.650766+0000","last_became_peered":"2024-03-09T14:26:30.650766+0000","last_unstale":"2024-03-09T15:12:02.910474+0000","last_undegraded":"2024-03-09T15:12:02.910474+0000","last_fullsized":"2024-03-09T15:12:02.910474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-03-09T15:12:02.910368+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-03-09T15:12:02.910368+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.910368+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:27.066749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1149,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":787,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'246","reported_seq":1321,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:38.838335+0000","last_change":"2024-03-09T14:26:32.869468+0000","last_active":"2024-03-09T15:11:38.838335+0000","last_peered":"2024-03-09T15:11:38.838335+0000","last_clean":"2024-03-09T15:11:38.838335+0000","last_became_active":"2024-03-09T14:26:32.868092+0000","last_became_peered":"2024-03-09T14:26:32.868092+0000","last_unstale":"2024-03-09T15:11:38.838335+0000","last_undegraded":"2024-03-09T15:11:38.838335+0000","last_fullsized":"2024-03-09T15:11:38.838335+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":188,"num_read_kb":180,"num_write":173,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.562662+0000","last_change":"2024-03-09T15:12:14.562662+0000","last_active":"2024-03-09T15:12:14.562662+0000","last_peered":"2024-03-09T15:12:14.562662+0000","last_clean":"2024-03-09T15:12:14.562662+0000","last_became_active":"2024-03-09T14:26:34.666484+0000","last_became_peered":"2024-03-09T14:26:34.666484+0000","last_unstale":"2024-03-09T15:12:14.562662+0000","last_undegraded":"2024-03-09T15:12:14.562662+0000","last_fullsized":"2024-03-09T15:12:14.562662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:14.562543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:14.562543+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.562543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:43.432852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'257","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.108568+0000","last_change":"2024-03-09T15:12:05.108604+0000","last_active":"2024-03-09T15:12:05.108568+0000","last_peered":"2024-03-09T15:12:05.108568+0000","last_clean":"2024-03-09T15:12:05.108568+0000","last_became_active":"2024-03-09T14:26:36.674637+0000","last_became_peered":"2024-03-09T14:26:36.674637+0000","last_unstale":"2024-03-09T15:12:05.108568+0000","last_undegraded":"2024-03-09T15:12:05.108568+0000","last_fullsized":"2024-03-09T15:12:05.108568+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-03-09T15:12:05.108478+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-03-09T15:12:05.108478+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.108478+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:01.447168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":491,"num_write":562,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'351","reported_seq":1828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.796019+0000","last_change":"2024-03-09T15:12:16.796019+0000","last_active":"2024-03-09T15:12:16.796019+0000","last_peered":"2024-03-09T15:12:16.796019+0000","last_clean":"2024-03-09T15:12:16.796019+0000","last_became_active":"2024-03-09T14:26:28.646594+0000","last_became_peered":"2024-03-09T14:26:28.646594+0000","last_unstale":"2024-03-09T15:12:16.796019+0000","last_undegraded":"2024-03-09T15:12:16.796019+0000","last_fullsized":"2024-03-09T15:12:16.796019+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-03-09T15:12:16.795850+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-03-09T15:12:16.795850+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.795850+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:21:33.078150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1989,"num_read_kb":1907,"num_write":411,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:25.366207+0000","last_change":"2024-03-09T15:12:25.366258+0000","last_active":"2024-03-09T15:12:25.366207+0000","last_peered":"2024-03-09T15:12:25.366207+0000","last_clean":"2024-03-09T15:12:25.366207+0000","last_became_active":"2024-03-09T14:26:18.581330+0000","last_became_peered":"2024-03-09T14:26:18.581330+0000","last_unstale":"2024-03-09T15:12:25.366207+0000","last_undegraded":"2024-03-09T15:12:25.366207+0000","last_fullsized":"2024-03-09T15:12:25.366207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:25.366098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:25.366098+0000","last_clean_scrub_stamp":"2024-03-09T15:12:25.366098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:25:16.393458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'265","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.797515+0000","last_change":"2024-03-09T15:11:55.797567+0000","last_active":"2024-03-09T15:11:55.797515+0000","last_peered":"2024-03-09T15:11:55.797515+0000","last_clean":"2024-03-09T15:11:55.797515+0000","last_became_active":"2024-03-09T14:27:03.719517+0000","last_became_peered":"2024-03-09T14:27:03.719517+0000","last_unstale":"2024-03-09T15:11:55.797515+0000","last_undegraded":"2024-03-09T15:11:55.797515+0000","last_fullsized":"2024-03-09T15:11:55.797515+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'265","last_scrub_stamp":"2024-03-09T15:11:55.797417+0000","last_deep_scrub":"264'265","last_deep_scrub_stamp":"2024-03-09T15:11:55.797417+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.797417+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:46:48.759059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1107,"num_read_kb":25709,"num_write":1307,"num_write_kb":24224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.554917+0000","last_change":"2024-03-09T15:12:19.554940+0000","last_active":"2024-03-09T15:12:19.554917+0000","last_peered":"2024-03-09T15:12:19.554917+0000","last_clean":"2024-03-09T15:12:19.554917+0000","last_became_active":"2024-03-09T14:26:30.646190+0000","last_became_peered":"2024-03-09T14:26:30.646190+0000","last_unstale":"2024-03-09T15:12:19.554917+0000","last_undegraded":"2024-03-09T15:12:19.554917+0000","last_fullsized":"2024-03-09T15:12:19.554917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:19.554823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:19.554823+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.554823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:26:55.353874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'108","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395456+0000","last_change":"2024-03-09T14:26:32.650252+0000","last_active":"2024-03-09T15:11:50.395456+0000","last_peered":"2024-03-09T15:11:50.395456+0000","last_clean":"2024-03-09T15:11:50.395456+0000","last_became_active":"2024-03-09T14:26:32.650020+0000","last_became_peered":"2024-03-09T14:26:32.650020+0000","last_unstale":"2024-03-09T15:11:50.395456+0000","last_undegraded":"2024-03-09T15:11:50.395456+0000","last_fullsized":"2024-03-09T15:11:50.395456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":130,"num_write":96,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.256440+0000","last_change":"2024-03-09T15:12:02.256440+0000","last_active":"2024-03-09T15:12:02.256440+0000","last_peered":"2024-03-09T15:12:02.256440+0000","last_clean":"2024-03-09T15:12:02.256440+0000","last_became_active":"2024-03-09T14:26:34.667409+0000","last_became_peered":"2024-03-09T14:26:34.667409+0000","last_unstale":"2024-03-09T15:12:02.256440+0000","last_undegraded":"2024-03-09T15:12:02.256440+0000","last_fullsized":"2024-03-09T15:12:02.256440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:02.256293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:02.256293+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.256293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:53:04.069399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'129","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.326603+0000","last_change":"2024-03-09T15:11:57.326603+0000","last_active":"2024-03-09T15:11:57.326603+0000","last_peered":"2024-03-09T15:11:57.326603+0000","last_clean":"2024-03-09T15:11:57.326603+0000","last_became_active":"2024-03-09T14:26:36.674343+0000","last_became_peered":"2024-03-09T14:26:36.674343+0000","last_unstale":"2024-03-09T15:11:57.326603+0000","last_undegraded":"2024-03-09T15:11:57.326603+0000","last_fullsized":"2024-03-09T15:11:57.326603+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-03-09T15:11:57.326430+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-03-09T15:11:57.326430+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.326430+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:42.536388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":182,"num_write":308,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'428","reported_seq":2193,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.951233+0000","last_change":"2024-03-09T15:12:06.951233+0000","last_active":"2024-03-09T15:12:06.951233+0000","last_peered":"2024-03-09T15:12:06.951233+0000","last_clean":"2024-03-09T15:12:06.951233+0000","last_became_active":"2024-03-09T14:26:28.655479+0000","last_became_peered":"2024-03-09T14:26:28.655479+0000","last_unstale":"2024-03-09T15:12:06.951233+0000","last_undegraded":"2024-03-09T15:12:06.951233+0000","last_fullsized":"2024-03-09T15:12:06.951233+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'428","last_scrub_stamp":"2024-03-09T15:12:06.951095+0000","last_deep_scrub":"264'428","last_deep_scrub_stamp":"2024-03-09T15:12:06.951095+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.951095+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:57:14.025604+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2618,"num_read_kb":2506,"num_write":497,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'279","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:20.372844+0000","last_change":"2024-03-09T15:12:20.372844+0000","last_active":"2024-03-09T15:12:20.372844+0000","last_peered":"2024-03-09T15:12:20.372844+0000","last_clean":"2024-03-09T15:12:20.372844+0000","last_became_active":"2024-03-09T14:26:26.649325+0000","last_became_peered":"2024-03-09T14:26:26.649325+0000","last_unstale":"2024-03-09T15:12:20.372844+0000","last_undegraded":"2024-03-09T15:12:20.372844+0000","last_fullsized":"2024-03-09T15:12:20.372844+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'279","last_scrub_stamp":"2024-03-09T15:12:20.372679+0000","last_deep_scrub":"264'279","last_deep_scrub_stamp":"2024-03-09T15:12:20.372679+0000","last_clean_scrub_stamp":"2024-03-09T15:12:20.372679+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:37:14.298643+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778712,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":954,"num_read_kb":64626,"num_write":1397,"num_write_kb":23267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.829676+0000","last_change":"2024-03-09T15:12:18.829703+0000","last_active":"2024-03-09T15:12:18.829676+0000","last_peered":"2024-03-09T15:12:18.829676+0000","last_clean":"2024-03-09T15:12:18.829676+0000","last_became_active":"2024-03-09T14:26:18.578807+0000","last_became_peered":"2024-03-09T14:26:18.578807+0000","last_unstale":"2024-03-09T15:12:18.829676+0000","last_undegraded":"2024-03-09T15:12:18.829676+0000","last_fullsized":"2024-03-09T15:12:18.829676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:18.829567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:18.829567+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.829567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:52.562219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.574499+0000","last_change":"2024-03-09T15:12:21.574499+0000","last_active":"2024-03-09T15:12:21.574499+0000","last_peered":"2024-03-09T15:12:21.574499+0000","last_clean":"2024-03-09T15:12:21.574499+0000","last_became_active":"2024-03-09T14:26:30.648619+0000","last_became_peered":"2024-03-09T14:26:30.648619+0000","last_unstale":"2024-03-09T15:12:21.574499+0000","last_undegraded":"2024-03-09T15:12:21.574499+0000","last_fullsized":"2024-03-09T15:12:21.574499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:21.574386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:21.574386+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.574386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:32.810199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'274","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.883082+0000","last_change":"2024-03-09T14:26:32.654402+0000","last_active":"2024-03-09T15:11:45.883082+0000","last_peered":"2024-03-09T15:11:45.883082+0000","last_clean":"2024-03-09T15:11:45.883082+0000","last_became_active":"2024-03-09T14:26:32.653912+0000","last_became_peered":"2024-03-09T14:26:32.653912+0000","last_unstale":"2024-03-09T15:11:45.883082+0000","last_undegraded":"2024-03-09T15:11:45.883082+0000","last_fullsized":"2024-03-09T15:11:45.883082+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16298,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1016,"num_read_kb":1109,"num_write":1512,"num_write_kb":1369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.186062+0000","last_change":"2024-03-09T15:11:59.186062+0000","last_active":"2024-03-09T15:11:59.186062+0000","last_peered":"2024-03-09T15:11:59.186062+0000","last_clean":"2024-03-09T15:11:59.186062+0000","last_became_active":"2024-03-09T14:26:34.675234+0000","last_became_peered":"2024-03-09T14:26:34.675234+0000","last_unstale":"2024-03-09T15:11:59.186062+0000","last_undegraded":"2024-03-09T15:11:59.186062+0000","last_fullsized":"2024-03-09T15:11:59.186062+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:11:59.185947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:11:59.185947+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.185947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:15.640797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'167","reported_seq":679,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.426525+0000","last_change":"2024-03-09T15:12:00.426559+0000","last_active":"2024-03-09T15:12:00.426525+0000","last_peered":"2024-03-09T15:12:00.426525+0000","last_clean":"2024-03-09T15:12:00.426525+0000","last_became_active":"2024-03-09T14:26:36.786088+0000","last_became_peered":"2024-03-09T14:26:36.786088+0000","last_unstale":"2024-03-09T15:12:00.426525+0000","last_undegraded":"2024-03-09T15:12:00.426525+0000","last_fullsized":"2024-03-09T15:12:00.426525+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'167","last_scrub_stamp":"2024-03-09T15:12:00.426423+0000","last_deep_scrub":"264'167","last_deep_scrub_stamp":"2024-03-09T15:12:00.426423+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.426423+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:03:18.704412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":687,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":146,"num_write":429,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'835","reported_seq":2540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.017687+0000","last_change":"2024-03-09T14:26:28.646272+0000","last_active":"2024-03-09T15:11:49.017687+0000","last_peered":"2024-03-09T15:11:49.017687+0000","last_clean":"2024-03-09T15:11:49.017687+0000","last_became_active":"2024-03-09T14:26:28.645944+0000","last_became_peered":"2024-03-09T14:26:28.645944+0000","last_unstale":"2024-03-09T15:11:49.017687+0000","last_undegraded":"2024-03-09T15:11:49.017687+0000","last_fullsized":"2024-03-09T15:11:49.017687+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4110,"num_read_kb":3687,"num_write":1137,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'200","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.803207+0000","last_change":"2024-03-09T15:12:22.803264+0000","last_active":"2024-03-09T15:12:22.803207+0000","last_peered":"2024-03-09T15:12:22.803207+0000","last_clean":"2024-03-09T15:12:22.803207+0000","last_became_active":"2024-03-09T14:26:26.639853+0000","last_became_peered":"2024-03-09T14:26:26.639853+0000","last_unstale":"2024-03-09T15:12:22.803207+0000","last_undegraded":"2024-03-09T15:12:22.803207+0000","last_fullsized":"2024-03-09T15:12:22.803207+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-03-09T15:12:22.803085+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-03-09T15:12:22.803085+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.803085+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:21:14.474491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992354,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":10153,"num_write":1145,"num_write_kb":29784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.255960+0000","last_change":"2024-03-09T14:26:18.582360+0000","last_active":"2024-03-09T15:11:52.255960+0000","last_peered":"2024-03-09T15:11:52.255960+0000","last_clean":"2024-03-09T15:11:52.255960+0000","last_became_active":"2024-03-09T14:26:18.581750+0000","last_became_peered":"2024-03-09T14:26:18.581750+0000","last_unstale":"2024-03-09T15:11:52.255960+0000","last_undegraded":"2024-03-09T15:11:52.255960+0000","last_fullsized":"2024-03-09T15:11:52.255960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:17.561382+0000","last_clean_scrub_stamp":"2024-03-09T14:26:17.561382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.293296+0000","last_change":"2024-03-09T15:12:03.293296+0000","last_active":"2024-03-09T15:12:03.293296+0000","last_peered":"2024-03-09T15:12:03.293296+0000","last_clean":"2024-03-09T15:12:03.293296+0000","last_became_active":"2024-03-09T14:26:30.649176+0000","last_became_peered":"2024-03-09T14:26:30.649176+0000","last_unstale":"2024-03-09T15:12:03.293296+0000","last_undegraded":"2024-03-09T15:12:03.293296+0000","last_fullsized":"2024-03-09T15:12:03.293296+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:03.293087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:03.293087+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.293087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:24.818377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'194","reported_seq":763,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.940076+0000","last_change":"2024-03-09T15:12:09.940076+0000","last_active":"2024-03-09T15:12:09.940076+0000","last_peered":"2024-03-09T15:12:09.940076+0000","last_clean":"2024-03-09T15:12:09.940076+0000","last_became_active":"2024-03-09T14:26:32.868165+0000","last_became_peered":"2024-03-09T14:26:32.868165+0000","last_unstale":"2024-03-09T15:12:09.940076+0000","last_undegraded":"2024-03-09T15:12:09.940076+0000","last_fullsized":"2024-03-09T15:12:09.940076+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'194","last_scrub_stamp":"2024-03-09T15:12:09.939941+0000","last_deep_scrub":"264'194","last_deep_scrub_stamp":"2024-03-09T15:12:09.939941+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.939941+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:11:13.722883+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":224,"num_write":210,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5650,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'558","reported_seq":2232,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.361436+0000","last_change":"2024-03-09T15:12:02.361470+0000","last_active":"2024-03-09T15:12:02.361436+0000","last_peered":"2024-03-09T15:12:02.361436+0000","last_clean":"2024-03-09T15:12:02.361436+0000","last_became_active":"2024-03-09T14:26:34.672351+0000","last_became_peered":"2024-03-09T14:26:34.672351+0000","last_unstale":"2024-03-09T15:12:02.361436+0000","last_undegraded":"2024-03-09T15:12:02.361436+0000","last_fullsized":"2024-03-09T15:12:02.361436+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'558","last_scrub_stamp":"2024-03-09T15:12:02.361345+0000","last_deep_scrub":"264'558","last_deep_scrub_stamp":"2024-03-09T15:12:02.361345+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.361345+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:21:04.025240+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'124","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.082707+0000","last_change":"2024-03-09T15:12:03.082748+0000","last_active":"2024-03-09T15:12:03.082707+0000","last_peered":"2024-03-09T15:12:03.082707+0000","last_clean":"2024-03-09T15:12:03.082707+0000","last_became_active":"2024-03-09T14:26:36.785453+0000","last_became_peered":"2024-03-09T14:26:36.785453+0000","last_unstale":"2024-03-09T15:12:03.082707+0000","last_undegraded":"2024-03-09T15:12:03.082707+0000","last_fullsized":"2024-03-09T15:12:03.082707+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:12:03.082612+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:12:03.082612+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.082612+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:56.726690+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":860,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":155,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'677","reported_seq":2134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:25.005595+0000","last_change":"2024-03-09T15:12:25.005636+0000","last_active":"2024-03-09T15:12:25.005595+0000","last_peered":"2024-03-09T15:12:25.005595+0000","last_clean":"2024-03-09T15:12:25.005595+0000","last_became_active":"2024-03-09T14:26:28.655904+0000","last_became_peered":"2024-03-09T14:26:28.655904+0000","last_unstale":"2024-03-09T15:12:25.005595+0000","last_undegraded":"2024-03-09T15:12:25.005595+0000","last_fullsized":"2024-03-09T15:12:25.005595+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'677","last_scrub_stamp":"2024-03-09T15:12:25.005508+0000","last_deep_scrub":"264'677","last_deep_scrub_stamp":"2024-03-09T15:12:25.005508+0000","last_clean_scrub_stamp":"2024-03-09T15:12:25.005508+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":600,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:02:36.921019+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3203,"num_read_kb":2919,"num_write":883,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'221","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395053+0000","last_change":"2024-03-09T14:26:26.644176+0000","last_active":"2024-03-09T15:11:50.395053+0000","last_peered":"2024-03-09T15:11:50.395053+0000","last_clean":"2024-03-09T15:11:50.395053+0000","last_became_active":"2024-03-09T14:26:26.643087+0000","last_became_peered":"2024-03-09T14:26:26.643087+0000","last_unstale":"2024-03-09T15:11:50.395053+0000","last_undegraded":"2024-03-09T15:11:50.395053+0000","last_fullsized":"2024-03-09T15:11:50.395053+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":456,"num_read_kb":60158,"num_write":1088,"num_write_kb":49675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.783967+0000","last_change":"2024-03-09T15:12:17.784007+0000","last_active":"2024-03-09T15:12:17.783967+0000","last_peered":"2024-03-09T15:12:17.783967+0000","last_clean":"2024-03-09T15:12:17.783967+0000","last_became_active":"2024-03-09T14:26:18.577564+0000","last_became_peered":"2024-03-09T14:26:18.577564+0000","last_unstale":"2024-03-09T15:12:17.783967+0000","last_undegraded":"2024-03-09T15:12:17.783967+0000","last_fullsized":"2024-03-09T15:12:17.783967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:17.783855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:17.783855+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.783855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:51.999902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.036401+0000","last_change":"2024-03-09T15:12:18.036401+0000","last_active":"2024-03-09T15:12:18.036401+0000","last_peered":"2024-03-09T15:12:18.036401+0000","last_clean":"2024-03-09T15:12:18.036401+0000","last_became_active":"2024-03-09T14:26:30.650370+0000","last_became_peered":"2024-03-09T14:26:30.650370+0000","last_unstale":"2024-03-09T15:12:18.036401+0000","last_undegraded":"2024-03-09T15:12:18.036401+0000","last_fullsized":"2024-03-09T15:12:18.036401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:18.036284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:18.036284+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.036284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:48:04.074398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'107","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.081426+0000","last_change":"2024-03-09T15:12:05.081426+0000","last_active":"2024-03-09T15:12:05.081426+0000","last_peered":"2024-03-09T15:12:05.081426+0000","last_clean":"2024-03-09T15:12:05.081426+0000","last_became_active":"2024-03-09T14:26:32.655285+0000","last_became_peered":"2024-03-09T14:26:32.655285+0000","last_unstale":"2024-03-09T15:12:05.081426+0000","last_undegraded":"2024-03-09T15:12:05.081426+0000","last_fullsized":"2024-03-09T15:12:05.081426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-03-09T15:12:05.081295+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-03-09T15:12:05.081295+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.081295+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:35.530675+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":120,"num_read_kb":114,"num_write":82,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'565","reported_seq":4071,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.104143+0000","last_change":"2024-03-09T15:12:12.104143+0000","last_active":"2024-03-09T15:12:12.104143+0000","last_peered":"2024-03-09T15:12:12.104143+0000","last_clean":"2024-03-09T15:12:12.104143+0000","last_became_active":"2024-03-09T14:26:34.678503+0000","last_became_peered":"2024-03-09T14:26:34.678503+0000","last_unstale":"2024-03-09T15:12:12.104143+0000","last_undegraded":"2024-03-09T15:12:12.104143+0000","last_fullsized":"2024-03-09T15:12:12.104143+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'565","last_scrub_stamp":"2024-03-09T15:12:12.103964+0000","last_deep_scrub":"264'565","last_deep_scrub_stamp":"2024-03-09T15:12:12.103964+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.103964+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:42.234957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'187","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.442621+0000","last_change":"2024-03-09T15:12:05.442677+0000","last_active":"2024-03-09T15:12:05.442621+0000","last_peered":"2024-03-09T15:12:05.442621+0000","last_clean":"2024-03-09T15:12:05.442621+0000","last_became_active":"2024-03-09T14:26:36.668775+0000","last_became_peered":"2024-03-09T14:26:36.668775+0000","last_unstale":"2024-03-09T15:12:05.442621+0000","last_undegraded":"2024-03-09T15:12:05.442621+0000","last_fullsized":"2024-03-09T15:12:05.442621+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-03-09T15:12:05.442512+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-03-09T15:12:05.442512+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.442512+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:06:37.514099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":97,"num_write":406,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'323","reported_seq":1669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.039241+0000","last_change":"2024-03-09T15:12:09.039241+0000","last_active":"2024-03-09T15:12:09.039241+0000","last_peered":"2024-03-09T15:12:09.039241+0000","last_clean":"2024-03-09T15:12:09.039241+0000","last_became_active":"2024-03-09T14:26:28.653003+0000","last_became_peered":"2024-03-09T14:26:28.653003+0000","last_unstale":"2024-03-09T15:12:09.039241+0000","last_undegraded":"2024-03-09T15:12:09.039241+0000","last_fullsized":"2024-03-09T15:12:09.039241+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-03-09T15:12:09.039101+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-03-09T15:12:09.039101+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.039101+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:16:44.029365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1763,"num_read_kb":1672,"num_write":372,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'241","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.881001+0000","last_change":"2024-03-09T15:11:57.881045+0000","last_active":"2024-03-09T15:11:57.881001+0000","last_peered":"2024-03-09T15:11:57.881001+0000","last_clean":"2024-03-09T15:11:57.881001+0000","last_became_active":"2024-03-09T14:27:03.719395+0000","last_became_peered":"2024-03-09T14:27:03.719395+0000","last_unstale":"2024-03-09T15:11:57.881001+0000","last_undegraded":"2024-03-09T15:11:57.881001+0000","last_fullsized":"2024-03-09T15:11:57.881001+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'241","last_scrub_stamp":"2024-03-09T15:11:57.880900+0000","last_deep_scrub":"264'241","last_deep_scrub_stamp":"2024-03-09T15:11:57.880900+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.880900+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:07:39.960326+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992298,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":20107,"num_write":1293,"num_write_kb":28946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.293882+0000","last_change":"2024-03-09T15:12:14.293922+0000","last_active":"2024-03-09T15:12:14.293882+0000","last_peered":"2024-03-09T15:12:14.293882+0000","last_clean":"2024-03-09T15:12:14.293882+0000","last_became_active":"2024-03-09T14:26:18.577994+0000","last_became_peered":"2024-03-09T14:26:18.577994+0000","last_unstale":"2024-03-09T15:12:14.293882+0000","last_undegraded":"2024-03-09T15:12:14.293882+0000","last_fullsized":"2024-03-09T15:12:14.293882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:14.293772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:14.293772+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.293772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:39.408446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:24.005994+0000","last_change":"2024-03-09T15:12:24.006019+0000","last_active":"2024-03-09T15:12:24.005994+0000","last_peered":"2024-03-09T15:12:24.005994+0000","last_clean":"2024-03-09T15:12:24.005994+0000","last_became_active":"2024-03-09T14:26:30.648910+0000","last_became_peered":"2024-03-09T14:26:30.648910+0000","last_unstale":"2024-03-09T15:12:24.005994+0000","last_undegraded":"2024-03-09T15:12:24.005994+0000","last_fullsized":"2024-03-09T15:12:24.005994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:24.005902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:24.005902+0000","last_clean_scrub_stamp":"2024-03-09T15:12:24.005902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:41:46.642481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'319","reported_seq":1039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.923725+0000","last_change":"2024-03-09T15:12:17.923725+0000","last_active":"2024-03-09T15:12:17.923725+0000","last_peered":"2024-03-09T15:12:17.923725+0000","last_clean":"2024-03-09T15:12:17.923725+0000","last_became_active":"2024-03-09T14:26:32.868370+0000","last_became_peered":"2024-03-09T14:26:32.868370+0000","last_unstale":"2024-03-09T15:12:17.923725+0000","last_undegraded":"2024-03-09T15:12:17.923725+0000","last_fullsized":"2024-03-09T15:12:17.923725+0000","mapping_epoch":29,"log_start":"264'301","ondisk_log_start":"264'301","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'319","last_scrub_stamp":"2024-03-09T15:12:17.923594+0000","last_deep_scrub":"264'319","last_deep_scrub_stamp":"2024-03-09T15:12:17.923594+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.923594+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":301,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:58.388284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32196,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":474,"num_read_kb":726,"num_write":246,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.082085+0000","last_change":"2024-03-09T15:12:13.082085+0000","last_active":"2024-03-09T15:12:13.082085+0000","last_peered":"2024-03-09T15:12:13.082085+0000","last_clean":"2024-03-09T15:12:13.082085+0000","last_became_active":"2024-03-09T14:26:34.672655+0000","last_became_peered":"2024-03-09T14:26:34.672655+0000","last_unstale":"2024-03-09T15:12:13.082085+0000","last_undegraded":"2024-03-09T15:12:13.082085+0000","last_fullsized":"2024-03-09T15:12:13.082085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:13.081992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:13.081992+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.081992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:57:51.211937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'122","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.365413+0000","last_change":"2024-03-09T15:11:53.365460+0000","last_active":"2024-03-09T15:11:53.365413+0000","last_peered":"2024-03-09T15:11:53.365413+0000","last_clean":"2024-03-09T15:11:53.365413+0000","last_became_active":"2024-03-09T14:26:36.678641+0000","last_became_peered":"2024-03-09T14:26:36.678641+0000","last_unstale":"2024-03-09T15:11:53.365413+0000","last_undegraded":"2024-03-09T15:11:53.365413+0000","last_fullsized":"2024-03-09T15:11:53.365413+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'122","last_scrub_stamp":"2024-03-09T15:11:53.365321+0000","last_deep_scrub":"264'122","last_deep_scrub_stamp":"2024-03-09T15:11:53.365321+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.365321+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:24:39.835900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'142","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.442131+0000","last_change":"2024-03-09T15:12:01.442131+0000","last_active":"2024-03-09T15:12:01.442131+0000","last_peered":"2024-03-09T15:12:01.442131+0000","last_clean":"2024-03-09T15:12:01.442131+0000","last_became_active":"2024-03-09T14:26:36.671823+0000","last_became_peered":"2024-03-09T14:26:36.671823+0000","last_unstale":"2024-03-09T15:12:01.442131+0000","last_undegraded":"2024-03-09T15:12:01.442131+0000","last_fullsized":"2024-03-09T15:12:01.442131+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-03-09T15:12:01.441992+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-03-09T15:12:01.441992+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.441992+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:57:30.083070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":220,"num_write":322,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'412","reported_seq":1981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.003641+0000","last_change":"2024-03-09T15:12:19.003675+0000","last_active":"2024-03-09T15:12:19.003641+0000","last_peered":"2024-03-09T15:12:19.003641+0000","last_clean":"2024-03-09T15:12:19.003641+0000","last_became_active":"2024-03-09T14:26:28.649681+0000","last_became_peered":"2024-03-09T14:26:28.649681+0000","last_unstale":"2024-03-09T15:12:19.003641+0000","last_undegraded":"2024-03-09T15:12:19.003641+0000","last_fullsized":"2024-03-09T15:12:19.003641+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'412","last_scrub_stamp":"2024-03-09T15:12:19.003554+0000","last_deep_scrub":"264'412","last_deep_scrub_stamp":"2024-03-09T15:12:19.003554+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.003554+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:49.080744+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2231,"num_read_kb":2115,"num_write":479,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'192","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:26.924177+0000","last_change":"2024-03-09T15:12:26.924233+0000","last_active":"2024-03-09T15:12:26.924177+0000","last_peered":"2024-03-09T15:12:26.924177+0000","last_clean":"2024-03-09T15:12:26.924177+0000","last_became_active":"2024-03-09T14:26:26.643598+0000","last_became_peered":"2024-03-09T14:26:26.643598+0000","last_unstale":"2024-03-09T15:12:26.924177+0000","last_undegraded":"2024-03-09T15:12:26.924177+0000","last_fullsized":"2024-03-09T15:12:26.924177+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-03-09T15:12:26.924084+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-03-09T15:12:26.924084+0000","last_clean_scrub_stamp":"2024-03-09T15:12:26.924084+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:07.971034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":35501,"num_write":902,"num_write_kb":49168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.942015+0000","last_change":"2024-03-09T15:12:04.942055+0000","last_active":"2024-03-09T15:12:04.942015+0000","last_peered":"2024-03-09T15:12:04.942015+0000","last_clean":"2024-03-09T15:12:04.942015+0000","last_became_active":"2024-03-09T14:26:30.650743+0000","last_became_peered":"2024-03-09T14:26:30.650743+0000","last_unstale":"2024-03-09T15:12:04.942015+0000","last_undegraded":"2024-03-09T15:12:04.942015+0000","last_fullsized":"2024-03-09T15:12:04.942015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:04.941908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:04.941908+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.941908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:48:42.425183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'128","reported_seq":693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.796494+0000","last_change":"2024-03-09T14:26:32.651032+0000","last_active":"2024-03-09T15:11:45.796494+0000","last_peered":"2024-03-09T15:11:45.796494+0000","last_clean":"2024-03-09T15:11:45.796494+0000","last_became_active":"2024-03-09T14:26:32.650770+0000","last_became_peered":"2024-03-09T14:26:32.650770+0000","last_unstale":"2024-03-09T15:11:45.796494+0000","last_undegraded":"2024-03-09T15:11:45.796494+0000","last_fullsized":"2024-03-09T15:11:45.796494+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7550,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":243,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.025231+0000","last_change":"2024-03-09T15:12:09.025268+0000","last_active":"2024-03-09T15:12:09.025231+0000","last_peered":"2024-03-09T15:12:09.025231+0000","last_clean":"2024-03-09T15:12:09.025231+0000","last_became_active":"2024-03-09T14:26:34.678657+0000","last_became_peered":"2024-03-09T14:26:34.678657+0000","last_unstale":"2024-03-09T15:12:09.025231+0000","last_undegraded":"2024-03-09T15:12:09.025231+0000","last_fullsized":"2024-03-09T15:12:09.025231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:09.025137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:09.025137+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.025137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:30:35.785925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'109","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.100876+0000","last_change":"2024-03-09T15:12:04.100945+0000","last_active":"2024-03-09T15:12:04.100876+0000","last_peered":"2024-03-09T15:12:04.100876+0000","last_clean":"2024-03-09T15:12:04.100876+0000","last_became_active":"2024-03-09T14:26:36.678174+0000","last_became_peered":"2024-03-09T14:26:36.678174+0000","last_unstale":"2024-03-09T15:12:04.100876+0000","last_undegraded":"2024-03-09T15:12:04.100876+0000","last_fullsized":"2024-03-09T15:12:04.100876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-03-09T15:12:04.100776+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-03-09T15:12:04.100776+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.100776+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:06:28.140547+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":96,"num_write":259,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'449","reported_seq":2113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.776766+0000","last_change":"2024-03-09T15:12:23.776804+0000","last_active":"2024-03-09T15:12:23.776766+0000","last_peered":"2024-03-09T15:12:23.776766+0000","last_clean":"2024-03-09T15:12:23.776766+0000","last_became_active":"2024-03-09T14:26:28.644951+0000","last_became_peered":"2024-03-09T14:26:28.644951+0000","last_unstale":"2024-03-09T15:12:23.776766+0000","last_undegraded":"2024-03-09T15:12:23.776766+0000","last_fullsized":"2024-03-09T15:12:23.776766+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'449","last_scrub_stamp":"2024-03-09T15:12:23.776676+0000","last_deep_scrub":"264'449","last_deep_scrub_stamp":"2024-03-09T15:12:23.776676+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.776676+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:56.169806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2607,"num_read_kb":2478,"num_write":564,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'189","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.256047+0000","last_change":"2024-03-09T14:26:26.652608+0000","last_active":"2024-03-09T15:11:52.256047+0000","last_peered":"2024-03-09T15:11:52.256047+0000","last_clean":"2024-03-09T15:11:52.256047+0000","last_became_active":"2024-03-09T14:26:26.652260+0000","last_became_peered":"2024-03-09T14:26:26.652260+0000","last_unstale":"2024-03-09T15:11:52.256047+0000","last_undegraded":"2024-03-09T15:11:52.256047+0000","last_fullsized":"2024-03-09T15:11:52.256047+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":396,"num_read_kb":5479,"num_write":1053,"num_write_kb":16075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:26.049054+0000","last_change":"2024-03-09T15:12:26.049083+0000","last_active":"2024-03-09T15:12:26.049054+0000","last_peered":"2024-03-09T15:12:26.049054+0000","last_clean":"2024-03-09T15:12:26.049054+0000","last_became_active":"2024-03-09T14:26:30.649790+0000","last_became_peered":"2024-03-09T14:26:30.649790+0000","last_unstale":"2024-03-09T15:12:26.049054+0000","last_undegraded":"2024-03-09T15:12:26.049054+0000","last_fullsized":"2024-03-09T15:12:26.049054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:26.048953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:26.048953+0000","last_clean_scrub_stamp":"2024-03-09T15:12:26.048953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:00.968101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'56","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:09.205086+0000","last_change":"2024-03-09T14:26:32.655566+0000","last_active":"2024-03-09T15:11:09.205086+0000","last_peered":"2024-03-09T15:11:09.205086+0000","last_clean":"2024-03-09T15:11:09.205086+0000","last_became_active":"2024-03-09T14:26:32.655269+0000","last_became_peered":"2024-03-09T14:26:32.655269+0000","last_unstale":"2024-03-09T15:11:09.205086+0000","last_undegraded":"2024-03-09T15:11:09.205086+0000","last_fullsized":"2024-03-09T15:11:09.205086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.935078+0000","last_change":"2024-03-09T15:12:14.935102+0000","last_active":"2024-03-09T15:12:14.935078+0000","last_peered":"2024-03-09T15:12:14.935078+0000","last_clean":"2024-03-09T15:12:14.935078+0000","last_became_active":"2024-03-09T14:26:34.671065+0000","last_became_peered":"2024-03-09T14:26:34.671065+0000","last_unstale":"2024-03-09T15:12:14.935078+0000","last_undegraded":"2024-03-09T15:12:14.935078+0000","last_fullsized":"2024-03-09T15:12:14.935078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:14.934991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:14.934991+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.934991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:13:26.265646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'189","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.464645+0000","last_change":"2024-03-09T15:12:06.464674+0000","last_active":"2024-03-09T15:12:06.464645+0000","last_peered":"2024-03-09T15:12:06.464645+0000","last_clean":"2024-03-09T15:12:06.464645+0000","last_became_active":"2024-03-09T14:26:36.666762+0000","last_became_peered":"2024-03-09T14:26:36.666762+0000","last_unstale":"2024-03-09T15:12:06.464645+0000","last_undegraded":"2024-03-09T15:12:06.464645+0000","last_fullsized":"2024-03-09T15:12:06.464645+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-03-09T15:12:06.464544+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-03-09T15:12:06.464544+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.464544+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:57:59.260932+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":266,"num_read_kb":261,"num_write":413,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'441","reported_seq":2112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.107028+0000","last_change":"2024-03-09T15:12:21.107066+0000","last_active":"2024-03-09T15:12:21.107028+0000","last_peered":"2024-03-09T15:12:21.107028+0000","last_clean":"2024-03-09T15:12:21.107028+0000","last_became_active":"2024-03-09T14:26:28.657024+0000","last_became_peered":"2024-03-09T14:26:28.657024+0000","last_unstale":"2024-03-09T15:12:21.107028+0000","last_undegraded":"2024-03-09T15:12:21.107028+0000","last_fullsized":"2024-03-09T15:12:21.107028+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'441","last_scrub_stamp":"2024-03-09T15:12:21.106920+0000","last_deep_scrub":"264'441","last_deep_scrub_stamp":"2024-03-09T15:12:21.106920+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.106920+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:23:18.679220+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2592,"num_read_kb":2450,"num_write":527,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2520,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'200","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.322265+0000","last_change":"2024-03-09T14:26:26.646837+0000","last_active":"2024-03-09T15:11:51.322265+0000","last_peered":"2024-03-09T15:11:51.322265+0000","last_clean":"2024-03-09T15:11:51.322265+0000","last_became_active":"2024-03-09T14:26:26.646506+0000","last_became_peered":"2024-03-09T14:26:26.646506+0000","last_unstale":"2024-03-09T15:11:51.322265+0000","last_undegraded":"2024-03-09T15:11:51.322265+0000","last_fullsized":"2024-03-09T15:11:51.322265+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680231,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":50376,"num_write":989,"num_write_kb":56973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:24.741360+0000","last_change":"2024-03-09T15:12:24.741412+0000","last_active":"2024-03-09T15:12:24.741360+0000","last_peered":"2024-03-09T15:12:24.741360+0000","last_clean":"2024-03-09T15:12:24.741360+0000","last_became_active":"2024-03-09T14:26:30.652245+0000","last_became_peered":"2024-03-09T14:26:30.652245+0000","last_unstale":"2024-03-09T15:12:24.741360+0000","last_undegraded":"2024-03-09T15:12:24.741360+0000","last_fullsized":"2024-03-09T15:12:24.741360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:24.741248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:24.741248+0000","last_clean_scrub_stamp":"2024-03-09T15:12:24.741248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:07:18.855673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'167","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.698044+0000","last_change":"2024-03-09T14:26:32.652895+0000","last_active":"2024-03-09T15:11:45.698044+0000","last_peered":"2024-03-09T15:11:45.698044+0000","last_clean":"2024-03-09T15:11:45.698044+0000","last_became_active":"2024-03-09T14:26:32.652610+0000","last_became_peered":"2024-03-09T14:26:32.652610+0000","last_unstale":"2024-03-09T15:11:45.698044+0000","last_undegraded":"2024-03-09T15:11:45.698044+0000","last_fullsized":"2024-03-09T15:11:45.698044+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11381,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":311,"num_write":122,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.237273+0000","last_change":"2024-03-09T15:12:00.237310+0000","last_active":"2024-03-09T15:12:00.237273+0000","last_peered":"2024-03-09T15:12:00.237273+0000","last_clean":"2024-03-09T15:12:00.237273+0000","last_became_active":"2024-03-09T14:26:34.667373+0000","last_became_peered":"2024-03-09T14:26:34.667373+0000","last_unstale":"2024-03-09T15:12:00.237273+0000","last_undegraded":"2024-03-09T15:12:00.237273+0000","last_fullsized":"2024-03-09T15:12:00.237273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:00.237122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:00.237122+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.237122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:48:22.922919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'135","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.293978+0000","last_change":"2024-03-09T15:11:56.294011+0000","last_active":"2024-03-09T15:11:56.293978+0000","last_peered":"2024-03-09T15:11:56.293978+0000","last_clean":"2024-03-09T15:11:56.293978+0000","last_became_active":"2024-03-09T14:26:36.678306+0000","last_became_peered":"2024-03-09T14:26:36.678306+0000","last_unstale":"2024-03-09T15:11:56.293978+0000","last_undegraded":"2024-03-09T15:11:56.293978+0000","last_fullsized":"2024-03-09T15:11:56.293978+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'135","last_scrub_stamp":"2024-03-09T15:11:56.293887+0000","last_deep_scrub":"264'135","last_deep_scrub_stamp":"2024-03-09T15:11:56.293887+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.293887+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:56.519336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":110,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'434","reported_seq":2107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:29.108577+0000","last_change":"2024-03-09T15:12:29.108611+0000","last_active":"2024-03-09T15:12:29.108577+0000","last_peered":"2024-03-09T15:12:29.108577+0000","last_clean":"2024-03-09T15:12:29.108577+0000","last_became_active":"2024-03-09T14:26:28.651640+0000","last_became_peered":"2024-03-09T14:26:28.651640+0000","last_unstale":"2024-03-09T15:12:29.108577+0000","last_undegraded":"2024-03-09T15:12:29.108577+0000","last_fullsized":"2024-03-09T15:12:29.108577+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'434","last_scrub_stamp":"2024-03-09T15:12:29.108491+0000","last_deep_scrub":"264'434","last_deep_scrub_stamp":"2024-03-09T15:12:29.108491+0000","last_clean_scrub_stamp":"2024-03-09T15:12:29.108491+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:43:55.826599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2590,"num_read_kb":2461,"num_write":546,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'207","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.017405+0000","last_change":"2024-03-09T14:26:26.636955+0000","last_active":"2024-03-09T15:11:49.017405+0000","last_peered":"2024-03-09T15:11:49.017405+0000","last_clean":"2024-03-09T15:11:49.017405+0000","last_became_active":"2024-03-09T14:26:26.636087+0000","last_became_peered":"2024-03-09T14:26:26.636087+0000","last_unstale":"2024-03-09T15:11:49.017405+0000","last_undegraded":"2024-03-09T15:11:49.017405+0000","last_fullsized":"2024-03-09T15:11:49.017405+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":651,"num_read_kb":124750,"num_write":1247,"num_write_kb":18410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.229265+0000","last_change":"2024-03-09T15:11:59.229293+0000","last_active":"2024-03-09T15:11:59.229265+0000","last_peered":"2024-03-09T15:11:59.229265+0000","last_clean":"2024-03-09T15:11:59.229265+0000","last_became_active":"2024-03-09T14:26:30.652925+0000","last_became_peered":"2024-03-09T14:26:30.652925+0000","last_unstale":"2024-03-09T15:11:59.229265+0000","last_undegraded":"2024-03-09T15:11:59.229265+0000","last_fullsized":"2024-03-09T15:11:59.229265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:11:59.229150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:11:59.229150+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.229150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:26:08.349262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'130","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.972783+0000","last_change":"2024-03-09T14:26:32.657556+0000","last_active":"2024-03-09T15:11:45.972783+0000","last_peered":"2024-03-09T15:11:45.972783+0000","last_clean":"2024-03-09T15:11:45.972783+0000","last_became_active":"2024-03-09T14:26:32.657221+0000","last_became_peered":"2024-03-09T14:26:32.657221+0000","last_unstale":"2024-03-09T15:11:45.972783+0000","last_undegraded":"2024-03-09T15:11:45.972783+0000","last_fullsized":"2024-03-09T15:11:45.972783+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24100,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":271,"num_write":84,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.481693+0000","last_change":"2024-03-09T15:12:12.481732+0000","last_active":"2024-03-09T15:12:12.481693+0000","last_peered":"2024-03-09T15:12:12.481693+0000","last_clean":"2024-03-09T15:12:12.481693+0000","last_became_active":"2024-03-09T14:26:34.670283+0000","last_became_peered":"2024-03-09T14:26:34.670283+0000","last_unstale":"2024-03-09T15:12:12.481693+0000","last_undegraded":"2024-03-09T15:12:12.481693+0000","last_fullsized":"2024-03-09T15:12:12.481693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:12.481537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:12.481537+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.481537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:51:29.132549+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'871","reported_seq":2456,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.263071+0000","last_change":"2024-03-09T15:12:07.263071+0000","last_active":"2024-03-09T15:12:07.263071+0000","last_peered":"2024-03-09T15:12:07.263071+0000","last_clean":"2024-03-09T15:12:07.263071+0000","last_became_active":"2024-03-09T14:26:28.651921+0000","last_became_peered":"2024-03-09T14:26:28.651921+0000","last_unstale":"2024-03-09T15:12:07.263071+0000","last_undegraded":"2024-03-09T15:12:07.263071+0000","last_fullsized":"2024-03-09T15:12:07.263071+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'871","last_scrub_stamp":"2024-03-09T15:12:07.262941+0000","last_deep_scrub":"264'871","last_deep_scrub_stamp":"2024-03-09T15:12:07.262941+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.262941+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:58:27.987184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3929,"num_read_kb":3481,"num_write":1218,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'260","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.768224+0000","last_change":"2024-03-09T15:11:53.768349+0000","last_active":"2024-03-09T15:11:53.768224+0000","last_peered":"2024-03-09T15:11:53.768224+0000","last_clean":"2024-03-09T15:11:53.768224+0000","last_became_active":"2024-03-09T14:27:03.716852+0000","last_became_peered":"2024-03-09T14:27:03.716852+0000","last_unstale":"2024-03-09T15:11:53.768224+0000","last_undegraded":"2024-03-09T15:11:53.768224+0000","last_fullsized":"2024-03-09T15:11:53.768224+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'260","last_scrub_stamp":"2024-03-09T15:11:53.768142+0000","last_deep_scrub":"264'260","last_deep_scrub_stamp":"2024-03-09T15:11:53.768142+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.768142+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:03:13.404383+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524411,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":890,"num_read_kb":7728,"num_write":1384,"num_write_kb":17237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"264'4","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.497825+0000","last_change":"2024-03-09T15:12:23.497891+0000","last_active":"2024-03-09T15:12:23.497825+0000","last_peered":"2024-03-09T15:12:23.497825+0000","last_clean":"2024-03-09T15:12:23.497825+0000","last_became_active":"2024-03-09T14:26:30.651711+0000","last_became_peered":"2024-03-09T14:26:30.651711+0000","last_unstale":"2024-03-09T15:12:23.497825+0000","last_undegraded":"2024-03-09T15:12:23.497825+0000","last_fullsized":"2024-03-09T15:12:23.497825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:12:23.497732+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:12:23.497732+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.497732+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:26:31.046818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":482,"num_read_kb":480,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'211","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.932212+0000","last_change":"2024-03-09T15:12:07.932255+0000","last_active":"2024-03-09T15:12:07.932212+0000","last_peered":"2024-03-09T15:12:07.932212+0000","last_clean":"2024-03-09T15:12:07.932212+0000","last_became_active":"2024-03-09T14:26:32.655391+0000","last_became_peered":"2024-03-09T14:26:32.655391+0000","last_unstale":"2024-03-09T15:12:07.932212+0000","last_undegraded":"2024-03-09T15:12:07.932212+0000","last_fullsized":"2024-03-09T15:12:07.932212+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'211","last_scrub_stamp":"2024-03-09T15:12:07.932126+0000","last_deep_scrub":"264'211","last_deep_scrub_stamp":"2024-03-09T15:12:07.932126+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.932126+0000","objects_scrubbed":6,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:14:49.656627+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39743,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":317,"num_read_kb":534,"num_write":200,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22450,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.333298+0000","last_change":"2024-03-09T15:12:01.333337+0000","last_active":"2024-03-09T15:12:01.333298+0000","last_peered":"2024-03-09T15:12:01.333298+0000","last_clean":"2024-03-09T15:12:01.333298+0000","last_became_active":"2024-03-09T14:26:34.675248+0000","last_became_peered":"2024-03-09T14:26:34.675248+0000","last_unstale":"2024-03-09T15:12:01.333298+0000","last_undegraded":"2024-03-09T15:12:01.333298+0000","last_fullsized":"2024-03-09T15:12:01.333298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:01.333180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:01.333180+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.333180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:15.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'188","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.120569+0000","last_change":"2024-03-09T15:12:01.120602+0000","last_active":"2024-03-09T15:12:01.120569+0000","last_peered":"2024-03-09T15:12:01.120569+0000","last_clean":"2024-03-09T15:12:01.120569+0000","last_became_active":"2024-03-09T14:26:36.786403+0000","last_became_peered":"2024-03-09T14:26:36.786403+0000","last_unstale":"2024-03-09T15:12:01.120569+0000","last_undegraded":"2024-03-09T15:12:01.120569+0000","last_fullsized":"2024-03-09T15:12:01.120569+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'188","last_scrub_stamp":"2024-03-09T15:12:01.120487+0000","last_deep_scrub":"264'188","last_deep_scrub_stamp":"2024-03-09T15:12:01.120487+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.120487+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:57:04.326385+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1042,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":213,"num_write":429,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'371","reported_seq":1882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:37.152663+0000","last_change":"2024-03-09T14:26:28.642746+0000","last_active":"2024-03-09T15:11:37.152663+0000","last_peered":"2024-03-09T15:11:37.152663+0000","last_clean":"2024-03-09T15:11:37.152663+0000","last_became_active":"2024-03-09T14:26:28.642452+0000","last_became_peered":"2024-03-09T14:26:28.642452+0000","last_unstale":"2024-03-09T15:11:37.152663+0000","last_undegraded":"2024-03-09T15:11:37.152663+0000","last_fullsized":"2024-03-09T15:11:37.152663+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2046,"num_read_kb":1963,"num_write":419,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'183","reported_seq":810,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.086406+0000","last_change":"2024-03-09T15:11:55.086406+0000","last_active":"2024-03-09T15:11:55.086406+0000","last_peered":"2024-03-09T15:11:55.086406+0000","last_clean":"2024-03-09T15:11:55.086406+0000","last_became_active":"2024-03-09T14:27:03.724521+0000","last_became_peered":"2024-03-09T14:27:03.724521+0000","last_unstale":"2024-03-09T15:11:55.086406+0000","last_undegraded":"2024-03-09T15:11:55.086406+0000","last_fullsized":"2024-03-09T15:11:55.086406+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'183","last_scrub_stamp":"2024-03-09T15:11:55.086218+0000","last_deep_scrub":"264'183","last_deep_scrub_stamp":"2024-03-09T15:11:55.086218+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.086218+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:33:58.839877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1070276,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":327,"num_read_kb":39345,"num_write":965,"num_write_kb":40541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.210053+0000","last_change":"2024-03-09T15:12:01.210053+0000","last_active":"2024-03-09T15:12:01.210053+0000","last_peered":"2024-03-09T15:12:01.210053+0000","last_clean":"2024-03-09T15:12:01.210053+0000","last_became_active":"2024-03-09T14:26:30.652243+0000","last_became_peered":"2024-03-09T14:26:30.652243+0000","last_unstale":"2024-03-09T15:12:01.210053+0000","last_undegraded":"2024-03-09T15:12:01.210053+0000","last_fullsized":"2024-03-09T15:12:01.210053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:01.209942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:01.209942+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.209942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:41:59.901072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'153","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.983215+0000","last_change":"2024-03-09T14:26:32.658910+0000","last_active":"2024-03-09T15:11:45.983215+0000","last_peered":"2024-03-09T15:11:45.983215+0000","last_clean":"2024-03-09T15:11:45.983215+0000","last_became_active":"2024-03-09T14:26:32.658626+0000","last_became_peered":"2024-03-09T14:26:32.658626+0000","last_unstale":"2024-03-09T15:11:45.983215+0000","last_undegraded":"2024-03-09T15:11:45.983215+0000","last_fullsized":"2024-03-09T15:11:45.983215+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13483,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":225,"num_read_kb":299,"num_write":146,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.815818+0000","last_change":"2024-03-09T15:12:13.815853+0000","last_active":"2024-03-09T15:12:13.815818+0000","last_peered":"2024-03-09T15:12:13.815818+0000","last_clean":"2024-03-09T15:12:13.815818+0000","last_became_active":"2024-03-09T14:26:34.669482+0000","last_became_peered":"2024-03-09T14:26:34.669482+0000","last_unstale":"2024-03-09T15:12:13.815818+0000","last_undegraded":"2024-03-09T15:12:13.815818+0000","last_fullsized":"2024-03-09T15:12:13.815818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:13.815678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:13.815678+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.815678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:22:00.615697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'226","reported_seq":1418,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.347668+0000","last_change":"2024-03-09T15:12:22.347714+0000","last_active":"2024-03-09T15:12:22.347668+0000","last_peered":"2024-03-09T15:12:22.347668+0000","last_clean":"2024-03-09T15:12:22.347668+0000","last_became_active":"2024-03-09T14:26:36.678232+0000","last_became_peered":"2024-03-09T14:26:36.678232+0000","last_unstale":"2024-03-09T15:12:22.347668+0000","last_undegraded":"2024-03-09T15:12:22.347668+0000","last_fullsized":"2024-03-09T15:12:22.347668+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'226","last_scrub_stamp":"2024-03-09T15:12:22.347577+0000","last_deep_scrub":"264'226","last_deep_scrub_stamp":"2024-03-09T15:12:22.347577+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.347577+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:55:38.476236+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":941,"num_read_kb":939,"num_write":605,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'431","reported_seq":1936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.060010+0000","last_change":"2024-03-09T15:12:22.060038+0000","last_active":"2024-03-09T15:12:22.060010+0000","last_peered":"2024-03-09T15:12:22.060010+0000","last_clean":"2024-03-09T15:12:22.060010+0000","last_became_active":"2024-03-09T14:26:28.657488+0000","last_became_peered":"2024-03-09T14:26:28.657488+0000","last_unstale":"2024-03-09T15:12:22.060010+0000","last_undegraded":"2024-03-09T15:12:22.060010+0000","last_fullsized":"2024-03-09T15:12:22.060010+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'431","last_scrub_stamp":"2024-03-09T15:12:22.059927+0000","last_deep_scrub":"264'431","last_deep_scrub_stamp":"2024-03-09T15:12:22.059927+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.059927+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:19:43.405036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2287,"num_read_kb":2137,"num_write":511,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'198","reported_seq":813,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:24.873320+0000","last_change":"2024-03-09T15:12:24.873363+0000","last_active":"2024-03-09T15:12:24.873320+0000","last_peered":"2024-03-09T15:12:24.873320+0000","last_clean":"2024-03-09T15:12:24.873320+0000","last_became_active":"2024-03-09T14:26:26.641003+0000","last_became_peered":"2024-03-09T14:26:26.641003+0000","last_unstale":"2024-03-09T15:12:24.873320+0000","last_undegraded":"2024-03-09T15:12:24.873320+0000","last_fullsized":"2024-03-09T15:12:24.873320+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'198","last_scrub_stamp":"2024-03-09T15:12:24.873229+0000","last_deep_scrub":"264'198","last_deep_scrub_stamp":"2024-03-09T15:12:24.873229+0000","last_clean_scrub_stamp":"2024-03-09T15:12:24.873229+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:28:18.495512+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":32756,"num_write":1157,"num_write_kb":45988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.970264+0000","last_change":"2024-03-09T15:12:21.970296+0000","last_active":"2024-03-09T15:12:21.970264+0000","last_peered":"2024-03-09T15:12:21.970264+0000","last_clean":"2024-03-09T15:12:21.970264+0000","last_became_active":"2024-03-09T14:26:30.653249+0000","last_became_peered":"2024-03-09T14:26:30.653249+0000","last_unstale":"2024-03-09T15:12:21.970264+0000","last_undegraded":"2024-03-09T15:12:21.970264+0000","last_fullsized":"2024-03-09T15:12:21.970264+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:21.970156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:21.970156+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.970156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:39:54.152238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'132","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.127920+0000","last_change":"2024-03-09T15:12:15.127920+0000","last_active":"2024-03-09T15:12:15.127920+0000","last_peered":"2024-03-09T15:12:15.127920+0000","last_clean":"2024-03-09T15:12:15.127920+0000","last_became_active":"2024-03-09T14:26:32.868236+0000","last_became_peered":"2024-03-09T14:26:32.868236+0000","last_unstale":"2024-03-09T15:12:15.127920+0000","last_undegraded":"2024-03-09T15:12:15.127920+0000","last_fullsized":"2024-03-09T15:12:15.127920+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'132","last_scrub_stamp":"2024-03-09T15:12:15.127769+0000","last_deep_scrub":"264'132","last_deep_scrub_stamp":"2024-03-09T15:12:15.127769+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.127769+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:18:46.490112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7847,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":246,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.795017+0000","last_change":"2024-03-09T15:12:15.795042+0000","last_active":"2024-03-09T15:12:15.795017+0000","last_peered":"2024-03-09T15:12:15.795017+0000","last_clean":"2024-03-09T15:12:15.795017+0000","last_became_active":"2024-03-09T14:26:34.675120+0000","last_became_peered":"2024-03-09T14:26:34.675120+0000","last_unstale":"2024-03-09T15:12:15.795017+0000","last_undegraded":"2024-03-09T15:12:15.795017+0000","last_fullsized":"2024-03-09T15:12:15.795017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:15.794923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:15.794923+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.794923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:03:59.218151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'107","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.317205+0000","last_change":"2024-03-09T15:11:54.317247+0000","last_active":"2024-03-09T15:11:54.317205+0000","last_peered":"2024-03-09T15:11:54.317205+0000","last_clean":"2024-03-09T15:11:54.317205+0000","last_became_active":"2024-03-09T14:26:36.678521+0000","last_became_peered":"2024-03-09T14:26:36.678521+0000","last_unstale":"2024-03-09T15:11:54.317205+0000","last_undegraded":"2024-03-09T15:11:54.317205+0000","last_fullsized":"2024-03-09T15:11:54.317205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-03-09T15:11:54.317104+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-03-09T15:11:54.317104+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.317104+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:54:32.730793+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":103,"num_write":248,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'328","reported_seq":1752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.987370+0000","last_change":"2024-03-09T15:12:12.987395+0000","last_active":"2024-03-09T15:12:12.987370+0000","last_peered":"2024-03-09T15:12:12.987370+0000","last_clean":"2024-03-09T15:12:12.987370+0000","last_became_active":"2024-03-09T14:26:28.648204+0000","last_became_peered":"2024-03-09T14:26:28.648204+0000","last_unstale":"2024-03-09T15:12:12.987370+0000","last_undegraded":"2024-03-09T15:12:12.987370+0000","last_fullsized":"2024-03-09T15:12:12.987370+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'328","last_scrub_stamp":"2024-03-09T15:12:12.987287+0000","last_deep_scrub":"264'328","last_deep_scrub_stamp":"2024-03-09T15:12:12.987287+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.987287+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:29:10.004907+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1841,"num_read_kb":1771,"num_write":371,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'202","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.395271+0000","last_change":"2024-03-09T15:11:58.395346+0000","last_active":"2024-03-09T15:11:58.395271+0000","last_peered":"2024-03-09T15:11:58.395271+0000","last_clean":"2024-03-09T15:11:58.395271+0000","last_became_active":"2024-03-09T14:27:03.719292+0000","last_became_peered":"2024-03-09T14:27:03.719292+0000","last_unstale":"2024-03-09T15:11:58.395271+0000","last_undegraded":"2024-03-09T15:11:58.395271+0000","last_fullsized":"2024-03-09T15:11:58.395271+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'202","last_scrub_stamp":"2024-03-09T15:11:58.395179+0000","last_deep_scrub":"264'202","last_deep_scrub_stamp":"2024-03-09T15:11:58.395179+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.395179+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:08.784732+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778707,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":941,"num_read_kb":86830,"num_write":1019,"num_write_kb":33052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.975665+0000","last_change":"2024-03-09T15:12:01.975725+0000","last_active":"2024-03-09T15:12:01.975665+0000","last_peered":"2024-03-09T15:12:01.975665+0000","last_clean":"2024-03-09T15:12:01.975665+0000","last_became_active":"2024-03-09T14:26:30.652190+0000","last_became_peered":"2024-03-09T14:26:30.652190+0000","last_unstale":"2024-03-09T15:12:01.975665+0000","last_undegraded":"2024-03-09T15:12:01.975665+0000","last_fullsized":"2024-03-09T15:12:01.975665+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:01.975568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:01.975568+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.975568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:24.946938+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'89","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.145304+0000","last_change":"2024-03-09T15:12:03.145341+0000","last_active":"2024-03-09T15:12:03.145304+0000","last_peered":"2024-03-09T15:12:03.145304+0000","last_clean":"2024-03-09T15:12:03.145304+0000","last_became_active":"2024-03-09T14:26:32.867985+0000","last_became_peered":"2024-03-09T14:26:32.867985+0000","last_unstale":"2024-03-09T15:12:03.145304+0000","last_undegraded":"2024-03-09T15:12:03.145304+0000","last_fullsized":"2024-03-09T15:12:03.145304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'89","last_scrub_stamp":"2024-03-09T15:12:03.145219+0000","last_deep_scrub":"264'89","last_deep_scrub_stamp":"2024-03-09T15:12:03.145219+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.145219+0000","objects_scrubbed":7,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:52:51.643446+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":100,"num_read_kb":95,"num_write":100,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11222,"num_omap_keys":30,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'535","reported_seq":2055,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.242069+0000","last_change":"2024-03-09T15:11:58.242069+0000","last_active":"2024-03-09T15:11:58.242069+0000","last_peered":"2024-03-09T15:11:58.242069+0000","last_clean":"2024-03-09T15:11:58.242069+0000","last_became_active":"2024-03-09T14:26:34.664708+0000","last_became_peered":"2024-03-09T14:26:34.664708+0000","last_unstale":"2024-03-09T15:11:58.242069+0000","last_undegraded":"2024-03-09T15:11:58.242069+0000","last_fullsized":"2024-03-09T15:11:58.242069+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'535","last_scrub_stamp":"2024-03-09T15:11:58.241917+0000","last_deep_scrub":"264'535","last_deep_scrub_stamp":"2024-03-09T15:11:58.241917+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.241917+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:14.531917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'142","reported_seq":663,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.978957+0000","last_change":"2024-03-09T15:12:10.978984+0000","last_active":"2024-03-09T15:12:10.978957+0000","last_peered":"2024-03-09T15:12:10.978957+0000","last_clean":"2024-03-09T15:12:10.978957+0000","last_became_active":"2024-03-09T14:26:36.675855+0000","last_became_peered":"2024-03-09T14:26:36.675855+0000","last_unstale":"2024-03-09T15:12:10.978957+0000","last_undegraded":"2024-03-09T15:12:10.978957+0000","last_fullsized":"2024-03-09T15:12:10.978957+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-03-09T15:12:10.978858+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-03-09T15:12:10.978858+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.978858+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:12.611273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":194,"num_write":349,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'799","reported_seq":2340,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.129181+0000","last_change":"2024-03-09T15:12:12.129238+0000","last_active":"2024-03-09T15:12:12.129181+0000","last_peered":"2024-03-09T15:12:12.129181+0000","last_clean":"2024-03-09T15:12:12.129181+0000","last_became_active":"2024-03-09T14:26:28.656940+0000","last_became_peered":"2024-03-09T14:26:28.656940+0000","last_unstale":"2024-03-09T15:12:12.129181+0000","last_undegraded":"2024-03-09T15:12:12.129181+0000","last_fullsized":"2024-03-09T15:12:12.129181+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'799","last_scrub_stamp":"2024-03-09T15:12:12.129068+0000","last_deep_scrub":"264'799","last_deep_scrub_stamp":"2024-03-09T15:12:12.129068+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.129068+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:38:23.851932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3613,"num_read_kb":3222,"num_write":1070,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":218,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'213","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.962305+0000","last_change":"2024-03-09T14:26:26.641435+0000","last_active":"2024-03-09T15:11:45.962305+0000","last_peered":"2024-03-09T15:11:45.962305+0000","last_clean":"2024-03-09T15:11:45.962305+0000","last_became_active":"2024-03-09T14:26:26.641031+0000","last_became_peered":"2024-03-09T14:26:26.641031+0000","last_unstale":"2024-03-09T15:11:45.962305+0000","last_undegraded":"2024-03-09T15:11:45.962305+0000","last_fullsized":"2024-03-09T15:11:45.962305+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651867,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":2692,"num_write":1154,"num_write_kb":40768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.757810+0000","last_change":"2024-03-09T15:12:22.757831+0000","last_active":"2024-03-09T15:12:22.757810+0000","last_peered":"2024-03-09T15:12:22.757810+0000","last_clean":"2024-03-09T15:12:22.757810+0000","last_became_active":"2024-03-09T14:26:30.652315+0000","last_became_peered":"2024-03-09T14:26:30.652315+0000","last_unstale":"2024-03-09T15:12:22.757810+0000","last_undegraded":"2024-03-09T15:12:22.757810+0000","last_fullsized":"2024-03-09T15:12:22.757810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:22.757722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:22.757722+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.757722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:15:37.062804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'177","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.479397+0000","last_change":"2024-03-09T15:12:08.479448+0000","last_active":"2024-03-09T15:12:08.479397+0000","last_peered":"2024-03-09T15:12:08.479397+0000","last_clean":"2024-03-09T15:12:08.479397+0000","last_became_active":"2024-03-09T14:26:32.656973+0000","last_became_peered":"2024-03-09T14:26:32.656973+0000","last_unstale":"2024-03-09T15:12:08.479397+0000","last_undegraded":"2024-03-09T15:12:08.479397+0000","last_fullsized":"2024-03-09T15:12:08.479397+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-03-09T15:12:08.479303+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-03-09T15:12:08.479303+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.479303+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:14.649439+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9391,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":206,"num_read_kb":261,"num_write":118,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.577094+0000","last_change":"2024-03-09T15:12:16.577119+0000","last_active":"2024-03-09T15:12:16.577094+0000","last_peered":"2024-03-09T15:12:16.577094+0000","last_clean":"2024-03-09T15:12:16.577094+0000","last_became_active":"2024-03-09T14:26:34.665208+0000","last_became_peered":"2024-03-09T14:26:34.665208+0000","last_unstale":"2024-03-09T15:12:16.577094+0000","last_undegraded":"2024-03-09T15:12:16.577094+0000","last_fullsized":"2024-03-09T15:12:16.577094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:16.576996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:16.576996+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.576996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:23.226310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'130","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.015033+0000","last_change":"2024-03-09T15:12:10.015061+0000","last_active":"2024-03-09T15:12:10.015033+0000","last_peered":"2024-03-09T15:12:10.015033+0000","last_clean":"2024-03-09T15:12:10.015033+0000","last_became_active":"2024-03-09T14:26:36.677867+0000","last_became_peered":"2024-03-09T14:26:36.677867+0000","last_unstale":"2024-03-09T15:12:10.015033+0000","last_undegraded":"2024-03-09T15:12:10.015033+0000","last_fullsized":"2024-03-09T15:12:10.015033+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-03-09T15:12:10.014948+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-03-09T15:12:10.014948+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.014948+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:41:45.538478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":311,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'826","reported_seq":2509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.082915+0000","last_change":"2024-03-09T15:12:10.082953+0000","last_active":"2024-03-09T15:12:10.082915+0000","last_peered":"2024-03-09T15:12:10.082915+0000","last_clean":"2024-03-09T15:12:10.082915+0000","last_became_active":"2024-03-09T14:26:28.656960+0000","last_became_peered":"2024-03-09T14:26:28.656960+0000","last_unstale":"2024-03-09T15:12:10.082915+0000","last_undegraded":"2024-03-09T15:12:10.082915+0000","last_fullsized":"2024-03-09T15:12:10.082915+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'826","last_scrub_stamp":"2024-03-09T15:12:10.082835+0000","last_deep_scrub":"264'826","last_deep_scrub_stamp":"2024-03-09T15:12:10.082835+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.082835+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:10:39.844814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4034,"num_read_kb":3617,"num_write":1125,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3995,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'217","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.379999+0000","last_change":"2024-03-09T15:12:18.380049+0000","last_active":"2024-03-09T15:12:18.379999+0000","last_peered":"2024-03-09T15:12:18.379999+0000","last_clean":"2024-03-09T15:12:18.379999+0000","last_became_active":"2024-03-09T14:26:26.649772+0000","last_became_peered":"2024-03-09T14:26:26.649772+0000","last_unstale":"2024-03-09T15:12:18.379999+0000","last_undegraded":"2024-03-09T15:12:18.379999+0000","last_fullsized":"2024-03-09T15:12:18.379999+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'217","last_scrub_stamp":"2024-03-09T15:12:18.379901+0000","last_deep_scrub":"264'217","last_deep_scrub_stamp":"2024-03-09T15:12:18.379901+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.379901+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:21:18.313370+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":404,"num_read_kb":32014,"num_write":1026,"num_write_kb":48046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.388029+0000","last_change":"2024-03-09T15:12:17.388054+0000","last_active":"2024-03-09T15:12:17.388029+0000","last_peered":"2024-03-09T15:12:17.388029+0000","last_clean":"2024-03-09T15:12:17.388029+0000","last_became_active":"2024-03-09T14:26:30.650674+0000","last_became_peered":"2024-03-09T14:26:30.650674+0000","last_unstale":"2024-03-09T15:12:17.388029+0000","last_undegraded":"2024-03-09T15:12:17.388029+0000","last_fullsized":"2024-03-09T15:12:17.388029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:17.387942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:17.387942+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.387942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:28.222149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'129","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.905586+0000","last_change":"2024-03-09T14:26:32.653856+0000","last_active":"2024-03-09T15:11:45.905586+0000","last_peered":"2024-03-09T15:11:45.905586+0000","last_clean":"2024-03-09T15:11:45.905586+0000","last_became_active":"2024-03-09T14:26:32.652397+0000","last_became_peered":"2024-03-09T14:26:32.652397+0000","last_unstale":"2024-03-09T15:11:45.905586+0000","last_undegraded":"2024-03-09T15:11:45.905586+0000","last_fullsized":"2024-03-09T15:11:45.905586+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:31.636497+0000","last_clean_scrub_stamp":"2024-03-09T14:26:31.636497+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14802,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":258,"num_write":88,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.230076+0000","last_change":"2024-03-09T15:12:06.230103+0000","last_active":"2024-03-09T15:12:06.230076+0000","last_peered":"2024-03-09T15:12:06.230076+0000","last_clean":"2024-03-09T15:12:06.230076+0000","last_became_active":"2024-03-09T14:26:34.671029+0000","last_became_peered":"2024-03-09T14:26:34.671029+0000","last_unstale":"2024-03-09T15:12:06.230076+0000","last_undegraded":"2024-03-09T15:12:06.230076+0000","last_fullsized":"2024-03-09T15:12:06.230076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:06.229979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:06.229979+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.229979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:24:48.116811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'114","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.126469+0000","last_change":"2024-03-09T15:12:00.126469+0000","last_active":"2024-03-09T15:12:00.126469+0000","last_peered":"2024-03-09T15:12:00.126469+0000","last_clean":"2024-03-09T15:12:00.126469+0000","last_became_active":"2024-03-09T14:26:36.786449+0000","last_became_peered":"2024-03-09T14:26:36.786449+0000","last_unstale":"2024-03-09T15:12:00.126469+0000","last_undegraded":"2024-03-09T15:12:00.126469+0000","last_fullsized":"2024-03-09T15:12:00.126469+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-03-09T15:12:00.126288+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-03-09T15:12:00.126288+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.126288+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:22.457832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":178,"num_write":287,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'518","reported_seq":2100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:10:35.356877+0000","last_change":"2024-03-09T14:26:28.649113+0000","last_active":"2024-03-09T15:10:35.356877+0000","last_peered":"2024-03-09T15:10:35.356877+0000","last_clean":"2024-03-09T15:10:35.356877+0000","last_became_active":"2024-03-09T14:26:28.647178+0000","last_became_peered":"2024-03-09T14:26:28.647178+0000","last_unstale":"2024-03-09T15:10:35.356877+0000","last_undegraded":"2024-03-09T15:10:35.356877+0000","last_fullsized":"2024-03-09T15:10:35.356877+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:27.614935+0000","last_clean_scrub_stamp":"2024-03-09T14:26:27.614935+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2831,"num_read_kb":2584,"num_write":686,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'273","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.978422+0000","last_change":"2024-03-09T14:26:26.643743+0000","last_active":"2024-03-09T15:11:45.978422+0000","last_peered":"2024-03-09T15:11:45.978422+0000","last_clean":"2024-03-09T15:11:45.978422+0000","last_became_active":"2024-03-09T14:26:26.643338+0000","last_became_peered":"2024-03-09T14:26:26.643338+0000","last_unstale":"2024-03-09T15:11:45.978422+0000","last_undegraded":"2024-03-09T15:11:45.978422+0000","last_fullsized":"2024-03-09T15:11:45.978422+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":43219,"num_write":1342,"num_write_kb":45633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.086304+0000","last_change":"2024-03-09T15:12:16.086304+0000","last_active":"2024-03-09T15:12:16.086304+0000","last_peered":"2024-03-09T15:12:16.086304+0000","last_clean":"2024-03-09T15:12:16.086304+0000","last_became_active":"2024-03-09T14:26:30.647466+0000","last_became_peered":"2024-03-09T14:26:30.647466+0000","last_unstale":"2024-03-09T15:12:16.086304+0000","last_undegraded":"2024-03-09T15:12:16.086304+0000","last_fullsized":"2024-03-09T15:12:16.086304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:16.086148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:16.086148+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.086148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:35.773363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'108","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.118774+0000","last_change":"2024-03-09T15:12:19.118806+0000","last_active":"2024-03-09T15:12:19.118774+0000","last_peered":"2024-03-09T15:12:19.118774+0000","last_clean":"2024-03-09T15:12:19.118774+0000","last_became_active":"2024-03-09T14:26:32.654096+0000","last_became_peered":"2024-03-09T14:26:32.654096+0000","last_unstale":"2024-03-09T15:12:19.118774+0000","last_undegraded":"2024-03-09T15:12:19.118774+0000","last_fullsized":"2024-03-09T15:12:19.118774+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'108","last_scrub_stamp":"2024-03-09T15:12:19.118689+0000","last_deep_scrub":"264'108","last_deep_scrub_stamp":"2024-03-09T15:12:19.118689+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.118689+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:16:59.329569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5925,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":181,"num_write":62,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.101718+0000","last_change":"2024-03-09T15:12:01.101744+0000","last_active":"2024-03-09T15:12:01.101718+0000","last_peered":"2024-03-09T15:12:01.101718+0000","last_clean":"2024-03-09T15:12:01.101718+0000","last_became_active":"2024-03-09T14:26:34.665478+0000","last_became_peered":"2024-03-09T14:26:34.665478+0000","last_unstale":"2024-03-09T15:12:01.101718+0000","last_undegraded":"2024-03-09T15:12:01.101718+0000","last_fullsized":"2024-03-09T15:12:01.101718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:01.101624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:01.101624+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.101624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:26.220172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'121","reported_seq":1787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.015724+0000","last_change":"2024-03-09T15:12:08.015757+0000","last_active":"2024-03-09T15:12:08.015724+0000","last_peered":"2024-03-09T15:12:08.015724+0000","last_clean":"2024-03-09T15:12:08.015724+0000","last_became_active":"2024-03-09T14:26:36.677953+0000","last_became_peered":"2024-03-09T14:26:36.677953+0000","last_unstale":"2024-03-09T15:12:08.015724+0000","last_undegraded":"2024-03-09T15:12:08.015724+0000","last_fullsized":"2024-03-09T15:12:08.015724+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-03-09T15:12:08.015633+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-03-09T15:12:08.015633+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.015633+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:02:55.565743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1291,"num_read_kb":1290,"num_write":257,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'555","reported_seq":2052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:28.927583+0000","last_change":"2024-03-09T15:12:28.927635+0000","last_active":"2024-03-09T15:12:28.927583+0000","last_peered":"2024-03-09T15:12:28.927583+0000","last_clean":"2024-03-09T15:12:28.927583+0000","last_became_active":"2024-03-09T14:26:28.644628+0000","last_became_peered":"2024-03-09T14:26:28.644628+0000","last_unstale":"2024-03-09T15:12:28.927583+0000","last_undegraded":"2024-03-09T15:12:28.927583+0000","last_fullsized":"2024-03-09T15:12:28.927583+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'555","last_scrub_stamp":"2024-03-09T15:12:28.927461+0000","last_deep_scrub":"264'555","last_deep_scrub_stamp":"2024-03-09T15:12:28.927461+0000","last_clean_scrub_stamp":"2024-03-09T15:12:28.927461+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:11.779163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2742,"num_read_kb":2524,"num_write":748,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'204","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.017459+0000","last_change":"2024-03-09T14:26:26.637200+0000","last_active":"2024-03-09T15:11:49.017459+0000","last_peered":"2024-03-09T15:11:49.017459+0000","last_clean":"2024-03-09T15:11:49.017459+0000","last_became_active":"2024-03-09T14:26:26.636600+0000","last_became_peered":"2024-03-09T14:26:26.636600+0000","last_unstale":"2024-03-09T15:11:49.017459+0000","last_undegraded":"2024-03-09T15:11:49.017459+0000","last_fullsized":"2024-03-09T15:11:49.017459+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":15859,"num_write":1037,"num_write_kb":26682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.934512+0000","last_change":"2024-03-09T15:12:02.934542+0000","last_active":"2024-03-09T15:12:02.934512+0000","last_peered":"2024-03-09T15:12:02.934512+0000","last_clean":"2024-03-09T15:12:02.934512+0000","last_became_active":"2024-03-09T14:26:30.650852+0000","last_became_peered":"2024-03-09T14:26:30.650852+0000","last_unstale":"2024-03-09T15:12:02.934512+0000","last_undegraded":"2024-03-09T15:12:02.934512+0000","last_fullsized":"2024-03-09T15:12:02.934512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:02.934422+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:02.934422+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.934422+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:48.652578+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'155","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.026213+0000","last_change":"2024-03-09T15:12:07.026256+0000","last_active":"2024-03-09T15:12:07.026213+0000","last_peered":"2024-03-09T15:12:07.026213+0000","last_clean":"2024-03-09T15:12:07.026213+0000","last_became_active":"2024-03-09T14:26:32.655220+0000","last_became_peered":"2024-03-09T14:26:32.655220+0000","last_unstale":"2024-03-09T15:12:07.026213+0000","last_undegraded":"2024-03-09T15:12:07.026213+0000","last_fullsized":"2024-03-09T15:12:07.026213+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'155","last_scrub_stamp":"2024-03-09T15:12:07.026079+0000","last_deep_scrub":"264'155","last_deep_scrub_stamp":"2024-03-09T15:12:07.026079+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.026079+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:36:29.946374+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6421,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":225,"num_write":106,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.496780+0000","last_change":"2024-03-09T15:12:09.496803+0000","last_active":"2024-03-09T15:12:09.496780+0000","last_peered":"2024-03-09T15:12:09.496780+0000","last_clean":"2024-03-09T15:12:09.496780+0000","last_became_active":"2024-03-09T14:26:34.673572+0000","last_became_peered":"2024-03-09T14:26:34.673572+0000","last_unstale":"2024-03-09T15:12:09.496780+0000","last_undegraded":"2024-03-09T15:12:09.496780+0000","last_fullsized":"2024-03-09T15:12:09.496780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:09.496689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:09.496689+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.496689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:32:35.139394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'131","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.183377+0000","last_change":"2024-03-09T15:11:56.183425+0000","last_active":"2024-03-09T15:11:56.183377+0000","last_peered":"2024-03-09T15:11:56.183377+0000","last_clean":"2024-03-09T15:11:56.183377+0000","last_became_active":"2024-03-09T14:26:36.668616+0000","last_became_peered":"2024-03-09T14:26:36.668616+0000","last_unstale":"2024-03-09T15:11:56.183377+0000","last_undegraded":"2024-03-09T15:11:56.183377+0000","last_fullsized":"2024-03-09T15:11:56.183377+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-03-09T15:11:56.183293+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-03-09T15:11:56.183293+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.183293+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:50:57.423599+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":154,"num_write":316,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'647","reported_seq":2244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:24.751258+0000","last_change":"2024-03-09T15:12:24.751312+0000","last_active":"2024-03-09T15:12:24.751258+0000","last_peered":"2024-03-09T15:12:24.751258+0000","last_clean":"2024-03-09T15:12:24.751258+0000","last_became_active":"2024-03-09T14:26:28.645626+0000","last_became_peered":"2024-03-09T14:26:28.645626+0000","last_unstale":"2024-03-09T15:12:24.751258+0000","last_undegraded":"2024-03-09T15:12:24.751258+0000","last_fullsized":"2024-03-09T15:12:24.751258+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'647","last_scrub_stamp":"2024-03-09T15:12:24.751141+0000","last_deep_scrub":"264'647","last_deep_scrub_stamp":"2024-03-09T15:12:24.751141+0000","last_clean_scrub_stamp":"2024-03-09T15:12:24.751141+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":600,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:04.226375+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3206,"num_read_kb":2874,"num_write":967,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'167","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.331036+0000","last_change":"2024-03-09T15:12:21.331157+0000","last_active":"2024-03-09T15:12:21.331036+0000","last_peered":"2024-03-09T15:12:21.331036+0000","last_clean":"2024-03-09T15:12:21.331036+0000","last_became_active":"2024-03-09T14:26:26.652050+0000","last_became_peered":"2024-03-09T14:26:26.652050+0000","last_unstale":"2024-03-09T15:12:21.331036+0000","last_undegraded":"2024-03-09T15:12:21.331036+0000","last_fullsized":"2024-03-09T15:12:21.331036+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'167","last_scrub_stamp":"2024-03-09T15:12:21.330911+0000","last_deep_scrub":"264'167","last_deep_scrub_stamp":"2024-03-09T15:12:21.330911+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.330911+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:30:18.179176+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3634858,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":329,"num_read_kb":46066,"num_write":939,"num_write_kb":31825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'425","reported_seq":2040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.892877+0000","last_change":"2024-03-09T15:12:10.892932+0000","last_active":"2024-03-09T15:12:10.892877+0000","last_peered":"2024-03-09T15:12:10.892877+0000","last_clean":"2024-03-09T15:12:10.892877+0000","last_became_active":"2024-03-09T14:26:28.652474+0000","last_became_peered":"2024-03-09T14:26:28.652474+0000","last_unstale":"2024-03-09T15:12:10.892877+0000","last_undegraded":"2024-03-09T15:12:10.892877+0000","last_fullsized":"2024-03-09T15:12:10.892877+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'425","last_scrub_stamp":"2024-03-09T15:12:10.892757+0000","last_deep_scrub":"264'425","last_deep_scrub_stamp":"2024-03-09T15:12:10.892757+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.892757+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:33:57.027615+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2338,"num_read_kb":2225,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'237","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.945222+0000","last_change":"2024-03-09T15:12:08.945222+0000","last_active":"2024-03-09T15:12:08.945222+0000","last_peered":"2024-03-09T15:12:08.945222+0000","last_clean":"2024-03-09T15:12:08.945222+0000","last_became_active":"2024-03-09T14:26:26.635943+0000","last_became_peered":"2024-03-09T14:26:26.635943+0000","last_unstale":"2024-03-09T15:12:08.945222+0000","last_undegraded":"2024-03-09T15:12:08.945222+0000","last_fullsized":"2024-03-09T15:12:08.945222+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'237","last_scrub_stamp":"2024-03-09T15:12:08.945063+0000","last_deep_scrub":"264'237","last_deep_scrub_stamp":"2024-03-09T15:12:08.945063+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.945063+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:24:10.736508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048641,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":547,"num_read_kb":21035,"num_write":1141,"num_write_kb":21105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'405","reported_seq":1839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.442214+0000","last_change":"2024-03-09T15:12:09.442252+0000","last_active":"2024-03-09T15:12:09.442214+0000","last_peered":"2024-03-09T15:12:09.442214+0000","last_clean":"2024-03-09T15:12:09.442214+0000","last_became_active":"2024-03-09T14:26:28.645917+0000","last_became_peered":"2024-03-09T14:26:28.645917+0000","last_unstale":"2024-03-09T15:12:09.442214+0000","last_undegraded":"2024-03-09T15:12:09.442214+0000","last_fullsized":"2024-03-09T15:12:09.442214+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-03-09T15:12:09.442112+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-03-09T15:12:09.442112+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.442112+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:41.180221+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2143,"num_read_kb":1999,"num_write":476,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'197","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:24.368705+0000","last_change":"2024-03-09T15:12:24.368744+0000","last_active":"2024-03-09T15:12:24.368705+0000","last_peered":"2024-03-09T15:12:24.368705+0000","last_clean":"2024-03-09T15:12:24.368705+0000","last_became_active":"2024-03-09T14:26:26.648084+0000","last_became_peered":"2024-03-09T14:26:26.648084+0000","last_unstale":"2024-03-09T15:12:24.368705+0000","last_undegraded":"2024-03-09T15:12:24.368705+0000","last_fullsized":"2024-03-09T15:12:24.368705+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'197","last_scrub_stamp":"2024-03-09T15:12:24.368619+0000","last_deep_scrub":"264'197","last_deep_scrub_stamp":"2024-03-09T15:12:24.368619+0000","last_clean_scrub_stamp":"2024-03-09T15:12:24.368619+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:25:32.713305+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097599,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":455,"num_read_kb":30660,"num_write":1035,"num_write_kb":42042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'1285","reported_seq":2888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.829514+0000","last_change":"2024-03-09T15:12:14.829561+0000","last_active":"2024-03-09T15:12:14.829514+0000","last_peered":"2024-03-09T15:12:14.829514+0000","last_clean":"2024-03-09T15:12:14.829514+0000","last_became_active":"2024-03-09T14:26:28.646936+0000","last_became_peered":"2024-03-09T14:26:28.646936+0000","last_unstale":"2024-03-09T15:12:14.829514+0000","last_undegraded":"2024-03-09T15:12:14.829514+0000","last_fullsized":"2024-03-09T15:12:14.829514+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1285","last_scrub_stamp":"2024-03-09T15:12:14.829417+0000","last_deep_scrub":"264'1285","last_deep_scrub_stamp":"2024-03-09T15:12:14.829417+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.829417+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:56:53.839431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5472,"num_read_kb":4757,"num_write":1845,"num_write_kb":841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'173","reported_seq":800,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.017451+0000","last_change":"2024-03-09T14:26:26.632719+0000","last_active":"2024-03-09T15:11:49.017451+0000","last_peered":"2024-03-09T15:11:49.017451+0000","last_clean":"2024-03-09T15:11:49.017451+0000","last_became_active":"2024-03-09T14:26:26.632394+0000","last_became_peered":"2024-03-09T14:26:26.632394+0000","last_unstale":"2024-03-09T15:11:49.017451+0000","last_undegraded":"2024-03-09T15:11:49.017451+0000","last_fullsized":"2024-03-09T15:11:49.017451+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194317,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":61859,"num_write":999,"num_write_kb":24366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'712","reported_seq":2168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.024404+0000","last_change":"2024-03-09T15:12:23.024404+0000","last_active":"2024-03-09T15:12:23.024404+0000","last_peered":"2024-03-09T15:12:23.024404+0000","last_clean":"2024-03-09T15:12:23.024404+0000","last_became_active":"2024-03-09T14:26:28.655549+0000","last_became_peered":"2024-03-09T14:26:28.655549+0000","last_unstale":"2024-03-09T15:12:23.024404+0000","last_undegraded":"2024-03-09T15:12:23.024404+0000","last_fullsized":"2024-03-09T15:12:23.024404+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'712","last_scrub_stamp":"2024-03-09T15:12:23.024273+0000","last_deep_scrub":"264'712","last_deep_scrub_stamp":"2024-03-09T15:12:23.024273+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.024273+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":700,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:49.883280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3228,"num_read_kb":2913,"num_write":936,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'248","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395073+0000","last_change":"2024-03-09T14:26:26.641172+0000","last_active":"2024-03-09T15:11:50.395073+0000","last_peered":"2024-03-09T15:11:50.395073+0000","last_clean":"2024-03-09T15:11:50.395073+0000","last_became_active":"2024-03-09T14:26:26.640874+0000","last_became_peered":"2024-03-09T14:26:26.640874+0000","last_unstale":"2024-03-09T15:11:50.395073+0000","last_undegraded":"2024-03-09T15:11:50.395073+0000","last_fullsized":"2024-03-09T15:11:50.395073+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4477257,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":552,"num_read_kb":47489,"num_write":1247,"num_write_kb":60004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'343","reported_seq":1785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:27.888529+0000","last_change":"2024-03-09T15:12:27.888559+0000","last_active":"2024-03-09T15:12:27.888529+0000","last_peered":"2024-03-09T15:12:27.888529+0000","last_clean":"2024-03-09T15:12:27.888529+0000","last_became_active":"2024-03-09T14:26:28.645393+0000","last_became_peered":"2024-03-09T14:26:28.645393+0000","last_unstale":"2024-03-09T15:12:27.888529+0000","last_undegraded":"2024-03-09T15:12:27.888529+0000","last_fullsized":"2024-03-09T15:12:27.888529+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-03-09T15:12:27.888445+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-03-09T15:12:27.888445+0000","last_clean_scrub_stamp":"2024-03-09T15:12:27.888445+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:50.226173+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1972,"num_read_kb":1873,"num_write":396,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'185","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.823461+0000","last_change":"2024-03-09T15:12:19.823512+0000","last_active":"2024-03-09T15:12:19.823461+0000","last_peered":"2024-03-09T15:12:19.823461+0000","last_clean":"2024-03-09T15:12:19.823461+0000","last_became_active":"2024-03-09T14:26:26.631046+0000","last_became_peered":"2024-03-09T14:26:26.631046+0000","last_unstale":"2024-03-09T15:12:19.823461+0000","last_undegraded":"2024-03-09T15:12:19.823461+0000","last_fullsized":"2024-03-09T15:12:19.823461+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-03-09T15:12:19.823358+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-03-09T15:12:19.823358+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.823358+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:09:10.746963+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":463,"num_read_kb":18518,"num_write":1084,"num_write_kb":23654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'765","reported_seq":2196,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:31.049711+0000","last_change":"2024-03-09T15:12:31.049738+0000","last_active":"2024-03-09T15:12:31.049711+0000","last_peered":"2024-03-09T15:12:31.049711+0000","last_clean":"2024-03-09T15:12:31.049711+0000","last_became_active":"2024-03-09T14:26:28.651945+0000","last_became_peered":"2024-03-09T14:26:28.651945+0000","last_unstale":"2024-03-09T15:12:31.049711+0000","last_undegraded":"2024-03-09T15:12:31.049711+0000","last_fullsized":"2024-03-09T15:12:31.049711+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'765","last_scrub_stamp":"2024-03-09T15:12:31.049625+0000","last_deep_scrub":"264'765","last_deep_scrub_stamp":"2024-03-09T15:12:31.049625+0000","last_clean_scrub_stamp":"2024-03-09T15:12:31.049625+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:10:46.091772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3422,"num_read_kb":3025,"num_write":1046,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'210","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.279465+0000","last_change":"2024-03-09T15:12:18.279549+0000","last_active":"2024-03-09T15:12:18.279465+0000","last_peered":"2024-03-09T15:12:18.279465+0000","last_clean":"2024-03-09T15:12:18.279465+0000","last_became_active":"2024-03-09T14:26:26.645379+0000","last_became_peered":"2024-03-09T14:26:26.645379+0000","last_unstale":"2024-03-09T15:12:18.279465+0000","last_undegraded":"2024-03-09T15:12:18.279465+0000","last_fullsized":"2024-03-09T15:12:18.279465+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-03-09T15:12:18.279376+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-03-09T15:12:18.279376+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.279376+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:30:17.515463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2265,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":547,"num_read_kb":953,"num_write":1107,"num_write_kb":19452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'1203","reported_seq":2808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.279239+0000","last_change":"2024-03-09T15:12:09.279239+0000","last_active":"2024-03-09T15:12:09.279239+0000","last_peered":"2024-03-09T15:12:09.279239+0000","last_clean":"2024-03-09T15:12:09.279239+0000","last_became_active":"2024-03-09T14:26:28.651254+0000","last_became_peered":"2024-03-09T14:26:28.651254+0000","last_unstale":"2024-03-09T15:12:09.279239+0000","last_undegraded":"2024-03-09T15:12:09.279239+0000","last_fullsized":"2024-03-09T15:12:09.279239+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1203","last_scrub_stamp":"2024-03-09T15:12:09.279118+0000","last_deep_scrub":"264'1203","last_deep_scrub_stamp":"2024-03-09T15:12:09.279118+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.279118+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":1100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:59:28.674500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5174,"num_read_kb":4521,"num_write":1709,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'218","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.395143+0000","last_change":"2024-03-09T14:26:26.640461+0000","last_active":"2024-03-09T15:11:50.395143+0000","last_peered":"2024-03-09T15:11:50.395143+0000","last_clean":"2024-03-09T15:11:50.395143+0000","last_became_active":"2024-03-09T14:26:26.639719+0000","last_became_peered":"2024-03-09T14:26:26.639719+0000","last_unstale":"2024-03-09T15:11:50.395143+0000","last_undegraded":"2024-03-09T15:11:50.395143+0000","last_fullsized":"2024-03-09T15:11:50.395143+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3186960,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":530,"num_read_kb":50172,"num_write":1173,"num_write_kb":33138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1153","reported_seq":2688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:24.518847+0000","last_change":"2024-03-09T15:12:24.518911+0000","last_active":"2024-03-09T15:12:24.518847+0000","last_peered":"2024-03-09T15:12:24.518847+0000","last_clean":"2024-03-09T15:12:24.518847+0000","last_became_active":"2024-03-09T14:26:28.648626+0000","last_became_peered":"2024-03-09T14:26:28.648626+0000","last_unstale":"2024-03-09T15:12:24.518847+0000","last_undegraded":"2024-03-09T15:12:24.518847+0000","last_fullsized":"2024-03-09T15:12:24.518847+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1153","last_scrub_stamp":"2024-03-09T15:12:24.518738+0000","last_deep_scrub":"264'1153","last_deep_scrub_stamp":"2024-03-09T15:12:24.518738+0000","last_clean_scrub_stamp":"2024-03-09T15:12:24.518738+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":1100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:22.311612+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4796,"num_read_kb":4189,"num_write":1590,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'192","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.322376+0000","last_change":"2024-03-09T14:26:26.640526+0000","last_active":"2024-03-09T15:11:51.322376+0000","last_peered":"2024-03-09T15:11:51.322376+0000","last_clean":"2024-03-09T15:11:51.322376+0000","last_became_active":"2024-03-09T14:26:26.640157+0000","last_became_peered":"2024-03-09T14:26:26.640157+0000","last_unstale":"2024-03-09T15:11:51.322376+0000","last_undegraded":"2024-03-09T15:11:51.322376+0000","last_fullsized":"2024-03-09T15:11:51.322376+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":19261,"num_write":1003,"num_write_kb":28212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'709","reported_seq":2144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:20.954155+0000","last_change":"2024-03-09T15:12:20.954213+0000","last_active":"2024-03-09T15:12:20.954155+0000","last_peered":"2024-03-09T15:12:20.954155+0000","last_clean":"2024-03-09T15:12:20.954155+0000","last_became_active":"2024-03-09T14:26:28.650013+0000","last_became_peered":"2024-03-09T14:26:28.650013+0000","last_unstale":"2024-03-09T15:12:20.954155+0000","last_undegraded":"2024-03-09T15:12:20.954155+0000","last_fullsized":"2024-03-09T15:12:20.954155+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'709","last_scrub_stamp":"2024-03-09T15:12:20.954059+0000","last_deep_scrub":"264'709","last_deep_scrub_stamp":"2024-03-09T15:12:20.954059+0000","last_clean_scrub_stamp":"2024-03-09T15:12:20.954059+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:21.095472+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3189,"num_read_kb":2865,"num_write":935,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'212","reported_seq":858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.981234+0000","last_change":"2024-03-09T14:26:26.642035+0000","last_active":"2024-03-09T15:11:45.981234+0000","last_peered":"2024-03-09T15:11:45.981234+0000","last_clean":"2024-03-09T15:11:45.981234+0000","last_became_active":"2024-03-09T14:26:26.641737+0000","last_became_peered":"2024-03-09T14:26:26.641737+0000","last_unstale":"2024-03-09T15:11:45.981234+0000","last_undegraded":"2024-03-09T15:11:45.981234+0000","last_fullsized":"2024-03-09T15:11:45.981234+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262754,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":32584,"num_write":1138,"num_write_kb":28426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'423","reported_seq":2064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.998451+0000","last_change":"2024-03-09T15:12:10.998484+0000","last_active":"2024-03-09T15:12:10.998451+0000","last_peered":"2024-03-09T15:12:10.998451+0000","last_clean":"2024-03-09T15:12:10.998451+0000","last_became_active":"2024-03-09T14:26:28.644094+0000","last_became_peered":"2024-03-09T14:26:28.644094+0000","last_unstale":"2024-03-09T15:12:10.998451+0000","last_undegraded":"2024-03-09T15:12:10.998451+0000","last_fullsized":"2024-03-09T15:12:10.998451+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'423","last_scrub_stamp":"2024-03-09T15:12:10.998361+0000","last_deep_scrub":"264'423","last_deep_scrub_stamp":"2024-03-09T15:12:10.998361+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.998361+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:17:58.522488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2230,"num_write":484,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'212","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.817171+0000","last_change":"2024-03-09T14:26:26.645771+0000","last_active":"2024-03-09T15:11:45.817171+0000","last_peered":"2024-03-09T15:11:45.817171+0000","last_clean":"2024-03-09T15:11:45.817171+0000","last_became_active":"2024-03-09T14:26:26.645413+0000","last_became_peered":"2024-03-09T14:26:26.645413+0000","last_unstale":"2024-03-09T15:11:45.817171+0000","last_undegraded":"2024-03-09T15:11:45.817171+0000","last_fullsized":"2024-03-09T15:11:45.817171+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262161,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":457,"num_read_kb":3495,"num_write":1054,"num_write_kb":12293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'791","reported_seq":2467,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.085605+0000","last_change":"2024-03-09T15:12:13.085634+0000","last_active":"2024-03-09T15:12:13.085605+0000","last_peered":"2024-03-09T15:12:13.085605+0000","last_clean":"2024-03-09T15:12:13.085605+0000","last_became_active":"2024-03-09T14:26:28.650629+0000","last_became_peered":"2024-03-09T14:26:28.650629+0000","last_unstale":"2024-03-09T15:12:13.085605+0000","last_undegraded":"2024-03-09T15:12:13.085605+0000","last_fullsized":"2024-03-09T15:12:13.085605+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'791","last_scrub_stamp":"2024-03-09T15:12:13.085516+0000","last_deep_scrub":"264'791","last_deep_scrub_stamp":"2024-03-09T15:12:13.085516+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.085516+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:44:33.681890+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3842,"num_read_kb":3483,"num_write":1039,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'234","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.977735+0000","last_change":"2024-03-09T14:26:26.644786+0000","last_active":"2024-03-09T15:11:45.977735+0000","last_peered":"2024-03-09T15:11:45.977735+0000","last_clean":"2024-03-09T15:11:45.977735+0000","last_became_active":"2024-03-09T14:26:26.644358+0000","last_became_peered":"2024-03-09T14:26:26.644358+0000","last_unstale":"2024-03-09T15:11:45.977735+0000","last_undegraded":"2024-03-09T15:11:45.977735+0000","last_fullsized":"2024-03-09T15:11:45.977735+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":7434,"num_write":1304,"num_write_kb":33527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'510","reported_seq":2085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.782090+0000","last_change":"2024-03-09T15:12:21.782134+0000","last_active":"2024-03-09T15:12:21.782090+0000","last_peered":"2024-03-09T15:12:21.782090+0000","last_clean":"2024-03-09T15:12:21.782090+0000","last_became_active":"2024-03-09T14:26:28.655438+0000","last_became_peered":"2024-03-09T14:26:28.655438+0000","last_unstale":"2024-03-09T15:12:21.782090+0000","last_undegraded":"2024-03-09T15:12:21.782090+0000","last_fullsized":"2024-03-09T15:12:21.782090+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'510","last_scrub_stamp":"2024-03-09T15:12:21.781992+0000","last_deep_scrub":"264'510","last_deep_scrub_stamp":"2024-03-09T15:12:21.781992+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.781992+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:19:30.411160+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2613,"num_read_kb":2408,"num_write":650,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":303,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'184","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:20.287695+0000","last_change":"2024-03-09T15:12:20.287731+0000","last_active":"2024-03-09T15:12:20.287695+0000","last_peered":"2024-03-09T15:12:20.287695+0000","last_clean":"2024-03-09T15:12:20.287695+0000","last_became_active":"2024-03-09T14:26:26.648682+0000","last_became_peered":"2024-03-09T14:26:26.648682+0000","last_unstale":"2024-03-09T15:12:20.287695+0000","last_undegraded":"2024-03-09T15:12:20.287695+0000","last_fullsized":"2024-03-09T15:12:20.287695+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-03-09T15:12:20.287609+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-03-09T15:12:20.287609+0000","last_clean_scrub_stamp":"2024-03-09T15:12:20.287609+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:15:27.312267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":448,"num_read_kb":6066,"num_write":1003,"num_write_kb":27510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'408","reported_seq":2023,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:26.498667+0000","last_change":"2024-03-09T15:12:26.498695+0000","last_active":"2024-03-09T15:12:26.498667+0000","last_peered":"2024-03-09T15:12:26.498667+0000","last_clean":"2024-03-09T15:12:26.498667+0000","last_became_active":"2024-03-09T14:26:28.646239+0000","last_became_peered":"2024-03-09T14:26:28.646239+0000","last_unstale":"2024-03-09T15:12:26.498667+0000","last_undegraded":"2024-03-09T15:12:26.498667+0000","last_fullsized":"2024-03-09T15:12:26.498667+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'408","last_scrub_stamp":"2024-03-09T15:12:26.498566+0000","last_deep_scrub":"264'408","last_deep_scrub_stamp":"2024-03-09T15:12:26.498566+0000","last_clean_scrub_stamp":"2024-03-09T15:12:26.498566+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:12:03.971664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2327,"num_read_kb":2213,"num_write":484,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'215","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:45.874655+0000","last_change":"2024-03-09T14:26:26.646103+0000","last_active":"2024-03-09T15:11:45.874655+0000","last_peered":"2024-03-09T15:11:45.874655+0000","last_clean":"2024-03-09T15:11:45.874655+0000","last_became_active":"2024-03-09T14:26:26.645230+0000","last_became_peered":"2024-03-09T14:26:26.645230+0000","last_unstale":"2024-03-09T15:11:45.874655+0000","last_undegraded":"2024-03-09T15:11:45.874655+0000","last_fullsized":"2024-03-09T15:11:45.874655+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:26:25.602807+0000","last_clean_scrub_stamp":"2024-03-09T14:26:25.602807+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":27386,"num_write":1086,"num_write_kb":24817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'342","reported_seq":1825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:27.031969+0000","last_change":"2024-03-09T15:12:27.031995+0000","last_active":"2024-03-09T15:12:27.031969+0000","last_peered":"2024-03-09T15:12:27.031969+0000","last_clean":"2024-03-09T15:12:27.031969+0000","last_became_active":"2024-03-09T14:26:28.653177+0000","last_became_peered":"2024-03-09T14:26:28.653177+0000","last_unstale":"2024-03-09T15:12:27.031969+0000","last_undegraded":"2024-03-09T15:12:27.031969+0000","last_fullsized":"2024-03-09T15:12:27.031969+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-03-09T15:12:27.031882+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-03-09T15:12:27.031882+0000","last_clean_scrub_stamp":"2024-03-09T15:12:27.031882+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:59:35.559899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1954,"num_read_kb":1880,"num_write":380,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'196","reported_seq":809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.989551+0000","last_change":"2024-03-09T15:12:09.989595+0000","last_active":"2024-03-09T15:12:09.989551+0000","last_peered":"2024-03-09T15:12:09.989551+0000","last_clean":"2024-03-09T15:12:09.989551+0000","last_became_active":"2024-03-09T14:26:26.637589+0000","last_became_peered":"2024-03-09T14:26:26.637589+0000","last_unstale":"2024-03-09T15:12:09.989551+0000","last_undegraded":"2024-03-09T15:12:09.989551+0000","last_fullsized":"2024-03-09T15:12:09.989551+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-03-09T15:12:09.989450+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-03-09T15:12:09.989450+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.989450+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:20:22.984515+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456529,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":381,"num_read_kb":13354,"num_write":1025,"num_write_kb":55720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'1151","reported_seq":2620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.858491+0000","last_change":"2024-03-09T15:12:19.858518+0000","last_active":"2024-03-09T15:12:19.858491+0000","last_peered":"2024-03-09T15:12:19.858491+0000","last_clean":"2024-03-09T15:12:19.858491+0000","last_became_active":"2024-03-09T14:26:28.655383+0000","last_became_peered":"2024-03-09T14:26:28.655383+0000","last_unstale":"2024-03-09T15:12:19.858491+0000","last_undegraded":"2024-03-09T15:12:19.858491+0000","last_fullsized":"2024-03-09T15:12:19.858491+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1151","last_scrub_stamp":"2024-03-09T15:12:19.858394+0000","last_deep_scrub":"264'1151","last_deep_scrub_stamp":"2024-03-09T15:12:19.858394+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.858394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:15:05.051301+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4791,"num_read_kb":4166,"num_write":1605,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'231","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.417261+0000","last_change":"2024-03-09T15:12:16.417334+0000","last_active":"2024-03-09T15:12:16.417261+0000","last_peered":"2024-03-09T15:12:16.417261+0000","last_clean":"2024-03-09T15:12:16.417261+0000","last_became_active":"2024-03-09T14:26:26.652576+0000","last_became_peered":"2024-03-09T14:26:26.652576+0000","last_unstale":"2024-03-09T15:12:16.417261+0000","last_undegraded":"2024-03-09T15:12:16.417261+0000","last_fullsized":"2024-03-09T15:12:16.417261+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-03-09T15:12:16.417152+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-03-09T15:12:16.417152+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.417152+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:10:31.051645+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460219,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":654,"num_read_kb":5204,"num_write":1022,"num_write_kb":18451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'327","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.419358+0000","last_change":"2024-03-09T15:11:52.419449+0000","last_active":"2024-03-09T15:11:52.419358+0000","last_peered":"2024-03-09T15:11:52.419358+0000","last_clean":"2024-03-09T15:11:52.419358+0000","last_became_active":"2024-03-09T14:27:03.715719+0000","last_became_peered":"2024-03-09T14:27:03.715719+0000","last_unstale":"2024-03-09T15:11:52.419358+0000","last_undegraded":"2024-03-09T15:11:52.419358+0000","last_fullsized":"2024-03-09T15:11:52.419358+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'327","last_scrub_stamp":"2024-03-09T15:11:52.419247+0000","last_deep_scrub":"264'327","last_deep_scrub_stamp":"2024-03-09T15:11:52.419247+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.419247+0000","objects_scrubbed":7,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:53.358056+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388665,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":851,"num_read_kb":60318,"num_write":1289,"num_write_kb":31608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'794","reported_seq":2417,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:20.530882+0000","last_change":"2024-03-09T15:12:20.530913+0000","last_active":"2024-03-09T15:12:20.530882+0000","last_peered":"2024-03-09T15:12:20.530882+0000","last_clean":"2024-03-09T15:12:20.530882+0000","last_became_active":"2024-03-09T14:26:28.649178+0000","last_became_peered":"2024-03-09T14:26:28.649178+0000","last_unstale":"2024-03-09T15:12:20.530882+0000","last_undegraded":"2024-03-09T15:12:20.530882+0000","last_fullsized":"2024-03-09T15:12:20.530882+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'794","last_scrub_stamp":"2024-03-09T15:12:20.530774+0000","last_deep_scrub":"264'794","last_deep_scrub_stamp":"2024-03-09T15:12:20.530774+0000","last_clean_scrub_stamp":"2024-03-09T15:12:20.530774+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:21:08.985356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3684,"num_read_kb":3311,"num_write":1055,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'191","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.037655+0000","last_change":"2024-03-09T15:11:57.037713+0000","last_active":"2024-03-09T15:11:57.037655+0000","last_peered":"2024-03-09T15:11:57.037655+0000","last_clean":"2024-03-09T15:11:57.037655+0000","last_became_active":"2024-03-09T14:27:03.721595+0000","last_became_peered":"2024-03-09T14:27:03.721595+0000","last_unstale":"2024-03-09T15:11:57.037655+0000","last_undegraded":"2024-03-09T15:11:57.037655+0000","last_fullsized":"2024-03-09T15:11:57.037655+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'191","last_scrub_stamp":"2024-03-09T15:11:57.037513+0000","last_deep_scrub":"264'191","last_deep_scrub_stamp":"2024-03-09T15:11:57.037513+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.037513+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:18:55.396406+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815977,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":112993,"num_write":1053,"num_write_kb":48480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'390","reported_seq":2056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.501628+0000","last_change":"2024-03-09T15:12:14.501628+0000","last_active":"2024-03-09T15:12:14.501628+0000","last_peered":"2024-03-09T15:12:14.501628+0000","last_clean":"2024-03-09T15:12:14.501628+0000","last_became_active":"2024-03-09T14:26:28.645067+0000","last_became_peered":"2024-03-09T14:26:28.645067+0000","last_unstale":"2024-03-09T15:12:14.501628+0000","last_undegraded":"2024-03-09T15:12:14.501628+0000","last_fullsized":"2024-03-09T15:12:14.501628+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'390","last_scrub_stamp":"2024-03-09T15:12:14.501517+0000","last_deep_scrub":"264'390","last_deep_scrub_stamp":"2024-03-09T15:12:14.501517+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.501517+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:39:50.142913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2475,"num_read_kb":2383,"num_write":438,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3064,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5887,"num_read_kb":4246,"num_write":2185,"num_write_kb":841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8667,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1219,"ondisk_log_size":1219,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":12946,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":15495,"num_read_kb":15279,"num_write":16228,"num_write_kb":4747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2170,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":507904,"data_stored":25892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1741,"ondisk_log_size":1741,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":440,"ondisk_log_size":440,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":322743,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8037,"num_read_kb":10144,"num_write":5663,"num_write_kb":2860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":134610,"num_omap_keys":318,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2092,"ondisk_log_size":2092,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1593,"num_read_kb":1897,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":195183,"num_read_kb":178329,"num_write":51691,"num_write_kb":17736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":121,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":29748,"num_omap_keys":123,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3647,"ondisk_log_size":3647,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":155728130,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":241,"num_whiteouts":0,"num_read":32390,"num_read_kb":2319225,"num_write":69850,"num_write_kb":2158516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":235536384,"data_stored":235536384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4154,"ondisk_log_size":4154,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":164063,"num_write":179,"num_write_kb":125047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":167,"num_read_kb":183429,"num_write":179,"num_write_kb":125047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575409,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320772,"kb_used_data":50812,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94051068,"statfs":{"total":96636764160,"available":96308293632,"internally_reserved":0,"allocated":52031488,"data_stored":50062803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575409,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279852,"kb_used_data":23780,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94091988,"statfs":{"total":96636764160,"available":96350195712,"internally_reserved":0,"allocated":24350720,"data_stored":22401655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575409,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139292,"kb_used_data":53972,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94232548,"statfs":{"total":96636764160,"available":96494129152,"internally_reserved":0,"allocated":55267328,"data_stored":53270043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575408,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139252,"kb_used_data":35884,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94232588,"statfs":{"total":96636764160,"available":96494170112,"internally_reserved":0,"allocated":36745216,"data_stored":34850722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575409,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272684,"kb_used_data":38820,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94099156,"statfs":{"total":96636764160,"available":96357535744,"internally_reserved":0,"allocated":39751680,"data_stored":37775689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575407,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112676,"kb_used_data":41244,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94259164,"statfs":{"total":96636764160,"available":96521383936,"internally_reserved":0,"allocated":42233856,"data_stored":40310821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575408,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164480,"kb_used_data":43128,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94207360,"statfs":{"total":96636764160,"available":96468336640,"internally_reserved":0,"allocated":44163072,"data_stored":42229674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575408,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280168,"kb_used_data":42144,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94091672,"statfs":{"total":96636764160,"available":96349872128,"internally_reserved":0,"allocated":43155456,"data_stored":41182927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24678400,"data_stored":24678400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34705408,"data_stored":34705408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29638656,"data_stored":29638656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25006080,"data_stored":25006080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":31522816,"data_stored":31522816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36306944,"data_stored":36306944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":19070976,"data_stored":19070976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":34607104,"data_stored":34607104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:12:33.495 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.495 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.496 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.496 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.496 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.496 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.497 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.497 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.497 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.497 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.497 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.498 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.498 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.498 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.498 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.498 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-03-09T14:38:33.392879+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=33, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.499 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.499 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.499 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.499 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.500 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.500 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.500 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.500 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.500 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.500 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.501 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.501 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.501 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.501 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.501 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.502 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.502 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.502 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.502 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.502 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.503 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.503 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.503 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.503 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.503 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-03-09T14:50:34.485135+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=34, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.504 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-03-09T14:38:36.416798+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=38, tm_sec=36, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.504 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.504 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.504 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.504 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.504 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.505 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.505 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.505 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.505 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.506 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-09T14:26:29.627088+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.506 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.506 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.506 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.506 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.507 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.507 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.507 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.507 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.508 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.508 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.508 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.508 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-09T14:26:12.541311+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=12, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.509 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.509 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.509 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.509 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.509 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.510 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.510 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.510 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-09T14:26:17.561382+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.510 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.511 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.511 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.511 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.511 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.512 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.512 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.512 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.512 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.512 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.513 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.513 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-03-09T14:26:31.636497+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=31, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.513 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-09T14:26:27.614935+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=27, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.513 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.514 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.514 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.514 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.514 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.515 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.515 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.515 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.515 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.515 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-09T14:26:25.602807+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=11, tm_sec=47, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:12:33.516 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-09T15:12:53.517 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:12:53.860 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-03-09T15:12:53.873 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-03-09T15:12:53.876 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":1658,"stamp":"2024-03-09T15:12:53.562504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":190210338,"num_objects":676,"num_object_clones":0,"num_object_copies":1593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":676,"num_whiteouts":0,"num_read":259041,"num_read_kb":2876724,"num_write":146172,"num_write_kb":2437235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":166,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":731643,"num_omap_keys":1758,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13593,"ondisk_log_size":13593,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1709176,"kb_used_data":329784,"kb_used_omap":12,"kb_used_meta":1379315,"kb_avail":753265544,"statfs":{"total":773094113280,"available":771343917056,"internally_reserved":0,"allocated":337698816,"data_stored":322084334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1412419120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6976,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005075"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:38.200346+0000","last_change":"2024-03-09T15:12:38.200392+0000","last_active":"2024-03-09T15:12:38.200346+0000","last_peered":"2024-03-09T15:12:38.200346+0000","last_clean":"2024-03-09T15:12:38.200346+0000","last_became_active":"2024-03-09T14:50:35.506543+0000","last_became_peered":"2024-03-09T14:50:35.506543+0000","last_unstale":"2024-03-09T15:12:38.200346+0000","last_undegraded":"2024-03-09T15:12:38.200346+0000","last_fullsized":"2024-03-09T15:12:38.200346+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:38.200249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:38.200249+0000","last_clean_scrub_stamp":"2024-03-09T15:12:38.200249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:39:49.254001+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'7","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:35.306552+0000","last_change":"2024-03-09T15:12:35.306579+0000","last_active":"2024-03-09T15:12:35.306552+0000","last_peered":"2024-03-09T15:12:35.306552+0000","last_clean":"2024-03-09T15:12:35.306552+0000","last_became_active":"2024-03-09T14:38:37.436381+0000","last_became_peered":"2024-03-09T14:38:37.436381+0000","last_unstale":"2024-03-09T15:12:35.306552+0000","last_undegraded":"2024-03-09T15:12:35.306552+0000","last_fullsized":"2024-03-09T15:12:35.306552+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-03-09T15:12:35.306447+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-03-09T15:12:35.306447+0000","last_clean_scrub_stamp":"2024-03-09T15:12:35.306447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:56:31.048565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"261'4","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.112913+0000","last_change":"2024-03-09T15:11:51.112934+0000","last_active":"2024-03-09T15:11:51.112913+0000","last_peered":"2024-03-09T15:11:51.112913+0000","last_clean":"2024-03-09T15:11:51.112913+0000","last_became_active":"2024-03-09T14:38:34.418748+0000","last_became_peered":"2024-03-09T14:38:34.418748+0000","last_unstale":"2024-03-09T15:11:51.112913+0000","last_undegraded":"2024-03-09T15:11:51.112913+0000","last_fullsized":"2024-03-09T15:11:51.112913+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-03-09T15:11:51.112840+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-03-09T15:11:51.112840+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.112840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:50.837065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'22","reported_seq":112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.476708+0000","last_change":"2024-03-09T15:11:52.476729+0000","last_active":"2024-03-09T15:11:52.476708+0000","last_peered":"2024-03-09T15:11:52.476708+0000","last_clean":"2024-03-09T15:11:52.476708+0000","last_became_active":"2024-03-09T14:35:41.121412+0000","last_became_peered":"2024-03-09T14:35:41.121412+0000","last_unstale":"2024-03-09T15:11:52.476708+0000","last_undegraded":"2024-03-09T15:11:52.476708+0000","last_fullsized":"2024-03-09T15:11:52.476708+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-03-09T15:11:52.476636+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-03-09T15:11:52.476636+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.476636+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:24:35.562139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":67,"num_write":35,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.043978+0000","last_change":"2024-03-09T15:12:22.044000+0000","last_active":"2024-03-09T15:12:22.043978+0000","last_peered":"2024-03-09T15:12:22.043978+0000","last_clean":"2024-03-09T15:12:22.043978+0000","last_became_active":"2024-03-09T14:50:35.506905+0000","last_became_peered":"2024-03-09T14:50:35.506905+0000","last_unstale":"2024-03-09T15:12:22.043978+0000","last_undegraded":"2024-03-09T15:12:22.043978+0000","last_fullsized":"2024-03-09T15:12:22.043978+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:22.043886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:22.043886+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.043886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:03:33.511711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:37.890773+0000","last_change":"2024-03-09T15:12:37.890817+0000","last_active":"2024-03-09T15:12:37.890773+0000","last_peered":"2024-03-09T15:12:37.890773+0000","last_clean":"2024-03-09T15:12:37.890773+0000","last_became_active":"2024-03-09T14:38:37.440733+0000","last_became_peered":"2024-03-09T14:38:37.440733+0000","last_unstale":"2024-03-09T15:12:37.890773+0000","last_undegraded":"2024-03-09T15:12:37.890773+0000","last_fullsized":"2024-03-09T15:12:37.890773+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:12:37.890652+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:12:37.890652+0000","last_clean_scrub_stamp":"2024-03-09T15:12:37.890652+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:26:54.878020+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.046428+0000","last_change":"2024-03-09T15:11:56.046457+0000","last_active":"2024-03-09T15:11:56.046428+0000","last_peered":"2024-03-09T15:11:56.046428+0000","last_clean":"2024-03-09T15:11:56.046428+0000","last_became_active":"2024-03-09T14:38:34.425629+0000","last_became_peered":"2024-03-09T14:38:34.425629+0000","last_unstale":"2024-03-09T15:11:56.046428+0000","last_undegraded":"2024-03-09T15:11:56.046428+0000","last_fullsized":"2024-03-09T15:11:56.046428+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:11:56.046346+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:11:56.046346+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.046346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:00:15.566941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'52","reported_seq":185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.943868+0000","last_change":"2024-03-09T15:12:15.943911+0000","last_active":"2024-03-09T15:12:15.943868+0000","last_peered":"2024-03-09T15:12:15.943868+0000","last_clean":"2024-03-09T15:12:15.943868+0000","last_became_active":"2024-03-09T14:35:41.117858+0000","last_became_peered":"2024-03-09T14:35:41.117858+0000","last_unstale":"2024-03-09T15:12:15.943868+0000","last_undegraded":"2024-03-09T15:12:15.943868+0000","last_fullsized":"2024-03-09T15:12:15.943868+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-03-09T15:12:15.943743+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-03-09T15:12:15.943743+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.943743+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:01.919651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":156,"num_write":85,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:29.306982+0000","last_change":"2024-03-09T15:12:29.307005+0000","last_active":"2024-03-09T15:12:29.306982+0000","last_peered":"2024-03-09T15:12:29.306982+0000","last_clean":"2024-03-09T15:12:29.306982+0000","last_became_active":"2024-03-09T14:50:35.506136+0000","last_became_peered":"2024-03-09T14:50:35.506136+0000","last_unstale":"2024-03-09T15:12:29.306982+0000","last_undegraded":"2024-03-09T15:12:29.306982+0000","last_fullsized":"2024-03-09T15:12:29.306982+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:29.306861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:29.306861+0000","last_clean_scrub_stamp":"2024-03-09T15:12:29.306861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:06:17.572533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'11","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:42.442540+0000","last_change":"2024-03-09T15:12:42.442601+0000","last_active":"2024-03-09T15:12:42.442540+0000","last_peered":"2024-03-09T15:12:42.442540+0000","last_clean":"2024-03-09T15:12:42.442540+0000","last_became_active":"2024-03-09T14:38:37.442906+0000","last_became_peered":"2024-03-09T14:38:37.442906+0000","last_unstale":"2024-03-09T15:12:42.442540+0000","last_undegraded":"2024-03-09T15:12:42.442540+0000","last_fullsized":"2024-03-09T15:12:42.442540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-03-09T15:12:42.442425+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-03-09T15:12:42.442425+0000","last_clean_scrub_stamp":"2024-03-09T15:12:42.442425+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:45:38.504630+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":8196,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'6","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.960735+0000","last_change":"2024-03-09T15:12:18.960735+0000","last_active":"2024-03-09T15:12:18.960735+0000","last_peered":"2024-03-09T15:12:18.960735+0000","last_clean":"2024-03-09T15:12:18.960735+0000","last_became_active":"2024-03-09T14:38:34.425459+0000","last_became_peered":"2024-03-09T14:38:34.425459+0000","last_unstale":"2024-03-09T15:12:18.960735+0000","last_undegraded":"2024-03-09T15:12:18.960735+0000","last_fullsized":"2024-03-09T15:12:18.960735+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:12:18.960606+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:12:18.960606+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.960606+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:15:27.077248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"261'16","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:49.432500+0000","last_change":"2024-03-09T15:11:49.432531+0000","last_active":"2024-03-09T15:11:49.432500+0000","last_peered":"2024-03-09T15:11:49.432500+0000","last_clean":"2024-03-09T15:11:49.432500+0000","last_became_active":"2024-03-09T14:35:41.123171+0000","last_became_peered":"2024-03-09T14:35:41.123171+0000","last_unstale":"2024-03-09T15:11:49.432500+0000","last_undegraded":"2024-03-09T15:11:49.432500+0000","last_fullsized":"2024-03-09T15:11:49.432500+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'16","last_scrub_stamp":"2024-03-09T15:11:49.432421+0000","last_deep_scrub":"261'16","last_deep_scrub_stamp":"2024-03-09T15:11:49.432421+0000","last_clean_scrub_stamp":"2024-03-09T15:11:49.432421+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:33:27.802202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":56,"num_write":23,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:47.147957+0000","last_change":"2024-03-09T15:12:47.147979+0000","last_active":"2024-03-09T15:12:47.147957+0000","last_peered":"2024-03-09T15:12:47.147957+0000","last_clean":"2024-03-09T15:12:47.147957+0000","last_became_active":"2024-03-09T14:50:35.503090+0000","last_became_peered":"2024-03-09T14:50:35.503090+0000","last_unstale":"2024-03-09T15:12:47.147957+0000","last_undegraded":"2024-03-09T15:12:47.147957+0000","last_fullsized":"2024-03-09T15:12:47.147957+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:47.147862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:47.147862+0000","last_clean_scrub_stamp":"2024-03-09T15:12:47.147862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:33:32.351265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.095521+0000","last_change":"2024-03-09T15:12:02.095521+0000","last_active":"2024-03-09T15:12:02.095521+0000","last_peered":"2024-03-09T15:12:02.095521+0000","last_clean":"2024-03-09T15:12:02.095521+0000","last_became_active":"2024-03-09T14:38:37.432089+0000","last_became_peered":"2024-03-09T14:38:37.432089+0000","last_unstale":"2024-03-09T15:12:02.095521+0000","last_undegraded":"2024-03-09T15:12:02.095521+0000","last_fullsized":"2024-03-09T15:12:02.095521+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:02.095344+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:02.095344+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.095344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:06:26.800542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.165978+0000","last_change":"2024-03-09T15:11:54.165978+0000","last_active":"2024-03-09T15:11:54.165978+0000","last_peered":"2024-03-09T15:11:54.165978+0000","last_clean":"2024-03-09T15:11:54.165978+0000","last_became_active":"2024-03-09T14:38:34.417024+0000","last_became_peered":"2024-03-09T14:38:34.417024+0000","last_unstale":"2024-03-09T15:11:54.165978+0000","last_undegraded":"2024-03-09T15:11:54.165978+0000","last_fullsized":"2024-03-09T15:11:54.165978+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:54.165851+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:54.165851+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.165851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:07:17.408333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'52","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.159931+0000","last_change":"2024-03-09T15:11:57.159971+0000","last_active":"2024-03-09T15:11:57.159931+0000","last_peered":"2024-03-09T15:11:57.159931+0000","last_clean":"2024-03-09T15:11:57.159931+0000","last_became_active":"2024-03-09T14:35:41.118960+0000","last_became_peered":"2024-03-09T14:35:41.118960+0000","last_unstale":"2024-03-09T15:11:57.159931+0000","last_undegraded":"2024-03-09T15:11:57.159931+0000","last_fullsized":"2024-03-09T15:11:57.159931+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-03-09T15:11:57.159825+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-03-09T15:11:57.159825+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.159825+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:17:22.468521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":146,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:51.113968+0000","last_change":"2024-03-09T15:12:51.113993+0000","last_active":"2024-03-09T15:12:51.113968+0000","last_peered":"2024-03-09T15:12:51.113968+0000","last_clean":"2024-03-09T15:12:51.113968+0000","last_became_active":"2024-03-09T14:50:35.512534+0000","last_became_peered":"2024-03-09T14:50:35.512534+0000","last_unstale":"2024-03-09T15:12:51.113968+0000","last_undegraded":"2024-03-09T15:12:51.113968+0000","last_fullsized":"2024-03-09T15:12:51.113968+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:51.113872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:51.113872+0000","last_clean_scrub_stamp":"2024-03-09T15:12:51.113872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:52.717118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'7","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:36.284705+0000","last_change":"2024-03-09T15:12:36.284741+0000","last_active":"2024-03-09T15:12:36.284705+0000","last_peered":"2024-03-09T15:12:36.284705+0000","last_clean":"2024-03-09T15:12:36.284705+0000","last_became_active":"2024-03-09T14:38:37.436829+0000","last_became_peered":"2024-03-09T14:38:37.436829+0000","last_unstale":"2024-03-09T15:12:36.284705+0000","last_undegraded":"2024-03-09T15:12:36.284705+0000","last_fullsized":"2024-03-09T15:12:36.284705+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-03-09T15:12:36.284616+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-03-09T15:12:36.284616+0000","last_clean_scrub_stamp":"2024-03-09T15:12:36.284616+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:57:47.778572+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'6","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.433537+0000","last_change":"2024-03-09T15:11:59.433537+0000","last_active":"2024-03-09T15:11:59.433537+0000","last_peered":"2024-03-09T15:11:59.433537+0000","last_clean":"2024-03-09T15:11:59.433537+0000","last_became_active":"2024-03-09T14:38:34.418209+0000","last_became_peered":"2024-03-09T14:38:34.418209+0000","last_unstale":"2024-03-09T15:11:59.433537+0000","last_undegraded":"2024-03-09T15:11:59.433537+0000","last_fullsized":"2024-03-09T15:11:59.433537+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:11:59.433411+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:11:59.433411+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.433411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:32.542902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6194,"num_write":6,"num_write_kb":5170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'22","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.103062+0000","last_change":"2024-03-09T15:11:52.103111+0000","last_active":"2024-03-09T15:11:52.103062+0000","last_peered":"2024-03-09T15:11:52.103062+0000","last_clean":"2024-03-09T15:11:52.103062+0000","last_became_active":"2024-03-09T14:35:41.123715+0000","last_became_peered":"2024-03-09T14:35:41.123715+0000","last_unstale":"2024-03-09T15:11:52.103062+0000","last_undegraded":"2024-03-09T15:11:52.103062+0000","last_fullsized":"2024-03-09T15:11:52.103062+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-03-09T15:11:52.102969+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-03-09T15:11:52.102969+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.102969+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:05:50.481258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":62,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:31.781062+0000","last_change":"2024-03-09T15:12:31.781087+0000","last_active":"2024-03-09T15:12:31.781062+0000","last_peered":"2024-03-09T15:12:31.781062+0000","last_clean":"2024-03-09T15:12:31.781062+0000","last_became_active":"2024-03-09T14:50:35.509938+0000","last_became_peered":"2024-03-09T14:50:35.509938+0000","last_unstale":"2024-03-09T15:12:31.781062+0000","last_undegraded":"2024-03-09T15:12:31.781062+0000","last_fullsized":"2024-03-09T15:12:31.781062+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:31.780972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:31.780972+0000","last_clean_scrub_stamp":"2024-03-09T15:12:31.780972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:48:48.657480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:25.406233+0000","last_change":"2024-03-09T15:12:25.406233+0000","last_active":"2024-03-09T15:12:25.406233+0000","last_peered":"2024-03-09T15:12:25.406233+0000","last_clean":"2024-03-09T15:12:25.406233+0000","last_became_active":"2024-03-09T14:38:37.439120+0000","last_became_peered":"2024-03-09T14:38:37.439120+0000","last_unstale":"2024-03-09T15:12:25.406233+0000","last_undegraded":"2024-03-09T15:12:25.406233+0000","last_fullsized":"2024-03-09T15:12:25.406233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:25.406108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:25.406108+0000","last_clean_scrub_stamp":"2024-03-09T15:12:25.406108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:48:51.911943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.212474+0000","last_change":"2024-03-09T15:11:58.212474+0000","last_active":"2024-03-09T15:11:58.212474+0000","last_peered":"2024-03-09T15:11:58.212474+0000","last_clean":"2024-03-09T15:11:58.212474+0000","last_became_active":"2024-03-09T14:38:34.418553+0000","last_became_peered":"2024-03-09T14:38:34.418553+0000","last_unstale":"2024-03-09T15:11:58.212474+0000","last_undegraded":"2024-03-09T15:11:58.212474+0000","last_fullsized":"2024-03-09T15:11:58.212474+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:11:58.212359+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:11:58.212359+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.212359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:05.878755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":6,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'47","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.218080+0000","last_change":"2024-03-09T15:11:52.218122+0000","last_active":"2024-03-09T15:11:52.218080+0000","last_peered":"2024-03-09T15:11:52.218080+0000","last_clean":"2024-03-09T15:11:52.218080+0000","last_became_active":"2024-03-09T14:35:41.123785+0000","last_became_peered":"2024-03-09T14:35:41.123785+0000","last_unstale":"2024-03-09T15:11:52.218080+0000","last_undegraded":"2024-03-09T15:11:52.218080+0000","last_fullsized":"2024-03-09T15:11:52.218080+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-03-09T15:11:52.217928+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-03-09T15:11:52.217928+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.217928+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:33.071186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":141,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.911915+0000","last_change":"2024-03-09T15:12:12.911945+0000","last_active":"2024-03-09T15:12:12.911915+0000","last_peered":"2024-03-09T15:12:12.911915+0000","last_clean":"2024-03-09T15:12:12.911915+0000","last_became_active":"2024-03-09T14:50:35.499942+0000","last_became_peered":"2024-03-09T14:50:35.499942+0000","last_unstale":"2024-03-09T15:12:12.911915+0000","last_undegraded":"2024-03-09T15:12:12.911915+0000","last_fullsized":"2024-03-09T15:12:12.911915+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:12.911833+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:12.911833+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.911833+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:04:45.866722+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:24.416282+0000","last_change":"2024-03-09T15:12:24.416347+0000","last_active":"2024-03-09T15:12:24.416282+0000","last_peered":"2024-03-09T15:12:24.416282+0000","last_clean":"2024-03-09T15:12:24.416282+0000","last_became_active":"2024-03-09T14:38:37.437714+0000","last_became_peered":"2024-03-09T14:38:37.437714+0000","last_unstale":"2024-03-09T15:12:24.416282+0000","last_undegraded":"2024-03-09T15:12:24.416282+0000","last_fullsized":"2024-03-09T15:12:24.416282+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:12:24.416065+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:12:24.416065+0000","last_clean_scrub_stamp":"2024-03-09T15:12:24.416065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:10.539890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.028592+0000","last_change":"2024-03-09T15:12:06.028618+0000","last_active":"2024-03-09T15:12:06.028592+0000","last_peered":"2024-03-09T15:12:06.028592+0000","last_clean":"2024-03-09T15:12:06.028592+0000","last_became_active":"2024-03-09T14:38:34.420232+0000","last_became_peered":"2024-03-09T14:38:34.420232+0000","last_unstale":"2024-03-09T15:12:06.028592+0000","last_undegraded":"2024-03-09T15:12:06.028592+0000","last_fullsized":"2024-03-09T15:12:06.028592+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:06.028501+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:06.028501+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.028501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:00:04.885173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'24","reported_seq":113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.465788+0000","last_change":"2024-03-09T15:11:53.465788+0000","last_active":"2024-03-09T15:11:53.465788+0000","last_peered":"2024-03-09T15:11:53.465788+0000","last_clean":"2024-03-09T15:11:53.465788+0000","last_became_active":"2024-03-09T14:35:41.121566+0000","last_became_peered":"2024-03-09T14:35:41.121566+0000","last_unstale":"2024-03-09T15:11:53.465788+0000","last_undegraded":"2024-03-09T15:11:53.465788+0000","last_fullsized":"2024-03-09T15:11:53.465788+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-03-09T15:11:53.465689+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-03-09T15:11:53.465689+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.465689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:20.850766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":46,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:43.816700+0000","last_change":"2024-03-09T15:12:43.816728+0000","last_active":"2024-03-09T15:12:43.816700+0000","last_peered":"2024-03-09T15:12:43.816700+0000","last_clean":"2024-03-09T15:12:43.816700+0000","last_became_active":"2024-03-09T14:50:35.501422+0000","last_became_peered":"2024-03-09T14:50:35.501422+0000","last_unstale":"2024-03-09T15:12:43.816700+0000","last_undegraded":"2024-03-09T15:12:43.816700+0000","last_fullsized":"2024-03-09T15:12:43.816700+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:43.816595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:43.816595+0000","last_clean_scrub_stamp":"2024-03-09T15:12:43.816595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:05:44.838020+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"264'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:45.070226+0000","last_change":"2024-03-09T15:12:45.070250+0000","last_active":"2024-03-09T15:12:45.070226+0000","last_peered":"2024-03-09T15:12:45.070226+0000","last_clean":"2024-03-09T15:12:45.070226+0000","last_became_active":"2024-03-09T14:38:37.438685+0000","last_became_peered":"2024-03-09T14:38:37.438685+0000","last_unstale":"2024-03-09T15:12:45.070226+0000","last_undegraded":"2024-03-09T15:12:45.070226+0000","last_fullsized":"2024-03-09T15:12:45.070226+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:12:45.070135+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:12:45.070135+0000","last_clean_scrub_stamp":"2024-03-09T15:12:45.070135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:29:25.625931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.451884+0000","last_change":"2024-03-09T15:12:11.451910+0000","last_active":"2024-03-09T15:12:11.451884+0000","last_peered":"2024-03-09T15:12:11.451884+0000","last_clean":"2024-03-09T15:12:11.451884+0000","last_became_active":"2024-03-09T14:38:34.422607+0000","last_became_peered":"2024-03-09T14:38:34.422607+0000","last_unstale":"2024-03-09T15:12:11.451884+0000","last_undegraded":"2024-03-09T15:12:11.451884+0000","last_fullsized":"2024-03-09T15:12:11.451884+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:12:11.451792+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:12:11.451792+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.451792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:22:45.795308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'68","reported_seq":233,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.058888+0000","last_change":"2024-03-09T15:11:53.058888+0000","last_active":"2024-03-09T15:11:53.058888+0000","last_peered":"2024-03-09T15:11:53.058888+0000","last_clean":"2024-03-09T15:11:53.058888+0000","last_became_active":"2024-03-09T14:35:41.122898+0000","last_became_peered":"2024-03-09T14:35:41.122898+0000","last_unstale":"2024-03-09T15:11:53.058888+0000","last_undegraded":"2024-03-09T15:11:53.058888+0000","last_fullsized":"2024-03-09T15:11:53.058888+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'68","last_scrub_stamp":"2024-03-09T15:11:53.058785+0000","last_deep_scrub":"264'68","last_deep_scrub_stamp":"2024-03-09T15:11:53.058785+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.058785+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:18:11.685762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":238,"num_write":108,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:30.757619+0000","last_change":"2024-03-09T15:12:30.757640+0000","last_active":"2024-03-09T15:12:30.757619+0000","last_peered":"2024-03-09T15:12:30.757619+0000","last_clean":"2024-03-09T15:12:30.757619+0000","last_became_active":"2024-03-09T14:50:35.508726+0000","last_became_peered":"2024-03-09T14:50:35.508726+0000","last_unstale":"2024-03-09T15:12:30.757619+0000","last_undegraded":"2024-03-09T15:12:30.757619+0000","last_fullsized":"2024-03-09T15:12:30.757619+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:30.757535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:30.757535+0000","last_clean_scrub_stamp":"2024-03-09T15:12:30.757535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:29:23.124225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'8","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.148764+0000","last_change":"2024-03-09T15:12:18.148764+0000","last_active":"2024-03-09T15:12:18.148764+0000","last_peered":"2024-03-09T15:12:18.148764+0000","last_clean":"2024-03-09T15:12:18.148764+0000","last_became_active":"2024-03-09T14:38:37.437039+0000","last_became_peered":"2024-03-09T14:38:37.437039+0000","last_unstale":"2024-03-09T15:12:18.148764+0000","last_undegraded":"2024-03-09T15:12:18.148764+0000","last_fullsized":"2024-03-09T15:12:18.148764+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-03-09T15:12:18.148637+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-03-09T15:12:18.148637+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.148637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:44:42.949509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10340,"num_write":8,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"264'6","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.314908+0000","last_change":"2024-03-09T15:12:03.314950+0000","last_active":"2024-03-09T15:12:03.314908+0000","last_peered":"2024-03-09T15:12:03.314908+0000","last_clean":"2024-03-09T15:12:03.314908+0000","last_became_active":"2024-03-09T14:38:34.418269+0000","last_became_peered":"2024-03-09T14:38:34.418269+0000","last_unstale":"2024-03-09T15:12:03.314908+0000","last_undegraded":"2024-03-09T15:12:03.314908+0000","last_fullsized":"2024-03-09T15:12:03.314908+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:12:03.314754+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:12:03.314754+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.314754+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:24:52.192811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'38","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.441547+0000","last_change":"2024-03-09T15:11:50.441547+0000","last_active":"2024-03-09T15:11:50.441547+0000","last_peered":"2024-03-09T15:11:50.441547+0000","last_clean":"2024-03-09T15:11:50.441547+0000","last_became_active":"2024-03-09T14:35:41.122257+0000","last_became_peered":"2024-03-09T14:35:41.122257+0000","last_unstale":"2024-03-09T15:11:50.441547+0000","last_undegraded":"2024-03-09T15:11:50.441547+0000","last_fullsized":"2024-03-09T15:11:50.441547+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-03-09T15:11:50.441402+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-03-09T15:11:50.441402+0000","last_clean_scrub_stamp":"2024-03-09T15:11:50.441402+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:44.539083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":116,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.023321+0000","last_change":"2024-03-09T15:12:21.023369+0000","last_active":"2024-03-09T15:12:21.023321+0000","last_peered":"2024-03-09T15:12:21.023321+0000","last_clean":"2024-03-09T15:12:21.023321+0000","last_became_active":"2024-03-09T14:50:35.503595+0000","last_became_peered":"2024-03-09T14:50:35.503595+0000","last_unstale":"2024-03-09T15:12:21.023321+0000","last_undegraded":"2024-03-09T15:12:21.023321+0000","last_fullsized":"2024-03-09T15:12:21.023321+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:21.023181+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:21.023181+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.023181+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:01:30.969392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'5","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.169969+0000","last_change":"2024-03-09T15:11:58.170016+0000","last_active":"2024-03-09T15:11:58.169969+0000","last_peered":"2024-03-09T15:11:58.169969+0000","last_clean":"2024-03-09T15:11:58.169969+0000","last_became_active":"2024-03-09T14:38:37.429956+0000","last_became_peered":"2024-03-09T14:38:37.429956+0000","last_unstale":"2024-03-09T15:11:58.169969+0000","last_undegraded":"2024-03-09T15:11:58.169969+0000","last_fullsized":"2024-03-09T15:11:58.169969+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:11:58.169839+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:11:58.169839+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.169839+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:56:13.470034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":11264,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.097802+0000","last_change":"2024-03-09T15:11:55.097802+0000","last_active":"2024-03-09T15:11:55.097802+0000","last_peered":"2024-03-09T15:11:55.097802+0000","last_clean":"2024-03-09T15:11:55.097802+0000","last_became_active":"2024-03-09T14:38:34.421678+0000","last_became_peered":"2024-03-09T14:38:34.421678+0000","last_unstale":"2024-03-09T15:11:55.097802+0000","last_undegraded":"2024-03-09T15:11:55.097802+0000","last_fullsized":"2024-03-09T15:11:55.097802+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:55.097675+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:55.097675+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.097675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:06.648401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'25","reported_seq":108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.192215+0000","last_change":"2024-03-09T15:11:55.192215+0000","last_active":"2024-03-09T15:11:55.192215+0000","last_peered":"2024-03-09T15:11:55.192215+0000","last_clean":"2024-03-09T15:11:55.192215+0000","last_became_active":"2024-03-09T14:35:41.120818+0000","last_became_peered":"2024-03-09T14:35:41.120818+0000","last_unstale":"2024-03-09T15:11:55.192215+0000","last_undegraded":"2024-03-09T15:11:55.192215+0000","last_fullsized":"2024-03-09T15:11:55.192215+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-03-09T15:11:55.192100+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-03-09T15:11:55.192100+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.192100+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:56:16.097474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":54,"num_write":56,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.901991+0000","last_change":"2024-03-09T15:12:16.902013+0000","last_active":"2024-03-09T15:12:16.901991+0000","last_peered":"2024-03-09T15:12:16.901991+0000","last_clean":"2024-03-09T15:12:16.901991+0000","last_became_active":"2024-03-09T14:50:35.500196+0000","last_became_peered":"2024-03-09T14:50:35.500196+0000","last_unstale":"2024-03-09T15:12:16.901991+0000","last_undegraded":"2024-03-09T15:12:16.901991+0000","last_fullsized":"2024-03-09T15:12:16.901991+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:16.901895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:16.901895+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.901895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:28:45.708776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.062995+0000","last_change":"2024-03-09T15:12:10.062995+0000","last_active":"2024-03-09T15:12:10.062995+0000","last_peered":"2024-03-09T15:12:10.062995+0000","last_clean":"2024-03-09T15:12:10.062995+0000","last_became_active":"2024-03-09T14:38:37.436884+0000","last_became_peered":"2024-03-09T14:38:37.436884+0000","last_unstale":"2024-03-09T15:12:10.062995+0000","last_undegraded":"2024-03-09T15:12:10.062995+0000","last_fullsized":"2024-03-09T15:12:10.062995+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:10.062853+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:10.062853+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.062853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:49:41.996594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.934492+0000","last_change":"2024-03-09T15:12:17.934492+0000","last_active":"2024-03-09T15:12:17.934492+0000","last_peered":"2024-03-09T15:12:17.934492+0000","last_clean":"2024-03-09T15:12:17.934492+0000","last_became_active":"2024-03-09T14:38:34.420002+0000","last_became_peered":"2024-03-09T14:38:34.420002+0000","last_unstale":"2024-03-09T15:12:17.934492+0000","last_undegraded":"2024-03-09T15:12:17.934492+0000","last_fullsized":"2024-03-09T15:12:17.934492+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:17.934379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:17.934379+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.934379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:54:49.231163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'34","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.947754+0000","last_change":"2024-03-09T15:12:05.947778+0000","last_active":"2024-03-09T15:12:05.947754+0000","last_peered":"2024-03-09T15:12:05.947754+0000","last_clean":"2024-03-09T15:12:05.947754+0000","last_became_active":"2024-03-09T14:35:41.116430+0000","last_became_peered":"2024-03-09T14:35:41.116430+0000","last_unstale":"2024-03-09T15:12:05.947754+0000","last_undegraded":"2024-03-09T15:12:05.947754+0000","last_fullsized":"2024-03-09T15:12:05.947754+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-03-09T15:12:05.947669+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-03-09T15:12:05.947669+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.947669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:39:25.396644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":94,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:39.215682+0000","last_change":"2024-03-09T15:12:39.215704+0000","last_active":"2024-03-09T15:12:39.215682+0000","last_peered":"2024-03-09T15:12:39.215682+0000","last_clean":"2024-03-09T15:12:39.215682+0000","last_became_active":"2024-03-09T14:50:35.506969+0000","last_became_peered":"2024-03-09T14:50:35.506969+0000","last_unstale":"2024-03-09T15:12:39.215682+0000","last_undegraded":"2024-03-09T15:12:39.215682+0000","last_fullsized":"2024-03-09T15:12:39.215682+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:39.215593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:39.215593+0000","last_clean_scrub_stamp":"2024-03-09T15:12:39.215593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:59:00.791569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:33.966293+0000","last_change":"2024-03-09T15:12:33.966322+0000","last_active":"2024-03-09T15:12:33.966293+0000","last_peered":"2024-03-09T15:12:33.966293+0000","last_clean":"2024-03-09T15:12:33.966293+0000","last_became_active":"2024-03-09T14:38:37.435960+0000","last_became_peered":"2024-03-09T14:38:37.435960+0000","last_unstale":"2024-03-09T15:12:33.966293+0000","last_undegraded":"2024-03-09T15:12:33.966293+0000","last_fullsized":"2024-03-09T15:12:33.966293+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:12:33.966176+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:12:33.966176+0000","last_clean_scrub_stamp":"2024-03-09T15:12:33.966176+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:07:26.106169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'8","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.504210+0000","last_change":"2024-03-09T15:12:07.504210+0000","last_active":"2024-03-09T15:12:07.504210+0000","last_peered":"2024-03-09T15:12:07.504210+0000","last_clean":"2024-03-09T15:12:07.504210+0000","last_became_active":"2024-03-09T14:38:34.420571+0000","last_became_peered":"2024-03-09T14:38:34.420571+0000","last_unstale":"2024-03-09T15:12:07.504210+0000","last_undegraded":"2024-03-09T15:12:07.504210+0000","last_fullsized":"2024-03-09T15:12:07.504210+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-03-09T15:12:07.504039+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-03-09T15:12:07.504039+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.504039+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:59.430132+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":6146,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'36","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.028960+0000","last_change":"2024-03-09T15:12:04.029007+0000","last_active":"2024-03-09T15:12:04.028960+0000","last_peered":"2024-03-09T15:12:04.028960+0000","last_clean":"2024-03-09T15:12:04.028960+0000","last_became_active":"2024-03-09T14:35:41.121060+0000","last_became_peered":"2024-03-09T14:35:41.121060+0000","last_unstale":"2024-03-09T15:12:04.028960+0000","last_undegraded":"2024-03-09T15:12:04.028960+0000","last_fullsized":"2024-03-09T15:12:04.028960+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-03-09T15:12:04.028848+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-03-09T15:12:04.028848+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.028848+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:40:13.122787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":100,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:48.144528+0000","last_change":"2024-03-09T15:12:48.144552+0000","last_active":"2024-03-09T15:12:48.144528+0000","last_peered":"2024-03-09T15:12:48.144528+0000","last_clean":"2024-03-09T15:12:48.144528+0000","last_became_active":"2024-03-09T14:50:35.503970+0000","last_became_peered":"2024-03-09T14:50:35.503970+0000","last_unstale":"2024-03-09T15:12:48.144528+0000","last_undegraded":"2024-03-09T15:12:48.144528+0000","last_fullsized":"2024-03-09T15:12:48.144528+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:48.144420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:48.144420+0000","last_clean_scrub_stamp":"2024-03-09T15:12:48.144420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:57:40.861607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:26.747177+0000","last_change":"2024-03-09T15:12:26.747228+0000","last_active":"2024-03-09T15:12:26.747177+0000","last_peered":"2024-03-09T15:12:26.747177+0000","last_clean":"2024-03-09T15:12:26.747177+0000","last_became_active":"2024-03-09T14:38:37.438604+0000","last_became_peered":"2024-03-09T14:38:37.438604+0000","last_unstale":"2024-03-09T15:12:26.747177+0000","last_undegraded":"2024-03-09T15:12:26.747177+0000","last_fullsized":"2024-03-09T15:12:26.747177+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:26.747074+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:26.747074+0000","last_clean_scrub_stamp":"2024-03-09T15:12:26.747074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:07.340329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"261'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:32.932239+0000","last_change":"2024-03-09T15:12:32.932271+0000","last_active":"2024-03-09T15:12:32.932239+0000","last_peered":"2024-03-09T15:12:32.932239+0000","last_clean":"2024-03-09T15:12:32.932239+0000","last_became_active":"2024-03-09T14:38:34.421476+0000","last_became_peered":"2024-03-09T14:38:34.421476+0000","last_unstale":"2024-03-09T15:12:32.932239+0000","last_undegraded":"2024-03-09T15:12:32.932239+0000","last_fullsized":"2024-03-09T15:12:32.932239+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:12:32.932127+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:12:32.932127+0000","last_clean_scrub_stamp":"2024-03-09T15:12:32.932127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:42.544710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'115","reported_seq":397,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.153883+0000","last_change":"2024-03-09T15:11:59.153935+0000","last_active":"2024-03-09T15:11:59.153883+0000","last_peered":"2024-03-09T15:11:59.153883+0000","last_clean":"2024-03-09T15:11:59.153883+0000","last_became_active":"2024-03-09T14:35:41.125114+0000","last_became_peered":"2024-03-09T14:35:41.125114+0000","last_unstale":"2024-03-09T15:11:59.153883+0000","last_undegraded":"2024-03-09T15:11:59.153883+0000","last_fullsized":"2024-03-09T15:11:59.153883+0000","mapping_epoch":251,"log_start":"264'100","ondisk_log_start":"264'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-03-09T15:11:59.153761+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-03-09T15:11:59.153761+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.153761+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:13:38.381151+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":488,"num_write":144,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4176,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:48.403108+0000","last_change":"2024-03-09T15:12:48.403130+0000","last_active":"2024-03-09T15:12:48.403108+0000","last_peered":"2024-03-09T15:12:48.403108+0000","last_clean":"2024-03-09T15:12:48.403108+0000","last_became_active":"2024-03-09T14:50:35.510598+0000","last_became_peered":"2024-03-09T14:50:35.510598+0000","last_unstale":"2024-03-09T15:12:48.403108+0000","last_undegraded":"2024-03-09T15:12:48.403108+0000","last_fullsized":"2024-03-09T15:12:48.403108+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:48.403020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:48.403020+0000","last_clean_scrub_stamp":"2024-03-09T15:12:48.403020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:32:26.731812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:28.715928+0000","last_change":"2024-03-09T15:12:28.715952+0000","last_active":"2024-03-09T15:12:28.715928+0000","last_peered":"2024-03-09T15:12:28.715928+0000","last_clean":"2024-03-09T15:12:28.715928+0000","last_became_active":"2024-03-09T14:38:37.439360+0000","last_became_peered":"2024-03-09T14:38:37.439360+0000","last_unstale":"2024-03-09T15:12:28.715928+0000","last_undegraded":"2024-03-09T15:12:28.715928+0000","last_fullsized":"2024-03-09T15:12:28.715928+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:28.715839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:28.715839+0000","last_clean_scrub_stamp":"2024-03-09T15:12:28.715839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:58:55.924080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.165524+0000","last_change":"2024-03-09T15:11:54.165560+0000","last_active":"2024-03-09T15:11:54.165524+0000","last_peered":"2024-03-09T15:11:54.165524+0000","last_clean":"2024-03-09T15:11:54.165524+0000","last_became_active":"2024-03-09T14:38:34.419467+0000","last_became_peered":"2024-03-09T14:38:34.419467+0000","last_unstale":"2024-03-09T15:11:54.165524+0000","last_undegraded":"2024-03-09T15:11:54.165524+0000","last_fullsized":"2024-03-09T15:11:54.165524+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:11:54.165424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:11:54.165424+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.165424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:20:22.550276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'15","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.415399+0000","last_change":"2024-03-09T15:11:56.415425+0000","last_active":"2024-03-09T15:11:56.415399+0000","last_peered":"2024-03-09T15:11:56.415399+0000","last_clean":"2024-03-09T15:11:56.415399+0000","last_became_active":"2024-03-09T14:35:41.118591+0000","last_became_peered":"2024-03-09T14:35:41.118591+0000","last_unstale":"2024-03-09T15:11:56.415399+0000","last_undegraded":"2024-03-09T15:11:56.415399+0000","last_fullsized":"2024-03-09T15:11:56.415399+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'15","last_scrub_stamp":"2024-03-09T15:11:56.415294+0000","last_deep_scrub":"264'15","last_deep_scrub_stamp":"2024-03-09T15:11:56.415294+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.415294+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:22:01.480650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":42,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:44.381637+0000","last_change":"2024-03-09T15:12:44.381663+0000","last_active":"2024-03-09T15:12:44.381637+0000","last_peered":"2024-03-09T15:12:44.381637+0000","last_clean":"2024-03-09T15:12:44.381637+0000","last_became_active":"2024-03-09T14:50:35.503274+0000","last_became_peered":"2024-03-09T14:50:35.503274+0000","last_unstale":"2024-03-09T15:12:44.381637+0000","last_undegraded":"2024-03-09T15:12:44.381637+0000","last_fullsized":"2024-03-09T15:12:44.381637+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:44.381560+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:44.381560+0000","last_clean_scrub_stamp":"2024-03-09T15:12:44.381560+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:11:09.772211+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'6","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.104713+0000","last_change":"2024-03-09T15:12:06.104765+0000","last_active":"2024-03-09T15:12:06.104713+0000","last_peered":"2024-03-09T15:12:06.104713+0000","last_clean":"2024-03-09T15:12:06.104713+0000","last_became_active":"2024-03-09T14:38:37.436078+0000","last_became_peered":"2024-03-09T14:38:37.436078+0000","last_unstale":"2024-03-09T15:12:06.104713+0000","last_undegraded":"2024-03-09T15:12:06.104713+0000","last_fullsized":"2024-03-09T15:12:06.104713+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:12:06.104603+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:12:06.104603+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.104603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:59:01.145657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'6","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.368271+0000","last_change":"2024-03-09T15:12:23.368339+0000","last_active":"2024-03-09T15:12:23.368271+0000","last_peered":"2024-03-09T15:12:23.368271+0000","last_clean":"2024-03-09T15:12:23.368271+0000","last_became_active":"2024-03-09T14:38:34.419935+0000","last_became_peered":"2024-03-09T14:38:34.419935+0000","last_unstale":"2024-03-09T15:12:23.368271+0000","last_undegraded":"2024-03-09T15:12:23.368271+0000","last_fullsized":"2024-03-09T15:12:23.368271+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:12:23.368156+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:12:23.368156+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.368156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:27:10.114365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7208,"num_write":6,"num_write_kb":7208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'26","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.111431+0000","last_change":"2024-03-09T15:11:52.111489+0000","last_active":"2024-03-09T15:11:52.111431+0000","last_peered":"2024-03-09T15:11:52.111431+0000","last_clean":"2024-03-09T15:11:52.111431+0000","last_became_active":"2024-03-09T14:35:41.116852+0000","last_became_peered":"2024-03-09T14:35:41.116852+0000","last_unstale":"2024-03-09T15:11:52.111431+0000","last_undegraded":"2024-03-09T15:11:52.111431+0000","last_fullsized":"2024-03-09T15:11:52.111431+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-03-09T15:11:52.111320+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-03-09T15:11:52.111320+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.111320+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:02:00.553764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":65,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:49.101847+0000","last_change":"2024-03-09T15:12:49.101876+0000","last_active":"2024-03-09T15:12:49.101847+0000","last_peered":"2024-03-09T15:12:49.101847+0000","last_clean":"2024-03-09T15:12:49.101847+0000","last_became_active":"2024-03-09T14:50:35.509202+0000","last_became_peered":"2024-03-09T14:50:35.509202+0000","last_unstale":"2024-03-09T15:12:49.101847+0000","last_undegraded":"2024-03-09T15:12:49.101847+0000","last_fullsized":"2024-03-09T15:12:49.101847+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:49.101760+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:49.101760+0000","last_clean_scrub_stamp":"2024-03-09T15:12:49.101760+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:56:34.080472+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:27.346421+0000","last_change":"2024-03-09T15:12:27.346480+0000","last_active":"2024-03-09T15:12:27.346421+0000","last_peered":"2024-03-09T15:12:27.346421+0000","last_clean":"2024-03-09T15:12:27.346421+0000","last_became_active":"2024-03-09T14:38:37.441554+0000","last_became_peered":"2024-03-09T14:38:37.441554+0000","last_unstale":"2024-03-09T15:12:27.346421+0000","last_undegraded":"2024-03-09T15:12:27.346421+0000","last_fullsized":"2024-03-09T15:12:27.346421+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:27.346300+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:27.346300+0000","last_clean_scrub_stamp":"2024-03-09T15:12:27.346300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:55:13.522607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'2","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.424983+0000","last_change":"2024-03-09T15:12:07.425009+0000","last_active":"2024-03-09T15:12:07.424983+0000","last_peered":"2024-03-09T15:12:07.424983+0000","last_clean":"2024-03-09T15:12:07.424983+0000","last_became_active":"2024-03-09T14:38:34.424507+0000","last_became_peered":"2024-03-09T14:38:34.424507+0000","last_unstale":"2024-03-09T15:12:07.424983+0000","last_undegraded":"2024-03-09T15:12:07.424983+0000","last_fullsized":"2024-03-09T15:12:07.424983+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:07.424892+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:07.424892+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.424892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:44:56.004033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'52","reported_seq":178,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.134229+0000","last_change":"2024-03-09T15:11:59.134272+0000","last_active":"2024-03-09T15:11:59.134229+0000","last_peered":"2024-03-09T15:11:59.134229+0000","last_clean":"2024-03-09T15:11:59.134229+0000","last_became_active":"2024-03-09T14:35:41.116932+0000","last_became_peered":"2024-03-09T14:35:41.116932+0000","last_unstale":"2024-03-09T15:11:59.134229+0000","last_undegraded":"2024-03-09T15:11:59.134229+0000","last_fullsized":"2024-03-09T15:11:59.134229+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-03-09T15:11:59.134102+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-03-09T15:11:59.134102+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.134102+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:37.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":147,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.988650+0000","last_change":"2024-03-09T15:12:19.988650+0000","last_active":"2024-03-09T15:12:19.988650+0000","last_peered":"2024-03-09T15:12:19.988650+0000","last_clean":"2024-03-09T15:12:19.988650+0000","last_became_active":"2024-03-09T14:50:35.498045+0000","last_became_peered":"2024-03-09T14:50:35.498045+0000","last_unstale":"2024-03-09T15:12:19.988650+0000","last_undegraded":"2024-03-09T15:12:19.988650+0000","last_fullsized":"2024-03-09T15:12:19.988650+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:19.988501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:19.988501+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.988501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:24:29.592291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.107598+0000","last_change":"2024-03-09T15:12:14.107598+0000","last_active":"2024-03-09T15:12:14.107598+0000","last_peered":"2024-03-09T15:12:14.107598+0000","last_clean":"2024-03-09T15:12:14.107598+0000","last_became_active":"2024-03-09T14:38:37.436672+0000","last_became_peered":"2024-03-09T14:38:37.436672+0000","last_unstale":"2024-03-09T15:12:14.107598+0000","last_undegraded":"2024-03-09T15:12:14.107598+0000","last_fullsized":"2024-03-09T15:12:14.107598+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:12:14.107494+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:12:14.107494+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.107494+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:26.057559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'11","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.086271+0000","last_change":"2024-03-09T15:11:57.086271+0000","last_active":"2024-03-09T15:11:57.086271+0000","last_peered":"2024-03-09T15:11:57.086271+0000","last_clean":"2024-03-09T15:11:57.086271+0000","last_became_active":"2024-03-09T14:38:34.423136+0000","last_became_peered":"2024-03-09T14:38:34.423136+0000","last_unstale":"2024-03-09T15:11:57.086271+0000","last_undegraded":"2024-03-09T15:11:57.086271+0000","last_fullsized":"2024-03-09T15:11:57.086271+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-03-09T15:11:57.086146+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-03-09T15:11:57.086146+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.086146+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:08:25.289761+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'29","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.181901+0000","last_change":"2024-03-09T15:11:56.181925+0000","last_active":"2024-03-09T15:11:56.181901+0000","last_peered":"2024-03-09T15:11:56.181901+0000","last_clean":"2024-03-09T15:11:56.181901+0000","last_became_active":"2024-03-09T14:35:41.119901+0000","last_became_peered":"2024-03-09T14:35:41.119901+0000","last_unstale":"2024-03-09T15:11:56.181901+0000","last_undegraded":"2024-03-09T15:11:56.181901+0000","last_fullsized":"2024-03-09T15:11:56.181901+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-03-09T15:11:56.181805+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-03-09T15:11:56.181805+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.181805+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:32.492795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":86,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:49.943542+0000","last_change":"2024-03-09T15:12:49.943565+0000","last_active":"2024-03-09T15:12:49.943542+0000","last_peered":"2024-03-09T15:12:49.943542+0000","last_clean":"2024-03-09T15:12:49.943542+0000","last_became_active":"2024-03-09T14:50:35.510330+0000","last_became_peered":"2024-03-09T14:50:35.510330+0000","last_unstale":"2024-03-09T15:12:49.943542+0000","last_undegraded":"2024-03-09T15:12:49.943542+0000","last_fullsized":"2024-03-09T15:12:49.943542+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:49.943447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:49.943447+0000","last_clean_scrub_stamp":"2024-03-09T15:12:49.943447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:17:32.785058+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'10","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:37.247545+0000","last_change":"2024-03-09T15:12:37.247545+0000","last_active":"2024-03-09T15:12:37.247545+0000","last_peered":"2024-03-09T15:12:37.247545+0000","last_clean":"2024-03-09T15:12:37.247545+0000","last_became_active":"2024-03-09T14:39:04.819697+0000","last_became_peered":"2024-03-09T14:39:04.819697+0000","last_unstale":"2024-03-09T15:12:37.247545+0000","last_undegraded":"2024-03-09T15:12:37.247545+0000","last_fullsized":"2024-03-09T15:12:37.247545+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-03-09T15:12:37.247356+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-03-09T15:12:37.247356+0000","last_clean_scrub_stamp":"2024-03-09T15:12:37.247356+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:47:43.170880+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":4098,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.d","version":"264'10","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.752089+0000","last_change":"2024-03-09T15:11:50.752089+0000","last_active":"2024-03-09T15:11:50.752089+0000","last_peered":"2024-03-09T15:11:50.752089+0000","last_clean":"2024-03-09T15:11:50.752089+0000","last_became_active":"2024-03-09T14:38:34.416475+0000","last_became_peered":"2024-03-09T14:38:34.416475+0000","last_unstale":"2024-03-09T15:11:50.752089+0000","last_undegraded":"2024-03-09T15:11:50.752089+0000","last_fullsized":"2024-03-09T15:11:50.752089+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-03-09T15:11:50.751954+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-03-09T15:11:50.751954+0000","last_clean_scrub_stamp":"2024-03-09T15:11:50.751954+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:13:41.632453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4098,"num_write":13,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'38","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.323693+0000","last_change":"2024-03-09T15:11:55.323720+0000","last_active":"2024-03-09T15:11:55.323693+0000","last_peered":"2024-03-09T15:11:55.323693+0000","last_clean":"2024-03-09T15:11:55.323693+0000","last_became_active":"2024-03-09T14:35:41.119890+0000","last_became_peered":"2024-03-09T14:35:41.119890+0000","last_unstale":"2024-03-09T15:11:55.323693+0000","last_undegraded":"2024-03-09T15:11:55.323693+0000","last_fullsized":"2024-03-09T15:11:55.323693+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-03-09T15:11:55.323577+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-03-09T15:11:55.323577+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.323577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:32:34.891547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":99,"num_write":64,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:28.316997+0000","last_change":"2024-03-09T15:12:28.317038+0000","last_active":"2024-03-09T15:12:28.316997+0000","last_peered":"2024-03-09T15:12:28.316997+0000","last_clean":"2024-03-09T15:12:28.316997+0000","last_became_active":"2024-03-09T14:50:35.503207+0000","last_became_peered":"2024-03-09T14:50:35.503207+0000","last_unstale":"2024-03-09T15:12:28.316997+0000","last_undegraded":"2024-03-09T15:12:28.316997+0000","last_fullsized":"2024-03-09T15:12:28.316997+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:28.316902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:28.316902+0000","last_clean_scrub_stamp":"2024-03-09T15:12:28.316902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:36:59.795683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.947805+0000","last_change":"2024-03-09T15:11:59.947805+0000","last_active":"2024-03-09T15:11:59.947805+0000","last_peered":"2024-03-09T15:11:59.947805+0000","last_clean":"2024-03-09T15:11:59.947805+0000","last_became_active":"2024-03-09T14:38:37.438507+0000","last_became_peered":"2024-03-09T14:38:37.438507+0000","last_unstale":"2024-03-09T15:11:59.947805+0000","last_undegraded":"2024-03-09T15:11:59.947805+0000","last_fullsized":"2024-03-09T15:11:59.947805+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:59.947646+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:59.947646+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.947646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:49:38.139594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"261'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.416790+0000","last_change":"2024-03-09T15:12:03.416790+0000","last_active":"2024-03-09T15:12:03.416790+0000","last_peered":"2024-03-09T15:12:03.416790+0000","last_clean":"2024-03-09T15:12:03.416790+0000","last_became_active":"2024-03-09T14:38:34.419043+0000","last_became_peered":"2024-03-09T14:38:34.419043+0000","last_unstale":"2024-03-09T15:12:03.416790+0000","last_undegraded":"2024-03-09T15:12:03.416790+0000","last_fullsized":"2024-03-09T15:12:03.416790+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:12:03.416671+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:12:03.416671+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.416671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:13.207851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'89","reported_seq":342,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.286986+0000","last_change":"2024-03-09T15:11:55.287018+0000","last_active":"2024-03-09T15:11:55.286986+0000","last_peered":"2024-03-09T15:11:55.286986+0000","last_clean":"2024-03-09T15:11:55.286986+0000","last_became_active":"2024-03-09T14:35:41.117590+0000","last_became_peered":"2024-03-09T14:35:41.117590+0000","last_unstale":"2024-03-09T15:11:55.286986+0000","last_undegraded":"2024-03-09T15:11:55.286986+0000","last_fullsized":"2024-03-09T15:11:55.286986+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'89","last_scrub_stamp":"2024-03-09T15:11:55.286893+0000","last_deep_scrub":"264'89","last_deep_scrub_stamp":"2024-03-09T15:11:55.286893+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.286893+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:09.078407+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":440,"num_write":100,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4491,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:47.913101+0000","last_change":"2024-03-09T15:12:47.913123+0000","last_active":"2024-03-09T15:12:47.913101+0000","last_peered":"2024-03-09T15:12:47.913101+0000","last_clean":"2024-03-09T15:12:47.913101+0000","last_became_active":"2024-03-09T14:50:35.508832+0000","last_became_peered":"2024-03-09T14:50:35.508832+0000","last_unstale":"2024-03-09T15:12:47.913101+0000","last_undegraded":"2024-03-09T15:12:47.913101+0000","last_fullsized":"2024-03-09T15:12:47.913101+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:47.913005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:47.913005+0000","last_clean_scrub_stamp":"2024-03-09T15:12:47.913005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:55:23.260450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'7","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:46.112414+0000","last_change":"2024-03-09T15:12:46.112445+0000","last_active":"2024-03-09T15:12:46.112414+0000","last_peered":"2024-03-09T15:12:46.112414+0000","last_clean":"2024-03-09T15:12:46.112414+0000","last_became_active":"2024-03-09T14:38:37.439177+0000","last_became_peered":"2024-03-09T14:38:37.439177+0000","last_unstale":"2024-03-09T15:12:46.112414+0000","last_undegraded":"2024-03-09T15:12:46.112414+0000","last_fullsized":"2024-03-09T15:12:46.112414+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-03-09T15:12:46.112322+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-03-09T15:12:46.112322+0000","last_clean_scrub_stamp":"2024-03-09T15:12:46.112322+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:33:12.468394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'2","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.077579+0000","last_change":"2024-03-09T15:11:51.077579+0000","last_active":"2024-03-09T15:11:51.077579+0000","last_peered":"2024-03-09T15:11:51.077579+0000","last_clean":"2024-03-09T15:11:51.077579+0000","last_became_active":"2024-03-09T14:38:34.419461+0000","last_became_peered":"2024-03-09T14:38:34.419461+0000","last_unstale":"2024-03-09T15:11:51.077579+0000","last_undegraded":"2024-03-09T15:11:51.077579+0000","last_fullsized":"2024-03-09T15:11:51.077579+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:51.077473+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:51.077473+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.077473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:06:44.961094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'58","reported_seq":201,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.923615+0000","last_change":"2024-03-09T15:12:03.923641+0000","last_active":"2024-03-09T15:12:03.923615+0000","last_peered":"2024-03-09T15:12:03.923615+0000","last_clean":"2024-03-09T15:12:03.923615+0000","last_became_active":"2024-03-09T14:35:41.115769+0000","last_became_peered":"2024-03-09T14:35:41.115769+0000","last_unstale":"2024-03-09T15:12:03.923615+0000","last_undegraded":"2024-03-09T15:12:03.923615+0000","last_fullsized":"2024-03-09T15:12:03.923615+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'58","last_scrub_stamp":"2024-03-09T15:12:03.923518+0000","last_deep_scrub":"264'58","last_deep_scrub_stamp":"2024-03-09T15:12:03.923518+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.923518+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:51:21.138456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":187,"num_write":89,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:50.099020+0000","last_change":"2024-03-09T15:12:50.099058+0000","last_active":"2024-03-09T15:12:50.099020+0000","last_peered":"2024-03-09T15:12:50.099020+0000","last_clean":"2024-03-09T15:12:50.099020+0000","last_became_active":"2024-03-09T14:50:35.512515+0000","last_became_peered":"2024-03-09T14:50:35.512515+0000","last_unstale":"2024-03-09T15:12:50.099020+0000","last_undegraded":"2024-03-09T15:12:50.099020+0000","last_fullsized":"2024-03-09T15:12:50.099020+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:50.098918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:50.098918+0000","last_clean_scrub_stamp":"2024-03-09T15:12:50.098918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:26:29.163615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'8","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:35.908414+0000","last_change":"2024-03-09T15:12:35.908448+0000","last_active":"2024-03-09T15:12:35.908414+0000","last_peered":"2024-03-09T15:12:35.908414+0000","last_clean":"2024-03-09T15:12:35.908414+0000","last_became_active":"2024-03-09T14:38:37.437674+0000","last_became_peered":"2024-03-09T14:38:37.437674+0000","last_unstale":"2024-03-09T15:12:35.908414+0000","last_undegraded":"2024-03-09T15:12:35.908414+0000","last_fullsized":"2024-03-09T15:12:35.908414+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-03-09T15:12:35.908322+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-03-09T15:12:35.908322+0000","last_clean_scrub_stamp":"2024-03-09T15:12:35.908322+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:34:09.505311+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'11","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.443513+0000","last_change":"2024-03-09T15:11:55.443557+0000","last_active":"2024-03-09T15:11:55.443513+0000","last_peered":"2024-03-09T15:11:55.443513+0000","last_clean":"2024-03-09T15:11:55.443513+0000","last_became_active":"2024-03-09T14:38:34.416635+0000","last_became_peered":"2024-03-09T14:38:34.416635+0000","last_unstale":"2024-03-09T15:11:55.443513+0000","last_undegraded":"2024-03-09T15:11:55.443513+0000","last_fullsized":"2024-03-09T15:11:55.443513+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-03-09T15:11:55.443427+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-03-09T15:11:55.443427+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.443427+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:28:32.324995+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'78","reported_seq":253,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.439208+0000","last_change":"2024-03-09T15:11:57.439251+0000","last_active":"2024-03-09T15:11:57.439208+0000","last_peered":"2024-03-09T15:11:57.439208+0000","last_clean":"2024-03-09T15:11:57.439208+0000","last_became_active":"2024-03-09T14:35:41.113283+0000","last_became_peered":"2024-03-09T14:35:41.113283+0000","last_unstale":"2024-03-09T15:11:57.439208+0000","last_undegraded":"2024-03-09T15:11:57.439208+0000","last_fullsized":"2024-03-09T15:11:57.439208+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'78","last_scrub_stamp":"2024-03-09T15:11:57.439095+0000","last_deep_scrub":"264'78","last_deep_scrub_stamp":"2024-03-09T15:11:57.439095+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.439095+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:21:29.929734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":352,"num_read_kb":252,"num_write":133,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:48.900421+0000","last_change":"2024-03-09T15:12:48.900450+0000","last_active":"2024-03-09T15:12:48.900421+0000","last_peered":"2024-03-09T15:12:48.900421+0000","last_clean":"2024-03-09T15:12:48.900421+0000","last_became_active":"2024-03-09T14:50:35.509248+0000","last_became_peered":"2024-03-09T14:50:35.509248+0000","last_unstale":"2024-03-09T15:12:48.900421+0000","last_undegraded":"2024-03-09T15:12:48.900421+0000","last_fullsized":"2024-03-09T15:12:48.900421+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:48.900326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:48.900326+0000","last_clean_scrub_stamp":"2024-03-09T15:12:48.900326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:51.553784+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.080140+0000","last_change":"2024-03-09T15:12:05.080203+0000","last_active":"2024-03-09T15:12:05.080140+0000","last_peered":"2024-03-09T15:12:05.080140+0000","last_clean":"2024-03-09T15:12:05.080140+0000","last_became_active":"2024-03-09T14:38:37.432007+0000","last_became_peered":"2024-03-09T14:38:37.432007+0000","last_unstale":"2024-03-09T15:12:05.080140+0000","last_undegraded":"2024-03-09T15:12:05.080140+0000","last_fullsized":"2024-03-09T15:12:05.080140+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:12:05.080028+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:12:05.080028+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.080028+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:16:23.673108+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"261'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:50.059541+0000","last_change":"2024-03-09T15:11:50.059591+0000","last_active":"2024-03-09T15:11:50.059541+0000","last_peered":"2024-03-09T15:11:50.059541+0000","last_clean":"2024-03-09T15:11:50.059541+0000","last_became_active":"2024-03-09T14:38:34.419582+0000","last_became_peered":"2024-03-09T14:38:34.419582+0000","last_unstale":"2024-03-09T15:11:50.059541+0000","last_undegraded":"2024-03-09T15:11:50.059541+0000","last_fullsized":"2024-03-09T15:11:50.059541+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:11:50.059454+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:11:50.059454+0000","last_clean_scrub_stamp":"2024-03-09T15:11:50.059454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:11.962230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"261'10","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.067857+0000","last_change":"2024-03-09T15:12:02.067857+0000","last_active":"2024-03-09T15:12:02.067857+0000","last_peered":"2024-03-09T15:12:02.067857+0000","last_clean":"2024-03-09T15:12:02.067857+0000","last_became_active":"2024-03-09T14:35:41.122670+0000","last_became_peered":"2024-03-09T14:35:41.122670+0000","last_unstale":"2024-03-09T15:12:02.067857+0000","last_undegraded":"2024-03-09T15:12:02.067857+0000","last_fullsized":"2024-03-09T15:12:02.067857+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'10","last_scrub_stamp":"2024-03-09T15:12:02.067736+0000","last_deep_scrub":"261'10","last_deep_scrub_stamp":"2024-03-09T15:12:02.067736+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.067736+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:30.445400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:45.845538+0000","last_change":"2024-03-09T15:12:45.845593+0000","last_active":"2024-03-09T15:12:45.845538+0000","last_peered":"2024-03-09T15:12:45.845538+0000","last_clean":"2024-03-09T15:12:45.845538+0000","last_became_active":"2024-03-09T14:50:35.506542+0000","last_became_peered":"2024-03-09T14:50:35.506542+0000","last_unstale":"2024-03-09T15:12:45.845538+0000","last_undegraded":"2024-03-09T15:12:45.845538+0000","last_fullsized":"2024-03-09T15:12:45.845538+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:45.845423+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:45.845423+0000","last_clean_scrub_stamp":"2024-03-09T15:12:45.845423+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:15:04.102604+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:29.763394+0000","last_change":"2024-03-09T15:12:29.763419+0000","last_active":"2024-03-09T15:12:29.763394+0000","last_peered":"2024-03-09T15:12:29.763394+0000","last_clean":"2024-03-09T15:12:29.763394+0000","last_became_active":"2024-03-09T14:38:37.439444+0000","last_became_peered":"2024-03-09T14:38:37.439444+0000","last_unstale":"2024-03-09T15:12:29.763394+0000","last_undegraded":"2024-03-09T15:12:29.763394+0000","last_fullsized":"2024-03-09T15:12:29.763394+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:12:29.763254+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:12:29.763254+0000","last_clean_scrub_stamp":"2024-03-09T15:12:29.763254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:06.184691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.434628+0000","last_change":"2024-03-09T15:11:51.434678+0000","last_active":"2024-03-09T15:11:51.434628+0000","last_peered":"2024-03-09T15:11:51.434628+0000","last_clean":"2024-03-09T15:11:51.434628+0000","last_became_active":"2024-03-09T14:38:34.416139+0000","last_became_peered":"2024-03-09T14:38:34.416139+0000","last_unstale":"2024-03-09T15:11:51.434628+0000","last_undegraded":"2024-03-09T15:11:51.434628+0000","last_fullsized":"2024-03-09T15:11:51.434628+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:51.434539+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:51.434539+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.434539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:58:52.717684+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'57","reported_seq":197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.131507+0000","last_change":"2024-03-09T15:11:53.131507+0000","last_active":"2024-03-09T15:11:53.131507+0000","last_peered":"2024-03-09T15:11:53.131507+0000","last_clean":"2024-03-09T15:11:53.131507+0000","last_became_active":"2024-03-09T14:35:41.120802+0000","last_became_peered":"2024-03-09T14:35:41.120802+0000","last_unstale":"2024-03-09T15:11:53.131507+0000","last_undegraded":"2024-03-09T15:11:53.131507+0000","last_fullsized":"2024-03-09T15:11:53.131507+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'57","last_scrub_stamp":"2024-03-09T15:11:53.131366+0000","last_deep_scrub":"264'57","last_deep_scrub_stamp":"2024-03-09T15:11:53.131366+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.131366+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:33.973786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":244,"num_read_kb":179,"num_write":100,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:46.356531+0000","last_change":"2024-03-09T15:12:46.356554+0000","last_active":"2024-03-09T15:12:46.356531+0000","last_peered":"2024-03-09T15:12:46.356531+0000","last_clean":"2024-03-09T15:12:46.356531+0000","last_became_active":"2024-03-09T14:50:35.505278+0000","last_became_peered":"2024-03-09T14:50:35.505278+0000","last_unstale":"2024-03-09T15:12:46.356531+0000","last_undegraded":"2024-03-09T15:12:46.356531+0000","last_fullsized":"2024-03-09T15:12:46.356531+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:46.356445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:46.356445+0000","last_clean_scrub_stamp":"2024-03-09T15:12:46.356445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:44:21.344407+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.021464+0000","last_change":"2024-03-09T15:12:09.021489+0000","last_active":"2024-03-09T15:12:09.021464+0000","last_peered":"2024-03-09T15:12:09.021464+0000","last_clean":"2024-03-09T15:12:09.021464+0000","last_became_active":"2024-03-09T14:38:37.435952+0000","last_became_peered":"2024-03-09T14:38:37.435952+0000","last_unstale":"2024-03-09T15:12:09.021464+0000","last_undegraded":"2024-03-09T15:12:09.021464+0000","last_fullsized":"2024-03-09T15:12:09.021464+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:09.021368+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:09.021368+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.021368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:24.869644+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.117193+0000","last_change":"2024-03-09T15:12:02.117193+0000","last_active":"2024-03-09T15:12:02.117193+0000","last_peered":"2024-03-09T15:12:02.117193+0000","last_clean":"2024-03-09T15:12:02.117193+0000","last_became_active":"2024-03-09T14:38:34.420453+0000","last_became_peered":"2024-03-09T14:38:34.420453+0000","last_unstale":"2024-03-09T15:12:02.117193+0000","last_undegraded":"2024-03-09T15:12:02.117193+0000","last_fullsized":"2024-03-09T15:12:02.117193+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:12:02.117071+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:12:02.117071+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.117071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:07:29.454344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":4,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'47","reported_seq":174,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.237161+0000","last_change":"2024-03-09T15:11:53.237161+0000","last_active":"2024-03-09T15:11:53.237161+0000","last_peered":"2024-03-09T15:11:53.237161+0000","last_clean":"2024-03-09T15:11:53.237161+0000","last_became_active":"2024-03-09T14:35:41.119481+0000","last_became_peered":"2024-03-09T14:35:41.119481+0000","last_unstale":"2024-03-09T15:11:53.237161+0000","last_undegraded":"2024-03-09T15:11:53.237161+0000","last_fullsized":"2024-03-09T15:11:53.237161+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-03-09T15:11:53.237044+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-03-09T15:11:53.237044+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.237044+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:14.411457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":141,"num_write":77,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:46.872216+0000","last_change":"2024-03-09T15:12:46.872258+0000","last_active":"2024-03-09T15:12:46.872216+0000","last_peered":"2024-03-09T15:12:46.872216+0000","last_clean":"2024-03-09T15:12:46.872216+0000","last_became_active":"2024-03-09T14:50:35.508707+0000","last_became_peered":"2024-03-09T14:50:35.508707+0000","last_unstale":"2024-03-09T15:12:46.872216+0000","last_undegraded":"2024-03-09T15:12:46.872216+0000","last_fullsized":"2024-03-09T15:12:46.872216+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:46.872101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:46.872101+0000","last_clean_scrub_stamp":"2024-03-09T15:12:46.872101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:59:39.774920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:43.396073+0000","last_change":"2024-03-09T15:12:43.396106+0000","last_active":"2024-03-09T15:12:43.396073+0000","last_peered":"2024-03-09T15:12:43.396073+0000","last_clean":"2024-03-09T15:12:43.396073+0000","last_became_active":"2024-03-09T14:38:37.443923+0000","last_became_peered":"2024-03-09T14:38:37.443923+0000","last_unstale":"2024-03-09T15:12:43.396073+0000","last_undegraded":"2024-03-09T15:12:43.396073+0000","last_fullsized":"2024-03-09T15:12:43.396073+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:12:43.395971+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:12:43.395971+0000","last_clean_scrub_stamp":"2024-03-09T15:12:43.395971+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:27.364786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'9","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.106603+0000","last_change":"2024-03-09T15:11:56.106603+0000","last_active":"2024-03-09T15:11:56.106603+0000","last_peered":"2024-03-09T15:11:56.106603+0000","last_clean":"2024-03-09T15:11:56.106603+0000","last_became_active":"2024-03-09T14:38:34.421150+0000","last_became_peered":"2024-03-09T14:38:34.421150+0000","last_unstale":"2024-03-09T15:11:56.106603+0000","last_undegraded":"2024-03-09T15:11:56.106603+0000","last_fullsized":"2024-03-09T15:11:56.106603+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-03-09T15:11:56.106469+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-03-09T15:11:56.106469+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.106469+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:26.682205+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":24,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'56","reported_seq":196,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.445236+0000","last_change":"2024-03-09T15:11:54.445236+0000","last_active":"2024-03-09T15:11:54.445236+0000","last_peered":"2024-03-09T15:11:54.445236+0000","last_clean":"2024-03-09T15:11:54.445236+0000","last_became_active":"2024-03-09T14:35:41.121047+0000","last_became_peered":"2024-03-09T14:35:41.121047+0000","last_unstale":"2024-03-09T15:11:54.445236+0000","last_undegraded":"2024-03-09T15:11:54.445236+0000","last_fullsized":"2024-03-09T15:11:54.445236+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'56","last_scrub_stamp":"2024-03-09T15:11:54.445106+0000","last_deep_scrub":"264'56","last_deep_scrub_stamp":"2024-03-09T15:11:54.445106+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.445106+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:18:07.884126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":176,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:40.215122+0000","last_change":"2024-03-09T15:12:40.215147+0000","last_active":"2024-03-09T15:12:40.215122+0000","last_peered":"2024-03-09T15:12:40.215122+0000","last_clean":"2024-03-09T15:12:40.215122+0000","last_became_active":"2024-03-09T14:50:35.512540+0000","last_became_peered":"2024-03-09T14:50:35.512540+0000","last_unstale":"2024-03-09T15:12:40.215122+0000","last_undegraded":"2024-03-09T15:12:40.215122+0000","last_fullsized":"2024-03-09T15:12:40.215122+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:40.215030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:40.215030+0000","last_clean_scrub_stamp":"2024-03-09T15:12:40.215030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:59:43.191438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"261'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.547837+0000","last_change":"2024-03-09T15:12:15.547863+0000","last_active":"2024-03-09T15:12:15.547837+0000","last_peered":"2024-03-09T15:12:15.547837+0000","last_clean":"2024-03-09T15:12:15.547837+0000","last_became_active":"2024-03-09T14:38:37.436246+0000","last_became_peered":"2024-03-09T14:38:37.436246+0000","last_unstale":"2024-03-09T15:12:15.547837+0000","last_undegraded":"2024-03-09T15:12:15.547837+0000","last_fullsized":"2024-03-09T15:12:15.547837+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:12:15.547748+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:12:15.547748+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.547748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:43.692708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.937352+0000","last_change":"2024-03-09T15:12:16.937392+0000","last_active":"2024-03-09T15:12:16.937352+0000","last_peered":"2024-03-09T15:12:16.937352+0000","last_clean":"2024-03-09T15:12:16.937352+0000","last_became_active":"2024-03-09T14:38:34.417530+0000","last_became_peered":"2024-03-09T14:38:34.417530+0000","last_unstale":"2024-03-09T15:12:16.937352+0000","last_undegraded":"2024-03-09T15:12:16.937352+0000","last_fullsized":"2024-03-09T15:12:16.937352+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:16.937207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:16.937207+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.937207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:40:55.122603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'34","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.290231+0000","last_change":"2024-03-09T15:11:57.290231+0000","last_active":"2024-03-09T15:11:57.290231+0000","last_peered":"2024-03-09T15:11:57.290231+0000","last_clean":"2024-03-09T15:11:57.290231+0000","last_became_active":"2024-03-09T14:35:41.116050+0000","last_became_peered":"2024-03-09T14:35:41.116050+0000","last_unstale":"2024-03-09T15:11:57.290231+0000","last_undegraded":"2024-03-09T15:11:57.290231+0000","last_fullsized":"2024-03-09T15:11:57.290231+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-03-09T15:11:57.290111+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-03-09T15:11:57.290111+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.290111+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:40:12.008655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":98,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:32.800947+0000","last_change":"2024-03-09T15:12:32.800947+0000","last_active":"2024-03-09T15:12:32.800947+0000","last_peered":"2024-03-09T15:12:32.800947+0000","last_clean":"2024-03-09T15:12:32.800947+0000","last_became_active":"2024-03-09T14:50:35.512533+0000","last_became_peered":"2024-03-09T14:50:35.512533+0000","last_unstale":"2024-03-09T15:12:32.800947+0000","last_undegraded":"2024-03-09T15:12:32.800947+0000","last_fullsized":"2024-03-09T15:12:32.800947+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:32.800794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:32.800794+0000","last_clean_scrub_stamp":"2024-03-09T15:12:32.800794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:12:21.441156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.082439+0000","last_change":"2024-03-09T15:12:01.082464+0000","last_active":"2024-03-09T15:12:01.082439+0000","last_peered":"2024-03-09T15:12:01.082439+0000","last_clean":"2024-03-09T15:12:01.082439+0000","last_became_active":"2024-03-09T14:38:37.432627+0000","last_became_peered":"2024-03-09T14:38:37.432627+0000","last_unstale":"2024-03-09T15:12:01.082439+0000","last_undegraded":"2024-03-09T15:12:01.082439+0000","last_fullsized":"2024-03-09T15:12:01.082439+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:12:01.082349+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:12:01.082349+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.082349+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:29:35.802601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.329616+0000","last_change":"2024-03-09T15:11:59.329643+0000","last_active":"2024-03-09T15:11:59.329616+0000","last_peered":"2024-03-09T15:11:59.329616+0000","last_clean":"2024-03-09T15:11:59.329616+0000","last_became_active":"2024-03-09T14:38:34.415277+0000","last_became_peered":"2024-03-09T14:38:34.415277+0000","last_unstale":"2024-03-09T15:11:59.329616+0000","last_undegraded":"2024-03-09T15:11:59.329616+0000","last_fullsized":"2024-03-09T15:11:59.329616+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:11:59.329530+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:11:59.329530+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.329530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:30:14.001843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'18","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.111501+0000","last_change":"2024-03-09T15:12:00.111526+0000","last_active":"2024-03-09T15:12:00.111501+0000","last_peered":"2024-03-09T15:12:00.111501+0000","last_clean":"2024-03-09T15:12:00.111501+0000","last_became_active":"2024-03-09T14:35:41.123542+0000","last_became_peered":"2024-03-09T14:35:41.123542+0000","last_unstale":"2024-03-09T15:12:00.111501+0000","last_undegraded":"2024-03-09T15:12:00.111501+0000","last_fullsized":"2024-03-09T15:12:00.111501+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-03-09T15:12:00.111408+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-03-09T15:12:00.111408+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.111408+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:58:58.676620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":44,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:38.936108+0000","last_change":"2024-03-09T15:12:38.936135+0000","last_active":"2024-03-09T15:12:38.936108+0000","last_peered":"2024-03-09T15:12:38.936108+0000","last_clean":"2024-03-09T15:12:38.936108+0000","last_became_active":"2024-03-09T14:50:35.506332+0000","last_became_peered":"2024-03-09T14:50:35.506332+0000","last_unstale":"2024-03-09T15:12:38.936108+0000","last_undegraded":"2024-03-09T15:12:38.936108+0000","last_fullsized":"2024-03-09T15:12:38.936108+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:38.936016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:38.936016+0000","last_clean_scrub_stamp":"2024-03-09T15:12:38.936016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:26:36.462453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:36.893315+0000","last_change":"2024-03-09T15:12:36.893355+0000","last_active":"2024-03-09T15:12:36.893315+0000","last_peered":"2024-03-09T15:12:36.893315+0000","last_clean":"2024-03-09T15:12:36.893315+0000","last_became_active":"2024-03-09T14:38:37.438182+0000","last_became_peered":"2024-03-09T14:38:37.438182+0000","last_unstale":"2024-03-09T15:12:36.893315+0000","last_undegraded":"2024-03-09T15:12:36.893315+0000","last_fullsized":"2024-03-09T15:12:36.893315+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:12:36.893220+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:12:36.893220+0000","last_clean_scrub_stamp":"2024-03-09T15:12:36.893220+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:21:46.808530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.060938+0000","last_change":"2024-03-09T15:11:54.060989+0000","last_active":"2024-03-09T15:11:54.060938+0000","last_peered":"2024-03-09T15:11:54.060938+0000","last_clean":"2024-03-09T15:11:54.060938+0000","last_became_active":"2024-03-09T14:38:34.423106+0000","last_became_peered":"2024-03-09T14:38:34.423106+0000","last_unstale":"2024-03-09T15:11:54.060938+0000","last_undegraded":"2024-03-09T15:11:54.060938+0000","last_fullsized":"2024-03-09T15:11:54.060938+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:54.060823+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:54.060823+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.060823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:12:09.238327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'25","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.105170+0000","last_change":"2024-03-09T15:11:54.105214+0000","last_active":"2024-03-09T15:11:54.105170+0000","last_peered":"2024-03-09T15:11:54.105170+0000","last_clean":"2024-03-09T15:11:54.105170+0000","last_became_active":"2024-03-09T14:35:41.117841+0000","last_became_peered":"2024-03-09T14:35:41.117841+0000","last_unstale":"2024-03-09T15:11:54.105170+0000","last_undegraded":"2024-03-09T15:11:54.105170+0000","last_fullsized":"2024-03-09T15:11:54.105170+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-03-09T15:11:54.105043+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-03-09T15:11:54.105043+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.105043+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:41.171924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":73,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.053058+0000","last_change":"2024-03-09T15:12:23.053090+0000","last_active":"2024-03-09T15:12:23.053058+0000","last_peered":"2024-03-09T15:12:23.053058+0000","last_clean":"2024-03-09T15:12:23.053058+0000","last_became_active":"2024-03-09T14:50:35.509460+0000","last_became_peered":"2024-03-09T14:50:35.509460+0000","last_unstale":"2024-03-09T15:12:23.053058+0000","last_undegraded":"2024-03-09T15:12:23.053058+0000","last_fullsized":"2024-03-09T15:12:23.053058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:23.052971+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:23.052971+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.052971+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:24:39.241271+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:27.727172+0000","last_change":"2024-03-09T15:12:27.727198+0000","last_active":"2024-03-09T15:12:27.727172+0000","last_peered":"2024-03-09T15:12:27.727172+0000","last_clean":"2024-03-09T15:12:27.727172+0000","last_became_active":"2024-03-09T14:38:37.439087+0000","last_became_peered":"2024-03-09T14:38:37.439087+0000","last_unstale":"2024-03-09T15:12:27.727172+0000","last_undegraded":"2024-03-09T15:12:27.727172+0000","last_fullsized":"2024-03-09T15:12:27.727172+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:27.727077+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:27.727077+0000","last_clean_scrub_stamp":"2024-03-09T15:12:27.727077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:06:37.922331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.105040+0000","last_change":"2024-03-09T15:11:58.105040+0000","last_active":"2024-03-09T15:11:58.105040+0000","last_peered":"2024-03-09T15:11:58.105040+0000","last_clean":"2024-03-09T15:11:58.105040+0000","last_became_active":"2024-03-09T14:38:34.418453+0000","last_became_peered":"2024-03-09T14:38:34.418453+0000","last_unstale":"2024-03-09T15:11:58.105040+0000","last_undegraded":"2024-03-09T15:11:58.105040+0000","last_fullsized":"2024-03-09T15:11:58.105040+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:11:58.104921+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:11:58.104921+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.104921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:02:06.522978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'42","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.368598+0000","last_change":"2024-03-09T15:11:51.368625+0000","last_active":"2024-03-09T15:11:51.368598+0000","last_peered":"2024-03-09T15:11:51.368598+0000","last_clean":"2024-03-09T15:11:51.368598+0000","last_became_active":"2024-03-09T14:35:41.119181+0000","last_became_peered":"2024-03-09T14:35:41.119181+0000","last_unstale":"2024-03-09T15:11:51.368598+0000","last_undegraded":"2024-03-09T15:11:51.368598+0000","last_fullsized":"2024-03-09T15:11:51.368598+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-03-09T15:11:51.368508+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-03-09T15:11:51.368508+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.368508+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:30:47.169740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":129,"num_write":69,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:45.401367+0000","last_change":"2024-03-09T15:12:45.401394+0000","last_active":"2024-03-09T15:12:45.401367+0000","last_peered":"2024-03-09T15:12:45.401367+0000","last_clean":"2024-03-09T15:12:45.401367+0000","last_became_active":"2024-03-09T14:50:35.503858+0000","last_became_peered":"2024-03-09T14:50:35.503858+0000","last_unstale":"2024-03-09T15:12:45.401367+0000","last_undegraded":"2024-03-09T15:12:45.401367+0000","last_fullsized":"2024-03-09T15:12:45.401367+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:45.401271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:45.401271+0000","last_clean_scrub_stamp":"2024-03-09T15:12:45.401271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:25:53.140226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:34.345331+0000","last_change":"2024-03-09T15:12:34.345331+0000","last_active":"2024-03-09T15:12:34.345331+0000","last_peered":"2024-03-09T15:12:34.345331+0000","last_clean":"2024-03-09T15:12:34.345331+0000","last_became_active":"2024-03-09T14:38:37.434065+0000","last_became_peered":"2024-03-09T14:38:37.434065+0000","last_unstale":"2024-03-09T15:12:34.345331+0000","last_undegraded":"2024-03-09T15:12:34.345331+0000","last_fullsized":"2024-03-09T15:12:34.345331+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:34.345166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:34.345166+0000","last_clean_scrub_stamp":"2024-03-09T15:12:34.345166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:17:45.443588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'4","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.108634+0000","last_change":"2024-03-09T15:11:53.108634+0000","last_active":"2024-03-09T15:11:53.108634+0000","last_peered":"2024-03-09T15:11:53.108634+0000","last_clean":"2024-03-09T15:11:53.108634+0000","last_became_active":"2024-03-09T14:38:34.423145+0000","last_became_peered":"2024-03-09T14:38:34.423145+0000","last_unstale":"2024-03-09T15:11:53.108634+0000","last_undegraded":"2024-03-09T15:11:53.108634+0000","last_fullsized":"2024-03-09T15:11:53.108634+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:11:53.108507+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:11:53.108507+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.108507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:06:47.906719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'41","reported_seq":155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.081553+0000","last_change":"2024-03-09T15:11:51.081580+0000","last_active":"2024-03-09T15:11:51.081553+0000","last_peered":"2024-03-09T15:11:51.081553+0000","last_clean":"2024-03-09T15:11:51.081553+0000","last_became_active":"2024-03-09T14:35:41.117617+0000","last_became_peered":"2024-03-09T14:35:41.117617+0000","last_unstale":"2024-03-09T15:11:51.081553+0000","last_undegraded":"2024-03-09T15:11:51.081553+0000","last_fullsized":"2024-03-09T15:11:51.081553+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-03-09T15:11:51.081467+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-03-09T15:11:51.081467+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.081467+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:57:36.656065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":72,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:47.354818+0000","last_change":"2024-03-09T15:12:47.354845+0000","last_active":"2024-03-09T15:12:47.354818+0000","last_peered":"2024-03-09T15:12:47.354818+0000","last_clean":"2024-03-09T15:12:47.354818+0000","last_became_active":"2024-03-09T14:50:35.506356+0000","last_became_peered":"2024-03-09T14:50:35.506356+0000","last_unstale":"2024-03-09T15:12:47.354818+0000","last_undegraded":"2024-03-09T15:12:47.354818+0000","last_fullsized":"2024-03-09T15:12:47.354818+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:47.354674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:47.354674+0000","last_clean_scrub_stamp":"2024-03-09T15:12:47.354674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:24:00.795329+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:26.357066+0000","last_change":"2024-03-09T15:12:26.357094+0000","last_active":"2024-03-09T15:12:26.357066+0000","last_peered":"2024-03-09T15:12:26.357066+0000","last_clean":"2024-03-09T15:12:26.357066+0000","last_became_active":"2024-03-09T14:38:37.439120+0000","last_became_peered":"2024-03-09T14:38:37.439120+0000","last_unstale":"2024-03-09T15:12:26.357066+0000","last_undegraded":"2024-03-09T15:12:26.357066+0000","last_fullsized":"2024-03-09T15:12:26.357066+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:12:26.356975+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:12:26.356975+0000","last_clean_scrub_stamp":"2024-03-09T15:12:26.356975+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:20:30.951668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'5","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.071993+0000","last_change":"2024-03-09T15:11:52.071993+0000","last_active":"2024-03-09T15:11:52.071993+0000","last_peered":"2024-03-09T15:11:52.071993+0000","last_clean":"2024-03-09T15:11:52.071993+0000","last_became_active":"2024-03-09T14:38:34.422585+0000","last_became_peered":"2024-03-09T14:38:34.422585+0000","last_unstale":"2024-03-09T15:11:52.071993+0000","last_undegraded":"2024-03-09T15:11:52.071993+0000","last_fullsized":"2024-03-09T15:11:52.071993+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:11:52.071888+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:11:52.071888+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.071888+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:53:01.363827+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'19","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.256100+0000","last_change":"2024-03-09T15:11:54.256127+0000","last_active":"2024-03-09T15:11:54.256100+0000","last_peered":"2024-03-09T15:11:54.256100+0000","last_clean":"2024-03-09T15:11:54.256100+0000","last_became_active":"2024-03-09T14:35:41.118425+0000","last_became_peered":"2024-03-09T14:35:41.118425+0000","last_unstale":"2024-03-09T15:11:54.256100+0000","last_undegraded":"2024-03-09T15:11:54.256100+0000","last_fullsized":"2024-03-09T15:11:54.256100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'19","last_scrub_stamp":"2024-03-09T15:11:54.256010+0000","last_deep_scrub":"264'19","last_deep_scrub_stamp":"2024-03-09T15:11:54.256010+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.256010+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:26.207996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":53,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:44.842628+0000","last_change":"2024-03-09T15:12:44.842653+0000","last_active":"2024-03-09T15:12:44.842628+0000","last_peered":"2024-03-09T15:12:44.842628+0000","last_clean":"2024-03-09T15:12:44.842628+0000","last_became_active":"2024-03-09T14:50:35.505615+0000","last_became_peered":"2024-03-09T14:50:35.505615+0000","last_unstale":"2024-03-09T15:12:44.842628+0000","last_undegraded":"2024-03-09T15:12:44.842628+0000","last_fullsized":"2024-03-09T15:12:44.842628+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:44.842494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:44.842494+0000","last_clean_scrub_stamp":"2024-03-09T15:12:44.842494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:57.947450+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:34.946418+0000","last_change":"2024-03-09T15:12:34.946446+0000","last_active":"2024-03-09T15:12:34.946418+0000","last_peered":"2024-03-09T15:12:34.946418+0000","last_clean":"2024-03-09T15:12:34.946418+0000","last_became_active":"2024-03-09T14:38:37.437417+0000","last_became_peered":"2024-03-09T14:38:37.437417+0000","last_unstale":"2024-03-09T15:12:34.946418+0000","last_undegraded":"2024-03-09T15:12:34.946418+0000","last_fullsized":"2024-03-09T15:12:34.946418+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:12:34.946325+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:12:34.946325+0000","last_clean_scrub_stamp":"2024-03-09T15:12:34.946325+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:45:42.144762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"261'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.271804+0000","last_change":"2024-03-09T15:11:56.271804+0000","last_active":"2024-03-09T15:11:56.271804+0000","last_peered":"2024-03-09T15:11:56.271804+0000","last_clean":"2024-03-09T15:11:56.271804+0000","last_became_active":"2024-03-09T14:38:34.415722+0000","last_became_peered":"2024-03-09T14:38:34.415722+0000","last_unstale":"2024-03-09T15:11:56.271804+0000","last_undegraded":"2024-03-09T15:11:56.271804+0000","last_fullsized":"2024-03-09T15:11:56.271804+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:11:56.271674+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:11:56.271674+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.271674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:48:05.171502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'34","reported_seq":142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.068920+0000","last_change":"2024-03-09T15:12:03.068946+0000","last_active":"2024-03-09T15:12:03.068920+0000","last_peered":"2024-03-09T15:12:03.068920+0000","last_clean":"2024-03-09T15:12:03.068920+0000","last_became_active":"2024-03-09T14:35:41.121524+0000","last_became_peered":"2024-03-09T14:35:41.121524+0000","last_unstale":"2024-03-09T15:12:03.068920+0000","last_undegraded":"2024-03-09T15:12:03.068920+0000","last_fullsized":"2024-03-09T15:12:03.068920+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-03-09T15:12:03.068812+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-03-09T15:12:03.068812+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.068812+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:02:49.962553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":103,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'188","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.019914+0000","last_change":"2024-03-09T15:12:07.019914+0000","last_active":"2024-03-09T15:12:07.019914+0000","last_peered":"2024-03-09T15:12:07.019914+0000","last_clean":"2024-03-09T15:12:07.019914+0000","last_became_active":"2024-03-09T14:27:03.724231+0000","last_became_peered":"2024-03-09T14:27:03.724231+0000","last_unstale":"2024-03-09T15:12:07.019914+0000","last_undegraded":"2024-03-09T15:12:07.019914+0000","last_fullsized":"2024-03-09T15:12:07.019914+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'188","last_scrub_stamp":"2024-03-09T15:12:07.019764+0000","last_deep_scrub":"264'188","last_deep_scrub_stamp":"2024-03-09T15:12:07.019764+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.019764+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:52:58.541169+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8703114,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":339,"num_read_kb":37539,"num_write":995,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'402","reported_seq":1864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.467931+0000","last_change":"2024-03-09T15:12:13.467968+0000","last_active":"2024-03-09T15:12:13.467931+0000","last_peered":"2024-03-09T15:12:13.467931+0000","last_clean":"2024-03-09T15:12:13.467931+0000","last_became_active":"2024-03-09T14:26:28.648852+0000","last_became_peered":"2024-03-09T14:26:28.648852+0000","last_unstale":"2024-03-09T15:12:13.467931+0000","last_undegraded":"2024-03-09T15:12:13.467931+0000","last_fullsized":"2024-03-09T15:12:13.467931+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'402","last_scrub_stamp":"2024-03-09T15:12:13.467846+0000","last_deep_scrub":"264'402","last_deep_scrub_stamp":"2024-03-09T15:12:13.467846+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.467846+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:17:36.060526+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2165,"num_read_kb":2027,"num_write":486,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'163","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:20.788947+0000","last_change":"2024-03-09T15:12:20.788986+0000","last_active":"2024-03-09T15:12:20.788947+0000","last_peered":"2024-03-09T15:12:20.788947+0000","last_clean":"2024-03-09T15:12:20.788947+0000","last_became_active":"2024-03-09T14:26:26.635705+0000","last_became_peered":"2024-03-09T14:26:26.635705+0000","last_unstale":"2024-03-09T15:12:20.788947+0000","last_undegraded":"2024-03-09T15:12:20.788947+0000","last_fullsized":"2024-03-09T15:12:20.788947+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-03-09T15:12:20.788850+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-03-09T15:12:20.788850+0000","last_clean_scrub_stamp":"2024-03-09T15:12:20.788850+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:33.866862+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":33876,"num_write":835,"num_write_kb":32927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'819","reported_seq":2399,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.044391+0000","last_change":"2024-03-09T15:12:06.044426+0000","last_active":"2024-03-09T15:12:06.044391+0000","last_peered":"2024-03-09T15:12:06.044391+0000","last_clean":"2024-03-09T15:12:06.044391+0000","last_became_active":"2024-03-09T14:28:04.196872+0000","last_became_peered":"2024-03-09T14:28:04.196872+0000","last_unstale":"2024-03-09T15:12:06.044391+0000","last_undegraded":"2024-03-09T15:12:06.044391+0000","last_fullsized":"2024-03-09T15:12:06.044391+0000","mapping_epoch":38,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'819","last_scrub_stamp":"2024-03-09T15:12:06.044299+0000","last_deep_scrub":"264'819","last_deep_scrub_stamp":"2024-03-09T15:12:06.044299+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.044299+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:04.510091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3746,"num_read_kb":3347,"num_write":1098,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'207","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:33.488962+0000","last_change":"2024-03-09T15:12:33.488991+0000","last_active":"2024-03-09T15:12:33.488962+0000","last_peered":"2024-03-09T15:12:33.488962+0000","last_clean":"2024-03-09T15:12:33.488962+0000","last_became_active":"2024-03-09T14:26:26.626521+0000","last_became_peered":"2024-03-09T14:26:26.626521+0000","last_unstale":"2024-03-09T15:12:33.488962+0000","last_undegraded":"2024-03-09T15:12:33.488962+0000","last_fullsized":"2024-03-09T15:12:33.488962+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-03-09T15:12:33.488882+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-03-09T15:12:33.488882+0000","last_clean_scrub_stamp":"2024-03-09T15:12:33.488882+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:51.938089+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":486,"num_read_kb":60498,"num_write":1106,"num_write_kb":28928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'632","reported_seq":2082,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.931304+0000","last_change":"2024-03-09T15:12:22.931338+0000","last_active":"2024-03-09T15:12:22.931304+0000","last_peered":"2024-03-09T15:12:22.931304+0000","last_clean":"2024-03-09T15:12:22.931304+0000","last_became_active":"2024-03-09T14:26:28.649054+0000","last_became_peered":"2024-03-09T14:26:28.649054+0000","last_unstale":"2024-03-09T15:12:22.931304+0000","last_undegraded":"2024-03-09T15:12:22.931304+0000","last_fullsized":"2024-03-09T15:12:22.931304+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'632","last_scrub_stamp":"2024-03-09T15:12:22.931212+0000","last_deep_scrub":"264'632","last_deep_scrub_stamp":"2024-03-09T15:12:22.931212+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.931212+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":600,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:25.197345+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3080,"num_read_kb":2811,"num_write":822,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'179","reported_seq":795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:32.401882+0000","last_change":"2024-03-09T15:12:32.401935+0000","last_active":"2024-03-09T15:12:32.401882+0000","last_peered":"2024-03-09T15:12:32.401882+0000","last_clean":"2024-03-09T15:12:32.401882+0000","last_became_active":"2024-03-09T14:26:26.647183+0000","last_became_peered":"2024-03-09T14:26:26.647183+0000","last_unstale":"2024-03-09T15:12:32.401882+0000","last_undegraded":"2024-03-09T15:12:32.401882+0000","last_fullsized":"2024-03-09T15:12:32.401882+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-03-09T15:12:32.401785+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-03-09T15:12:32.401785+0000","last_clean_scrub_stamp":"2024-03-09T15:12:32.401785+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:26:12.774571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":425,"num_read_kb":10841,"num_write":993,"num_write_kb":22118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'384","reported_seq":1962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.556416+0000","last_change":"2024-03-09T15:12:18.556442+0000","last_active":"2024-03-09T15:12:18.556416+0000","last_peered":"2024-03-09T15:12:18.556416+0000","last_clean":"2024-03-09T15:12:18.556416+0000","last_became_active":"2024-03-09T14:26:28.649146+0000","last_became_peered":"2024-03-09T14:26:28.649146+0000","last_unstale":"2024-03-09T15:12:18.556416+0000","last_undegraded":"2024-03-09T15:12:18.556416+0000","last_fullsized":"2024-03-09T15:12:18.556416+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-03-09T15:12:18.556329+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-03-09T15:12:18.556329+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.556329+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:08:15.222991+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2286,"num_read_kb":2187,"num_write":441,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'274","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:39.792385+0000","last_change":"2024-03-09T15:12:39.792534+0000","last_active":"2024-03-09T15:12:39.792385+0000","last_peered":"2024-03-09T15:12:39.792385+0000","last_clean":"2024-03-09T15:12:39.792385+0000","last_became_active":"2024-03-09T14:26:26.651564+0000","last_became_peered":"2024-03-09T14:26:26.651564+0000","last_unstale":"2024-03-09T15:12:39.792385+0000","last_undegraded":"2024-03-09T15:12:39.792385+0000","last_fullsized":"2024-03-09T15:12:39.792385+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'274","last_scrub_stamp":"2024-03-09T15:12:39.792279+0000","last_deep_scrub":"264'274","last_deep_scrub_stamp":"2024-03-09T15:12:39.792279+0000","last_clean_scrub_stamp":"2024-03-09T15:12:39.792279+0000","objects_scrubbed":8,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:00.892208+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12595319,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":658,"num_read_kb":37858,"num_write":1532,"num_write_kb":26421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'337","reported_seq":1785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.262925+0000","last_change":"2024-03-09T15:12:13.262925+0000","last_active":"2024-03-09T15:12:13.262925+0000","last_peered":"2024-03-09T15:12:13.262925+0000","last_clean":"2024-03-09T15:12:13.262925+0000","last_became_active":"2024-03-09T14:26:28.648259+0000","last_became_peered":"2024-03-09T14:26:28.648259+0000","last_unstale":"2024-03-09T15:12:13.262925+0000","last_undegraded":"2024-03-09T15:12:13.262925+0000","last_fullsized":"2024-03-09T15:12:13.262925+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-03-09T15:12:13.262759+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-03-09T15:12:13.262759+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.262759+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:11:10.276881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2053,"num_read_kb":1964,"num_write":385,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'170","reported_seq":784,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.414633+0000","last_change":"2024-03-09T15:12:22.414716+0000","last_active":"2024-03-09T15:12:22.414633+0000","last_peered":"2024-03-09T15:12:22.414633+0000","last_clean":"2024-03-09T15:12:22.414633+0000","last_became_active":"2024-03-09T14:26:26.648780+0000","last_became_peered":"2024-03-09T14:26:26.648780+0000","last_unstale":"2024-03-09T15:12:22.414633+0000","last_undegraded":"2024-03-09T15:12:22.414633+0000","last_fullsized":"2024-03-09T15:12:22.414633+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'170","last_scrub_stamp":"2024-03-09T15:12:22.414534+0000","last_deep_scrub":"264'170","last_deep_scrub_stamp":"2024-03-09T15:12:22.414534+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.414534+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:29.029481+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525518,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":382,"num_read_kb":3119,"num_write":934,"num_write_kb":23902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'464","reported_seq":2019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.075942+0000","last_change":"2024-03-09T15:12:17.075942+0000","last_active":"2024-03-09T15:12:17.075942+0000","last_peered":"2024-03-09T15:12:17.075942+0000","last_clean":"2024-03-09T15:12:17.075942+0000","last_became_active":"2024-03-09T14:26:28.649994+0000","last_became_peered":"2024-03-09T14:26:28.649994+0000","last_unstale":"2024-03-09T15:12:17.075942+0000","last_undegraded":"2024-03-09T15:12:17.075942+0000","last_fullsized":"2024-03-09T15:12:17.075942+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'464","last_scrub_stamp":"2024-03-09T15:12:17.075802+0000","last_deep_scrub":"264'464","last_deep_scrub_stamp":"2024-03-09T15:12:17.075802+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.075802+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:27:58.383959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2508,"num_read_kb":2326,"num_write":602,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'163","reported_seq":821,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:40.809062+0000","last_change":"2024-03-09T15:12:40.809108+0000","last_active":"2024-03-09T15:12:40.809062+0000","last_peered":"2024-03-09T15:12:40.809062+0000","last_clean":"2024-03-09T15:12:40.809062+0000","last_became_active":"2024-03-09T14:26:26.651754+0000","last_became_peered":"2024-03-09T14:26:26.651754+0000","last_unstale":"2024-03-09T15:12:40.809062+0000","last_undegraded":"2024-03-09T15:12:40.809062+0000","last_fullsized":"2024-03-09T15:12:40.809062+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-03-09T15:12:40.808967+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-03-09T15:12:40.808967+0000","last_clean_scrub_stamp":"2024-03-09T15:12:40.808967+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:59:15.759380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":432,"num_read_kb":120305,"num_write":891,"num_write_kb":41051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'1265","reported_seq":2902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.461205+0000","last_change":"2024-03-09T15:12:15.461205+0000","last_active":"2024-03-09T15:12:15.461205+0000","last_peered":"2024-03-09T15:12:15.461205+0000","last_clean":"2024-03-09T15:12:15.461205+0000","last_became_active":"2024-03-09T14:26:28.651754+0000","last_became_peered":"2024-03-09T14:26:28.651754+0000","last_unstale":"2024-03-09T15:12:15.461205+0000","last_undegraded":"2024-03-09T15:12:15.461205+0000","last_fullsized":"2024-03-09T15:12:15.461205+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1265","last_scrub_stamp":"2024-03-09T15:12:15.461028+0000","last_deep_scrub":"264'1265","last_deep_scrub_stamp":"2024-03-09T15:12:15.461028+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.461028+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":1200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:48.502160+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5611,"num_read_kb":4890,"num_write":1803,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'158","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:38.962189+0000","last_change":"2024-03-09T15:12:38.962228+0000","last_active":"2024-03-09T15:12:38.962189+0000","last_peered":"2024-03-09T15:12:38.962189+0000","last_clean":"2024-03-09T15:12:38.962189+0000","last_became_active":"2024-03-09T14:26:26.643195+0000","last_became_peered":"2024-03-09T14:26:26.643195+0000","last_unstale":"2024-03-09T15:12:38.962189+0000","last_undegraded":"2024-03-09T15:12:38.962189+0000","last_fullsized":"2024-03-09T15:12:38.962189+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'158","last_scrub_stamp":"2024-03-09T15:12:38.962101+0000","last_deep_scrub":"264'158","last_deep_scrub_stamp":"2024-03-09T15:12:38.962101+0000","last_clean_scrub_stamp":"2024-03-09T15:12:38.962101+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:44:48.331678+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924406,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":386,"num_read_kb":7445,"num_write":885,"num_write_kb":17740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'832","reported_seq":2511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.968241+0000","last_change":"2024-03-09T15:12:13.968241+0000","last_active":"2024-03-09T15:12:13.968241+0000","last_peered":"2024-03-09T15:12:13.968241+0000","last_clean":"2024-03-09T15:12:13.968241+0000","last_became_active":"2024-03-09T14:26:28.653778+0000","last_became_peered":"2024-03-09T14:26:28.653778+0000","last_unstale":"2024-03-09T15:12:13.968241+0000","last_undegraded":"2024-03-09T15:12:13.968241+0000","last_fullsized":"2024-03-09T15:12:13.968241+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'832","last_scrub_stamp":"2024-03-09T15:12:13.968142+0000","last_deep_scrub":"264'832","last_deep_scrub_stamp":"2024-03-09T15:12:13.968142+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.968142+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:13.118115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3883,"num_read_kb":3504,"num_write":1111,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'453","reported_seq":2044,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:30.890107+0000","last_change":"2024-03-09T15:12:30.890157+0000","last_active":"2024-03-09T15:12:30.890107+0000","last_peered":"2024-03-09T15:12:30.890107+0000","last_clean":"2024-03-09T15:12:30.890107+0000","last_became_active":"2024-03-09T14:26:28.649128+0000","last_became_peered":"2024-03-09T14:26:28.649128+0000","last_unstale":"2024-03-09T15:12:30.890107+0000","last_undegraded":"2024-03-09T15:12:30.890107+0000","last_fullsized":"2024-03-09T15:12:30.890107+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'453","last_scrub_stamp":"2024-03-09T15:12:30.889994+0000","last_deep_scrub":"264'453","last_deep_scrub_stamp":"2024-03-09T15:12:30.889994+0000","last_clean_scrub_stamp":"2024-03-09T15:12:30.889994+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:21.035252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2472,"num_read_kb":2328,"num_write":564,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'188","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:38.786607+0000","last_change":"2024-03-09T15:12:38.786695+0000","last_active":"2024-03-09T15:12:38.786607+0000","last_peered":"2024-03-09T15:12:38.786607+0000","last_clean":"2024-03-09T15:12:38.786607+0000","last_became_active":"2024-03-09T14:26:26.651323+0000","last_became_peered":"2024-03-09T14:26:26.651323+0000","last_unstale":"2024-03-09T15:12:38.786607+0000","last_undegraded":"2024-03-09T15:12:38.786607+0000","last_fullsized":"2024-03-09T15:12:38.786607+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'188","last_scrub_stamp":"2024-03-09T15:12:38.786481+0000","last_deep_scrub":"264'188","last_deep_scrub_stamp":"2024-03-09T15:12:38.786481+0000","last_clean_scrub_stamp":"2024-03-09T15:12:38.786481+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:12:33.219530+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2187,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":439,"num_read_kb":7847,"num_write":1012,"num_write_kb":34087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'418","reported_seq":1947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.752910+0000","last_change":"2024-03-09T15:12:23.752943+0000","last_active":"2024-03-09T15:12:23.752910+0000","last_peered":"2024-03-09T15:12:23.752910+0000","last_clean":"2024-03-09T15:12:23.752910+0000","last_became_active":"2024-03-09T14:26:28.645422+0000","last_became_peered":"2024-03-09T14:26:28.645422+0000","last_unstale":"2024-03-09T15:12:23.752910+0000","last_undegraded":"2024-03-09T15:12:23.752910+0000","last_fullsized":"2024-03-09T15:12:23.752910+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'418","last_scrub_stamp":"2024-03-09T15:12:23.752791+0000","last_deep_scrub":"264'418","last_deep_scrub_stamp":"2024-03-09T15:12:23.752791+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.752791+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:07:21.902125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2243,"num_read_kb":2118,"num_write":516,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'179","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.298486+0000","last_change":"2024-03-09T15:12:17.298486+0000","last_active":"2024-03-09T15:12:17.298486+0000","last_peered":"2024-03-09T15:12:17.298486+0000","last_clean":"2024-03-09T15:12:17.298486+0000","last_became_active":"2024-03-09T14:26:26.644578+0000","last_became_peered":"2024-03-09T14:26:26.644578+0000","last_unstale":"2024-03-09T15:12:17.298486+0000","last_undegraded":"2024-03-09T15:12:17.298486+0000","last_fullsized":"2024-03-09T15:12:17.298486+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-03-09T15:12:17.298329+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-03-09T15:12:17.298329+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.298329+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:38.437013+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":16041,"num_write":1043,"num_write_kb":25248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'395","reported_seq":2111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.422714+0000","last_change":"2024-03-09T15:12:11.422749+0000","last_active":"2024-03-09T15:12:11.422714+0000","last_peered":"2024-03-09T15:12:11.422714+0000","last_clean":"2024-03-09T15:12:11.422714+0000","last_became_active":"2024-03-09T14:26:28.648115+0000","last_became_peered":"2024-03-09T14:26:28.648115+0000","last_unstale":"2024-03-09T15:12:11.422714+0000","last_undegraded":"2024-03-09T15:12:11.422714+0000","last_fullsized":"2024-03-09T15:12:11.422714+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-03-09T15:12:11.422623+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-03-09T15:12:11.422623+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.422623+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:31.095264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2471,"num_read_kb":2382,"num_write":449,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2442,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'206","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.250411+0000","last_change":"2024-03-09T15:12:19.250411+0000","last_active":"2024-03-09T15:12:19.250411+0000","last_peered":"2024-03-09T15:12:19.250411+0000","last_clean":"2024-03-09T15:12:19.250411+0000","last_became_active":"2024-03-09T14:26:26.647391+0000","last_became_peered":"2024-03-09T14:26:26.647391+0000","last_unstale":"2024-03-09T15:12:19.250411+0000","last_undegraded":"2024-03-09T15:12:19.250411+0000","last_fullsized":"2024-03-09T15:12:19.250411+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-03-09T15:12:19.250204+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-03-09T15:12:19.250204+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.250204+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:12:14.352167+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778753,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":14846,"num_write":1056,"num_write_kb":41673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'455","reported_seq":2034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.979611+0000","last_change":"2024-03-09T15:12:11.979611+0000","last_active":"2024-03-09T15:12:11.979611+0000","last_peered":"2024-03-09T15:12:11.979611+0000","last_clean":"2024-03-09T15:12:11.979611+0000","last_became_active":"2024-03-09T14:26:28.647846+0000","last_became_peered":"2024-03-09T14:26:28.647846+0000","last_unstale":"2024-03-09T15:12:11.979611+0000","last_undegraded":"2024-03-09T15:12:11.979611+0000","last_fullsized":"2024-03-09T15:12:11.979611+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'455","last_scrub_stamp":"2024-03-09T15:12:11.979455+0000","last_deep_scrub":"264'455","last_deep_scrub_stamp":"2024-03-09T15:12:11.979455+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.979455+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:12:48.086252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2382,"num_read_kb":2246,"num_write":552,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":961,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'284","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.915543+0000","last_change":"2024-03-09T15:12:23.915596+0000","last_active":"2024-03-09T15:12:23.915543+0000","last_peered":"2024-03-09T15:12:23.915543+0000","last_clean":"2024-03-09T15:12:23.915543+0000","last_became_active":"2024-03-09T14:26:26.637767+0000","last_became_peered":"2024-03-09T14:26:26.637767+0000","last_unstale":"2024-03-09T15:12:23.915543+0000","last_undegraded":"2024-03-09T15:12:23.915543+0000","last_fullsized":"2024-03-09T15:12:23.915543+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'284","last_scrub_stamp":"2024-03-09T15:12:23.915441+0000","last_deep_scrub":"264'284","last_deep_scrub_stamp":"2024-03-09T15:12:23.915441+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.915441+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:28:30.522143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4508970,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":598,"num_read_kb":72489,"num_write":1415,"num_write_kb":47263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'1536","reported_seq":3271,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.976389+0000","last_change":"2024-03-09T15:12:14.976389+0000","last_active":"2024-03-09T15:12:14.976389+0000","last_peered":"2024-03-09T15:12:14.976389+0000","last_clean":"2024-03-09T15:12:14.976389+0000","last_became_active":"2024-03-09T14:26:28.653385+0000","last_became_peered":"2024-03-09T14:26:28.653385+0000","last_unstale":"2024-03-09T15:12:14.976389+0000","last_undegraded":"2024-03-09T15:12:14.976389+0000","last_fullsized":"2024-03-09T15:12:14.976389+0000","mapping_epoch":25,"log_start":"264'1500","ondisk_log_start":"264'1500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1536","last_scrub_stamp":"2024-03-09T15:12:14.976254+0000","last_deep_scrub":"264'1536","last_deep_scrub_stamp":"2024-03-09T15:12:14.976254+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.976254+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":1500,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:52:46.633280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6446,"num_read_kb":5594,"num_write":2158,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'220","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:40.978222+0000","last_change":"2024-03-09T15:12:40.978311+0000","last_active":"2024-03-09T15:12:40.978222+0000","last_peered":"2024-03-09T15:12:40.978222+0000","last_clean":"2024-03-09T15:12:40.978222+0000","last_became_active":"2024-03-09T14:26:26.643401+0000","last_became_peered":"2024-03-09T14:26:26.643401+0000","last_unstale":"2024-03-09T15:12:40.978222+0000","last_undegraded":"2024-03-09T15:12:40.978222+0000","last_fullsized":"2024-03-09T15:12:40.978222+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'220","last_scrub_stamp":"2024-03-09T15:12:40.978124+0000","last_deep_scrub":"264'220","last_deep_scrub_stamp":"2024-03-09T15:12:40.978124+0000","last_clean_scrub_stamp":"2024-03-09T15:12:40.978124+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:41.894474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":517275,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":464,"num_read_kb":13858,"num_write":1176,"num_write_kb":34499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'728","reported_seq":2217,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.070669+0000","last_change":"2024-03-09T15:12:15.070669+0000","last_active":"2024-03-09T15:12:15.070669+0000","last_peered":"2024-03-09T15:12:15.070669+0000","last_clean":"2024-03-09T15:12:15.070669+0000","last_became_active":"2024-03-09T14:26:28.650334+0000","last_became_peered":"2024-03-09T14:26:28.650334+0000","last_unstale":"2024-03-09T15:12:15.070669+0000","last_undegraded":"2024-03-09T15:12:15.070669+0000","last_fullsized":"2024-03-09T15:12:15.070669+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'728","last_scrub_stamp":"2024-03-09T15:12:15.070486+0000","last_deep_scrub":"264'728","last_deep_scrub_stamp":"2024-03-09T15:12:15.070486+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.070486+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:09:57.328921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3318,"num_read_kb":2980,"num_write":968,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'137","reported_seq":736,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:34.460650+0000","last_change":"2024-03-09T15:12:34.460691+0000","last_active":"2024-03-09T15:12:34.460650+0000","last_peered":"2024-03-09T15:12:34.460650+0000","last_clean":"2024-03-09T15:12:34.460650+0000","last_became_active":"2024-03-09T14:26:26.631203+0000","last_became_peered":"2024-03-09T14:26:26.631203+0000","last_unstale":"2024-03-09T15:12:34.460650+0000","last_undegraded":"2024-03-09T15:12:34.460650+0000","last_fullsized":"2024-03-09T15:12:34.460650+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-03-09T15:12:34.460555+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-03-09T15:12:34.460555+0000","last_clean_scrub_stamp":"2024-03-09T15:12:34.460555+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:56.639137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049909,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":305,"num_read_kb":11988,"num_write":738,"num_write_kb":25932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'99","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.165554+0000","last_change":"2024-03-09T15:11:55.165554+0000","last_active":"2024-03-09T15:11:55.165554+0000","last_peered":"2024-03-09T15:11:55.165554+0000","last_clean":"2024-03-09T15:11:55.165554+0000","last_became_active":"2024-03-09T14:26:36.674500+0000","last_became_peered":"2024-03-09T14:26:36.674500+0000","last_unstale":"2024-03-09T15:11:55.165554+0000","last_undegraded":"2024-03-09T15:11:55.165554+0000","last_fullsized":"2024-03-09T15:11:55.165554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'99","last_scrub_stamp":"2024-03-09T15:11:55.165436+0000","last_deep_scrub":"264'99","last_deep_scrub_stamp":"2024-03-09T15:11:55.165436+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.165436+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:59.949962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":88,"num_write":230,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'373","reported_seq":1783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.860775+0000","last_change":"2024-03-09T15:12:01.860775+0000","last_active":"2024-03-09T15:12:01.860775+0000","last_peered":"2024-03-09T15:12:01.860775+0000","last_clean":"2024-03-09T15:12:01.860775+0000","last_became_active":"2024-03-09T14:28:03.815924+0000","last_became_peered":"2024-03-09T14:28:03.815924+0000","last_unstale":"2024-03-09T15:12:01.860775+0000","last_undegraded":"2024-03-09T15:12:01.860775+0000","last_fullsized":"2024-03-09T15:12:01.860775+0000","mapping_epoch":38,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-03-09T15:12:01.860643+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-03-09T15:12:01.860643+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.860643+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:05.270001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1992,"num_read_kb":1883,"num_write":432,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"264'204","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:27.835730+0000","last_change":"2024-03-09T15:12:27.835767+0000","last_active":"2024-03-09T15:12:27.835730+0000","last_peered":"2024-03-09T15:12:27.835730+0000","last_clean":"2024-03-09T15:12:27.835730+0000","last_became_active":"2024-03-09T14:26:26.652957+0000","last_became_peered":"2024-03-09T14:26:26.652957+0000","last_unstale":"2024-03-09T15:12:27.835730+0000","last_undegraded":"2024-03-09T15:12:27.835730+0000","last_fullsized":"2024-03-09T15:12:27.835730+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'204","last_scrub_stamp":"2024-03-09T15:12:27.835636+0000","last_deep_scrub":"264'204","last_deep_scrub_stamp":"2024-03-09T15:12:27.835636+0000","last_clean_scrub_stamp":"2024-03-09T15:12:27.835636+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:37:20.599675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048753,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":421,"num_read_kb":22200,"num_write":1166,"num_write_kb":38864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:33.389164+0000","last_change":"2024-03-09T15:12:33.389196+0000","last_active":"2024-03-09T15:12:33.389164+0000","last_peered":"2024-03-09T15:12:33.389164+0000","last_clean":"2024-03-09T15:12:33.389164+0000","last_became_active":"2024-03-09T14:26:30.654862+0000","last_became_peered":"2024-03-09T14:26:30.654862+0000","last_unstale":"2024-03-09T15:12:33.389164+0000","last_undegraded":"2024-03-09T15:12:33.389164+0000","last_fullsized":"2024-03-09T15:12:33.389164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:33.389078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:33.389078+0000","last_clean_scrub_stamp":"2024-03-09T15:12:33.389078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:42:13.846581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'189","reported_seq":801,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:27.485248+0000","last_change":"2024-03-09T15:12:27.485248+0000","last_active":"2024-03-09T15:12:27.485248+0000","last_peered":"2024-03-09T15:12:27.485248+0000","last_clean":"2024-03-09T15:12:27.485248+0000","last_became_active":"2024-03-09T14:26:32.652879+0000","last_became_peered":"2024-03-09T14:26:32.652879+0000","last_unstale":"2024-03-09T15:12:27.485248+0000","last_undegraded":"2024-03-09T15:12:27.485248+0000","last_fullsized":"2024-03-09T15:12:27.485248+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-03-09T15:12:27.485132+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-03-09T15:12:27.485132+0000","last_clean_scrub_stamp":"2024-03-09T15:12:27.485132+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:47.803860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19668,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":251,"num_read_kb":350,"num_write":144,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.916819+0000","last_change":"2024-03-09T15:12:15.916819+0000","last_active":"2024-03-09T15:12:15.916819+0000","last_peered":"2024-03-09T15:12:15.916819+0000","last_clean":"2024-03-09T15:12:15.916819+0000","last_became_active":"2024-03-09T14:26:34.670336+0000","last_became_peered":"2024-03-09T14:26:34.670336+0000","last_unstale":"2024-03-09T15:12:15.916819+0000","last_undegraded":"2024-03-09T15:12:15.916819+0000","last_fullsized":"2024-03-09T15:12:15.916819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:15.916655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:15.916655+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.916655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:43:07.942906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'171","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.364403+0000","last_change":"2024-03-09T15:11:58.364403+0000","last_active":"2024-03-09T15:11:58.364403+0000","last_peered":"2024-03-09T15:11:58.364403+0000","last_clean":"2024-03-09T15:11:58.364403+0000","last_became_active":"2024-03-09T14:26:36.673806+0000","last_became_peered":"2024-03-09T14:26:36.673806+0000","last_unstale":"2024-03-09T15:11:58.364403+0000","last_undegraded":"2024-03-09T15:11:58.364403+0000","last_fullsized":"2024-03-09T15:11:58.364403+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-03-09T15:11:58.364272+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-03-09T15:11:58.364272+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.364272+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:00:50.536210+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":385,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'375","reported_seq":1928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.469674+0000","last_change":"2024-03-09T15:12:10.469674+0000","last_active":"2024-03-09T15:12:10.469674+0000","last_peered":"2024-03-09T15:12:10.469674+0000","last_clean":"2024-03-09T15:12:10.469674+0000","last_became_active":"2024-03-09T14:26:28.645537+0000","last_became_peered":"2024-03-09T14:26:28.645537+0000","last_unstale":"2024-03-09T15:12:10.469674+0000","last_undegraded":"2024-03-09T15:12:10.469674+0000","last_fullsized":"2024-03-09T15:12:10.469674+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-03-09T15:12:10.469530+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-03-09T15:12:10.469530+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.469530+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:06:26.190793+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2096,"num_read_kb":2016,"num_write":417,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'227","reported_seq":869,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:40.413519+0000","last_change":"2024-03-09T15:12:40.413645+0000","last_active":"2024-03-09T15:12:40.413519+0000","last_peered":"2024-03-09T15:12:40.413519+0000","last_clean":"2024-03-09T15:12:40.413519+0000","last_became_active":"2024-03-09T14:26:26.644563+0000","last_became_peered":"2024-03-09T14:26:26.644563+0000","last_unstale":"2024-03-09T15:12:40.413519+0000","last_undegraded":"2024-03-09T15:12:40.413519+0000","last_fullsized":"2024-03-09T15:12:40.413519+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'227","last_scrub_stamp":"2024-03-09T15:12:40.413420+0000","last_deep_scrub":"264'227","last_deep_scrub_stamp":"2024-03-09T15:12:40.413420+0000","last_clean_scrub_stamp":"2024-03-09T15:12:40.413420+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:00.929327+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":463,"num_read_kb":29388,"num_write":1134,"num_write_kb":42312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:28.080657+0000","last_change":"2024-03-09T15:12:28.080682+0000","last_active":"2024-03-09T15:12:28.080657+0000","last_peered":"2024-03-09T15:12:28.080657+0000","last_clean":"2024-03-09T15:12:28.080657+0000","last_became_active":"2024-03-09T14:26:30.651683+0000","last_became_peered":"2024-03-09T14:26:30.651683+0000","last_unstale":"2024-03-09T15:12:28.080657+0000","last_undegraded":"2024-03-09T15:12:28.080657+0000","last_fullsized":"2024-03-09T15:12:28.080657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:28.080528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:28.080528+0000","last_clean_scrub_stamp":"2024-03-09T15:12:28.080528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:32.203719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'84","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.126890+0000","last_change":"2024-03-09T15:12:04.126890+0000","last_active":"2024-03-09T15:12:04.126890+0000","last_peered":"2024-03-09T15:12:04.126890+0000","last_clean":"2024-03-09T15:12:04.126890+0000","last_became_active":"2024-03-09T14:26:32.656995+0000","last_became_peered":"2024-03-09T14:26:32.656995+0000","last_unstale":"2024-03-09T15:12:04.126890+0000","last_undegraded":"2024-03-09T15:12:04.126890+0000","last_fullsized":"2024-03-09T15:12:04.126890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-03-09T15:12:04.126765+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-03-09T15:12:04.126765+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.126765+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:29:25.687030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":86,"num_read_kb":83,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.143212+0000","last_change":"2024-03-09T15:12:00.143212+0000","last_active":"2024-03-09T15:12:00.143212+0000","last_peered":"2024-03-09T15:12:00.143212+0000","last_clean":"2024-03-09T15:12:00.143212+0000","last_became_active":"2024-03-09T14:26:34.666326+0000","last_became_peered":"2024-03-09T14:26:34.666326+0000","last_unstale":"2024-03-09T15:12:00.143212+0000","last_undegraded":"2024-03-09T15:12:00.143212+0000","last_fullsized":"2024-03-09T15:12:00.143212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:00.143034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:00.143034+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.143034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:46:46.627453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'117","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.468997+0000","last_change":"2024-03-09T15:12:04.469035+0000","last_active":"2024-03-09T15:12:04.468997+0000","last_peered":"2024-03-09T15:12:04.468997+0000","last_clean":"2024-03-09T15:12:04.468997+0000","last_became_active":"2024-03-09T14:26:36.671071+0000","last_became_peered":"2024-03-09T14:26:36.671071+0000","last_unstale":"2024-03-09T15:12:04.468997+0000","last_undegraded":"2024-03-09T15:12:04.468997+0000","last_fullsized":"2024-03-09T15:12:04.468997+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-03-09T15:12:04.468905+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-03-09T15:12:04.468905+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.468905+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:59:52.388940+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":104,"num_write":246,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'952","reported_seq":2550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.532483+0000","last_change":"2024-03-09T15:12:22.532483+0000","last_active":"2024-03-09T15:12:22.532483+0000","last_peered":"2024-03-09T15:12:22.532483+0000","last_clean":"2024-03-09T15:12:22.532483+0000","last_became_active":"2024-03-09T14:26:28.648586+0000","last_became_peered":"2024-03-09T14:26:28.648586+0000","last_unstale":"2024-03-09T15:12:22.532483+0000","last_undegraded":"2024-03-09T15:12:22.532483+0000","last_fullsized":"2024-03-09T15:12:22.532483+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'952","last_scrub_stamp":"2024-03-09T15:12:22.532310+0000","last_deep_scrub":"264'952","last_deep_scrub_stamp":"2024-03-09T15:12:22.532310+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.532310+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":900,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:38.666020+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4258,"num_read_kb":3730,"num_write":1359,"num_write_kb":540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'185","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:31.742069+0000","last_change":"2024-03-09T15:12:31.742122+0000","last_active":"2024-03-09T15:12:31.742069+0000","last_peered":"2024-03-09T15:12:31.742069+0000","last_clean":"2024-03-09T15:12:31.742069+0000","last_became_active":"2024-03-09T14:26:26.652803+0000","last_became_peered":"2024-03-09T14:26:26.652803+0000","last_unstale":"2024-03-09T15:12:31.742069+0000","last_undegraded":"2024-03-09T15:12:31.742069+0000","last_fullsized":"2024-03-09T15:12:31.742069+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-03-09T15:12:31.741972+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-03-09T15:12:31.741972+0000","last_clean_scrub_stamp":"2024-03-09T15:12:31.741972+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:21:00.259651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":6854,"num_write":972,"num_write_kb":33721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:30.077868+0000","last_change":"2024-03-09T15:12:30.077892+0000","last_active":"2024-03-09T15:12:30.077868+0000","last_peered":"2024-03-09T15:12:30.077868+0000","last_clean":"2024-03-09T15:12:30.077868+0000","last_became_active":"2024-03-09T14:26:30.652699+0000","last_became_peered":"2024-03-09T14:26:30.652699+0000","last_unstale":"2024-03-09T15:12:30.077868+0000","last_undegraded":"2024-03-09T15:12:30.077868+0000","last_fullsized":"2024-03-09T15:12:30.077868+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:30.077770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:30.077770+0000","last_clean_scrub_stamp":"2024-03-09T15:12:30.077770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:46.459602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'103","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.845603+0000","last_change":"2024-03-09T15:11:56.845640+0000","last_active":"2024-03-09T15:11:56.845603+0000","last_peered":"2024-03-09T15:11:56.845603+0000","last_clean":"2024-03-09T15:11:56.845603+0000","last_became_active":"2024-03-09T14:26:32.658348+0000","last_became_peered":"2024-03-09T14:26:32.658348+0000","last_unstale":"2024-03-09T15:11:56.845603+0000","last_undegraded":"2024-03-09T15:11:56.845603+0000","last_fullsized":"2024-03-09T15:11:56.845603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'103","last_scrub_stamp":"2024-03-09T15:11:56.845520+0000","last_deep_scrub":"264'103","last_deep_scrub_stamp":"2024-03-09T15:11:56.845520+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.845520+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:59:30.263896+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'532","reported_seq":1976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.894519+0000","last_change":"2024-03-09T15:12:13.894519+0000","last_active":"2024-03-09T15:12:13.894519+0000","last_peered":"2024-03-09T15:12:13.894519+0000","last_clean":"2024-03-09T15:12:13.894519+0000","last_became_active":"2024-03-09T14:26:34.673916+0000","last_became_peered":"2024-03-09T14:26:34.673916+0000","last_unstale":"2024-03-09T15:12:13.894519+0000","last_undegraded":"2024-03-09T15:12:13.894519+0000","last_fullsized":"2024-03-09T15:12:13.894519+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'532","last_scrub_stamp":"2024-03-09T15:12:13.894406+0000","last_deep_scrub":"264'532","last_deep_scrub_stamp":"2024-03-09T15:12:13.894406+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.894406+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:30.354650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'207","reported_seq":1018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.154737+0000","last_change":"2024-03-09T15:11:53.154775+0000","last_active":"2024-03-09T15:11:53.154737+0000","last_peered":"2024-03-09T15:11:53.154737+0000","last_clean":"2024-03-09T15:11:53.154737+0000","last_became_active":"2024-03-09T14:26:36.786202+0000","last_became_peered":"2024-03-09T14:26:36.786202+0000","last_unstale":"2024-03-09T15:11:53.154737+0000","last_undegraded":"2024-03-09T15:11:53.154737+0000","last_fullsized":"2024-03-09T15:11:53.154737+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-03-09T15:11:53.154651+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-03-09T15:11:53.154651+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.154651+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:25:55.897162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":555,"num_write":450,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'734","reported_seq":2342,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:20.129347+0000","last_change":"2024-03-09T15:12:20.129347+0000","last_active":"2024-03-09T15:12:20.129347+0000","last_peered":"2024-03-09T15:12:20.129347+0000","last_clean":"2024-03-09T15:12:20.129347+0000","last_became_active":"2024-03-09T14:26:28.657030+0000","last_became_peered":"2024-03-09T14:26:28.657030+0000","last_unstale":"2024-03-09T15:12:20.129347+0000","last_undegraded":"2024-03-09T15:12:20.129347+0000","last_fullsized":"2024-03-09T15:12:20.129347+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'734","last_scrub_stamp":"2024-03-09T15:12:20.129217+0000","last_deep_scrub":"264'734","last_deep_scrub_stamp":"2024-03-09T15:12:20.129217+0000","last_clean_scrub_stamp":"2024-03-09T15:12:20.129217+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:40:57.058857+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3495,"num_read_kb":3179,"num_write":956,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'234","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.300268+0000","last_change":"2024-03-09T15:12:15.300299+0000","last_active":"2024-03-09T15:12:15.300268+0000","last_peered":"2024-03-09T15:12:15.300268+0000","last_clean":"2024-03-09T15:12:15.300268+0000","last_became_active":"2024-03-09T14:26:26.643877+0000","last_became_peered":"2024-03-09T14:26:26.643877+0000","last_unstale":"2024-03-09T15:12:15.300268+0000","last_undegraded":"2024-03-09T15:12:15.300268+0000","last_fullsized":"2024-03-09T15:12:15.300268+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'234","last_scrub_stamp":"2024-03-09T15:12:15.300170+0000","last_deep_scrub":"264'234","last_deep_scrub_stamp":"2024-03-09T15:12:15.300170+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.300170+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:44.155158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":619,"num_read_kb":42109,"num_write":1108,"num_write_kb":38892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.404059+0000","last_change":"2024-03-09T15:12:19.404059+0000","last_active":"2024-03-09T15:12:19.404059+0000","last_peered":"2024-03-09T15:12:19.404059+0000","last_clean":"2024-03-09T15:12:19.404059+0000","last_became_active":"2024-03-09T14:26:30.650741+0000","last_became_peered":"2024-03-09T14:26:30.650741+0000","last_unstale":"2024-03-09T15:12:19.404059+0000","last_undegraded":"2024-03-09T15:12:19.404059+0000","last_fullsized":"2024-03-09T15:12:19.404059+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:19.403955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:19.403955+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.403955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:13:04.415182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'150","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:32.708613+0000","last_change":"2024-03-09T15:12:32.708663+0000","last_active":"2024-03-09T15:12:32.708613+0000","last_peered":"2024-03-09T15:12:32.708613+0000","last_clean":"2024-03-09T15:12:32.708613+0000","last_became_active":"2024-03-09T14:26:32.868081+0000","last_became_peered":"2024-03-09T14:26:32.868081+0000","last_unstale":"2024-03-09T15:12:32.708613+0000","last_undegraded":"2024-03-09T15:12:32.708613+0000","last_fullsized":"2024-03-09T15:12:32.708613+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'150","last_scrub_stamp":"2024-03-09T15:12:32.708519+0000","last_deep_scrub":"264'150","last_deep_scrub_stamp":"2024-03-09T15:12:32.708519+0000","last_clean_scrub_stamp":"2024-03-09T15:12:32.708519+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:09.842280+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7737,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":240,"num_write":102,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'565","reported_seq":4034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.044373+0000","last_change":"2024-03-09T15:12:08.044409+0000","last_active":"2024-03-09T15:12:08.044373+0000","last_peered":"2024-03-09T15:12:08.044373+0000","last_clean":"2024-03-09T15:12:08.044373+0000","last_became_active":"2024-03-09T14:26:34.679280+0000","last_became_peered":"2024-03-09T14:26:34.679280+0000","last_unstale":"2024-03-09T15:12:08.044373+0000","last_undegraded":"2024-03-09T15:12:08.044373+0000","last_fullsized":"2024-03-09T15:12:08.044373+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'565","last_scrub_stamp":"2024-03-09T15:12:08.044279+0000","last_deep_scrub":"264'565","last_deep_scrub_stamp":"2024-03-09T15:12:08.044279+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.044279+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:14.925666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'337","reported_seq":1691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.424274+0000","last_change":"2024-03-09T15:12:12.424303+0000","last_active":"2024-03-09T15:12:12.424274+0000","last_peered":"2024-03-09T15:12:12.424274+0000","last_clean":"2024-03-09T15:12:12.424274+0000","last_became_active":"2024-03-09T14:26:28.645600+0000","last_became_peered":"2024-03-09T14:26:28.645600+0000","last_unstale":"2024-03-09T15:12:12.424274+0000","last_undegraded":"2024-03-09T15:12:12.424274+0000","last_fullsized":"2024-03-09T15:12:12.424274+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-03-09T15:12:12.424154+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-03-09T15:12:12.424154+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.424154+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:54:05.390153+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1869,"num_read_kb":1759,"num_write":401,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'208","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:41.837020+0000","last_change":"2024-03-09T15:12:41.837075+0000","last_active":"2024-03-09T15:12:41.837020+0000","last_peered":"2024-03-09T15:12:41.837020+0000","last_clean":"2024-03-09T15:12:41.837020+0000","last_became_active":"2024-03-09T14:26:26.652163+0000","last_became_peered":"2024-03-09T14:26:26.652163+0000","last_unstale":"2024-03-09T15:12:41.837020+0000","last_undegraded":"2024-03-09T15:12:41.837020+0000","last_fullsized":"2024-03-09T15:12:41.837020+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-03-09T15:12:41.836918+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-03-09T15:12:41.836918+0000","last_clean_scrub_stamp":"2024-03-09T15:12:41.836918+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:12:00.322921+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263243,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":85490,"num_write":1165,"num_write_kb":31492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.883702+0000","last_change":"2024-03-09T15:12:18.883731+0000","last_active":"2024-03-09T15:12:18.883702+0000","last_peered":"2024-03-09T15:12:18.883702+0000","last_clean":"2024-03-09T15:12:18.883702+0000","last_became_active":"2024-03-09T14:26:30.648227+0000","last_became_peered":"2024-03-09T14:26:30.648227+0000","last_unstale":"2024-03-09T15:12:18.883702+0000","last_undegraded":"2024-03-09T15:12:18.883702+0000","last_fullsized":"2024-03-09T15:12:18.883702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:18.883596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:18.883596+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.883596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:13:04.286704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'213","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.364047+0000","last_change":"2024-03-09T15:12:04.364047+0000","last_active":"2024-03-09T15:12:04.364047+0000","last_peered":"2024-03-09T15:12:04.364047+0000","last_clean":"2024-03-09T15:12:04.364047+0000","last_became_active":"2024-03-09T14:26:32.868020+0000","last_became_peered":"2024-03-09T14:26:32.868020+0000","last_unstale":"2024-03-09T15:12:04.364047+0000","last_undegraded":"2024-03-09T15:12:04.364047+0000","last_fullsized":"2024-03-09T15:12:04.364047+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-03-09T15:12:04.363892+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-03-09T15:12:04.363892+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.363892+0000","objects_scrubbed":9,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:51:51.117538+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":278,"num_read_kb":313,"num_write":162,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.867852+0000","last_change":"2024-03-09T15:12:11.867877+0000","last_active":"2024-03-09T15:12:11.867852+0000","last_peered":"2024-03-09T15:12:11.867852+0000","last_clean":"2024-03-09T15:12:11.867852+0000","last_became_active":"2024-03-09T14:26:34.666539+0000","last_became_peered":"2024-03-09T14:26:34.666539+0000","last_unstale":"2024-03-09T15:12:11.867852+0000","last_undegraded":"2024-03-09T15:12:11.867852+0000","last_fullsized":"2024-03-09T15:12:11.867852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:11.867738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:11.867738+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.867738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:34:22.712191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'540","reported_seq":1356,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.359359+0000","last_change":"2024-03-09T15:12:00.359359+0000","last_active":"2024-03-09T15:12:00.359359+0000","last_peered":"2024-03-09T15:12:00.359359+0000","last_clean":"2024-03-09T15:12:00.359359+0000","last_became_active":"2024-03-09T14:26:36.672173+0000","last_became_peered":"2024-03-09T14:26:36.672173+0000","last_unstale":"2024-03-09T15:12:00.359359+0000","last_undegraded":"2024-03-09T15:12:00.359359+0000","last_fullsized":"2024-03-09T15:12:00.359359+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'540","last_scrub_stamp":"2024-03-09T15:12:00.359237+0000","last_deep_scrub":"264'540","last_deep_scrub_stamp":"2024-03-09T15:12:00.359237+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.359237+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:34:05.613372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1288,"num_read_kb":1278,"num_write":1107,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'870","reported_seq":2473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.072798+0000","last_change":"2024-03-09T15:12:08.072839+0000","last_active":"2024-03-09T15:12:08.072798+0000","last_peered":"2024-03-09T15:12:08.072798+0000","last_clean":"2024-03-09T15:12:08.072798+0000","last_became_active":"2024-03-09T14:26:28.655572+0000","last_became_peered":"2024-03-09T14:26:28.655572+0000","last_unstale":"2024-03-09T15:12:08.072798+0000","last_undegraded":"2024-03-09T15:12:08.072798+0000","last_fullsized":"2024-03-09T15:12:08.072798+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'870","last_scrub_stamp":"2024-03-09T15:12:08.072716+0000","last_deep_scrub":"264'870","last_deep_scrub_stamp":"2024-03-09T15:12:08.072716+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.072716+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:03:01.925355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4137,"num_read_kb":3672,"num_write":1196,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1528,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'214","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:25.766961+0000","last_change":"2024-03-09T15:12:25.767040+0000","last_active":"2024-03-09T15:12:25.766961+0000","last_peered":"2024-03-09T15:12:25.766961+0000","last_clean":"2024-03-09T15:12:25.766961+0000","last_became_active":"2024-03-09T14:26:26.653969+0000","last_became_peered":"2024-03-09T14:26:26.653969+0000","last_unstale":"2024-03-09T15:12:25.766961+0000","last_undegraded":"2024-03-09T15:12:25.766961+0000","last_fullsized":"2024-03-09T15:12:25.766961+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-03-09T15:12:25.766830+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-03-09T15:12:25.766830+0000","last_clean_scrub_stamp":"2024-03-09T15:12:25.766830+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:26:57.223737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":36496,"num_write":1173,"num_write_kb":46772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.901424+0000","last_change":"2024-03-09T15:12:04.901453+0000","last_active":"2024-03-09T15:12:04.901424+0000","last_peered":"2024-03-09T15:12:04.901424+0000","last_clean":"2024-03-09T15:12:04.901424+0000","last_became_active":"2024-03-09T14:26:30.646765+0000","last_became_peered":"2024-03-09T14:26:30.646765+0000","last_unstale":"2024-03-09T15:12:04.901424+0000","last_undegraded":"2024-03-09T15:12:04.901424+0000","last_fullsized":"2024-03-09T15:12:04.901424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:04.901323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:04.901323+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.901323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:29:11.810512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'126","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.103514+0000","last_change":"2024-03-09T15:12:17.103592+0000","last_active":"2024-03-09T15:12:17.103514+0000","last_peered":"2024-03-09T15:12:17.103514+0000","last_clean":"2024-03-09T15:12:17.103514+0000","last_became_active":"2024-03-09T14:26:32.655037+0000","last_became_peered":"2024-03-09T14:26:32.655037+0000","last_unstale":"2024-03-09T15:12:17.103514+0000","last_undegraded":"2024-03-09T15:12:17.103514+0000","last_fullsized":"2024-03-09T15:12:17.103514+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-03-09T15:12:17.103410+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-03-09T15:12:17.103410+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.103410+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:24:03.182443+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":177,"num_write":74,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.054199+0000","last_change":"2024-03-09T15:12:11.054199+0000","last_active":"2024-03-09T15:12:11.054199+0000","last_peered":"2024-03-09T15:12:11.054199+0000","last_clean":"2024-03-09T15:12:11.054199+0000","last_became_active":"2024-03-09T14:26:34.678525+0000","last_became_peered":"2024-03-09T14:26:34.678525+0000","last_unstale":"2024-03-09T15:12:11.054199+0000","last_undegraded":"2024-03-09T15:12:11.054199+0000","last_fullsized":"2024-03-09T15:12:11.054199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:11.054057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:11.054057+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.054057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:04:56.057745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'2466","reported_seq":4892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.275999+0000","last_change":"2024-03-09T15:12:10.275999+0000","last_active":"2024-03-09T15:12:10.275999+0000","last_peered":"2024-03-09T15:12:10.275999+0000","last_clean":"2024-03-09T15:12:10.275999+0000","last_became_active":"2024-03-09T14:26:36.671204+0000","last_became_peered":"2024-03-09T14:26:36.671204+0000","last_unstale":"2024-03-09T15:12:10.275999+0000","last_undegraded":"2024-03-09T15:12:10.275999+0000","last_fullsized":"2024-03-09T15:12:10.275999+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2466","last_scrub_stamp":"2024-03-09T15:12:10.275825+0000","last_deep_scrub":"264'2466","last_deep_scrub_stamp":"2024-03-09T15:12:10.275825+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.275825+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":2400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:58.222088+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6722,"num_read_kb":6726,"num_write":4987,"num_write_kb":1828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'375","reported_seq":1952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.268564+0000","last_change":"2024-03-09T15:12:11.268564+0000","last_active":"2024-03-09T15:12:11.268564+0000","last_peered":"2024-03-09T15:12:11.268564+0000","last_clean":"2024-03-09T15:12:11.268564+0000","last_became_active":"2024-03-09T14:26:28.648620+0000","last_became_peered":"2024-03-09T14:26:28.648620+0000","last_unstale":"2024-03-09T15:12:11.268564+0000","last_undegraded":"2024-03-09T15:12:11.268564+0000","last_fullsized":"2024-03-09T15:12:11.268564+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-03-09T15:12:11.268447+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-03-09T15:12:11.268447+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.268447+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:36.954188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2195,"num_write":437,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'221","reported_seq":1120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:29.781053+0000","last_change":"2024-03-09T15:12:29.781098+0000","last_active":"2024-03-09T15:12:29.781053+0000","last_peered":"2024-03-09T15:12:29.781053+0000","last_clean":"2024-03-09T15:12:29.781053+0000","last_became_active":"2024-03-09T14:26:26.653181+0000","last_became_peered":"2024-03-09T14:26:26.653181+0000","last_unstale":"2024-03-09T15:12:29.781053+0000","last_undegraded":"2024-03-09T15:12:29.781053+0000","last_fullsized":"2024-03-09T15:12:29.781053+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-03-09T15:12:29.780959+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-03-09T15:12:29.780959+0000","last_clean_scrub_stamp":"2024-03-09T15:12:29.780959+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:03:31.783949+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194373,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1046,"num_read_kb":176280,"num_write":1134,"num_write_kb":52674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.919675+0000","last_change":"2024-03-09T15:12:06.919699+0000","last_active":"2024-03-09T15:12:06.919675+0000","last_peered":"2024-03-09T15:12:06.919675+0000","last_clean":"2024-03-09T15:12:06.919675+0000","last_became_active":"2024-03-09T14:26:30.645656+0000","last_became_peered":"2024-03-09T14:26:30.645656+0000","last_unstale":"2024-03-09T15:12:06.919675+0000","last_undegraded":"2024-03-09T15:12:06.919675+0000","last_fullsized":"2024-03-09T15:12:06.919675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:06.919571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:06.919571+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.919571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:29:49.003185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'179","reported_seq":768,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:28.819000+0000","last_change":"2024-03-09T15:12:28.819041+0000","last_active":"2024-03-09T15:12:28.819000+0000","last_peered":"2024-03-09T15:12:28.819000+0000","last_clean":"2024-03-09T15:12:28.819000+0000","last_became_active":"2024-03-09T14:26:32.657144+0000","last_became_peered":"2024-03-09T14:26:32.657144+0000","last_unstale":"2024-03-09T15:12:28.819000+0000","last_undegraded":"2024-03-09T15:12:28.819000+0000","last_fullsized":"2024-03-09T15:12:28.819000+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-03-09T15:12:28.818913+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-03-09T15:12:28.818913+0000","last_clean_scrub_stamp":"2024-03-09T15:12:28.818913+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:09:15.063240+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6043,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":209,"num_read_kb":276,"num_write":118,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'544","reported_seq":1948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.521595+0000","last_change":"2024-03-09T15:12:13.521619+0000","last_active":"2024-03-09T15:12:13.521595+0000","last_peered":"2024-03-09T15:12:13.521595+0000","last_clean":"2024-03-09T15:12:13.521595+0000","last_became_active":"2024-03-09T14:26:34.667795+0000","last_became_peered":"2024-03-09T14:26:34.667795+0000","last_unstale":"2024-03-09T15:12:13.521595+0000","last_undegraded":"2024-03-09T15:12:13.521595+0000","last_fullsized":"2024-03-09T15:12:13.521595+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'544","last_scrub_stamp":"2024-03-09T15:12:13.521519+0000","last_deep_scrub":"264'544","last_deep_scrub_stamp":"2024-03-09T15:12:13.521519+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.521519+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:21:54.107680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'112","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.443257+0000","last_change":"2024-03-09T15:12:02.443257+0000","last_active":"2024-03-09T15:12:02.443257+0000","last_peered":"2024-03-09T15:12:02.443257+0000","last_clean":"2024-03-09T15:12:02.443257+0000","last_became_active":"2024-03-09T14:26:36.671635+0000","last_became_peered":"2024-03-09T14:26:36.671635+0000","last_unstale":"2024-03-09T15:12:02.443257+0000","last_undegraded":"2024-03-09T15:12:02.443257+0000","last_fullsized":"2024-03-09T15:12:02.443257+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-03-09T15:12:02.443069+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-03-09T15:12:02.443069+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.443069+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:03:53.401726+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":89,"num_write":251,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'431","reported_seq":1958,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:30.528394+0000","last_change":"2024-03-09T15:12:30.528421+0000","last_active":"2024-03-09T15:12:30.528394+0000","last_peered":"2024-03-09T15:12:30.528394+0000","last_clean":"2024-03-09T15:12:30.528394+0000","last_became_active":"2024-03-09T14:26:28.645215+0000","last_became_peered":"2024-03-09T14:26:28.645215+0000","last_unstale":"2024-03-09T15:12:30.528394+0000","last_undegraded":"2024-03-09T15:12:30.528394+0000","last_fullsized":"2024-03-09T15:12:30.528394+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'431","last_scrub_stamp":"2024-03-09T15:12:30.528281+0000","last_deep_scrub":"264'431","last_deep_scrub_stamp":"2024-03-09T15:12:30.528281+0000","last_clean_scrub_stamp":"2024-03-09T15:12:30.528281+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:29:19.431944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2276,"num_read_kb":2131,"num_write":518,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'218","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:27.393602+0000","last_change":"2024-03-09T15:12:27.393667+0000","last_active":"2024-03-09T15:12:27.393602+0000","last_peered":"2024-03-09T15:12:27.393602+0000","last_clean":"2024-03-09T15:12:27.393602+0000","last_became_active":"2024-03-09T14:26:26.639784+0000","last_became_peered":"2024-03-09T14:26:26.639784+0000","last_unstale":"2024-03-09T15:12:27.393602+0000","last_undegraded":"2024-03-09T15:12:27.393602+0000","last_fullsized":"2024-03-09T15:12:27.393602+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'218","last_scrub_stamp":"2024-03-09T15:12:27.393482+0000","last_deep_scrub":"264'218","last_deep_scrub_stamp":"2024-03-09T15:12:27.393482+0000","last_clean_scrub_stamp":"2024-03-09T15:12:27.393482+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:12:01.479254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048623,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":725,"num_read_kb":41897,"num_write":1164,"num_write_kb":44648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.880795+0000","last_change":"2024-03-09T15:12:00.880795+0000","last_active":"2024-03-09T15:12:00.880795+0000","last_peered":"2024-03-09T15:12:00.880795+0000","last_clean":"2024-03-09T15:12:00.880795+0000","last_became_active":"2024-03-09T14:26:30.652726+0000","last_became_peered":"2024-03-09T14:26:30.652726+0000","last_unstale":"2024-03-09T15:12:00.880795+0000","last_undegraded":"2024-03-09T15:12:00.880795+0000","last_fullsized":"2024-03-09T15:12:00.880795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:00.880676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:00.880676+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.880676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:24:25.796674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'187","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:25.550124+0000","last_change":"2024-03-09T15:12:25.550170+0000","last_active":"2024-03-09T15:12:25.550124+0000","last_peered":"2024-03-09T15:12:25.550124+0000","last_clean":"2024-03-09T15:12:25.550124+0000","last_became_active":"2024-03-09T14:26:32.653026+0000","last_became_peered":"2024-03-09T14:26:32.653026+0000","last_unstale":"2024-03-09T15:12:25.550124+0000","last_undegraded":"2024-03-09T15:12:25.550124+0000","last_fullsized":"2024-03-09T15:12:25.550124+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-03-09T15:12:25.550031+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-03-09T15:12:25.550031+0000","last_clean_scrub_stamp":"2024-03-09T15:12:25.550031+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:07:07.970128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8197,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":250,"num_read_kb":316,"num_write":112,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:51.758985+0000","last_change":"2024-03-09T15:11:51.758985+0000","last_active":"2024-03-09T15:11:51.758985+0000","last_peered":"2024-03-09T15:11:51.758985+0000","last_clean":"2024-03-09T15:11:51.758985+0000","last_became_active":"2024-03-09T14:26:34.673715+0000","last_became_peered":"2024-03-09T14:26:34.673715+0000","last_unstale":"2024-03-09T15:11:51.758985+0000","last_undegraded":"2024-03-09T15:11:51.758985+0000","last_fullsized":"2024-03-09T15:11:51.758985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:11:51.758812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:11:51.758812+0000","last_clean_scrub_stamp":"2024-03-09T15:11:51.758812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:01:51.947493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'123","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.928141+0000","last_change":"2024-03-09T15:12:00.928141+0000","last_active":"2024-03-09T15:12:00.928141+0000","last_peered":"2024-03-09T15:12:00.928141+0000","last_clean":"2024-03-09T15:12:00.928141+0000","last_became_active":"2024-03-09T14:26:36.672843+0000","last_became_peered":"2024-03-09T14:26:36.672843+0000","last_unstale":"2024-03-09T15:12:00.928141+0000","last_undegraded":"2024-03-09T15:12:00.928141+0000","last_fullsized":"2024-03-09T15:12:00.928141+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'123","last_scrub_stamp":"2024-03-09T15:12:00.928002+0000","last_deep_scrub":"264'123","last_deep_scrub_stamp":"2024-03-09T15:12:00.928002+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.928002+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:02:24.575451+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":286,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'746","reported_seq":2343,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.055219+0000","last_change":"2024-03-09T15:12:14.055269+0000","last_active":"2024-03-09T15:12:14.055219+0000","last_peered":"2024-03-09T15:12:14.055219+0000","last_clean":"2024-03-09T15:12:14.055219+0000","last_became_active":"2024-03-09T14:26:28.656983+0000","last_became_peered":"2024-03-09T14:26:28.656983+0000","last_unstale":"2024-03-09T15:12:14.055219+0000","last_undegraded":"2024-03-09T15:12:14.055219+0000","last_fullsized":"2024-03-09T15:12:14.055219+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'746","last_scrub_stamp":"2024-03-09T15:12:14.055099+0000","last_deep_scrub":"264'746","last_deep_scrub_stamp":"2024-03-09T15:12:14.055099+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.055099+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:50:19.578653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3462,"num_read_kb":3140,"num_write":976,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'178","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.896895+0000","last_change":"2024-03-09T15:11:59.896895+0000","last_active":"2024-03-09T15:11:59.896895+0000","last_peered":"2024-03-09T15:11:59.896895+0000","last_clean":"2024-03-09T15:11:59.896895+0000","last_became_active":"2024-03-09T14:27:03.724370+0000","last_became_peered":"2024-03-09T14:27:03.724370+0000","last_unstale":"2024-03-09T15:11:59.896895+0000","last_undegraded":"2024-03-09T15:11:59.896895+0000","last_fullsized":"2024-03-09T15:11:59.896895+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-03-09T15:11:59.896739+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-03-09T15:11:59.896739+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.896739+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:55:55.773250+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":389,"num_read_kb":32223,"num_write":1032,"num_write_kb":26912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.896555+0000","last_change":"2024-03-09T15:11:58.896581+0000","last_active":"2024-03-09T15:11:58.896555+0000","last_peered":"2024-03-09T15:11:58.896555+0000","last_clean":"2024-03-09T15:11:58.896555+0000","last_became_active":"2024-03-09T14:26:30.653184+0000","last_became_peered":"2024-03-09T14:26:30.653184+0000","last_unstale":"2024-03-09T15:11:58.896555+0000","last_undegraded":"2024-03-09T15:11:58.896555+0000","last_fullsized":"2024-03-09T15:11:58.896555+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:11:58.896456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:11:58.896456+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.896456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:41:39.300580+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'164","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:31.905506+0000","last_change":"2024-03-09T15:12:31.905547+0000","last_active":"2024-03-09T15:12:31.905506+0000","last_peered":"2024-03-09T15:12:31.905506+0000","last_clean":"2024-03-09T15:12:31.905506+0000","last_became_active":"2024-03-09T14:26:32.652956+0000","last_became_peered":"2024-03-09T14:26:32.652956+0000","last_unstale":"2024-03-09T15:12:31.905506+0000","last_undegraded":"2024-03-09T15:12:31.905506+0000","last_fullsized":"2024-03-09T15:12:31.905506+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'164","last_scrub_stamp":"2024-03-09T15:12:31.905417+0000","last_deep_scrub":"264'164","last_deep_scrub_stamp":"2024-03-09T15:12:31.905417+0000","last_clean_scrub_stamp":"2024-03-09T15:12:31.905417+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:10.784568+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7924,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":318,"num_write":180,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.454267+0000","last_change":"2024-03-09T15:12:08.454294+0000","last_active":"2024-03-09T15:12:08.454267+0000","last_peered":"2024-03-09T15:12:08.454267+0000","last_clean":"2024-03-09T15:12:08.454267+0000","last_became_active":"2024-03-09T14:26:34.675354+0000","last_became_peered":"2024-03-09T14:26:34.675354+0000","last_unstale":"2024-03-09T15:12:08.454267+0000","last_undegraded":"2024-03-09T15:12:08.454267+0000","last_fullsized":"2024-03-09T15:12:08.454267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:08.454125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:08.454125+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.454125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:39:33.417972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'147","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.084756+0000","last_change":"2024-03-09T15:12:07.084756+0000","last_active":"2024-03-09T15:12:07.084756+0000","last_peered":"2024-03-09T15:12:07.084756+0000","last_clean":"2024-03-09T15:12:07.084756+0000","last_became_active":"2024-03-09T14:26:36.672111+0000","last_became_peered":"2024-03-09T14:26:36.672111+0000","last_unstale":"2024-03-09T15:12:07.084756+0000","last_undegraded":"2024-03-09T15:12:07.084756+0000","last_fullsized":"2024-03-09T15:12:07.084756+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-03-09T15:12:07.084592+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-03-09T15:12:07.084592+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.084592+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:46:57.461652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":110,"num_write":237,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'512","reported_seq":1991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.102653+0000","last_change":"2024-03-09T15:12:11.102714+0000","last_active":"2024-03-09T15:12:11.102653+0000","last_peered":"2024-03-09T15:12:11.102653+0000","last_clean":"2024-03-09T15:12:11.102653+0000","last_became_active":"2024-03-09T14:26:28.650560+0000","last_became_peered":"2024-03-09T14:26:28.650560+0000","last_unstale":"2024-03-09T15:12:11.102653+0000","last_undegraded":"2024-03-09T15:12:11.102653+0000","last_fullsized":"2024-03-09T15:12:11.102653+0000","mapping_epoch":25,"log_start":"264'501","ondisk_log_start":"264'501","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'512","last_scrub_stamp":"2024-03-09T15:12:11.102538+0000","last_deep_scrub":"264'512","last_deep_scrub_stamp":"2024-03-09T15:12:11.102538+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.102538+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":501,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:13:10.878275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2567,"num_read_kb":2395,"num_write":702,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'170","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.300923+0000","last_change":"2024-03-09T15:12:16.301007+0000","last_active":"2024-03-09T15:12:16.300923+0000","last_peered":"2024-03-09T15:12:16.300923+0000","last_clean":"2024-03-09T15:12:16.300923+0000","last_became_active":"2024-03-09T14:26:26.644347+0000","last_became_peered":"2024-03-09T14:26:26.644347+0000","last_unstale":"2024-03-09T15:12:16.300923+0000","last_undegraded":"2024-03-09T15:12:16.300923+0000","last_fullsized":"2024-03-09T15:12:16.300923+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'170","last_scrub_stamp":"2024-03-09T15:12:16.300820+0000","last_deep_scrub":"264'170","last_deep_scrub_stamp":"2024-03-09T15:12:16.300820+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.300820+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:43:04.619237+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456529,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":342,"num_read_kb":3953,"num_write":941,"num_write_kb":27527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.930413+0000","last_change":"2024-03-09T15:12:03.930452+0000","last_active":"2024-03-09T15:12:03.930413+0000","last_peered":"2024-03-09T15:12:03.930413+0000","last_clean":"2024-03-09T15:12:03.930413+0000","last_became_active":"2024-03-09T14:26:30.654575+0000","last_became_peered":"2024-03-09T14:26:30.654575+0000","last_unstale":"2024-03-09T15:12:03.930413+0000","last_undegraded":"2024-03-09T15:12:03.930413+0000","last_fullsized":"2024-03-09T15:12:03.930413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:03.930331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:03.930331+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.930331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:07:07.118362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'151","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.795915+0000","last_change":"2024-03-09T15:11:54.795964+0000","last_active":"2024-03-09T15:11:54.795915+0000","last_peered":"2024-03-09T15:11:54.795915+0000","last_clean":"2024-03-09T15:11:54.795915+0000","last_became_active":"2024-03-09T14:26:32.659984+0000","last_became_peered":"2024-03-09T14:26:32.659984+0000","last_unstale":"2024-03-09T15:11:54.795915+0000","last_undegraded":"2024-03-09T15:11:54.795915+0000","last_fullsized":"2024-03-09T15:11:54.795915+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-03-09T15:11:54.795827+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-03-09T15:11:54.795827+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.795827+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:07.483041+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12965,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":276,"num_write":112,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'506","reported_seq":2232,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.759668+0000","last_change":"2024-03-09T15:11:52.759691+0000","last_active":"2024-03-09T15:11:52.759668+0000","last_peered":"2024-03-09T15:11:52.759668+0000","last_clean":"2024-03-09T15:11:52.759668+0000","last_became_active":"2024-03-09T14:26:34.673054+0000","last_became_peered":"2024-03-09T14:26:34.673054+0000","last_unstale":"2024-03-09T15:11:52.759668+0000","last_undegraded":"2024-03-09T15:11:52.759668+0000","last_fullsized":"2024-03-09T15:11:52.759668+0000","mapping_epoch":31,"log_start":"261'400","ondisk_log_start":"261'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'506","last_scrub_stamp":"2024-03-09T15:11:52.759595+0000","last_deep_scrub":"264'506","last_deep_scrub_stamp":"2024-03-09T15:11:52.759595+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.759595+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:53.620306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'100","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:25.704316+0000","last_change":"2024-03-09T15:12:25.704316+0000","last_active":"2024-03-09T15:12:25.704316+0000","last_peered":"2024-03-09T15:12:25.704316+0000","last_clean":"2024-03-09T15:12:25.704316+0000","last_became_active":"2024-03-09T14:26:36.668217+0000","last_became_peered":"2024-03-09T14:26:36.668217+0000","last_unstale":"2024-03-09T15:12:25.704316+0000","last_undegraded":"2024-03-09T15:12:25.704316+0000","last_fullsized":"2024-03-09T15:12:25.704316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-03-09T15:12:25.704178+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-03-09T15:12:25.704178+0000","last_clean_scrub_stamp":"2024-03-09T15:12:25.704178+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:49:07.289847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":82,"num_write":217,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'680","reported_seq":2388,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:29.919841+0000","last_change":"2024-03-09T15:12:29.919877+0000","last_active":"2024-03-09T15:12:29.919841+0000","last_peered":"2024-03-09T15:12:29.919841+0000","last_clean":"2024-03-09T15:12:29.919841+0000","last_became_active":"2024-03-09T14:26:28.648408+0000","last_became_peered":"2024-03-09T14:26:28.648408+0000","last_unstale":"2024-03-09T15:12:29.919841+0000","last_undegraded":"2024-03-09T15:12:29.919841+0000","last_fullsized":"2024-03-09T15:12:29.919841+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'680","last_scrub_stamp":"2024-03-09T15:12:29.919760+0000","last_deep_scrub":"264'680","last_deep_scrub_stamp":"2024-03-09T15:12:29.919760+0000","last_clean_scrub_stamp":"2024-03-09T15:12:29.919760+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":600,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:18:48.593828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3385,"num_read_kb":3042,"num_write":948,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'222","reported_seq":870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:25.895621+0000","last_change":"2024-03-09T15:12:25.895705+0000","last_active":"2024-03-09T15:12:25.895621+0000","last_peered":"2024-03-09T15:12:25.895621+0000","last_clean":"2024-03-09T15:12:25.895621+0000","last_became_active":"2024-03-09T14:26:26.643522+0000","last_became_peered":"2024-03-09T14:26:26.643522+0000","last_unstale":"2024-03-09T15:12:25.895621+0000","last_undegraded":"2024-03-09T15:12:25.895621+0000","last_fullsized":"2024-03-09T15:12:25.895621+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'222","last_scrub_stamp":"2024-03-09T15:12:25.895505+0000","last_deep_scrub":"264'222","last_deep_scrub_stamp":"2024-03-09T15:12:25.895505+0000","last_clean_scrub_stamp":"2024-03-09T15:12:25.895505+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:32:48.798666+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718714,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":452,"num_read_kb":51521,"num_write":1235,"num_write_kb":50999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.399793+0000","last_change":"2024-03-09T15:12:21.399833+0000","last_active":"2024-03-09T15:12:21.399793+0000","last_peered":"2024-03-09T15:12:21.399793+0000","last_clean":"2024-03-09T15:12:21.399793+0000","last_became_active":"2024-03-09T14:26:30.652594+0000","last_became_peered":"2024-03-09T14:26:30.652594+0000","last_unstale":"2024-03-09T15:12:21.399793+0000","last_undegraded":"2024-03-09T15:12:21.399793+0000","last_fullsized":"2024-03-09T15:12:21.399793+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:12:21.399692+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:12:21.399692+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.399692+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:01:42.826952+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":630,"num_read_kb":630,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'83","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.083255+0000","last_change":"2024-03-09T15:12:16.083290+0000","last_active":"2024-03-09T15:12:16.083255+0000","last_peered":"2024-03-09T15:12:16.083255+0000","last_clean":"2024-03-09T15:12:16.083255+0000","last_became_active":"2024-03-09T14:26:32.868147+0000","last_became_peered":"2024-03-09T14:26:32.868147+0000","last_unstale":"2024-03-09T15:12:16.083255+0000","last_undegraded":"2024-03-09T15:12:16.083255+0000","last_fullsized":"2024-03-09T15:12:16.083255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'83","last_scrub_stamp":"2024-03-09T15:12:16.083169+0000","last_deep_scrub":"264'83","last_deep_scrub_stamp":"2024-03-09T15:12:16.083169+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.083169+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:33:58.823306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'535","reported_seq":2296,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.309739+0000","last_change":"2024-03-09T15:12:04.309767+0000","last_active":"2024-03-09T15:12:04.309739+0000","last_peered":"2024-03-09T15:12:04.309739+0000","last_clean":"2024-03-09T15:12:04.309739+0000","last_became_active":"2024-03-09T14:26:34.669695+0000","last_became_peered":"2024-03-09T14:26:34.669695+0000","last_unstale":"2024-03-09T15:12:04.309739+0000","last_undegraded":"2024-03-09T15:12:04.309739+0000","last_fullsized":"2024-03-09T15:12:04.309739+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'535","last_scrub_stamp":"2024-03-09T15:12:04.309652+0000","last_deep_scrub":"264'535","last_deep_scrub_stamp":"2024-03-09T15:12:04.309652+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.309652+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:43:08.557837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'143","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.218148+0000","last_change":"2024-03-09T15:11:57.218148+0000","last_active":"2024-03-09T15:11:57.218148+0000","last_peered":"2024-03-09T15:11:57.218148+0000","last_clean":"2024-03-09T15:11:57.218148+0000","last_became_active":"2024-03-09T14:26:36.668361+0000","last_became_peered":"2024-03-09T14:26:36.668361+0000","last_unstale":"2024-03-09T15:11:57.218148+0000","last_undegraded":"2024-03-09T15:11:57.218148+0000","last_fullsized":"2024-03-09T15:11:57.218148+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'143","last_scrub_stamp":"2024-03-09T15:11:57.218031+0000","last_deep_scrub":"264'143","last_deep_scrub_stamp":"2024-03-09T15:11:57.218031+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.218031+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:15:02.428364+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":387,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":346,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'486","reported_seq":2126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.973394+0000","last_change":"2024-03-09T15:12:08.973424+0000","last_active":"2024-03-09T15:12:08.973394+0000","last_peered":"2024-03-09T15:12:08.973394+0000","last_clean":"2024-03-09T15:12:08.973394+0000","last_became_active":"2024-03-09T14:26:28.654325+0000","last_became_peered":"2024-03-09T14:26:28.654325+0000","last_unstale":"2024-03-09T15:12:08.973394+0000","last_undegraded":"2024-03-09T15:12:08.973394+0000","last_fullsized":"2024-03-09T15:12:08.973394+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'486","last_scrub_stamp":"2024-03-09T15:12:08.973311+0000","last_deep_scrub":"264'486","last_deep_scrub_stamp":"2024-03-09T15:12:08.973311+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.973311+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:49.023731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2761,"num_read_kb":2604,"num_write":649,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'188","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:34.992362+0000","last_change":"2024-03-09T15:12:34.992434+0000","last_active":"2024-03-09T15:12:34.992362+0000","last_peered":"2024-03-09T15:12:34.992362+0000","last_clean":"2024-03-09T15:12:34.992362+0000","last_became_active":"2024-03-09T14:26:26.652273+0000","last_became_peered":"2024-03-09T14:26:26.652273+0000","last_unstale":"2024-03-09T15:12:34.992362+0000","last_undegraded":"2024-03-09T15:12:34.992362+0000","last_fullsized":"2024-03-09T15:12:34.992362+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'188","last_scrub_stamp":"2024-03-09T15:12:34.992189+0000","last_deep_scrub":"264'188","last_deep_scrub_stamp":"2024-03-09T15:12:34.992189+0000","last_clean_scrub_stamp":"2024-03-09T15:12:34.992189+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:03:57.901735+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262266,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":15479,"num_write":998,"num_write_kb":26748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.955802+0000","last_change":"2024-03-09T15:12:19.955827+0000","last_active":"2024-03-09T15:12:19.955802+0000","last_peered":"2024-03-09T15:12:19.955802+0000","last_clean":"2024-03-09T15:12:19.955802+0000","last_became_active":"2024-03-09T14:26:30.651949+0000","last_became_peered":"2024-03-09T14:26:30.651949+0000","last_unstale":"2024-03-09T15:12:19.955802+0000","last_undegraded":"2024-03-09T15:12:19.955802+0000","last_fullsized":"2024-03-09T15:12:19.955802+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:19.955707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:19.955707+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.955707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:53.400693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'195","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.406588+0000","last_change":"2024-03-09T15:12:06.406637+0000","last_active":"2024-03-09T15:12:06.406588+0000","last_peered":"2024-03-09T15:12:06.406588+0000","last_clean":"2024-03-09T15:12:06.406588+0000","last_became_active":"2024-03-09T14:26:32.656959+0000","last_became_peered":"2024-03-09T14:26:32.656959+0000","last_unstale":"2024-03-09T15:12:06.406588+0000","last_undegraded":"2024-03-09T15:12:06.406588+0000","last_fullsized":"2024-03-09T15:12:06.406588+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-03-09T15:12:06.406501+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-03-09T15:12:06.406501+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.406501+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:57:07.294016+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9621,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":264,"num_read_kb":329,"num_write":152,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.297468+0000","last_change":"2024-03-09T15:12:08.297491+0000","last_active":"2024-03-09T15:12:08.297468+0000","last_peered":"2024-03-09T15:12:08.297468+0000","last_clean":"2024-03-09T15:12:08.297468+0000","last_became_active":"2024-03-09T14:26:34.675350+0000","last_became_peered":"2024-03-09T14:26:34.675350+0000","last_unstale":"2024-03-09T15:12:08.297468+0000","last_undegraded":"2024-03-09T15:12:08.297468+0000","last_fullsized":"2024-03-09T15:12:08.297468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:08.297379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:08.297379+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.297379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:13:35.442572+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'124","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.981933+0000","last_change":"2024-03-09T15:11:58.981933+0000","last_active":"2024-03-09T15:11:58.981933+0000","last_peered":"2024-03-09T15:11:58.981933+0000","last_clean":"2024-03-09T15:11:58.981933+0000","last_became_active":"2024-03-09T14:26:36.673059+0000","last_became_peered":"2024-03-09T14:26:36.673059+0000","last_unstale":"2024-03-09T15:11:58.981933+0000","last_undegraded":"2024-03-09T15:11:58.981933+0000","last_fullsized":"2024-03-09T15:11:58.981933+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:11:58.981820+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:11:58.981820+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.981820+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:12.931239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":194,"num_write":274,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'858","reported_seq":2487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.276948+0000","last_change":"2024-03-09T15:12:05.276948+0000","last_active":"2024-03-09T15:12:05.276948+0000","last_peered":"2024-03-09T15:12:05.276948+0000","last_clean":"2024-03-09T15:12:05.276948+0000","last_became_active":"2024-03-09T14:26:28.653261+0000","last_became_peered":"2024-03-09T14:26:28.653261+0000","last_unstale":"2024-03-09T15:12:05.276948+0000","last_undegraded":"2024-03-09T15:12:05.276948+0000","last_fullsized":"2024-03-09T15:12:05.276948+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'858","last_scrub_stamp":"2024-03-09T15:12:05.276825+0000","last_deep_scrub":"264'858","last_deep_scrub_stamp":"2024-03-09T15:12:05.276825+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.276825+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:38:48.151292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3846,"num_read_kb":3440,"num_write":1147,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'119","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:34.754163+0000","last_change":"2024-03-09T15:12:34.754236+0000","last_active":"2024-03-09T15:12:34.754163+0000","last_peered":"2024-03-09T15:12:34.754163+0000","last_clean":"2024-03-09T15:12:34.754163+0000","last_became_active":"2024-03-09T14:26:13.797817+0000","last_became_peered":"2024-03-09T14:26:13.797817+0000","last_unstale":"2024-03-09T15:12:34.754163+0000","last_undegraded":"2024-03-09T15:12:34.754163+0000","last_fullsized":"2024-03-09T15:12:34.754163+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-03-09T15:12:34.754058+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-03-09T15:12:34.754058+0000","last_clean_scrub_stamp":"2024-03-09T15:12:34.754058+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:17:49.551967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:26.345288+0000","last_change":"2024-03-09T15:12:26.345312+0000","last_active":"2024-03-09T15:12:26.345288+0000","last_peered":"2024-03-09T15:12:26.345288+0000","last_clean":"2024-03-09T15:12:26.345288+0000","last_became_active":"2024-03-09T14:26:18.581598+0000","last_became_peered":"2024-03-09T14:26:18.581598+0000","last_unstale":"2024-03-09T15:12:26.345288+0000","last_undegraded":"2024-03-09T15:12:26.345288+0000","last_fullsized":"2024-03-09T15:12:26.345288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:26.345178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:26.345178+0000","last_clean_scrub_stamp":"2024-03-09T15:12:26.345178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:12:25.158203+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'183","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:43.008312+0000","last_change":"2024-03-09T15:12:43.008408+0000","last_active":"2024-03-09T15:12:43.008312+0000","last_peered":"2024-03-09T15:12:43.008312+0000","last_clean":"2024-03-09T15:12:43.008312+0000","last_became_active":"2024-03-09T14:26:26.644848+0000","last_became_peered":"2024-03-09T14:26:26.644848+0000","last_unstale":"2024-03-09T15:12:43.008312+0000","last_undegraded":"2024-03-09T15:12:43.008312+0000","last_fullsized":"2024-03-09T15:12:43.008312+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'183","last_scrub_stamp":"2024-03-09T15:12:43.008155+0000","last_deep_scrub":"264'183","last_deep_scrub_stamp":"2024-03-09T15:12:43.008155+0000","last_clean_scrub_stamp":"2024-03-09T15:12:43.008155+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:47:16.033602+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992272,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":345,"num_read_kb":37512,"num_write":1008,"num_write_kb":40555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:20.808700+0000","last_change":"2024-03-09T15:12:20.808700+0000","last_active":"2024-03-09T15:12:20.808700+0000","last_peered":"2024-03-09T15:12:20.808700+0000","last_clean":"2024-03-09T15:12:20.808700+0000","last_became_active":"2024-03-09T14:26:30.650376+0000","last_became_peered":"2024-03-09T14:26:30.650376+0000","last_unstale":"2024-03-09T15:12:20.808700+0000","last_undegraded":"2024-03-09T15:12:20.808700+0000","last_fullsized":"2024-03-09T15:12:20.808700+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:20.808590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:20.808590+0000","last_clean_scrub_stamp":"2024-03-09T15:12:20.808590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:23:26.881934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'306","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.380281+0000","last_change":"2024-03-09T15:12:05.380281+0000","last_active":"2024-03-09T15:12:05.380281+0000","last_peered":"2024-03-09T15:12:05.380281+0000","last_clean":"2024-03-09T15:12:05.380281+0000","last_became_active":"2024-03-09T14:26:32.657752+0000","last_became_peered":"2024-03-09T14:26:32.657752+0000","last_unstale":"2024-03-09T15:12:05.380281+0000","last_undegraded":"2024-03-09T15:12:05.380281+0000","last_fullsized":"2024-03-09T15:12:05.380281+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-03-09T15:12:05.380113+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-03-09T15:12:05.380113+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.380113+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:03:36.952007+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33862,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":557,"num_read_kb":770,"num_write":482,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89050,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.449244+0000","last_change":"2024-03-09T15:12:10.449266+0000","last_active":"2024-03-09T15:12:10.449244+0000","last_peered":"2024-03-09T15:12:10.449244+0000","last_clean":"2024-03-09T15:12:10.449244+0000","last_became_active":"2024-03-09T14:26:34.670987+0000","last_became_peered":"2024-03-09T14:26:34.670987+0000","last_unstale":"2024-03-09T15:12:10.449244+0000","last_undegraded":"2024-03-09T15:12:10.449244+0000","last_fullsized":"2024-03-09T15:12:10.449244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:10.449117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:10.449117+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.449117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:23:14.231544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'207","reported_seq":905,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.254554+0000","last_change":"2024-03-09T15:12:12.254604+0000","last_active":"2024-03-09T15:12:12.254554+0000","last_peered":"2024-03-09T15:12:12.254554+0000","last_clean":"2024-03-09T15:12:12.254554+0000","last_became_active":"2024-03-09T14:26:36.671941+0000","last_became_peered":"2024-03-09T14:26:36.671941+0000","last_unstale":"2024-03-09T15:12:12.254554+0000","last_undegraded":"2024-03-09T15:12:12.254554+0000","last_fullsized":"2024-03-09T15:12:12.254554+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-03-09T15:12:12.254464+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-03-09T15:12:12.254464+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.254464+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:34.424401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":432,"num_read_kb":416,"num_write":433,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'396","reported_seq":1996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.566469+0000","last_change":"2024-03-09T15:12:17.566505+0000","last_active":"2024-03-09T15:12:17.566469+0000","last_peered":"2024-03-09T15:12:17.566469+0000","last_clean":"2024-03-09T15:12:17.566469+0000","last_became_active":"2024-03-09T14:26:28.652611+0000","last_became_peered":"2024-03-09T14:26:28.652611+0000","last_unstale":"2024-03-09T15:12:17.566469+0000","last_undegraded":"2024-03-09T15:12:17.566469+0000","last_fullsized":"2024-03-09T15:12:17.566469+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'396","last_scrub_stamp":"2024-03-09T15:12:17.566379+0000","last_deep_scrub":"264'396","last_deep_scrub_stamp":"2024-03-09T15:12:17.566379+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.566379+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:41.776537+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2259,"num_read_kb":2164,"num_write":448,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:36.771631+0000","last_change":"2024-03-09T15:12:36.771654+0000","last_active":"2024-03-09T15:12:36.771631+0000","last_peered":"2024-03-09T15:12:36.771631+0000","last_clean":"2024-03-09T15:12:36.771631+0000","last_became_active":"2024-03-09T14:26:18.581306+0000","last_became_peered":"2024-03-09T14:26:18.581306+0000","last_unstale":"2024-03-09T15:12:36.771631+0000","last_undegraded":"2024-03-09T15:12:36.771631+0000","last_fullsized":"2024-03-09T15:12:36.771631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:36.771537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:36.771537+0000","last_clean_scrub_stamp":"2024-03-09T15:12:36.771537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:56:26.657532+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'137","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:35.492366+0000","last_change":"2024-03-09T15:12:35.492432+0000","last_active":"2024-03-09T15:12:35.492366+0000","last_peered":"2024-03-09T15:12:35.492366+0000","last_clean":"2024-03-09T15:12:35.492366+0000","last_became_active":"2024-03-09T14:26:26.632272+0000","last_became_peered":"2024-03-09T14:26:26.632272+0000","last_unstale":"2024-03-09T15:12:35.492366+0000","last_undegraded":"2024-03-09T15:12:35.492366+0000","last_fullsized":"2024-03-09T15:12:35.492366+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-03-09T15:12:35.492241+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-03-09T15:12:35.492241+0000","last_clean_scrub_stamp":"2024-03-09T15:12:35.492241+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:44:49.728772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":283,"num_read_kb":61756,"num_write":788,"num_write_kb":21716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.403929+0000","last_change":"2024-03-09T15:12:23.403954+0000","last_active":"2024-03-09T15:12:23.403929+0000","last_peered":"2024-03-09T15:12:23.403929+0000","last_clean":"2024-03-09T15:12:23.403929+0000","last_became_active":"2024-03-09T14:26:30.654922+0000","last_became_peered":"2024-03-09T14:26:30.654922+0000","last_unstale":"2024-03-09T15:12:23.403929+0000","last_undegraded":"2024-03-09T15:12:23.403929+0000","last_fullsized":"2024-03-09T15:12:23.403929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:23.403834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:23.403834+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.403834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:25:02.787238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'702","reported_seq":2101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.943001+0000","last_change":"2024-03-09T15:12:05.943001+0000","last_active":"2024-03-09T15:12:05.943001+0000","last_peered":"2024-03-09T15:12:05.943001+0000","last_clean":"2024-03-09T15:12:05.943001+0000","last_became_active":"2024-03-09T14:26:32.655430+0000","last_became_peered":"2024-03-09T14:26:32.655430+0000","last_unstale":"2024-03-09T15:12:05.943001+0000","last_undegraded":"2024-03-09T15:12:05.943001+0000","last_fullsized":"2024-03-09T15:12:05.943001+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'702","last_scrub_stamp":"2024-03-09T15:12:05.942851+0000","last_deep_scrub":"264'702","last_deep_scrub_stamp":"2024-03-09T15:12:05.942851+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.942851+0000","objects_scrubbed":12,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:10:41.864242+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17414,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":925,"num_read_kb":1078,"num_write":294,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:11.949202+0000","last_change":"2024-03-09T15:12:11.949202+0000","last_active":"2024-03-09T15:12:11.949202+0000","last_peered":"2024-03-09T15:12:11.949202+0000","last_clean":"2024-03-09T15:12:11.949202+0000","last_became_active":"2024-03-09T14:26:34.678431+0000","last_became_peered":"2024-03-09T14:26:34.678431+0000","last_unstale":"2024-03-09T15:12:11.949202+0000","last_undegraded":"2024-03-09T15:12:11.949202+0000","last_fullsized":"2024-03-09T15:12:11.949202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:11.949038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:11.949038+0000","last_clean_scrub_stamp":"2024-03-09T15:12:11.949038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:12:06.095596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'165","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.020974+0000","last_change":"2024-03-09T15:11:58.020974+0000","last_active":"2024-03-09T15:11:58.020974+0000","last_peered":"2024-03-09T15:11:58.020974+0000","last_clean":"2024-03-09T15:11:58.020974+0000","last_became_active":"2024-03-09T14:26:36.784815+0000","last_became_peered":"2024-03-09T14:26:36.784815+0000","last_unstale":"2024-03-09T15:11:58.020974+0000","last_undegraded":"2024-03-09T15:11:58.020974+0000","last_fullsized":"2024-03-09T15:11:58.020974+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-03-09T15:11:58.020857+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-03-09T15:11:58.020857+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.020857+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:55:16.554222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":213,"num_read_kb":212,"num_write":359,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'798","reported_seq":2471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.840843+0000","last_change":"2024-03-09T15:12:12.840888+0000","last_active":"2024-03-09T15:12:12.840843+0000","last_peered":"2024-03-09T15:12:12.840843+0000","last_clean":"2024-03-09T15:12:12.840843+0000","last_became_active":"2024-03-09T14:26:28.650409+0000","last_became_peered":"2024-03-09T14:26:28.650409+0000","last_unstale":"2024-03-09T15:12:12.840843+0000","last_undegraded":"2024-03-09T15:12:12.840843+0000","last_fullsized":"2024-03-09T15:12:12.840843+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'798","last_scrub_stamp":"2024-03-09T15:12:12.840759+0000","last_deep_scrub":"264'798","last_deep_scrub_stamp":"2024-03-09T15:12:12.840759+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.840759+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:47:58.312223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3830,"num_read_kb":3466,"num_write":1049,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2681,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.921226+0000","last_change":"2024-03-09T15:12:07.921250+0000","last_active":"2024-03-09T15:12:07.921226+0000","last_peered":"2024-03-09T15:12:07.921226+0000","last_clean":"2024-03-09T15:12:07.921226+0000","last_became_active":"2024-03-09T14:26:18.577041+0000","last_became_peered":"2024-03-09T14:26:18.577041+0000","last_unstale":"2024-03-09T15:12:07.921226+0000","last_undegraded":"2024-03-09T15:12:07.921226+0000","last_fullsized":"2024-03-09T15:12:07.921226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:07.921131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:07.921131+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.921131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:13:44.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'176","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.824760+0000","last_change":"2024-03-09T15:12:21.824760+0000","last_active":"2024-03-09T15:12:21.824760+0000","last_peered":"2024-03-09T15:12:21.824760+0000","last_clean":"2024-03-09T15:12:21.824760+0000","last_became_active":"2024-03-09T14:26:26.635771+0000","last_became_peered":"2024-03-09T14:26:26.635771+0000","last_unstale":"2024-03-09T15:12:21.824760+0000","last_undegraded":"2024-03-09T15:12:21.824760+0000","last_fullsized":"2024-03-09T15:12:21.824760+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'176","last_scrub_stamp":"2024-03-09T15:12:21.824568+0000","last_deep_scrub":"264'176","last_deep_scrub_stamp":"2024-03-09T15:12:21.824568+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.824568+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:13:46.172168+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730144,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":357,"num_read_kb":5368,"num_write":1014,"num_write_kb":33352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'7","reported_seq":825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.910474+0000","last_change":"2024-03-09T15:12:02.910518+0000","last_active":"2024-03-09T15:12:02.910474+0000","last_peered":"2024-03-09T15:12:02.910474+0000","last_clean":"2024-03-09T15:12:02.910474+0000","last_became_active":"2024-03-09T14:26:30.650766+0000","last_became_peered":"2024-03-09T14:26:30.650766+0000","last_unstale":"2024-03-09T15:12:02.910474+0000","last_undegraded":"2024-03-09T15:12:02.910474+0000","last_fullsized":"2024-03-09T15:12:02.910474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-03-09T15:12:02.910368+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-03-09T15:12:02.910368+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.910368+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:27.066749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1149,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":787,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'255","reported_seq":1339,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:42.830932+0000","last_change":"2024-03-09T15:12:42.830970+0000","last_active":"2024-03-09T15:12:42.830932+0000","last_peered":"2024-03-09T15:12:42.830932+0000","last_clean":"2024-03-09T15:12:42.830932+0000","last_became_active":"2024-03-09T14:26:32.868092+0000","last_became_peered":"2024-03-09T14:26:32.868092+0000","last_unstale":"2024-03-09T15:12:42.830932+0000","last_undegraded":"2024-03-09T15:12:42.830932+0000","last_fullsized":"2024-03-09T15:12:42.830932+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'255","last_scrub_stamp":"2024-03-09T15:12:42.830844+0000","last_deep_scrub":"264'255","last_deep_scrub_stamp":"2024-03-09T15:12:42.830844+0000","last_clean_scrub_stamp":"2024-03-09T15:12:42.830844+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:58.979944+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":188,"num_read_kb":180,"num_write":173,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.562662+0000","last_change":"2024-03-09T15:12:14.562662+0000","last_active":"2024-03-09T15:12:14.562662+0000","last_peered":"2024-03-09T15:12:14.562662+0000","last_clean":"2024-03-09T15:12:14.562662+0000","last_became_active":"2024-03-09T14:26:34.666484+0000","last_became_peered":"2024-03-09T14:26:34.666484+0000","last_unstale":"2024-03-09T15:12:14.562662+0000","last_undegraded":"2024-03-09T15:12:14.562662+0000","last_fullsized":"2024-03-09T15:12:14.562662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:14.562543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:14.562543+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.562543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:43.432852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'257","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.108568+0000","last_change":"2024-03-09T15:12:05.108604+0000","last_active":"2024-03-09T15:12:05.108568+0000","last_peered":"2024-03-09T15:12:05.108568+0000","last_clean":"2024-03-09T15:12:05.108568+0000","last_became_active":"2024-03-09T14:26:36.674637+0000","last_became_peered":"2024-03-09T14:26:36.674637+0000","last_unstale":"2024-03-09T15:12:05.108568+0000","last_undegraded":"2024-03-09T15:12:05.108568+0000","last_fullsized":"2024-03-09T15:12:05.108568+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-03-09T15:12:05.108478+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-03-09T15:12:05.108478+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.108478+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:01.447168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":491,"num_write":562,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'351","reported_seq":1828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.796019+0000","last_change":"2024-03-09T15:12:16.796019+0000","last_active":"2024-03-09T15:12:16.796019+0000","last_peered":"2024-03-09T15:12:16.796019+0000","last_clean":"2024-03-09T15:12:16.796019+0000","last_became_active":"2024-03-09T14:26:28.646594+0000","last_became_peered":"2024-03-09T14:26:28.646594+0000","last_unstale":"2024-03-09T15:12:16.796019+0000","last_undegraded":"2024-03-09T15:12:16.796019+0000","last_fullsized":"2024-03-09T15:12:16.796019+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-03-09T15:12:16.795850+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-03-09T15:12:16.795850+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.795850+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:21:33.078150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1989,"num_read_kb":1907,"num_write":411,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:25.366207+0000","last_change":"2024-03-09T15:12:25.366258+0000","last_active":"2024-03-09T15:12:25.366207+0000","last_peered":"2024-03-09T15:12:25.366207+0000","last_clean":"2024-03-09T15:12:25.366207+0000","last_became_active":"2024-03-09T14:26:18.581330+0000","last_became_peered":"2024-03-09T14:26:18.581330+0000","last_unstale":"2024-03-09T15:12:25.366207+0000","last_undegraded":"2024-03-09T15:12:25.366207+0000","last_fullsized":"2024-03-09T15:12:25.366207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:25.366098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:25.366098+0000","last_clean_scrub_stamp":"2024-03-09T15:12:25.366098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:25:16.393458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'265","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.797515+0000","last_change":"2024-03-09T15:11:55.797567+0000","last_active":"2024-03-09T15:11:55.797515+0000","last_peered":"2024-03-09T15:11:55.797515+0000","last_clean":"2024-03-09T15:11:55.797515+0000","last_became_active":"2024-03-09T14:27:03.719517+0000","last_became_peered":"2024-03-09T14:27:03.719517+0000","last_unstale":"2024-03-09T15:11:55.797515+0000","last_undegraded":"2024-03-09T15:11:55.797515+0000","last_fullsized":"2024-03-09T15:11:55.797515+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'265","last_scrub_stamp":"2024-03-09T15:11:55.797417+0000","last_deep_scrub":"264'265","last_deep_scrub_stamp":"2024-03-09T15:11:55.797417+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.797417+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:46:48.759059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1107,"num_read_kb":25709,"num_write":1307,"num_write_kb":24224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.554940+0000","last_change":"2024-03-09T15:12:19.554940+0000","last_active":"2024-03-09T15:12:19.554940+0000","last_peered":"2024-03-09T15:12:19.554940+0000","last_clean":"2024-03-09T15:12:19.554940+0000","last_became_active":"2024-03-09T14:26:30.646190+0000","last_became_peered":"2024-03-09T14:26:30.646190+0000","last_unstale":"2024-03-09T15:12:19.554940+0000","last_undegraded":"2024-03-09T15:12:19.554940+0000","last_fullsized":"2024-03-09T15:12:19.554940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:19.554823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:19.554823+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.554823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:26:55.353874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'115","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:32.023043+0000","last_change":"2024-03-09T15:12:32.023090+0000","last_active":"2024-03-09T15:12:32.023043+0000","last_peered":"2024-03-09T15:12:32.023043+0000","last_clean":"2024-03-09T15:12:32.023043+0000","last_became_active":"2024-03-09T14:26:32.650020+0000","last_became_peered":"2024-03-09T14:26:32.650020+0000","last_unstale":"2024-03-09T15:12:32.023043+0000","last_undegraded":"2024-03-09T15:12:32.023043+0000","last_fullsized":"2024-03-09T15:12:32.023043+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-03-09T15:12:32.022942+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-03-09T15:12:32.022942+0000","last_clean_scrub_stamp":"2024-03-09T15:12:32.022942+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:51.845115+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":130,"num_write":96,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1504,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.256440+0000","last_change":"2024-03-09T15:12:02.256440+0000","last_active":"2024-03-09T15:12:02.256440+0000","last_peered":"2024-03-09T15:12:02.256440+0000","last_clean":"2024-03-09T15:12:02.256440+0000","last_became_active":"2024-03-09T14:26:34.667409+0000","last_became_peered":"2024-03-09T14:26:34.667409+0000","last_unstale":"2024-03-09T15:12:02.256440+0000","last_undegraded":"2024-03-09T15:12:02.256440+0000","last_fullsized":"2024-03-09T15:12:02.256440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:02.256293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:02.256293+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.256293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:53:04.069399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'129","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.326603+0000","last_change":"2024-03-09T15:11:57.326603+0000","last_active":"2024-03-09T15:11:57.326603+0000","last_peered":"2024-03-09T15:11:57.326603+0000","last_clean":"2024-03-09T15:11:57.326603+0000","last_became_active":"2024-03-09T14:26:36.674343+0000","last_became_peered":"2024-03-09T14:26:36.674343+0000","last_unstale":"2024-03-09T15:11:57.326603+0000","last_undegraded":"2024-03-09T15:11:57.326603+0000","last_fullsized":"2024-03-09T15:11:57.326603+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-03-09T15:11:57.326430+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-03-09T15:11:57.326430+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.326430+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:42.536388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1022,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":182,"num_write":308,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'428","reported_seq":2193,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.951233+0000","last_change":"2024-03-09T15:12:06.951233+0000","last_active":"2024-03-09T15:12:06.951233+0000","last_peered":"2024-03-09T15:12:06.951233+0000","last_clean":"2024-03-09T15:12:06.951233+0000","last_became_active":"2024-03-09T14:26:28.655479+0000","last_became_peered":"2024-03-09T14:26:28.655479+0000","last_unstale":"2024-03-09T15:12:06.951233+0000","last_undegraded":"2024-03-09T15:12:06.951233+0000","last_fullsized":"2024-03-09T15:12:06.951233+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'428","last_scrub_stamp":"2024-03-09T15:12:06.951095+0000","last_deep_scrub":"264'428","last_deep_scrub_stamp":"2024-03-09T15:12:06.951095+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.951095+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:57:14.025604+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2618,"num_read_kb":2506,"num_write":497,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'279","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:20.372844+0000","last_change":"2024-03-09T15:12:20.372844+0000","last_active":"2024-03-09T15:12:20.372844+0000","last_peered":"2024-03-09T15:12:20.372844+0000","last_clean":"2024-03-09T15:12:20.372844+0000","last_became_active":"2024-03-09T14:26:26.649325+0000","last_became_peered":"2024-03-09T14:26:26.649325+0000","last_unstale":"2024-03-09T15:12:20.372844+0000","last_undegraded":"2024-03-09T15:12:20.372844+0000","last_fullsized":"2024-03-09T15:12:20.372844+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'279","last_scrub_stamp":"2024-03-09T15:12:20.372679+0000","last_deep_scrub":"264'279","last_deep_scrub_stamp":"2024-03-09T15:12:20.372679+0000","last_clean_scrub_stamp":"2024-03-09T15:12:20.372679+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:37:14.298643+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778712,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":954,"num_read_kb":64626,"num_write":1397,"num_write_kb":23267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.829676+0000","last_change":"2024-03-09T15:12:18.829703+0000","last_active":"2024-03-09T15:12:18.829676+0000","last_peered":"2024-03-09T15:12:18.829676+0000","last_clean":"2024-03-09T15:12:18.829676+0000","last_became_active":"2024-03-09T14:26:18.578807+0000","last_became_peered":"2024-03-09T14:26:18.578807+0000","last_unstale":"2024-03-09T15:12:18.829676+0000","last_undegraded":"2024-03-09T15:12:18.829676+0000","last_fullsized":"2024-03-09T15:12:18.829676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:18.829567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:18.829567+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.829567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:52.562219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.574499+0000","last_change":"2024-03-09T15:12:21.574499+0000","last_active":"2024-03-09T15:12:21.574499+0000","last_peered":"2024-03-09T15:12:21.574499+0000","last_clean":"2024-03-09T15:12:21.574499+0000","last_became_active":"2024-03-09T14:26:30.648619+0000","last_became_peered":"2024-03-09T14:26:30.648619+0000","last_unstale":"2024-03-09T15:12:21.574499+0000","last_undegraded":"2024-03-09T15:12:21.574499+0000","last_fullsized":"2024-03-09T15:12:21.574499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:21.574386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:21.574386+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.574386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:32.810199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'283","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:31.523316+0000","last_change":"2024-03-09T15:12:31.523316+0000","last_active":"2024-03-09T15:12:31.523316+0000","last_peered":"2024-03-09T15:12:31.523316+0000","last_clean":"2024-03-09T15:12:31.523316+0000","last_became_active":"2024-03-09T14:26:32.653912+0000","last_became_peered":"2024-03-09T14:26:32.653912+0000","last_unstale":"2024-03-09T15:12:31.523316+0000","last_undegraded":"2024-03-09T15:12:31.523316+0000","last_fullsized":"2024-03-09T15:12:31.523316+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'283","last_scrub_stamp":"2024-03-09T15:12:31.523162+0000","last_deep_scrub":"264'283","last_deep_scrub_stamp":"2024-03-09T15:12:31.523162+0000","last_clean_scrub_stamp":"2024-03-09T15:12:31.523162+0000","objects_scrubbed":9,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:28.265887+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16298,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1016,"num_read_kb":1109,"num_write":1512,"num_write_kb":1369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":518872,"num_omap_keys":1180,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.186062+0000","last_change":"2024-03-09T15:11:59.186062+0000","last_active":"2024-03-09T15:11:59.186062+0000","last_peered":"2024-03-09T15:11:59.186062+0000","last_clean":"2024-03-09T15:11:59.186062+0000","last_became_active":"2024-03-09T14:26:34.675234+0000","last_became_peered":"2024-03-09T14:26:34.675234+0000","last_unstale":"2024-03-09T15:11:59.186062+0000","last_undegraded":"2024-03-09T15:11:59.186062+0000","last_fullsized":"2024-03-09T15:11:59.186062+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:11:59.185947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:11:59.185947+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.185947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:15.640797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'167","reported_seq":679,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.426525+0000","last_change":"2024-03-09T15:12:00.426559+0000","last_active":"2024-03-09T15:12:00.426525+0000","last_peered":"2024-03-09T15:12:00.426525+0000","last_clean":"2024-03-09T15:12:00.426525+0000","last_became_active":"2024-03-09T14:26:36.786088+0000","last_became_peered":"2024-03-09T14:26:36.786088+0000","last_unstale":"2024-03-09T15:12:00.426525+0000","last_undegraded":"2024-03-09T15:12:00.426525+0000","last_fullsized":"2024-03-09T15:12:00.426525+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'167","last_scrub_stamp":"2024-03-09T15:12:00.426423+0000","last_deep_scrub":"264'167","last_deep_scrub_stamp":"2024-03-09T15:12:00.426423+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.426423+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:03:18.704412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":687,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":146,"num_write":429,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'838","reported_seq":2551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:28.476856+0000","last_change":"2024-03-09T15:12:28.476906+0000","last_active":"2024-03-09T15:12:28.476856+0000","last_peered":"2024-03-09T15:12:28.476856+0000","last_clean":"2024-03-09T15:12:28.476856+0000","last_became_active":"2024-03-09T14:26:28.645944+0000","last_became_peered":"2024-03-09T14:26:28.645944+0000","last_unstale":"2024-03-09T15:12:28.476856+0000","last_undegraded":"2024-03-09T15:12:28.476856+0000","last_fullsized":"2024-03-09T15:12:28.476856+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'838","last_scrub_stamp":"2024-03-09T15:12:28.476743+0000","last_deep_scrub":"264'838","last_deep_scrub_stamp":"2024-03-09T15:12:28.476743+0000","last_clean_scrub_stamp":"2024-03-09T15:12:28.476743+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:01:44.053843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4110,"num_read_kb":3687,"num_write":1137,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2284,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'200","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.803207+0000","last_change":"2024-03-09T15:12:22.803264+0000","last_active":"2024-03-09T15:12:22.803207+0000","last_peered":"2024-03-09T15:12:22.803207+0000","last_clean":"2024-03-09T15:12:22.803207+0000","last_became_active":"2024-03-09T14:26:26.639853+0000","last_became_peered":"2024-03-09T14:26:26.639853+0000","last_unstale":"2024-03-09T15:12:22.803207+0000","last_undegraded":"2024-03-09T15:12:22.803207+0000","last_fullsized":"2024-03-09T15:12:22.803207+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-03-09T15:12:22.803085+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-03-09T15:12:22.803085+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.803085+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:21:14.474491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992354,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":10153,"num_write":1145,"num_write_kb":29784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:35.795145+0000","last_change":"2024-03-09T15:12:35.795166+0000","last_active":"2024-03-09T15:12:35.795145+0000","last_peered":"2024-03-09T15:12:35.795145+0000","last_clean":"2024-03-09T15:12:35.795145+0000","last_became_active":"2024-03-09T14:26:18.581750+0000","last_became_peered":"2024-03-09T14:26:18.581750+0000","last_unstale":"2024-03-09T15:12:35.795145+0000","last_undegraded":"2024-03-09T15:12:35.795145+0000","last_fullsized":"2024-03-09T15:12:35.795145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:35.795055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:35.795055+0000","last_clean_scrub_stamp":"2024-03-09T15:12:35.795055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:36:05.107511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.293296+0000","last_change":"2024-03-09T15:12:03.293296+0000","last_active":"2024-03-09T15:12:03.293296+0000","last_peered":"2024-03-09T15:12:03.293296+0000","last_clean":"2024-03-09T15:12:03.293296+0000","last_became_active":"2024-03-09T14:26:30.649176+0000","last_became_peered":"2024-03-09T14:26:30.649176+0000","last_unstale":"2024-03-09T15:12:03.293296+0000","last_undegraded":"2024-03-09T15:12:03.293296+0000","last_fullsized":"2024-03-09T15:12:03.293296+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:03.293087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:03.293087+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.293087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:24.818377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'194","reported_seq":763,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.940076+0000","last_change":"2024-03-09T15:12:09.940076+0000","last_active":"2024-03-09T15:12:09.940076+0000","last_peered":"2024-03-09T15:12:09.940076+0000","last_clean":"2024-03-09T15:12:09.940076+0000","last_became_active":"2024-03-09T14:26:32.868165+0000","last_became_peered":"2024-03-09T14:26:32.868165+0000","last_unstale":"2024-03-09T15:12:09.940076+0000","last_undegraded":"2024-03-09T15:12:09.940076+0000","last_fullsized":"2024-03-09T15:12:09.940076+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'194","last_scrub_stamp":"2024-03-09T15:12:09.939941+0000","last_deep_scrub":"264'194","last_deep_scrub_stamp":"2024-03-09T15:12:09.939941+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.939941+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:11:13.722883+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":224,"num_write":210,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5650,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'558","reported_seq":2233,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.361470+0000","last_change":"2024-03-09T15:12:02.361470+0000","last_active":"2024-03-09T15:12:02.361470+0000","last_peered":"2024-03-09T15:12:02.361470+0000","last_clean":"2024-03-09T15:12:02.361470+0000","last_became_active":"2024-03-09T14:26:34.672351+0000","last_became_peered":"2024-03-09T14:26:34.672351+0000","last_unstale":"2024-03-09T15:12:02.361470+0000","last_undegraded":"2024-03-09T15:12:02.361470+0000","last_fullsized":"2024-03-09T15:12:02.361470+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'558","last_scrub_stamp":"2024-03-09T15:12:02.361345+0000","last_deep_scrub":"264'558","last_deep_scrub_stamp":"2024-03-09T15:12:02.361345+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.361345+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:21:04.025240+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'124","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.082707+0000","last_change":"2024-03-09T15:12:03.082748+0000","last_active":"2024-03-09T15:12:03.082707+0000","last_peered":"2024-03-09T15:12:03.082707+0000","last_clean":"2024-03-09T15:12:03.082707+0000","last_became_active":"2024-03-09T14:26:36.785453+0000","last_became_peered":"2024-03-09T14:26:36.785453+0000","last_unstale":"2024-03-09T15:12:03.082707+0000","last_undegraded":"2024-03-09T15:12:03.082707+0000","last_fullsized":"2024-03-09T15:12:03.082707+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:12:03.082612+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:12:03.082612+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.082612+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:56.726690+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":860,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":155,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'677","reported_seq":2135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:25.005636+0000","last_change":"2024-03-09T15:12:25.005636+0000","last_active":"2024-03-09T15:12:25.005636+0000","last_peered":"2024-03-09T15:12:25.005636+0000","last_clean":"2024-03-09T15:12:25.005636+0000","last_became_active":"2024-03-09T14:26:28.655904+0000","last_became_peered":"2024-03-09T14:26:28.655904+0000","last_unstale":"2024-03-09T15:12:25.005636+0000","last_undegraded":"2024-03-09T15:12:25.005636+0000","last_fullsized":"2024-03-09T15:12:25.005636+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'677","last_scrub_stamp":"2024-03-09T15:12:25.005508+0000","last_deep_scrub":"264'677","last_deep_scrub_stamp":"2024-03-09T15:12:25.005508+0000","last_clean_scrub_stamp":"2024-03-09T15:12:25.005508+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":600,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:02:36.921019+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3203,"num_read_kb":2919,"num_write":883,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'221","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:42.011648+0000","last_change":"2024-03-09T15:12:42.011721+0000","last_active":"2024-03-09T15:12:42.011648+0000","last_peered":"2024-03-09T15:12:42.011648+0000","last_clean":"2024-03-09T15:12:42.011648+0000","last_became_active":"2024-03-09T14:26:26.643087+0000","last_became_peered":"2024-03-09T14:26:26.643087+0000","last_unstale":"2024-03-09T15:12:42.011648+0000","last_undegraded":"2024-03-09T15:12:42.011648+0000","last_fullsized":"2024-03-09T15:12:42.011648+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-03-09T15:12:42.011519+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-03-09T15:12:42.011519+0000","last_clean_scrub_stamp":"2024-03-09T15:12:42.011519+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:24:25.127066+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":456,"num_read_kb":60158,"num_write":1088,"num_write_kb":49675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.783967+0000","last_change":"2024-03-09T15:12:17.784007+0000","last_active":"2024-03-09T15:12:17.783967+0000","last_peered":"2024-03-09T15:12:17.783967+0000","last_clean":"2024-03-09T15:12:17.783967+0000","last_became_active":"2024-03-09T14:26:18.577564+0000","last_became_peered":"2024-03-09T14:26:18.577564+0000","last_unstale":"2024-03-09T15:12:17.783967+0000","last_undegraded":"2024-03-09T15:12:17.783967+0000","last_fullsized":"2024-03-09T15:12:17.783967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:17.783855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:17.783855+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.783855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:51.999902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.036401+0000","last_change":"2024-03-09T15:12:18.036401+0000","last_active":"2024-03-09T15:12:18.036401+0000","last_peered":"2024-03-09T15:12:18.036401+0000","last_clean":"2024-03-09T15:12:18.036401+0000","last_became_active":"2024-03-09T14:26:30.650370+0000","last_became_peered":"2024-03-09T14:26:30.650370+0000","last_unstale":"2024-03-09T15:12:18.036401+0000","last_undegraded":"2024-03-09T15:12:18.036401+0000","last_fullsized":"2024-03-09T15:12:18.036401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:18.036284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:18.036284+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.036284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:48:04.074398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'107","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.081426+0000","last_change":"2024-03-09T15:12:05.081426+0000","last_active":"2024-03-09T15:12:05.081426+0000","last_peered":"2024-03-09T15:12:05.081426+0000","last_clean":"2024-03-09T15:12:05.081426+0000","last_became_active":"2024-03-09T14:26:32.655285+0000","last_became_peered":"2024-03-09T14:26:32.655285+0000","last_unstale":"2024-03-09T15:12:05.081426+0000","last_undegraded":"2024-03-09T15:12:05.081426+0000","last_fullsized":"2024-03-09T15:12:05.081426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-03-09T15:12:05.081295+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-03-09T15:12:05.081295+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.081295+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:35.530675+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":120,"num_read_kb":114,"num_write":82,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'565","reported_seq":4071,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.104143+0000","last_change":"2024-03-09T15:12:12.104143+0000","last_active":"2024-03-09T15:12:12.104143+0000","last_peered":"2024-03-09T15:12:12.104143+0000","last_clean":"2024-03-09T15:12:12.104143+0000","last_became_active":"2024-03-09T14:26:34.678503+0000","last_became_peered":"2024-03-09T14:26:34.678503+0000","last_unstale":"2024-03-09T15:12:12.104143+0000","last_undegraded":"2024-03-09T15:12:12.104143+0000","last_fullsized":"2024-03-09T15:12:12.104143+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'565","last_scrub_stamp":"2024-03-09T15:12:12.103964+0000","last_deep_scrub":"264'565","last_deep_scrub_stamp":"2024-03-09T15:12:12.103964+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.103964+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:42.234957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'187","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:05.442621+0000","last_change":"2024-03-09T15:12:05.442677+0000","last_active":"2024-03-09T15:12:05.442621+0000","last_peered":"2024-03-09T15:12:05.442621+0000","last_clean":"2024-03-09T15:12:05.442621+0000","last_became_active":"2024-03-09T14:26:36.668775+0000","last_became_peered":"2024-03-09T14:26:36.668775+0000","last_unstale":"2024-03-09T15:12:05.442621+0000","last_undegraded":"2024-03-09T15:12:05.442621+0000","last_fullsized":"2024-03-09T15:12:05.442621+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-03-09T15:12:05.442512+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-03-09T15:12:05.442512+0000","last_clean_scrub_stamp":"2024-03-09T15:12:05.442512+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:06:37.514099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":97,"num_write":406,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'323","reported_seq":1669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.039241+0000","last_change":"2024-03-09T15:12:09.039241+0000","last_active":"2024-03-09T15:12:09.039241+0000","last_peered":"2024-03-09T15:12:09.039241+0000","last_clean":"2024-03-09T15:12:09.039241+0000","last_became_active":"2024-03-09T14:26:28.653003+0000","last_became_peered":"2024-03-09T14:26:28.653003+0000","last_unstale":"2024-03-09T15:12:09.039241+0000","last_undegraded":"2024-03-09T15:12:09.039241+0000","last_fullsized":"2024-03-09T15:12:09.039241+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-03-09T15:12:09.039101+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-03-09T15:12:09.039101+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.039101+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:16:44.029365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1763,"num_read_kb":1672,"num_write":372,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'241","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.881045+0000","last_change":"2024-03-09T15:11:57.881045+0000","last_active":"2024-03-09T15:11:57.881045+0000","last_peered":"2024-03-09T15:11:57.881045+0000","last_clean":"2024-03-09T15:11:57.881045+0000","last_became_active":"2024-03-09T14:27:03.719395+0000","last_became_peered":"2024-03-09T14:27:03.719395+0000","last_unstale":"2024-03-09T15:11:57.881045+0000","last_undegraded":"2024-03-09T15:11:57.881045+0000","last_fullsized":"2024-03-09T15:11:57.881045+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'241","last_scrub_stamp":"2024-03-09T15:11:57.880900+0000","last_deep_scrub":"264'241","last_deep_scrub_stamp":"2024-03-09T15:11:57.880900+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.880900+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:07:39.960326+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992298,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":20107,"num_write":1293,"num_write_kb":28946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.293882+0000","last_change":"2024-03-09T15:12:14.293922+0000","last_active":"2024-03-09T15:12:14.293882+0000","last_peered":"2024-03-09T15:12:14.293882+0000","last_clean":"2024-03-09T15:12:14.293882+0000","last_became_active":"2024-03-09T14:26:18.577994+0000","last_became_peered":"2024-03-09T14:26:18.577994+0000","last_unstale":"2024-03-09T15:12:14.293882+0000","last_undegraded":"2024-03-09T15:12:14.293882+0000","last_fullsized":"2024-03-09T15:12:14.293882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:14.293772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:14.293772+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.293772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:39.408446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:24.006019+0000","last_change":"2024-03-09T15:12:24.006019+0000","last_active":"2024-03-09T15:12:24.006019+0000","last_peered":"2024-03-09T15:12:24.006019+0000","last_clean":"2024-03-09T15:12:24.006019+0000","last_became_active":"2024-03-09T14:26:30.648910+0000","last_became_peered":"2024-03-09T14:26:30.648910+0000","last_unstale":"2024-03-09T15:12:24.006019+0000","last_undegraded":"2024-03-09T15:12:24.006019+0000","last_fullsized":"2024-03-09T15:12:24.006019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:24.005902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:24.005902+0000","last_clean_scrub_stamp":"2024-03-09T15:12:24.005902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:41:46.642481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'319","reported_seq":1039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.923725+0000","last_change":"2024-03-09T15:12:17.923725+0000","last_active":"2024-03-09T15:12:17.923725+0000","last_peered":"2024-03-09T15:12:17.923725+0000","last_clean":"2024-03-09T15:12:17.923725+0000","last_became_active":"2024-03-09T14:26:32.868370+0000","last_became_peered":"2024-03-09T14:26:32.868370+0000","last_unstale":"2024-03-09T15:12:17.923725+0000","last_undegraded":"2024-03-09T15:12:17.923725+0000","last_fullsized":"2024-03-09T15:12:17.923725+0000","mapping_epoch":29,"log_start":"264'301","ondisk_log_start":"264'301","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'319","last_scrub_stamp":"2024-03-09T15:12:17.923594+0000","last_deep_scrub":"264'319","last_deep_scrub_stamp":"2024-03-09T15:12:17.923594+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.923594+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":301,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:58.388284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32196,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":474,"num_read_kb":726,"num_write":246,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.082085+0000","last_change":"2024-03-09T15:12:13.082085+0000","last_active":"2024-03-09T15:12:13.082085+0000","last_peered":"2024-03-09T15:12:13.082085+0000","last_clean":"2024-03-09T15:12:13.082085+0000","last_became_active":"2024-03-09T14:26:34.672655+0000","last_became_peered":"2024-03-09T14:26:34.672655+0000","last_unstale":"2024-03-09T15:12:13.082085+0000","last_undegraded":"2024-03-09T15:12:13.082085+0000","last_fullsized":"2024-03-09T15:12:13.082085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:13.081992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:13.081992+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.081992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:57:51.211937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'122","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.365413+0000","last_change":"2024-03-09T15:11:53.365460+0000","last_active":"2024-03-09T15:11:53.365413+0000","last_peered":"2024-03-09T15:11:53.365413+0000","last_clean":"2024-03-09T15:11:53.365413+0000","last_became_active":"2024-03-09T14:26:36.678641+0000","last_became_peered":"2024-03-09T14:26:36.678641+0000","last_unstale":"2024-03-09T15:11:53.365413+0000","last_undegraded":"2024-03-09T15:11:53.365413+0000","last_fullsized":"2024-03-09T15:11:53.365413+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'122","last_scrub_stamp":"2024-03-09T15:11:53.365321+0000","last_deep_scrub":"264'122","last_deep_scrub_stamp":"2024-03-09T15:11:53.365321+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.365321+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:24:39.835900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'142","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.442131+0000","last_change":"2024-03-09T15:12:01.442131+0000","last_active":"2024-03-09T15:12:01.442131+0000","last_peered":"2024-03-09T15:12:01.442131+0000","last_clean":"2024-03-09T15:12:01.442131+0000","last_became_active":"2024-03-09T14:26:36.671823+0000","last_became_peered":"2024-03-09T14:26:36.671823+0000","last_unstale":"2024-03-09T15:12:01.442131+0000","last_undegraded":"2024-03-09T15:12:01.442131+0000","last_fullsized":"2024-03-09T15:12:01.442131+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-03-09T15:12:01.441992+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-03-09T15:12:01.441992+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.441992+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:57:30.083070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":220,"num_write":322,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'412","reported_seq":1981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.003641+0000","last_change":"2024-03-09T15:12:19.003675+0000","last_active":"2024-03-09T15:12:19.003641+0000","last_peered":"2024-03-09T15:12:19.003641+0000","last_clean":"2024-03-09T15:12:19.003641+0000","last_became_active":"2024-03-09T14:26:28.649681+0000","last_became_peered":"2024-03-09T14:26:28.649681+0000","last_unstale":"2024-03-09T15:12:19.003641+0000","last_undegraded":"2024-03-09T15:12:19.003641+0000","last_fullsized":"2024-03-09T15:12:19.003641+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'412","last_scrub_stamp":"2024-03-09T15:12:19.003554+0000","last_deep_scrub":"264'412","last_deep_scrub_stamp":"2024-03-09T15:12:19.003554+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.003554+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:49.080744+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2231,"num_read_kb":2115,"num_write":479,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'192","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:26.924177+0000","last_change":"2024-03-09T15:12:26.924233+0000","last_active":"2024-03-09T15:12:26.924177+0000","last_peered":"2024-03-09T15:12:26.924177+0000","last_clean":"2024-03-09T15:12:26.924177+0000","last_became_active":"2024-03-09T14:26:26.643598+0000","last_became_peered":"2024-03-09T14:26:26.643598+0000","last_unstale":"2024-03-09T15:12:26.924177+0000","last_undegraded":"2024-03-09T15:12:26.924177+0000","last_fullsized":"2024-03-09T15:12:26.924177+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-03-09T15:12:26.924084+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-03-09T15:12:26.924084+0000","last_clean_scrub_stamp":"2024-03-09T15:12:26.924084+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:07.971034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":35501,"num_write":902,"num_write_kb":49168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.942015+0000","last_change":"2024-03-09T15:12:04.942055+0000","last_active":"2024-03-09T15:12:04.942015+0000","last_peered":"2024-03-09T15:12:04.942015+0000","last_clean":"2024-03-09T15:12:04.942015+0000","last_became_active":"2024-03-09T14:26:30.650743+0000","last_became_peered":"2024-03-09T14:26:30.650743+0000","last_unstale":"2024-03-09T15:12:04.942015+0000","last_undegraded":"2024-03-09T15:12:04.942015+0000","last_fullsized":"2024-03-09T15:12:04.942015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:04.941908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:04.941908+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.941908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:48:42.425183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'133","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:33.966022+0000","last_change":"2024-03-09T15:12:33.966057+0000","last_active":"2024-03-09T15:12:33.966022+0000","last_peered":"2024-03-09T15:12:33.966022+0000","last_clean":"2024-03-09T15:12:33.966022+0000","last_became_active":"2024-03-09T14:26:32.650770+0000","last_became_peered":"2024-03-09T14:26:32.650770+0000","last_unstale":"2024-03-09T15:12:33.966022+0000","last_undegraded":"2024-03-09T15:12:33.966022+0000","last_fullsized":"2024-03-09T15:12:33.966022+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'133","last_scrub_stamp":"2024-03-09T15:12:33.965950+0000","last_deep_scrub":"264'133","last_deep_scrub_stamp":"2024-03-09T15:12:33.965950+0000","last_clean_scrub_stamp":"2024-03-09T15:12:33.965950+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:48:22.584079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7550,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":243,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.025231+0000","last_change":"2024-03-09T15:12:09.025268+0000","last_active":"2024-03-09T15:12:09.025231+0000","last_peered":"2024-03-09T15:12:09.025231+0000","last_clean":"2024-03-09T15:12:09.025231+0000","last_became_active":"2024-03-09T14:26:34.678657+0000","last_became_peered":"2024-03-09T14:26:34.678657+0000","last_unstale":"2024-03-09T15:12:09.025231+0000","last_undegraded":"2024-03-09T15:12:09.025231+0000","last_fullsized":"2024-03-09T15:12:09.025231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:09.025137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:09.025137+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.025137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:30:35.785925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'109","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:04.100945+0000","last_change":"2024-03-09T15:12:04.100945+0000","last_active":"2024-03-09T15:12:04.100945+0000","last_peered":"2024-03-09T15:12:04.100945+0000","last_clean":"2024-03-09T15:12:04.100945+0000","last_became_active":"2024-03-09T14:26:36.678174+0000","last_became_peered":"2024-03-09T14:26:36.678174+0000","last_unstale":"2024-03-09T15:12:04.100945+0000","last_undegraded":"2024-03-09T15:12:04.100945+0000","last_fullsized":"2024-03-09T15:12:04.100945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-03-09T15:12:04.100776+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-03-09T15:12:04.100776+0000","last_clean_scrub_stamp":"2024-03-09T15:12:04.100776+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:06:28.140547+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":96,"num_write":259,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'449","reported_seq":2113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.776766+0000","last_change":"2024-03-09T15:12:23.776804+0000","last_active":"2024-03-09T15:12:23.776766+0000","last_peered":"2024-03-09T15:12:23.776766+0000","last_clean":"2024-03-09T15:12:23.776766+0000","last_became_active":"2024-03-09T14:26:28.644951+0000","last_became_peered":"2024-03-09T14:26:28.644951+0000","last_unstale":"2024-03-09T15:12:23.776766+0000","last_undegraded":"2024-03-09T15:12:23.776766+0000","last_fullsized":"2024-03-09T15:12:23.776766+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'449","last_scrub_stamp":"2024-03-09T15:12:23.776676+0000","last_deep_scrub":"264'449","last_deep_scrub_stamp":"2024-03-09T15:12:23.776676+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.776676+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:56.169806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2607,"num_read_kb":2478,"num_write":564,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'189","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:33.751085+0000","last_change":"2024-03-09T15:12:33.751117+0000","last_active":"2024-03-09T15:12:33.751085+0000","last_peered":"2024-03-09T15:12:33.751085+0000","last_clean":"2024-03-09T15:12:33.751085+0000","last_became_active":"2024-03-09T14:26:26.652260+0000","last_became_peered":"2024-03-09T14:26:26.652260+0000","last_unstale":"2024-03-09T15:12:33.751085+0000","last_undegraded":"2024-03-09T15:12:33.751085+0000","last_fullsized":"2024-03-09T15:12:33.751085+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-03-09T15:12:33.750984+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-03-09T15:12:33.750984+0000","last_clean_scrub_stamp":"2024-03-09T15:12:33.750984+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:23:12.319639+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":396,"num_read_kb":5479,"num_write":1053,"num_write_kb":16075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:26.049054+0000","last_change":"2024-03-09T15:12:26.049083+0000","last_active":"2024-03-09T15:12:26.049054+0000","last_peered":"2024-03-09T15:12:26.049054+0000","last_clean":"2024-03-09T15:12:26.049054+0000","last_became_active":"2024-03-09T14:26:30.649790+0000","last_became_peered":"2024-03-09T14:26:30.649790+0000","last_unstale":"2024-03-09T15:12:26.049054+0000","last_undegraded":"2024-03-09T15:12:26.049054+0000","last_fullsized":"2024-03-09T15:12:26.049054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:26.048953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:26.048953+0000","last_clean_scrub_stamp":"2024-03-09T15:12:26.048953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:00.968101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'59","reported_seq":574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:41.414399+0000","last_change":"2024-03-09T15:12:41.414433+0000","last_active":"2024-03-09T15:12:41.414399+0000","last_peered":"2024-03-09T15:12:41.414399+0000","last_clean":"2024-03-09T15:12:41.414399+0000","last_became_active":"2024-03-09T14:26:32.655269+0000","last_became_peered":"2024-03-09T14:26:32.655269+0000","last_unstale":"2024-03-09T15:12:41.414399+0000","last_undegraded":"2024-03-09T15:12:41.414399+0000","last_fullsized":"2024-03-09T15:12:41.414399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'59","last_scrub_stamp":"2024-03-09T15:12:41.414289+0000","last_deep_scrub":"264'59","last_deep_scrub_stamp":"2024-03-09T15:12:41.414289+0000","last_clean_scrub_stamp":"2024-03-09T15:12:41.414289+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:57:07.833154+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.935078+0000","last_change":"2024-03-09T15:12:14.935102+0000","last_active":"2024-03-09T15:12:14.935078+0000","last_peered":"2024-03-09T15:12:14.935078+0000","last_clean":"2024-03-09T15:12:14.935078+0000","last_became_active":"2024-03-09T14:26:34.671065+0000","last_became_peered":"2024-03-09T14:26:34.671065+0000","last_unstale":"2024-03-09T15:12:14.935078+0000","last_undegraded":"2024-03-09T15:12:14.935078+0000","last_fullsized":"2024-03-09T15:12:14.935078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:14.934991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:14.934991+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.934991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:13:26.265646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'189","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.464645+0000","last_change":"2024-03-09T15:12:06.464674+0000","last_active":"2024-03-09T15:12:06.464645+0000","last_peered":"2024-03-09T15:12:06.464645+0000","last_clean":"2024-03-09T15:12:06.464645+0000","last_became_active":"2024-03-09T14:26:36.666762+0000","last_became_peered":"2024-03-09T14:26:36.666762+0000","last_unstale":"2024-03-09T15:12:06.464645+0000","last_undegraded":"2024-03-09T15:12:06.464645+0000","last_fullsized":"2024-03-09T15:12:06.464645+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-03-09T15:12:06.464544+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-03-09T15:12:06.464544+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.464544+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:57:59.260932+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":266,"num_read_kb":261,"num_write":413,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'441","reported_seq":2112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.107028+0000","last_change":"2024-03-09T15:12:21.107066+0000","last_active":"2024-03-09T15:12:21.107028+0000","last_peered":"2024-03-09T15:12:21.107028+0000","last_clean":"2024-03-09T15:12:21.107028+0000","last_became_active":"2024-03-09T14:26:28.657024+0000","last_became_peered":"2024-03-09T14:26:28.657024+0000","last_unstale":"2024-03-09T15:12:21.107028+0000","last_undegraded":"2024-03-09T15:12:21.107028+0000","last_fullsized":"2024-03-09T15:12:21.107028+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'441","last_scrub_stamp":"2024-03-09T15:12:21.106920+0000","last_deep_scrub":"264'441","last_deep_scrub_stamp":"2024-03-09T15:12:21.106920+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.106920+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:23:18.679220+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2592,"num_read_kb":2450,"num_write":527,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2520,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'200","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:31.379404+0000","last_change":"2024-03-09T15:12:31.379513+0000","last_active":"2024-03-09T15:12:31.379404+0000","last_peered":"2024-03-09T15:12:31.379404+0000","last_clean":"2024-03-09T15:12:31.379404+0000","last_became_active":"2024-03-09T14:26:26.646506+0000","last_became_peered":"2024-03-09T14:26:26.646506+0000","last_unstale":"2024-03-09T15:12:31.379404+0000","last_undegraded":"2024-03-09T15:12:31.379404+0000","last_fullsized":"2024-03-09T15:12:31.379404+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-03-09T15:12:31.379291+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-03-09T15:12:31.379291+0000","last_clean_scrub_stamp":"2024-03-09T15:12:31.379291+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:56:30.675688+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680231,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":50376,"num_write":989,"num_write_kb":56973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:24.741360+0000","last_change":"2024-03-09T15:12:24.741412+0000","last_active":"2024-03-09T15:12:24.741360+0000","last_peered":"2024-03-09T15:12:24.741360+0000","last_clean":"2024-03-09T15:12:24.741360+0000","last_became_active":"2024-03-09T14:26:30.652245+0000","last_became_peered":"2024-03-09T14:26:30.652245+0000","last_unstale":"2024-03-09T15:12:24.741360+0000","last_undegraded":"2024-03-09T15:12:24.741360+0000","last_fullsized":"2024-03-09T15:12:24.741360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:24.741248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:24.741248+0000","last_clean_scrub_stamp":"2024-03-09T15:12:24.741248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:07:18.855673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'172","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:44.031922+0000","last_change":"2024-03-09T15:12:44.031966+0000","last_active":"2024-03-09T15:12:44.031922+0000","last_peered":"2024-03-09T15:12:44.031922+0000","last_clean":"2024-03-09T15:12:44.031922+0000","last_became_active":"2024-03-09T14:26:32.652610+0000","last_became_peered":"2024-03-09T14:26:32.652610+0000","last_unstale":"2024-03-09T15:12:44.031922+0000","last_undegraded":"2024-03-09T15:12:44.031922+0000","last_fullsized":"2024-03-09T15:12:44.031922+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'172","last_scrub_stamp":"2024-03-09T15:12:44.031837+0000","last_deep_scrub":"264'172","last_deep_scrub_stamp":"2024-03-09T15:12:44.031837+0000","last_clean_scrub_stamp":"2024-03-09T15:12:44.031837+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:59:44.115732+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11381,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":311,"num_write":122,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.237273+0000","last_change":"2024-03-09T15:12:00.237310+0000","last_active":"2024-03-09T15:12:00.237273+0000","last_peered":"2024-03-09T15:12:00.237273+0000","last_clean":"2024-03-09T15:12:00.237273+0000","last_became_active":"2024-03-09T14:26:34.667373+0000","last_became_peered":"2024-03-09T14:26:34.667373+0000","last_unstale":"2024-03-09T15:12:00.237273+0000","last_undegraded":"2024-03-09T15:12:00.237273+0000","last_fullsized":"2024-03-09T15:12:00.237273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:00.237122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:00.237122+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.237122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:48:22.922919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'135","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.293978+0000","last_change":"2024-03-09T15:11:56.294011+0000","last_active":"2024-03-09T15:11:56.293978+0000","last_peered":"2024-03-09T15:11:56.293978+0000","last_clean":"2024-03-09T15:11:56.293978+0000","last_became_active":"2024-03-09T14:26:36.678306+0000","last_became_peered":"2024-03-09T14:26:36.678306+0000","last_unstale":"2024-03-09T15:11:56.293978+0000","last_undegraded":"2024-03-09T15:11:56.293978+0000","last_fullsized":"2024-03-09T15:11:56.293978+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'135","last_scrub_stamp":"2024-03-09T15:11:56.293887+0000","last_deep_scrub":"264'135","last_deep_scrub_stamp":"2024-03-09T15:11:56.293887+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.293887+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:56.519336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":110,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'434","reported_seq":2107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:29.108577+0000","last_change":"2024-03-09T15:12:29.108611+0000","last_active":"2024-03-09T15:12:29.108577+0000","last_peered":"2024-03-09T15:12:29.108577+0000","last_clean":"2024-03-09T15:12:29.108577+0000","last_became_active":"2024-03-09T14:26:28.651640+0000","last_became_peered":"2024-03-09T14:26:28.651640+0000","last_unstale":"2024-03-09T15:12:29.108577+0000","last_undegraded":"2024-03-09T15:12:29.108577+0000","last_fullsized":"2024-03-09T15:12:29.108577+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'434","last_scrub_stamp":"2024-03-09T15:12:29.108491+0000","last_deep_scrub":"264'434","last_deep_scrub_stamp":"2024-03-09T15:12:29.108491+0000","last_clean_scrub_stamp":"2024-03-09T15:12:29.108491+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:43:55.826599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2590,"num_read_kb":2461,"num_write":546,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'207","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:37.478896+0000","last_change":"2024-03-09T15:12:37.478941+0000","last_active":"2024-03-09T15:12:37.478896+0000","last_peered":"2024-03-09T15:12:37.478896+0000","last_clean":"2024-03-09T15:12:37.478896+0000","last_became_active":"2024-03-09T14:26:26.636087+0000","last_became_peered":"2024-03-09T14:26:26.636087+0000","last_unstale":"2024-03-09T15:12:37.478896+0000","last_undegraded":"2024-03-09T15:12:37.478896+0000","last_fullsized":"2024-03-09T15:12:37.478896+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-03-09T15:12:37.478805+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-03-09T15:12:37.478805+0000","last_clean_scrub_stamp":"2024-03-09T15:12:37.478805+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:18:38.800618+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":651,"num_read_kb":124750,"num_write":1247,"num_write_kb":18410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:59.229265+0000","last_change":"2024-03-09T15:11:59.229293+0000","last_active":"2024-03-09T15:11:59.229265+0000","last_peered":"2024-03-09T15:11:59.229265+0000","last_clean":"2024-03-09T15:11:59.229265+0000","last_became_active":"2024-03-09T14:26:30.652925+0000","last_became_peered":"2024-03-09T14:26:30.652925+0000","last_unstale":"2024-03-09T15:11:59.229265+0000","last_undegraded":"2024-03-09T15:11:59.229265+0000","last_fullsized":"2024-03-09T15:11:59.229265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:11:59.229150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:11:59.229150+0000","last_clean_scrub_stamp":"2024-03-09T15:11:59.229150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:26:08.349262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'134","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:26.812491+0000","last_change":"2024-03-09T15:12:26.812527+0000","last_active":"2024-03-09T15:12:26.812491+0000","last_peered":"2024-03-09T15:12:26.812491+0000","last_clean":"2024-03-09T15:12:26.812491+0000","last_became_active":"2024-03-09T14:26:32.657221+0000","last_became_peered":"2024-03-09T14:26:32.657221+0000","last_unstale":"2024-03-09T15:12:26.812491+0000","last_undegraded":"2024-03-09T15:12:26.812491+0000","last_fullsized":"2024-03-09T15:12:26.812491+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-03-09T15:12:26.812403+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-03-09T15:12:26.812403+0000","last_clean_scrub_stamp":"2024-03-09T15:12:26.812403+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:31:04.266204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24100,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":162,"num_read_kb":271,"num_write":84,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.481693+0000","last_change":"2024-03-09T15:12:12.481732+0000","last_active":"2024-03-09T15:12:12.481693+0000","last_peered":"2024-03-09T15:12:12.481693+0000","last_clean":"2024-03-09T15:12:12.481693+0000","last_became_active":"2024-03-09T14:26:34.670283+0000","last_became_peered":"2024-03-09T14:26:34.670283+0000","last_unstale":"2024-03-09T15:12:12.481693+0000","last_undegraded":"2024-03-09T15:12:12.481693+0000","last_fullsized":"2024-03-09T15:12:12.481693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:12.481537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:12.481537+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.481537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:51:29.132549+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'871","reported_seq":2456,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.263071+0000","last_change":"2024-03-09T15:12:07.263071+0000","last_active":"2024-03-09T15:12:07.263071+0000","last_peered":"2024-03-09T15:12:07.263071+0000","last_clean":"2024-03-09T15:12:07.263071+0000","last_became_active":"2024-03-09T14:26:28.651921+0000","last_became_peered":"2024-03-09T14:26:28.651921+0000","last_unstale":"2024-03-09T15:12:07.263071+0000","last_undegraded":"2024-03-09T15:12:07.263071+0000","last_fullsized":"2024-03-09T15:12:07.263071+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'871","last_scrub_stamp":"2024-03-09T15:12:07.262941+0000","last_deep_scrub":"264'871","last_deep_scrub_stamp":"2024-03-09T15:12:07.262941+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.262941+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:58:27.987184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3929,"num_read_kb":3481,"num_write":1218,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'260","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:53.768224+0000","last_change":"2024-03-09T15:11:53.768349+0000","last_active":"2024-03-09T15:11:53.768224+0000","last_peered":"2024-03-09T15:11:53.768224+0000","last_clean":"2024-03-09T15:11:53.768224+0000","last_became_active":"2024-03-09T14:27:03.716852+0000","last_became_peered":"2024-03-09T14:27:03.716852+0000","last_unstale":"2024-03-09T15:11:53.768224+0000","last_undegraded":"2024-03-09T15:11:53.768224+0000","last_fullsized":"2024-03-09T15:11:53.768224+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'260","last_scrub_stamp":"2024-03-09T15:11:53.768142+0000","last_deep_scrub":"264'260","last_deep_scrub_stamp":"2024-03-09T15:11:53.768142+0000","last_clean_scrub_stamp":"2024-03-09T15:11:53.768142+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:03:13.404383+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524411,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":890,"num_read_kb":7728,"num_write":1384,"num_write_kb":17237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"264'4","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.497891+0000","last_change":"2024-03-09T15:12:23.497891+0000","last_active":"2024-03-09T15:12:23.497891+0000","last_peered":"2024-03-09T15:12:23.497891+0000","last_clean":"2024-03-09T15:12:23.497891+0000","last_became_active":"2024-03-09T14:26:30.651711+0000","last_became_peered":"2024-03-09T14:26:30.651711+0000","last_unstale":"2024-03-09T15:12:23.497891+0000","last_undegraded":"2024-03-09T15:12:23.497891+0000","last_fullsized":"2024-03-09T15:12:23.497891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:12:23.497732+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:12:23.497732+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.497732+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:26:31.046818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":482,"num_read_kb":480,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'211","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.932212+0000","last_change":"2024-03-09T15:12:07.932255+0000","last_active":"2024-03-09T15:12:07.932212+0000","last_peered":"2024-03-09T15:12:07.932212+0000","last_clean":"2024-03-09T15:12:07.932212+0000","last_became_active":"2024-03-09T14:26:32.655391+0000","last_became_peered":"2024-03-09T14:26:32.655391+0000","last_unstale":"2024-03-09T15:12:07.932212+0000","last_undegraded":"2024-03-09T15:12:07.932212+0000","last_fullsized":"2024-03-09T15:12:07.932212+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'211","last_scrub_stamp":"2024-03-09T15:12:07.932126+0000","last_deep_scrub":"264'211","last_deep_scrub_stamp":"2024-03-09T15:12:07.932126+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.932126+0000","objects_scrubbed":6,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:14:49.656627+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39743,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":317,"num_read_kb":534,"num_write":200,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22450,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.333298+0000","last_change":"2024-03-09T15:12:01.333337+0000","last_active":"2024-03-09T15:12:01.333298+0000","last_peered":"2024-03-09T15:12:01.333298+0000","last_clean":"2024-03-09T15:12:01.333298+0000","last_became_active":"2024-03-09T14:26:34.675248+0000","last_became_peered":"2024-03-09T14:26:34.675248+0000","last_unstale":"2024-03-09T15:12:01.333298+0000","last_undegraded":"2024-03-09T15:12:01.333298+0000","last_fullsized":"2024-03-09T15:12:01.333298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:01.333180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:01.333180+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.333180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:15.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'188","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.120569+0000","last_change":"2024-03-09T15:12:01.120602+0000","last_active":"2024-03-09T15:12:01.120569+0000","last_peered":"2024-03-09T15:12:01.120569+0000","last_clean":"2024-03-09T15:12:01.120569+0000","last_became_active":"2024-03-09T14:26:36.786403+0000","last_became_peered":"2024-03-09T14:26:36.786403+0000","last_unstale":"2024-03-09T15:12:01.120569+0000","last_undegraded":"2024-03-09T15:12:01.120569+0000","last_fullsized":"2024-03-09T15:12:01.120569+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'188","last_scrub_stamp":"2024-03-09T15:12:01.120487+0000","last_deep_scrub":"264'188","last_deep_scrub_stamp":"2024-03-09T15:12:01.120487+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.120487+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:57:04.326385+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1042,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":213,"num_write":429,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'375","reported_seq":1895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:32.523720+0000","last_change":"2024-03-09T15:12:32.523720+0000","last_active":"2024-03-09T15:12:32.523720+0000","last_peered":"2024-03-09T15:12:32.523720+0000","last_clean":"2024-03-09T15:12:32.523720+0000","last_became_active":"2024-03-09T14:26:28.642452+0000","last_became_peered":"2024-03-09T14:26:28.642452+0000","last_unstale":"2024-03-09T15:12:32.523720+0000","last_undegraded":"2024-03-09T15:12:32.523720+0000","last_fullsized":"2024-03-09T15:12:32.523720+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-03-09T15:12:32.523581+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-03-09T15:12:32.523581+0000","last_clean_scrub_stamp":"2024-03-09T15:12:32.523581+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:14:18.763607+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2046,"num_read_kb":1963,"num_write":419,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":556,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'183","reported_seq":810,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:55.086406+0000","last_change":"2024-03-09T15:11:55.086406+0000","last_active":"2024-03-09T15:11:55.086406+0000","last_peered":"2024-03-09T15:11:55.086406+0000","last_clean":"2024-03-09T15:11:55.086406+0000","last_became_active":"2024-03-09T14:27:03.724521+0000","last_became_peered":"2024-03-09T14:27:03.724521+0000","last_unstale":"2024-03-09T15:11:55.086406+0000","last_undegraded":"2024-03-09T15:11:55.086406+0000","last_fullsized":"2024-03-09T15:11:55.086406+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'183","last_scrub_stamp":"2024-03-09T15:11:55.086218+0000","last_deep_scrub":"264'183","last_deep_scrub_stamp":"2024-03-09T15:11:55.086218+0000","last_clean_scrub_stamp":"2024-03-09T15:11:55.086218+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:33:58.839877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1070276,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":327,"num_read_kb":39345,"num_write":965,"num_write_kb":40541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.210053+0000","last_change":"2024-03-09T15:12:01.210053+0000","last_active":"2024-03-09T15:12:01.210053+0000","last_peered":"2024-03-09T15:12:01.210053+0000","last_clean":"2024-03-09T15:12:01.210053+0000","last_became_active":"2024-03-09T14:26:30.652243+0000","last_became_peered":"2024-03-09T14:26:30.652243+0000","last_unstale":"2024-03-09T15:12:01.210053+0000","last_undegraded":"2024-03-09T15:12:01.210053+0000","last_fullsized":"2024-03-09T15:12:01.210053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:01.209942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:01.209942+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.209942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:41:59.901072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'161","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:30.732670+0000","last_change":"2024-03-09T15:12:30.732717+0000","last_active":"2024-03-09T15:12:30.732670+0000","last_peered":"2024-03-09T15:12:30.732670+0000","last_clean":"2024-03-09T15:12:30.732670+0000","last_became_active":"2024-03-09T14:26:32.658626+0000","last_became_peered":"2024-03-09T14:26:32.658626+0000","last_unstale":"2024-03-09T15:12:30.732670+0000","last_undegraded":"2024-03-09T15:12:30.732670+0000","last_fullsized":"2024-03-09T15:12:30.732670+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'161","last_scrub_stamp":"2024-03-09T15:12:30.732584+0000","last_deep_scrub":"264'161","last_deep_scrub_stamp":"2024-03-09T15:12:30.732584+0000","last_clean_scrub_stamp":"2024-03-09T15:12:30.732584+0000","objects_scrubbed":8,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:40.767961+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13483,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":225,"num_read_kb":299,"num_write":146,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.815818+0000","last_change":"2024-03-09T15:12:13.815853+0000","last_active":"2024-03-09T15:12:13.815818+0000","last_peered":"2024-03-09T15:12:13.815818+0000","last_clean":"2024-03-09T15:12:13.815818+0000","last_became_active":"2024-03-09T14:26:34.669482+0000","last_became_peered":"2024-03-09T14:26:34.669482+0000","last_unstale":"2024-03-09T15:12:13.815818+0000","last_undegraded":"2024-03-09T15:12:13.815818+0000","last_fullsized":"2024-03-09T15:12:13.815818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:13.815678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:13.815678+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.815678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:22:00.615697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'226","reported_seq":1418,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.347668+0000","last_change":"2024-03-09T15:12:22.347714+0000","last_active":"2024-03-09T15:12:22.347668+0000","last_peered":"2024-03-09T15:12:22.347668+0000","last_clean":"2024-03-09T15:12:22.347668+0000","last_became_active":"2024-03-09T14:26:36.678232+0000","last_became_peered":"2024-03-09T14:26:36.678232+0000","last_unstale":"2024-03-09T15:12:22.347668+0000","last_undegraded":"2024-03-09T15:12:22.347668+0000","last_fullsized":"2024-03-09T15:12:22.347668+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'226","last_scrub_stamp":"2024-03-09T15:12:22.347577+0000","last_deep_scrub":"264'226","last_deep_scrub_stamp":"2024-03-09T15:12:22.347577+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.347577+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:55:38.476236+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":941,"num_read_kb":939,"num_write":605,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'431","reported_seq":1936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.060010+0000","last_change":"2024-03-09T15:12:22.060038+0000","last_active":"2024-03-09T15:12:22.060010+0000","last_peered":"2024-03-09T15:12:22.060010+0000","last_clean":"2024-03-09T15:12:22.060010+0000","last_became_active":"2024-03-09T14:26:28.657488+0000","last_became_peered":"2024-03-09T14:26:28.657488+0000","last_unstale":"2024-03-09T15:12:22.060010+0000","last_undegraded":"2024-03-09T15:12:22.060010+0000","last_fullsized":"2024-03-09T15:12:22.060010+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'431","last_scrub_stamp":"2024-03-09T15:12:22.059927+0000","last_deep_scrub":"264'431","last_deep_scrub_stamp":"2024-03-09T15:12:22.059927+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.059927+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:19:43.405036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2287,"num_read_kb":2137,"num_write":511,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'198","reported_seq":813,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:24.873320+0000","last_change":"2024-03-09T15:12:24.873363+0000","last_active":"2024-03-09T15:12:24.873320+0000","last_peered":"2024-03-09T15:12:24.873320+0000","last_clean":"2024-03-09T15:12:24.873320+0000","last_became_active":"2024-03-09T14:26:26.641003+0000","last_became_peered":"2024-03-09T14:26:26.641003+0000","last_unstale":"2024-03-09T15:12:24.873320+0000","last_undegraded":"2024-03-09T15:12:24.873320+0000","last_fullsized":"2024-03-09T15:12:24.873320+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'198","last_scrub_stamp":"2024-03-09T15:12:24.873229+0000","last_deep_scrub":"264'198","last_deep_scrub_stamp":"2024-03-09T15:12:24.873229+0000","last_clean_scrub_stamp":"2024-03-09T15:12:24.873229+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:28:18.495512+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":32756,"num_write":1157,"num_write_kb":45988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.970264+0000","last_change":"2024-03-09T15:12:21.970296+0000","last_active":"2024-03-09T15:12:21.970264+0000","last_peered":"2024-03-09T15:12:21.970264+0000","last_clean":"2024-03-09T15:12:21.970264+0000","last_became_active":"2024-03-09T14:26:30.653249+0000","last_became_peered":"2024-03-09T14:26:30.653249+0000","last_unstale":"2024-03-09T15:12:21.970264+0000","last_undegraded":"2024-03-09T15:12:21.970264+0000","last_fullsized":"2024-03-09T15:12:21.970264+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:21.970156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:21.970156+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.970156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:39:54.152238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'132","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.127920+0000","last_change":"2024-03-09T15:12:15.127920+0000","last_active":"2024-03-09T15:12:15.127920+0000","last_peered":"2024-03-09T15:12:15.127920+0000","last_clean":"2024-03-09T15:12:15.127920+0000","last_became_active":"2024-03-09T14:26:32.868236+0000","last_became_peered":"2024-03-09T14:26:32.868236+0000","last_unstale":"2024-03-09T15:12:15.127920+0000","last_undegraded":"2024-03-09T15:12:15.127920+0000","last_fullsized":"2024-03-09T15:12:15.127920+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'132","last_scrub_stamp":"2024-03-09T15:12:15.127769+0000","last_deep_scrub":"264'132","last_deep_scrub_stamp":"2024-03-09T15:12:15.127769+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.127769+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:18:46.490112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7847,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":246,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:15.795042+0000","last_change":"2024-03-09T15:12:15.795042+0000","last_active":"2024-03-09T15:12:15.795042+0000","last_peered":"2024-03-09T15:12:15.795042+0000","last_clean":"2024-03-09T15:12:15.795042+0000","last_became_active":"2024-03-09T14:26:34.675120+0000","last_became_peered":"2024-03-09T14:26:34.675120+0000","last_unstale":"2024-03-09T15:12:15.795042+0000","last_undegraded":"2024-03-09T15:12:15.795042+0000","last_fullsized":"2024-03-09T15:12:15.795042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:15.794923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:15.794923+0000","last_clean_scrub_stamp":"2024-03-09T15:12:15.794923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:03:59.218151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'107","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:54.317205+0000","last_change":"2024-03-09T15:11:54.317247+0000","last_active":"2024-03-09T15:11:54.317205+0000","last_peered":"2024-03-09T15:11:54.317205+0000","last_clean":"2024-03-09T15:11:54.317205+0000","last_became_active":"2024-03-09T14:26:36.678521+0000","last_became_peered":"2024-03-09T14:26:36.678521+0000","last_unstale":"2024-03-09T15:11:54.317205+0000","last_undegraded":"2024-03-09T15:11:54.317205+0000","last_fullsized":"2024-03-09T15:11:54.317205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-03-09T15:11:54.317104+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-03-09T15:11:54.317104+0000","last_clean_scrub_stamp":"2024-03-09T15:11:54.317104+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:54:32.730793+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":103,"num_write":248,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'328","reported_seq":1752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.987370+0000","last_change":"2024-03-09T15:12:12.987395+0000","last_active":"2024-03-09T15:12:12.987370+0000","last_peered":"2024-03-09T15:12:12.987370+0000","last_clean":"2024-03-09T15:12:12.987370+0000","last_became_active":"2024-03-09T14:26:28.648204+0000","last_became_peered":"2024-03-09T14:26:28.648204+0000","last_unstale":"2024-03-09T15:12:12.987370+0000","last_undegraded":"2024-03-09T15:12:12.987370+0000","last_fullsized":"2024-03-09T15:12:12.987370+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'328","last_scrub_stamp":"2024-03-09T15:12:12.987287+0000","last_deep_scrub":"264'328","last_deep_scrub_stamp":"2024-03-09T15:12:12.987287+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.987287+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:29:10.004907+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1841,"num_read_kb":1771,"num_write":371,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'202","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.395271+0000","last_change":"2024-03-09T15:11:58.395346+0000","last_active":"2024-03-09T15:11:58.395271+0000","last_peered":"2024-03-09T15:11:58.395271+0000","last_clean":"2024-03-09T15:11:58.395271+0000","last_became_active":"2024-03-09T14:27:03.719292+0000","last_became_peered":"2024-03-09T14:27:03.719292+0000","last_unstale":"2024-03-09T15:11:58.395271+0000","last_undegraded":"2024-03-09T15:11:58.395271+0000","last_fullsized":"2024-03-09T15:11:58.395271+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'202","last_scrub_stamp":"2024-03-09T15:11:58.395179+0000","last_deep_scrub":"264'202","last_deep_scrub_stamp":"2024-03-09T15:11:58.395179+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.395179+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:08.784732+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778707,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":941,"num_read_kb":86830,"num_write":1019,"num_write_kb":33052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.975665+0000","last_change":"2024-03-09T15:12:01.975725+0000","last_active":"2024-03-09T15:12:01.975665+0000","last_peered":"2024-03-09T15:12:01.975665+0000","last_clean":"2024-03-09T15:12:01.975665+0000","last_became_active":"2024-03-09T14:26:30.652190+0000","last_became_peered":"2024-03-09T14:26:30.652190+0000","last_unstale":"2024-03-09T15:12:01.975665+0000","last_undegraded":"2024-03-09T15:12:01.975665+0000","last_fullsized":"2024-03-09T15:12:01.975665+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:01.975568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:01.975568+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.975568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:24.946938+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'89","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:03.145341+0000","last_change":"2024-03-09T15:12:03.145341+0000","last_active":"2024-03-09T15:12:03.145341+0000","last_peered":"2024-03-09T15:12:03.145341+0000","last_clean":"2024-03-09T15:12:03.145341+0000","last_became_active":"2024-03-09T14:26:32.867985+0000","last_became_peered":"2024-03-09T14:26:32.867985+0000","last_unstale":"2024-03-09T15:12:03.145341+0000","last_undegraded":"2024-03-09T15:12:03.145341+0000","last_fullsized":"2024-03-09T15:12:03.145341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'89","last_scrub_stamp":"2024-03-09T15:12:03.145219+0000","last_deep_scrub":"264'89","last_deep_scrub_stamp":"2024-03-09T15:12:03.145219+0000","last_clean_scrub_stamp":"2024-03-09T15:12:03.145219+0000","objects_scrubbed":7,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:52:51.643446+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":100,"num_read_kb":95,"num_write":100,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11222,"num_omap_keys":30,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'535","reported_seq":2055,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:58.242069+0000","last_change":"2024-03-09T15:11:58.242069+0000","last_active":"2024-03-09T15:11:58.242069+0000","last_peered":"2024-03-09T15:11:58.242069+0000","last_clean":"2024-03-09T15:11:58.242069+0000","last_became_active":"2024-03-09T14:26:34.664708+0000","last_became_peered":"2024-03-09T14:26:34.664708+0000","last_unstale":"2024-03-09T15:11:58.242069+0000","last_undegraded":"2024-03-09T15:11:58.242069+0000","last_fullsized":"2024-03-09T15:11:58.242069+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'535","last_scrub_stamp":"2024-03-09T15:11:58.241917+0000","last_deep_scrub":"264'535","last_deep_scrub_stamp":"2024-03-09T15:11:58.241917+0000","last_clean_scrub_stamp":"2024-03-09T15:11:58.241917+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:14.531917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'142","reported_seq":663,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.978957+0000","last_change":"2024-03-09T15:12:10.978984+0000","last_active":"2024-03-09T15:12:10.978957+0000","last_peered":"2024-03-09T15:12:10.978957+0000","last_clean":"2024-03-09T15:12:10.978957+0000","last_became_active":"2024-03-09T14:26:36.675855+0000","last_became_peered":"2024-03-09T14:26:36.675855+0000","last_unstale":"2024-03-09T15:12:10.978957+0000","last_undegraded":"2024-03-09T15:12:10.978957+0000","last_fullsized":"2024-03-09T15:12:10.978957+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-03-09T15:12:10.978858+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-03-09T15:12:10.978858+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.978858+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:12.611273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":194,"num_write":349,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'799","reported_seq":2340,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:12.129181+0000","last_change":"2024-03-09T15:12:12.129238+0000","last_active":"2024-03-09T15:12:12.129181+0000","last_peered":"2024-03-09T15:12:12.129181+0000","last_clean":"2024-03-09T15:12:12.129181+0000","last_became_active":"2024-03-09T14:26:28.656940+0000","last_became_peered":"2024-03-09T14:26:28.656940+0000","last_unstale":"2024-03-09T15:12:12.129181+0000","last_undegraded":"2024-03-09T15:12:12.129181+0000","last_fullsized":"2024-03-09T15:12:12.129181+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'799","last_scrub_stamp":"2024-03-09T15:12:12.129068+0000","last_deep_scrub":"264'799","last_deep_scrub_stamp":"2024-03-09T15:12:12.129068+0000","last_clean_scrub_stamp":"2024-03-09T15:12:12.129068+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:38:23.851932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3613,"num_read_kb":3222,"num_write":1070,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":218,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'213","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:29.376199+0000","last_change":"2024-03-09T15:12:29.376316+0000","last_active":"2024-03-09T15:12:29.376199+0000","last_peered":"2024-03-09T15:12:29.376199+0000","last_clean":"2024-03-09T15:12:29.376199+0000","last_became_active":"2024-03-09T14:26:26.641031+0000","last_became_peered":"2024-03-09T14:26:26.641031+0000","last_unstale":"2024-03-09T15:12:29.376199+0000","last_undegraded":"2024-03-09T15:12:29.376199+0000","last_fullsized":"2024-03-09T15:12:29.376199+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-03-09T15:12:29.376063+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-03-09T15:12:29.376063+0000","last_clean_scrub_stamp":"2024-03-09T15:12:29.376063+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:12:28.930956+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651867,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":2692,"num_write":1154,"num_write_kb":40768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:22.757810+0000","last_change":"2024-03-09T15:12:22.757831+0000","last_active":"2024-03-09T15:12:22.757810+0000","last_peered":"2024-03-09T15:12:22.757810+0000","last_clean":"2024-03-09T15:12:22.757810+0000","last_became_active":"2024-03-09T14:26:30.652315+0000","last_became_peered":"2024-03-09T14:26:30.652315+0000","last_unstale":"2024-03-09T15:12:22.757810+0000","last_undegraded":"2024-03-09T15:12:22.757810+0000","last_fullsized":"2024-03-09T15:12:22.757810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:22.757722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:22.757722+0000","last_clean_scrub_stamp":"2024-03-09T15:12:22.757722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:15:37.062804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'177","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.479448+0000","last_change":"2024-03-09T15:12:08.479448+0000","last_active":"2024-03-09T15:12:08.479448+0000","last_peered":"2024-03-09T15:12:08.479448+0000","last_clean":"2024-03-09T15:12:08.479448+0000","last_became_active":"2024-03-09T14:26:32.656973+0000","last_became_peered":"2024-03-09T14:26:32.656973+0000","last_unstale":"2024-03-09T15:12:08.479448+0000","last_undegraded":"2024-03-09T15:12:08.479448+0000","last_fullsized":"2024-03-09T15:12:08.479448+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-03-09T15:12:08.479303+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-03-09T15:12:08.479303+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.479303+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:14.649439+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9391,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":206,"num_read_kb":261,"num_write":118,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.577119+0000","last_change":"2024-03-09T15:12:16.577119+0000","last_active":"2024-03-09T15:12:16.577119+0000","last_peered":"2024-03-09T15:12:16.577119+0000","last_clean":"2024-03-09T15:12:16.577119+0000","last_became_active":"2024-03-09T14:26:34.665208+0000","last_became_peered":"2024-03-09T14:26:34.665208+0000","last_unstale":"2024-03-09T15:12:16.577119+0000","last_undegraded":"2024-03-09T15:12:16.577119+0000","last_fullsized":"2024-03-09T15:12:16.577119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:16.576996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:16.576996+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.576996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:23.226310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'130","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.015061+0000","last_change":"2024-03-09T15:12:10.015061+0000","last_active":"2024-03-09T15:12:10.015061+0000","last_peered":"2024-03-09T15:12:10.015061+0000","last_clean":"2024-03-09T15:12:10.015061+0000","last_became_active":"2024-03-09T14:26:36.677867+0000","last_became_peered":"2024-03-09T14:26:36.677867+0000","last_unstale":"2024-03-09T15:12:10.015061+0000","last_undegraded":"2024-03-09T15:12:10.015061+0000","last_fullsized":"2024-03-09T15:12:10.015061+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-03-09T15:12:10.014948+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-03-09T15:12:10.014948+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.014948+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:41:45.538478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":311,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'826","reported_seq":2509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.082915+0000","last_change":"2024-03-09T15:12:10.082953+0000","last_active":"2024-03-09T15:12:10.082915+0000","last_peered":"2024-03-09T15:12:10.082915+0000","last_clean":"2024-03-09T15:12:10.082915+0000","last_became_active":"2024-03-09T14:26:28.656960+0000","last_became_peered":"2024-03-09T14:26:28.656960+0000","last_unstale":"2024-03-09T15:12:10.082915+0000","last_undegraded":"2024-03-09T15:12:10.082915+0000","last_fullsized":"2024-03-09T15:12:10.082915+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'826","last_scrub_stamp":"2024-03-09T15:12:10.082835+0000","last_deep_scrub":"264'826","last_deep_scrub_stamp":"2024-03-09T15:12:10.082835+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.082835+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:10:39.844814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4034,"num_read_kb":3617,"num_write":1125,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3995,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'217","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.379999+0000","last_change":"2024-03-09T15:12:18.380049+0000","last_active":"2024-03-09T15:12:18.379999+0000","last_peered":"2024-03-09T15:12:18.379999+0000","last_clean":"2024-03-09T15:12:18.379999+0000","last_became_active":"2024-03-09T14:26:26.649772+0000","last_became_peered":"2024-03-09T14:26:26.649772+0000","last_unstale":"2024-03-09T15:12:18.379999+0000","last_undegraded":"2024-03-09T15:12:18.379999+0000","last_fullsized":"2024-03-09T15:12:18.379999+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'217","last_scrub_stamp":"2024-03-09T15:12:18.379901+0000","last_deep_scrub":"264'217","last_deep_scrub_stamp":"2024-03-09T15:12:18.379901+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.379901+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:21:18.313370+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":404,"num_read_kb":32014,"num_write":1026,"num_write_kb":48046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:17.388029+0000","last_change":"2024-03-09T15:12:17.388054+0000","last_active":"2024-03-09T15:12:17.388029+0000","last_peered":"2024-03-09T15:12:17.388029+0000","last_clean":"2024-03-09T15:12:17.388029+0000","last_became_active":"2024-03-09T14:26:30.650674+0000","last_became_peered":"2024-03-09T14:26:30.650674+0000","last_unstale":"2024-03-09T15:12:17.388029+0000","last_undegraded":"2024-03-09T15:12:17.388029+0000","last_fullsized":"2024-03-09T15:12:17.388029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:17.387942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:17.387942+0000","last_clean_scrub_stamp":"2024-03-09T15:12:17.387942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:28.222149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'133","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:29.481281+0000","last_change":"2024-03-09T15:12:29.481281+0000","last_active":"2024-03-09T15:12:29.481281+0000","last_peered":"2024-03-09T15:12:29.481281+0000","last_clean":"2024-03-09T15:12:29.481281+0000","last_became_active":"2024-03-09T14:26:32.652397+0000","last_became_peered":"2024-03-09T14:26:32.652397+0000","last_unstale":"2024-03-09T15:12:29.481281+0000","last_undegraded":"2024-03-09T15:12:29.481281+0000","last_fullsized":"2024-03-09T15:12:29.481281+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'133","last_scrub_stamp":"2024-03-09T15:12:29.481162+0000","last_deep_scrub":"264'133","last_deep_scrub_stamp":"2024-03-09T15:12:29.481162+0000","last_clean_scrub_stamp":"2024-03-09T15:12:29.481162+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:01:10.674133+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14802,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":258,"num_write":88,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:06.230103+0000","last_change":"2024-03-09T15:12:06.230103+0000","last_active":"2024-03-09T15:12:06.230103+0000","last_peered":"2024-03-09T15:12:06.230103+0000","last_clean":"2024-03-09T15:12:06.230103+0000","last_became_active":"2024-03-09T14:26:34.671029+0000","last_became_peered":"2024-03-09T14:26:34.671029+0000","last_unstale":"2024-03-09T15:12:06.230103+0000","last_undegraded":"2024-03-09T15:12:06.230103+0000","last_fullsized":"2024-03-09T15:12:06.230103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:06.229979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:06.229979+0000","last_clean_scrub_stamp":"2024-03-09T15:12:06.229979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:24:48.116811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'114","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:00.126469+0000","last_change":"2024-03-09T15:12:00.126469+0000","last_active":"2024-03-09T15:12:00.126469+0000","last_peered":"2024-03-09T15:12:00.126469+0000","last_clean":"2024-03-09T15:12:00.126469+0000","last_became_active":"2024-03-09T14:26:36.786449+0000","last_became_peered":"2024-03-09T14:26:36.786449+0000","last_unstale":"2024-03-09T15:12:00.126469+0000","last_undegraded":"2024-03-09T15:12:00.126469+0000","last_fullsized":"2024-03-09T15:12:00.126469+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-03-09T15:12:00.126288+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-03-09T15:12:00.126288+0000","last_clean_scrub_stamp":"2024-03-09T15:12:00.126288+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:22.457832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":178,"num_write":287,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'521","reported_seq":2112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:33.009702+0000","last_change":"2024-03-09T15:12:33.009702+0000","last_active":"2024-03-09T15:12:33.009702+0000","last_peered":"2024-03-09T15:12:33.009702+0000","last_clean":"2024-03-09T15:12:33.009702+0000","last_became_active":"2024-03-09T14:26:28.647178+0000","last_became_peered":"2024-03-09T14:26:28.647178+0000","last_unstale":"2024-03-09T15:12:33.009702+0000","last_undegraded":"2024-03-09T15:12:33.009702+0000","last_fullsized":"2024-03-09T15:12:33.009702+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'521","last_scrub_stamp":"2024-03-09T15:12:33.009530+0000","last_deep_scrub":"264'521","last_deep_scrub_stamp":"2024-03-09T15:12:33.009530+0000","last_clean_scrub_stamp":"2024-03-09T15:12:33.009530+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:41:49.943723+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2831,"num_read_kb":2584,"num_write":686,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'273","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:39.979221+0000","last_change":"2024-03-09T15:12:39.979253+0000","last_active":"2024-03-09T15:12:39.979221+0000","last_peered":"2024-03-09T15:12:39.979221+0000","last_clean":"2024-03-09T15:12:39.979221+0000","last_became_active":"2024-03-09T14:26:26.643338+0000","last_became_peered":"2024-03-09T14:26:26.643338+0000","last_unstale":"2024-03-09T15:12:39.979221+0000","last_undegraded":"2024-03-09T15:12:39.979221+0000","last_fullsized":"2024-03-09T15:12:39.979221+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'273","last_scrub_stamp":"2024-03-09T15:12:39.979124+0000","last_deep_scrub":"264'273","last_deep_scrub_stamp":"2024-03-09T15:12:39.979124+0000","last_clean_scrub_stamp":"2024-03-09T15:12:39.979124+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:36:45.075234+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":43219,"num_write":1342,"num_write_kb":45633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.086304+0000","last_change":"2024-03-09T15:12:16.086304+0000","last_active":"2024-03-09T15:12:16.086304+0000","last_peered":"2024-03-09T15:12:16.086304+0000","last_clean":"2024-03-09T15:12:16.086304+0000","last_became_active":"2024-03-09T14:26:30.647466+0000","last_became_peered":"2024-03-09T14:26:30.647466+0000","last_unstale":"2024-03-09T15:12:16.086304+0000","last_undegraded":"2024-03-09T15:12:16.086304+0000","last_fullsized":"2024-03-09T15:12:16.086304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:16.086148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:16.086148+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.086148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:35.773363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'108","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.118774+0000","last_change":"2024-03-09T15:12:19.118806+0000","last_active":"2024-03-09T15:12:19.118774+0000","last_peered":"2024-03-09T15:12:19.118774+0000","last_clean":"2024-03-09T15:12:19.118774+0000","last_became_active":"2024-03-09T14:26:32.654096+0000","last_became_peered":"2024-03-09T14:26:32.654096+0000","last_unstale":"2024-03-09T15:12:19.118774+0000","last_undegraded":"2024-03-09T15:12:19.118774+0000","last_fullsized":"2024-03-09T15:12:19.118774+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'108","last_scrub_stamp":"2024-03-09T15:12:19.118689+0000","last_deep_scrub":"264'108","last_deep_scrub_stamp":"2024-03-09T15:12:19.118689+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.118689+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:16:59.329569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5925,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":181,"num_write":62,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:01.101718+0000","last_change":"2024-03-09T15:12:01.101744+0000","last_active":"2024-03-09T15:12:01.101718+0000","last_peered":"2024-03-09T15:12:01.101718+0000","last_clean":"2024-03-09T15:12:01.101718+0000","last_became_active":"2024-03-09T14:26:34.665478+0000","last_became_peered":"2024-03-09T14:26:34.665478+0000","last_unstale":"2024-03-09T15:12:01.101718+0000","last_undegraded":"2024-03-09T15:12:01.101718+0000","last_fullsized":"2024-03-09T15:12:01.101718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:01.101624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:01.101624+0000","last_clean_scrub_stamp":"2024-03-09T15:12:01.101624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:26.220172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'121","reported_seq":1788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.015757+0000","last_change":"2024-03-09T15:12:08.015757+0000","last_active":"2024-03-09T15:12:08.015757+0000","last_peered":"2024-03-09T15:12:08.015757+0000","last_clean":"2024-03-09T15:12:08.015757+0000","last_became_active":"2024-03-09T14:26:36.677953+0000","last_became_peered":"2024-03-09T14:26:36.677953+0000","last_unstale":"2024-03-09T15:12:08.015757+0000","last_undegraded":"2024-03-09T15:12:08.015757+0000","last_fullsized":"2024-03-09T15:12:08.015757+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-03-09T15:12:08.015633+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-03-09T15:12:08.015633+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.015633+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:02:55.565743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1291,"num_read_kb":1290,"num_write":257,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'555","reported_seq":2052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:28.927583+0000","last_change":"2024-03-09T15:12:28.927635+0000","last_active":"2024-03-09T15:12:28.927583+0000","last_peered":"2024-03-09T15:12:28.927583+0000","last_clean":"2024-03-09T15:12:28.927583+0000","last_became_active":"2024-03-09T14:26:28.644628+0000","last_became_peered":"2024-03-09T14:26:28.644628+0000","last_unstale":"2024-03-09T15:12:28.927583+0000","last_undegraded":"2024-03-09T15:12:28.927583+0000","last_fullsized":"2024-03-09T15:12:28.927583+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'555","last_scrub_stamp":"2024-03-09T15:12:28.927461+0000","last_deep_scrub":"264'555","last_deep_scrub_stamp":"2024-03-09T15:12:28.927461+0000","last_clean_scrub_stamp":"2024-03-09T15:12:28.927461+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:11.779163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2742,"num_read_kb":2524,"num_write":748,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'204","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:38.468315+0000","last_change":"2024-03-09T15:12:38.468382+0000","last_active":"2024-03-09T15:12:38.468315+0000","last_peered":"2024-03-09T15:12:38.468315+0000","last_clean":"2024-03-09T15:12:38.468315+0000","last_became_active":"2024-03-09T14:26:26.636600+0000","last_became_peered":"2024-03-09T14:26:26.636600+0000","last_unstale":"2024-03-09T15:12:38.468315+0000","last_undegraded":"2024-03-09T15:12:38.468315+0000","last_fullsized":"2024-03-09T15:12:38.468315+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'204","last_scrub_stamp":"2024-03-09T15:12:38.468177+0000","last_deep_scrub":"264'204","last_deep_scrub_stamp":"2024-03-09T15:12:38.468177+0000","last_clean_scrub_stamp":"2024-03-09T15:12:38.468177+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:07:27.414354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":15859,"num_write":1037,"num_write_kb":26682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:02.934542+0000","last_change":"2024-03-09T15:12:02.934542+0000","last_active":"2024-03-09T15:12:02.934542+0000","last_peered":"2024-03-09T15:12:02.934542+0000","last_clean":"2024-03-09T15:12:02.934542+0000","last_became_active":"2024-03-09T14:26:30.650852+0000","last_became_peered":"2024-03-09T14:26:30.650852+0000","last_unstale":"2024-03-09T15:12:02.934542+0000","last_undegraded":"2024-03-09T15:12:02.934542+0000","last_fullsized":"2024-03-09T15:12:02.934542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:12:02.934422+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:12:02.934422+0000","last_clean_scrub_stamp":"2024-03-09T15:12:02.934422+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:48.652578+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'155","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:07.026213+0000","last_change":"2024-03-09T15:12:07.026256+0000","last_active":"2024-03-09T15:12:07.026213+0000","last_peered":"2024-03-09T15:12:07.026213+0000","last_clean":"2024-03-09T15:12:07.026213+0000","last_became_active":"2024-03-09T14:26:32.655220+0000","last_became_peered":"2024-03-09T14:26:32.655220+0000","last_unstale":"2024-03-09T15:12:07.026213+0000","last_undegraded":"2024-03-09T15:12:07.026213+0000","last_fullsized":"2024-03-09T15:12:07.026213+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'155","last_scrub_stamp":"2024-03-09T15:12:07.026079+0000","last_deep_scrub":"264'155","last_deep_scrub_stamp":"2024-03-09T15:12:07.026079+0000","last_clean_scrub_stamp":"2024-03-09T15:12:07.026079+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:36:29.946374+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6421,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":225,"num_write":106,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.496780+0000","last_change":"2024-03-09T15:12:09.496803+0000","last_active":"2024-03-09T15:12:09.496780+0000","last_peered":"2024-03-09T15:12:09.496780+0000","last_clean":"2024-03-09T15:12:09.496780+0000","last_became_active":"2024-03-09T14:26:34.673572+0000","last_became_peered":"2024-03-09T14:26:34.673572+0000","last_unstale":"2024-03-09T15:12:09.496780+0000","last_undegraded":"2024-03-09T15:12:09.496780+0000","last_fullsized":"2024-03-09T15:12:09.496780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:12:09.496689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:12:09.496689+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.496689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:32:35.139394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'131","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:56.183377+0000","last_change":"2024-03-09T15:11:56.183425+0000","last_active":"2024-03-09T15:11:56.183377+0000","last_peered":"2024-03-09T15:11:56.183377+0000","last_clean":"2024-03-09T15:11:56.183377+0000","last_became_active":"2024-03-09T14:26:36.668616+0000","last_became_peered":"2024-03-09T14:26:36.668616+0000","last_unstale":"2024-03-09T15:11:56.183377+0000","last_undegraded":"2024-03-09T15:11:56.183377+0000","last_fullsized":"2024-03-09T15:11:56.183377+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-03-09T15:11:56.183293+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-03-09T15:11:56.183293+0000","last_clean_scrub_stamp":"2024-03-09T15:11:56.183293+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:50:57.423599+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":154,"num_write":316,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'647","reported_seq":2244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:24.751258+0000","last_change":"2024-03-09T15:12:24.751312+0000","last_active":"2024-03-09T15:12:24.751258+0000","last_peered":"2024-03-09T15:12:24.751258+0000","last_clean":"2024-03-09T15:12:24.751258+0000","last_became_active":"2024-03-09T14:26:28.645626+0000","last_became_peered":"2024-03-09T14:26:28.645626+0000","last_unstale":"2024-03-09T15:12:24.751258+0000","last_undegraded":"2024-03-09T15:12:24.751258+0000","last_fullsized":"2024-03-09T15:12:24.751258+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'647","last_scrub_stamp":"2024-03-09T15:12:24.751141+0000","last_deep_scrub":"264'647","last_deep_scrub_stamp":"2024-03-09T15:12:24.751141+0000","last_clean_scrub_stamp":"2024-03-09T15:12:24.751141+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":600,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:04.226375+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3206,"num_read_kb":2874,"num_write":967,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'167","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.331036+0000","last_change":"2024-03-09T15:12:21.331157+0000","last_active":"2024-03-09T15:12:21.331036+0000","last_peered":"2024-03-09T15:12:21.331036+0000","last_clean":"2024-03-09T15:12:21.331036+0000","last_became_active":"2024-03-09T14:26:26.652050+0000","last_became_peered":"2024-03-09T14:26:26.652050+0000","last_unstale":"2024-03-09T15:12:21.331036+0000","last_undegraded":"2024-03-09T15:12:21.331036+0000","last_fullsized":"2024-03-09T15:12:21.331036+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'167","last_scrub_stamp":"2024-03-09T15:12:21.330911+0000","last_deep_scrub":"264'167","last_deep_scrub_stamp":"2024-03-09T15:12:21.330911+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.330911+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:30:18.179176+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3634858,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":329,"num_read_kb":46066,"num_write":939,"num_write_kb":31825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'425","reported_seq":2040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.892877+0000","last_change":"2024-03-09T15:12:10.892932+0000","last_active":"2024-03-09T15:12:10.892877+0000","last_peered":"2024-03-09T15:12:10.892877+0000","last_clean":"2024-03-09T15:12:10.892877+0000","last_became_active":"2024-03-09T14:26:28.652474+0000","last_became_peered":"2024-03-09T14:26:28.652474+0000","last_unstale":"2024-03-09T15:12:10.892877+0000","last_undegraded":"2024-03-09T15:12:10.892877+0000","last_fullsized":"2024-03-09T15:12:10.892877+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'425","last_scrub_stamp":"2024-03-09T15:12:10.892757+0000","last_deep_scrub":"264'425","last_deep_scrub_stamp":"2024-03-09T15:12:10.892757+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.892757+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:33:57.027615+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2338,"num_read_kb":2225,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'237","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:08.945222+0000","last_change":"2024-03-09T15:12:08.945222+0000","last_active":"2024-03-09T15:12:08.945222+0000","last_peered":"2024-03-09T15:12:08.945222+0000","last_clean":"2024-03-09T15:12:08.945222+0000","last_became_active":"2024-03-09T14:26:26.635943+0000","last_became_peered":"2024-03-09T14:26:26.635943+0000","last_unstale":"2024-03-09T15:12:08.945222+0000","last_undegraded":"2024-03-09T15:12:08.945222+0000","last_fullsized":"2024-03-09T15:12:08.945222+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'237","last_scrub_stamp":"2024-03-09T15:12:08.945063+0000","last_deep_scrub":"264'237","last_deep_scrub_stamp":"2024-03-09T15:12:08.945063+0000","last_clean_scrub_stamp":"2024-03-09T15:12:08.945063+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:24:10.736508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048641,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":547,"num_read_kb":21035,"num_write":1141,"num_write_kb":21105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'405","reported_seq":1839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.442214+0000","last_change":"2024-03-09T15:12:09.442252+0000","last_active":"2024-03-09T15:12:09.442214+0000","last_peered":"2024-03-09T15:12:09.442214+0000","last_clean":"2024-03-09T15:12:09.442214+0000","last_became_active":"2024-03-09T14:26:28.645917+0000","last_became_peered":"2024-03-09T14:26:28.645917+0000","last_unstale":"2024-03-09T15:12:09.442214+0000","last_undegraded":"2024-03-09T15:12:09.442214+0000","last_fullsized":"2024-03-09T15:12:09.442214+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-03-09T15:12:09.442112+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-03-09T15:12:09.442112+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.442112+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:41.180221+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2143,"num_read_kb":1999,"num_write":476,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'197","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:24.368705+0000","last_change":"2024-03-09T15:12:24.368744+0000","last_active":"2024-03-09T15:12:24.368705+0000","last_peered":"2024-03-09T15:12:24.368705+0000","last_clean":"2024-03-09T15:12:24.368705+0000","last_became_active":"2024-03-09T14:26:26.648084+0000","last_became_peered":"2024-03-09T14:26:26.648084+0000","last_unstale":"2024-03-09T15:12:24.368705+0000","last_undegraded":"2024-03-09T15:12:24.368705+0000","last_fullsized":"2024-03-09T15:12:24.368705+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'197","last_scrub_stamp":"2024-03-09T15:12:24.368619+0000","last_deep_scrub":"264'197","last_deep_scrub_stamp":"2024-03-09T15:12:24.368619+0000","last_clean_scrub_stamp":"2024-03-09T15:12:24.368619+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:25:32.713305+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097599,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":455,"num_read_kb":30660,"num_write":1035,"num_write_kb":42042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'1285","reported_seq":2888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.829514+0000","last_change":"2024-03-09T15:12:14.829561+0000","last_active":"2024-03-09T15:12:14.829514+0000","last_peered":"2024-03-09T15:12:14.829514+0000","last_clean":"2024-03-09T15:12:14.829514+0000","last_became_active":"2024-03-09T14:26:28.646936+0000","last_became_peered":"2024-03-09T14:26:28.646936+0000","last_unstale":"2024-03-09T15:12:14.829514+0000","last_undegraded":"2024-03-09T15:12:14.829514+0000","last_fullsized":"2024-03-09T15:12:14.829514+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1285","last_scrub_stamp":"2024-03-09T15:12:14.829417+0000","last_deep_scrub":"264'1285","last_deep_scrub_stamp":"2024-03-09T15:12:14.829417+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.829417+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:56:53.839431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5472,"num_read_kb":4757,"num_write":1845,"num_write_kb":841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'173","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:36.466222+0000","last_change":"2024-03-09T15:12:36.466286+0000","last_active":"2024-03-09T15:12:36.466222+0000","last_peered":"2024-03-09T15:12:36.466222+0000","last_clean":"2024-03-09T15:12:36.466222+0000","last_became_active":"2024-03-09T14:26:26.632394+0000","last_became_peered":"2024-03-09T14:26:26.632394+0000","last_unstale":"2024-03-09T15:12:36.466222+0000","last_undegraded":"2024-03-09T15:12:36.466222+0000","last_fullsized":"2024-03-09T15:12:36.466222+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-03-09T15:12:36.466122+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-03-09T15:12:36.466122+0000","last_clean_scrub_stamp":"2024-03-09T15:12:36.466122+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:50:10.718928+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194317,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":61859,"num_write":999,"num_write_kb":24366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'712","reported_seq":2168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:23.024404+0000","last_change":"2024-03-09T15:12:23.024404+0000","last_active":"2024-03-09T15:12:23.024404+0000","last_peered":"2024-03-09T15:12:23.024404+0000","last_clean":"2024-03-09T15:12:23.024404+0000","last_became_active":"2024-03-09T14:26:28.655549+0000","last_became_peered":"2024-03-09T14:26:28.655549+0000","last_unstale":"2024-03-09T15:12:23.024404+0000","last_undegraded":"2024-03-09T15:12:23.024404+0000","last_fullsized":"2024-03-09T15:12:23.024404+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'712","last_scrub_stamp":"2024-03-09T15:12:23.024273+0000","last_deep_scrub":"264'712","last_deep_scrub_stamp":"2024-03-09T15:12:23.024273+0000","last_clean_scrub_stamp":"2024-03-09T15:12:23.024273+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":700,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:49.883280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3228,"num_read_kb":2913,"num_write":936,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'248","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:36.989538+0000","last_change":"2024-03-09T15:12:36.989662+0000","last_active":"2024-03-09T15:12:36.989538+0000","last_peered":"2024-03-09T15:12:36.989538+0000","last_clean":"2024-03-09T15:12:36.989538+0000","last_became_active":"2024-03-09T14:26:26.640874+0000","last_became_peered":"2024-03-09T14:26:26.640874+0000","last_unstale":"2024-03-09T15:12:36.989538+0000","last_undegraded":"2024-03-09T15:12:36.989538+0000","last_fullsized":"2024-03-09T15:12:36.989538+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'248","last_scrub_stamp":"2024-03-09T15:12:36.989421+0000","last_deep_scrub":"264'248","last_deep_scrub_stamp":"2024-03-09T15:12:36.989421+0000","last_clean_scrub_stamp":"2024-03-09T15:12:36.989421+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:30:57.882568+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4477257,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":552,"num_read_kb":47489,"num_write":1247,"num_write_kb":60004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'343","reported_seq":1785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:27.888529+0000","last_change":"2024-03-09T15:12:27.888559+0000","last_active":"2024-03-09T15:12:27.888529+0000","last_peered":"2024-03-09T15:12:27.888529+0000","last_clean":"2024-03-09T15:12:27.888529+0000","last_became_active":"2024-03-09T14:26:28.645393+0000","last_became_peered":"2024-03-09T14:26:28.645393+0000","last_unstale":"2024-03-09T15:12:27.888529+0000","last_undegraded":"2024-03-09T15:12:27.888529+0000","last_fullsized":"2024-03-09T15:12:27.888529+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-03-09T15:12:27.888445+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-03-09T15:12:27.888445+0000","last_clean_scrub_stamp":"2024-03-09T15:12:27.888445+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:50.226173+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1972,"num_read_kb":1873,"num_write":396,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'185","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.823461+0000","last_change":"2024-03-09T15:12:19.823512+0000","last_active":"2024-03-09T15:12:19.823461+0000","last_peered":"2024-03-09T15:12:19.823461+0000","last_clean":"2024-03-09T15:12:19.823461+0000","last_became_active":"2024-03-09T14:26:26.631046+0000","last_became_peered":"2024-03-09T14:26:26.631046+0000","last_unstale":"2024-03-09T15:12:19.823461+0000","last_undegraded":"2024-03-09T15:12:19.823461+0000","last_fullsized":"2024-03-09T15:12:19.823461+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-03-09T15:12:19.823358+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-03-09T15:12:19.823358+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.823358+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:09:10.746963+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":463,"num_read_kb":18518,"num_write":1084,"num_write_kb":23654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'765","reported_seq":2196,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:31.049711+0000","last_change":"2024-03-09T15:12:31.049738+0000","last_active":"2024-03-09T15:12:31.049711+0000","last_peered":"2024-03-09T15:12:31.049711+0000","last_clean":"2024-03-09T15:12:31.049711+0000","last_became_active":"2024-03-09T14:26:28.651945+0000","last_became_peered":"2024-03-09T14:26:28.651945+0000","last_unstale":"2024-03-09T15:12:31.049711+0000","last_undegraded":"2024-03-09T15:12:31.049711+0000","last_fullsized":"2024-03-09T15:12:31.049711+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'765","last_scrub_stamp":"2024-03-09T15:12:31.049625+0000","last_deep_scrub":"264'765","last_deep_scrub_stamp":"2024-03-09T15:12:31.049625+0000","last_clean_scrub_stamp":"2024-03-09T15:12:31.049625+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:10:46.091772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3422,"num_read_kb":3025,"num_write":1046,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'210","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:18.279465+0000","last_change":"2024-03-09T15:12:18.279549+0000","last_active":"2024-03-09T15:12:18.279465+0000","last_peered":"2024-03-09T15:12:18.279465+0000","last_clean":"2024-03-09T15:12:18.279465+0000","last_became_active":"2024-03-09T14:26:26.645379+0000","last_became_peered":"2024-03-09T14:26:26.645379+0000","last_unstale":"2024-03-09T15:12:18.279465+0000","last_undegraded":"2024-03-09T15:12:18.279465+0000","last_fullsized":"2024-03-09T15:12:18.279465+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-03-09T15:12:18.279376+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-03-09T15:12:18.279376+0000","last_clean_scrub_stamp":"2024-03-09T15:12:18.279376+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:30:17.515463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2265,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":547,"num_read_kb":953,"num_write":1107,"num_write_kb":19452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'1203","reported_seq":2808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.279239+0000","last_change":"2024-03-09T15:12:09.279239+0000","last_active":"2024-03-09T15:12:09.279239+0000","last_peered":"2024-03-09T15:12:09.279239+0000","last_clean":"2024-03-09T15:12:09.279239+0000","last_became_active":"2024-03-09T14:26:28.651254+0000","last_became_peered":"2024-03-09T14:26:28.651254+0000","last_unstale":"2024-03-09T15:12:09.279239+0000","last_undegraded":"2024-03-09T15:12:09.279239+0000","last_fullsized":"2024-03-09T15:12:09.279239+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1203","last_scrub_stamp":"2024-03-09T15:12:09.279118+0000","last_deep_scrub":"264'1203","last_deep_scrub_stamp":"2024-03-09T15:12:09.279118+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.279118+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":1100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:59:28.674500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5174,"num_read_kb":4521,"num_write":1709,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'218","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:36.016616+0000","last_change":"2024-03-09T15:12:36.016661+0000","last_active":"2024-03-09T15:12:36.016616+0000","last_peered":"2024-03-09T15:12:36.016616+0000","last_clean":"2024-03-09T15:12:36.016616+0000","last_became_active":"2024-03-09T14:26:26.639719+0000","last_became_peered":"2024-03-09T14:26:26.639719+0000","last_unstale":"2024-03-09T15:12:36.016616+0000","last_undegraded":"2024-03-09T15:12:36.016616+0000","last_fullsized":"2024-03-09T15:12:36.016616+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'218","last_scrub_stamp":"2024-03-09T15:12:36.016528+0000","last_deep_scrub":"264'218","last_deep_scrub_stamp":"2024-03-09T15:12:36.016528+0000","last_clean_scrub_stamp":"2024-03-09T15:12:36.016528+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:26:33.147706+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3186960,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":530,"num_read_kb":50172,"num_write":1173,"num_write_kb":33138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1153","reported_seq":2688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:24.518847+0000","last_change":"2024-03-09T15:12:24.518911+0000","last_active":"2024-03-09T15:12:24.518847+0000","last_peered":"2024-03-09T15:12:24.518847+0000","last_clean":"2024-03-09T15:12:24.518847+0000","last_became_active":"2024-03-09T14:26:28.648626+0000","last_became_peered":"2024-03-09T14:26:28.648626+0000","last_unstale":"2024-03-09T15:12:24.518847+0000","last_undegraded":"2024-03-09T15:12:24.518847+0000","last_fullsized":"2024-03-09T15:12:24.518847+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1153","last_scrub_stamp":"2024-03-09T15:12:24.518738+0000","last_deep_scrub":"264'1153","last_deep_scrub_stamp":"2024-03-09T15:12:24.518738+0000","last_clean_scrub_stamp":"2024-03-09T15:12:24.518738+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":1100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:22.311612+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4796,"num_read_kb":4189,"num_write":1590,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'192","reported_seq":834,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:28.379354+0000","last_change":"2024-03-09T15:12:28.379404+0000","last_active":"2024-03-09T15:12:28.379354+0000","last_peered":"2024-03-09T15:12:28.379354+0000","last_clean":"2024-03-09T15:12:28.379354+0000","last_became_active":"2024-03-09T14:26:26.640157+0000","last_became_peered":"2024-03-09T14:26:26.640157+0000","last_unstale":"2024-03-09T15:12:28.379354+0000","last_undegraded":"2024-03-09T15:12:28.379354+0000","last_fullsized":"2024-03-09T15:12:28.379354+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-03-09T15:12:28.379261+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-03-09T15:12:28.379261+0000","last_clean_scrub_stamp":"2024-03-09T15:12:28.379261+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:29.135877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":19261,"num_write":1003,"num_write_kb":28212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'709","reported_seq":2144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:20.954155+0000","last_change":"2024-03-09T15:12:20.954213+0000","last_active":"2024-03-09T15:12:20.954155+0000","last_peered":"2024-03-09T15:12:20.954155+0000","last_clean":"2024-03-09T15:12:20.954155+0000","last_became_active":"2024-03-09T14:26:28.650013+0000","last_became_peered":"2024-03-09T14:26:28.650013+0000","last_unstale":"2024-03-09T15:12:20.954155+0000","last_undegraded":"2024-03-09T15:12:20.954155+0000","last_fullsized":"2024-03-09T15:12:20.954155+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'709","last_scrub_stamp":"2024-03-09T15:12:20.954059+0000","last_deep_scrub":"264'709","last_deep_scrub_stamp":"2024-03-09T15:12:20.954059+0000","last_clean_scrub_stamp":"2024-03-09T15:12:20.954059+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:21.095472+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3189,"num_read_kb":2865,"num_write":935,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'212","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:38.004402+0000","last_change":"2024-03-09T15:12:38.004486+0000","last_active":"2024-03-09T15:12:38.004402+0000","last_peered":"2024-03-09T15:12:38.004402+0000","last_clean":"2024-03-09T15:12:38.004402+0000","last_became_active":"2024-03-09T14:26:26.641737+0000","last_became_peered":"2024-03-09T14:26:26.641737+0000","last_unstale":"2024-03-09T15:12:38.004402+0000","last_undegraded":"2024-03-09T15:12:38.004402+0000","last_fullsized":"2024-03-09T15:12:38.004402+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-03-09T15:12:38.004285+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-03-09T15:12:38.004285+0000","last_clean_scrub_stamp":"2024-03-09T15:12:38.004285+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:39:01.798563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262754,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":32584,"num_write":1138,"num_write_kb":28426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'423","reported_seq":2064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:10.998451+0000","last_change":"2024-03-09T15:12:10.998484+0000","last_active":"2024-03-09T15:12:10.998451+0000","last_peered":"2024-03-09T15:12:10.998451+0000","last_clean":"2024-03-09T15:12:10.998451+0000","last_became_active":"2024-03-09T14:26:28.644094+0000","last_became_peered":"2024-03-09T14:26:28.644094+0000","last_unstale":"2024-03-09T15:12:10.998451+0000","last_undegraded":"2024-03-09T15:12:10.998451+0000","last_fullsized":"2024-03-09T15:12:10.998451+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'423","last_scrub_stamp":"2024-03-09T15:12:10.998361+0000","last_deep_scrub":"264'423","last_deep_scrub_stamp":"2024-03-09T15:12:10.998361+0000","last_clean_scrub_stamp":"2024-03-09T15:12:10.998361+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:17:58.522488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2230,"num_write":484,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'212","reported_seq":825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:30.397094+0000","last_change":"2024-03-09T15:12:30.397135+0000","last_active":"2024-03-09T15:12:30.397094+0000","last_peered":"2024-03-09T15:12:30.397094+0000","last_clean":"2024-03-09T15:12:30.397094+0000","last_became_active":"2024-03-09T14:26:26.645413+0000","last_became_peered":"2024-03-09T14:26:26.645413+0000","last_unstale":"2024-03-09T15:12:30.397094+0000","last_undegraded":"2024-03-09T15:12:30.397094+0000","last_fullsized":"2024-03-09T15:12:30.397094+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-03-09T15:12:30.396996+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-03-09T15:12:30.396996+0000","last_clean_scrub_stamp":"2024-03-09T15:12:30.396996+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:07:03.783219+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262161,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":457,"num_read_kb":3495,"num_write":1054,"num_write_kb":12293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'791","reported_seq":2467,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:13.085605+0000","last_change":"2024-03-09T15:12:13.085634+0000","last_active":"2024-03-09T15:12:13.085605+0000","last_peered":"2024-03-09T15:12:13.085605+0000","last_clean":"2024-03-09T15:12:13.085605+0000","last_became_active":"2024-03-09T14:26:28.650629+0000","last_became_peered":"2024-03-09T14:26:28.650629+0000","last_unstale":"2024-03-09T15:12:13.085605+0000","last_undegraded":"2024-03-09T15:12:13.085605+0000","last_fullsized":"2024-03-09T15:12:13.085605+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'791","last_scrub_stamp":"2024-03-09T15:12:13.085516+0000","last_deep_scrub":"264'791","last_deep_scrub_stamp":"2024-03-09T15:12:13.085516+0000","last_clean_scrub_stamp":"2024-03-09T15:12:13.085516+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:44:33.681890+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3842,"num_read_kb":3483,"num_write":1039,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'234","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:39.446081+0000","last_change":"2024-03-09T15:12:39.446116+0000","last_active":"2024-03-09T15:12:39.446081+0000","last_peered":"2024-03-09T15:12:39.446081+0000","last_clean":"2024-03-09T15:12:39.446081+0000","last_became_active":"2024-03-09T14:26:26.644358+0000","last_became_peered":"2024-03-09T14:26:26.644358+0000","last_unstale":"2024-03-09T15:12:39.446081+0000","last_undegraded":"2024-03-09T15:12:39.446081+0000","last_fullsized":"2024-03-09T15:12:39.446081+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'234","last_scrub_stamp":"2024-03-09T15:12:39.445989+0000","last_deep_scrub":"264'234","last_deep_scrub_stamp":"2024-03-09T15:12:39.445989+0000","last_clean_scrub_stamp":"2024-03-09T15:12:39.445989+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:40:45.762343+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":7434,"num_write":1304,"num_write_kb":33527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'510","reported_seq":2085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:21.782090+0000","last_change":"2024-03-09T15:12:21.782134+0000","last_active":"2024-03-09T15:12:21.782090+0000","last_peered":"2024-03-09T15:12:21.782090+0000","last_clean":"2024-03-09T15:12:21.782090+0000","last_became_active":"2024-03-09T14:26:28.655438+0000","last_became_peered":"2024-03-09T14:26:28.655438+0000","last_unstale":"2024-03-09T15:12:21.782090+0000","last_undegraded":"2024-03-09T15:12:21.782090+0000","last_fullsized":"2024-03-09T15:12:21.782090+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'510","last_scrub_stamp":"2024-03-09T15:12:21.781992+0000","last_deep_scrub":"264'510","last_deep_scrub_stamp":"2024-03-09T15:12:21.781992+0000","last_clean_scrub_stamp":"2024-03-09T15:12:21.781992+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:19:30.411160+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2613,"num_read_kb":2408,"num_write":650,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":303,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'184","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:20.287695+0000","last_change":"2024-03-09T15:12:20.287731+0000","last_active":"2024-03-09T15:12:20.287695+0000","last_peered":"2024-03-09T15:12:20.287695+0000","last_clean":"2024-03-09T15:12:20.287695+0000","last_became_active":"2024-03-09T14:26:26.648682+0000","last_became_peered":"2024-03-09T14:26:26.648682+0000","last_unstale":"2024-03-09T15:12:20.287695+0000","last_undegraded":"2024-03-09T15:12:20.287695+0000","last_fullsized":"2024-03-09T15:12:20.287695+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-03-09T15:12:20.287609+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-03-09T15:12:20.287609+0000","last_clean_scrub_stamp":"2024-03-09T15:12:20.287609+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:15:27.312267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":448,"num_read_kb":6066,"num_write":1003,"num_write_kb":27510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'408","reported_seq":2023,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:26.498667+0000","last_change":"2024-03-09T15:12:26.498695+0000","last_active":"2024-03-09T15:12:26.498667+0000","last_peered":"2024-03-09T15:12:26.498667+0000","last_clean":"2024-03-09T15:12:26.498667+0000","last_became_active":"2024-03-09T14:26:28.646239+0000","last_became_peered":"2024-03-09T14:26:28.646239+0000","last_unstale":"2024-03-09T15:12:26.498667+0000","last_undegraded":"2024-03-09T15:12:26.498667+0000","last_fullsized":"2024-03-09T15:12:26.498667+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'408","last_scrub_stamp":"2024-03-09T15:12:26.498566+0000","last_deep_scrub":"264'408","last_deep_scrub_stamp":"2024-03-09T15:12:26.498566+0000","last_clean_scrub_stamp":"2024-03-09T15:12:26.498566+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:12:03.971664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2327,"num_read_kb":2213,"num_write":484,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'215","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:37.786726+0000","last_change":"2024-03-09T15:12:37.786795+0000","last_active":"2024-03-09T15:12:37.786726+0000","last_peered":"2024-03-09T15:12:37.786726+0000","last_clean":"2024-03-09T15:12:37.786726+0000","last_became_active":"2024-03-09T14:26:26.645230+0000","last_became_peered":"2024-03-09T14:26:26.645230+0000","last_unstale":"2024-03-09T15:12:37.786726+0000","last_undegraded":"2024-03-09T15:12:37.786726+0000","last_fullsized":"2024-03-09T15:12:37.786726+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'215","last_scrub_stamp":"2024-03-09T15:12:37.786608+0000","last_deep_scrub":"264'215","last_deep_scrub_stamp":"2024-03-09T15:12:37.786608+0000","last_clean_scrub_stamp":"2024-03-09T15:12:37.786608+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:53:29.705508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":27386,"num_write":1086,"num_write_kb":24817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'342","reported_seq":1825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:27.031969+0000","last_change":"2024-03-09T15:12:27.031995+0000","last_active":"2024-03-09T15:12:27.031969+0000","last_peered":"2024-03-09T15:12:27.031969+0000","last_clean":"2024-03-09T15:12:27.031969+0000","last_became_active":"2024-03-09T14:26:28.653177+0000","last_became_peered":"2024-03-09T14:26:28.653177+0000","last_unstale":"2024-03-09T15:12:27.031969+0000","last_undegraded":"2024-03-09T15:12:27.031969+0000","last_fullsized":"2024-03-09T15:12:27.031969+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-03-09T15:12:27.031882+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-03-09T15:12:27.031882+0000","last_clean_scrub_stamp":"2024-03-09T15:12:27.031882+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:59:35.559899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1954,"num_read_kb":1880,"num_write":380,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'196","reported_seq":809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:09.989551+0000","last_change":"2024-03-09T15:12:09.989595+0000","last_active":"2024-03-09T15:12:09.989551+0000","last_peered":"2024-03-09T15:12:09.989551+0000","last_clean":"2024-03-09T15:12:09.989551+0000","last_became_active":"2024-03-09T14:26:26.637589+0000","last_became_peered":"2024-03-09T14:26:26.637589+0000","last_unstale":"2024-03-09T15:12:09.989551+0000","last_undegraded":"2024-03-09T15:12:09.989551+0000","last_fullsized":"2024-03-09T15:12:09.989551+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-03-09T15:12:09.989450+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-03-09T15:12:09.989450+0000","last_clean_scrub_stamp":"2024-03-09T15:12:09.989450+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:20:22.984515+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456529,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":381,"num_read_kb":13354,"num_write":1025,"num_write_kb":55720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'1151","reported_seq":2620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:19.858491+0000","last_change":"2024-03-09T15:12:19.858518+0000","last_active":"2024-03-09T15:12:19.858491+0000","last_peered":"2024-03-09T15:12:19.858491+0000","last_clean":"2024-03-09T15:12:19.858491+0000","last_became_active":"2024-03-09T14:26:28.655383+0000","last_became_peered":"2024-03-09T14:26:28.655383+0000","last_unstale":"2024-03-09T15:12:19.858491+0000","last_undegraded":"2024-03-09T15:12:19.858491+0000","last_fullsized":"2024-03-09T15:12:19.858491+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1151","last_scrub_stamp":"2024-03-09T15:12:19.858394+0000","last_deep_scrub":"264'1151","last_deep_scrub_stamp":"2024-03-09T15:12:19.858394+0000","last_clean_scrub_stamp":"2024-03-09T15:12:19.858394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:15:05.051301+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4791,"num_read_kb":4166,"num_write":1605,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'231","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:16.417261+0000","last_change":"2024-03-09T15:12:16.417334+0000","last_active":"2024-03-09T15:12:16.417261+0000","last_peered":"2024-03-09T15:12:16.417261+0000","last_clean":"2024-03-09T15:12:16.417261+0000","last_became_active":"2024-03-09T14:26:26.652576+0000","last_became_peered":"2024-03-09T14:26:26.652576+0000","last_unstale":"2024-03-09T15:12:16.417261+0000","last_undegraded":"2024-03-09T15:12:16.417261+0000","last_fullsized":"2024-03-09T15:12:16.417261+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-03-09T15:12:16.417152+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-03-09T15:12:16.417152+0000","last_clean_scrub_stamp":"2024-03-09T15:12:16.417152+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:10:31.051645+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460219,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":654,"num_read_kb":5204,"num_write":1022,"num_write_kb":18451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'327","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:52.419358+0000","last_change":"2024-03-09T15:11:52.419449+0000","last_active":"2024-03-09T15:11:52.419358+0000","last_peered":"2024-03-09T15:11:52.419358+0000","last_clean":"2024-03-09T15:11:52.419358+0000","last_became_active":"2024-03-09T14:27:03.715719+0000","last_became_peered":"2024-03-09T14:27:03.715719+0000","last_unstale":"2024-03-09T15:11:52.419358+0000","last_undegraded":"2024-03-09T15:11:52.419358+0000","last_fullsized":"2024-03-09T15:11:52.419358+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'327","last_scrub_stamp":"2024-03-09T15:11:52.419247+0000","last_deep_scrub":"264'327","last_deep_scrub_stamp":"2024-03-09T15:11:52.419247+0000","last_clean_scrub_stamp":"2024-03-09T15:11:52.419247+0000","objects_scrubbed":7,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:53.358056+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388665,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":851,"num_read_kb":60318,"num_write":1289,"num_write_kb":31608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'794","reported_seq":2418,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:20.530913+0000","last_change":"2024-03-09T15:12:20.530913+0000","last_active":"2024-03-09T15:12:20.530913+0000","last_peered":"2024-03-09T15:12:20.530913+0000","last_clean":"2024-03-09T15:12:20.530913+0000","last_became_active":"2024-03-09T14:26:28.649178+0000","last_became_peered":"2024-03-09T14:26:28.649178+0000","last_unstale":"2024-03-09T15:12:20.530913+0000","last_undegraded":"2024-03-09T15:12:20.530913+0000","last_fullsized":"2024-03-09T15:12:20.530913+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'794","last_scrub_stamp":"2024-03-09T15:12:20.530774+0000","last_deep_scrub":"264'794","last_deep_scrub_stamp":"2024-03-09T15:12:20.530774+0000","last_clean_scrub_stamp":"2024-03-09T15:12:20.530774+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:21:08.985356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3684,"num_read_kb":3311,"num_write":1055,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'191","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:11:57.037655+0000","last_change":"2024-03-09T15:11:57.037713+0000","last_active":"2024-03-09T15:11:57.037655+0000","last_peered":"2024-03-09T15:11:57.037655+0000","last_clean":"2024-03-09T15:11:57.037655+0000","last_became_active":"2024-03-09T14:27:03.721595+0000","last_became_peered":"2024-03-09T14:27:03.721595+0000","last_unstale":"2024-03-09T15:11:57.037655+0000","last_undegraded":"2024-03-09T15:11:57.037655+0000","last_fullsized":"2024-03-09T15:11:57.037655+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'191","last_scrub_stamp":"2024-03-09T15:11:57.037513+0000","last_deep_scrub":"264'191","last_deep_scrub_stamp":"2024-03-09T15:11:57.037513+0000","last_clean_scrub_stamp":"2024-03-09T15:11:57.037513+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:18:55.396406+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815977,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":112993,"num_write":1053,"num_write_kb":48480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'390","reported_seq":2056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:12:14.501628+0000","last_change":"2024-03-09T15:12:14.501628+0000","last_active":"2024-03-09T15:12:14.501628+0000","last_peered":"2024-03-09T15:12:14.501628+0000","last_clean":"2024-03-09T15:12:14.501628+0000","last_became_active":"2024-03-09T14:26:28.645067+0000","last_became_peered":"2024-03-09T14:26:28.645067+0000","last_unstale":"2024-03-09T15:12:14.501628+0000","last_undegraded":"2024-03-09T15:12:14.501628+0000","last_fullsized":"2024-03-09T15:12:14.501628+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'390","last_scrub_stamp":"2024-03-09T15:12:14.501517+0000","last_deep_scrub":"264'390","last_deep_scrub_stamp":"2024-03-09T15:12:14.501517+0000","last_clean_scrub_stamp":"2024-03-09T15:12:14.501517+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:39:50.142913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2475,"num_read_kb":2383,"num_write":438,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3064,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5887,"num_read_kb":4246,"num_write":2185,"num_write_kb":841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8667,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1219,"ondisk_log_size":1219,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":12946,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":15495,"num_read_kb":15279,"num_write":16228,"num_write_kb":4747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2170,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":507904,"data_stored":25892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1741,"ondisk_log_size":1741,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":440,"ondisk_log_size":440,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":322743,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8037,"num_read_kb":10144,"num_write":5663,"num_write_kb":2860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":686822,"num_omap_keys":1578,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2068,"ondisk_log_size":2068,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1593,"num_read_kb":1897,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":195183,"num_read_kb":178329,"num_write":51691,"num_write_kb":17736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":121,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":32856,"num_omap_keys":136,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3657,"ondisk_log_size":3657,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":155728130,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":241,"num_whiteouts":0,"num_read":32390,"num_read_kb":2319225,"num_write":69850,"num_write_kb":2158516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":235536384,"data_stored":235536384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4154,"ondisk_log_size":4154,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":164063,"num_write":179,"num_write_kb":125047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":167,"num_read_kb":183429,"num_write":179,"num_write_kb":125047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575414,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320772,"kb_used_data":50812,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94051068,"statfs":{"total":96636764160,"available":96308293632,"internally_reserved":0,"allocated":52031488,"data_stored":50062803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575413,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279852,"kb_used_data":23780,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94091988,"statfs":{"total":96636764160,"available":96350195712,"internally_reserved":0,"allocated":24350720,"data_stored":22401655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575414,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139292,"kb_used_data":53972,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94232548,"statfs":{"total":96636764160,"available":96494129152,"internally_reserved":0,"allocated":55267328,"data_stored":53270043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575412,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139252,"kb_used_data":35884,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94232588,"statfs":{"total":96636764160,"available":96494170112,"internally_reserved":0,"allocated":36745216,"data_stored":34850722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575413,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272684,"kb_used_data":38820,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94099156,"statfs":{"total":96636764160,"available":96357535744,"internally_reserved":0,"allocated":39751680,"data_stored":37775689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575412,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112676,"kb_used_data":41244,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94259164,"statfs":{"total":96636764160,"available":96521383936,"internally_reserved":0,"allocated":42233856,"data_stored":40310821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575413,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164480,"kb_used_data":43128,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94207360,"statfs":{"total":96636764160,"available":96468336640,"internally_reserved":0,"allocated":44163072,"data_stored":42229674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575413,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280168,"kb_used_data":42144,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94091672,"statfs":{"total":96636764160,"available":96349872128,"internally_reserved":0,"allocated":43155456,"data_stored":41182927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24678400,"data_stored":24678400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34705408,"data_stored":34705408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29638656,"data_stored":29638656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25006080,"data_stored":25006080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":31522816,"data_stored":31522816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36306944,"data_stored":36306944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":19070976,"data_stored":19070976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":34607104,"data_stored":34607104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:12:53.897 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-09T15:12:54.221 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-09T15:12:54.221 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-09T15:12:54.222 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-09T15:12:54.222 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:12:54.266 INFO:tasks.ceph.osd.0:Stopped 2024-03-09T15:12:54.266 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-09T15:12:54.266 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:12:54.308 INFO:tasks.ceph.osd.1:Stopped 2024-03-09T15:12:54.308 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-09T15:12:54.308 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:12:54.345 INFO:tasks.ceph.osd.2:Stopped 2024-03-09T15:12:54.346 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-09T15:12:54.346 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:12:54.430 INFO:tasks.ceph.osd.3:Stopped 2024-03-09T15:12:54.431 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-09T15:12:54.431 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:12:54.475 INFO:tasks.ceph.osd.4:Stopped 2024-03-09T15:12:54.476 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-09T15:12:54.476 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:12:54.535 INFO:tasks.ceph.osd.5:Stopped 2024-03-09T15:12:54.535 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-09T15:12:54.536 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:12:54.588 INFO:tasks.ceph.osd.6:Stopped 2024-03-09T15:12:54.588 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-09T15:12:54.588 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:12:54.643 INFO:tasks.ceph.osd.7:Stopped 2024-03-09T15:12:54.644 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-09T15:12:54.644 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-09T15:12:54.644 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:12:54.669 INFO:tasks.ceph.mgr.y:Stopped 2024-03-09T15:12:54.669 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-09T15:12:54.670 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:12:54.699 INFO:tasks.ceph.mgr.x:Stopped 2024-03-09T15:12:54.699 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-09T15:12:54.700 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-09T15:12:54.700 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:12:54.724 INFO:tasks.ceph.mon.a:Stopped 2024-03-09T15:12:54.724 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-09T15:12:54.724 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:12:54.777 INFO:tasks.ceph.mon.c:Stopped 2024-03-09T15:12:54.777 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-09T15:12:54.778 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:12:54.790 INFO:tasks.ceph.mon.b:Stopped 2024-03-09T15:12:54.790 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-09T15:12:54.790 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-03-09T15:12:54.875 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi088.front.sepia.ceph.com 2024-03-09T15:12:54.875 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-09T15:12:55.082 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi088.front.sepia.ceph.com 2024-03-09T15:12:55.083 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-09T15:12:55.191 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi088.front.sepia.ceph.com 2024-03-09T15:12:55.191 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-09T15:12:55.263 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi088.front.sepia.ceph.com 2024-03-09T15:12:55.263 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-09T15:12:55.363 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi132.front.sepia.ceph.com 2024-03-09T15:12:55.363 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-09T15:12:55.620 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi132.front.sepia.ceph.com 2024-03-09T15:12:55.620 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-09T15:12:55.719 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi132.front.sepia.ceph.com 2024-03-09T15:12:55.719 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-09T15:12:55.804 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi132.front.sepia.ceph.com 2024-03-09T15:12:55.804 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-09T15:12:55.886 INFO:tasks.ceph:Archiving mon data... 2024-03-09T15:12:55.888 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484/data/mon.a.tgz 2024-03-09T15:12:55.888 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-03-09T15:12:55.918 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.ItGfNnppsx 2024-03-09T15:12:55.919 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ItGfNnppsx 2024-03-09T15:12:56.125 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.ItGfNnppsx 2024-03-09T15:12:56.235 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.ItGfNnppsx is 508KB 2024-03-09T15:12:56.339 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.ItGfNnppsx 2024-03-09T15:12:56.366 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484/data/mon.c.tgz 2024-03-09T15:12:56.366 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-03-09T15:12:56.432 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.TWlswrPcyk 2024-03-09T15:12:56.433 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.TWlswrPcyk 2024-03-09T15:12:56.642 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.TWlswrPcyk 2024-03-09T15:12:56.752 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.TWlswrPcyk is 554KB 2024-03-09T15:12:56.853 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.TWlswrPcyk 2024-03-09T15:12:56.881 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484/data/mon.b.tgz 2024-03-09T15:12:56.881 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2024-03-09T15:12:56.914 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.TGPOPAhzWe 2024-03-09T15:12:56.914 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.TGPOPAhzWe 2024-03-09T15:12:57.146 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.TGPOPAhzWe 2024-03-09T15:12:57.255 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.TGPOPAhzWe is 553KB 2024-03-09T15:12:57.356 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.TGPOPAhzWe 2024-03-09T15:12:57.382 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-09T15:12:57.383 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-09T15:12:57.385 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-09T15:12:57.565 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-09T15:12:57.594 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-09T15:12:57.594 INFO:tasks.ceph:Archiving crash dumps... 2024-03-09T15:12:57.598 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484/remote/smithi088/crash 2024-03-09T15:12:57.599 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-09T15:12:57.638 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484/remote/smithi132/crash 2024-03-09T15:12:57.639 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-09T15:12:57.678 INFO:tasks.ceph:Compressing logs... 2024-03-09T15:12:57.678 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-09T15:12:57.683 DEBUG:teuthology.orchestra.run.smithi132:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-09T15:12:57.784 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-09T15:12:57.784 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33500.log 2024-03-09T15:12:57.784 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33720.log 2024-03-09T15:12:57.784 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.6.log: gzip/var/log/ceph/ceph-client.admin.33500.log: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-09T15:12:57.784 INFO:teuthology.orchestra.run.smithi132.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33500.log.gz 2024-03-09T15:12:57.784 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.33720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33676.log 2024-03-09T15:12:57.785 INFO:teuthology.orchestra.run.smithi132.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33720.log.gz 2024-03-09T15:12:57.785 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33632.log 2024-03-09T15:12:57.785 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.33676.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-09T15:12:57.785 INFO:teuthology.orchestra.run.smithi132.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33676.log.gz 2024-03-09T15:12:57.785 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.33632.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33632.log.gz -5 2024-03-09T15:12:57.785 INFO:teuthology.orchestra.run.smithi132.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33808.log 2024-03-09T15:12:57.785 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33764.log 2024-03-09T15:12:57.785 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.33808.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-09T15:12:57.786 INFO:teuthology.orchestra.run.smithi132.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33808.log.gz 2024-03-09T15:12:57.786 INFO:teuthology.orchestra.run.smithi132.stderr: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-09T15:12:57.786 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-09T15:12:57.786 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.33764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33764.log.gz 2024-03-09T15:12:57.786 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33588.log 2024-03-09T15:12:57.786 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33544.log 2024-03-09T15:12:57.786 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.33588.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-09T15:12:57.787 INFO:teuthology.orchestra.run.smithi132.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33588.log.gz 2024-03-09T15:12:57.787 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.33544.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-09T15:12:57.787 INFO:teuthology.orchestra.run.smithi132.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33544.log.gz 2024-03-09T15:12:57.787 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-09T15:12:57.787 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mon.b.log: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-09T15:12:57.896 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96774.log 2024-03-09T15:12:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62531.log 2024-03-09T15:12:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.96774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39782.log 2024-03-09T15:12:57.897 INFO:teuthology.orchestra.run.smithi088.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.96774.log.gz 2024-03-09T15:12:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.62531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120428.log 2024-03-09T15:12:57.897 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62531.log.gz 2024-03-09T15:12:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.39782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49012.log 2024-03-09T15:12:57.897 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39782.log.gz 2024-03-09T15:12:57.897 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41114.log 2024-03-09T15:12:57.898 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120428.log.gz 2024-03-09T15:12:57.898 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39491.log 2024-03-09T15:12:57.898 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49012.log.gz 2024-03-09T15:12:57.898 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104431.log 2024-03-09T15:12:57.898 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41114.log.gz 2024-03-09T15:12:57.898 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.39491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112677.log 2024-03-09T15:12:57.898 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39491.log.gz 2024-03-09T15:12:57.899 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105020.log 2024-03-09T15:12:57.899 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.104431.log: /var/log/ceph/ceph-client.admin.112677.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-09T15:12:57.899 INFO:teuthology.orchestra.run.smithi088.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.112677.log.gz 2024-03-09T15:12:57.899 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.105020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41158.log 2024-03-09T15:12:57.899 INFO:teuthology.orchestra.run.smithi088.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.105020.log.gz 2024-03-09T15:12:57.899 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.136432.log 2024-03-09T15:12:57.899 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125469.log 2024-03-09T15:12:57.899 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41158.log.gz 2024-03-09T15:12:57.899 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.136432.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.104431.log.gz 2024-03-09T15:12:57.900 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143729.log 2024-03-09T15:12:57.900 INFO:teuthology.orchestra.run.smithi088.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.0.136432.log.gz/var/log/ceph/ceph-client.admin.125469.log: 2024-03-09T15:12:57.900 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49649.log 2024-03-09T15:12:57.900 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.143729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.138868.log 2024-03-09T15:12:57.900 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143729.log.gz 2024-03-09T15:12:57.900 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62671.log 2024-03-09T15:12:57.900 INFO:teuthology.orchestra.run.smithi088.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.49649.log.gz 2024-03-09T15:12:57.900 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.138868.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.125469.log.gz 2024-03-09T15:12:57.901 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143821.log 2024-03-09T15:12:57.901 INFO:teuthology.orchestra.run.smithi088.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.138868.log.gz 2024-03-09T15:12:57.901 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.62671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47834.log 2024-03-09T15:12:57.901 INFO:teuthology.orchestra.run.smithi088.stderr: 57.3% -- replaced with /var/log/ceph/ceph-client.admin.62671.log.gz 2024-03-09T15:12:57.901 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.143821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110321.log 0.0% 2024-03-09T15:12:57.901 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.143821.log.gz 2024-03-09T15:12:57.901 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115644.log 2024-03-09T15:12:57.901 INFO:teuthology.orchestra.run.smithi088.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.47834.log.gz 2024-03-09T15:12:57.902 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.110321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55587.log 2024-03-09T15:12:57.902 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.115644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87939.log 2024-03-09T15:12:57.902 INFO:teuthology.orchestra.run.smithi088.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.115644.log.gz 2024-03-09T15:12:57.902 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63329.log 2024-03-09T15:12:57.902 INFO:teuthology.orchestra.run.smithi088.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.55587.log.gz 2024-03-09T15:12:57.902 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80282.log 2024-03-09T15:12:57.902 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.87939.log: /var/log/ceph/ceph-client.admin.63329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57354.log 2024-03-09T15:12:57.902 INFO:teuthology.orchestra.run.smithi088.stderr: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.63329.log.gz 2024-03-09T15:12:57.902 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87939.log.gz 2024-03-09T15:12:57.903 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.80282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57991.log 2024-03-09T15:12:57.903 INFO:teuthology.orchestra.run.smithi088.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.110321.log.gz 2024-03-09T15:12:57.903 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.57354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57354.log.gz 2024-03-09T15:12:57.903 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144559.log 2024-03-09T15:12:57.903 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.80282.log.gz 2024-03-09T15:12:57.903 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.57991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67732.log 2024-03-09T15:12:57.903 INFO:teuthology.orchestra.run.smithi088.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.57991.log.gz 2024-03-09T15:12:57.903 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.144559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76397.log 2024-03-09T15:12:57.904 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144559.log.gz 2024-03-09T15:12:57.904 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.67732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144327.log 2024-03-09T15:12:57.904 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.76397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66498.log 2024-03-09T15:12:57.904 INFO:teuthology.orchestra.run.smithi088.stderr: 51.4% -- replaced with /var/log/ceph/ceph-client.admin.76397.log.gz 2024-03-09T15:12:57.904 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.144327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144327.log.gz 2024-03-09T15:12:57.904 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119226.log 2024-03-09T15:12:57.904 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.66498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40394.log 2024-03-09T15:12:57.904 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.119226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129873.log 2024-03-09T15:12:57.904 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67732.log.gz 2024-03-09T15:12:57.905 INFO:teuthology.orchestra.run.smithi088.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.119226.log.gz 2024-03-09T15:12:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107965.log 2024-03-09T15:12:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40394.log.gz 2024-03-09T15:12:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129873.log: gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-03-09T15:12:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.107965.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.129873.log.gz 2024-03-09T15:12:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41202.log 2024-03-09T15:12:57.905 INFO:teuthology.orchestra.run.smithi088.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.107965.log.gz 2024-03-09T15:12:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74315.log 2024-03-09T15:12:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/valgrind/ceph.client.0.log: /var/log/ceph/ceph-client.admin.41202.log: 61.8% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-03-09T15:12:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143913.log 2024-03-09T15:12:57.906 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41202.log.gz 2024-03-09T15:12:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.74315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113855.log 2024-03-09T15:12:57.906 INFO:teuthology.orchestra.run.smithi088.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.74315.log.gz 2024-03-09T15:12:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.143913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143913.log.gz 2024-03-09T15:12:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82049.log 2024-03-09T15:12:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.113855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56176.log 2024-03-09T15:12:57.907 INFO:teuthology.orchestra.run.smithi088.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.113855.log.gz 2024-03-09T15:12:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.82049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40398.log 2024-03-09T15:12:57.907 INFO:teuthology.orchestra.run.smithi088.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.82049.log.gz 2024-03-09T15:12:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39690.log 2024-03-09T15:12:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56176.log: /var/log/ceph/ceph-client.admin.40398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144051.log 2024-03-09T15:12:57.907 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40398.log.gz 2024-03-09T15:12:57.907 INFO:teuthology.orchestra.run.smithi088.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.56176.log.gz 2024-03-09T15:12:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.39690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.139477.log 2024-03-09T15:12:57.908 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39690.log.gz 2024-03-09T15:12:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.144051.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.66498.log.gz 2024-03-09T15:12:57.908 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144051.log.gz 2024-03-09T15:12:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128049.log 2024-03-09T15:12:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.139477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57402.log 2024-03-09T15:12:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.128049.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.139477.log.gz 2024-03-09T15:12:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118637.log 2024-03-09T15:12:57.908 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.57402.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.128049.log.gz 2024-03-09T15:12:57.909 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40042.log 2024-03-09T15:12:57.909 INFO:teuthology.orchestra.run.smithi088.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.57402.log.gz 2024-03-09T15:12:57.909 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.118637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118000.log 2024-03-09T15:12:57.909 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40042.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.118637.log.gz 2024-03-09T15:12:57.909 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144373.log 2024-03-09T15:12:57.909 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40042.log.gz 2024-03-09T15:12:57.909 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.118000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65264.log 2024-03-09T15:12:57.909 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.144373.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118000.log.gz 2024-03-09T15:12:57.909 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60984.log 2024-03-09T15:12:57.910 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144373.log.gz 2024-03-09T15:12:57.910 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.65264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40407.log 2024-03-09T15:12:57.910 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.60984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112088.log 2024-03-09T15:12:57.910 INFO:teuthology.orchestra.run.smithi088.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.60984.log.gz 2024-03-09T15:12:57.910 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.137650.log 2024-03-09T15:12:57.910 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40407.log.gz 2024-03-09T15:12:57.910 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.112088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39646.log 2024-03-09T15:12:57.910 INFO:teuthology.orchestra.run.smithi088.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.112088.log.gz 2024-03-09T15:12:57.911 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.137650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102075.log 2024-03-09T15:12:57.911 INFO:teuthology.orchestra.run.smithi088.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.137650.log.gz 2024-03-09T15:12:57.911 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54409.log 2024-03-09T15:12:57.911 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.39646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39646.log.gz 2024-03-09T15:12:57.911 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.102075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81460.log 2024-03-09T15:12:57.911 INFO:teuthology.orchestra.run.smithi088.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.102075.log.gz 2024-03-09T15:12:57.911 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103253.log 2024-03-09T15:12:57.911 INFO:teuthology.orchestra.run.smithi088.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.54409.log.gz 2024-03-09T15:12:57.912 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.81460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99719.log 2024-03-09T15:12:57.912 INFO:teuthology.orchestra.run.smithi088.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.81460.log.gz 2024-03-09T15:12:57.912 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51440.log 2024-03-09T15:12:57.912 INFO:teuthology.orchestra.run.smithi088.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.103253.log.gz 2024-03-09T15:12:57.912 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.99719.log: /var/log/ceph/ceph-client.admin.118613.log 2024-03-09T15:12:57.912 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68966.log 2024-03-09T15:12:57.912 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51440.log.gz 2024-03-09T15:12:57.912 INFO:teuthology.orchestra.run.smithi088.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.99719.log.gz 2024-03-09T15:12:57.912 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.118613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49060.log 2024-03-09T15:12:57.913 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118613.log.gz 2024-03-09T15:12:57.913 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.68966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144097.log 2024-03-09T15:12:57.913 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40771.log 2024-03-09T15:12:57.913 INFO:teuthology.orchestra.run.smithi088.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.49060.log.gz 2024-03-09T15:12:57.913 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.144097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143591.log 2024-03-09T15:12:57.913 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144097.log.gz 2024-03-09T15:12:57.913 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.123082.log 2024-03-09T15:12:57.913 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40771.log.gz 2024-03-09T15:12:57.914 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.143591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143591.log.gz 2024-03-09T15:12:57.914 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144281.log 2024-03-09T15:12:57.914 INFO:teuthology.orchestra.run.smithi088.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.65264.log.gz 2024-03-09T15:12:57.914 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121041.log 2024-03-09T15:12:57.914 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.123082.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.68966.log.gz 2024-03-09T15:12:57.914 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.144281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116822.log 2024-03-09T15:12:57.914 INFO:teuthology.orchestra.run.smithi088.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.123082.log.gz 2024-03-09T15:12:57.914 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144281.log.gz 2024-03-09T15:12:57.915 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.121041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70200.log 2024-03-09T15:12:57.915 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.116822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109143.log 2024-03-09T15:12:57.915 INFO:teuthology.orchestra.run.smithi088.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.121041.log.gz 2024-03-09T15:12:57.915 INFO:teuthology.orchestra.run.smithi088.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.116822.log.gz 2024-03-09T15:12:57.915 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.70200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59169.log 2024-03-09T15:12:57.915 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.109143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88528.log 2024-03-09T15:12:57.915 INFO:teuthology.orchestra.run.smithi088.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.109143.log.gz 2024-03-09T15:12:57.915 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.59169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87350.log 2024-03-09T15:12:57.916 INFO:teuthology.orchestra.run.smithi088.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.59169.log.gz 2024-03-09T15:12:57.916 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.88528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144005.log 2024-03-09T15:12:57.916 INFO:teuthology.orchestra.run.smithi088.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.88528.log.gz 2024-03-09T15:12:57.916 INFO:teuthology.orchestra.run.smithi088.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.70200.log.gz 2024-03-09T15:12:57.916 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.87350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90884.log 2024-03-09T15:12:57.916 INFO:teuthology.orchestra.run.smithi088.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.87350.log.gz 2024-03-09T15:12:57.916 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.144005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41922.log 2024-03-09T15:12:57.916 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144005.log.gz 2024-03-09T15:12:57.917 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.90884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33719.log 2024-03-09T15:12:57.917 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.41922.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.90884.log.gz 2024-03-09T15:12:57.917 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106198.log 2024-03-09T15:12:57.917 INFO:teuthology.orchestra.run.smithi088.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.41922.log.gz 2024-03-09T15:12:57.917 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.33719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144189.log 2024-03-09T15:12:57.917 INFO:teuthology.orchestra.run.smithi088.stderr: 28.5% -- replaced with /var/log/ceph/ceph-client.admin.33719.log.gz 2024-03-09T15:12:57.917 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.106198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65881.log 2024-03-09T15:12:57.917 INFO:teuthology.orchestra.run.smithi088.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.106198.log.gz 2024-03-09T15:12:57.918 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.144189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64647.log 2024-03-09T15:12:57.918 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144189.log.gz 2024-03-09T15:12:57.918 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.65881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89117.log 2024-03-09T15:12:57.918 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.64647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75075.log 2024-03-09T15:12:57.918 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.89117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143683.log 2024-03-09T15:12:57.918 INFO:teuthology.orchestra.run.smithi088.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.89117.log.gz 2024-03-09T15:12:57.918 INFO:teuthology.orchestra.run.smithi088.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.64647.log.gz 2024-03-09T15:12:57.918 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143867.log 2024-03-09T15:12:57.919 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.75075.log: /var/log/ceph/ceph-client.admin.143683.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-09T15:12:57.919 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143683.log.gz 2024-03-09T15:12:57.919 INFO:teuthology.orchestra.run.smithi088.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.75075.log.gz 2024-03-09T15:12:57.919 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.143867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.137041.log 2024-03-09T15:12:57.919 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143867.log.gz 2024-03-09T15:12:57.919 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115033.log 2024-03-09T15:12:57.919 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.137041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68349.log 2024-03-09T15:12:57.919 INFO:teuthology.orchestra.run.smithi088.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.137041.log.gz 2024-03-09T15:12:57.920 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.115033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86761.log 2024-03-09T15:12:57.920 INFO:teuthology.orchestra.run.smithi088.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.115033.log.gz 2024-03-09T15:12:57.920 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62246.log 2024-03-09T15:12:57.920 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.68349.log: /var/log/ceph/ceph-client.admin.86761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54998.log 2024-03-09T15:12:57.920 INFO:teuthology.orchestra.run.smithi088.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.86761.log.gz 2024-03-09T15:12:57.920 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.62246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40776.log 2024-03-09T15:12:57.920 INFO:teuthology.orchestra.run.smithi088.stderr: 50.9% -- replaced with /var/log/ceph/ceph-client.admin.62246.log.gz 2024-03-09T15:12:57.920 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40028.log 2024-03-09T15:12:57.920 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54998.log: /var/log/ceph/ceph-client.admin.40776.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40776.log.gz 2024-03-09T15:12:57.921 INFO:teuthology.orchestra.run.smithi088.stderr: -5 84.1% -- replaced with /var/log/ceph/ceph-client.admin.54998.log.gz 2024-03-09T15:12:57.921 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53820.log 2024-03-09T15:12:57.921 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.142959.log 2024-03-09T15:12:57.921 INFO:teuthology.orchestra.run.smithi088.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.65881.log.gz 2024-03-09T15:12:57.921 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40028.log.gz 2024-03-09T15:12:57.921 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53820.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-09T15:12:57.921 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46656.log 2024-03-09T15:12:57.921 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.142959.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.53820.log.gz 2024-03-09T15:12:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93240.log 2024-03-09T15:12:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109732.log 2024-03-09T15:12:57.922 INFO:teuthology.orchestra.run.smithi088.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.46656.log.gz 2024-03-09T15:12:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.93240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126077.log 2024-03-09T15:12:57.922 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.109732.log: gzip 84.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.93240.log.gz --verbose 2024-03-09T15:12:57.922 INFO:teuthology.orchestra.run.smithi088.stderr: -- /var/log/ceph/ceph-client.admin.101486.log 2024-03-09T15:12:57.922 INFO:teuthology.orchestra.run.smithi088.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.109732.log.gz 2024-03-09T15:12:57.923 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.126077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95596.log 2024-03-09T15:12:57.923 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.101486.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.142959.log.gz 2024-03-09T15:12:57.923 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76449.log 2024-03-09T15:12:57.923 INFO:teuthology.orchestra.run.smithi088.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.101486.log.gz 2024-03-09T15:12:57.923 INFO:teuthology.orchestra.run.smithi088.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.126077.log.gz 2024-03-09T15:12:57.923 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.95596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75684.log 2024-03-09T15:12:57.923 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.76449.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.95596.log.gz 2024-03-09T15:12:57.923 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98541.log 2024-03-09T15:12:57.924 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.75684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51416.log 2024-03-09T15:12:57.924 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.98541.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.75684.log.gz 2024-03-09T15:12:57.924 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131531.log 2024-03-09T15:12:57.924 INFO:teuthology.orchestra.run.smithi088.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.98541.log.gz 2024-03-09T15:12:57.924 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42525.log 2024-03-09T15:12:57.924 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51416.log.gz 2024-03-09T15:12:57.924 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.131531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89706.log 2024-03-09T15:12:57.924 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.42525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103842.log 2024-03-09T15:12:57.925 INFO:teuthology.orchestra.run.smithi088.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.131531.log.gz 2024-03-09T15:12:57.925 INFO:teuthology.orchestra.run.smithi088.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.42525.log.gz 2024-03-09T15:12:57.925 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.89706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144511.log 2024-03-09T15:12:57.925 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120452.log 2024-03-09T15:12:57.925 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.103842.log: 92.2%/var/log/ceph/ceph-client.admin.144511.log: -- replaced with /var/log/ceph/ceph-client.0.76449.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40034.log 2024-03-09T15:12:57.925 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-03-09T15:12:57.925 INFO:teuthology.orchestra.run.smithi088.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.103842.log.gz 2024-03-09T15:12:57.925 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144511.log.gz 2024-03-09T15:12:57.926 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41070.log 2024-03-09T15:12:57.926 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120452.log.gz 2024-03-09T15:12:57.926 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121630.log 2024-03-09T15:12:57.926 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40034.log.gz 2024-03-09T15:12:57.926 INFO:teuthology.orchestra.run.smithi088.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.89706.log.gz 2024-03-09T15:12:57.926 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116233.log 2024-03-09T15:12:57.926 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41070.log.gz 2024-03-09T15:12:57.926 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.121630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96185.log 2024-03-09T15:12:57.927 INFO:teuthology.orchestra.run.smithi088.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.121630.log.gz 2024-03-09T15:12:57.927 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.141304.log 2024-03-09T15:12:57.927 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.116233.log: /var/log/ceph/ceph-client.admin.96185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.135214.log 2024-03-09T15:12:57.927 INFO:teuthology.orchestra.run.smithi088.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.116233.log.gz 2024-03-09T15:12:57.927 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.141304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85583.log 2024-03-09T15:12:57.927 INFO:teuthology.orchestra.run.smithi088.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.0.141304.log.gz 2024-03-09T15:12:57.927 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.135214.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-09T15:12:57.927 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63265.log 2024-03-09T15:12:57.928 INFO:teuthology.orchestra.run.smithi088.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.135214.log.gz 2024-03-09T15:12:57.928 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.85583.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40036.log 2024-03-09T15:12:57.928 INFO:teuthology.orchestra.run.smithi088.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.85583.log.gz 2024-03-09T15:12:57.928 INFO:teuthology.orchestra.run.smithi088.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.96185.log.gz 2024-03-09T15:12:57.928 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.63265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62136.log 2024-03-09T15:12:57.928 INFO:teuthology.orchestra.run.smithi088.stderr: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.63265.log.gz 2024-03-09T15:12:57.928 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.133996.log 2024-03-09T15:12:57.928 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40036.log.gz 2024-03-09T15:12:57.928 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.62136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97952.log 2024-03-09T15:12:57.929 INFO:teuthology.orchestra.run.smithi088.stderr: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.62136.log.gz 2024-03-09T15:12:57.929 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.133996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92651.log 2024-03-09T15:12:57.929 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97952.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.133996.log.gz 2024-03-09T15:12:57.929 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39828.log 2024-03-09T15:12:57.929 INFO:teuthology.orchestra.run.smithi088.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.97952.log.gz 2024-03-09T15:12:57.929 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.92651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40777.log 2024-03-09T15:12:57.929 INFO:teuthology.orchestra.run.smithi088.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.92651.log.gz 2024-03-09T15:12:57.929 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59806.log 2024-03-09T15:12:57.930 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.39828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39828.log.gz 2024-03-09T15:12:57.930 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40777.log.gz 2024-03-09T15:12:57.930 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129265.log 2024-03-09T15:12:57.930 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53231.log 2024-03-09T15:12:57.930 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.59806.log: /var/log/ceph/ceph-client.admin.129265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44340.log 2024-03-09T15:12:57.930 INFO:teuthology.orchestra.run.smithi088.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.59806.log.gz 2024-03-09T15:12:57.930 INFO:teuthology.orchestra.run.smithi088.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.129265.log.gz 2024-03-09T15:12:57.930 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77058.log 2024-03-09T15:12:57.930 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80871.log 2024-03-09T15:12:57.931 INFO:teuthology.orchestra.run.smithi088.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.53231.log.gz 2024-03-09T15:12:57.931 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.44340.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.44340.log.gz 2024-03-09T15:12:57.931 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.77058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41246.log 2024-03-09T15:12:57.931 INFO:teuthology.orchestra.run.smithi088.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.0.77058.log.gz 2024-03-09T15:12:57.931 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.80871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83816.log 2024-03-09T15:12:57.931 INFO:teuthology.orchestra.run.smithi088.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.80871.log.gz 2024-03-09T15:12:57.931 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56765.log 2024-03-09T15:12:57.931 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41246.log.gz 2024-03-09T15:12:57.932 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143775.log 2024-03-09T15:12:57.932 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.83816.log: /var/log/ceph/ceph-client.admin.56765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50827.log 2024-03-09T15:12:57.932 INFO:teuthology.orchestra.run.smithi088.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.83816.log.gz 2024-03-09T15:12:57.932 INFO:teuthology.orchestra.run.smithi088.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.56765.log.gz 2024-03-09T15:12:57.932 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.143775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106787.log 2024-03-09T15:12:57.932 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143775.log.gz 2024-03-09T15:12:57.932 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94418.log 2024-03-09T15:12:57.932 INFO:teuthology.orchestra.run.smithi088.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.50827.log.gz 2024-03-09T15:12:57.933 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.106787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99130.log 2024-03-09T15:12:57.933 INFO:teuthology.orchestra.run.smithi088.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.106787.log.gz 2024-03-09T15:12:57.933 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.94418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48423.log 2024-03-09T15:12:57.933 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.99130.log: gzip 87.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.94418.log.gz -- 2024-03-09T15:12:57.933 INFO:teuthology.orchestra.run.smithi088.stderr: /var/log/ceph/ceph-client.0.132169.log 2024-03-09T15:12:57.933 INFO:teuthology.orchestra.run.smithi088.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.99130.log.gz 2024-03-09T15:12:57.933 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52642.log 2024-03-09T15:12:57.933 INFO:teuthology.orchestra.run.smithi088.stderr: 83.9%/var/log/ceph/ceph-client.0.132169.log: -- replaced with /var/log/ceph/ceph-client.admin.48423.log.gz 2024-03-09T15:12:57.934 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58580.log 2024-03-09T15:12:57.934 INFO:teuthology.orchestra.run.smithi088.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.0.132169.log.gz 2024-03-09T15:12:57.934 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.142254.log 2024-03-09T15:12:57.934 INFO:teuthology.orchestra.run.smithi088.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.52642.log.gz 2024-03-09T15:12:57.934 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.58580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73134.log 2024-03-09T15:12:57.934 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124339.log 2024-03-09T15:12:57.934 INFO:teuthology.orchestra.run.smithi088.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.58580.log.gz 2024-03-09T15:12:57.934 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.142254.log: /var/log/ceph/ceph-client.admin.73134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144605.log 2024-03-09T15:12:57.935 INFO:teuthology.orchestra.run.smithi088.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.142254.log.gz 2024-03-09T15:12:57.935 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124339.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27598.log 2024-03-09T15:12:57.935 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.144605.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.73134.log.gz 2024-03-09T15:12:57.935 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144605.log.gz 2024-03-09T15:12:57.935 INFO:teuthology.orchestra.run.smithi088.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.124339.log.gz 2024-03-09T15:12:57.935 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.140086.log 2024-03-09T15:12:57.935 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.tmp-client.admin.27598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144235.log 2024-03-09T15:12:57.935 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27598.log.gz 2024-03-09T15:12:57.935 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.140086.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-09T15:12:57.936 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.144235.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.140086.log.gz 2024-03-09T15:12:57.936 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34176.log 2024-03-09T15:12:57.936 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144235.log.gz 2024-03-09T15:12:57.936 INFO:teuthology.orchestra.run.smithi088.stderr:gzip/var/log/ceph/ceph-osd.3.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.70862.log 2024-03-09T15:12:57.936 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144419.log 2024-03-09T15:12:57.936 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34176.log.gz 2024-03-09T15:12:57.936 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.70862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49036.log 2024-03-09T15:12:57.936 INFO:teuthology.orchestra.run.smithi088.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.70862.log.gz 2024-03-09T15:12:57.937 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.144419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43737.log 2024-03-09T15:12:57.937 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144419.log.gz 2024-03-09T15:12:57.937 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119815.log 2024-03-09T15:12:57.937 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49036.log: 0.0% 95.1% -- replaced with /var/log/ceph/ceph-client.admin.68349.log.gz 2024-03-09T15:12:57.937 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49036.log.gz 2024-03-09T15:12:57.937 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.43737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40775.log 2024-03-09T15:12:57.937 INFO:teuthology.orchestra.run.smithi088.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.43737.log.gz 2024-03-09T15:12:57.937 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47245.log 2024-03-09T15:12:57.937 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.119815.log: /var/log/ceph/ceph-client.admin.40775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40408.log 2024-03-09T15:12:57.938 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% 86.9% -- replaced with /var/log/ceph/ceph-client.admin.119815.log.gz 2024-03-09T15:12:57.938 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40775.log.gz 2024-03-09T15:12:57.938 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144465.log 2024-03-09T15:12:57.938 INFO:teuthology.orchestra.run.smithi088.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.47245.log.gz 2024-03-09T15:12:57.938 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143637.log 2024-03-09T15:12:57.938 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40408.log.gz 2024-03-09T15:12:57.938 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.144465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84994.log 2024-03-09T15:12:57.938 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144465.log.gz 2024-03-09T15:12:57.939 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.143637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143959.log 2024-03-09T15:12:57.939 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143637.log.gz 2024-03-09T15:12:57.939 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.84994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95007.log 2024-03-09T15:12:57.939 INFO:teuthology.orchestra.run.smithi088.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.84994.log.gz 2024-03-09T15:12:57.939 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.143959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74906.log 2024-03-09T15:12:57.939 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143959.log.gz 2024-03-09T15:12:57.939 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.95007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64030.log 2024-03-09T15:12:57.939 INFO:teuthology.orchestra.run.smithi088.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.95007.log.gz 2024-03-09T15:12:57.939 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.74906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93829.log 2024-03-09T15:12:57.940 INFO:teuthology.orchestra.run.smithi088.stderr: 25.0% -- replaced with /var/log/ceph/ceph-client.admin.74906.log.gz 2024-03-09T15:12:57.940 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.64030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100308.log 2024-03-09T15:12:57.940 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.93829.log: gzip -5 --verbose 81.7% -- -- replaced with /var/log/ceph/ceph-client.admin.93829.log.gz 2024-03-09T15:12:57.940 INFO:teuthology.orchestra.run.smithi088.stderr: /var/log/ceph/ceph-client.admin.40040.log 2024-03-09T15:12:57.940 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.100308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144651.log 2024-03-09T15:12:57.940 INFO:teuthology.orchestra.run.smithi088.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.100308.log.gz 2024-03-09T15:12:57.940 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40040.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.40040.log.gz /var/log/ceph/ceph-client.admin.128657.log 2024-03-09T15:12:57.940 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-03-09T15:12:57.941 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.144651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79104.log 2024-03-09T15:12:57.941 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144651.log.gz 2024-03-09T15:12:57.941 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.128657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69583.log 2024-03-09T15:12:57.941 INFO:teuthology.orchestra.run.smithi088.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.128657.log.gz 2024-03-09T15:12:57.941 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.79104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.135823.log 2024-03-09T15:12:57.941 INFO:teuthology.orchestra.run.smithi088.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.79104.log.gz 2024-03-09T15:12:57.941 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.69583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40409.log 2024-03-09T15:12:57.941 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.135823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59758.log 2024-03-09T15:12:57.942 INFO:teuthology.orchestra.run.smithi088.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.135823.log.gz 2024-03-09T15:12:57.942 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40409.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92062.log 2024-03-09T15:12:57.942 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40409.log.gz 2024-03-09T15:12:57.942 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.59758.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-03-09T15:12:57.942 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59758.log.gz 2024-03-09T15:12:57.942 INFO:teuthology.orchestra.run.smithi088.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.69583.log.gz 2024-03-09T15:12:57.942 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43134.log 2024-03-09T15:12:57.942 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.92062.log: /var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34046.log 2024-03-09T15:12:57.943 INFO:teuthology.orchestra.run.smithi088.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.92062.log.gz 2024-03-09T15:12:57.943 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-09T15:12:57.943 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.43134.log: /var/log/ceph/ceph-client.admin.34046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.140695.log 2024-03-09T15:12:57.943 INFO:teuthology.orchestra.run.smithi088.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.43134.log.gz 2024-03-09T15:12:57.943 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34046.log.gz 2024-03-09T15:12:57.943 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.133387.log 2024-03-09T15:12:57.943 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.140695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120404.log 2024-03-09T15:12:57.943 INFO:teuthology.orchestra.run.smithi088.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.140695.log.gz 2024-03-09T15:12:57.944 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.133387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117411.log 2024-03-09T15:12:57.944 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120404.log.gz 2024-03-09T15:12:57.944 INFO:teuthology.orchestra.run.smithi088.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.0.133387.log.gz 2024-03-09T15:12:57.944 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105609.log 2024-03-09T15:12:57.944 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.117411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78515.log 2024-03-09T15:12:57.944 INFO:teuthology.orchestra.run.smithi088.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.117411.log.gz 2024-03-09T15:12:57.944 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.105609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40774.log 2024-03-09T15:12:57.944 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.78515.log: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-03-09T15:12:57.944 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105609.log.gz 2024-03-09T15:12:57.945 INFO:teuthology.orchestra.run.smithi088.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.78515.log.gz 2024-03-09T15:12:57.945 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40610.log 2024-03-09T15:12:57.945 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40774.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91473.log 2024-03-09T15:12:57.945 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40774.log.gz 2024-03-09T15:12:57.945 INFO:teuthology.orchestra.run.smithi088.stderr:gzip/var/log/ceph/ceph-client.admin.40610.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40610.log.gz 2024-03-09T15:12:57.945 INFO:teuthology.orchestra.run.smithi088.stderr: /var/log/ceph/ceph-client.admin.144695.log 2024-03-09T15:12:57.945 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.91473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144143.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91473.log.gz 2024-03-09T15:12:57.945 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-03-09T15:12:57.946 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.144695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144695.log.gz 2024-03-09T15:12:57.946 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40778.log 2024-03-09T15:12:57.946 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.144143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144143.log.gz 2024-03-09T15:12:57.946 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79693.log 2024-03-09T15:12:57.946 INFO:teuthology.orchestra.run.smithi088.stderr:gzip/var/log/ceph/ceph-client.admin.40778.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50238.log 2024-03-09T15:12:57.946 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40778.log.gz 2024-03-09T15:12:57.946 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.79693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40772.log 2024-03-09T15:12:57.946 INFO:teuthology.orchestra.run.smithi088.stderr: 80.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52053.log 2024-03-09T15:12:57.947 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.79693.log.gz 2024-03-09T15:12:57.947 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50238.log: /var/log/ceph/ceph-client.admin.40772.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82638.log 2024-03-09T15:12:57.947 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40772.log.gz 2024-03-09T15:12:57.947 INFO:teuthology.orchestra.run.smithi088.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.50238.log.gz 2024-03-09T15:12:57.947 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39582.log 2024-03-09T15:12:57.947 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.82638.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.52053.log.gz 2024-03-09T15:12:57.947 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115623.log 79.4% 2024-03-09T15:12:57.947 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.82638.log.gz 2024-03-09T15:12:57.947 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.39582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39582.log.gz 2024-03-09T15:12:57.948 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-09T15:12:57.948 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.115623.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115623.log.gz 2024-03-09T15:12:57.948 INFO:teuthology.orchestra.run.smithi088.stderr: -- /var/log/ceph/ceph-client.admin.40978.log 2024-03-09T15:12:57.948 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61883.log 2024-03-09T15:12:57.948 INFO:teuthology.orchestra.run.smithi088.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.64030.log.gz 2024-03-09T15:12:57.948 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40978.log.gz 2024-03-09T15:12:57.948 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40039.log 2024-03-09T15:12:57.948 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.61883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59782.log 2024-03-09T15:12:57.949 INFO:teuthology.orchestra.run.smithi088.stderr: 61.8% -- replaced with /var/log/ceph/ceph-client.admin.61883.log.gz/var/log/ceph/ceph-client.admin.40039.log: 2024-03-09T15:12:57.949 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118589.log 2024-03-09T15:12:57.949 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40039.log.gz 2024-03-09T15:12:57.949 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44943.log 2024-03-09T15:12:57.949 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.59782.log: 0.0%/var/log/ceph/ceph-client.admin.118589.log: -- replaced with /var/log/ceph/ceph-client.admin.59782.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77926.log 2024-03-09T15:12:57.949 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-03-09T15:12:57.949 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118589.log.gz 2024-03-09T15:12:57.949 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-03-09T15:12:57.949 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.44943.log: /var/log/ceph/ceph-client.admin.77926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62733.log 2024-03-09T15:12:57.950 INFO:teuthology.orchestra.run.smithi088.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.44943.log.gz 2024-03-09T15:12:57.950 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.77926.log.gz 2024-03-09T15:12:57.950 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40397.log 2024-03-09T15:12:57.950 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.62733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72542.log 2024-03-09T15:12:57.950 INFO:teuthology.orchestra.run.smithi088.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.62733.log.gz 2024-03-09T15:12:57.950 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40397.log.gz 2024-03-09T15:12:57.950 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130923.log 2024-03-09T15:12:57.950 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.72542.log: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.72542.log.gz 2024-03-09T15:12:57.951 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86172.log 2024-03-09T15:12:57.951 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130923.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-09T15:12:57.951 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.86172.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86172.log.gz 2024-03-09T15:12:57.951 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51464.log 2024-03-09T15:12:57.951 INFO:teuthology.orchestra.run.smithi088.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.130923.log.gz 2024-03-09T15:12:57.951 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40038.log 2024-03-09T15:12:57.951 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51464.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.51464.log.gz 2024-03-09T15:12:57.951 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-09T15:12:57.952 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40038.log.gz 2024-03-09T15:12:57.952 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.134605.log 2024-03-09T15:12:57.952 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.2.log: 93.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-09T15:12:57.952 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73724.log 2024-03-09T15:12:57.952 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.134605.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.134605.log.gz 2024-03-09T15:12:57.952 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57378.log 2024-03-09T15:12:57.952 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.73724.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.73724.log.gz 2024-03-09T15:12:57.952 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63441.log 2024-03-09T15:12:57.953 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.57378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57378.log.gz 2024-03-09T15:12:57.953 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111499.log 2024-03-09T15:12:57.953 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.63441.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.63441.log.gz 2024-03-09T15:12:57.953 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108554.log 2024-03-09T15:12:57.953 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.111499.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111499.log.gz 2024-03-09T15:12:57.953 INFO:teuthology.orchestra.run.smithi088.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gzgzip 2024-03-09T15:12:57.953 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.102664.log 2024-03-09T15:12:57.953 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114444.log 2024-03-09T15:12:57.953 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.108554.log: /var/log/ceph/ceph-client.admin.102664.log: 87.5% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108554.log.gz 2024-03-09T15:12:57.954 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102664.log.gz 2024-03-09T15:12:57.954 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71953.log 2024-03-09T15:12:57.954 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.114444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.132778.log 2024-03-09T15:12:57.954 INFO:teuthology.orchestra.run.smithi088.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.114444.log.gz 2024-03-09T15:12:57.954 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.71953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62606.log 2024-03-09T15:12:57.954 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.132778.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.71953.log.gz 2024-03-09T15:12:57.954 INFO:teuthology.orchestra.run.smithi088.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.132778.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.41313.log 2024-03-09T15:12:57.954 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-03-09T15:12:57.955 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-03-09T15:12:57.955 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.41313.log: /var/log/ceph/ceph-client.admin.62606.log: 95.8% -- replaced with /var/log/ceph/ceph-client.0.41313.log.gz 2024-03-09T15:12:57.955 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123731.log 2024-03-09T15:12:57.955 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41290.log 2024-03-09T15:12:57.955 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123731.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.123731.log.gz 2024-03-09T15:12:57.955 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62606.log.gz 2024-03-09T15:12:57.955 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107376.log 2024-03-09T15:12:57.955 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41290.log.gz 2024-03-09T15:12:57.955 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110910.log 2024-03-09T15:12:57.956 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.107376.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.107376.log.gz 2024-03-09T15:12:57.956 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100897.log 2024-03-09T15:12:57.956 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.110910.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.110910.log.gz 2024-03-09T15:12:57.956 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127293.log 2024-03-09T15:12:57.956 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.100897.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.100897.log.gz 2024-03-09T15:12:57.956 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67115.log 2024-03-09T15:12:57.956 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.127293.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.127293.log.gz 2024-03-09T15:12:57.956 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62452.log 2024-03-09T15:12:57.957 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.67115.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67115.log.gz 2024-03-09T15:12:57.957 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126685.log 2024-03-09T15:12:57.957 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.62452.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62452.log.gz 2024-03-09T15:12:57.957 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83227.log 2024-03-09T15:12:57.957 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.126685.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.126685.log.gz 2024-03-09T15:12:57.957 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60395.log 2024-03-09T15:12:57.957 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.83227.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.83227.log.gz 2024-03-09T15:12:57.957 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39736.log 2024-03-09T15:12:57.957 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.60395.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.60395.log.gz 2024-03-09T15:12:57.958 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113266.log 2024-03-09T15:12:57.958 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.39736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39736.log.gz 2024-03-09T15:12:57.958 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41024.log 2024-03-09T15:12:57.958 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.113266.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.113266.log.gz 2024-03-09T15:12:57.958 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40041.log 2024-03-09T15:12:57.958 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41024.log.gz 2024-03-09T15:12:57.958 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84405.log 2024-03-09T15:12:57.958 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40041.log.gz 2024-03-09T15:12:57.959 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40396.log 2024-03-09T15:12:57.959 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.84405.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.84405.log.gz 2024-03-09T15:12:57.959 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90295.log 2024-03-09T15:12:57.959 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40396.log.gz 2024-03-09T15:12:57.959 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.138259.log 2024-03-09T15:12:57.959 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.90295.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.90295.log.gz 2024-03-09T15:12:57.959 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40410.log 2024-03-09T15:12:57.959 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.138259.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.138259.log.gz 2024-03-09T15:12:57.960 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97363.log 2024-03-09T15:12:57.960 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40410.log.gz 2024-03-09T15:12:57.960 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-09T15:12:57.960 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.97363.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.97363.log.gz 2024-03-09T15:12:57.961 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mon.c.log: 94.4% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-03-09T15:12:58.226 INFO:teuthology.orchestra.run.smithi132.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-09T15:12:58.722 INFO:teuthology.orchestra.run.smithi088.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-09T15:12:58.828 INFO:teuthology.orchestra.run.smithi132.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-09T15:13:00.054 INFO:teuthology.orchestra.run.smithi088.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-09T15:13:01.001 INFO:teuthology.orchestra.run.smithi088.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-03-09T15:13:03.944 INFO:teuthology.orchestra.run.smithi088.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-09T15:13:06.272 INFO:teuthology.orchestra.run.smithi132.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-09T15:13:06.438 INFO:teuthology.orchestra.run.smithi132.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-09T15:13:06.747 INFO:teuthology.orchestra.run.smithi132.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-09T15:13:06.846 INFO:teuthology.orchestra.run.smithi088.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-09T15:13:09.352 INFO:teuthology.orchestra.run.smithi132.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-09T15:13:09.354 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-03-09T15:13:09.354 INFO:teuthology.orchestra.run.smithi132.stderr:real 0m11.603s 2024-03-09T15:13:09.354 INFO:teuthology.orchestra.run.smithi132.stderr:user 0m37.884s 2024-03-09T15:13:09.355 INFO:teuthology.orchestra.run.smithi132.stderr:sys 0m1.346s 2024-03-09T15:13:09.492 INFO:teuthology.orchestra.run.smithi088.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-09T15:13:15.991 INFO:teuthology.orchestra.run.smithi088.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-09T15:13:15.993 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-03-09T15:13:15.994 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m18.286s 2024-03-09T15:13:15.994 INFO:teuthology.orchestra.run.smithi088.stderr:user 0m50.066s 2024-03-09T15:13:15.994 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m1.901s 2024-03-09T15:13:15.994 INFO:tasks.ceph:Archiving logs... 2024-03-09T15:13:15.995 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484/remote/smithi088/log 2024-03-09T15:13:15.996 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-09T15:13:23.237 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484/remote/smithi132/log 2024-03-09T15:13:23.238 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-09T15:13:28.890 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-09T15:13:28.901 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-09T15:13:28.901 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-09T15:13:28.904 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-09T15:13:29.009 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-09T15:13:29.020 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-09T15:13:29.020 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-09T15:13:29.023 DEBUG:teuthology.orchestra.run.smithi132:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-09T15:13:29.049 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-03-09T15:13:29.052 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2024-03-09T15:13:29.054 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-09T15:13:29.054 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-03-09T15:13:29.054 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 48 +846us[ +846us] +/- 106ms 2024-03-09T15:13:29.054 INFO:teuthology.orchestra.run.smithi088.stdout:^* hv02.front.sepia.ceph.com 3 7 377 115 -856us[ -762us] +/- 61ms 2024-03-09T15:13:29.054 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 +643us[ +643us] +/- 67ms 2024-03-09T15:13:29.054 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T15:13:29.057 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-09T15:13:29.057 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-03-09T15:13:29.057 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 46 +819us[ +838us] +/- 107ms 2024-03-09T15:13:29.057 INFO:teuthology.orchestra.run.smithi132.stdout:^* hv02.front.sepia.ceph.com 3 6 377 46 -908us[ -889us] +/- 62ms 2024-03-09T15:13:29.058 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 +559us[ +578us] +/- 67ms 2024-03-09T15:13:29.058 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T15:13:29.059 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-09T15:13:29.085 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-09T15:13:29.085 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-09T15:13:29.096 DEBUG:teuthology.orchestra.run.smithi088:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-09T15:13:29.179 DEBUG:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-09T15:13:29.262 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-09T15:13:29.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T15:13:29.305 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-09T15:13:29.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T15:13:29.349 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-09T15:13:29.362 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-09T15:13:29.372 INFO:teuthology.task.internal:Duration was 3283.059545 seconds 2024-03-09T15:13:29.373 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-09T15:13:29.384 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-09T15:13:29.384 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-09T15:13:29.387 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-09T15:13:29.440 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-09T15:13:29.446 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-09T15:13:29.807 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-09T15:13:29.807 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2024-03-09T15:13:29.807 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-09T15:13:29.839 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi132.front.sepia.ceph.com 2024-03-09T15:13:29.839 DEBUG:teuthology.orchestra.run.smithi132:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-09T15:13:29.873 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-09T15:13:29.873 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-09T15:13:29.881 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-09T15:13:29.954 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-09T15:13:29.954 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-09T15:13:29.962 DEBUG:teuthology.orchestra.run.smithi132:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-09T15:13:30.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-09T15:13:30.116 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-09T15:13:30.116 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-09T15:13:30.155 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-09T15:13:30.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-09T15:13:30.208 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-09T15:13:30.210 DEBUG:teuthology.orchestra.run.smithi132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-09T15:13:30.246 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2024-03-09T15:13:30.272 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = core 2024-03-09T15:13:30.292 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-09T15:13:30.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T15:13:30.329 DEBUG:teuthology.orchestra.run.smithi132:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-09T15:13:30.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T15:13:30.358 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-09T15:13:30.373 INFO:teuthology.task.internal:Transferring archived files... 2024-03-09T15:13:30.374 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484/remote/smithi088 2024-03-09T15:13:30.375 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-09T15:13:30.425 DEBUG:teuthology.misc:Transferring archived files from smithi132:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484/remote/smithi132 2024-03-09T15:13:30.426 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-09T15:13:30.475 INFO:teuthology.task.internal:Removing archive directory... 2024-03-09T15:13:30.475 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-09T15:13:30.477 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-09T15:13:30.536 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-09T15:13:30.550 INFO:teuthology.task.internal:Not uploading archives. 2024-03-09T15:13:30.550 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-09T15:13:30.563 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-09T15:13:30.563 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-09T15:13:30.565 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-09T15:13:30.590 INFO:teuthology.orchestra.run.smithi088.stdout: 265300 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 9 15:13 /home/ubuntu/cephtest 2024-03-09T15:13:30.602 INFO:teuthology.orchestra.run.smithi132.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 9 15:13 /home/ubuntu/cephtest 2024-03-09T15:13:30.603 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-09T15:13:30.616 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-09T15:13:30.640 INFO:teuthology.nuke:Checking targets against current locks 2024-03-09T15:13:30.665 DEBUG:teuthology.nuke:shortname: smithi088 2024-03-09T15:13:30.666 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-09T15:13:30.690 DEBUG:teuthology.nuke:shortname: smithi132 2024-03-09T15:13:30.690 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-09T15:13:30.694 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-09 14:09:18.450602', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLdtrRT99sDurN4PmqBejSe8+hw5Kx40rgqwoN57B61MTNS+gxPUGjelnDy0ix9LAM9V6Hy+V216d7iKXZ+p8f8='} 2024-03-09T15:13:30.718 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588484', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-09 14:09:18.451697', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ7LiqayEOgfVyz0QeLjdO0Z/3ilRQWwBCs/yi1K4gMIDHnub5mWKmMowyZxsw1WoaTZc6Y46AvcIdZP2bJLO4o='} 2024-03-09T15:13:30.749 INFO:teuthology.orchestra.console.smithi088:Power off 2024-03-09T15:13:30.750 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-09T15:13:30.776 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-03-09T15:13:30.777 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:13:30.793 INFO:teuthology.orchestra.console.smithi132:Power off 2024-03-09T15:13:30.793 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-09T15:13:30.804 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-03-09T15:13:30.815 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2024-03-09T15:13:30.816 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:13:30.846 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-03-09T15:13:34.805 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:13:34.847 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:13:34.916 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-03-09T15:13:34.958 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-03-09T15:13:38.921 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:13:38.959 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:13:39.031 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-03-09T15:13:39.069 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-03-09T15:13:39.170 INFO:teuthology.orchestra.console.smithi132:Power off completed 2024-03-09T15:13:43.034 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:13:43.145 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-03-09T15:13:43.246 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-03-09T15:13:43.351 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 3283.0595450401306 failure_reason: 'Command failed (s3 tests against rgw) on smithi088 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m ''not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3''"' flavor: default owner: scheduled_cbodley@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=e4ad29ed51094e48bb75ebcdb3b9d191 status: fail success: false 2024-03-09T15:13:43.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T15:13:43.441 INFO:teuthology.run:FAIL